JP5909990B2 - Imaging apparatus and imaging method - Google Patents

Description

  The present invention relates to an image pickup apparatus and an image pickup method, and more particularly to an image pickup apparatus and an image pickup method capable of taking an image while correcting the bending distortion of a book.

  In recent years, with the widespread use of portable information terminals (tablet type portable terminals, electronic paper, etc.), an opportunity to digitize a paper book and take it in a portable information terminal (this digitization is also generally referred to as “self-catering”). Is increasing.

When a book is digitized, a flatbed scanner is used, but a digital camera can be digitized with a simpler operation.
However, when photographing a book with a digital camera, it is necessary to open the page on a desk or the like with the book reading surface as the top surface. At that time, the spread portion (binding portion) is curved and curved. There was a problem that it was difficult to see the contents printed on the copy. Also, when a book is placed in a spread state on a desk or the like and shot from above, the information of the acceleration sensor used for detecting the shooting direction (vertical and horizontal) when shooting a normal subject is based on the digital camera and the book. The relationship between the shooting directions cannot be detected. Furthermore, although there is a dedicated device (used for public library business etc.) as a device for reading books from the top surface, it requires a large area and is not suitable for personal use.

Here, as a conventional technique for photographing a book, Patent Document 1 (Japanese Patent Application Laid-Open No. 08-242347) discloses an invention relating to a basic configuration of a stationary book scanner, in order to detect a bending of a binding portion of a book. A configuration is disclosed in which a mirror is provided at a position where the side of a book is imaged on a document table. Further, the height of the document table is also detected.
However, the configuration described in Patent Document 1 has problems such as an increase in the size and cost of the apparatus because a detection means for detecting the bending of the binding portion is separately provided on the side of the book.

Further, in Patent Document 2 (Japanese Patent No. 4162501), when a book placed in a spread state is photographed by an imaging unit having a shape measuring unit that measures a three-dimensional shape of a subject, the detection result of the shape measuring unit is used. A configuration for detecting a binding portion of a book is disclosed. In the configuration described in Patent Document 2, zooming is performed so that the detected binding portion is enlarged, high-resolution imaging is performed, the image of the binding portion of the entire image is replaced, and further, the binding portion by the shape measurement unit The bending distortion is corrected to a plane from the detection result of the bending state.
However, the configuration described in Patent Document 2 has a configuration in which the imaging unit is fixed to a support base, resulting in poor portability and restrictions on the device configuration. Further, the shape measuring unit projects a predetermined pattern light by the light projecting means and detects a shape from the projection position, and therefore requires a device for projecting the predetermined pattern light, which increases the size and cost of the device. There are problems such as inviting. In addition, there is a problem that the data capacity is greatly increased because it is necessary to capture images with high resolution.

  The present invention has been made in view of the above-described problems in the prior art, and can correct a curved distortion of a book image without significantly increasing the data capacity, obtain an image with less distortion, and has excellent portability. It is an object of the present invention to provide an imaging apparatus and an imaging method that are small and low cost.

Imaging device according to the present invention in order to solve the above SL problem, an imaging device, an imaging lens system for forming an image of an object on the image sensor, the image generation means for generating image data from the signal of the imaging device Recording means for recording the image data; distance measuring means for measuring the distance of the subject by multipoint distance measurement to obtain distance measurement data; a book photographing mode for photographing a book as the subject; and the book photographing mode. Control means for correcting curvature distortion based on the distance measurement data obtained by the distance measurement means, and the distance measurement means according to the amount of change in distance in one direction in two dimensions. Then, the distance measurement data converted into different resolutions are acquired.
Further, in order to solve the above problems, an imaging method according to the present invention includes an image generation step of forming an image of a subject on an imaging device via a photographing lens system and generating image data from a signal of the imaging device; A recording step for recording the image data, a ranging step for measuring the distance of the subject at multiple points to obtain ranging data, a step for setting a book photographing mode for photographing a book as the subject, and the book photographing A control step of correcting the curvature distortion based on the distance measurement data acquired in the distance measurement step, and the distance change amount in one direction in two dimensions in the distance measurement step. The distance measurement data converted into different resolutions is acquired according to the above.

  According to the present invention, there is provided an imaging apparatus and an imaging method capable of correcting a curving distortion of a book image without acquiring a significant increase in data capacity, obtaining an image with less distortion, excellent in portability, small and low cost. can do.

It is a front view which shows the structural example in the digital camera as one Embodiment of the imaging device which concerns on this invention. It is a block diagram which shows the outline | summary of the system configuration | structure of the digital camera shown in FIG. It is a schematic sectional side view which shows the structure of the ranging part (ranging apparatus) with which the digital camera shown in FIG. 1 is provided. It is a schematic front view which shows the structure of the ranging part (ranging apparatus) with which the digital camera shown in FIG. 1 is provided. It is a figure for demonstrating the ranging principle in one Embodiment of the imaging device which concerns on this invention. (A): It is a figure which shows the book used as the shape where the binding part curved. (B): It is a perspective view which shows the distance image data of the book shown to (a). (C): It is a graph which shows the distance image data of the book shown to (a). (A): A distorted image before correction. (B): A corrected image with little distortion. It is explanatory drawing explaining the correction principle of the curvature distortion at the time of a book spread. It is explanatory drawing explaining the direction detection method of a book and an imaging device. It is a figure which shows the example of an image display using the direction detection result of a book and an imaging device. It is a flowchart which shows the processing flow in 1st Embodiment of the book photography mode of the imaging device which concerns on this invention. It is a flowchart which shows the processing flow in 2nd Embodiment of the book photography mode of the imaging device which concerns on this invention. It is a flowchart which shows the processing flow in 3rd Embodiment of the book photography mode of the imaging device which concerns on this invention.

  An image pickup apparatus according to the present invention includes an image pickup element 11, a photographing lens system 2 that forms an image of a subject on the image pickup element 11, an image generation unit 12 that generates image data from a signal from the image pickup element 11, and Recording means for recording image data, distance measuring means 3 for measuring the distance of the subject in a two-dimensional direction to obtain distance measurement data, and photography capable of setting a book photographing mode for photographing a book as the subject Comprising: a mode selection unit; and a control unit 14 that corrects the curvature distortion of the image data obtained by selecting the book photographing mode based on the distance measurement data acquired by the distance measurement unit 3. To do.

Here, a digital camera CX5 (manufactured by Ricoh Co., Ltd.) on which a distance measuring device using ultra-high speed and high precision AF technology is mounted has already been put on the market. This ultra-high speed and high-precision AF technology uses two image sensors out of a plurality of image sensors on the same substrate to perform distance measurement based on the principle of triangulation, and provides a two-dimensional distance image of a subject. Can be obtained.
In the present invention, the distance image (three-dimensional shape) is corrected by using the ultra-high-speed high-precision AF technology, etc., by measuring the distance image (three-dimensional shape) of a point where the binding portion is difficult to view when the user shoots the book in a spread state. By performing (stretching process), it can be converted into an easy-to-see image. At this time, it is preferable that the book photographing mode is provided in the photographing mode of the camera so that when the book photographing mode is selected, these processes are performed so that the non-book image can be photographed as usual. .
In the present invention, the distance image is used to detect the relative orientation between the book and the camera from the curving direction of the book, and when the image photographed in the book photographing mode is displayed, the relative orientation is detected. It is preferable that the display direction of the image can be changed.

Next, the imaging device and the imaging method according to the present invention will be described in more detail.
Although the embodiments described below are preferred embodiments of the present invention, various technically preferable limitations are attached thereto, but the scope of the present invention is intended to limit the present invention in the following description. Unless otherwise described, the present invention is not limited to these embodiments.

  FIG. 1 is a front view showing a configuration example of a digital camera as an embodiment of an imaging apparatus according to the present invention, and FIG. 2 is a block diagram showing an outline of a system configuration of the digital camera shown in FIG. 3 is a schematic sectional side view showing the configuration of the distance measuring unit (ranging device) provided in the digital camera shown in FIG. 1, and FIG. 4 is a distance measuring unit (measured by the digital camera shown in FIG. 1). It is a schematic front view which shows the structure of a distance apparatus.

(Appearance structure of digital camera)
As shown in FIG. 1, on the front (front) side of the digital camera 1 according to the present embodiment, a photographing lens system 2, a lens array 4 on the front side of a distance measuring device 3 as distance measuring means, and the like are arranged. Yes. On the surface of the lens array 4, a first distance measuring lens 5a and a second distance measuring lens 5b, which are arranged on the left and right sides at a predetermined interval, are integrally formed. The optical axes of the imaging lens system 2 and the first and second distance measuring lenses 5a and 5b are parallel to each other.

(System configuration of digital camera 1)
As shown in FIG. 2, the digital camera 1 has a photographing lens system 2 having a plurality of lens groups, a diaphragm unit 10 having a shutter function, and a subject image incident through the photographing lens system 2 formed on a light receiving surface. A CCD image sensor 11 serving as a solid-state image sensor, and a signal processing unit that is an image generation unit that captures an imaging signal (electric signal) output from each pixel of the CCD image sensor 11 and converts it into image data that can be displayed or recorded 12. Based on operation input information from the operation unit 13 (release button 7, shooting mode switching button 8 (see FIG. 1) which is a shooting mode selection means, etc.) 13, based on a control program stored in a ROM (not shown). The control unit 14 that performs system control and the like of the entire digital camera 1 and the image data of the subject being shot generated by the signal processing unit 12 are displayed. A liquid crystal monitor (LCD) 15 that is a display means for displaying image data read from a memory card 18 to be described later, a focus lens driving unit 16 that drives the focus lens group of the photographing lens system 2, and an aperture that drives the aperture unit 10. The unit driving unit 17 and the external measuring type distance measuring device 3 for measuring the distance to the subject are provided. The image data generated by the image processing unit 12 is recorded on a removable memory card 18 by a recording means (not shown).
The shooting mode switching button 8 can set a book shooting mode for shooting a book as a subject.

(Configuration of ranging device 3)
As shown in FIGS. 3 and 4, the distance measuring device 3 includes a housing 20 whose front side (front side, upper side in FIG. 3) is open, and the first and second sides on the front side of the housing 20. A rectangular lens array 4 made of a transparent resin material in which distance measuring lenses 5a and 5b are integrally formed in a row (left and right direction of the digital camera 1), and a rear surface side in the housing 20 facing the lens array 4 ( A thin plate-shaped image sensor substrate 21 disposed on the lower side of FIG. 3, planar (two-dimensional) ranging image sensors 22 a and 22 b disposed on the image sensor substrate 21, and the image sensor substrate 21. The circuit board 24 is provided on the back surface of the circuit board.

The pair of distance-measuring imaging elements 22a and 22b are arranged so as to face the first and second distance-measuring lenses 5a and 5b, respectively.
The planar light receiving surfaces of the distance measuring imaging elements 22a and 22b have the same size and the same number of pixels. In addition, a predetermined gap is provided between the distance measuring image sensors 22a and 22b.
The distance measuring image pickup devices 22a and 22b on the image pickup device substrate 21 are image pickup devices integrally formed on a semiconductor wafer by a known semiconductor process (in this embodiment, a CCD, but an image pickup device such as a CMOS). And a large number of light receiving elements (pixels) are arranged in a grid pattern.

The optical axes of the first and second ranging lenses 5a and 5b are parallel to each other, and the diagonal centers of the respective light receiving surfaces of the ranging imaging elements 22a and 22b and the respective lenses (first and second measuring lenses). The distance lenses 5a and 5b) are positioned so that their optical axes substantially coincide.
The first and second distance measuring lenses 5a and 5b allow subject light incident on the first and second distance measuring lenses 5a and 5b to form an image on the surfaces of the distance image sensors 22a and 22b. Has a focal length.
Further, the field angles of the first and second distance measuring lenses 5 a and 5 b are configured to be substantially the same as the field angle of the photographing lens system 2. As a result, the distance measuring device 3 can measure the entire screen corresponding to all the light receiving surfaces (imaging regions) of the CCD image sensor 11.

  The circuit board 24 is provided with a ranging calculation unit 25 and the like. The ranging calculation unit 25 takes in pixel output signals output from the pixels of the ranging imaging elements 22a and 22b, and performs ranging imaging. A distance (parallax) between subject images formed on the elements 22a and 22b is calculated, and a distance to the subject is calculated.

Here, the principle of distance measurement by the distance measuring device 3 will be briefly described in detail with reference to FIG. FIG. 5 is a diagram for explaining the principle of distance measurement in the embodiment of the imaging apparatus according to the present invention.
As shown in FIG. 5, in the subject image a1 obtained through the first distance measuring lens 5a and the subject image a2 obtained through the second distance measuring lens 5b, the same point on the subject A is only parallax Δ. The images are shifted and imaged on the surfaces of the distance measuring imaging elements 22a and 22b, respectively, and received by a plurality of light receiving elements (pixels) and converted into electric signals.
The parallax is Δ, the distance between the optical axes of the first and second distance measuring lenses 5a and 5b (base line length) is D, and the distance between the first and second distance measuring lenses 5a and 5b and the subject A is D. Is L, the focal lengths of the first and second distance measuring lenses 5a and 5b are f, and when L >> f, the following equation (1) is established.

      L = D · f / Δ Expression (1)

Therefore, since D and f are known, the parallax Δ is calculated by a known calculation method from the pixel output signals respectively output from the pixels (light receiving elements) of the ranging imaging elements 22a and 22b by the ranging arithmetic circuit 25. Is calculated, the distance L between the first and second distance measuring lenses 5a and 5b and the subject can be calculated.
If the distance (base line length) D between the optical axes of the first and second distance measuring lenses 5a and 5b is too short, the parallax Δ becomes small and the distance L to the subject cannot be accurately calculated.

  The distance measuring means in the present invention measures the distance by a distance measuring sensor having an optical system different from the above-described photographic lens system, and obtains distance measurement data by measuring the distance of the subject in a two-dimensional direction. It is not limited to things. In other words, distance measurement data may be obtained by ranging by a hill-climbing method using a subject image on the image sensor (a method of obtaining a contrast peak while slightly changing the focal length of the photographing lens). A part of the light beam may be guided to a plurality of line sensors, and the distance measurement data may be obtained by measuring the distance by the phase difference method.

(First embodiment of book photographing mode)
Next, a first embodiment of a book shooting mode that is a feature of the imaging apparatus according to the present invention will be described.
FIG. 6A is a view showing a book having a curved binding portion, FIG. 6B is a perspective view showing distance image data of the book shown in FIG. 6A, and FIG. ) Is a graph showing distance image data of the book shown in FIG.

  When the book is set in a spread state, the binding portion (the spread center of the book) is curved as shown in FIG. 6A, and the captured image is distorted. When the distance is measured by the distance measuring image sensor in this state, the right page in FIG. 6A is measured as the distance image data of each pixel shown in perspective in FIG. 6B. Since the curvature of the binding portion has a large change in the distance image with respect to one planar direction, a data amount is required in the Xa direction as shown in FIG. 6C, but in the Ya direction. Since there is little change in distance, a smaller amount of data is sufficient to correct distortion.

  In the present invention, the distance image obtained at the time of photographing can be recorded as distance measurement data by converting the data with high resolution in the direction where the change in distance is large and converting the data into low resolution in the direction where the change in distance is small. preferable. For example, by performing correction using the three-dimensional shape obtained in FIG. 6C, the distorted image before correction in FIG. 7A can be corrected to an image with less distortion in FIG. 7B. It becomes possible.

It should be noted that in the photographed image of the book, the only area where distortion correction is required is the book photography area, so that distortion correction of parts other than the book photography area (such as the document placement surface) is unnecessary.
Therefore, since the distance measurement data necessary for distortion correction is an area surrounded by the outer peripheral edge of the book, the area of the book is detected from the contrast with the background image, and from the obtained distance measurement data, the area of the book area is detected. Ranging data (ranging data of the area surrounded by the outer edge of the book) is extracted. And the curvature distortion of the area | region of a book mentioned later is correct | amended using the extracted ranging data (distance to the spread center of a book).

Here, correction of bending distortion will be described. The vertical extension process will be described with reference to FIG. The vertical distortion of the captured image is removed by the vertical expansion process. This expansion process is performed by calculating the expansion rate for each pixel column and mapping the pixels in each pixel column in the vertical direction according to the distance from the center line X0 of the image.
First, the distance in the depth direction of the image is obtained for each pixel row by the distance measuring image sensor. Here, if the subject is a book and is placed facing the imaging unit, the pixels in each column in the originally captured input image, that is, the vertical direction shown in FIG. Pixels aligned in should have the same depth distance. However, due to the influence of noise or the like, variation in the depth distance may be detected for each pixel. In this case, an average value between the pixels is obtained. When obtaining the average value, it is necessary to use only points on the subject, so pixels near the center of the image are used, or pixels whose height is a certain value or more are used. When the depth distance of each point on the subject corresponding to the Y axis (X0) of the image thus obtained is D0 and the depth distance of each point on the subject corresponding to the i-th column is Di, the following equation According to (2), the pixel position Pij1 of the j-th pixel row of the i-th pixel column is moved in the column direction and rearranged as Pij2.

      Pij2 = Pij1 · (Di / D0) (2)

  Due to the rearrangement process and the interpolation process between the pixels, the distortion in the vertical direction, that is, the difference in the distance between the image sensor and the subject (in the case of the spread state in which the book is opened, the binding portion shown in FIG. The document is curved with the fulcrum as the fulcrum, and as a result, the raised portion is obtained by removing distortion caused by the perspective factor due to a phenomenon that is closer to the imaging unit than other portions.

  Further, if the pixels in each row are extended by an appropriate amount in the direction, that is, the horizontal direction, the horizontal distortion can be removed. As shown in FIG. 8B, the pixels are rearranged in the row direction in accordance with the distance from the Y axis (X0) of the subject image, and the image is expanded in the horizontal direction. The specific method will be described below.

FIG. 8C shows the positions of the points on the subject in the three-dimensional position space corresponding to the pixels Pi0 to Pi3 in a certain pixel row by white circles (outlined circles). Here, Pi0 is a point on X0.
First, distances L01 to L23 between adjacent points in these points are obtained. Then, the position after the rearrangement of the pixels to be rearranged is determined as a distance from the center line X0 of the image by sequentially adding the scales together. For example, Pi3 is rearranged at a position of (L01 + L12 + L23) · f / F (moves from a black circle that is a pixel position before expansion to a gray circle that is a pixel position after expansion). Here, f is the focal length of the corresponding optical system, and F is the depth distance from the optical center to a point on the subject corresponding to the center point of the image.

  By the rearrangement process and the interpolation process between the pixels, an image from which lateral distortion is removed is generated. The image may be corrected so as to be enlarged or reduced as appropriate. In that case, the number of pixels may be increased or decreased uniformly by an appropriate coefficient at the time of correction.

By performing these processes, a result in which distortion is corrected as shown in FIG. 7B is obtained.
In other words, the image data obtained by selecting the book photographing mode by the control means is corrected for the curvature distortion based on the distance measurement data acquired by the distance measurement means, thereby obtaining an image in which the distortion is corrected.

A processing flow in the present invention is shown in FIG. When the camera is ready to shoot, and the book shooting mode is selected by the shooting mode switching dial (S1-1), the distance image (two-dimensional distance data) can be acquired by the distance measuring image sensor. (S1-2). In this state, image capturing starts (S1-3) and ends (S1-4) by shutter release, and then the obtained distance image is converted into distance measurement data necessary for correcting distortion of the book (S1- 5), the image data and the distance measurement data are associated with each other and stored by the recording means (S1-6).
Further, Exif (Exchangeable Image File Format) may be used as the image data format, and ranging data necessary for correcting the distortion of the book may be embedded and recorded. By embedding and recording the distance data acquired when the book is photographed by the imaging device, the problem that the image data and the distance data are separated and cannot be corrected does not occur.

As another embodiment, after (S1-5), the curvature distortion of the image data is corrected by the control means based on the distance measurement data necessary for the distortion correction of the book, and the corrected image data of the distortion distortion is obtained. You may record on a recording means. (S1-6 ′)
Recording the image data after correcting the curvature distortion eliminates the need to store the distance measurement data. Further, since the image data after correction of the curvature distortion is recorded, only the image after the correction of the curvature distortion is displayed when the image data is displayed, but each time the display is performed, the correction of the curvature distortion is performed by the control means. Less processing is required because there is no need to do so.

  As yet another embodiment, when the distortion of the book cannot be sufficiently detected from the detection result (ranging data) by the distance measuring sensor, the book is curved based on the print information (ruled lines, characters, etc.) of the book. You may provide the structure which detects and correct | amends distortion. This is also preferable because curvature distortion can be corrected even when distance measurement cannot be performed by the distance measurement sensor.

(Second embodiment of book shooting mode)
Next, a second embodiment of the book photographing mode that is a feature of the imaging apparatus according to the present invention will be described.
The second embodiment relates to a display method when the image acquired in the first embodiment is displayed by an image display means such as an LCD provided in an imaging apparatus. FIG. 12 shows a processing flow.
When the image display mode is selected in the imaging device and the display image is data photographed in the book photographing mode (S2-1), the corresponding distance measurement data is extracted (S2-2), and the above Correction based on the curvature distortion correction processing of the book described in the first embodiment is performed (S2-3), and a corrected image is displayed (S2-4).
According to the present embodiment, when a book image shot in the book shooting mode is played back, an image with less distortion with corrected curvature distortion can be automatically displayed.

  Although not shown here, there are a menu for saving the corrected image as it is, a menu for changing the display direction of the image, and the like, which may be operated by the user.

Further, in the processing flow shown in FIG. 13, when an image of a book is selected at the time of image display (S3-1), the user instructs the image correction instruction means whether or not to correct the distortion of the book (step S3-1). S3-2) Only when instructed to do so, distance measurement data is extracted (S3-3), the curvature distortion of the book is corrected (S3-4), and a corrected image is displayed (S3-5) You may make it let it. When the execution of the correction of the bending distortion of the book is not instructed, the image data as it is not corrected is displayed.
By making it possible to instruct the correction of the bending distortion, the correction process can be executed only for an image that needs to be corrected.

(Third embodiment of book shooting mode)
Next, a third embodiment of the book photographing mode that is a feature of the imaging apparatus according to the present invention will be described.
In the third embodiment, the relative position relationship between the book and the imaging device is determined by the determination unit based on the detection result of the curved shape of the book, and when the captured image data of the book is displayed, the orientation of the book (determination of the relative position relationship) Rotation is set so that the correct orientation is automatically displayed according to the screen.
By making it possible to automatically detect the direction between the book and the imaging device, it is possible to reproduce the book in the correct direction (the direction in which the book is read) when the image obtained by photographing the book is reproduced.
This process will be described in more detail with reference to FIGS.

When shooting a book to be the subject, there are a case where the camera is taken in landscape orientation (FIG. 9 (a) landscape photography) and a case where the camera is photographed in portrait orientation (FIG. 9 (b) portrait photography). When photographing a book, the book photographing mode described in the first and second embodiments is selected.
In the book photographing mode, a distance image can be acquired by a distance measuring image sensor, and distance measuring data necessary for correcting distortion of the book can be acquired. In the distance measurement data, the amount of change in the vertical direction and the amount of change in the horizontal direction of the image are calculated, and the direction in which the amount of change is large is recognized as the curving direction of the book (shown in bold lines in FIGS. 9A and 9B). The amount of change is a statistic that can quantitatively compare the amount of change, such as a variation (maximum-minimum) or standard deviation of the distance measurement data, and the magnitudes in the vertical and horizontal directions are compared.

  The shape of a two-page spread has a common feature that it is curved in the same direction with respect to the height direction at the two-page spread, and in many books, the direction orthogonal to the bending direction is the correct orientation for reading. It has become. The blue thick line in FIG. 9 is the curve direction, and the direction perpendicular to the “up” side (shown in FIG. 9) of the book. In this way, when the image is displayed as shown in FIG. 10 by recognizing the “up” side of the book from the curving direction and adding it to the image data, the “up” side is also the upper side on the image display means. By making it display on, the photographed book can be displayed in the correct orientation.

Similarly, when the binding portion is inclined halfway with respect to the horizontal and vertical directions (for example, inclined by 10 °), it is preferable that the binding portion is automatically corrected in the vertical direction.
In addition, since a calendar or the like turns a page up and down around the binding portion, it is preferable to set automatic rotation ON / OFF.

  According to the first to third embodiments described above, it is possible to correct the curving distortion of the book image without significantly increasing the data capacity and obtain an image with less distortion, and to have excellent portability, small size, and low cost. Can be achieved.

1 Digital camera (imaging device)
DESCRIPTION OF SYMBOLS 2 Shooting lens system 3 Distance measuring device 4 Lens array 5a 1st ranging lens 5b 2nd ranging lens 7 Release button 8 Shooting mode switch dial 11 CCD image sensor 12 Signal processing part 13 Operation part 14 Control part 15 LCD
16 Focus lens drive unit 17 Aperture unit drive unit 18 Memory card 20 Housing 21 Image sensor base 22a Distance image sensor 22b Distance image sensor 24 Circuit board 25 Distance calculation unit A Subject Δ Parallax L Distance lens Distance between the subject and the object f Focal distance D Distance between the optical axes (base line length)

Japanese Patent Laid-Open No. 08-242347 Japanese Patent No. 4162501

Claims (9)

An image sensor;
A taking lens system for forming an image of a subject on the image sensor;
Image generating means for generating image data from a signal of the image sensor;
Recording means for recording the image data;
Distance measuring means for measuring the distance of the subject in multiple points and obtaining distance measurement data;
A book shooting mode for shooting a book as the subject;
Control means for correcting the distortion of the image data obtained in the book photographing mode based on distance measurement data acquired by the distance measurement means;
The distance measuring means, in accordance with a change in distance with respect to one direction in two dimensions, an imaging apparatus characterized by obtaining the distance measurement data converted into different resolutions. Further comprising display means for displaying the image data,
The recording means records the image data generated from the signal of the imaging element in correspondence with the distance measurement data acquired by the distance measurement means,
When displaying the image data obtained in the book photographing mode, the control means reads the image data and the distance measurement data to correct the curvature distortion, and the display means corrects the curvature distortion. The imaging apparatus according to claim 1, wherein data is displayed. Image correction instruction means for instructing the control means to execute correction of curvature distortion of the image data;
When execution of correction of the curvature distortion of the image data is instructed by the image correction instruction means, the control means corrects the curvature distortion of the image data, and the display means corrects the curvature distortion. Display data,
When the execution of correction of the curvature distortion of the image data is not instructed by the image correction instruction means, the display means displays the image data without the control means correcting the curvature distortion of the image data. The imaging apparatus according to claim 2 , wherein: The imaging apparatus according to claim 1, wherein the recording unit records image data in which curvature distortion is corrected based on distance measurement data acquired by the control unit by the control unit. Wherein, in any one of claims 1 to 4, characterized in that to perform the correction of the curvature distortion based in a region surrounded by the edge portion of the outer periphery of the book to the distance to spread the center of the book The imaging device described. Wherein said control means includes a distance to spread the center of the book, the imaging device according to any one of claims 1 to 4, characterized in that to perform the correction of the curvature distortion based on the print information of the book. A display unit that displays the image data recorded by the recording unit; and a determination unit that determines a relative positional relationship between the imaging device and the book,
The image pickup apparatus according to claim 1, wherein the image data is displayed with a display direction automatically set based on determination by the determination unit. The distance measuring means measures a distance by a distance sensor having an optical system different from the photographing lens system, measures a distance by a hill-climbing method using a subject image on the image sensor, and the photographing lens The imaging apparatus according to claim 1 , wherein any one of the distance measuring methods is used in which a part of the light beam that has passed through the system is guided to a plurality of line sensors and is measured by a phase difference method. An image generation step of forming an image of a subject on an image sensor via a photographing lens system and generating image data from a signal of the image sensor;
A recording step for recording the image data;
A distance measuring step for measuring the distance of the subject by multipoint distance measurement and obtaining distance measurement data;
Setting a book shooting mode for shooting a book as the subject;
A control step of correcting image distortion obtained in the book photographing mode based on distance measurement data acquired by the distance measurement step;
In the distance measuring step, the distance measuring data converted into different resolutions is acquired according to a change amount of a distance in one direction in two dimensions.