JP4513580B2 - Image processing program and digital camera - Google Patents

Description

  The present invention relates to an image processing program for editing image data and a digital camera equipped with the image processing program.

  The following camera is known from Patent Document 1. This camera displays the size and angle of the subject in the viewfinder.

JP-A-4-326004

  However, according to the conventional camera, the camera must be equipped with a deflection angle sensor for detecting the angle of the subject existing in the viewfinder, and the photographer points the camera toward the subject and There has been a problem that the angle can be displayed only when the subject is shown on the screen.

The invention described in claim 1 is an image processing program to be executed by a computer, an image display process for displaying on a monitor a captured image obtained by capturing an image of a subject by an imaging optical system , and a display on the monitor A designation process for designating two points in the captured image , and converting the two points on the designated captured image into a first position and a second position on the image sensor, respectively, on the image sensor The first position information and the second position information, and the relative relationship between the image sensor and the rear node of the imaging optical system determined by the focal length of the imaging optical system and the imaging distance of the subject. Acquisition processing for acquiring relative position information indicating a specific position, a rear node of the photographing optical system and a first straight line connecting the first position, a rear node of the photographing optical system, and the second position Tie An angle between two straight lines, the said relative position information and the first positional information and the second position information and angle calculation process of calculating on the basis of acquired by the acquisition process, calculated by the angle calculation process And an angle display process for displaying the angle as an angle between two points on the real space corresponding to the two specified points as viewed from the photographing optical system .

  According to the present invention, the angle seen from the photographing lens in the real space between two points designated by the user on the image displayed on the monitor is calculated and displayed on the monitor. This makes it possible to calculate the angle between two points as viewed from the photographic lens in real space without separately mounting a deflection angle sensor for calculating the angle. Further, since the angle is calculated using the image after imaging, the angle between the two points viewed from the photographing lens can be calculated and presented to the user even when the camera is not directed toward the subject.

  FIG. 1 is a block diagram showing a configuration of an embodiment of an image processing apparatus according to the present embodiment. The image processing apparatus 100 includes, for example, a mouse 101 that is operated by a user using a personal computer, an HDD 102 that stores image data captured by a digital camera or the like that is an object of image processing, which will be described later, and an image processing program. A memory 103 as a work area for executing the image processing program, a CPU 104 for executing the image processing program, image data stored in the HDD 102, and a monitor 105 for displaying various data displayed by the image processing program And has.

  In the image processing apparatus 100 according to the present embodiment, an angle viewed from the photographing lens between any two points in the image captured by the user is calculated and displayed on the monitor 105. Thus, for example, when there are two different subjects in the image, the user designates one point on each of the two subjects, so that the user can see from the photographing lens in the image between the two points. Can know the angle. Thus, in order to calculate the angle seen from the photographing lens between any two points in the image, the user operates the mouse 101 and the photographing lens between any two points from the image stored in the HDD 102. Then, an image for which the angle viewed from is to be calculated is selected and displayed on the monitor 105. Then, the following processing is performed on the displayed target image.

  First, the user operates the mouse 101 to designate two arbitrary points whose angles are to be calculated on the target image displayed on the monitor 105. In the image processing apparatus 100 according to the present embodiment, when the user clicks the mouse 101 at an arbitrary position on the image displayed on the monitor 105, the click position can be designated as a point. By clicking the mouse 101 at two arbitrary positions, two arbitrary points whose angles are to be calculated can be designated on the target image.

  When two points are designated on the target image by the user, processing is executed as follows, and an angle between the two points is calculated by equations (1) to (13) described later. First, the positions of the two points designated on the target image by the user are converted into positions on the image sensor of the digital camera that captured the target image. As a result, the two points designated on the target image by the user are converted into positions A ′ and B ′ on the image sensor 2b, for example, as shown in FIG.

  In FIG. 2, the distance from the front node N of the lens 2a of the digital camera to the point O obtained by converting the front node N into the subject position, that is, the distance from the front node N to the subject is l. The distance from the rear node N ′ of the lens 2a to the point O ′ obtained by converting the rear node N ′ into a position on the image sensor, that is, the distance from the rear node N ′ to the image sensor 2b is l ′. . Then, ∠ANB = ω and ∠A′N′B ′ = ω ′, and the relationship of ω = ω ′ is established. Therefore, by calculating the angle seen from the photographic lens between two points on the image sensor, the angle seen from the photographic lens in the real space between the two points designated in the target image can be obtained.

  Here, the distance from the front node N of the lens 2a to the subject is l, and the distance l ′ from the rear node N ′ to the image sensor 2b differs depending on the type of the lens 2a, and is based on the photographing distance and the focal length. It can be calculated. Here, the shooting distance is measured together with shooting data such as a focal length by the digital camera at the time of shooting the target image, and is stored in the image data of the target image. A correspondence table of the shooting distance and focal length corresponding to the model of the lens 2a of the digital camera and the distances l and l 'is stored in the HDD 102 in advance, and the distances l and l' are calculated based on the correspondence table.

  FIG. 3 is a diagram clearly showing the positional relationship between two points A ′ and B ′ converted into positions on the image sensor 2b by enlarging the image sensor 2b side in FIG. In FIG. 3, the distances from the rear node N ′ of the lens 2a to the two points A ′ and B ′ are denoted by la and lb, respectively. A point indicating the horizontal distance from the point O ′ to the point A ′ is A′x, a point indicating the vertical distance is A′y, and the horizontal distance from the point O ′ to the point B ′ is A point to be indicated is B′x, and a point indicating a vertical distance is B′y.

FIG. 4 is a view of FIG. 3 described above as viewed from above, that is, from the direction of the arrow 3a. In FIG. 4, the length between the point O ′ and the point A′x is ax, the length between the point O ′ and the point B′x is bx, and the length between the rear side node N ′ and the point A′x. Is lah, and the length between the rear node N ′ and the point B′x is lbh. At this time, ∠A′xN′B′x, that is, if the horizontal angle of the two points A ′ and B ′ converted into positions on the image sensor is ωh, the horizontal angle ωh is expressed by the following equation (1) and Calculated by (2).
(Ax + bx) ² = lah ² + lbh ² −2 · lah · lbh · cosωh (1)
^{ωh = cos -1 ((lah 2} + lbh 2 - (ax + bx) 2) / (2 · lah · lbh)) ··· (2)

In formula (2), lah and lbh can be calculated by the following formulas (3) and (4). That is, since ∠N′O′A′x and ∠N′O′B′x are at right angles, the following equations (3) and (4) are established by the three-square theorem.
lah ² = l ′ ² + ax ² (3)
lbh ² = l ′ ² + bx ² (4)

FIG. 5 is a view of FIG. 3 as seen from the side, that is, from the direction of the arrow 3b. In FIG. 5, the length between the point O ′ and the point A′y is ay, the length between the point O ′ and the point B′y is by, and the length between the rear node N ′ and the point A′y. Is lav, and the length between the rear node N ′ and the point B′y is lbv. At this time, ∠A′yN′B′y, that is, if the vertical angle of the two points A ′ and B ′ converted into positions on the image sensor is ωv, the vertical angle ωv is expressed by the following equation (5) according to the cosine theorem. And (6).
(Ay + by) ² = lav ² + lbv ² −2 · lav · lbv · cos ωv (5)
ωv = cos ⁻¹ ((lav ² + lbv ² − (ay + by) ² ) / (2 · lav · lbv)) (6)

In equation (6), lav and lbv can be calculated by the following equations (7) and (8). That is, since ∠N′O′A′y and ∠N′O′B′y are at right angles, the following equations (7) and (8) are established by the three-square theorem.
lav ² = l ′ ² + ay ² (7)
lbv ² = l ′ ² + by ² (8)

The angle ω between A′B ′ in FIG. 3 is calculated by the following equations (9) and (10), where d is the distance between A′B ′.
d ² = la ² + lb ² −2 · la · lb · cos ω (9)
ω = cos ⁻¹ ((la ² + lb ² −d ² ) / (2 · la · lb)) (10)

In Expression (10), d can be calculated by the following Expression (11).
d ² = (ax + bx) ² + (ay + by) ² (11)
Moreover, la and lb can be calculated by the following equations (12) and (13). That is, in FIG. 3, ∠N′A′xA ′ and ∠N′B′xB ′ are at right angles, and therefore, the following equations (12) and (13) are established by equations (3) and (4). .
la ² = lah ² + ay ² = l ′ ² + ax ² + ay ² (12)
lb ² = lbh ² + by ² = l ′ ² + bx ² + by ² (13)

  The horizontal angle between A′B ′ calculated in the above formulas (2), (6), and (10) is ωh, the vertical angle is ωv, and the angle ω is between two points AB specified by the user. As a horizontal angle, a vertical angle, and an angle, it outputs on the monitor 105 as shown in FIG. Thus, the user can grasp the horizontal angle, the vertical angle, and the angle as viewed from the photographing lens between the two points AB designated on the target image.

In the image processing apparatus 100 according to the present embodiment, when the display of the distance D between the two points AB designated by the user is further instructed, the distance D between the two points AB is calculated and presented to the user. Can do. In FIG. 2 described above, the distance D between the two points AB can be calculated by multiplying the distance d between A′B ′ on the image sensor calculated by Expression (11) by 1 / l ′. That is, it can be calculated by the following equation (14).
D = d · l / l ′ (14)

Further, the horizontal distance Dh and the vertical distance Dv between the two points AB at this time can be calculated by the following equations (15) and (16).
Dh = (ax + bx) · l / l ′ (15)
Dv = (ay + by) · l / l ′ (16)

  Then, in addition to the angle display shown in FIG. 6, the distance D between the two points AB, the horizontal distance Dh, and the vertical distance Dv at the distance l calculated by the equations (14) to (16) are shown in FIG. As shown in FIG. Thus, the user can see the distance D between the two points AB at the distance l, the horizontal distance Dh, and the vertical distance together with the horizontal angle, the vertical angle, and the angle as viewed from the photographing lens between the two points AB designated on the target image. Dv can be grasped.

FIG. 8 is a flowchart showing the processing of the image processing program executed by the image processing apparatus 100 in the present embodiment. The image processing program is activated when the user gives an instruction to start image processing via the mouse 101 and is executed by the CPU 104 . In step S10, it is determined whether or not the user has operated the mouse 101 as described above to select a target image. If it is determined that the target image has been selected by the user, the process proceeds to step S20.

In step S20, it is determined whether or not two points are designated on the target image by a click operation of the mouse 101 on the monitor 105 by the user. If it is determined that two points are designated on the target image by the user, the process proceeds to step S30. In step S30, as described above, the horizontal angle ωh, the vertical angle ωv, and the angle ω viewed from the photographing lens between the two points AB are calculated by the equations (1) to (13), and the process proceeds to step S40. In step S40, it is determined whether or not the user has also instructed display of the distance between the two designated points AB.

  When it is determined that the display of the distance between the two points AB is not instructed by the user, the process proceeds to step S60, and the calculated horizontal angle ωh, vertical angle ωv, and angle ω viewed from the photographing lens between the two points AB are determined. As shown in FIG. 6, it is displayed on the monitor 105. On the other hand, if it is determined by the user that the display of the distance between the two points AB has been instructed, the process proceeds to step S50. In step S50, as described above, the distance D between the two points AB, the horizontal distance Dh, and the vertical distance Dv are calculated by the equations (14) to (16), and the process proceeds to step S60. The distance D, horizontal distance Dh, and vertical distance Dv are displayed on the monitor 105 as shown in FIG. Thereafter, the process ends.

According to the present embodiment described above, the following operational effects can be obtained.
(1) The position of two points designated on the target image by the user is converted into a position on the image sensor, and an angle seen from the photographing lens between the two points on the image sensor is calculated, and the real space is calculated. The angle viewed from the photographic lens between two points is presented to the user. Thus, the user can grasp the angle seen from the photographing lens between two points in the real space only by specifying two points on the target image.
(2) The angle seen from the photographic lens at two points on the image sensor was calculated using the cosine theorem or the three-square theorem to obtain the angle seen from the photographic lens between two points in real space. . Thus, it is not necessary to measure the angle when capturing the target image, and it is not necessary to mount an angle measuring device on the digital camera.
(3) Based on the distance to the subject included in the target image data, the distance between the two points in the distance to the subject is calculated and presented to the user. Thus, the user can grasp the distance between the two points as well as the angle viewed from the photographing lens between the two points.

-Modification-
The image processing apparatus according to the above-described embodiment can be modified as follows.
(1) In the above-described embodiment, the example in which the angle viewed from the photographing lens between two points designated by the user has been described. However, the present invention is not limited to this. For example, a point (center point) located at the center of the image is set, and the angle viewed from the photographing lens from the center point of the entire image, that is, all pixels on the image is calculated. Then, straight lines passing through the pixels having the same angle are drawn every predetermined angle, for example, every 10 degrees, in the horizontal direction and the vertical direction from the center point. As a result, as shown in FIG. 9, grid lines can be drawn at intervals of 10 degrees from the center 9a of the image, and the user can easily grasp the positional relationship of the subject in the image.

(2) In the above-described embodiment, an example has been described in which the angle viewed from the photographic lens between two points designated by the user is calculated, and the calculated angle is displayed on the monitor and presented to the user. However, the present invention is not limited to this, and map data is mounted on the image processing apparatus 100. For example, when a name on a map of a subject existing at any one of two designated points is designated, The angle seen from the taking lens with respect to the other one point is calculated. Then, the positional relationship on the map between the point whose name is specified in advance based on the calculated angle and the other point is grasped, and the name of the other point is read from the map data and displayed on the image. Thus, even when there is a subject whose name is unknown in the image, if the names of some subjects are known, the name of the subject whose name is unknown can be grasped.

(3) In the embodiment described above, an example in which a personal computer is used as the image processing apparatus 100 and the image processing program is executed on the personal computer has been described. However, the present invention is not limited to this, and the image processing program described above on the digital camera is executed. May be executed. In this case, the target image is displayed on the monitor mounted on the digital camera, and the user operates the input device such as a touch panel mounted on the digital camera to designate two points on the target image displayed on the monitor.

  Note that the present invention is not limited to the configurations in the above-described embodiments as long as the characteristic functions of the present invention are not impaired.

  The correspondence between the constituent elements of the claims and the embodiment will be described. The HDD 102 corresponds to storage means, and the CPU 104 corresponds to execution means. This correspondence is an example, and the correspondence is different depending on the configuration of the embodiment.

It is a block diagram which shows the structure of one Embodiment of the image processing apparatus in this Embodiment. It is a figure which shows the specific example at the time of converting the position of 2 points | pieces designated on the target image by the user into the position on an image pick-up element. FIG. 3 is a diagram clearly showing the positional relationship between two points A ′ and B ′ converted into a position on the image sensor 2 b by enlarging the image sensor 2 b side in FIG. 2. It is the figure which looked at FIG. 3 from the upper direction, ie, the direction of the arrow 3a. It is the figure which looked at FIG. 3 from the side, ie, the direction of the arrow 3b. It is a figure which shows the example of a display of horizontal angle (omega) h, vertical angle (omega) v, and angle (omega) between 2 points | pieces calculated. It is a figure which shows the example of a display of the calculated angle, the distance D between two points AB in the distance l, the horizontal distance Dh, and the vertical distance Dv. It is a flowchart figure which shows the process of the image processing program performed with the image processing apparatus 100 in this Embodiment. It is a figure which shows the specific example of the grid display in a modification.

Explanation of symbols

100 image processing apparatus 101 mouse 102 HDD
103 memory 104 CPU
105 Monitor

Claims (6)

An image processing program for execution by a computer,
Image display processing for displaying on a monitor a photographed image obtained by photographing an object image by a photographing optical system , and
A designation process for designating two points in the captured image displayed on the monitor;
The two points on the designated captured image are respectively converted into a first position and a second position on the image sensor, and the first position information and the second position information on the image sensor are obtained. Conversion process
An acquisition process for acquiring relative position information indicating a relative position between a rear node of the imaging optical system determined by a focal length of the imaging optical system and an imaging distance of the subject and the imaging element;
An angle formed by a first straight line connecting the rear node of the photographing optical system and the first position and a second straight line connecting the rear node of the photographing optical system and the second position is acquired. An angle calculation process for calculating based on the relative position information, the first position information, and the second position information acquired by
The angle calculated by said angle calculation process, the viewed from the photographing optical system, and characterized in that it has an angle display processing for displaying as the angle between two points on the real space corresponding to the two points where the specified An image processing program. In the image processing program according to claim 1,
The first position information and the second position information include coordinate positions in xy orthogonal coordinates determined on the image sensor,
The relative position information is a distance between a rear node of the photographing optical system and the image sensor,
In the angle calculation process, the angle formed by the first straight line and the second straight line is obtained by the distance obtained by the obtaining process, the coordinate position information regarding the first position, and the coordinate position regarding the second position. An image processing program that is calculated based on information . The image processing program according to claim 1 or 2,
A distance calculation process for calculating a distance between two points in the real space based on the relative position information, the shooting distance, the first position information, and the second position information ;
An image processing program , further comprising: a distance display process for displaying a distance between two points in the real space calculated by the distance calculation process . The image processing program according to claim 3 .
The relative position information is a distance between a rear node of the photographing optical system and the image sensor,
The distance calculation process includes a first process for calculating a distance between the first position and the second position on the image sensor based on the first position information and the second position information;
And a second process for calculating a distance between two points in the real space based on the distance calculated by the first process, the distance acquired by the acquisition process, and the shooting distance. An image processing program. In the image processing program according to any one of claims 1 to 4 ,
The angle seen from the photographing lens between the center point of the image displayed on the monitor and a plurality of points set for the entire image is calculated, and the same from the center point in the horizontal direction and the vertical direction at every predetermined angle. An image processing program characterized by further comprising a grid line display process for drawing a straight line passing over a point serving as an angle and displaying a grid line on the image . Storage means for storing the image processing program according to any one of claims 1 to 5,
  Execution means for executing the image processing program stored in the storage means;
  A digital camera comprising the monitor according to claim 1.

Images