JP2005189051A - Size measurement device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To measure the actual size of a measurement object without using a distance sensor by analyzing taken photographic images while considering anteroposterior relation (perspective relation) between the object to be a size measurement object and the object to be a reference object to be compared with the measurement object. <P>SOLUTION: In the status that the object in the monitor images taken by a camera imaging section 7 is designated as the object to be measured, and a plurality of other objects existing in the monitor images are designated as reference objects, a CPU 1 measures the perspective distances between the measurement object and a plurality of reference objects in the anteroposterior direction respectively and also measures the real size of the plurality of designated reference objects respectively, and further calculates the image size of the measurement object and each of the reference object by analyzing the monitor images. The real size of the measurement object is calculated based on each calculated size, each perspective distance, and the real size of the reference objects. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a size measuring apparatus and program for measuring the actual size of a subject included in a captured image.

Conventionally, as a technique for measuring the size of a subject by camera shooting, for example, the distance from the lens position measured by a distance sensor provided in the camera to the subject, and an arbitrary part of the subject displayed on the display, A digital camera is known in which an actual dimension of a subject is measured based on a shooting angle of view of a lens (see Patent Document 1). In addition, the fish species discrimination is based on the display screen to determine the actual size of the fish shadow based on the focal length of the underwater camera and the distance to the fish captured by the transducer integrated in the underwater camera. An apparatus is known (see Patent Document 2).
Japanese Patent Application Laid-Open No. 11-344311 Japanese Patent Laid-Open No. 5-31947

 However, in the above-described digital camera for measuring the actual size of the subject and the fish type discriminating apparatus for measuring the actual size of the fish shadow, a relatively high accuracy measurement result can be obtained. It is assumed that a transmitter / receiver is provided to measure the distance from the camera position to the subject, and that the subject is subject to size measurement and that the subject is in focus. Each time the size of the subject was measured, it was necessary to take one picture for each subject while focusing on the subject.

An object of the first invention is to take a photographed image while taking into consideration the front-to-back relationship (perspective relationship) between a subject to be size-measured and a reference subject to be compared with the subject to be measured without using a distance sensor. Is to enable measurement of the actual size of the measurement object.
The subject of the second invention is that the actual size of the measurement object can be measured by analyzing the photographed image while comparing the measurement object, which is the subject in the photographed image, with the reference object, without using a distance sensor. In addition, the actual size of the measurement object can be appropriately measured depending on whether or not the measurement object and the reference object are in a context.

The invention according to claim 1 (first invention) is a size measuring device for measuring the actual size of a subject included in a photographed image, wherein the subject in the photographed image is a target for size measurement. In addition to designating as a target, designation means for designating a plurality of other subjects existing in the captured image as reference targets to be compared with the measurement target, the designated measurement target and a plurality of reference targets in the captured image Measuring means for measuring the distance in the front-rear direction between, and acquisition means for acquiring the actual size for each of the plurality of designated reference objects, and for each measurement object and reference object by analyzing the captured image And calculating means for calculating the image size and calculating the actual size of the measurement object based on the calculated sizes, the perspective distances, and the actual sizes of the reference objects. Furthermore, the computer provides a program for implementing the key features shown in the invention of claim 1, wherein the above (invention of claim 11, wherein) the.

The invention described in claim 1 may be as follows.
The designating unit designates an image portion located in the center portion by analyzing a captured image as an object to be measured (the invention according to claim 2).

The specifying means searches for a plurality of subjects characteristically matching any of a plurality of types of reference targets stored and managed in advance among the subjects included in the photographed image, thereby at least two A reference object is designated (the invention according to claim 3).
In this case, the designation means designates two reference objects having different longitudinal positions in the plane coordinate system where the photographed image is developed and having a perspective relationship (the invention according to claim 4). The designation means designates the same reference object or a reference object having substantially the same size when designating two reference objects having a perspective relationship (the invention according to claim 5).

  The measuring means measures the vertical component in the vertical direction as a perspective distance in a plane coordinate system in which a photographed image is developed when measuring the perspective distance in the front-rear direction between the measurement target and the plurality of reference targets. (Invention of Claim 6). In this case, the measurement unit measures the perspective distance between one reference object and the measurement object and the distance between the other reference object and the measurement object, out of the two reference objects in perspective relation. Alternatively, the perspective distance between one reference object and the measurement object and the distance between each reference object are measured (the invention according to claim 7).

  In a state where the actual size is stored and managed in advance corresponding to a plurality of types of reference objects, the acquisition unit reads and acquires the actual size corresponding to the designated reference object (the invention according to claim 8).

  Distinguishing means for discriminating the context between the designated measurement object and a plurality of reference objects by analyzing a captured image is provided, and the calculating means according to a calculation formula corresponding to the context determined by the discrimination means, The actual size of the measurement object is calculated (the invention according to claim 9).

  In a state in which a captured image including the measurement target is displayed, the actual size is displayed in association with the measurement target in the captured image (the invention according to claim 10).

The invention according to claim 12 (second invention) is a size measuring apparatus for measuring the actual size of a subject included in a photographed image, wherein the subject in the photographed image is a target for size measurement. In addition to designating as an object, designation means for designating a reference object to be compared with the measurement object, and whether the designated measurement object and the reference object are in a context in the captured image by analyzing the captured image When it is determined by the determining means and the determining means that there is no context, the actual size of the reference object is obtained and the captured image is analyzed to obtain the image size for each measurement object and reference object. The first calculating means for calculating the actual size of the measurement object based on the respective calculated sizes and the actual size of the reference object, and the determination means determine that there is a context. When separated, measure the distance in the front-rear direction between the specified measurement object and the reference object in the captured image, acquire the actual size for each reference object, and analyze the captured image The second calculation means for calculating the image size for each measurement object and reference object, and calculating the actual size of the measurement object based on each calculated size, each perspective distance, and the actual size of the reference object. Furthermore, a program for realizing the main functions shown in the invention described in claim 12 is provided to the computer (the invention described in claim 15).

The invention described in claim 12 may be as follows.
The designation unit designates, as a reference target, an image portion of a subject that characteristically matches any of a plurality of types of reference targets stored and managed in advance among the subjects included in the captured image (claims). Item 13).

  By analyzing the captured image, the front-to-back relationship between the designated measurement target and the reference target is determined, and the calculation means calculates the actual size of the measurement target according to a calculation formula corresponding to the front-rear relationship. Described invention)

According to the first aspect of the present invention, the subject in the captured image is designated as a measurement target to be size-measured, and a plurality of other subjects existing in the captured image are compared with the measurement target. In the state designated as the reference object, the distance in the front-rear direction between the measurement object and the plurality of reference objects is measured in the captured image, and the actual size is acquired for each of the designated plurality of reference objects. Further, by analyzing the captured image, the image size is calculated for each measurement object and reference object, and the actual size of the measurement object is calculated based on each calculated size, each perspective distance, and the actual size of each reference object. Therefore, without using a distance sensor, the anteroposterior relationship (perspective relationship) between the subject whose size is to be measured and the reference subject to be compared with this subject. It can be measured actual size of the measuring object by analyzing the photographed image while considering.
In this case, the size measurement can be performed not only at the time of shooting but also at the time of reproducing the image, so that the size measurement can be freely performed at any time as necessary. Therefore, the size measuring device is not limited to being incorporated into a digital camera, but can be incorporated into an image data processing device such as a personal computer. In addition, when a plurality of measurement objects are specified in the captured image, the actual size can be measured for each measurement object.

  According to the invention described in claim 2, in addition to having the same effect as that of the invention described in claim 1, the image portion located in the central portion is designated as the measurement object by analyzing the photographed image. Therefore, the measurement target can be automatically specified by image analysis, a special specification operation becomes unnecessary, and the measurement target can be specified reliably.

According to the invention described in claim 3, in addition to having the same effect as that of the invention described in claim 1 above, among the subjects included in the photographed image, a plurality of types of reference objects stored and managed in advance Since at least two reference objects are specified by searching for a plurality of subjects that characteristically match any one of the above, it is possible to automatically specify a plurality of reference objects by analyzing a captured image, and special operations can be performed. It becomes unnecessary, and it becomes possible to specify a reference object reliably.
In this case, in the planar coordinate system in which the photographed image is developed, two reference objects having different longitudinal positions are specified (invention of claim 4), or 2 in perspective relation. When specifying one reference object, the same reference object or the reference object having substantially the same size is specified (the invention according to claim 5), so that the actual size of the measurement object can be easily calculated. Is possible.

  Also, when measuring the perspective distance in the front-rear direction between the measurement object and the plurality of reference objects, the vertical component in the vertical direction is measured as the perspective distance in the plane coordinate system where the photographed image is developed. (Invention of Item 6), whether the distance between one of the two reference objects and the measurement object and the distance between the other reference object and the measurement object are measured. Since the distance between one reference object and the measurement object and the distance between each reference object are measured (the invention according to claim 7), the actual size of the measurement object can be easily calculated. It becomes possible.

  According to the invention described in claim 8, in addition to having the same effect as that of the invention described in claim 1 described above, in the state where the actual size is stored and managed in advance corresponding to a plurality of types of reference objects, the acquisition means Since the actual size corresponding to the designated reference object is read out and acquired, the actual size of the reference object can be automatically acquired, and no special operation is required.

  According to the ninth aspect of the invention, in addition to having the same effect as that of the first aspect of the invention described above, the front-rear relationship between the measurement object and the plurality of reference objects is determined by analyzing the captured image, and the determination is made. Since the actual size of the measurement object is calculated according to the calculation formula corresponding to the determined context, the actual size of the measurement object can be easily calculated.

 According to the invention described in claim 10, in addition to having the same effect as that of the invention described in claim 1 described above, in the state where the captured image including the measurement object is displayed, the measurement is performed in the captured image. Since the actual size is displayed in association with the object, the measurement object can be viewed while checking the size in the captured image, and the correspondence between the measurement object and the actual size becomes clear.

  According to the twelfth aspect of the present invention, in the state where the measurement target is specified in the captured image and the reference target is specified, the measurement target and the reference target are included in the captured image by analyzing the captured image. If there is no context, the actual size of the measurement target is calculated based on the image size of the measurement target and the reference target and the actual size of the reference target. In the captured image, the distance in the front-rear direction between the measurement object and the reference object is measured, and the measurement object, the image size of the reference object, each perspective distance, and the actual size of the reference object are measured. Since the actual size is calculated, the captured image can be analyzed while comparing the measurement target and the reference target in the captured image without using a distance sensor. Together can measure the actual size of the measuring object I, the measured object and the reference object can be properly measured actual size of the measuring object according to whether the context. Furthermore, since size measurement can be performed not only at the time of shooting but also at the time of image reproduction, size measurement can be freely performed at any time as necessary. In addition, when a plurality of measurement objects are specified in the captured image, the actual size can be measured for each measurement object.

  According to the thirteenth aspect, in addition to the same effects as the above-described twelfth aspect, a plurality of types of reference objects that are stored and managed in advance among the subjects included in the photographed image. Since the image portion of the subject that characteristically matches any of the above is designated as the reference object, it is possible to automatically specify the reference object by analyzing the captured image, and no special designation operation is required. It becomes possible to specify the reference object with certainty.

  According to the invention described in claim 14, in addition to having the same effect as that of the invention described in claim 12, the context of the measurement object and the reference object is determined by analyzing the photographed image, and this context Since the actual size of the measurement object is calculated according to the corresponding calculation formula, the actual size of the measurement object can be easily calculated.

Embodiments of the present invention will be described below with reference to FIGS.
FIG. 1 is a block diagram showing basic components of a digital camera in this embodiment.
This digital camera is capable of measuring the actual size of the subject included in the captured image (monitor image), and when the measurement of the subject size is instructed before the subject is actually captured, the digital image captured on the monitor It has a size measurement function that measures the actual size by analyzing and displays it on the monitor screen. In this case, even if a distance sensor is not used, the actual size of the measurement target is measured by analyzing the captured image while comparing the measurement target that is the subject in the captured image with the reference target.
Before detailed description of the features of this embodiment, the hardware configuration of this embodiment will be described below.

  The CPU 1 is a central processing unit that controls the overall operation of the digital camera in accordance with the operating system and various application software in the storage unit 2. The storage unit 2 is a fixed memory such as a hard disk, and has a program storage area and a data storage area. The program storage area in the storage unit 2 stores an application program for realizing the present embodiment in accordance with the operation procedure shown in FIGS. 8 and 11 described later, and the data storage area stores FIG. 5 described later. (Reference target table) is stored. The program and data are loaded into the work memory 3 as necessary, and the data in the work memory 3 is saved in the storage unit 2. The recording medium 4 is a removable memory such as a DVD, and exchanges programs, image data, and the like with the storage unit 2 and the work memory 3.

  On the other hand, an operation unit 5, a display unit 6, a camera photographing unit 7, and an image memory 8 which are input / output peripheral devices are connected to the CPU 1 via a bus line, and the CPU 1 inputs these according to an input / output program. Controls the operation of the output device. The operation unit 5 has various function buttons such as a shutter button, a mode button for switching to a shooting mode / playback mode, and a size measurement button for instructing start of size measurement, and the operation signal is given to the CPU 1. The display unit 6 is, for example, a liquid crystal display unit with a touch panel, and is used as a monitor screen / finder screen / image reproduction screen. The camera photographing unit 7 includes a photographing lens, a lens / mirror block such as a mirror, an image sensor such as a CCD image sensor, a driving system thereof, and the like, and sequentially transfers the photographed image to the image memory 8 for each photographing. Adjusts and controls the shooting direction (the direction of the lens) and the zoom mechanism, controls driving during autofocus, shutter drive control, shutter speed, exposure, white balance, etc., and captures captured images.

The CPU 1 measures and displays the actual size of the subject included in the monitor image by activating the size measurement function when the size measurement button is operated in the shooting mode.
Here, as shown in FIG. 2, among the subjects in the monitor image, the subject X is a measurement target to be size measured, and the other one subject A is a reference target to be compared with the measurement target X. Then, the CPU 1 automatically designates the measurement target X and the reference target A by analyzing the monitor image. In this case, the CPU 1 automatically designates the subject positioned at the center portion of the monitor image as the measurement target X, and automatically designates the subject that is in a state of being substantially side by side with respect to the measurement target X as the reference target A. Therefore, the measurement target X and the reference target A are not in a perspective relationship (front-rear relationship), but are substantially in a side-by-side relationship, that is, the distance from the shooting position (lens position) to the measurement target, and the reference position to the reference target. The distance to is substantially the same.

  In this case, after acquiring the actual size (for example, vertical dimension) J1 indicating the actual size of the reference object A, the CPU 1 measures the measurement object X and the image size (for example, vertical dimension) G1 for each reference object A, G0 is calculated, and the actual size J0 of the measurement object X is calculated based on the measurement object X, the calculated sizes G1 and G0 of the reference object A, and the actual size J1 of the reference object. The actual size J0 of the measurement target X calculated in this way is additionally displayed in association with the measurement target X in the monitor screen.

  FIG. 3 shows that when the subjects in the monitor image are not substantially in a side-by-side state, the other two subjects A and B that are in a perspective relationship (front-rear relationship) with respect to the measurement target X are automatically designated as reference targets. It is shown that. That is, among the subjects in the monitor image, when the other subject is not in a substantially horizontal state with respect to the measurement target X, the CPU 1 is positioned at the central portion of the monitor image as in the above case. A subject to be measured is automatically designated as a measurement target X. At this time, the other two subjects A and B that are in a perspective relationship (front-rear relationship) with respect to the measurement target X are automatically designated as reference targets. In other words, in the planar coordinate system in which the monitor image is developed, two reference objects A and B having different perspective positions are automatically specified, but at this time, two identical reference objects are used. The reference target is designated on the condition that (the same type of subjects having different positions) are included in the monitor image.

In this case, the CPU 1 discriminates the positional relationship (front-rear relationship) between the measurement target X and each of the reference objects A and B by analyzing the captured image, and the actual size of the measurement target X according to the calculation formula corresponding to this front-rear relationship. Is calculated.
4 to 6 show the positional relationship (front-rear relationship) between the measurement target X and the reference targets A and B, and the actual size of the measurement target X is determined according to a calculation formula prepared in advance according to the front-rear relationship. It is calculated. Here, FIG. 4 shows a case where the measurement object X is located in the middle of the reference objects A and B, and the actual size of the measurement object X is calculated according to the first calculation formula. FIG. 5 shows a case where the measurement object X is located behind the reference objects A and B, and the actual size of the measurement object X is calculated according to the second calculation formula. FIG. 6 shows a case where the measurement object X is positioned in front of the reference objects A and B, and the actual size of the measurement object X is calculated according to the third calculation formula.
In this embodiment, the CPU 1 selects the corresponding first to third calculation formulas according to the context of the measurement target X and the reference targets A and B, but the first calculation formula Only the (basic formula) may be stored and managed, and the second and third calculation formulas may be obtained by modifying the basic formula.

In each calculation formula in FIGS. 4 to 6, as described above, “J1” is the actual size of the reference object A, “G1” is the image size of the reference object A, “G0” is the image size of the measurement object X, “J0” indicates the actual size of the measurement target X. Further, “J2” indicates the actual size of the reference object B, and “G2” indicates the image size of the reference object B.
“H1” and “h2” indicate distances in the front-rear direction between the measurement object X and the reference objects A and B, and the CPU 1 displays the vertical distance in the plane coordinate system where the monitor image is developed. The vertical component of the direction is measured as the perspective distances “h1” and “h2”. In this case, the perspective distance “h1” indicates the distance of the vertical component from the reference target A to the lower end of the measurement target X with the lower end of the reference target A as the base point, and the perspective distance “h2” indicates the reference target B The distance of the vertical component from the reference object B to the lower end part of the measurement object X is shown with the lower end of the reference point as the base point.

FIG. 7 is a diagram showing the contents of the reference target table 11.
The reference object table 11 is configured to store and manage the actual size data for each reference object arbitrarily registered in advance. As described above, the “reference object” is an image of the reference object to be compared with the measurement object at the time of size measurement, and is obtained by arbitrarily photographing and registering a subject whose actual size is known. It is a photographed image of a road sign, a post box, a fire hydrant, a building and its window frame. In this case, when the CPU 1 automatically identifies the reference object included in the captured image by analyzing the captured image, the CPU 1 selects one of a plurality of “reference objects” registered in the reference object table 11. An image portion of a subject that matches characteristically is specified as a reference target. At that time, the reference object is designated on the condition that two identical reference objects (for example, postboxes having different positions) are included in the monitor image.

  The “actual size data” is divided into actual sizes for each direction corresponding to the “vertical dimension”, “horizontal dimension”, and depth dimension ”, and the CPU 1 arbitrarily selects from the actual sizes for each direction in advance. The actual size in the selected direction is read out. In other words, the direction in which the actual size is read out among “vertical dimension”, “horizontal dimension”, and depth dimension ”can be arbitrarily selected and designated in advance, and the CPU 1 refers to this designation content. The actual size in the corresponding direction is read out. Depending on the type of the reference object, any one of “vertical dimension”, “horizontal dimension”, and depth dimension ”may be registered.

  Next, the operation concept of the digital camera in this embodiment will be described with reference to the flowcharts shown in FIGS. Here, each function described in these flowcharts is stored in the form of a readable program code, and operations according to the program code are sequentially executed. In addition, the operation according to the above-described program code transmitted via the transmission medium can be sequentially executed. In other words, in addition to the recording medium, the program / data supplied externally via the transmission medium can be used to execute the operation specific to this embodiment.

FIG. 8 is a flowchart showing an outline of the overall operation of the digital camera, which starts executing in response to power-on.
First, in a state where the photographing mode is set (step A1), the CPU 1 sequentially captures monitor images (step A2) and displays them as moving images on the monitor screen (step A3). In this state, the presence / absence of button operation is checked (step A4). If no button is operated (NO in step A4), the monitor image capturing is resumed (step A2), but now the shutter button is operated. When this happens (step A5), the captured image at that time is recorded and saved as an image file (step A6), and then the process returns to capturing the monitor image (step A2).

 On the other hand, when the shooting mode is switched to the playback mode (step A7), a playback process is performed in which the recorded images are played back and displayed sequentially while selecting and specifying the recorded images in the forward / reverse directions according to the user instruction (step A8). Thereafter, when the playback mode is switched to the shooting mode (step A9), the process returns to the process of capturing the monitor image (step A2). Here, when the size measurement button is operated in the photographing mode (step A10), the process proceeds to a size measurement process for measuring the actual size of the measurement target included in the monitor image (step A11).

9 to 11 are flowcharts detailing the size measurement processing executed in response to the operation of the size measurement button in the shooting mode.
First, the CPU 1 displays a measurement start screen (see FIG. 12) that displays precautions regarding photographing of the measurement target (a message that the measurement target is centered and the shutter operation is performed) (step B1), and then the monitor. An image is acquired and displayed on a monitor (step B2). In this state, the presence or absence of the shutter button is checked (step B3), and if there is no shutter operation, the process returns to step B2, but when the shutter operation is performed, the current monitor image is fixedly displayed (step B4), The subject image located at the center of the fixed monitor image is specified as the measurement target (step B5).

 Then, an image portion of another subject that is substantially in a line with the measurement target is extracted, and the reference target table 11 is searched based on the extracted image (step B6). (Step B7). Here, when the subject in a state of being substantially side-by-side with respect to the measurement target matches any reference target (YES in Step B7), the process proceeds to the first measurement process of FIG. If there is no subject in a substantially side-by-side state, or if there is a substantially side-by-side subject but it is not registered in the reference target table 11 (NO in step B7), the process proceeds to the next step B8.

 In this step B8, image portions of a plurality of (two) subjects having a front-rear (perspective) relationship with respect to the measurement target in the monitor image are extracted, the reference target table 11 is searched based on each extracted image, and the extracted image It is checked whether each of these is characteristically matched to any reference object (step B9). In this case, two postboxes are searched and specified as a reference object on condition that two identical subjects (for example, postboxes) having a front-rear (perspective) relationship are included in the monitor image. Here, when the corresponding reference object is searched (YES in step B9), the process proceeds to the second measurement process of FIG. 11, but there are no two identical subjects in the context of the measurement object. Alternatively, if each subject is not registered in the reference object table 11 (NO in step B9) even though there are contextual subjects, a measurement impossible message is displayed (step B10), and the monitor image is fixedly displayed. After canceling, the normal state is restored (step B11).

 When the first measurement process of FIG. 10 is started, the CPU 1 reads and acquires the actual size J1 of the reference object searched in step B6 described above from the reference object table 11 (step B12). Then, by analyzing the monitor image, the reference target image size “G1” is measured (step B13), and the measurement target image size “G0” is measured (step B14). The image sizes “G0” and “G1” are sizes on an image sensor such as a CCD, and the vertical direction based on the horizontal / vertical dimensions of the entire effective area and the horizontal / vertical dot size of the entire effective area. The size per dot in (vertical pitch) / the size per dot in the horizontal direction (horizontal pitch) is obtained and converted into size information based on this dot pitch.

As a result, when all of the actual size J1 and image size G1 of the reference object and the image size G0 of the measurement object are obtained, a calculation process for obtaining the actual size J0 of the measurement object is performed using these values as parameters (step B15). In this case, the actual size of the measurement target is calculated according to the following formula.
Actual size of measurement object “J0” = G0 / G1 * J1

  The actual size of the measurement target calculated in this way is a value obtained by multiplying the ratio of the image size by the actual size of the reference target. In this case, it is assumed that the measurement target and the reference target are substantially in a side-by-side state. It is said. In other words, it is assumed that the distance from the shooting position to the measurement target (building) and the distance to the reference target (person) are substantially the same, and the calculated value is an approximate size. Then, a frame surrounding the measurement object in the monitor image is generated and displayed, and the actual size is additionally displayed in the vicinity of the frame display (step B16). FIG. 13 is a view showing a monitor screen in which the actual size obtained by the first measurement process is additionally displayed, and the vertical dimension (3 m40 cm) of the measurement target (tree) is calculated using the post box as a reference target. The case where it is displayed is shown. Thereafter, the operation wait state is entered (step B17), and when the return key is operated, the fixed display of the monitor image is released and then the normal state is restored (step B18).

  When the second measurement process in FIG. 11 is started, the CPU 1 designates the two reference objects searched in step B8 described above (step B19), and then designates one of them as the first reference object (FIG. 4 to FIG. 4). As the reference object A) shown in FIG. 6, the actual size “J1” is read from the reference object table 11 (step B20), and the image size “G1” of the first reference object is measured on the monitor image (step B20). B21). Similarly, the other reference object is set as the second reference object (reference object B shown in FIGS. 4 to 6), and the actual size “J2” is read out from the reference object table 11 (step B22), and the monitor image is displayed. Above, the image size “G2” of the second reference object is measured (step B23). Further, the measurement target image size “G0” is measured on the monitor image (step B24). The image sizes “G0”, “G1”, and “G2” are sizes on an image sensor such as a CCD, and the horizontal / vertical dimensions of the entire effective area and the horizontal / vertical dot sizes of the entire effective area. Based on this, the size per dot in the vertical direction (vertical pitch) / the size per dot in the horizontal direction (horizontal pitch) is obtained, and is a value converted into size information based on this dot pitch.

Next, the distance of the vertical component from the first reference object to the measurement object is measured in the monitor image (step B25). In this case, as shown in FIGS. 4 to 6, the distance h <b> 1 from the lower end of the reference object A to the lower end of the measurement object X is measured. Further, the distance of the vertical component from the second reference object to the measurement object in the monitor image is measured (step B26). In this case, the distance h2 from the lower end of the reference object B to the lower end of the measurement object X is measured as shown in FIGS.
Thus, the actual sizes J1 and J2 of the reference objects A and B and their image sizes G1 and G2, the image size G0 of the measurement object X, the distance h1 from the reference object A to the measurement object X, and from the reference object B to the measurement object X When all the distances h2 are complete, a calculation process for obtaining the actual size J0 of the measurement target X is performed using these values as parameters.

In this case, the CPU 1 determines the positional relationship (front-rear relationship) between the measurement target and each reference target by analyzing the monitor image (step B27). Now, as shown in FIG. 4, when the measurement target is located in the middle of each reference target (YES in step B28), the first calculation formula (basic formula) shown in FIG. 4 is selected (step B29) and the actual size J0 of the measuring object X is obtained (step B33).
J0 = G0 * (h2 / (h1 + h2) * J1 / G1 + h1 / (h1 + h2) * J2 / G2)

Also, as shown in FIG. 5, when the measurement object is located behind each reference object (YES in step B30), the second calculation formula shown in FIG. 5 is selected (step B31), The actual size J0 of the measurement object X is obtained (step B33). This second calculation formula is a modification of the first calculation formula described above as a basic formula.
J0 = G0 * (J1 / G1 * h2 / (h2-h1) -J2 / G2 * h1 / (h2-h1))
Also, as shown in FIG. 6, when the measurement object is located in front of each reference object (NO in step B30), the third calculation formula shown in FIG. 6 is selected (step B32), The actual size J0 of the measurement object X is obtained (step B33). This third calculation formula is a modification of the first calculation formula described above as a basic formula.
J0 = G0 * (J2 / G2 * h1 / (h1-h2) −J1 / G1 * h2 / (h1-h2))

 When the actual size (approximate value) of the measurement target is calculated in this way, the process returns to step B16 in FIG. 10, and a frame surrounding the measurement target in the monitor image is generated and displayed, and the actual size is set. Additional display in the vicinity of the frame display. FIG. 14 is a diagram showing a monitor screen in a state where the actual size obtained by the second measurement process is additionally displayed. In this case, with a post box that is far away as a reference object, the vertical dimension (3 m40 cm) of the measurement object (tree) located in the middle is calculated and displayed according to the first calculation formula described above. Show. In this state, in response to the operation of the return key (step B17), the monitor image is released from the fixed display and then returned to the normal state (step B18).

 As described above, in this embodiment, the subject in the monitor image photographed by the camera photographing unit 7 is designated as the measurement target, and a plurality of other subjects existing in the monitor image are used as the reference subject. In the designated state, the CPU 1 measures the distance in the front-rear direction between the measurement object and the plurality of reference objects in the monitor image, and acquires the actual size for each of the plurality of designated reference objects. Further, by analyzing the monitor image, the image size is calculated for each measurement object and reference object, and the actual size of the measurement object is calculated based on each calculated size, each perspective distance, and the actual size of each reference object. As a result, without using a distance sensor, the subject to be measured and the reference subject to be compared with this subject It can be measured actual size of the measuring object by analyzing the photographed image while considering the post-relationship (distance relation).

  In this case, since the CPU 1 analyzes the monitor image and designates the image portion located in the central portion as the measurement target, the measurement target can be automatically designated by the image analysis, and a special operation is performed. It becomes unnecessary, and it becomes possible to specify the measurement target with certainty. Further, among the subjects included in the monitor image, by searching for a plurality of subjects characteristically matching any of a plurality of types of reference targets registered in the reference target table 11, at least two criteria are obtained. Since the target is specified, it is possible to automatically specify a plurality of reference objects by analyzing the monitor image, so that no special operation is required and the reference object can be specified reliably. In this case, since the actual size is stored and managed in the reference object table 11 corresponding to the reference object, the actual size of the reference object can be automatically acquired, and no special operation is required.

  At this time, in the planar coordinate system in which the monitor image is developed, two reference objects having different vertical positions and having a perspective relation are designated, or two reference objects having a perspective relation are designated. At this time, since the same reference object is designated, the actual size of the measurement object can be easily calculated. Furthermore, when measuring the perspective distance in the front-rear direction between the measurement target and a plurality of reference targets, the vertical component in the vertical direction is measured as the perspective distance in the plane coordinate system where the monitor image is developed, Of the two reference objects in a relationship, the distance between one reference object and the measurement object and the distance between the other reference object and the measurement object are measured. The size can be easily calculated.

  Further, the CPU 1 determines the front-rear relationship between the measurement target and the plurality of reference targets by analyzing the monitor image, and calculates the actual size of the measurement target according to the calculation formula corresponding to the determined front-rear relationship. Thus, the actual size of the measurement object can be easily calculated. In this case, in the state where the monitor image including the measurement target is displayed, the actual size is displayed in association with the measurement target in the monitor image, so the size is confirmed in the monitor image. While being able to see the measurement object, the correspondence between the measurement object and its actual size becomes clear.

  On the other hand, in a state where the measurement target is specified in the monitor image and the reference target is specified, the CPU 1 analyzes the monitor image so that the measurement target and the reference target are in the context of the monitor image. If there is no context, the first measurement process is performed, and the actual size of the measurement target is calculated based on the measurement target, the image size of the reference target, and the actual size of the reference target. If there is a anteroposterior relationship, the first measurement process is executed to measure the perspective distance in the front-rear direction between the measurement object and the reference object, respectively, and the measurement object, reference object image size, perspective distance, and reference object Since the actual size of the measurement target is calculated based on the actual size, the monitor image can be analyzed while comparing the measurement target with the reference target without using a distance sensor. Thus with can measure the actual size of the measuring object, the measured object and the reference object can be properly measured actual size of the measuring object according to whether the context.

In the above-described embodiment, when two reference objects having a perspective relationship are designated, the same reference object (postbox having a different distance) is designated for retrieval. However, they have substantially the same size. Each reference object may be designated.
In the embodiment described above, the distance “h1” of the vertical component from the reference target A to the lower end of the measurement target X with the lower end of the reference target A as the base point, and the reference target with the lower end of the reference target B as the base point The distance “h2” of the vertical component from B to the lower end of the measurement target X is measured. For example, the distance between one reference object and the measurement object and the distance between each reference object are measured. It may be.

 In the above-described embodiment, the measurement target and the reference target are automatically specified by analyzing the monitor image. However, the photographer arbitrarily designates the measurement target and the reference target on the monitor screen. May be. In this case, when an arbitrary position is touched (point specified) on a monitor screen with a touch panel, the measurement target or reference target is specified in consideration of the continuity of the image at the specified point. Also good. In addition, when a touch designation is made on an arbitrary measurement target or reference object, if the touch designation is made along the contour, the measurement target or reference object can be easily specified.

 In the above-described embodiment, it is assumed that the measurement target and the reference target are on the same plane. However, even if the measurement target and the reference target are different in height, the actual size of the measurement target is set. Can be measured. In this case, in the above-described embodiment, the sizes of the measurement object and the reference object are specified in the monitor image. Therefore, even if the heights of the measurement object and the reference object are different, the actual size of the measurement object is set. It becomes possible to measure.

 In addition, when recording and saving a captured image in response to a shutter operation, if the actual size of the measurement target is also recorded and saved, the actual size of the measurement target associated with the captured image at the time of image playback Can be read and displayed. Further, the actual size of the measurement object is added to each captured image and stored in a recording medium, and this recording medium is inserted into an image data processing apparatus such as a personal computer to perform image reproduction. The actual size of the measurement object can be displayed for each image.

 In the embodiment described above, image data of a plurality of types of reference objects are arbitrarily registered in the reference object table 11, but the size is fixed, for example, a road sign, a post box, a fire hydrant or the like. If it is, the characteristic image of this comparison standard (for example, if it is a postbox, the cube, the aspect ratio, the whole is red) should be registered. May be. The contents of the reference object table 11 may be set and registered at the time of product purchase, and the user may additionally register an arbitrary reference object and its actual size as necessary.

In the above-described embodiments, the case where the present invention is applied to a digital camera is shown. However, it may be incorporated in an image data processing apparatus such as a personal computer, a camera-equipped mobile phone or a portable information device, and for various applications. It can be used. For example, after shooting at a construction site, civil engineering site, etc., when checking the status of the site while reproducing images at the company, the actual size of each part is measured and displayed based on each captured image Also good.
In addition, the size measuring device is not limited to a stand-alone type, but each component is physically separated into two or more cases, and wired transmission paths such as communication lines and cables, or wireless transmission such as radio waves, microwaves, and infrared rays. It may be a distributed system that transmits and receives data via a path.

  On the other hand, a recording medium (for example, a CD-ROM, a flexible disk, a RAM card, etc.) on which program codes for executing the above-described units are recorded may be provided to the computer. That is, a recording medium having a computer-readable program code, in addition to designating a subject in a captured image as a measurement target for size measurement, and a plurality of other subjects existing in the captured image A function for designating a reference object to be compared with a measurement object, a function for measuring the distance in the front-rear direction between the designated measurement object and a plurality of reference objects in a captured image, and the plurality of designated A function to acquire the actual size for each reference object, and to calculate the image size for each measurement object and reference object by analyzing the captured image, and to calculate each calculated size, each perspective distance, and the actual size of each reference object And a computer-readable recording that stores a program for realizing the function of calculating the actual size of the measurement object based on It may be provided a medium.

  A recording medium having a computer-readable program code, and a function for designating a reference object to be compared with a measurement object in addition to designating a subject in a captured image as a measurement object to be subjected to size measurement; A function for determining whether the specified measurement object and the reference object are in the context in the captured image by analyzing the captured image, and if it is determined that there is no context, the reference object Obtain the actual size and calculate the image size for each measurement object and reference object by analyzing the captured image, and calculate the actual size of the measurement object based on each calculated size and the actual size of the reference object If it is determined that there is a front-rear relationship with the function, the distance in the front-rear direction between the specified measurement target and the reference target in the captured image is determined. Each distance is measured, the actual size is obtained for each reference object, and the captured image is analyzed to calculate the image size for each measurement object and reference object. Each calculated size, perspective distance, and actual size of the reference object A computer-readable recording medium that records a program for realizing the function of calculating the actual size of the measurement object based on the above may be provided.

The block diagram which showed the basic component of the digital camera. The figure which illustrated the case where the measuring object X and the reference | standard object A are not in the perspective relationship (front-rear relationship) on the monitor image, but are in respectively the state where it is substantially side by side. The figure which illustrated the case where the measuring object X and the two reference objects A and B are in a perspective relationship (front-rear relationship) on the monitor image. The figure which showed that the real size of the measuring object X was calculated according to the 1st calculation formula, when the measuring object X is located in the middle of the reference objects A and B. The figure which showed that the actual size of the measuring object X was calculated according to the 2nd calculation formula, when the measuring object X is located back rather than the reference | standard objects A and B The figure which showed that the actual size of the measuring object X was calculated according to the 3rd calculation formula, when the measuring object X is located in front of the reference objects A and B. The figure which showed the content of the reference | standard object table 11. FIG. The flowchart which showed the outline | summary of the whole operation | movement of the digital camera started execution according to power activation. The flowchart which detailed the size measurement process performed according to operation of a size measurement button at the time of imaging | photography mode. The flowchart which showed the 1st measurement process performed in the size measurement process of FIG. The flowchart which showed the 2nd measurement process performed in the size measurement process of FIG. The figure which showed the measurement start screen. The figure which showed the display screen of the measurement result after execution of a 1st measurement process. The figure which showed the display screen of the measurement result after execution of a 2nd measurement process.

Explanation of symbols

1 CPU
2 storage unit 4 recording medium 5 operation unit 6 display unit 7 camera photographing unit 8 image memory 11 reference object table X measurement object A, B reference object

Claims (15)

A size measuring device for measuring the actual size of a subject included in a captured image,
In addition to designating a subject in the captured image as a measurement target to be size-measured, a designation means for designating a plurality of other subjects present in the captured image as reference targets to be compared with the measurement target;
Measuring means for measuring the distance in the front-rear direction between the specified measurement object and a plurality of reference objects in the captured image;
Obtaining means for obtaining the actual size for each of the plurality of designated reference objects;
Calculation means for calculating the image size for each measurement object and reference object by analyzing the captured image, and calculating the actual size of the measurement object based on each calculated size, each perspective distance, and the actual size of each reference object When,
A size measuring device comprising: The designation means designates an image portion located in the center portion by analyzing a captured image as a measurement target.
2. The size measuring apparatus according to claim 1, wherein the size measuring apparatus is configured as described above. The specifying means searches for a plurality of subjects characteristically matching any of a plurality of types of reference targets stored and managed in advance among the subjects included in the photographed image, thereby at least two Specify the reference target,
2. The size measuring apparatus according to claim 1, wherein the size measuring apparatus is configured as described above. The designation means designates two reference objects having different longitudinal positions in a plane coordinate system in which a photographed image is developed and having a perspective relationship,
4. The size measuring apparatus according to claim 3, wherein the size measuring apparatus is configured as described above. The designation means designates the same reference object or a reference object having substantially the same size when designating two reference objects in perspective relation,
4. The size measuring apparatus according to claim 3, wherein the size measuring apparatus is configured as described above. The measuring means measures the vertical component in the vertical direction as a perspective distance in a plane coordinate system in which a photographed image is developed when measuring the perspective distance in the front-rear direction between the measurement target and the plurality of reference targets. ,
The size measuring device according to claim 1, which is configured as described above. The measuring means measures a perspective distance between one reference object and the measurement object and a perspective distance between the other reference object and the measurement object, or one of the two reference objects in a perspective relationship, Measure the perspective distance between the reference object and the measurement object and the distance between each reference object.
The size measuring device according to claim 6, which is configured as described above. In a state where the actual size is stored and managed in advance corresponding to a plurality of types of reference objects, the acquisition unit reads and acquires the actual size corresponding to the designated reference object.
2. The size measuring apparatus according to claim 1, wherein the size measuring apparatus is configured as described above. Providing a discriminating means for discriminating the anteroposterior relationship between the designated measurement object and a plurality of reference objects by analyzing the captured image
The calculation means calculates the actual size of the measurement object according to the calculation formula corresponding to the context determined by the determination means,
2. The size measuring apparatus according to claim 1, wherein the size measuring apparatus is configured as described above. In a state where a captured image including the measurement target is displayed, the actual size is displayed in association with the measurement target in the captured image.
2. The size measuring apparatus according to claim 1, wherein the size measuring apparatus is configured as described above. Against the computer,
In addition to designating a subject in a captured image as a measurement target to be size measured, a function of designating a plurality of other subjects present in the captured image as reference targets to be compared with the measurement target,
A function of measuring the perspective distance in the front-rear direction between the specified measurement object and a plurality of reference objects in the captured image;
A function of acquiring the actual size for each of the plurality of designated reference objects;
A function of calculating the image size for each measurement target and reference target by analyzing the captured image, and calculating the actual size of the measurement target based on each calculated size, each perspective distance, and the actual size of each reference target; ,
A program to realize A size measuring device for measuring the actual size of a subject included in a captured image,
In addition to specifying the subject in the captured image as a measurement target to be size measurement, a designation means for specifying a reference target to be compared with this measurement target,
Discriminating means for discriminating whether the specified measurement object and the reference object are in a context in the captured image by analyzing the captured image;
When it is determined by this determination means that there is no context, the actual size of the reference object is acquired, and the image size is calculated for each measurement object and reference object by analyzing the captured image. A first calculating means for calculating the actual size of the measurement object based on the calculated size and the actual size of the reference object;
When it is determined by the determination means that there is a front-rear relationship, the distance in the front-rear direction between the specified measurement object and the reference object in the captured image is measured, and the actual size of each reference object is measured. The image size is calculated for each measurement object and reference object by analyzing the captured image, and the actual size of the measurement object is calculated based on each calculated size, each perspective distance, and the actual size of the reference object. A second calculating means;
A size measuring device comprising: The designation means designates, as a reference target, an image portion of a subject that characteristically matches any of a plurality of types of reference targets stored and managed in advance among the subjects included in the captured image.
The size measuring apparatus according to claim 10, which is configured as described above. Analyzing the captured image to determine the front-to-back relationship between the specified measurement object and the reference object, and the calculation means calculates the actual size of the measurement object according to a calculation formula corresponding to the front-rear relationship,
The size measuring apparatus according to claim 10, which is configured as described above. Against the computer,
In addition to specifying the subject in the captured image as the measurement target for size measurement, the function to specify the reference target to be compared with this measurement target,
A function of determining whether the designated measurement object and the reference object are in a context in the captured image by analyzing the captured image;
When it is determined that there is no context, the actual size of the reference object is acquired, and the image size is calculated for each measurement object and reference object by analyzing the captured image. A function for calculating the actual size of the measurement target based on the actual size of the target;
When it is determined that there is a front-rear relationship, the distance in the front-rear direction between the specified measurement object and the reference object in the captured image is measured, and the actual size is obtained for each reference object. A function for calculating the image size for each measurement object and reference object by analyzing the captured image, and calculating the actual size of the measurement object based on each calculated size, each perspective distance and the actual size of the reference object,
A program to realize

Images