JP2005181034A - Size measurement device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable a measurement of the actual size of a measurement object included in a photographed image, by analyzing the photographed image while taking into account of the front-to-rear relationship (perspective relationship) between the object of the size measurement and a reference object to be compared with the measurement object. <P>SOLUTION: In the state in which the measurement object and the reference object are specified in a monitor image photographed by a camera photographing part 7, after acquiring the ratio of the distance of the measurement object to that of the reference object and the actual size of the reference object, a CPU 1 calculates the image size for each of the measurement object and the reference object, by analyzing the photographed image, and calculates the actual size of the measurement object, on the basis of each calculated size, the distance ratio, and the actual size of the reference object. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a size measuring apparatus and program for measuring the actual size of a subject included in a captured image.

Conventionally, as a technique for measuring the size of a subject by camera shooting, for example, the distance from the lens position measured by a distance sensor provided in the camera to the subject, and an arbitrary part of the subject displayed on the display, A digital camera is known in which an actual dimension of a subject is measured based on a shooting angle of view of a lens (see Patent Document 1). In addition, the fish species discrimination is based on the display screen to determine the actual size of the fish shadow based on the focal length of the underwater camera and the distance to the fish captured by the transducer integrated in the underwater camera. An apparatus is known (see Patent Document 2).
Japanese Patent Application Laid-Open No. 11-344311 Japanese Patent Laid-Open No. 5-31947

 However, in the above-described digital camera for measuring the actual size of the subject and the fish type discriminating apparatus for measuring the actual size of the fish shadow, a relatively high accuracy measurement result can be obtained. This is based on the premise that shooting is performed in a state where the target subject is in focus, and each time the size of the subject is measured, it is necessary to take one photo for each subject while focusing on the subject.

The subject of the first invention is included by analyzing a captured image in consideration of the front-to-back relationship (perspective relationship) between a subject to be measured for size and a reference subject to be compared with the subject to be measured. The subject of the second invention is to be able to measure the actual size of the measurement target being measured, and separately photograph the subject to be measured and the reference subject to be compared with the subject to be measured However, the actual size of the measurement object can be measured based on the actual size of the reference object.

The invention according to claim 1 (first invention) is a size measuring device for measuring the actual size of a subject included in a photographed image, wherein the subject in the photographed image is a target for size measurement. In addition to designating as a target, obtaining means for designating a reference target to be compared with the measurement target, and obtaining a distance ratio between the designated measurement target and the reference target, and obtaining an actual size of the reference target And calculating the image size for each measurement target and reference target by analyzing the captured image, and calculating the actual size of the measurement target based on each calculated size, the distance ratio, and the actual size of the reference target Furthermore, a program for causing a computer to realize the main functions shown in the invention described in claim 1 is provided (the invention described in claim 10). ).

The invention described in claim 1 may be as follows.
The designating unit designates an image portion located in the center portion by analyzing a captured image as an object to be measured (the invention according to claim 2).

  A mode switching unit that switches between a measurement target shooting mode and a reference target shooting mode is provided, and the specifying unit specifies an image portion included in a predetermined area in the captured image in the measurement target shooting mode as a measurement target, An image portion included in a predetermined area in the photographed image in the reference object photographing mode is designated as a reference object.

  The designation means designates, as a reference object, an image portion that characteristically matches any of a plurality of types of reference objects stored and managed in advance among the subjects included in the captured image. Described invention).

  In a state where the actual size is stored and managed in advance corresponding to a plurality of types of reference objects, the acquisition unit reads out and acquires the actual size corresponding to the specified reference object (the invention according to claim 5).

  A work area for size measurement is prepared by adding a non-photographing area to the actual photographing area where the photographed image in the visual field corresponding to the camera angle of view is developed, thereby expanding the visual field virtually to the camera position. The acquisition means uses the position in the non-photographing area corresponding to the camera position as a measurement base point, and the acquisition means obtains a virtual distance from the measurement base point to the measurement object and the reference object in the real photographing area and calculates the distance ratio thereof. Calculated and acquired (invention of claim 6).

  When the measurement object and the reference object are individually photographed, the acquisition unit obtains the virtual distance from the base point on the virtual region to the measurement object and the virtual distance to the reference object individually, The distance ratio is calculated and acquired (the invention according to claim 7).

  After acquiring the actual size and the image size of the reference object, every time the measurement object is designated, the actual size of the designated measurement object is calculated (the invention according to claim 8).

  In a state where a captured image including the measurement target is displayed, the actual size is displayed in the captured image in association with the measurement target.

The invention according to claim 11 (second invention) is a size measuring device for measuring an actual size of a subject included in a photographed image, wherein a measurement object to be size-measured in the photographed image is selected. First specifying means for specifying, second specifying means for specifying a reference object to be compared with the measurement object in another captured image different from the captured image, and an actual size of the reference object The acquisition means for acquiring the actual size shown, and the image size for each measurement target and reference target are calculated by analyzing the captured image, and the actual size of the measurement target is calculated based on each calculated size and the actual size of the reference target. And a calculating means for calculating the size.
Furthermore, a program for realizing the main functions shown in the invention described in claim 1 is provided to the computer (the invention described in claim 15).

The invention described in claim 11 may be as follows.
The second designating unit designates, as a standard target, a subject that characteristically matches any of a plurality of types of standard targets stored and managed in advance when designating the standard target, The actual size stored and managed in advance corresponding to the designated reference object is read out and acquired (invention of claim 12).

  Display means for guiding and displaying each characteristically matching candidate when a subject that is characteristically matched with any of a plurality of types of reference objects stored and managed in advance is designated as the reference object; The designating means designates a candidate arbitrarily selected from the candidate display as a reference object (the invention according to claim 13).

  When there is no candidate that characteristically matches any of a plurality of types of reference objects that are stored and managed in advance, guidance that prompts the user to re-photograph so as to include the reference objects is output (guidance). Item 14).

  According to the first aspect of the present invention, in the state in which the subject in the captured image is designated as the measurement target to be the size measurement target and the reference target to be compared with the measurement target is designated, The distance ratio between the reference object and the actual size of the reference object is obtained, and the image size is calculated for each measurement object and reference object by analyzing the captured image, and each calculated size, distance ratio, and reference Since the actual size of the measurement target is calculated based on the actual size of the target, the actual size of the measurement target is determined by analyzing the captured image while taking into account the front-to-back relationship (perspective relationship) between the measurement target and the reference target. In addition to being able to measure, once the reference object is designated, the actual size of each measurement object can be calculated and measured any number of times using the same reference object. In addition, when a plurality of measurement objects are specified in the captured image, the actual size can be measured for each measurement object. Furthermore, size measurement can be performed not only at the time of shooting but also at the time of image reproduction, and the size can be freely measured at any time as necessary. Therefore, not only when this size measuring device is incorporated into a digital camera, but also by incorporating it into an image data processing device such as a personal computer, the range of use can be expanded and it can be used for various applications.

  According to the invention described in claim 2, in addition to having the same effect as that of the invention described in claim 1, the image portion located in the central portion is designated as the measurement object by analyzing the photographed image. Therefore, the measurement target can be automatically specified by image analysis, a special operation is not necessary, and the measurement target can be reliably specified.

  According to the invention described in claim 3, in addition to having the same effect as that of the invention described in claim 1 described above, in the measurement object shooting mode, an image portion included in a predetermined area in the captured image is measured. In the reference target shooting mode, the image portion included in a predetermined area in the captured image is specified as the reference target, so that the measurement target is analyzed by analyzing each individually captured image, It is possible to automatically specify the reference object, no special operation is required, and it is possible to reliably specify the measurement object and the reference object.

  According to the invention described in claim 4, in addition to having the same effect as that of the invention described in claim 1, a plurality of types of reference objects stored and managed in advance among the subjects included in the photographed image. Since a subject that characteristically matches any of the above is designated as a reference target, it is possible to automatically designate the reference target by image analysis, and to reliably designate the reference target.

  According to the invention described in claim 5, in addition to having the same effect as that of the invention described in claim 1 described above, in the state where the actual size is stored and managed in advance corresponding to a plurality of types of reference objects, the acquisition means Since the actual size corresponding to the designated reference object is read out and acquired, the actual size of the reference object can be automatically acquired, and no special operation is required.

  According to the invention described in claim 6, in addition to the same effect as the invention described in claim 1, the non-shooting area is added to the actual shooting area where the shot image within the field of view corresponding to the camera angle of view is developed. In the state where the work area for size measurement in which the field of view is virtually expanded to the camera position is prepared, the actual position is taken from the measurement base point with the position in the non-photographing region corresponding to the camera position as the measurement base point. Since the virtual distance to the measurement object and reference object in the area is calculated and the distance ratio between them is calculated and acquired, the measurement object and reference object can be analyzed by analyzing the captured image without using a distance sensor etc. The distance ratio to can be calculated and acquired.

  According to the seventh aspect of the present invention, in addition to the same effects as the first and sixth aspects of the present invention, when the measurement object and the reference object are individually photographed, the measurement is performed from the base point on the virtual area. After obtaining the distance to the target and the distance to the reference object individually, the distance ratio between them was calculated and acquired, so even if the measurement object and the reference object were shot separately, the actual size of the reference object was Based on this, the actual size of the measurement object can be measured.

  According to the eighth aspect of the invention, in addition to having the same effect as the first aspect of the invention described above, the measurement target is designated every time the measurement target is designated after acquiring the actual size and the image size of the reference target. Since the actual size of the measured object is calculated, the actual sizes of a plurality of measured objects can be measured based on one reference object.

  According to the ninth aspect of the present invention, in addition to having the same effect as that of the first aspect of the present invention described above, in the state in which the photographed image including the measurement target is displayed, this measurement is included in the photographed image. Since the actual size is displayed in association with the object, the measurement object can be viewed while checking the size in the captured image, and the correspondence between the measurement object and the actual size becomes clear.

  According to the eleventh aspect of the invention, in the state where the measurement target is specified in the captured image and the reference target is specified in another captured image different from the captured image, the actual size of the reference target The image size is calculated for each measurement target and reference target by analyzing the captured image, and the actual size of the measurement target is calculated based on each calculated size and the actual size of the reference target. Therefore, even if the subject to be measured and the subject to be referenced are photographed separately, the actual size of the subject to be measured can be measured based on the actual size of the reference subject. In addition, when a plurality of measurement objects are specified in the captured image, the actual size can be measured for each measurement object. Furthermore, size measurement can be performed not only at the time of shooting but also at the time of image reproduction, and the size can be freely measured at any time as necessary. Therefore, not only when this size measuring device is incorporated into a digital camera, but also by incorporating it into an image data processing device such as a personal computer, the range of use can be expanded and it can be used for various applications.

  According to the invention described in claim 12, in addition to having the same effect as that of the invention described in claim 11 described above, when specifying the reference object, it is characterized by any of a plurality of types of reference objects stored and managed in advance. Automatically matching the specified subject as a reference target, and reading and acquiring the actual size stored and managed in advance corresponding to the specified reference target. It is possible to specify and to automatically acquire the actual size of the reference object.

  According to the thirteenth aspect of the present invention, in addition to the same effect as the above-described eleventh aspect of the present invention, a subject that characteristically matches any of a plurality of types of reference targets that are stored and managed in advance is used as a reference target. In the state where each candidate that is characteristically matched is displayed as guidance, the candidate arbitrarily selected from the candidate display is designated as the reference object. Can be specified.

  According to the invention described in claim 14, in addition to the same effects as those of the invention described in claims 11 and 13, the candidate that characteristically matches any of a plurality of types of reference objects stored and managed in advance is provided. In the case where it does not exist, the guidance that prompts the user to re-photograph so as to include the reference object is guided and output, so that a predetermined reference object can be reliably specified.

Embodiments of the present invention will be described below with reference to FIGS.
FIG. 1 is a block diagram showing basic components of a digital camera in this embodiment.
This digital camera is capable of measuring the actual size of the subject included in the captured image (monitor image). When the size measurement is instructed before the subject is actually photographed, the digital camera that has photographed the subject on the monitor It has a size measurement function that measures the actual size of the subject by analyzing the image and displays it on the monitor screen. In this case, the actual size of the measurement target is measured by analyzing the monitor image while taking into account the front-to-back relationship (perspective relationship) between the subject to be measured and the reference subject to be compared with this measurement target. It is trying to display. In addition, even if the subject to be measured and the reference subject to be compared with this subject are photographed separately, the actual size of the subject is measured and displayed based on the actual size of the reference subject. I am doing so.
Before detailed description of the features of this embodiment, the hardware configuration of this embodiment will be described below.

  The CPU 1 is a central processing unit that controls the overall operation of the digital camera in accordance with the operating system and various application software in the storage unit 2. The storage unit 2 is a fixed memory such as a hard disk, and has a program storage area and a data storage area. The program storage area in the storage unit 2 stores an application program for realizing the present embodiment in accordance with the operation procedure shown in FIGS. 7 to 10 described later, and the data storage area stores FIG. 6 described later. (Reference target table) is stored. The program and data are loaded into the work memory 3 as necessary, and the data in the work memory 3 is saved in the storage unit 2. The recording medium 4 is a removable memory such as a DVD, and exchanges programs, image data, and the like with the storage unit 2 and the work memory 3. The work memory 3 is provided with a size measurement work area (image memory for measurement) 30 described later.

  On the other hand, an operation unit 5, a display unit 6, a camera photographing unit 7, and an image memory 8 which are input / output peripheral devices are connected to the CPU 1 via a bus line, and the CPU 1 inputs these according to an input / output program. Controls the operation of the output device. The operation unit 5 has various function keys such as a shutter button, a mode button for switching to a shooting mode / playback mode, and a size measurement button for instructing start of size measurement, and an operation signal is given to the CPU 1. The display unit 6 is, for example, a liquid crystal display unit with a touch panel, and is used as a monitor screen / finder screen / image reproduction screen. The camera photographing unit 7 includes a photographing lens, a lens / mirror block such as a mirror, an image sensor such as a CCD image sensor, a driving system thereof, and the like, and sequentially transfers the photographed image to the image memory 8 for each photographing. Adjusts and controls the shooting direction (the direction of the lens) and the zoom mechanism, controls driving during autofocus, shutter drive control, shutter speed, exposure, white balance, etc., and captures captured images. Then, when the size measurement button is operated in the shooting mode, the size measurement function is activated to measure and display the actual size of the subject included in the monitor image.

2 and 3 are diagrams for explaining the above-described size measurement work area (measurement image memory) 30. FIG. 2 shows the configuration of the measurement image memory 30. As shown in FIG.
The measurement image memory 30 includes an actual shooting area 31 where a monitor image in a field of view corresponding to a camera angle of view is developed, and a camera position (lens) from the lower end of the field of view (in other words, the lower end of the monitor image). The non-photographing area 32 having a size approximately proportional to the distance width to the position) is added, and the non-photographing area 32 is added below the actual photographing area 31 so that the field of view is virtually reached to the camera position. It is an enlarged one.

  FIG. 3 is a diagram illustrating a state in which the camera is directed toward the subject for the purpose of explaining the measurement image memory 30. Here, with respect to the field of view BW corresponding to the camera angle of view, outside this field of view (broken line portion in the figure: outside the object to be photographed), the area BX outside the object to be photographed from the lower end of the field of view BW to the camera position is the camera body. The distance from the lower end of the field of view BW to the camera position in a state where the height and shooting angle of the camera body are fixed, that is, The width of the area BX is constant. In this embodiment, the case where the camera body is photographed in a fixed state without changing the height or photographing angle of the camera body is illustrated. When the non-photographing area 32 having a size approximately proportional to the length of the area BX is added below the actual photographing area 31, the position in the non-photographing area 32 corresponding to the camera position is used as the measurement base point BP. Is set. That is, a position that is separated from the lower end portion of the actual photographing region 31 (the lower end portion of the monitor image) by the width of the non-photographing region 32 is set as the measurement base point BP. Here, the CPU 1 measures a virtual distance S <b> 1 from the measurement base point BP to the subject (tree) A in the actual photographing region 31 on the measurement image memory 30. Hereinafter, the subject A is referred to as a measurement target that is a size measurement target.

FIG. 4 is a diagram showing an object (reference object) serving as a reference for size measurement on the measurement image memory 30 and a virtual distance from the measurement base point to the reference object.
Here, when another subject B (traffic sign) photographed separately from the measurement target A is a reference target B to be compared with the measurement target A, the CPU 1 performs measurement on the measurement image memory 30 as described above. A virtual distance S0 from the base point BP to the reference object (traffic sign) B in the actual photographing region 31 is measured. Then, the CPU 1 calculates and acquires the distance ratio based on the virtual distances S1 and S0 of the measurement target A and the reference target B, and performs processing for calculating the actual size of the measurement target in consideration of the distance ratio. When the reference object B is photographed, the camera is photographed in accordance with the “vertical center line” on the monitor screen while the camera height and the photographing angle when the measurement object A is photographed are fixed. ing.

  FIG. 5 is a diagram illustrating the relationship between the distance from the camera position to the actual measurement object A and the reference object B and the relationship between the monitor images when the measurement object and the reference object having a perspective relationship are separately photographed. . Here, since the actual distances L1 and L0 from the camera position to the actual measurement object A and the reference object B are substantially proportional to the virtual distances S1 and S0 described above, the CPU 1 takes these distance ratios into account. A process for calculating the actual size of the measurement object is performed. In this case, the CPU 1 calculates the image size of the measurement object A by analyzing the monitor image obtained by photographing the measurement object A, and analyzes the other monitor image obtained by photographing the reference object B. After calculating the size and obtaining the actual size indicating the actual size of the reference object B, measurement is performed based on the distance ratio between the image size of the measurement object A and the reference object B and the virtual distance and the actual size of the reference object. The actual size of the target A is calculated.

FIG. 6 is a diagram showing the contents of the reference target table 11.
The reference object table 11 is configured to store and manage “image data”, “reference object name”, and “actual size data” for each reference object arbitrarily registered in advance. As described above, “image data” is an image of a reference object to be compared with a measurement object at the time of size measurement, and is obtained by arbitrarily photographing and registering a subject whose actual size is known. It is a photographed image of a road sign, a post box, a fire hydrant, a building and its window frame. The “reference object name” is a general name of the reference object. In this case, the CPU 1 automatically identifies the reference object included in the captured image by analyzing the captured image. At that time, a plurality of types of reference objects registered in the reference object table 11 are used. An image portion of a subject that characteristically matches any of the above is specified as a reference target.

  The “actual size data” is divided into actual sizes for each direction corresponding to the “vertical dimension”, “horizontal dimension”, and depth dimension ”, and the CPU 1 arbitrarily selects from the actual sizes for each direction in advance. The actual size in the selected direction is read out. In other words, the direction in which the actual size is read out among “vertical dimension”, “horizontal dimension”, and depth dimension ”can be arbitrarily selected and designated in advance, and the CPU 1 refers to this designation content. The actual size in the corresponding direction is read out. Depending on the type of the reference object, any one of “vertical dimension”, “horizontal dimension”, and depth dimension ”may be registered.

  Next, the operation concept of the digital camera in this embodiment will be described with reference to the flowcharts shown in FIGS. Here, each function described in these flowcharts is stored in the form of a readable program code, and operations according to the program code are sequentially executed. In addition, the operation according to the above-described program code transmitted via the transmission medium can be sequentially executed. In other words, in addition to the recording medium, the program / data supplied externally via the transmission medium can be used to execute the operation specific to this embodiment.

FIG. 7 is a flowchart showing an outline of the overall operation of the digital camera, which starts executing in response to power-on.
First, in a state where the photographing mode is set (step A1), the CPU 1 sequentially captures monitor images (step A2) and displays them as moving images on the monitor screen (step A3). In this state, the presence / absence of button operation is checked (step A4). If no button is operated (NO in step A4), the monitor image capturing is resumed (step A2), but now the shutter button is operated. When this happens (step A5), the captured image at that time is recorded and saved as an image file (step A6), and then the process returns to capturing the monitor image (step A2).

   On the other hand, when the shooting mode is switched to the playback mode (step A7), a playback process is performed in which the recorded images are played back and displayed sequentially while selecting and specifying the recorded images in the forward / reverse directions according to the user instruction (step A8). Thereafter, when the playback mode is switched to the shooting mode (step A9), the process returns to the process of capturing the monitor image (step A2). Here, when the size measurement button is operated in the photographing mode (step A10), the process proceeds to a size measurement process for measuring the actual size of the measurement target included in the monitor image (step A11).

FIGS. 8 to 10 are flowcharts detailing the size measurement process executed in response to the operation of the size measurement button in the shooting mode.
First, the CPU 1 switches to the measurement object shooting mode in accordance with the operation of the size measurement button, and displays a measurement start screen (a message to the effect that the shutter operation is performed with the measurement object as the center) (displaying a message about the measurement object). 11 is displayed (step B1), a monitor image is acquired and displayed on the monitor (steps B2 and B3). In this state, the presence or absence of the shutter button is checked (step B4), and if there is no shutter operation, the process returns to step B2, but when the shutter operation is performed, the current monitor image is fixedly displayed (step B5), The subject image located at the center of the fixed monitor image is specified as the measurement target (step B6). Then, a frame surrounding the measurement target is generated and combined and displayed, and after a confirmation message is displayed (step B7), an operation waiting state is entered (step B8).

FIG. 12A is a diagram showing a confirmation message displayed on the fixed monitor screen. This confirmation message inquires the photographer about the suitability of the automatically specified subject, and according to the suitability (OK / NG). The function keys F1 / F2 are urged to be operated. If OK, the F1 key is operated. If NG, the F2 key is operated. Here, step B9 discriminates the operation key, and if the F2 key is operated, the process returns to step B2.
FIG. 12B shows a confirmation message when the shutter operation is performed after adjusting the shooting direction or the like so that another target subject comes to the center of the monitor image.

  Here, when the F1 key is operated, the fixed monitor image is read out and transferred to the actual photographing region 31 of the measurement image memory 30 (step B10). Then, a measurement target image size (measurement target frame size) G1 is calculated on the actual photographing region 31 (step B11). The image size “G1” is a size on an image sensor such as a CCD, and per one dot in the vertical direction based on the horizontal / vertical dimensions of the entire effective area and the horizontal / vertical dot size of the entire effective area. Dimension (vertical pitch) / dimension per dot (horizontal pitch) in the horizontal direction, and converted into size information based on this dot pitch (hereinafter the same). Then, the virtual distance S1 from the measurement base point BP to the measurement target in the actual photographing region 31 is calculated and measured on the measurement image memory 30 (step B12). Thereafter, the fixed monitor image, image size (measurement target frame size) G1, and virtual distance S1 in the measurement image memory 30 are transferred to a save memory (not shown) of the work memory 3 (step B13).

Next, it is checked whether or not the reference object has been photographed (step B14). If the photographing has not been performed yet, the reference object photographing mode is switched from the above-described measurement object photographing mode to the reference object photographing mode. Then, the process proceeds to Step B15 in Step 9, and the reference target photographing guide screen is displayed.
FIG. 13 is a diagram showing a reference target shooting guide screen, and displays a message indicating that a reference target sample can be displayed together with notes regarding shooting of the reference target. Here, as precautions for shooting, the message that the reference target is set to the vertical center line on the monitor screen and the shutter operation is performed, and the angle and height in the vertical direction when the measurement target is shot are not changed. A message to the effect that the photograph should be taken is displayed, and a message to the effect that the F1 key should be operated is displayed when it is desired to display the reference target sample.

  Next, after acquiring the monitor image (step B16), as shown in FIG. 14, the vertical center line is additionally displayed on the monitor screen (step B17). In this state, the shutter operation (step B18) and the presence / absence of the F1 key operation are checked (step B19). If the F1 key is operated, the reference target sample is displayed (step B20). That is, the reference object table 11 is accessed to read out the “image data” and “reference object name” for each reference object and display a sample list (thumbnail display). Here, after confirming the contents of the sample list display, the photographer performs the photographing again so as to include a desired sample. Thereafter, the process returns to step B16 to reacquire the monitor image.

If the shutter operation is performed (step B18), the current monitor image is fixedly displayed (step B21), and the subject located on the vertical center line in the fixed monitor image is specified as the reference target. Then, a frame surrounding the reference object is generated and combined and displayed (step B22). Then, after reading out the fixed monitor image and transferring it to the actual photographing area 31 of the measurement image memory 30 (step B23), the image portion in the reference target frame is extracted from the measurement image memory 30, and based on the extracted image. The reference object table 11 is searched (step B24), and each reference object registered in the reference object table 11 and the extracted image are sequentially compared to check for the presence or absence of characteristically matching images (step B25). As a result, if the extracted image does not correspond to any reference target (NO in step B25), a re-shooting guide is displayed (step B26).
FIG. 15 is a diagram showing the re-shooting guide screen, in which a message indicating that the sample display should be confirmed is displayed together with a message indicating no match. Thereafter, the process returns to step B15 to redisplay the reference target photographing guide screen.

On the other hand, if the extracted image corresponds to any reference object (YES in step B25), one corresponding reference object is checked (step B27), and if there is one, the process proceeds to step B30. If there is a match, a candidate selection guide is displayed (step B28).
FIG. 16 is a diagram showing the candidate selection guide screen, in which a plurality of corresponding reference target images are displayed as selection candidates. When an arbitrary candidate is selected and designated from the list display using the F1 key or the like (step B29), the process proceeds to the next step B30. This step B30 reads and acquires the actual size J0 by searching the reference object table 11 based on the selected reference object.

Next, the process proceeds to step B31 in FIG. 10, and the reference target image size (reference target frame size) G0 is calculated on the actual photographing region 31 of the measurement image memory 30. Then, on the measurement image memory 30, a virtual distance S0 from the measurement base point BP to the reference object in the actual photographing region 31 is calculated and measured (step B32). As a result, when all of the reference target actual size J0 and the frame size G0 and the measurement target frame size G1 have been prepared, a calculation process is performed to obtain the actual measurement target size using these values as parameters (step B33). That is, the measurement target image size (measurement target frame size) G1 and its virtual distance S1 are read from the save memory of the work memory 3, and the reference target and measurement target frame sizes G0 and G1, the virtual distances S0 and S1, and the reference Based on the actual size J0 of the target, the actual size J0 of the measurement target is calculated according to the following equation.
Actual size J1 = G1 / G0 * J0 * S1 / S0

  The actual size of the measurement target calculated in this way is a value obtained by multiplying the ratio of the virtual distance, the ratio of the target frame size, and the actual size of the reference target, but the calculated value is an approximate size. Next, the monitor image to be measured is read from the save memory of the work memory 3 and set in the monitor image memory (not shown) to redisplay the monitor image to be measured (step B34). In this state, the actual size of the measurement target is synthesized and displayed in the vicinity of the measurement target frame of the monitor image, and the message data is synthesized and displayed (step B35).

  FIG. 17 exemplifies the monitor screen in this case, and shows a case where the automatically calculated horizontal dimension and vertical dimension are displayed as the actual size of the measurement target. As shown in the figure, a message indicating the completion of the size measurement and a message for guiding the subsequent operation are displayed on the monitor screen. The F1 key is operated when the actual size measurement is continued for another measurement object, and the F0 key is operated when the size measurement is ended. Here, in the operation waiting state (step B36), when the F0 key is operated (step B37), the process exits this flow and returns to the normal state, but when the F1 key is operated (in step B37). NO), the process returns to the first step B1 in FIG. 8 to switch to the measurement start screen, and then the above-described operation is repeated. In this case, since the reference object has already been photographed (YES in step B14), the process proceeds to step B33 in FIG. 10, and the actual size calculation for the new measurement object is performed using the reference object photographed last time. In other words, once the reference object is photographed, it is not necessary to photograph the reference object, and each time a new measurement object is photographed, the actual size of each measurement object is measured any number of times using the same reference object. can do.

  As described above, in this embodiment, in the state where the measurement object and the reference object are specified in the monitor image captured by the camera photographing unit 7, the CPU 1 determines the distance ratio between the measurement object and the reference object. After acquiring the actual size of the reference object, calculate the image size for each measurement object and reference object by analyzing the captured image, and measure the measurement object based on the calculated size, distance ratio, and the actual size of the reference object. Since the actual size of the measurement object is calculated, the actual size of the measurement object can be measured by analyzing the monitor image while taking into account the front-to-back relationship (perspective relation) between the measurement object and the reference object. Once the image is taken, it is no longer necessary to shoot the reference object, and each time a new measurement object is photographed, the actual size of each measurement object can be measured with the same reference object. It can be calculated. In addition, when a plurality of measurement objects are specified in the monitor image, the actual size can be measured for each measurement object.

  In this case, after identifying the measurement object and the reference object by analyzing each monitor image separately photographed for each measurement object imaging mode and the reference object imaging mode, the actual size of the reference object is acquired and the measurement object Since the image size is calculated for each reference object, and the actual size of the measurement object is calculated based on each calculated size and the actual size of the reference object, the measurement object and the reference object are photographed separately. However, the actual size of the measurement object can be measured based on the actual size of the reference object.

  Further, since the CPU 1 analyzes the monitor image and identifies the image portion located in the center portion as the measurement target, the measurement target can be automatically specified by the image analysis, and no special operation is required. In addition, it is possible to reliably specify the measurement target. In the measurement target shooting mode, the image portion included in the central portion of the monitor image is specified as the measurement target. In the reference target shooting mode, the subject on the vertical center line in the monitor image is set as the reference target. Since each monitor image taken individually is analyzed, the measurement target and reference target can be automatically specified by analyzing each monitor image, and no special operation is required, and the measurement target and reference target can be specified reliably. It becomes possible.

  Since each subject included in the monitor image is searched for and specified as a reference target, a subject that is characteristically matched with any of a plurality of types of reference targets stored and managed in the reference target table 11, Image analysis enables automatic identification of a reference object, and can also reliably identify a reference object. In this case, when a plurality of reference objects are searched, they are displayed in a list as selection candidates, and candidates arbitrarily selected from the candidate display are specified as reference objects. Can be easily identified. In addition, when a corresponding reference object is not searched, guidance for prompting re-photographing to include the reference object is displayed, so that the reference object can be reliably identified. Furthermore, since the actual size corresponding to each reference object is stored and managed in the reference object table 11, the actual size corresponding to the reference object can be read, and the actual size of the reference object can be automatically acquired. No special operation is required.

  In the measurement target shooting mode, the virtual distance from the measurement base point BP to the measurement target in the actual shooting area 31 is calculated and measured on the measurement image memory 30. In the reference target shooting mode, the virtual distance from the measurement base point BP is calculated in the actual shooting area 31. Since the virtual distance to the reference object is calculated and measured, and the distance ratio between them is calculated, the monitor image can be analyzed even if the measurement object and the reference object are photographed separately or without using a distance sensor or the like. By doing so, the distance ratio between the measurement object and the reference object can be obtained.

  After acquiring the actual size and image size of the reference object, every time the measurement object is photographed, the actual size of the measurement object is calculated. Therefore, the actual sizes of a plurality of measurement objects are calculated based on one reference object. Can be measured. In addition, when the actual size of the measurement target is calculated, the actual size is displayed in association with the measurement target in the monitor image including the measurement target. The measurement object can be seen while performing, and the correspondence between the measurement object and its actual size becomes clear.

  In the above-described embodiment, the measurement target and the reference target are automatically specified by analyzing the monitor image. However, the photographer arbitrarily designates the measurement target and the reference target on the monitor screen. May be. In this case, when an arbitrary position is touched (point specified) on a monitor screen with a touch panel, the measurement target or reference target is specified in consideration of the continuity of the image at the specified point. Also good. In this case, when a touch designation is made on an arbitrary measurement object or reference object, if the touch designation is made along the contour, the measurement object or reference object can be easily specified.

In the above-described embodiment, the case where shooting is performed with the camera shooting angle (vertical angle with respect to the horizontal direction) fixed is illustrated, but an angle sensor that measures the vertical angle with respect to the horizontal direction during shooting is provided and shown in FIG. The measurement base point BP on the measurement image memory 30 may be changed according to the vertical angle measured by the angle sensor. That is, the non-photographing area BX from the lower end of the visual field BW to the camera position varies depending on the vertical angle, but the non-photographing area 32 having a size approximately proportional to the length of the area BX is realized. The position of the measurement base point BP may be changed by adding to the lower side of the imaging region 31.
In the above-described embodiment, it is assumed that the measurement target and the reference target are on the same plane. However, even if the measurement target and the reference target are different in height, the actual size of the measurement target is set. Can be measured. In this case, in the above-described embodiment, the sizes of the measurement object and the reference object are specified in the monitor image. Therefore, even if the heights of the measurement object and the reference object are different, the actual size of the measurement object is set. It becomes possible to measure.

  In addition, when recording and saving a captured image in response to a shutter operation, if the actual size of the measurement target is also recorded and saved, the actual size of the measurement target associated with the captured image at the time of image playback Can be read and displayed. Further, the actual size of the measurement object is added to each captured image and stored in a recording medium, and this recording medium is inserted into an image data processing apparatus such as a personal computer to perform image reproduction. The actual size of the measurement object can be displayed for each image.

  In the embodiment described above, image data of a plurality of types of reference objects are arbitrarily registered in the reference object table 11, but the size is fixed, for example, a road sign, a post box, a fire hydrant or the like. If it is, the characteristic image of this comparison standard (for example, if it is a postbox, the cube, the aspect ratio, the whole is red) should be registered. May be. The contents of the reference object table 11 may be set and registered at the time of product purchase, and the user may additionally register an arbitrary reference object and its actual size as necessary.

In the above-described embodiments, the case where the present invention is applied to a digital camera is shown. However, it may be incorporated in an image data processing apparatus such as a personal computer, a camera-equipped mobile phone or a portable information device, and for various applications. It can be used. For example, after shooting at a construction site, civil engineering site, etc., when checking the status of the site while reproducing images at the company, the actual size of each part is measured and displayed based on each captured image Also good.
In addition, the size measuring device is not limited to a stand-alone type, but each component is physically separated into two or more cases, and wired transmission paths such as communication lines and cables, or wireless transmission such as radio waves, microwaves, and infrared rays. It may be a distributed system that transmits and receives data via a path.

  On the other hand, a recording medium (for example, a CD-ROM, a flexible disk, a RAM card, etc.) on which program codes for executing the above-described units are recorded may be provided to the computer. That is, a recording medium having a computer readable program code, and a function for designating a reference object to be compared with a measurement object in addition to designating a subject in a captured image as a measurement object to be subjected to size measurement In addition to obtaining the distance ratio between the specified measurement object and the reference object, the function of obtaining the actual size of the reference object and the image size for each measurement object and reference object are calculated by analyzing the captured image. In addition, a computer-readable recording medium having recorded thereon a program for realizing the function of calculating the actual size of the measurement target based on each calculated size, the distance ratio, and the actual size of the reference target is provided. May be.

  In addition, the computer-readable recording medium having a program code that specifies a measurement target to be a size measurement in the captured image, and the measurement target in another captured image different from the captured image. A function for specifying a reference object to be compared, a function for obtaining an actual size indicating the actual size of the reference object, and calculating an image size for each measurement object and reference object by analyzing a captured image A computer-readable recording medium that records a program for realizing the function of calculating the actual size of the measurement target based on each calculated size and the actual size of the reference target may be provided.

The block diagram which showed the basic component of the digital camera. The figure for demonstrating the work area (image memory for a measurement) 30 for size measurement. The figure which showed the state which orient | assigned the camera to the to-be-photographed object for description of the image memory 30 for a measurement. FIG. 5 is a diagram showing a subject (reference object) serving as a size measurement reference on the measurement image memory 30 and a virtual distance from the measurement base point to the reference object. The figure which showed the relationship between the distance relationship from a camera position to an actual measurement object and a reference object, and each monitor image, when the measurement object and the reference object which are in a perspective relationship are photographed separately. The figure which showed the content of the reference | standard object table 11. FIG. The flowchart which showed the outline | summary of the whole operation | movement of the digital camera started execution according to power activation. The flowchart which detailed the size measurement process performed according to operation of a size measurement button at the time of imaging | photography mode. FIG. 9 is a flowchart of size measurement processing following FIG. 8. FIG. The flowchart of the size measurement process following FIG. 8, FIG. The figure which showed the measurement start screen. (A) is a diagram showing a confirmation message displayed on the fixed monitor screen, and (B) is after adjusting the shooting direction to change the target other subject to the center of the monitor image. The figure which showed the confirmation message when shutter operation was performed. The figure which showed the reference | standard object imaging | photography guide screen. The figure which showed the vertical center line additionally displayed on the monitor screen. The figure which showed the re-shooting guide screen. The figure which showed the candidate selection guide screen. The figure which showed the monitor screen at the time of carrying out the composite display of the actual size of a measuring object in the vicinity of the measuring object frame of a monitor image.

Explanation of symbols

1 CPU
2 storage unit 4 recording medium 5 operation unit 6 display unit 7 camera imaging unit 8 image memory 11 reference object table 30 measurement image memory 31 actual imaging area 32 non-imaging area BP measurement base point S0, S1 virtual distance A measurement object B reference object

Claims (15)

A size measuring device for measuring the actual size of a subject included in a captured image,
In addition to specifying the subject in the captured image as a measurement target to be size measurement, a designation means for specifying a reference target to be compared with this measurement target,
In addition to acquiring the distance ratio between the specified measurement object and the reference object, acquisition means for acquiring the actual size of the reference object;
Calculating the image size for each measurement object and reference object by analyzing the captured image, and calculating means for calculating the actual size of the measurement object based on each calculated size and the distance ratio and the actual size of the reference object;
A size measuring device comprising: The designation means designates an image portion located in the center portion by analyzing a captured image as a measurement target.
2. The size measuring apparatus according to claim 1, wherein the size measuring apparatus is configured as described above. A mode switching means for switching between the measurement target shooting mode and the reference target shooting mode is provided,
The designating unit designates an image portion included in a predetermined area in the captured image in the measurement target imaging mode as a measurement target, and is included in the predetermined area in the captured image in the reference target imaging mode. Specify the image part as the reference target,
2. The size measuring apparatus according to claim 1, wherein the size measuring apparatus is configured as described above. The designation means designates, as a reference target, an image portion that characteristically matches any of a plurality of types of reference targets stored and managed in advance among the subjects included in the captured image.
2. The size measuring apparatus according to claim 1, wherein the size measuring apparatus is configured as described above. In a state where the actual size is stored and managed in advance corresponding to a plurality of types of reference objects, the acquisition unit reads and acquires the actual size corresponding to the designated reference object.
2. The size measuring apparatus according to claim 1, wherein the size measuring apparatus is configured as described above. A work area for size measurement is prepared by adding a non-photographing area to the actual photographing area where the photographed image in the visual field corresponding to the camera angle of view is developed, thereby expanding the visual field virtually to the camera position. The acquisition means uses the position in the non-photographing area corresponding to the camera position as a measurement base point, and the acquisition means obtains a virtual distance from the measurement base point to the measurement object and the reference object in the real photographing area and calculates the distance ratio thereof. Get calculated,
2. The size measuring apparatus according to claim 1, wherein the size measuring apparatus is configured as described above. When the measurement object and the reference object are separately photographed, the acquisition unit obtains the virtual distance from the measurement base point on the virtual region to the measurement object and the virtual distance to the reference object individually, Calculating and obtaining the distance ratio of
The size measuring device according to claim 6, which is configured as described above. After obtaining the actual size and image size of the reference object, each time the measurement object is designated, the actual size of the designated measurement object is calculated.
The size measuring device according to claim 1, which is configured as described above. In a state where a captured image including the measurement target is displayed, the actual size is displayed in association with the measurement target in the captured image.
2. The size measuring apparatus according to claim 1, wherein the size measuring apparatus is configured as described above. Against the computer,
In addition to specifying the subject in the captured image as the measurement target for size measurement, the function to specify the reference target to be compared with this measurement target,
In addition to acquiring the distance ratio between the specified measurement object and the reference object, a function of acquiring the actual size of the reference object;
A function of calculating the image size for each measurement target and reference target by analyzing the captured image, and calculating the actual size of the measurement target based on each calculated size, the distance ratio, and the actual size of the reference target;
A program to realize A size measuring device for measuring the actual size of a subject included in a captured image,
A first designation means for designating a measurement target to be a size measurement target in the captured image;
A second designation means for designating a reference object to be compared with the measurement object in another photographed image different from the photographed image;
Obtaining means for obtaining an actual size indicating an actual size of the reference object;
Calculating the image size for each measurement object and reference object by analyzing the captured image, and calculating means for calculating the actual size of the measurement object based on each calculated size and the actual size of the reference object;
A size measuring device comprising: The second designating unit designates, as a reference object, a subject that characteristically matches any of a plurality of types of reference objects stored and managed in advance when the reference object is designated.
The acquisition means reads out and acquires an actual size stored and managed in advance corresponding to the designated reference object.
The size measuring device according to claim 11, which is configured as described above. Provided with a display means for guiding and displaying each characteristically matching candidate when a subject characteristically matching any of a plurality of types of reference objects stored and managed in advance is designated as a reference object,
The second designation means designates a candidate arbitrarily selected from the candidate displays as a reference target.
The size measuring device according to claim 11, which is configured as described above. When there is no candidate that characteristically matches any of a plurality of types of reference objects stored and managed in advance, guidance guidance that prompts the user to re-photograph so as to include the reference object is guided and output.
The size measuring device according to claim 13, which is configured as described above. Against the computer,
In addition to designating a measurement target to be a size measurement target in the captured image, a function for specifying a reference target to be compared with the measurement target in another captured image different from the captured image;
A function of obtaining an actual size indicating an actual size of the reference object;
A function for calculating the image size for each measurement object and reference object by analyzing the captured image, and calculating the actual size of the measurement object based on each calculated size and the actual size of the reference object,
A program to realize

Images