JP2005181033A - Camera photographing device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable a measurement of the actual size of an object by analyzing photographed images successively acquired from a camera photographing part, and to enable a real-time measurement of the actual size, each time when a new object is detected. <P>SOLUTION: A size calculation process is performed, in which the actual size of the object is acquired, after the image recognition of the object (measurement object) is performed, by analyzing monitor images successively acquired from the camera photographing part 7, before the photographing is actually performed. In the process for performing a size display process for displaying the actual size of the object in a monitor image, when the new monitor image is acquired from the camera photographing part 7, a CPU 1 executes the size calculation process and the size display process for the new object, each time when it is detected that the new object not existing in the former monitoring image is included in the current monitor image. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a camera photographing apparatus and a program for measuring an actual size of a subject included in a photographed image acquired from a camera photographing unit.

Conventionally, as a technique for measuring the size of a subject by camera shooting, for example, the distance from the lens position measured by a distance sensor provided in the camera to the subject, and an arbitrary part of the subject displayed on the display, A digital camera is known in which an actual dimension of a subject is measured based on a shooting angle of view of a lens (see Patent Document 1). In addition, the fish species discrimination is based on the display screen to determine the actual size of the fish shadow based on the focal length of the underwater camera and the distance to the fish captured by the transducer integrated in the underwater camera. An apparatus is known (see Patent Document 2).
Japanese Patent Application Laid-Open No. 11-344311 Japanese Patent Laid-Open No. 5-31947

 However, in the above-described digital camera for measuring the actual size of the subject and the fish type discriminating apparatus for measuring the actual size of the fish shadow, a relatively high accuracy measurement result can be obtained. This is based on the premise that shooting is performed with the subject in focus, and each time the size of the subject is measured, it is necessary to take one photo for each subject while focusing on the subject.

The subject of the first invention is that the actual size of the subject can be measured by analyzing captured images sequentially acquired from the camera photographing unit, and the actual size can be measured in real time every time a new subject is detected. It is to be.
The subject of the second invention is that an actual size of a subject can be measured by analyzing captured images sequentially obtained from a camera photographing unit, and a size-unmeasured subject whose size measurement has become impossible at the time of acquisition of a past captured image Each time is detected, its actual size can be measured.

The invention according to claim 1 (first invention) is a camera photographing apparatus for measuring an actual size of a subject included in a photographed image acquired from a camera photographing unit, and before the actual photographing, Recognizing means for recognizing the subject included in the image by analyzing the captured images sequentially obtained from the photographing unit, and size acquisition processing means for performing processing for obtaining the actual size of the subject recognized by the recognizing means And a size display processing means for performing processing for displaying the actual size of the subject obtained by the size acquisition processing in the photographed image, and when a new photographed image is obtained from the camera photographing unit, Each time it is detected that a new subject that does not exist in the captured image is included in the current captured image, the size acquisition process and the size display process are performed for the new subject. Characterized by comprising a control means for instructing.
Furthermore, a program for realizing the main functions shown in the invention described in claim 1 is provided to the computer (the invention described in claim 10).

The invention described in claim 1 may be as follows.
Prior to the size acquisition process, a determination unit for determining whether or not the actual size of the subject to be measured is measurable is provided, and when it is determined by the determination unit that measurement is possible, When the size acquisition process is started and it is determined that the measurement is impossible, the fact is notified (the invention according to claim 2).

  The recognizing unit recognizes a subject included in a predetermined region as a measurement target among the subjects included in the captured image by analyzing the photographed image (the invention according to claim 3).

  In the size display process, in a state where a captured image including the measurement target is displayed, the actual size is displayed in association with the measurement target in the captured image.

  While specifying a measurement object to be a size measurement object from among a plurality of subjects recognized by the recognition means, providing a specifying means for specifying a reference object to be compared with the measurement object, the size acquisition process, Acquire the actual size of the specified reference object and analyze the captured image to calculate the image size for each measurement object and reference object. Based on each calculated size and the actual size of the reference object, the measurement object Is calculated (the invention according to claim 6).

  When the reference object is specified from among the plurality of subjects recognized by the recognition means, the specifying means selects an image portion characteristically matching any of a plurality of types of reference objects stored and managed in advance. The size is specified as a reference object, and when the actual size of the specified reference object is acquired, the size acquisition process reads and acquires an actual size stored and managed in advance corresponding to the reference object. Described invention).

  A distance measuring unit that measures the distance from the shooting position to the subject to be measured is provided, and the size acquisition process is performed by analyzing the measurement distance obtained by the distance measuring unit and the photographed image. The actual size of the measurement target is calculated based on the image size and the focal length of the camera lens (the invention according to claim 8).

The invention according to claim 5 (second invention) is a camera photographing device for measuring the actual size of a subject included in a photographed image obtained from a camera photographing unit, which is sequentially obtained from the camera photographing unit. Recognizing means for recognizing a subject included in each captured image by analyzing each captured image, and comparing each subject recognized by the recognizing means up to the present time with the subject in the current captured image The determination means for determining whether or not an unmeasured subject whose size cannot be measured at the time of acquisition of a past captured image is included in the current captured image, and an unmeasured subject is detected by the determination means. Each time, the size measuring means for measuring the actual size and the actual size obtained by the size measuring means are associated with the subject in the current photographed image. Characterized by comprising a Shimesuru display means.
Furthermore, a program for realizing the main functions shown in the invention described in claim 1 is provided to the computer (invention described in claim 11).

The invention according to claim 5 (second invention) may also be the invention according to claims 6 to 8 shown in the invention according to claim 1 (first invention) described above. It may be as follows.
A position detection unit that detects a display position of the subject recognized by the recognition unit, a display position of the subject detected by the position detection unit, and an actual size of the subject obtained by the size measurement unit are associated with each other. Holding means for storing and holding, and when it is detected that the display position of the subject has moved, the display means displays the actual size of the subject in association with the display position of the movement destination. 9).

  According to the first aspect of the present invention (first invention), the actual size of the subject is acquired after the subject is image-recognized by analyzing the captured images sequentially acquired from the camera photographing unit before actual photographing. In the process of performing size acquisition processing and size display processing for displaying the actual size of the subject in the photographed image, when a new photographed image is obtained from the camera photographing unit, it exists in the previous photographed image. Each time it is detected that a new subject that is not included in the current captured image is detected, execution of size acquisition processing and size display processing is instructed to the new subject. The actual size of the subject can be measured by sequential analysis, and the actual size can be measured in real time each time a new subject is detected. For example, when image analysis is performed while sequentially acquiring monitor images, when a new subject appears due to a change in the monitor image (a person or the like appears), the actual size of the person or the like can be measured immediately. . When a plurality of subjects appear in the captured image, the actual size can be measured for each subject.

  According to the invention described in claim 2, in addition to having the same effect as that of the invention described in claim 1, it is determined whether or not the actual size of the subject to be measured can be measured prior to the size acquisition process. If the measurement is possible, the size acquisition process is started on the condition, and if the measurement is impossible, the fact is notified. Therefore, the usability can be improved by the user interaction method.

  According to the invention described in claim 3, in addition to having the same effect as that of the invention described in claim 1, the subject included in the subject by analyzing the photographed image is included in a predetermined area. Since the subject being recognized is recognized as the measurement target, the measurement target can be automatically specified, no special operation is required, and the measurement target can be reliably specified. In this case, every time a new measurement target appears due to a change in the shooting direction or movement of the subject, the actual size can be calculated without manually specifying the new measurement target.

  According to the invention described in claim 4, in addition to having the same effect as that of the invention described in claim 1 described above, in the state where the photographed image including the measurement object is displayed, this measurement is included in the photographed image. Since the actual size is displayed in association with the object, the measurement object can be viewed while checking the size in the captured image, and the correspondence between the measurement object and the actual size becomes clear.

According to the sixth aspect of the present invention, in addition to the effects similar to those of the first aspect of the present invention described above, among the subjects included therein by analyzing the captured image acquired from the camera photographing unit. While the measurement target to be measured is specified and the reference target to be compared with this measurement target is specified, the actual size of the specified reference target is acquired and the captured image is analyzed. By calculating the image size for each measurement object and reference object, and calculating the actual size of the measurement object based on each calculated size and the actual size of the reference object, the actual size of the measurement object is It can be calculated by multiplying a simple calculation formula, that is, the ratio of the image size of the measurement object and the reference object by the actual size of the reference object.
In calculating the actual size of the measurement target, the measurement target subject and the other reference target subjects are not in a perspective relationship (front-rear relationship), but are substantially in a side-by-side state, that is, a shooting position (lens position). ) To the measurement object and the distance from the shooting position to the reference object are assumed to be substantially the same.

  According to the invention described in claim 7, in addition to having the same effect as the invention described in claim 1 described above, when specifying the reference object, any one of a plurality of kinds of reference objects stored and managed in advance is used. An image part that is characteristically matched is specified as a reference object, and when acquiring the actual size of the reference object, the actual size stored and managed in advance corresponding to the reference object is read and acquired. Therefore, by analyzing the captured image, the reference object can be automatically specified, and the actual size of the reference object can be automatically acquired, so that no special operation is required.

  According to the eighth aspect of the invention, in addition to the same effect as the first aspect of the invention described above, the distance from the photographing position to the subject to be measured and the measurement obtained by analyzing the photographed image Since the actual size of the measurement target is calculated based on the image size of the target and the focal length of the camera lens, the subject to be measured and the other subject of the reference target are in a perspective relationship (front-back relationship). Even in this case, the actual size of the measurement target can be easily calculated.

  According to the invention described in claim 5 (second invention), by analyzing each captured image sequentially acquired from the camera imaging unit, the subject included in the image is recognized, and the image is recognized up to the present time. By comparing each subject and the subject in the current captured image, it is possible that the current captured image includes an unmeasured subject whose size measurement has become impossible when the previous captured image was acquired. Each time it is detected, its actual size is measured, and this actual size is displayed in association with the subject in the current captured image, so the actual size of the subject is measured by sequentially analyzing the captured image. Even if the subject for which the size measurement was impossible at the time of acquisition of a past captured image, if the subject is included in the current captured image, the size is changed. It is possible to constant. If there are a plurality of unmeasured subjects in the captured image, the actual size can be measured for each subject.

The second invention also has the same effects as the inventions according to claims 6 to 8 shown in the first invention described above.
According to the ninth aspect of the present invention, in addition to the same effect as the fifth aspect of the present invention, the display position of the subject is detected, and the display position of the subject is associated with the actual size of the subject. Since the actual size of the subject is displayed in association with the display position of the movement destination when it is detected that the display position of the subject has moved, for example, the monitor image is displayed. As a result of performing the image analysis while acquiring sequentially, even when the subject moves in the monitor image, it is possible to display the actual size following the subject, and to see the subject while checking the size.

Example 1
The first embodiment of the present invention will be described below with reference to FIGS.
FIG. 1 is a block diagram showing basic components of a digital camera in this embodiment.
This digital camera can measure the actual size of the subject included in the photographed image (monitor image). When the subject is instructed to measure the subject size before actually photographing the subject, the subject is photographed on the monitor. By analyzing the digital image, the actual size is measured and displayed on the monitor screen, and every time a new subject is detected, the actual size is measured in real time.
Before detailed description of the features of this embodiment, the hardware configuration of this embodiment will be described below.

  The CPU 1 is a central processing unit that controls the overall operation of the digital camera in accordance with the operating system and various application software in the storage unit 2. The storage unit 2 is a fixed memory such as a hard disk, and has a program storage area and a data storage area. The program storage area in the storage unit 2 stores an application program for realizing the present embodiment in accordance with an operation procedure shown in FIGS. 4 and 5 described later, and the data storage area stores FIG. 3 described later. (Reference target table) is stored. The program and data are loaded into the work memory 3 as necessary, and the data in the work memory 3 is saved in the storage unit 2. The recording medium 4 is a removable memory such as a DVD, and exchanges programs, image data, and the like with the storage unit 2 and the work memory 3.

  On the other hand, an operation unit 5, a display unit 6, a camera photographing unit 7, and an image memory 8 which are input / output peripheral devices are connected to the CPU 1 via a bus line, and the CPU 1 inputs these according to an input / output program. Controls the operation of the output device. The operation unit 5 has various function buttons such as a shutter button, a mode button for switching to a shooting mode / playback mode, and a size measurement button for instructing start of size measurement, and the operation signal is given to the CPU 1. The display unit 6 is, for example, a liquid crystal display unit with a touch panel, and is used as a monitor screen / finder screen / image reproduction screen. The camera photographing unit 7 includes a photographing lens, a lens / mirror block such as a mirror, an image sensor such as a CCD image sensor, a driving system thereof, and the like, and sequentially transfers the photographed image to the image memory 8 for each photographing. Adjusts and controls the shooting direction (the direction of the lens) and the zoom mechanism, controls driving during autofocus, shutter drive control, shutter speed, exposure, white balance, etc., and captures captured images.

The CPU 1 measures and displays the actual size of the subject included in the monitor image by activating the size measurement function when the size measurement button is operated in the shooting mode.
For example, as shown in FIG. 2, in the monitor image in the shooting mode, a subject (person) A is set as a measurement target for size measurement, and a subject (door) B is compared with the measurement target A. Assuming that it is a reference object, the CPU 1 automatically designates the measurement object A and the reference object B by analyzing the monitor image in this photographing mode. In this case, the CPU 1 automatically designates the subject located at the center of the monitor image (marked with x in the figure) as the measurement target A, and selects the subject that is in a state substantially parallel to the measurement target A as the reference target. Automatically specified as B. Therefore, the measurement target A and the reference target B are not in a perspective relationship (front-rear relationship), but are substantially in a side-by-side relationship, that is, the distance from the shooting position (lens position) to the measurement target, and the reference position to the reference target. The distance to is substantially the same.

  As described above, in the state where the measurement target A and the reference target B are designated in the captured image (monitor image), the CPU 1 displays the actual size of the reference target B (the vertical dimension of the door: 185 cm) C. , The image size is calculated for each of the measurement object A and the reference object B, and the measurement object A is calculated based on the calculated size (image size) of the measurement object A and the reference object B and the actual size C of the reference object. The actual size (height) D is calculated. The actual size D of the measurement target A calculated in this way is additionally displayed near the measurement target A in the monitor screen.

FIG. 3 is a diagram showing the contents of the reference target table 11.
The reference object table 11 is configured to store and manage the actual size data for each reference object arbitrarily registered in advance. The “reference object” is an image of a reference object to be compared with the measurement object at the time of size measurement, and is obtained by arbitrarily photographing and registering a subject whose actual size is known in advance, for example, a door, a specific person, a road sign Images of post, post, fire hydrant, building and its window frame. In this case, when the CPU 1 automatically specifies the reference object included in the captured image by analyzing the captured image, the CPU 1 is characteristic of any of the plurality of types of reference objects registered in the reference object table 11. The image portion of the subject that matches is designated as the reference target.

  The actual size data of the reference object is divided into actual sizes for each direction corresponding to the “vertical dimension” and “horizontal dimension”, and the CPU 1 arbitrarily selects and designates the actual size for each direction in advance. The actual size in the specified direction is read out. In other words, it is possible to arbitrarily select and specify in advance which direction the actual size of “vertical dimension” or “horizontal dimension” is to be read, and the CPU 1 refers to this designation content in the corresponding direction. The actual size is read out. In this case, depending on the type of the reference object, any one of “vertical dimension” and “horizontal dimension” may be registered.

  In addition, since the post boxes 10 to 14 having different shapes and sizes currently exist in the post box, the reference target table 11 includes the “reference target” corresponding to these five types of post boxes. “Image”, “Vertical dimension”, and “Horizontal dimension” are registered. Here, the post box 10 has a main body height of about 83 cm, a width of about 46 cm, a pedestal height of about 55 cm, and a diameter of about 17 cm. The “vertical dimension” registered in the table 11 is a total value of the heights of the main body and the pedestal.

  Next, the operation concept of the digital camera in this embodiment will be described with reference to the flowcharts shown in FIGS. Here, each function described in these flowcharts is stored in the form of a readable program code, and operations according to the program code are sequentially executed. In addition, the operation according to the above-described program code transmitted via the transmission medium can be sequentially executed. The same applies to the other embodiments, and in addition to the recording medium, an operation peculiar to this embodiment can be executed using a program / data supplied externally via a transmission medium.

FIG. 4 is a flowchart showing an outline of the overall operation of the digital camera, which starts executing in response to power-on.
First, in a state where the photographing mode is set (step A1), the CPU 1 sequentially captures monitor images (step A2) and displays them as moving images on the monitor screen (step A3). In this state, the presence / absence of button operation is checked (step A4). If no button is operated (NO in step A4), the monitor image capturing is resumed (step A2), but now the shutter button is operated. In this case (step A5), the captured image at that time is recorded and saved as an image file (step A6), and then the process returns to capturing the monitor image (step A2).

  On the other hand, when the shooting mode is switched to the playback mode (step A7), a playback process is performed in which the recorded images are played back and displayed sequentially while selecting and specifying the recorded images in the forward / reverse directions according to the user instruction (step A8). Thereafter, when the playback mode is switched to the shooting mode (step A9), the process returns to the process of capturing the monitor image (step A2). Here, when the size measurement button is operated in the photographing mode (step A10), the process proceeds to a size measurement process for measuring the actual size of the measurement target included in the monitor image (step A11).

FIG. 5 is a flowchart detailing the size measurement process executed in response to the operation of the size measurement button in the shooting mode.
First, the CPU 1 temporarily fixes and displays the current monitor image (step B1), and then analyzes the entire monitor image to specify the subject image located in the central portion as the measurement target (step B2). . That is, in the example of FIG. 2, since a person is shown in the central portion of the monitor image, the entire person is specified as a measurement target in consideration of the continuity of the image. By extracting from the monitor image an image portion (subject) that is positioned substantially side by side with respect to the subject (measurement target) specified in this way, and by searching the reference target table 11 based on the extracted subject image (step) B3) It is examined whether or not any of the reference objects registered in the reference object table 11 is characteristically matched (step B4). In other words, step B4 determines whether or not the actual size of the subject to be measured can be measured.

  Here, if the extracted subject does not match any reference object, it is determined that measurement is impossible (NO in step B4), and a message indicating that measurement is impossible is displayed on the monitor screen (step B5). The presence or absence of an end operation is checked (step B6). If there is no end instruction, a monitor image is acquired (step B7), displayed on the monitor (step B8), and this monitor image is fixedly displayed (step B1). On the other hand, if the extracted subject matches any reference target registered in the reference target table 11, it is determined that measurement is possible (YES in step B4), and the subject is designated as the reference target. The process moves to the process of calculating the actual size of the measurement target. In the example of FIG. 2, “door” is designated as the reference object.

  First, the reference object table 11 is accessed based on this reference object, and the actual size “J0” is read and acquired (step B9). In this case, as described above, the actual size in which direction of “vertical dimension” and “horizontal dimension” is read out is determined by referring to the designated content that is arbitrarily designated in advance. Is read. In the example of FIG. 2, “door vertical dimension: 185 cm” is read from the reference target table 11. Next, the reference target image size “G0” is measured by analyzing the monitor image (step B10), and the measurement target image size “G1” is measured (step B11). In this case, in the example of FIG. 2, the reference target image size “G0” is a size corresponding to the height of the door, and the measurement target image size “G1” is a size corresponding to the height of the person. is there. The image sizes “G0” and “G1” are sizes on an image sensor such as a CCD, and the vertical direction based on the horizontal / vertical dimensions of the entire effective area and the horizontal / vertical dot size of the entire effective area. The size per dot in (vertical pitch) / the size per dot in the horizontal direction (horizontal pitch) is obtained and converted into size information based on this dot pitch.

As a result, when all of the reference target actual size J0 and image size G0 and the measurement target image size G1 are obtained, a calculation process is performed to obtain the measurement target actual size J1 using these values as parameters (step B12). In this case, the actual size of the measurement target is calculated according to the following formula.
Actual size of measurement object “J1” = G1 / G0 * J0

  The actual size of the measurement target calculated in this way is a value obtained by multiplying the ratio of the image size by the actual size of the reference target. In this case, it is assumed that the measurement target and the reference target are substantially in a side-by-side state. It is said. In other words, it is assumed that the distance from the shooting position to the measurement target (building) and the distance to the reference target (person) are substantially the same, and the calculated value is an approximate size. Then, the fixed display of the monitor image is canceled (step B13), and the calculated actual size is associated with the measurement target and displayed on the monitor screen (step B14). In the example of FIG. 2, “140 cm” is displayed as the height of the measurement target (person).

  If the size measurement end button is operated (YES in step B15), the process exits from this flow and returns to the normal state. If there is no end instruction, the process proceeds to step B16 to obtain a monitor image. The monitor image is displayed (step B17), and the monitor image is temporarily fixed (step B18). In this state, as in the case described above, by analyzing the entire monitor image, the subject image located at the center portion is specified as the measurement target (step B19), and the measurement target specified this time and the measurement target specified last time are specified. To check whether or not they are the same (step B20). Here, if it is the same as the previous time, after canceling the fixed display of the monitor image (step B21), in response to the end operation (step B22), the process exits this flow and returns to the normal state, but there is no end instruction. For example, the process returns to step B16 to acquire the next monitor image, and the above operation is repeated thereafter.

  If the current measurement object is different from the previous measurement object (YES in step B20), the process returns to step B3 to specify the reference object. Here, when the measurement object in the monitor image changes from the state of FIG. 2 to the state of FIG. 6, that is, when the next person appears, it is detected that the current measurement object is different from the previous measurement object. In step B3, the door is specified as the reference object. Thereafter, the actual size calculation and display processing of the measurement target is performed as described above. In this case, in the example of FIG. 6, “185 cm” is displayed as the height of the current measurement target (person).

  As described above, in the first embodiment, the subject (measurement target) included in the image is recognized by analyzing the monitor image sequentially acquired from the camera photographing unit 7 before actual photographing. In the process of performing size calculation processing for acquiring the actual size of the subject later and performing size display processing for displaying the actual size of the subject in the monitor image, the CPU 1 obtains a new monitor image from the camera photographing unit 7. Each time it is detected that a new subject that is not present in the previous monitor image is included in the current monitor image, the size calculation process and the size display process are performed on the new subject. Since it is instructed to execute the monitor, it is possible to measure the actual size of the subject by sequentially analyzing the monitor image and to detect a new subject. Each is, it is possible to measure the actual size in real time. For example, when image analysis is performed while sequentially acquiring monitor images, when a new subject appears due to a change in the monitor image (a person or the like appears), the actual size of the person or the like can be measured immediately. . When a plurality of subjects appear in the monitor image, the actual size can be measured for each subject.

  In this case, the CPU 1 analyzes the monitor image so as to specify the image portion located in the central portion as the measurement target, so that the measurement target can be automatically specified by analyzing the image. The operation becomes unnecessary, and the measurement object can be specified reliably. In this case, every time a new measurement target appears due to a change in the shooting direction or movement of the subject, the actual size can be calculated without manually specifying the new measurement target.

  Further, when specifying the reference object, an image portion that characteristically matches any of a plurality of types of reference objects registered in the reference object table 11 is specified as the reference object, and the actual size of the reference object is determined. At the time of acquisition, the actual size corresponding to the reference object is read from the reference object table 11 and acquired. Therefore, by automatically analyzing the monitor image, the reference object can be automatically specified and the actual size of the reference object can be obtained. The size can be automatically acquired, and no special operation is required.

  In a state in which the measurement target and the reference target are specified in the monitor image, the CPU 1 acquires the actual size of the specified reference target and analyzes the monitor image for each measurement target and reference target. Since the size was calculated and the actual size of the measurement target was calculated based on each calculated size and the actual size of the reference target, the actual size of the measurement target was calculated using a simple formula: It can be calculated by multiplying the ratio of the target image size by the actual size of the reference target.

Prior to the size calculation process, the CPU 1 determines whether or not the actual size of the subject to be measured can be measured. If the measurement is possible, the CPU 1 starts executing the size calculation process on the condition that the measurement is impossible. In this case, since the fact is notified, it is possible to expect improvement in usability by the user interaction method.
In addition, while the monitor image containing the measurement target is displayed, the actual size is displayed in association with the measurement target in the monitor image, so the actual size is confirmed on the monitor screen. You can see the measurement object.
(Example 2)

A second embodiment of the present invention will be described below with reference to FIGS.
In the first embodiment described above, each time a new subject (measurement target) is detected when measuring the actual size of the subject by analyzing the monitor images sequentially acquired from the camera photographing unit 7, The actual size is measured in real time, but in this second embodiment, every time an unmeasured subject (measurement target) whose size measurement has become impossible when a past monitor image is acquired is detected, The actual size is measured.
Here, the same or the same names in both embodiments are denoted by the same reference numerals, the description thereof will be omitted, and the following description will focus on the features of the second embodiment. .

FIG. 7 is a block diagram showing the basic components of the digital camera in the second embodiment.
This digital camera has a distance sensor function (autofocus function) that measures the distance from the shooting position to the subject, and when a measurement of the subject size is instructed, a digital image obtained by monitoring the subject is displayed. It has a size measurement function that measures the actual size of the subject by analysis and displays it on the monitor screen. That is, this digital camera has a distance sensor 9 in addition to the CPU 1, the storage unit 2, the work memory 3, the recording medium 4, the operation unit 5, the display unit 6, the camera photographing unit 7, and the image memory 8 described above. . The distance sensor 9 automatically measures the distance from the lens position to the subject by, for example, triangulation (for example, active type / passive type) as in the normal autofocus function, and this measurement distance is converted to a digital value. It is converted and given to CPU1. In this case, the CPU 1 calculates the actual size of the measurement object based on the measurement distance obtained by the distance sensor 9, the image size of the measurement object obtained by analyzing the monitor image, and the focal length of the camera lens. Like to do.

FIG. 8 is a diagram showing the contents of the object table 12.
The object table 12 stores and manages various pieces of information for each object when each subject portion included therein is extracted as an object image by analyzing the monitor image. , “Monitor image position”, “actual size”, and “object image”.
“Object No.” is information generated to identify each object, and “Monitor Image Position” indicates the display position of the object existing in the monitor screen. The “real size” is a value read from the reference target table 11 when the object is a reference target, and is a value obtained by the size calculation process when the object is a measurement target. The “object image” is an image of the subject portion extracted from the monitor image.

Next, the operation concept of the digital camera in the second embodiment will be described with reference to the flowcharts shown in FIGS. In the second embodiment as well, the entire operation of the digital camera is performed according to the flowchart shown in FIG. 9 to 12 are flowcharts detailing the size measurement process executed in response to the operation of the size measurement button in the shooting mode.
First, the CPU 1 obtains a monitor image and analyzes the entire image to extract all image portions of each subject such as a person, a door, and a building as object images (step C1 in FIG. 9), and this extracted object. Various kinds of information are set in the object table 12 (step C2). In this case, “object No.” is updated and generated, “monitor image position” is detected, and the object image is set in the corresponding item position of the object table 12 together with the object image.

  Next, any one of the extracted objects is designated (step C3), and the distance from the photographing position (lens position) to the designated object is measured while the distance sensor 9 is focused on the designated object (step C4). In this case, it is checked whether or not measurement is possible (step C5). For example, whether or not measurement is possible is determined in consideration of whether the distance from the shooting position to the subject is too long. If measurement is possible, the process proceeds to the actual size calculation process for the designated object (step C6). If measurement is not possible, the actual size calculation process is skipped.

  This actual size calculation process calculates the image size of the designated object by analyzing the monitor image on the image center such as a CCD after obtaining the measurement distance to the designated object and the focal length of the lens, The actual size of the designated object is calculated based on the focal length and the image size. Here, assuming that the measurement distance is “L1”, the focal distance is “L0”, and the image size is “S1”, the actual size S2 of the designated object is calculated according to the calculation formula of S2 = L1 / L0 * S1. This calculated size is set at the corresponding item position in the object table 12 (the same applies hereinafter).

  Subsequently, the above-described operation is repeated until all objects are specified while specifying the next object (steps C3 to C7). Thus, the presence / absence of an object for which the actual size could be calculated is checked (step C8), and if one cannot be calculated, the normal state is restored, but even one can be calculated. In this case, in the monitor screen, the object is identified by being surrounded by a frame, and the actual size is displayed in the vicinity of the frame (step C9). FIG. 13 is a diagram illustrating an example of a monitor screen when the actual size calculation object is identified and displayed by the frame display and the calculation size is displayed in the vicinity of the frame. Xxx indicates actual size display (the same applies hereinafter).

  In this state, the process proceeds to step C10 in FIG. 10 to check whether the content of the monitor image has changed due to the movement of the subject or the change in the shooting direction. If there is no change in the image with respect to the previous monitor image, The presence / absence of an end operation is checked (step C11), and a standby state is entered until there is an image change or end instruction. Here, when an end instruction is received, the normal state is restored. However, when an image change is detected, all objects are extracted from the current monitor image (step C12), and each extracted current time is extracted. The object and each previous object set in the object table 12 are compared (step C13), and the presence / absence of the previously unset object is checked (step C14). That is, the presence or absence of an object (new appearance object) that does not exist in the previous monitor image but exists in the current monitor image is checked.

  As a result, if a new object is not included in the current monitor image (NO in step C14), the object table 12 is searched (step C15) to check the presence / absence of an object not extracted this time (step C16). ). In other words, the presence or absence of an object (exit object) that does not exist in the current monitor image but exists in the previous monitor image is checked. If there is an exit object, the unextracted object (exit object) is extracted from the object table 12. After deletion (step C17), the process proceeds to step C24 in FIG.

  On the other hand, when a new object appears in the current monitor image (YES in step C14), the process proceeds to step C18 in FIG. 11 and after the unset object image (new object) is additionally registered in the object table 12, In the current monitor image, the image portion of the additional object (new object) is designated (step C19). Then, the distance from the shooting position to the designated object is measured while adjusting the focus of the distance sensor 9 to the designated object (step C20), the measurement possibility is checked (step C21), and the condition is that the measurement is possible. The actual size of the designated object is calculated according to the calculated formula (step C22). In this case, when there are a plurality of additional objects, the process of calculating the actual size is repeated while designating all the additional objects one by one (steps C19 to C23).

  When all the additional objects have been specified (YES in step C23), the process proceeds to step C24 in FIG. Here, the object table 12 is searched to check whether there is an object whose size has not been calculated (step C25). In other words, even if the object cannot be measured for size because it is too far when acquiring a past monitor image, it is determined that it can be measured when acquiring the current image due to the movement of the subject or the change in the shooting direction. If there is an uncalculated object that has been determined to be unmeasurable in the past (YES in step C25), after designating the image portion of the uncalculated object in the monitor image (step C26), The distance to the designated object is measured (step C27), and on the condition that it can be measured (YES in step C28), the actual size of the designated object is calculated according to the above formula (step C29). Thereafter, the above-described operation is repeated until all the uncalculated objects are designated (steps C26 to C30).

  When the processing for calculating the actual size of the object whose size has not been calculated is completed (YES in step C30) or when it is detected in step C25 that there is no object whose size has not been calculated, the process proceeds to step C31. In the monitor screen, the current display positions of all objects included in the current monitor image are detected, the surroundings of the objects are surrounded by a frame, and the calculated size is displayed in the vicinity of the frame. Let As shown in FIG. 14, when the object (subject) for which the actual size has been calculated moves, the display of the actual size is also moved along with this movement.

  As described above, in the second embodiment, the CPU 1 recognizes each object by analyzing each monitor image sequentially acquired from the camera photographing unit 7, and recognizes each object image-recognized so far and the current monitor. Each time it is detected that an object of unmeasured size that has become impossible to measure the size at the time of acquisition of the past monitor image is included in the current monitor image by comparing with the object in the image. In addition to measuring the size and displaying the actual size in association with the object in the current monitor image, the actual size of the object can be measured by sequential analysis of the monitor image, and past monitors Even if the object is not available for size measurement at the time of image acquisition, If it contains the object, it is possible to measure its size. If there are a plurality of unmeasured objects in the monitor image, the actual size can be measured for each object.

  In this case, on the monitor screen, the actual size calculation object is surrounded and surrounded by a frame, and the calculated size is displayed in the vicinity of the frame, so that the object to be measured and its actual size are displayed. Correspondence becomes clear. Further, since the exit object (unextracted object) is deleted from the object table 12, the actual size can be displayed only for the object in the current monitor image.

  Further, the display position of the object in the monitor image is detected, and the display position of the object and the actual size of the object are stored in association with each other, and it is detected that the display position of the object has moved. At this time, since the actual size of the object is displayed in association with the display position of the movement destination, image analysis is performed while sequentially acquiring monitor images. The following actual size can be displayed, and the object can be viewed while checking the size.

  In the second embodiment described above, the measurement object is based on the measurement distance obtained by the distance sensor 9, the image size of the measurement object obtained by analyzing the monitor image, and the focal length of the camera lens. As in the first embodiment, after obtaining the actual size of the reference object, the monitor image is analyzed to calculate the image size for each measurement object and reference object. The actual size of the measurement target may be calculated based on each calculated size and the actual size of the reference target. 15 and 16 are diagrams for explaining the size calculation in this case.

FIG. 15 is a diagram showing the contents of the reference target table 11 in the second embodiment.
As described above, the reference object table 11 stores and manages the actual size data for each reference object arbitrarily registered in advance. The actual size data includes the “vertical dimension”, the “horizontal dimension”, It consists of “depth dimensions”. Also in this case, the CPU 1 can arbitrarily select and specify in advance which direction the actual size is read out of “vertical dimension”, “horizontal dimension”, and “depth dimension”. By referring to the specified contents, the actual size in the corresponding direction is read out.

FIG. 16 is a flowchart showing processing for calculating the actual size of the object to be measured.
First, the CPU 1 designates any one undesignated object as an object to be measured in order to designate all the objects in the monitor image one by one (step D1), and then the reference object table based on the designated object. 11 is searched (step D2), and it is checked whether or not this designated object (measurement object) is registered in advance as a reference object (step D3). If the designated object itself is a reference target (YES in step D3), the actual size is read from the reference target table 11 and set at a corresponding position in the object table 12 (step D4). Therefore, if the designated object is a reference target, the actual size is a value read from the reference target table 11.

  Thereafter, the above-described operation is repeated until all the objects in the monitor image have been designated (steps D1 to D5), but if the designated object is not the reference target (NO in step D3), the monitor image is omitted from the designated object. While extracting other objects arranged side by side, the reference object table 11 is searched based on this extracted object (step D6), and it is checked whether it is registered as a reference object (step D7). If any other object is not a reference target, the process returns to step D5 in order to make the designated object unmeasurable, but if it is a reference target registered in the reference target table 11, the reference target table 11 The actual size “J0” is read (step D8). Next, the reference target image size “G0” is measured by analyzing the monitor image (step D9), and the image size “G1” of the designated object (measurement target) is measured (step D10).

As a result, when all of the actual size J0 and the image size G0 of the reference target and the image size G1 of the designated object are obtained, a calculation process is performed to obtain the actual size J1 of the measurement target using these values as parameters (step D11).
Actual size of the specified object J1 = G1 / G0 * J0
The actual size of the designated object calculated in this way is set at the corresponding item position in the object table 12 (step D12). And it returns to step D5 and repeats the above-mentioned operation | movement below.

On the other hand, in the first embodiment described above, after acquiring the actual size of the reference object, the monitor image is analyzed to calculate the image size for each measurement object and reference object. Although the actual size of the measurement object is calculated based on the actual size, the measurement object obtained by analyzing the measurement distance obtained by the distance sensor and the monitor image as in the second embodiment described above. The actual size of the measurement target may be calculated based on the image size and the focal length of the camera lens.
Further, in the monitor screen, the measurement object may be surrounded and surrounded by a frame for identification display, and the actual size may be displayed near the frame.

  In the first and second embodiments described above, it is assumed that the measurement object and the reference object are on the same plane. However, even if the measurement object and the reference object have different heights, the measurement object The actual size can be measured. In this case, in the above-described embodiment, the sizes of the measurement object and the reference object are specified in the monitor image. Therefore, even if the heights of the measurement object and the reference object are different, the actual size of the measurement object is set. It becomes possible to measure.

  In the first and second embodiments described above, when a captured image is recorded and stored in response to a shutter operation, if the actual size of the measurement target is recorded and stored together, the captured image is displayed during image reproduction. It is possible to read and display the actual size of the measurement object associated therewith. Further, the actual size of the object to be measured is added to each captured image and stored in a recording medium, and this recording medium is inserted into an image data processing apparatus such as a personal computer to perform image reproduction. The actual size of the measurement object can be displayed for each image.

  Further, in the first and second embodiments described above, image data of a plurality of types of reference objects are arbitrarily registered in the reference object table 11, but for example, road signs, postboxes, fire hydrants, etc. If the size is fixed, the captured image itself is not registered, but the characteristic information of this comparison standard (for example, a postbox, cube, aspect ratio, overall (Red) may be registered. The contents of the reference object table 11 may be set and registered at the time of product purchase, and the user may additionally register an arbitrary reference object and its actual size as necessary.

In the above-described embodiments, the case where the present invention is applied to a digital camera is shown. However, it may be incorporated in an image data processing apparatus such as a personal computer, a camera-equipped mobile phone or a portable information device, and for various applications. It can be used. For example, after shooting at a construction site, civil engineering site, etc., when checking the status of the site while reproducing the image at the company, measure and display the actual size of each part based on each captured image Also good.
In addition, the size measuring device is not limited to a stand-alone type, but each component is physically separated into two or more cases, and a wired transmission path such as a communication line or cable, or radio transmission such as radio waves, microwaves, and infrared rays. It may be a distributed system that transmits and receives data via a path.

  On the other hand, a recording medium (for example, a CD-ROM, a flexible disk, a RAM card, etc.) on which program codes for executing the above-described units are recorded may be provided to the computer. That is, a computer-readable recording medium having a program code, and a function of recognizing an object included in a recording medium by analyzing a captured image sequentially acquired from a camera photographing unit before actual photographing A function for performing processing for acquiring the actual size of the recognized subject, a function for performing processing for displaying the actual size of the subject obtained by the size acquisition processing in the captured image, and a new function from the camera photographing unit. Each time it is detected that a new subject that does not exist in the previous captured image is included in the current captured image when the captured image is acquired, the size acquisition process is performed on the new subject. And a computer-readable recording medium storing a program for realizing a function for instructing execution of size display processing It may be.

  In addition, a computer-readable recording medium having a program code, and a function of recognizing a subject included in the recording image by sequentially analyzing each captured image acquired from the camera imaging unit, and so far By comparing each subject that has been image-recognized with the subject in the current captured image, the subject that has not been measured in size when the past captured image was acquired is included in the current captured image. And a function for measuring the actual size each time an unmeasured subject is detected, and a function for displaying the actual size in association with the subject in the current captured image. It is also possible to provide a computer-readable recording medium on which a program for recording is recorded.

The block diagram which showed the basic component of the digital camera. The figure for demonstrating the measurement object (person image) A used as the object of size measurement in a picked-up image, and the image (door image) B of the reference | standard object compared with this measurement object A. FIG. The figure which showed the content of the reference | standard object table 11. FIG. The flowchart which showed the outline | summary of the whole operation | movement of the digital camera started execution according to power activation. The flowchart which detailed the size measurement process performed according to operation of a size measurement button at the time of imaging | photography mode. The figure which illustrated the case where the next person appeared as a measuring object in a monitor image in the state of FIG. The block diagram which showed the basic component of the digital camera in 2nd Example. The figure which showed the content of the object table 12 in 2nd Example. 9 is a flowchart detailing a size measurement process executed in response to an operation of a size measurement button in the shooting mode in the second embodiment. FIG. 10 is a flowchart illustrating the size measurement process in detail following FIG. 9. FIG. 11 is a flowchart illustrating the size measurement process in detail following FIG. 10. FIG. 10 is a flowchart detailing the size measurement process following FIG. 11 and FIG. 9; FIG. The figure which illustrated the monitor screen in case the calculated size is displayed in the vicinity of this frame while the object of actual size calculation is identified and displayed by the frame display in the second embodiment. The figure which illustrated the monitor screen which showed that the actual size display moved according to it, when the object for which actual size was calculated in the 2nd example moved. The figure which showed the content of the reference | standard object table 11 in the modification application example of 2nd Example. The flowchart which showed the process which calculates the actual size of the object of a measurement object in the modification application example of 2nd Example.

Explanation of symbols

1 CPU
2 storage unit 4 recording medium 5 operation unit 6 display unit 7 camera photographing unit 8 image memory 11 reference object table 12 object table

Claims (11)

A camera photographing device for measuring an actual size of a subject included in a photographed image acquired from a camera photographing unit,
Recognizing means for recognizing the subject included in the image by analyzing the captured images sequentially acquired from the camera photographing unit before actual photographing,
Size acquisition processing means for performing processing for acquiring the actual size of the subject recognized by the recognition means;
Size display processing means for performing processing for displaying the actual size of the subject obtained by the size acquisition processing in the captured image;
Each time a new photographed image is acquired from the camera photographing unit, a new subject that does not exist in the previous photographed image is detected to be included in the current photographed image. Control means for instructing execution of the size acquisition processing and size display processing;
A camera photographing apparatus comprising: Prior to the size acquisition process, provided with a determination means for determining whether or not the actual size of the subject to be measured can be measured,
When it is determined that measurement is possible by this determination means, the size acquisition process is started on the condition, and when it is determined that measurement is impossible, the fact is notified,
The camera photographing apparatus according to claim 1, wherein the camera photographing apparatus is configured as described above. The recognizing unit recognizes a subject included in a predetermined area as a measurement target among each subject included in the captured image by analyzing the captured image.
The camera photographing apparatus according to claim 1, wherein the camera photographing apparatus is configured as described above. The size display process displays the actual size in association with the measurement target in the captured image in a state where the captured image including the measurement target is displayed.
The camera photographing apparatus according to claim 1, wherein the camera photographing apparatus is configured as described above. A camera photographing device for measuring an actual size of a subject included in a photographed image acquired from a camera photographing unit,
Recognizing means for recognizing the subject included in the image by analyzing each captured image sequentially acquired from the camera photographing unit;
By comparing each subject that has been image-recognized by this recognition means with the subject in the current captured image, an unmeasured subject whose size cannot be measured when acquiring a past captured image is A discriminating means for discriminating whether the image is included in the captured image;
Each time an unmeasured subject is detected by the determining means, a size measuring means for measuring the actual size,
Display means for displaying the actual size obtained by the size measuring means in association with the subject in the current captured image;
A camera photographing apparatus comprising: Specifying a measurement object to be a size measurement object from a plurality of subjects recognized by the recognition means, and specifying means for specifying a reference object to be compared with the measurement object;
The actual size of the identified reference object is acquired, and the image size is calculated for each measurement object and reference object by analyzing the captured image, and the measurement is performed based on each calculated size and the actual size of the reference object. Calculate the actual size of the target,
6. The camera photographing apparatus according to claim 1, wherein the camera photographing apparatus is configured as described above. When the reference object is specified from among the plurality of subjects recognized by the recognition means, the specifying means selects an image portion characteristically matching any of a plurality of types of reference objects stored and managed in advance. Identified as a reference target,
When acquiring the actual size of the specified reference object, the actual size stored and managed in advance corresponding to the reference object is read and acquired.
The camera photographing apparatus according to claim 6, which is configured as described above. Provide a distance measuring means to measure the distance from the shooting position to the subject to be measured,
Based on the measurement distance obtained by the distance measurement means, the image size of the measurement object obtained by analyzing the captured image, and the focal length of the camera lens, the actual size of the measurement object is calculated.
6. The camera photographing apparatus according to claim 1, wherein the camera photographing apparatus is configured as described above. Position detection means for detecting the display position of the subject recognized by the recognition means;
Holding means for storing and holding the display position of the subject detected by the position detecting means and the actual size of the subject obtained by the size measuring means in association with each other;
When the display position of the subject is detected to be moved, the display means displays the actual size of the subject in association with the display position of the movement destination.
6. The camera photographing apparatus according to claim 5, wherein the camera photographing apparatus is configured as described above. Against the computer,
A function of recognizing the subject included in the image by analyzing captured images sequentially acquired from the camera shooting unit before actual shooting,
A function to perform processing for obtaining the actual size of the recognized subject;
A function of performing processing for displaying the actual size of the subject obtained by the size acquisition processing in the captured image;
Each time a new photographed image is acquired from the camera photographing unit, a new subject that does not exist in the previous photographed image is detected to be included in the current photographed image. A function for instructing execution of the size acquisition process and the size display process;
A program to realize Against the computer,
A function of recognizing the subject included in the image by analyzing each captured image sequentially acquired from the camera photographing unit;
By comparing each subject that has been image-recognized so far with the subject in the current captured image, an unmeasured subject whose size cannot be measured when acquiring past captured images is included in the current captured image. A function to determine whether it is included, and
Each time an unmeasured subject is detected, the function to measure the actual size,
A function of displaying this actual size in association with the subject in the current captured image;
A program to realize

Images