JP2018155562A - Data acquisition device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a data acquisition device capable of easily checking the measurement accuracy when measurement is performed based on a photographic image.SOLUTION: A data acquisition device 10 for acquiring a photographic image of an object includes a measurement part 130 for measuring the shape of the object based on the photographic image, a condition determination part 136 for determining the photographic conditions affecting the accuracy of measurement, an accuracy determination part 138 for determining the measurement accuracy corresponding to the determined photographic conditions, and a control part 120 for displaying the determined measurement accuracy.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an information acquisition apparatus that acquires a captured image and measures an object based on the acquired captured image.

Images taken with a digital camera are overwhelmingly superior in immediacy compared with silver halide photographs, and thus are widely used as evidence photographs in various business fields. For example, in construction sites and civil engineering sites, systems that use image data taken with a digital camera as evidence photographs are spreading. Further, at the construction site, the shape measurement of members such as columns and beams is performed using the captured image data.
A technique for measuring a distance to a subject by simultaneously using a plurality of stereo cameras that include two imaging units and capture a stereoscopic image is known. For example, an imaging apparatus that accurately measures the length between two points designated by a user on a subject using an imaging apparatus such as a stereo camera has been proposed (Patent Document 1).

Japanese Patent No. 5018980

  When measuring the shape of an object such as a member based on a captured image, the measurement accuracy varies greatly depending on the shooting situation. For this reason, it is necessary to photograph in a situation where the accuracy required for measurement is satisfied. This is because the measurement value obtained in a situation where the required accuracy is not satisfied is not reliable.

  The present invention has been made in view of the above problems, and an object of the present invention is to provide an information acquisition apparatus that can easily check measurement accuracy when performing measurement based on a captured image.

  In order to achieve the above object, in an information acquisition device for acquiring a captured image of an object, a measurement unit that measures the shape of the object and a shooting situation that affects the accuracy of the measurement are determined based on the captured image. A determination unit that determines measurement accuracy according to the determined shooting situation, and a control unit that displays the determined measurement accuracy.

  ADVANTAGE OF THE INVENTION According to this invention, when performing the measurement based on a picked-up image, the information acquisition apparatus which can confirm confirmation of measurement accuracy easily can be provided.

It is a figure which shows the example of construction photography. It is a block diagram of the whole information acquisition system. It is a hardware block diagram of an information acquisition device. It is a figure explaining the relationship between the imaging distance with respect to measurement accuracy, and resolution. It is a figure explaining the relationship between an imaging | photography range and measurement accuracy. It is a figure explaining the relationship between an imaging | photography range and measurement accuracy. It is a flowchart 1 explaining an image acquisition process. It is a flowchart 2 explaining an image acquisition process. It is a figure which shows the imaging | photography state from the distant position. It is a display example of an accuracy meter. It is a figure which shows the imaging | photography state when approaching. It is a display example of an accuracy meter. It is a display example of a guide screen including configuration information and a live view image. It is a state of shooting an oblique pillar. It is a figure which shows typically the structure of a twin-lens camera part. It is a figure explaining the parallax in a twin-lens type camera part. It is a figure which shows the relationship of the left and right live view image by a twin-lens camera part. It is a flowchart 1 explaining a 2nd image acquisition process. It is a flowchart 2 explaining a 2nd image acquisition process. It is a display example of an accuracy meter. It is a display example of a synthetic live view image. It shows a situation where the convergence angle is adjusted with a twin-lens camera. It is a figure which shows the example of adjustment of the convergence angle according to an imaging distance. It is a flowchart 1 explaining a 3rd image acquisition process. It is a flowchart 1 explaining a 3rd image acquisition process. It is a display of a coincidence meter.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following embodiments, an example in which the information acquisition system 1 of the present invention is used for construction photography will be described. Construction photography is photography for obtaining evidence photographs of construction contents at a construction site. FIG. 1 shows a state of construction photography.

  FIG. 1 shows a situation where a photographer carrying a photographing device (hereinafter referred to as an information acquisition device 10) is preparing for photographing in a room where a plurality of members (columns P) are constructed. In the following, a construction site to be photographed such as a column or a beam is also referred to as a part or a member. And the part corresponding to the member image | photographed in the picked-up image is also called an imaging | photography site | part or only a site | part. Further, members corresponding to the parts are also abbreviated as parts unless obscured.

  FIG. 2 is a configuration diagram of the entire information acquisition system 1. The information acquisition system 1 is mainly composed of an information acquisition device 10 and an external device 40. The information acquisition device 10 is a device that acquires a captured image and performs predetermined processing on the acquired image. The information acquisition apparatus 10 may be a digital camera, an information processing apparatus with a camera, or a system in which a camera and an information processing terminal (for example, a tablet-type information processing terminal) are combined in a wired or wireless manner. The external device 40 is, for example, a server that is connected to the information acquisition device 10 via a communication line and stores a photographing result of the information acquisition device 10.

  The information acquisition apparatus 10 includes a camera unit 100, a control unit 120, a storage unit 150, a display unit 160, a touch panel 165, a communication unit 170, and the like. The camera unit 100 is also simply called a camera.

  The camera unit 100 includes a photographing unit 102, an image processing unit 104, an operation unit 106, an operation determination unit 108, and a posture sensor 110. The camera unit 100 may be either a monocular type or a binocular type. The imaging unit 102 includes a lens unit 102a (not shown), an image sensor 102b, and the like, and converts a subject image into an image signal. The image processing unit 104 converts the image signal output from the photographing unit 102 into digital data, and performs various types of image processing.

  The operation unit 106 is an instruction member for adjusting the focal position, focal length, various settings, and the like of the lens unit 102a of the imaging unit 102. The operation determination unit 108 determines an operation on the operation unit 106. The posture sensor 110 is a sensor that detects the posture and direction of the camera unit 100. The posture sensor 110 includes, for example, an inclination sensor (acceleration sensor) and an electronic compass.

  The control unit 120 controls the entire information acquisition apparatus 10 in an integrated manner. The control unit 120 includes an information processing unit 122, a camera control unit 124, a configuration information acquisition unit 126, an imaged site determination unit 128, a measurement unit 130, an imaging distance calculation unit 132, a coincidence degree determination unit 133, and a coincidence degree display processing unit 134. , A composite image creation unit 135, a situation determination unit 136, an accuracy determination unit 138, an accuracy display processing unit 140, a guide screen creation unit 142, a display control unit 144, and the like.

  The information processing unit 122 manages various determination processes and information input from the external device 40 or the camera unit 100. The camera control unit 124 controls the camera unit 100 based on an instruction input from the touch panel 165, and switches the operation mode of the camera unit 100 or performs shooting or the like.

  The configuration information acquisition unit 126 acquires configuration information indicating the configuration of a plurality of members to be imaged. The member to be photographed is a construction site such as a pillar, wall or beam. The configuration information is acquired from the design drawing information 422 of the external device 40 or the image taken by the camera unit 100.

  The configuration information acquisition unit 126 acquires an image (also referred to as an entire image) that is an image captured by the camera unit 100 and is captured of the entire plurality of members as first configuration information. In addition, the configuration information acquisition unit 126 acquires the design drawing information 422 from the external device 40 as the second configuration information based on the design drawing.

  A display example of the configuration information will be described with reference to FIG. FIG. 9 is a display example of a guide screen described later. In the guide screen 202 and the guide screen 203 of FIG. 9, the left side is a live view image, and the right side is configuration information. The configuration information on the right side of the guide screen 202 is second configuration information. This second configuration information is based on an indoor design drawing in which six columns are arranged. The configuration information on the right side of the guide screen 203 is first configuration information. The configuration information acquisition unit 126 stores the first configuration information and the second configuration information in the storage unit 150.

  The imaged region determination unit 128 determines the imaged member based on the process of sequentially imaging a plurality of members. Since there are many members having similar shapes at the construction site, by specifying the already-photographed member during photographing, it is possible to suppress waste of duplicate photographing and to prevent omission of photographing.

  The measurement unit 130 measures the shape of the part from the captured image and outputs a measurement value. The shape of the part is the width (diameter) or height of the column when the member to be imaged is a column. When the member is a beam, it is the thickness of the beam. The measurement principle will be described later using equation (1).

  The shooting distance calculation unit 132 calculates a distance from the camera unit 100 to a member (for example, a pillar) to be shot. When the camera unit 100 is monocular, the shooting distance calculation unit 132 calculates the shooting distance based on the position of the focusing lens of the shooting unit 102 detected by the contrast method. By adjusting the position of the focus detection point to the position of the target part, the photographing distance corresponding to the target part can be calculated.

  When the photographing unit 102 is a twin-lens type, the photographing distance calculation unit 132 may calculate the photographing distance by phase difference ranging using the left and right imaging elements 102b. Here, the phase difference ranging means detecting a shift (parallax) of the image position corresponding to the point of interest on the subject based on the degree of correlation (degree of coincidence) between the left and right subject images, and the left and right eyes This is a well-known method for calculating the distance to the target point based on the principle of triangulation, taking into account various conditions such as the base line length, which is the separation distance of the (optical axis), and the imaging magnification. It is possible to obtain the distance between the respective parts in one imaging.

  The coincidence degree determination unit 133 is used to obtain the degree of image correlation (coincidence degree) for the above-described phase difference distance measurement, and together with the coincidence degree display processing unit 134 and the composite image creation unit 135, a “convergence angle” described later. Used in “adjustment display processing”. The coincidence degree determination unit 133, the coincidence degree display processing unit 134, and the composite image creation unit 135 are provided when the camera unit 100 is a twin-lens system.

  The degree of coincidence determination unit 133 determines the degree of coincidence of images obtained from the left and right imaging elements 102b. The coincidence degree display processing unit 134 performs processing for displaying the degree of coincidence of the determined left and right images. The composite image creation unit 135 composites images obtained from the left and right imaging elements 102b to create a composite image.

  The situation determination unit 136 determines a shooting situation that affects the measurement accuracy of the measurement unit 130, and outputs the determined shooting situation as a determination result. The accuracy determination unit 138 determines the accuracy of measurement based on the shooting situation determined by the situation determination unit 136.

  The shooting situation that affects the measurement accuracy includes the characteristics of the shooting unit 102 (resolution of the lens unit 102a, resolution of the image sensor 102b, S / N of the image sensor 102b, amplifier gain, etc.), luminance and contrast of the subject, camera unit For example, the distance from 100 to the subject (shooting distance). In the case of a twin-lens system, the base line length is also included in the shooting situation.

  For example, if the shooting distance is increased, the shooting range is widened and a plurality of members can be shot together (see FIGS. 5A and 5B), but the measurement accuracy decreases due to the resolution of the image sensor 102b and the like. To do. That is, when high measurement accuracy is required, close-up imaging is required. As described above, it is necessary to set appropriate photographing conditions in accordance with the required accuracy for the measurement value of the member.

  The accuracy determination unit 138 determines the measurement accuracy based on the shooting situation determined by the situation determination unit 136. The accuracy determination unit 138 may determine the measurement accuracy by comparing the shooting situation determined by the situation determination unit 136 with the accuracy reference information 158. The accuracy reference information 158 is obtained by, for example, obtaining a relationship between data of various parameters of photographing conditions and measurement accuracy in advance by an experiment or the like and tabulating the relationship. Alternatively, the accuracy reference information 158 may be a calculation formula for calculating measurement accuracy from data of various parameters of the shooting situation. The calculation formula may be determined by experiments or the like.

  The accuracy determination unit 138 obtains the measurement accuracy corresponding to the current shooting situation data from the accuracy reference information 158, and determines the obtained measurement accuracy as the measurement accuracy. In addition, the accuracy determination unit 138 continuously determines the measurement accuracy according to a change in shooting conditions such as a shooting distance.

  The accuracy display processing unit 140 performs processing for displaying the measurement accuracy determined by the accuracy determination unit 138. The accuracy display processing unit 140 performs processing for displaying an accuracy meter as a screen indicating measurement accuracy. The screen of the accuracy meter will be described with reference to FIGS. 7B and 8B.

  The guide screen creation unit 142 creates a guide screen for photographing assistance. On the guide screen, a captured image (live view image or REC view image), configuration information, or various meters (accuracy meter, coincidence meter) are displayed. In addition to the guide screen, the guide screen creation unit 142 further includes a measurement value obtained by the measurement unit 130, imaging distance information calculated by the imaging distance calculation unit 132, required accuracy information, already-photographed information based on the determination of the already-photographed site determination unit 128, and the like. May be included.

  Further, the guide screen provides information that enables efficient and appropriate shooting according to the shooting and measurement environment and the shooting measurement target based on the performance and function information of the camera unit 100. This is a notification. As a result, a guide screen is displayed so that correct measurement of a part and efficient measurement at a time can be performed. The guide screen creation unit 142 creates a guide screen based on the performance of the camera unit 100, the accuracy of the measurement unit 130, the actual arrangement and size of each part, and the position and space where the photographer can shoot as necessary. The guide screen may be created in consideration of the above.

  The display control unit 144 causes the display unit 160 to display a setting screen for setting a captured image, a mode, or the like, or a guide screen.

  The storage unit 150 is a nonvolatile storage unit. The storage unit 150 is a non-volatile storage unit that stores a captured image 152, configuration information 154, camera unit characteristic information 156, accuracy reference information 158, and the like. The captured image 152 is image data captured and recorded by the camera unit 100. The configuration information 154 is information acquired by the configuration information acquisition unit 126.

  The camera unit characteristic information 156 is information relating to the characteristics of the camera unit 100, in particular, the lens unit 102a and the image sensor 102b. The characteristic information of the lens unit 102a includes brightness, resolution, distortion, and the like in addition to the specifications. The characteristic information of the image sensor 102b is the pixel size, the number of pixels, the pixel pitch, and the like. As described above, the accuracy reference information 158 is, for example, a table in which the relationship between various parameters of the shooting situation and measurement accuracy is described. Further, the accuracy reference information 158 may be a calculation formula for calculating the measurement accuracy.

  The display unit 160 is a LCD, for example, and displays a captured image, a guide screen, and the like. The touch panel 165 is an operation unit configured integrally with the display unit 160 and receives various instructions from the photographer. The communication unit 170 is an interface that performs various information communication with the external device 40. The communication unit 170 communicates with the external device 40 via a network (not shown). The communication unit 170 can determine a connection destination, a request for the connection, and the like based on reception, connection setting, and the like, so that the control unit 120 can determine various measurement required specifications. The external device 40 may transmit the required specification through this communication.

  The external device 40 includes a control unit 400, a communication unit 410, and a storage unit 420. The external device 40 is a server that manages construction photography. The control unit 400 controls the external device 40 in an integrated manner. The communication unit 410 is an interface that performs information communication with an external device, for example, the information acquisition device 10. The storage unit 420 stores design drawing information 422. In addition, the storage unit 420 stores imaging results captured by the information acquisition apparatus 10.

  FIG. 3 is a hardware block diagram of the information acquisition apparatus 10. The information acquisition apparatus 10 includes a central processing unit (CPU) 120a, a dynamic random access memory (DRAM) 120b, a read only memory (ROM) 120c, a flash memory 150a, a display unit 160, a touch panel 165, and a communication unit 170.

  The CPU 120a reads and executes a control program stored in the ROM 120c, and controls the information acquisition apparatus 10 by software processing. The DRAM 120b provides a working area for temporarily storing control programs and various data. The ROM 120c stores the control program in a nonvolatile manner. The control unit 120 includes a CPU 120a, a DRAM 120b, and a ROM 120c.

  The flash memory 150a stores various data tables and captured images. The storage unit 150 includes a flash memory 150a. Since the display unit 160, the touch panel 165, and the communication unit 170 have been described above, description thereof will be omitted.

  FIG. 4 is a diagram for simply explaining the relationship between measurement accuracy (resolution) and shooting distance. Each of the configuration diagram C1 and the configuration diagram C2 of FIG. 4 is a state where the camera unit 100 is viewed from above.

  The configuration diagram C1 of FIG. 4 is a diagram illustrating the principle of measuring the part shape (here, the width of the column P) from the captured image. The configuration diagram C1 is an example in which the camera unit 100 is monocular.

In the configuration diagram C1, the width W of the part (column P), the width X0 of the image sensor 102b, the angle of view φ of the lens unit 102a, the focal length F of the lens unit 102a, and the subject distance D are set. The width X0, the angle of view φ, and the focal length F are values included in the camera unit characteristic information 156. The subject distance D is calculated by the shooting distance calculation unit 132 based on the focus position detected by contrast AF, for example. As described above, in the monocular system, the width W of the column P is calculated by the following expression (1), and the angle of view φ is calculated by the expression (2).
W = D × X / F (1)
φ = 2 × arctan (X0 / (2 × F)) (2)
It should be noted that the portion denoted by F (focal length) in the expressions (1) and (2) is precisely the image plane distance obtained by adding the image plane movement by focusing to the focal length F (in the case of a fixed focus system, the fixed image). The distance should be F) for simplicity of explanation. Hereinafter, in the present specification, the same simplification is used without particular notice.
Here, X, which is the width of the part (column P) in the subject image on the image sensor, can be obtained by various known methods, but so-called “background separation” using characteristic analysis such as luminance, contrast, and color of the image. It is an example to obtain the number of pixels of the extracted main subject portion (column P portion) by applying the technique.

The configuration diagram C2 is a diagram illustrating the relationship between the resolution (measurement accuracy) on the light receiving surface (image surface) of the image sensor 102b and the resolution on the subject. It is assumed that the subject resolution Ro, the resolution ri on the image sensor 102b, and the subject distance D.
Ro = D × ri / F (3)
The relationship between the resolution (measurement accuracy) Ro on the object plane and the object distance D can be found from Expression (3). That is, as D is smaller, in other words, the closer to the subject, the higher the measurement accuracy (the subject resolution Ro becomes smaller). Here, when the required accuracy of measurement (required resolution) is Rr, Rr ≧ Ro may be obtained in order to obtain a reliable measurement result. × Rr / ri (4)
Is the condition.

  5A and 5B are diagrams for simply explaining the relationship between the imaging range and the measurement accuracy. In either case, the camera unit 100 in the shooting state is viewed from above. FIG. 5A shows a state where three pillars P are photographed one by one. FIG. 6 is a diagram showing that when shooting at a short distance of the subject distance D, only one pillar P can be shot. FIG. 5B shows a case where three pillars P are photographed together.

The shooting range H and the subject distance D on the subject plane are assumed.
H = D × X0 / F (5)
If the measurement accuracy is to be increased as described above, close-up shooting must be performed, but equation (5) indicates that the shooting range H is narrowed by doing so.

  Next, image acquisition processing by the information acquisition apparatus 10 will be described. The image acquisition process includes a measurement accuracy display process. 6A and 6B are flowcharts 1 and 2 for explaining the image acquisition process. The image acquisition process is mainly executed by the control unit 120 of the information acquisition apparatus 10.

  First, the control unit 120 determines whether the construction mode is selected by the information acquisition device 10 (step S100). When determining that the construction mode is not selected in the information acquisition apparatus 10 (NO in step S100), the control unit 120 executes another selected mode (step S102). Description of other modes is omitted.

  When determining that the construction mode is selected by the information acquisition apparatus 10 (YES in step S100), the control unit 120 determines whether or not “construction shooting” is selected (step S104). The construction mode includes sub-modes of “construction photography”, “image reproduction”, “design drawing acquisition”, “result confirmation”, and “result storage”.

  “Construction photography” is a process of photographing a construction site. “Image reproduction” is a process of reproducing a captured image. “Design drawing acquisition” is a process of acquiring the design drawing information 422 from the storage unit 420 of the external device 40 as second configuration information.

  The “result confirmation” is a process in which the photographer or the administrator confirms the photographing content based on the image of each part photographed by the information acquisition device 10. The photographer or administrator confirms on the confirmation screen that there are no omissions or defects in the imaged part. “Result storage” is a process in which results (captured images, measurement results) captured by the information acquisition device 10 are transmitted to the external device 40 and stored in the external device 40.

  When determining that “construction shooting” has been selected (YES in step S104), the control unit 120 starts image shooting (image acquisition) by the camera unit 100 and live view image display using an image acquired by the camera unit 100 ( Step S106).

  The control unit 120 determines whether there is the configuration information 154 (step S108). The control unit 120 determines whether the configuration information 154 is stored in the storage unit 150. When determining that there is no configuration information (NO in step S108), the control unit 120 performs normal live view image display (step S110).

  When the control unit 120 determines that the configuration information 154 exists (YES in step S108), the guide screen creation unit 142 synthesizes the configuration information 154 and the live view image to create a guide screen. The control unit 120 displays a guide screen including the configuration information 154 and the live view image on the display unit 160 (step S112). The configuration information and the live view image are divided and displayed.

  FIG. 9 is a display example of a guide screen including the configuration information 154 and the live view image. The guide screen 202 is an example in which the second configuration information based on the design drawing is displayed as the configuration information 154. The guide screen 203 is an example in which first configuration information based on the entire image is displayed as the configuration information 154.

  The control unit 120 determines whether or not the photographer has operated the camera unit 100 (step S114). The operation by the photographer is a zoom operation of the operation unit 106, for example. When the control unit 120 determines that there is an operation by the photographer (YES in step S114), the camera control unit 124 performs control reflecting the operation result (step S116).

  If it is determined that there is no operation by the photographer (NO in step S114), the control unit 120 determines whether a region has been selected (step S120). The part selection is an operation in which a specific part is selected by the photographer on the screen of the live view image or the configuration information. For example, the guide screen 202 in FIG. 9 is a state in which the photographer selects the lower right part (column) in the second configuration information on the right side.

  When the control unit 120 determines that a part has been selected (YES in step S120), the measurement unit 130 sets the selected part as a measurement target (step S122). If the part is not selected, the measurement unit 130 sets the part selected by default as a measurement target. For example, a part close to the center of the screen is automatically selected. If the control unit 120 determines that the region has not been selected (NO in step S122), the control unit 120 proceeds to step S124.

  The measurement unit 130 measures the shape of the selected part or the default selected part based on the live view image (step S124). The accuracy determination unit 138 determines the measurement accuracy, and the determined measurement accuracy is displayed on the accuracy meter (step S126).

  Specifically, the situation determination unit 136 determines the shooting situation and outputs the current shooting situation data. The accuracy determination unit 138 determines the measurement accuracy by comparing the current shooting situation data with the accuracy reference information 158. The accuracy display processing unit 140 performs processing for displaying an accuracy meter according to the determined measurement accuracy.

  The guide screen creation unit 142 creates a guide screen including a live view image, an accuracy meter, a measurement result, and the like. The control unit 120 displays a guide screen on the display unit 160.

  7B and 8B are display examples of the accuracy meter. 7B and 8B are examples of guide screens that do not include configuration information.

  FIG. 7A is a diagram illustrating a state in which the pillar P is photographed from a distant position. A guide screen 200 in FIG. 7B is a guide screen displayed in the shooting in FIG. 7A. A live view image is displayed on the left side of the guide screen 200, and an accuracy meter is displayed on the right side. In the live view image, a measured value (31 cm) is also displayed at the measured site. The shooting distance (4 m) is also displayed.

  The accuracy meter arranges cells indicating the measurement accuracy in the vertical direction, and indicates the measurement accuracy determined by the accuracy determination unit 138 step by step. The maximum value of the lighted cell indicates the determined measurement accuracy. It shows that the numerical value of the measurement accuracy is large (the accuracy is low) as the upper cell is lit. The number next to the cell indicates the measurement accuracy of that cell. The unit is, for example, mm.

  The guide screen 200 indicates that the measurement accuracy is within ± 10 mm in a state where the lower four cells are lit.

  The index Se is a mark indicating the position with the required accuracy specified by the photographer. The example of the guide screen 200 indicates that the specified required accuracy is within ± 5 mm. In accordance with the specified required accuracy, the index Se is moved up and down and displayed. Since the determined measurement accuracy is ± 10 mm, the photographer can understand from the display that the required accuracy within ± 5 mm is not satisfied in the current shooting situation.

  FIG. 8A shows a state in which the photographer has approached the pillar P as compared with FIG. 7A. A guide screen 201 in FIG. 8B is a guide screen in a state where the photographer approaches the pillar P. The accuracy meter indicates that the measurement accuracy is within ± 5 mm due to the reduction of the shooting distance. It can be seen that the measurement accuracy matches the required accuracy.

  In this way, the measurement accuracy is determined and displayed in a meter format, so that the photographer can easily determine whether or not shooting is possible in the current shooting situation. In addition, since the required accuracy is displayed on the accuracy meter, the determination becomes easier.

  Returning to FIG. 6A. The control unit 120 determines whether an imaging instruction has been given (step S170). If the control unit 120 determines that a shooting instruction has been given (YES in step S170), the control unit 120 performs shooting and measurement (step S172). The measurement unit 130 measures the part selected in step S122 or the default selected part based on the REC view image. On the guide screen, a REC view image based on the photographed image and a measurement result are displayed. In addition, the accuracy meter shown in FIG. 7B or the like may be displayed.

  When determining that there is no shooting instruction (NO in step S170), control unit 120 returns to step S100. The control unit 120 determines whether an OK instruction has been given (step S174). The photographer checks the displayed REC view image, measurement value, and the like, and operates an OK button or the like (not shown) when saving the photographed image. When determining that the OK operation has not been performed, the control unit 120 returns to step S100 (NO in step S174).

  When the control unit 120 determines that the OK operation has been performed (YES in step S174), the control unit 120 records the imaging result, the measurement value, and the like in the storage unit 150 (step S176). The control unit 120 determines whether or not the configuration information 154 exists, and when determining that there is no configuration information (NO in step S178), the control unit 120 returns to step S100. When determining that the configuration information is present (YES in step S178), the control unit 120 records the photographing result and the like in the storage unit 150 in association with the configuration information 154 (step S180).

  The control unit 120 displays a guide screen in which an electronic marker indicating the shooting state is added to the configuration information (step S182). The guide screen 203 in FIG. 9 is a state in which an electronic marker Q described as “Done” indicating that the image has been taken is added to the rightmost column P. The guide screen creation unit 142 adds the electronic marker Q to a predetermined site based on the determination by the imaged site determination unit 128. The electronic marker Q is an example of status information. The control unit 120 returns to step S100.

  Proceed to FIG. 6B. When determining that “construction photography” is not selected (NO in step S104), the control unit 120 determines whether “image reproduction” is selected (step S200).

  When determining that “image reproduction” is selected (YES in step S200), the control unit 120 performs image reproduction (step S202). The control unit 120 determines whether or not a reproduction image change instruction has been issued (step S204). If the control unit 120 determines that a reproduction image change instruction has been issued (YES in step S204), the control unit 120 changes the reproduction image in accordance with the instruction (step S206). ). If the control unit 120 determines that the instruction to change the reproduced image has not been given (NO in step S204), the control unit 120 returns to step S104.

  Further, when determining that “image reproduction” is not selected (NO in step S200), control unit 120 determines whether “design drawing acquisition” is selected (step S210). If the control unit 120 determines that “acquisition of design drawing” is selected (YES in step S210), the control unit 120 requests the design drawing information 422 from the external device 40 via the communication unit 170, and is transmitted from the external device 40. Information 422 is received (step S212). The control unit 120 records the received design drawing information 422 in the storage unit 150 as second configuration information.

  When determining that “design drawing acquisition” is not selected (NO in step S210), control unit 120 determines whether “result confirmation” is selected (step S220).

  When determining that “result confirmation” has been selected (YES in step S220), the control unit 120 displays a place designation (step S222). The location designation display is a display for designating a construction location for confirming the result. The control unit 120 displays the captured image at the designated location on the detail confirmation screen (step S224). On the detail confirmation screen, various results relating to the photographed image at the designated location are displayed.

  When determining that “result confirmation” is not selected (NO in step S220), the control unit 120 determines whether “result storage” is selected (step S230). When determining that “result storage” is selected (YES in step S230), the control unit 120 transmits the imaging result to the external device 40 (step S232). The external device 40 stores the transmitted shooting result in the storage unit 420.

  When determining that “result storage” is not selected (NO in step S230), control unit 120 returns to step S104. Also, after step S204, step S206, step S224, step S232, etc., the process returns to step S104.

  In the above description, the display example using the arranged cells is shown as the accuracy meter. However, the present invention is not limited to this. The determined numerical value may be displayed directly or a grade corresponding to the numerical value may be displayed. In addition, a shooting distance (recommended shooting distance) corresponding to the required accuracy may be displayed.

<Two-way accuracy meter>
Next, the two-way accuracy meter will be described. 7B and 8B described the accuracy meter that displays the measurement accuracy in one direction. However, the measurement direction of the member is not limited to one direction. In the second accuracy meter display, an accuracy meter that displays measurement accuracy in two orthogonal directions will be described.

  FIG. 10 shows a state where an oblique column P is photographed. The information acquisition system 1 has the same configuration as that shown in FIGS. In this example, the camera unit 100 is described as a twin-lens type.

  FIG. 11 is a diagram schematically illustrating the configuration of the lens unit 102a and the imaging element 102b in the twin-lens camera unit 100t. The imaging units 102 are provided on the left and right inside the camera unit 100t. The three-dimensional coordinates of XYZ define the mutual directional relationship of FIGS. The Y axis is in the vertical direction.

  The lens unit 102aR and the image sensor 102bR constitute the lower right imaging unit 102 toward the subject. The lens unit 102aL and the image sensor 102bL constitute the upper left imaging unit 102. In other words, the photographing unit 102 is arranged so as to be separated in both the left-right direction and the up-down direction. Bx is the baseline length in the X direction (left-right direction). By is the baseline length in the Y direction (vertical direction). Moreover, Px shows the cross section of the pillar P by XZ plane, and Wx shows the length of the X direction of Px. Similarly, Py indicates the cross section of the column P by the YZ plane, and Wy indicates the length of Py in the Y direction.

FIG. 12 is a diagram illustrating parallax in the twin-lens camera unit 100t. The configuration diagram C3 is a diagram of the camera unit 100t as viewed from above. The configuration diagram C4 is a view of the camera unit 100t as viewed from the side. Base line length Bx in the X direction, Base line length By in the Y direction, focal length F of the lens unit 102aR and the lens unit 102aL, subject distance D, parallax ΔX which is a relative image position shift in the X direction, and a relative image position shift in the Y direction. Let it be a certain parallax ΔY. The following equation holds.
D = F × Bx / ΔX (6)
D = F × By / ΔY (7)

  FIG. 13 is a diagram illustrating a relationship between left and right captured images by the twin-lens camera unit 100t. The live view image VR is an image obtained by the image sensor 102bR, and the live view image VL is an image obtained by the image sensor 102bL. In FIG. The live view image VR and the live view image VL have parallax that corresponds to the respective base line lengths on the left, right, and top and bottom. Note that the width W of the column P is calculated by W = Wx × SIN (θ).

  Next, an image acquisition process including a two-way accuracy meter display will be described. The image acquisition process including the two-direction accuracy meter display is referred to as a second image acquisition process. For the sake of distinction, the image acquisition process of FIGS. 6A and 6B is also referred to as a first image acquisition process hereinafter.

  14A and 14B are flowcharts 1 and 2 for explaining the second image acquisition process. The second image acquisition process is mainly executed by the control unit 120 of the information acquisition apparatus 10. In the following, the second image acquisition process will be described focusing on processes different from the first image acquisition process, and description of common processes will be omitted.

  Steps S100 to S120 and steps S170 to S182 in FIGS. 14A and 14B are the same as those in the flowchart 1 in FIG. Since FIG. 6B is also common, description is omitted. Steps S130 to S144 in FIG. 14A are processing different from the first image acquisition processing. Note that the displayed live view image may be a left or right image. In the following, it is assumed that a live view image VR photographed by the image sensor 102bR is displayed as a live view image.

  The measurement unit 130 sets the selected part as a measurement target (step S130). If the part is not selected, the measurement unit 130 sets the part selected by default as a measurement target. For example, a part close to the center of the screen is automatically selected.

  The control unit 120 determines whether a vertical slide operation has been performed on the selected part on the guide screen (step S132). If the control unit 120 determines that a vertical slide operation has been performed (YES in step S132), the measurement unit 130 measures the shape in the Y direction for the selected region or a default region based on the live view image ( Step S134). The measurement accuracy in the Y direction is determined, and the measurement accuracy in the Y direction is displayed on the accuracy meter (step S136). The measurement result in the Y direction is also displayed.

  Specifically, the situation determination unit 136 determines the current shooting situation and outputs the determined shooting situation data in the Y direction. The accuracy determination unit 138 determines the measurement accuracy by comparing the current Y-direction shooting situation data with the accuracy reference information 158. The accuracy display processing unit 140 performs processing for displaying an accuracy meter according to the determined measurement accuracy.

  If the control unit 120 determines that a horizontal slide has been performed instead of a vertical slide operation (NO in step S132), the measurement unit 130 determines whether the selected region or the default setting region is in the X direction based on the live view image. Is measured (step S138). The measurement accuracy in the X direction is determined in the same manner as in the Y direction, and the measurement accuracy in the X direction is displayed on the accuracy meter (step S140). The measurement result in the X direction is also displayed.

  FIG. 15 is a display example of the accuracy meter. The guide screen 204 is an example in which the Y-direction accuracy is displayed on the accuracy meter by a vertical slide operation. In this example, the Y direction accuracy is displayed as ± 5 mm, and the Y direction measurement value is displayed as 40 cm.

  Further, the guide screen 205 is an example in which the X-direction accuracy is displayed on the accuracy meter by a horizontal slide operation. In this example, the X direction accuracy is displayed as ± 1 mm, and the Y direction measurement value is displayed as 30 cm. The guide screens 204 and 205 are provided with a check switch (denoted as CK on the screen) under the index Se. The check switch instructs to check the overlap between the right image and the left image.

  The control unit 120 determines whether the check switch has been operated (step S142). When determining that the check switch has been operated (YES in step S142), the control unit 120 displays a composite live view image in which the left live view image VL is superimposed on the live view image VR (step S144). The composite image creation unit 135 creates a composite image in which the live view image VL is superimposed on the live view image VR.

  A guide screen 206 in FIG. 16 is a display example of a synthesized live view image. A solid line frame indicates a display frame that is a display range of the live view image, and the live view image VR is displayed in accordance with the display frame. Therefore, if the live view image VL is simply superimposed on the display frame in the same manner, the main subject such as the column P is displayed with a shift of R and L parallax. The case where the image is shifted and superimposed so that the minutes are corrected and the positions of the main subjects substantially coincide is illustrated. A frame L including a broken line portion indicates the range of the original live view image VL. Note that the broken line portion of the frame L is for explanation, and the image of the area outside the display frame is naturally not displayed, so the live view image VL is displayed only in the portion overlapping the live view image VR. Note that whether or not to perform correction by shifting the position of the image is arbitrary depending on the application.

  When the control unit 120 determines that the check switch is not operated (NO in step S142), the control unit 120 proceeds to step S170 in FIG. 14B. The control unit 120 proceeds to step S170 even after step S136 or step S140. Steps S170 and after are already described with reference to FIG.

  In the description of the bi-directional accuracy meter, the example applied to the binocular camera unit 100t has been described. However, the monocular camera unit 100 is also applicable. The two directions are not limited to the two orthogonal directions, and the angles of the two directions may be arbitrarily set according to the measurement target.

<Convergence angle adjustment display>
Next, the two-lens camera unit 100t that displays the degree of convergence angle adjustment will be described. The twin-lens camera unit 100t includes an adjustment mechanism that adjusts the convergence angle of the lens unit 102aR and the lens unit 102aL. The convergence angle is an angle formed by the optical axes of the lens portion 102aR and the lens portion 102aL. In this example, it is assumed that the camera unit 100t is arranged only in the horizontal (X) direction via a predetermined baseline length and has no vertical (Y) direction parallax.

  FIG. 17 shows a state where the information acquisition apparatus 10 including the two-lens camera unit 100t adjusts the convergence angle of the lens unit 102aR and images the three columns P. The convergence angle is adjusted by rotating the lens unit 102aR in a horizontal plane according to the rotation of a convergence adjustment dial (not shown) included in the operation unit 106. The seal M affixed to the middle column P is a convergence angle adjustment seal.

  FIG. 18 is a diagram illustrating an example of adjusting the convergence angle according to the shooting distance. FIG. 18 is a top view of the camera unit 100t in the shooting state. The distance between the camera unit 100t and each of the three pillars P is shown as three cases of Da, Db, or Dc. It is assumed that the lens unit 102aR is adjusted so that the optical axis CR of the lens unit 102aR and the optical axis CL of the lens unit 102aL intersect in the vicinity of Db.

  When the pillar P is photographed at a distance of Da, the three pillars can be accommodated in the left and right photographed images with a margin, but the photographing distance becomes long, which is disadvantageous in terms of the measurement accuracy described above. When the pillar P is photographed at a distance of Dc, the screen of the pillar P at the end is removed. When the column P is photographed at the distance Db, the convergence angle is adjusted, so that the three columns can be accommodated in the left and right captured images, and the three columns can be arranged on the full screen. In this way, the effective shooting range (the overlapping portion of the left and right shot images) can be maximized by adjusting the convergence angle according to the shooting distance so that the left and right shooting ranges substantially coincide.

  Next, an image acquisition process including a convergence angle adjustment display will be described. The image acquisition process including the convergence angle adjustment display is referred to as a third image acquisition process.

  19A and 19B are flowcharts 1 and 2 for explaining the third image acquisition process. The third image acquisition process is mainly executed by the control unit 120 of the information acquisition apparatus 10. In the following, the third image acquisition process will be described focusing on a process different from the first image acquisition process, and the description of the common process will be omitted.

  Steps S100 to S120 and steps S170 to S182 in FIGS. 19A and 19B are the same as those in the flowchart in FIG. Since FIG. 6B is also common, description is omitted. Steps S150 to S156 in FIG. 19A are processes different from those in FIG. 6A. Note that the displayed live view image may be a left or right image. In the following, it is assumed that a live view image VR photographed by the image sensor 102bR is displayed as a live view image.

The degree of coincidence determination unit 133 determines the degree of coincidence of images obtained from the left and right imaging elements 102bL and 102bR. For example, the coincidence determination unit 133 extracts luminance data of a predetermined area from the left and right image data, calculates a difference between the luminance data, and determines the coincidence. It is determined that the degree of coincidence is higher as the difference between the left and right image data is smaller.
Here, supplementing the above-mentioned sticker M, since the coincidence determination by the coincidence determination unit 133 is performed based on the image data, when the contrast of the image is low or the image pattern has repeatability, In principle, the accuracy and stability tend to deteriorate. In order to assist this, for example, a sticker of a color such as white or black, which is easy to obtain luminance contrast, or red or blue, which is easy to obtain chromaticity contrast, is provided so that the contrast in the vicinity of the subject becomes high with the sticker attached to the subject. The certainty of determination can be improved by performing a series of operations on the pasted one. A character pattern or the like may be printed instead of a single color.

  The coincidence degree display processing unit 134 performs processing for displaying the coincidence degree of the determined image data on the coincidence degree meter. The control unit 120 displays the determined degree of coincidence of the images on the coincidence degree meter (step S150). The coincidence meter is included in the guide screen.

  FIG. 20 is an example of the guide screen 207 on which the coincidence meter is displayed. In the center of the guide screen 207, eight cells arranged vertically are a coincidence meter. As the upper cell is lit, the degree of coincidence is higher. The photographer only has to adjust the convergence angle by turning the convergence adjustment dial so that the cell is lit up as high as possible with the coincidence meter.

  And accuracy meter display is also performed. The accuracy meter display process performed in step S152 and step S154 is the same process as step S124 and step S126 in FIG.

  You may comprise so that congestion adjustment may be confirmed visually, without using the said coincidence meter, or using together, The example is demonstrated. In this case, the control unit 120 superimposes and displays not only the live view image VR captured by the image sensor 102bR but also the live view image VL captured by the image sensor 102bL on the display frame of the live view. At that time, the correction is not particularly performed by shifting the position of the image, and the image is simply superimposed on the display frame in the same manner as the live view image VR. Accordingly, if the convergence adjustment is insufficient, the subject image is displayed with a shift between R and L. Therefore, the convergence angle may be adjusted by rotating the convergence adjustment dial so that they match.

  In this case, in order to improve the adjustment accuracy, a part of the live view screen superimposed on the guide screen is enlarged and displayed (step S156). That is, it is displayed as a confirmation screen MD next to the coincidence meter, and when a sticker M is pasted on the subject in advance, an enlarged image of the sticker M is displayed on the confirmation screen MD. That is, the confirmation screen MD is an auxiliary screen that is enlarged and displayed in order to confirm the degree of coincidence with high accuracy. It may be difficult to determine the degree of coincidence with pillars with poor appearance characteristics, but it is easy to judge the degree of coincidence visually by using colors or characters on the surface of a sticker with a color or print that enhances contrast. become. In addition, as described above, the coincidence determination unit 133 can more reliably determine the coincidence if there is a sticker that is colored or printed.

  As described above, by displaying the coincidence meter and the confirmation screen MD, it is possible to easily adjust the convergence angle so that the left and right photographing ranges substantially coincide with each other according to the photographing distance. In the two-lens camera unit 100t, the effective shooting range is maximized when the left and right shooting ranges are substantially coincident. Therefore, efficient shooting is possible by shooting in this state.

  The embodiment described above is applied to each target part in addition to measuring a part of a building, a group of buildings in a specific area, a single tree in a forest, crops in a field, animals and plants in other areas, etc. it can. Macroscopically, it can also be applied to three-dimensional measurement of parts, wiring patterns, semiconductors, and the like that are measured with a microscope image, and the present application can be applied by regarding each object as each part.

  Note that the information acquisition apparatus 10 may be an information processing apparatus including the control unit 120, the storage unit 150, and the display unit 160, excluding the camera unit 100.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Moreover, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, all the constituent elements shown in the embodiments may be appropriately combined. Furthermore, constituent elements over different embodiments may be appropriately combined. It goes without saying that various modifications and applications are possible without departing from the spirit of the invention.

DESCRIPTION OF SYMBOLS 1 Information acquisition system 10 Information acquisition apparatus 40 External apparatus 100 Camera part 120 Control part 126 Configuration information acquisition part 128 Image | photographed site | part determination part 130 Measurement part 132 Imaging distance calculation part 133 Match degree determination part 134 Match degree display process part 135 Composite image Creation unit 136 Status judgment unit 138 Accuracy judgment unit 140 Accuracy display processing unit 142 Guide screen creation unit 144 Display control unit 150 Storage unit 154 Configuration information 156 Camera unit characteristic information 158 Accuracy reference information 160 Display unit 165 Touch panel 170 Communication unit 400 Control unit 410 Communication unit 420 Storage unit 422 Blueprint information

Claims (10)

In an information acquisition device that acquires a captured image of an object,
A measuring unit for measuring the shape of the object based on the captured image;
A situation determination unit that determines a shooting situation that affects the accuracy of the measurement;
An accuracy determination unit that determines measurement accuracy according to the determined shooting situation;
And a control unit that displays the determined measurement accuracy. The information acquisition apparatus according to claim 1, wherein the situation determination unit includes at least a distance from a camera that has photographed the object to the object as the photographing situation. The captured image is a parallax image captured by a parallax image system that captures the object from a plurality of different viewpoints,
The information acquisition apparatus according to claim 2, wherein the situation determination unit determines the shooting distance based on the parallax image. The situation determination unit, as the shooting situation, any one of a distance from the camera that shot the object to the object, a resolution of the optical system of the camera, a pixel pitch of the image sensor, or a luminance of the object. The information acquisition apparatus according to claim 1, comprising at least. The measurement unit measures the shape of the object along two directions,
The accuracy determination unit determines the accuracy in the two directions as the measurement accuracy,
The information acquisition apparatus according to claim 1, wherein the control unit displays the determined accuracy in two directions. The information acquisition apparatus according to claim 1, wherein the control unit displays a measurement accuracy required for the object together with the measurement accuracy. The information acquisition apparatus according to claim 1, wherein the control unit displays the measurement value measured by the measurement unit together with the measurement accuracy. As the captured image, provided with a coincidence degree determination unit that determines the coincidence degree of the photographing ranges of the left and right photographed images photographed with a twin-lens camera,
The information acquisition apparatus according to claim 1, wherein the control unit displays the determined degree of coincidence together with the measurement accuracy. In a measurement method for measuring the shape of the object based on a captured image of the object,
A situation determination step for determining a shooting situation that affects the accuracy of the measurement;
An accuracy determination step of determining measurement accuracy in accordance with the determined shooting situation;
A measuring step for measuring the shape of the object based on a captured image of the object;
A display step of displaying the determined measurement accuracy. In a program for causing a computer to execute a measurement method for measuring the shape of the object based on a captured image of the object,
A situation determination step for determining a shooting situation that affects the accuracy of the measurement;
An accuracy determination step of determining measurement accuracy in accordance with the determined shooting situation;
A measuring step for measuring the shape of the object based on a captured image of the object;
A display step of displaying the determined measurement accuracy.