JP2019054406A - Imaging apparatus, imaging method, imaging system, and imaging assistance server - Google Patents

Abstract

To provide an imaging apparatus suitable for an application in which the same object is photographed a plurality of times.SOLUTION: An imaging apparatus includes an imaging unit that generates image data, an object information acquisition unit that acquires object information related to an object for which a construction photograph is taken, an image combining unit that combines the object information with captured image data generated by the imaging unit in response to a still image recording instruction to generate combined image data for the construction photograph, and a number-of-shootings control unit that controls the object information acquisition unit, the image combining unit, and a display unit according to the setting of the information on the number of times of shooting of the object. The number-of-shootings control unit causes the image combining unit to repeatedly use the object information to generate combined image data for the construction photograph until the still image recording for the number of times of shooting is completed.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an imaging apparatus for construction photography.

  At construction sites such as civil engineering and building construction, there are many constructions that are hidden from the eyes of people after construction, so as a proof that they were firmly constructed, take construction photographs at various stages of construction. Is done.

  Up until now, construction photography has been usually done by manually reading the blackboard text and lines on the blackboard where the shooting location, design values, actual measurement values, etc. have been manually written, in a position where the shooting target and shooting purpose can be clearly understood. It is done by arranging and taking photos as possible.

  This work requires time and effort to copy essential items. In many cases, a plurality of personnel are required for taking a picture. In addition, labor to carry the blackboard is also necessary.

  As a method for reducing such a burden, Japanese Patent No. 4270350 discloses a storage unit capable of storing memo information related to an image to be captured, and a display unit capable of displaying the memo information stored in the storage unit in the imaging mode. The digital camera provided with this is disclosed. The digital camera is also configured to be able to store shooting status information indicating that the subject has been shot.

  Japanese Patent Laid-Open No. 2001-24982 transmits shooting information created by a computer to a digital camera, stores the shooting information together with image data after shooting, and then transmits the image data and shooting information to the computer. A digital camera system is disclosed.

Japanese Patent No. 4270350 JP 2001-24982 A

  The above-described digital camera and digital camera system are effective in reducing labor and labor described above because information about the object to be photographed is acquired in advance. In addition, since the shooting status information is stored in association with the shot image, it is also effective for confirming that the user has forgotten to take a shot.

  However, none of the above-described digital cameras and digital camera systems are designed in consideration of the use of photographing the same object according to the field situation.

  An object of the present invention is to provide an imaging device, a photographing method, a photographing system, and a photographing auxiliary server suitable for use in photographing according to the situation on the site.

An imaging apparatus according to the present invention is generated by an imaging unit that generates image data, an object information acquisition unit that acquires object information regarding an object to be photographed for construction photography, and the imaging unit that receives a still image recording instruction. An image composition unit that synthesizes the object information with the captured image data generated to generate composite image data for a construction photograph; And a photographing number control unit for controlling the display unit and the display unit. The number-of-shooting control unit causes the image composition unit to repeatedly generate the composite image data for a construction photograph by repeatedly using the object information until the still image recording of the number of times of photographing is completed.
According to the imaging method of the present invention, image data is generated, object information relating to an object to be photographed for construction photography is acquired, and the object information is combined with the captured image data generated in response to a still image recording instruction. The composite image data for the construction photo is generated, and the object information is repeatedly used according to the setting of the number of times of photographing of the target object until the recording of the still image of the number of times of shooting is completed. Generate image data.
An imaging assistance server according to the present invention includes an information acquisition unit that acquires object information imaged by the imaging device, synthesis object information that is synthesized from the object information into an image imaged by the imaging device, And an information extraction unit that extracts user interface information that can be displayed on the display unit of the imaging apparatus.
The imaging system according to the present invention includes the imaging apparatus, an information acquisition unit that acquires object information captured by the imaging apparatus, and a synthesis target that is synthesized from the object information into an image captured by the imaging apparatus. The imaging assistance server includes an information extracting unit that extracts object information and user interface information that can be displayed on the display unit of the imaging apparatus.

  ADVANTAGE OF THE INVENTION According to this invention, the imaging device suitable for the use which image | photographs the same target object according to a condition, the imaging | photography method, an imaging | photography system, and an imaging | photography assistance server are provided.

It is a block diagram which shows the structure of the imaging device which concerns on embodiment. FIG. 2 shows a part of a flowchart of processing in the imaging apparatus shown in FIG. 1. FIG. FIG. 2 shows a part of a flowchart of processing in the imaging apparatus shown in FIG. 1. FIG. FIG. 2 shows a part of a flowchart of processing in the imaging apparatus shown in FIG. 1. FIG. FIG. 2 illustrates a state where a user photographs an object for photographing a construction photograph using the imaging apparatus illustrated in FIG. 1. The designation | designated part guide UI displayed on the touchscreen of the operation part of the imaging device shown by FIG. 1 is shown, and the mode that the room selection window is displayed is shown. The designation | designated part guide UI displayed on the touch panel of the operation part of the imaging device shown by FIG. 1 is shown, and the mode that the floor plan drawing window of a room is displayed is shown. 1 shows a designation unit guide UI displayed on the touch panel of the operation unit of the imaging apparatus shown in FIG. 1, and shows a state in which an information window of a designated object and a shooting number change window are displayed. FIG. 2 shows a designation unit guide UI displayed on the touch panel of the operation unit of the imaging apparatus shown in FIG. 1, and shows a state in which a live view window and a shooting count window are displayed. 2 shows a part of a flowchart of processing in a construction photo management server that communicates with the imaging apparatus shown in FIG. 1. 2 shows a part of a flowchart of processing in a construction photo management server that communicates with the imaging apparatus shown in FIG. 1.

[Embodiment]
Hereinafter, an imaging device according to an embodiment will be described with reference to the drawings.

[Constitution]
FIG. 1 is a block diagram illustrating a configuration of an imaging apparatus according to the embodiment. The imaging device 10 illustrated in FIG. 1 is configured by a digital camera, for example, but may be configured by various devices having an imaging function such as a tablet terminal, a smartphone, and a mobile phone with a camera function.

  The imaging device 10 includes an imaging unit 11 that generates image data, an image processing unit 12 that acquires and processes image data from the imaging unit 11, a control unit 13 that performs overall control of the imaging device 10, and various types of user operations. It includes an operation unit 14 that receives operation instructions and setting inputs, a display unit 15 that outputs various types of information including images, and a storage unit 16 that stores various types of information including images.

  The imaging apparatus 10 also includes a position sensor 17 a that detects the position of the imaging apparatus 10, an orientation sensor 17 b that detects the orientation of the imaging apparatus 10, and an orientation sensor 17 c that detects the orientation of the imaging apparatus 10. .

  The imaging apparatus 10 further includes a communication unit 18 that communicates various types of information with the construction photo management server, and a target information acquisition unit 19 that acquires target information related to the target of the construction photo. ing.

  These components of the imaging device 10, that is, the imaging unit 11, the image processing unit 12, the control unit 13, the operation unit 14, the storage unit 16, the position sensor 17 a, the orientation sensor 17 b, the orientation sensor 17 c, the communication unit 18, and the target object. Each of the information acquisition units 19 is configured by a combination of hardware and software, for example.

<Imaging unit 11>
The imaging unit 11 is configured to form an optical image based on incoming light, and generate and output image data corresponding to the formed optical image. The imaging unit 11 includes an imaging optical system 11a, an imaging element 11b, and a focus adjustment unit. The imaging optical system 11a has a diaphragm, a lens, and the like, and collects incoming light and makes it incident on the image sensor 11b. The imaging optical system 11a includes a focus lens for adjusting the in-focus state. The imaging element 11b includes, for example, a CMOS image sensor or a CCD image sensor, and generates image data related to the optical image formed by the imaging optical system 11a. The image sensor 11b includes, for example, a phase difference detection pixel so that the distance to the subject can be detected. The focus adjustment unit is configured to drive the focus lens of the imaging optical system 11a in the optical axis direction or drive the image sensor 11b in accordance with a focus control signal supplied from the control unit 13. .

<Image processing unit 12>
The image processing unit 12 is generally configured by an integrated circuit, and is integrated with a configuration in which various functions are easily used. The image processing unit 12 is configured to acquire image data from the imaging unit 11 and to perform image processing corresponding to the shooting mode and shooting state on the acquired image data.

  The image processing unit 12 is configured to generate various image data, image files, and signals by performing image processing on the image data acquired from the imaging unit 11. For example, the image processing unit 12 is configured to generate and output live view image data from the image data acquired from the imaging unit 11. The image processing unit 12 is also configured to generate and output a still image file from the image data acquired from the imaging unit 11. The image processing unit 12 is also configured to generate and output a moving image file from the image data acquired from the imaging unit 11. The image processing unit 12 is further configured to generate and output a focus control signal by image processing.

<Operation unit 14>
The operation unit 14 is a device that allows a user to operate the imaging apparatus 10. The operation unit 14 includes, for example, a release button, a moving image button, a setting button, a selection key, a start / stop button, a touch panel, and the like. The release button is an operation element for instructing still image shooting. The moving image button is an operation element for instructing the start and end of moving image shooting. The setting button is an operation element for causing the display unit 15 to display a setting screen of the imaging apparatus 10. The selection key is an operation element for selecting and determining an item on the setting screen, for example. The start / stop button is an operation element for instructing start and stop of the imaging apparatus 10. The touch panel is provided integrally with the display screen of the display unit 15 and is an operation element for detecting a touch operation by the user on the display screen. You may be comprised so that operation equivalent to a release button, a moving image button, a setting button, a selection key, and a start / stop button can be performed with a touch panel.

<Display unit 15>
The display unit 15 is configured by, for example, a liquid crystal display or an organic EL display. For example, the display unit 15 is configured to output various information supplied from the control unit 13. For example, the display unit 15 is configured to display an image according to the image data supplied from the control unit 13. The display unit 15 is also configured to output information other than the image supplied from the control unit 13. For example, the display unit 15 is configured to display character information supplied from the control unit 13 in addition to the image. Furthermore, the display unit 15 may be configured to output audio information supplied from the control unit 13.

<Storage unit 16>
The storage unit 16 is configured by a flash memory, for example. The storage unit 16 is configured to store various information supplied from the control unit 13. The storage unit 16 is also configured to provide various types of stored information to the control unit 13 in response to a request.

<Position sensor 17a, orientation sensor 17b, posture sensor 17c>
The position sensor 17a, the azimuth sensor 17b, and the attitude sensor 17c are configured to detect the position, azimuth, and attitude of the imaging device, respectively. The position sensor 17a is configured by a position measurement sensor that acquires position information using, for example, a GPS, a 3G antenna, or a WiFi access point. The direction sensor 17b is composed of a geomagnetic sensor such as an electronic compass, for example. The posture sensor 17c is configured using, for example, an angular velocity sensor such as a gyro sensor or an acceleration sensor.

<Communication unit 18>
The communication unit 18 is a device that enables communication between the imaging apparatus 10 and the construction photo management server. Communication between the imaging device 10 and the construction photo management server may be performed directly between the two, or may be performed via another device. For example, the communication unit 18 is configured to receive a designated unit guide UI program from the construction photo management server. The communication unit 18 is also configured to transmit work information to the construction photo management server. The construction photo management server may be configured as a cloud server. In addition, the construction photo management server assists photography, so it may be called a photography assistance server. In addition, a part or a plurality of functions installed in the imaging apparatus 10 may be provided in an external server or commissioned by devising information exchanged via the communication unit 18.

  The designated part guide UI program received by the communication part 18 includes, for example, a construction drawing. The construction drawing is preferably created separately for each work process of construction, and includes information necessary for construction photographs in the work process. The information necessary for the construction photo includes, for example, information on the target set for each target for which the construction photo is to be taken, information on the number of times of shooting, and the like. The necessary information of the construction photo also preferably includes position information of the object to be photographed for the construction photo. For example, in the construction drawing, coordinates are set for each object, and information necessary for a construction photograph is recorded in association with the coordinates. Thus, since the construction photo management server assists in taking a picture, it may be called a photography assistance server.

  The work information transmitted by the communication unit 18 includes, for example, an image file including a taken construction photograph and correction information of a specified unit guide UI parameter corrected on site. The modification information of the designation unit guide UI parameter includes, for example, change information of the number of photographing times. The correction information of the number of shooting includes, for example, information on the object whose number of shooting has been corrected and information on the number of shooting after the correction. The modification information of the designated part guide UI parameter is reflected in the designated part guide UI program for the next and subsequent work, for example, in the construction photo management server.

<Object information acquisition unit 19>
The object information acquisition unit 19 is configured to acquire object information regarding the object to be photographed for the construction photograph from the designation unit guide UI program received by the communication unit 18.

  The object information acquisition unit 19 includes a blackboard information generation unit 19a. The blackboard information generation unit 19a is configured to generate and output blackboard information, which is information to be copied into the construction photograph, from the object information acquired by the object information acquisition unit 19.

  The construction photo must be able to identify who, when, where, what, what, and how. For this reason, the blackboard information to be copied into the construction photograph includes the witness and the confirmer, construction time and work process, construction location and construction site, construction item and classification, standards, display marks, dimensions, etc., construction status, etc. Contains information. Such a function may be included in the server. In other words, the object information acquisition itself represented by the functional block is performed by an external server, and the computer circuit and program provided in the server perform the same processing, and the blackboard information and UI program are transmitted to the imaging apparatus 10 as a communication unit. The configuration may be such that the data is transmitted via 18. It is not necessary for the server to perform all of this, but the server transmits information to be written on the blackboard and auxiliary information on the shooting position, and the imaging apparatus 10 that receives the information creates the blackboard image itself or a screen with a UI display for imaging. Sharing may be performed. Of course, the server may transmit the blackboard image or UI display data itself. In other words, the server here has a function of acquiring object information such as a design drawing related to the object to be imaged by the image capturing apparatus 10, and appropriately selects information for each use from the object information, and the image capturing apparatus 10 can be expressed as a server having an information extraction (generation) unit that extracts (generates) synthesis object information to be combined with an image captured by the image 10 and user interface information that can be displayed on the display unit of the imaging apparatus 10. Is. That is, if the server has part or all of the image processing unit 12 and the object information acquisition 19 in FIG. 1 and has a transmission unit that transmits the generated information to the communication unit 18 of the imaging device 10. Good. Further, the object information acquisition unit 19 in FIG. 1 acquires not only the information of the design drawing but also the information extracted from the object information such as the design drawing (image information or text information). This design is also possible.

<Image processing unit 12>
The image processing unit 12 includes a blackboard image generation unit 12a and an image composition unit 12b for generating composite image data for construction photographs.

  The blackboard image generation unit 12a is configured to generate blackboard image data to be copied to the construction photo based on the blackboard information generated by the blackboard information generation unit 19a.

  The image synthesizing unit 12b is configured to synthesize the blackboard image data generated by the blackboard image generating unit 12a with the image data acquired from the imaging unit 11 to generate and output composite image data for construction photographs. ing. The image composition unit 12b is also configured to generate and output a construction photo still image file based on the generated composite image data for the construction photo.

<Control unit 13>
The control unit 13 operates appropriately for each of the imaging unit 11, the image processing unit 12, the operation unit 14, the storage unit 16, the position sensor 17 a, the orientation sensor 17 b, the orientation sensor 17 c, the communication unit 18, and the object information acquisition unit 19. It is comprised so that it may perform. The control unit 13 is also configured to appropriately control the exchange of information between these components.

  The control unit 13 includes a photographing number control unit 13a. For example, the number-of-shooting control unit 13a is configured to perform the following operation. (1) Each time the image composition unit 12b generates and outputs a construction photo still image file, the number of photographing is subtracted. (2) It is determined whether or not the number of photographing after subtraction is zero. (3) If it is determined that the number of shootings is not 0, the remaining number of shootings is notified.

[Operation]
Next, the operation of the imaging device 10 according to the present embodiment will be described. 2A, 2B, and 2C show flowcharts of processing in the imaging apparatus 10 according to the present embodiment. 2A, 2B, and 2C are performed mainly by the control unit 13.

  The flowcharts of FIGS. 2A, 2B, and 2C represent the process from when the imaging apparatus 10 is activated in a standby state waiting for activation until the imaging apparatus 10 is stopped and returned to the standby state.

  In the standby state, when the start / stop button of the operation unit 14 is operated by the user, the control unit 13 determines that activation of the imaging device 10 is instructed, and activates the imaging device 10.

  After the imaging device 10 is activated, in step S101, the control unit 13 determines whether or not the current operation mode of the imaging device 10 is the normal shooting mode. The storage unit 16 stores the operation mode of the imaging device 10 set by the operation of the operation unit 14 by the user. The operation mode is set to the reception mode in the initial state. The control unit 13 determines whether or not the current operation mode is the normal shooting mode according to the stored operation mode. If it is determined that the current operation mode is the normal shooting mode, the process proceeds to step S141. On the other hand, when it is determined that the operation mode of the imaging apparatus 10 is not the normal shooting mode, the process proceeds to step S102.

  If it is determined in step S101 that the current operation mode is the normal shooting mode, in step S141, the control unit 13 causes the imaging device 10 to perform normal shooting processing. Thereafter, the process proceeds to step S128. In the normal shooting process, a still image or a moving image is shot according to a user operation.

  If it is determined in step S101 that the current operation mode is not the normal shooting mode, in step S102, the control unit 13 sets the current operation mode of the imaging device 10 according to the operation mode stored in the storage unit 16. It is determined whether or not it is a photo shooting mode. If it is determined that the current operation mode is the construction photography mode, the process proceeds to step S103. On the other hand, if it is determined that the current operation mode of the imaging apparatus 10 is not the construction photography mode, the process proceeds to step S171 shown in FIG. 2B.

  If it is determined in step S102 that the current operation mode is not the construction photograph shadow mode, in step S171 shown in FIG. 2B, the control unit 13 performs the operation of the imaging device 10 according to the operation mode stored in the storage unit 16. It is determined whether or not the current operation mode is a playback mode. If it is determined that the current operation mode is the playback mode, the process proceeds to step S181. On the other hand, when it is determined that the current operation mode of the imaging device 10 is not the reproduction mode, the process proceeds to step S172.

  If it is determined in step S171 that the current operation mode is the playback mode, in step S181, the control unit 13 causes the imaging device 10 to perform playback processing. Thereafter, the process proceeds to step S129 shown in FIG. 2C. In the reproduction process, the image file selected by the user is reproduced on the display unit 15.

  If it is determined in step S171 that the current operation mode is not the playback mode, in step S172, the control unit 13 determines that the current operation mode of the imaging device 10 is the transmission mode according to the operation mode stored in the storage unit 16. It is determined whether or not. If it is determined that the current operation mode is the transmission mode, the process proceeds to step S182. On the other hand, when it is determined that the current operation mode of the imaging apparatus 10 is not the transmission mode, the process proceeds to step S173.

  If it is determined in step S172 that the current operation mode is the transmission mode, in step S182, the control unit 13 causes the imaging device 10 to perform transmission processing. The transmission process is a process of transmitting work information to the construction photo management server or the cloud. Thereafter, the process proceeds to step S129 shown in FIG. 2C.

  When it is determined in step S172 that the current operation mode is not the transmission mode, in step S173, the control unit 13 determines that the current operation mode of the imaging device 10 is the reception mode according to the operation mode stored in the storage unit 16. It is determined whether or not. If it is determined that the current operation mode is the reception mode, the process proceeds to step S183. On the other hand, when it is determined that the current operation mode of the imaging apparatus 10 is not the reception mode, the process proceeds to step S173.

  When it is determined in step S173 that the current operation mode is the reception mode, in step S183, the control unit 13 causes the imaging device 10 to perform reception processing. The reception process is a process of receiving the designated part guide UI program from the construction photo management server or the cloud. Thereafter, the process proceeds to step S129 shown in FIG. 2C.

  When it is determined in step S173 that the current operation mode is not the reception mode, in step S174, the control unit 13 determines that the current operation mode of the imaging device 10 is the setting mode according to the operation mode stored in the storage unit 16. It is determined whether or not. If it is determined that the current operation mode is the setting mode, the process proceeds to step S184. Conversely, if it is determined that the current operation mode of the imaging apparatus 10 is not the setting mode, the process proceeds to step S175.

  If it is determined in step S174 that the current operation mode is the setting mode, in step S184, the control unit 13 causes the imaging device 10 to perform setting processing. The setting process is a process for accepting a setting by the user via the operation unit 14. Thereafter, the process proceeds to step S129 shown in FIG. 2C.

  If it is determined in step S174 that the current operation mode is not the setting mode, in step S175, the control unit 13 causes the imaging device 10 to perform other processing. After the other processes, the process proceeds to step S129 shown in FIG. 2C.

  If it is determined in step S102 shown in FIG. 2A that the current operation mode is the construction photography mode, the control unit 13 activates the position sensor 17a, the orientation sensor 17b, and the attitude sensor 17c in step S103. Thereafter, the process proceeds to step S104.

  In step S104, the control unit 13 causes the imaging unit 11 to start imaging. The control unit 13 also causes the image processing unit 12 to generate image data for live view (LV) and causes the display unit 15 to display a live view (LV) image. Thereafter, the process proceeds to step S105.

  In step S <b> 105, the control unit 13 determines whether or not an instruction for requesting to display a designation unit guide user interface (designation unit guide UI) for the user to designate an object to be photographed for a construction photograph has been received. . If it is determined that an instruction to display the designation unit guide UI has been received, the process proceeds to step S106. On the other hand, if it is determined that the instruction to display the designated part guide UI has not been received, the process proceeds to step S151.

  For example, the control unit 13 displays an icon for displaying the designation unit guide UI on the touch panel of the operation unit 14 during the construction photography mode, and when the touch unit detects that the icon is touched, the designation unit It is determined that a guide UI display instruction has been received. FIG. 3 shows a situation where the user takes an image of the object 30 for taking a construction photograph using the imaging device 10.

  If it is determined in step S105 that the designation unit guide UI display instruction has not been received, in step S151, the control unit 13 determines whether still image recording has been instructed. For example, when the release button of the operation unit 14 is operated by the user or when the still image shooting button on the touch panel of the operation unit 14 is operated, the control unit 13 determines that the still image recording is instructed. . If it is determined that still image recording has been instructed, the process proceeds to step S152. If it is determined that still image recording is not instructed, the process proceeds to step S128 shown in FIG. 2C.

  If it is determined in step S151 that still image recording has been instructed, in step S152, the control unit 13 causes the image processing unit 12 to generate a still image file and stores the still image file in the storage unit 16. Thereafter, the processing proceeds to step S128 shown in FIG. 2C.

  If it is determined in step S <b> 105 that an instruction to display the designation unit guide UI has been received, the control unit 13 displays the designation unit guide UI on the touch panel of the operation unit 14 in step S <b> 106. Thereafter, the process proceeds to step S107.

  4A to 4D show the designation unit guide UI displayed on the touch panel 50 of the operation unit 14. FIG. 4A shows a screen that is initially displayed on the designation unit guide UI, and shows a state in which designation candidates are displayed. The touch panel 50 shown in FIG. 4A shows a determination button icon 50a, a return button icon 50b, a title window 50c, and a room designation window 50d.

  In the title window 50c, information on a construction target (for example, “Company A company building”) and information on a current process (for example, “process X”) are displayed. In the room designation window 50d, information on some designation candidates (for example, “4F room B, room C, room D”) and a designation icon 50e for designating the designation candidates are displayed. For example, the user can change the designation candidate by moving the designation icon 50e by operating the selection key of the operation unit 14, and can confirm the designation candidate by touching the icon 50a of the determination button. be able to.

  When the determination button icon 50a is touched, as shown in FIG. 4B, information on the designated room (for example, “Company A company building 4F D room”) is displayed in the title window 50c. A floor plan window 50f is displayed. In the floor plan drawing window 50f, several icons 50g indicating objects (for example, pillars) for taking a construction photograph in a designated room are displayed.

  In step S <b> 107, the control unit 13 determines whether or not an object for taking a construction photograph has been designated. For example, when one of the object icons 50g is touched by the user, is highlighted as indicated by the icon 50h, and the decision button icon 50a is further touched, the control unit 13 can take a construction photograph. It is determined that an object has been specified. If it is determined that the object to be photographed for the construction photo is designated, the process proceeds to step S108. If it is determined that the construction photo shooting target is not specified, the process proceeds to step S128 shown in FIG. 2C.

  If it is determined in step S107 that an object to be photographed for construction photography has been designated, in step S108, the control unit 13 acquires object information regarding the object to be photographed for construction photography in the object information obtaining unit 19. Then, the blackboard information generation unit 19a is caused to generate blackboard information that is information to be copied to the construction photograph from the target object information acquired by the target object information acquisition unit 19, and this is output to the blackboard image generation unit 12a.

  The control unit 13 also causes the blackboard image generation unit 12a to generate blackboard image data to be copied to the construction photo based on the blackboard information generated by the blackboard information generation unit 19a. The control unit 13 also causes the blackboard image generation unit 12a to hold the generated blackboard image data until an instruction to generate another blackboard image data is received. Thereafter, the processing proceeds to step S121 shown in FIG. 2C. The blackboard image data may be deleted when the required number of times of shooting has been completed.

  In step S121 shown in FIG. 2C, as shown in FIG. 4C, the control unit 13 causes the touch panel 50 of the operation unit 14 to display an object information window 50i and a shooting count change window 50k. For example, information on the designated object (for example, “component: rebar A”) is displayed in the object information window 50i. The shooting number change window 50k has a shooting number window 50l and a spin button icon 50m. An initial value of the number of times of photographing is displayed in the number of times of photographing window 50l. Information on the initial value of the number of photographing is received by the communication unit 18 and included in the designation unit guide UI program stored in the storage unit 16. The user can increase or decrease the number of shootings by operating the spin button icon 50m. The display of the shooting count window 50l is changed in accordance with the operation of the spin button icon 50m. Further, the user can determine the number of times of shooting by touching the icon 50a of the determination button. Thereafter, the process proceeds to step S122.

  In step S122, the control unit 13 determines whether or not the number of shootings has been changed. For example, the user operates the spin button icon 50m to change the display of the shooting number window 50l, touches the enter button icon 50a, and before and after the spin button icon 50m is operated, When the display is different, the control unit 13 determines that the number of photographing has been changed. If it is determined that the number of photographing has been changed, the process proceeds to step S161. On the other hand, if it is determined that the number of shootings has not been changed, the process proceeds to step S123.

  If it is determined in step S122 that the number of times of photographing has been changed, in step S161, the control unit 13 acquires information on the number of times of photographing after the change through the photographing number change window 50k, and updates the parameter of the number of times of photographing. The parameter of the number of times of photographing is stored in the storage unit 16, for example. Thereafter, the process proceeds to step S162.

  In step S162, the control unit 13 determines whether or not the number of shootings after the change is zero. If it is determined that the number of shootings after the change is 0, the process proceeds to step S128. On the other hand, when it is determined that the number of shootings after the change is not 0, the process proceeds to step S123.

  If it is determined in step S122 that the number of times of shooting has not been changed, or if it is determined in step S162 that the number of times of shooting after the change has not been zero, in step S123, the control unit 13 causes the image combining unit 12b. Then, the blackboard image data generated by the blackboard image generation unit 12a is combined with the image data acquired from the imaging unit 11 to generate composite image data for a construction photograph.

  The control unit 13 also causes the image processing unit 12 to generate composite image data for live view (LV) and display it in the live view (LV) window 50n as shown in FIG. 4D. In the LV window 50n, a construction photograph image in which a blackboard image 50o is superimposed on the front surface of an image captured by the imaging unit 11 is displayed. A shooting number window 50p is displayed near the LV window 50n.

  In the touch panel 50 shown in FIG. 4D, preferably, the user can change the position of the blackboard image 50o by a drag-and-drop operation. Further, the user can return to the screen of FIG. 4C on which the shooting number change window 50k is displayed by touching the icon 50b of the return button. Thereafter, the process proceeds to step S124.

  In step S124, the control unit 13 determines whether still image recording has been instructed. For example, when the release button of the operation unit 14 is operated by the user or when the still image shooting button on the touch panel of the operation unit 14 is operated, the control unit 13 determines that the still image recording is instructed. . If it is determined that still image recording has been instructed, the process proceeds to step S125. If it is determined that still image recording is not instructed, the process proceeds to step S128.

  If it is determined in step S124 that still image recording has been instructed, in step S125, the control unit 13 causes the image composition unit 12b to generate a construction photo still image file based on the composite image data for the construction photo. Then, the construction still image file is stored in the storage unit 16. The control unit 13 also subtracts 1 from the parameter of the number of times of shooting. Thereafter, the process proceeds to step S126.

  In step S126, the control unit 13 determines whether or not the remaining number of shootings is zero. If it is determined that the remaining number of shootings is 0, the process proceeds to step S127. On the other hand, if it is determined that the remaining number of shootings is not 0, the process proceeds to step S128.

  If it is determined in step S126 that the remaining number of times of photographing is 0, in step S127, the control unit 13 indicates that the necessary number of times of photographing for the object of the current construction photograph has been taken. Record in physical information. For example, the object information has a flag indicating whether or not the required number of times of shooting has been completed, and the control unit 13 records that the required number of times of shooting has been completed by changing this flag. The control unit 13 also stores the updated object information in the storage unit 16.

  The updated object information is transmitted to the construction photo management server or the cloud, for example, when the operation mode of the imaging device 10 is changed to the transmission mode. Alternatively, the updated object information may be automatically transmitted immediately after the update without waiting for the change of the operation mode. Thereafter, the process proceeds to step S128.

  In step S128, the control unit 13 determines whether the end of the shooting mode is instructed. If it is determined that the end of the shooting mode has been instructed, the process proceeds to step S129. Conversely, if it is determined that the end of the shooting mode has not been instructed, the process proceeds to step S101 shown in FIG. 2A.

  If it is determined in step S128 that the end of the shooting mode has been instructed, in step S129, the control unit 13 determines whether or not an instruction to stop the imaging device 10 has been issued. For example, when the start / stop button of the operation unit 14 is operated again by the user, the control unit 13 determines that an instruction to stop the imaging device 10 is given. In step S129, when it is determined that the stop of the imaging device 10 is not instructed, the process returns to step S101 illustrated in FIG. 2A. On the other hand, if it is determined in step S129 that the stop of the imaging device 10 has been instructed, the control unit 13 stops the imaging device 10 and the imaging device 10 returns to the standby state again.

  As described above, in the imaging device 10 according to the present embodiment, the blackboard image generation unit 12a is generated by the blackboard image generation unit 12a while the shooting number control unit 13a of the control unit 13 is shooting the same object. The same blackboard image data is repeatedly used to control to generate composite image data for construction photographs. Accordingly, only one piece of blackboard image data is generated for one target object for construction photography. As described above, the imaging apparatus 10 includes an object information acquisition unit 19 that acquires object information related to an object to be photographed for a construction photograph, in addition to the imaging unit 11 that generates image data. Generate an image. One of the images for synthesis is an image as shown in FIG. 4B for imaging control or confirmation, and the other is an image to be synthesized with a captured image as shown in FIG. 4D. As described above, the imaging apparatus 10 includes the image synthesis unit 12b that synthesizes the object information with the captured image data generated by the imaging unit 10 in response to the image recording instruction and generates the composite image data for the construction photograph. . In addition, by including the shooting number control unit 13a that controls the object information acquisition unit 19, the image composition unit 12b, and the display unit 15 according to the setting of the shooting number information of the target object, until the still image recording of the shooting number is completed. The image synthesizing unit 12b repeatedly uses the object information to generate the composite image data for the construction photograph. Therefore, the imaging apparatus 10 that can shoot without any mistake and can obtain an image that is a trail is obtained. It can be provided.

  Although not shown in the flowcharts of FIGS. 2A to 2C, the control unit 13 displays, for example, a blackboard image generation instruction icon on the touch panel of the operation unit 14 during the construction photography mode. When the touch is sensed, it requests the input of information necessary for blackboard image generation, causes the blackboard image generation unit 12a to generate blackboard image data based on the input information, and causes the blackboard image generation unit 12a to Composite image data for photographs is generated, composite image data for LV is generated by the image processing unit 12, LV images of construction photographs are displayed on the display unit 15, and an image processing unit is displayed in response to a still image recording instruction It is also possible to perform control so that the construction photo still image file is generated in 12 and the construction photo still image file is stored in the storage unit 16.

  Based on the information on the position, orientation, and orientation of the imaging apparatus 10 detected by the position sensor 17a, the orientation sensor 17b, and the orientation sensor 17c, the control unit 13 captures a shooting distance such as a foreground or a distant view, an eastward direction, or a southward direction. The blackboard image generation unit 12a may be controlled to calculate the shooting direction information of the shooting position, the shooting location information such as the upper and lower portions, and add the shooting status information as auxiliary information to the blackboard image data. This makes it easy to grasp the situation at the time of shooting after shooting.

  The control unit 13 also displays a floor plan drawing window 50f based on information on the position, orientation, and orientation of the imaging device 10 and object information included in the designation unit guide UI program received by the communication unit 18. 4B, it is determined whether or not the object specified by the user on the touch panel 50 is a correct object, for example, whether or not the object is present in the shooting direction of the current imaging apparatus 10, and is determined not to be the correct object. In such a case, a warning may be output via the display unit 15.

  Further, the number-of-shooting control unit 13a, for example, based on the information on the position, orientation, and orientation of the imaging device 10 and the object information included in the designation unit guide UI program, for example, the current imaging device 10 and the position of the object. Based on the relationship and information such as the shooting direction of the imaging device 10, it is determined whether or not the shooting has been completed before the required number of shootings is completed, and it is determined that the shooting has been completed before the required number of shootings is completed. In such a case, a warning may be output via the display unit 15.

  Each process performed by the control unit 13 according to the present embodiment can be stored as a program that can be executed by a computer. The program can be stored and distributed in a recording medium of an external storage device such as a magnetic disk, an optical disk, or a semiconductor memory. The computer can execute each process performed by the control unit 13 described above by reading a program stored in the recording medium of the external storage device and operating according to the read program.

  Next, a construction photo management server that communicates with the imaging device 10 described above will be described. 5A and 5B show a flowchart of processing in the construction photo management server that communicates with the imaging apparatus shown in FIG.

  In step S201, the construction photo management server determines whether information such as a construction photo and a design drawing has been obtained. If it is determined that the information has been obtained, the process proceeds to step S202. On the other hand, when it is determined that the information is not obtained, the process proceeds to step S231 illustrated in FIG. 5B.

  If it is determined in step S201 that the information has been obtained, in step S202, the construction photo management server determines whether a construction photo has been acquired. If it is determined that the construction photo has been acquired, the process proceeds to step S203. On the other hand, if it is determined that the construction photograph has not been acquired, the process proceeds to step S211.

  If it is determined in step S202 that a construction photo has been acquired, in step S203, the construction photo management server organizes and records the construction photo and its auxiliary information for each owner, contractor, construction information, and construction type. Create a construction photo ledger. Thereafter, the process proceeds to step S201.

  If it is determined in step S202 that the construction photo has not been acquired, in step S211, the construction photo management server stores drawing data (hereinafter referred to as a designated portion guide UI drawing) used for the designated portion guide UI program. It is determined whether or not it has been created. If it is determined that the designated part guide UI drawing has not been created, the process proceeds to step S221 shown in FIG. 5B. On the other hand, when it is determined that the designated part guide UI drawing has been created, the process proceeds to step S212.

  If it is determined in step S211 that the designated portion guide UI drawing has not been created, the construction photo management server individually determines each structure in the design drawing in step S221 shown in FIG. 5B. The determination of each structure may be performed using an image recognition technique, for example. Thereafter, the process proceeds to step S222.

  In step S222, the construction photo management server converts the type and coordinates of each structure into text. The text conversion may be performed using a recognition technique such as OCR, for example. Furthermore, the information regarding each structure is acquired by collating a text with a database. Furthermore, information relating to each structure may be acquired with reference to a layout diagram and various lists in the design book. Thereafter, the process proceeds to step S223.

  In step S223, the construction photo management server arranges a shooting point icon at or near the coordinates of each structure in the design drawing. Thereafter, the process proceeds to step S224.

  In step S224, the construction photo management server provides a switch function for the shooting point icon to create a UI program, and creates a designated portion guide UI drawing. The switch function has a function of displaying information related to the structure corresponding to the icon, for example, in response to an access operation. The switch function also includes a flag function. The flag function has a function of holding information on two states indicating whether shooting has already been performed at the shooting point, that is, information indicating whether shooting has been performed or not. Thereafter, the processing moves to step S201 shown in FIG. 5A.

  When it is determined in step S211 shown in FIG. 5A that the designated part guide UI drawing has been created, in step S212, the construction photo management server determines whether or not an auxiliary operation for creating the designated part guide UI drawing is necessary. Determine whether. The construction photo management server can create a new designated part guide UI program by learning the creation result of the designated part guide UI program created in the past. For this purpose, sufficient learning must be performed. In step S212, it is determined that the auxiliary operation for creating the designated part guide UI program is not necessary when learning is sufficiently performed to newly create the designated part guide UI program. If it is determined that the auxiliary operation for creating the designated portion guide UI drawing is necessary, the process proceeds to step S213. In this case, the designated part guide UI program is created by manual operation by the operator of the construction photo management server. On the other hand, if it is determined that the auxiliary operation for creating the designated portion guide UI drawing is not necessary, the process proceeds to step S216.

  If it is determined in step S212 that an auxiliary operation for creating the designated part guide UI drawing is necessary, in step S213, the construction photo management server acquires additional information from the corresponding design drawing or other corresponding material. Thereafter, the process proceeds to step S214.

  In step S <b> 214, the construction photo management server performs an auxiliary operation for creating the designated unit guide UI drawing. This auxiliary operation includes corrections to the designated portion guide UI drawing created in steps S221 to S224, for example, changes, additions and deletions of shooting points, changes and additions of information about each structure, and the like. For example, the construction photo management server displays the designated unit guide UI drawing on the display unit so that the operator can confirm it. The operator inputs necessary information while viewing the designated part guide UI drawing. This information includes information on an object set for each object for which a construction photograph is to be photographed, position information on the object for which the construction photograph is photographed, and the like. Further, the construction photo management server arranges an icon of the shooting point at or near the coordinates of each structure in the designated part guide UI drawing. Then, the construction photo management server provides a switch function for the shooting point icon to make a UI program. Thereafter, the process proceeds to step S215.

  In step S215, the construction photo management server learns the correction pattern of the designated part guide UI drawing. The learning of the correction pattern of the designation unit guide UI drawing is preferably performed for each user. Learning of the correction pattern of the designation unit guide UI parameter is performed using, for example, a machine learning technique. The learning of the correction pattern of the designation unit guide UI drawing may be performed by requesting an external organization. Thereafter, the process proceeds to step S201.

  If it is determined in step S212 that the auxiliary operation for creating the designated portion guide UI drawing is not necessary, the construction photo management server acquires a learning result for creating the designated portion guide UI drawing in step S216. Thereafter, the process proceeds to step S201.

  If it is determined in step S201 that the information has not been obtained, in step S231, the construction photo management server determines whether or not a request for transmission of the designation unit guide UI program for the corresponding process has been received. If it is determined that a request for transmission of the designated part guide UI program has been received, the process proceeds to step S232. On the other hand, if it is determined that the request for transmission of the designated part guide UI program has not been received, the process proceeds to step S241.

  If it is determined in step S231 that a request for transmission of the designated part guide UI program has been received, in step S232, the construction photo management server determines whether or not a designated part guide UI program has been created. If it is determined that the designated part guide UI program has been created, the process proceeds to step S233. On the other hand, if it is determined that the specified part guide UI program has not been created, the process proceeds to step S234.

  If it is determined in step S232 that the designated portion guide UI program has been created, the construction photo management server transmits the designated portion guide UI program in step S233. Thereafter, the processing moves to step S201 shown in FIG. 5A.

  If it is determined in step S232 that the designated part guide UI program has not been created, the construction photo management server transmits information for outputting a warning to the display unit 15 of the imaging apparatus 10 in step S234. Thereafter, the processing moves to step S201 shown in FIG. 5A.

  If it is determined in step S231 that a request for transmission of the designated part guide UI program has not been received, the construction photo management server determines in step S241 whether or not it is necessary to check the construction record. If it is determined that the construction record needs to be confirmed, the process proceeds to step S242. On the other hand, if it is determined that it is not necessary to check the construction record, the process proceeds to step S201 shown in FIG. 5A.

  If it is determined in step S241 that the construction record needs to be confirmed, in step S242, the construction photo management server searches for necessary information from the construction record and transmits it. Thereafter, the processing moves to step S201 shown in FIG. 5A.

  The embodiments of the present invention have been described above with reference to the drawings. However, the present invention is not limited to these embodiments, and various modifications and changes can be made without departing from the scope of the present invention. Also good. The various modifications and changes described here include an implementation in which the above-described embodiments are appropriately combined.

DESCRIPTION OF SYMBOLS 10 ... Imaging device, 11 ... Imaging part, 11a ... Imaging optical system, 11b ... Imaging element, 12 ... Image processing part, 12a ... Blackboard image generation part, 12b ... Image composition part, 13 ... Control part, 13a ... Number of imaging | photography Control unit, 14 ... operation unit, 15 ... display unit, 16 ... storage unit, 17a ... position sensor, 17b ... orientation sensor, 17c ... attitude sensor, 18 ... communication unit, 19 ... object information acquisition unit, 19a ... blackboard information Generating unit, 30 ... object, 50 ... touch panel, 50a ... determination button icon, 50b ... back button icon, 50c ... title window, 50d ... room designation window, 50e ... designation icon, 50f ... floor plan drawing window, 50g ... Object icon, 50h ... Object icon, 50i ... Information window, 50k ... Shooting number change window, 50l ... Shooting number window , 50m ... spin button on the icon, 50n ... Live View window, 50o ... blackboard image, 50p ... the number of shots window.

Claims (10)

An imaging unit for generating image data;
An object information acquisition unit for acquiring object information related to an object of construction photography;
An image synthesis unit that synthesizes the object information with the captured image data generated by the imaging unit in response to an instruction to record a still image, and generates composite image data for a construction photograph;
A shooting number control unit for controlling the object information acquisition unit and the image synthesis unit according to the setting of the number of shootings of the object;
The imaging apparatus, wherein the imaging number control unit causes the image synthesis unit to repeatedly generate the composite image data for construction photographs by repeatedly using the object information until the recording of the still image of the number of imagings is completed.   A blackboard image generation unit configured to generate blackboard image data based on the object information; and the image synthesis unit generates the composite image data by synthesizing the captured image data and the blackboard image data. Item 2. The imaging device according to Item 1.   The imaging apparatus according to claim 2, wherein the image composition unit generates the composite image data by repeatedly using the same blackboard image data generated by the blackboard image generation unit while photographing the same object.   The imaging apparatus according to claim 1, further comprising a photographing number changing unit that receives an instruction to change the number of photographing.   The imaging device according to any one of claims 1 to 3, wherein the display unit displays a shooting number display unit indicating a remaining number of shootings near an image corresponding to the composite image data. Generate image data,
Get object information about the object of construction photo shooting,
Composite image data for construction photographs is generated by combining the object information with the captured image data generated in response to a still image recording instruction,
A shooting method for generating composite image data for construction photographs by repeatedly using the object information until recording of the still image of the number of times of shooting is completed in accordance with the setting of the number of times of shooting of the object. Generate image data,
Get object information about the object of construction photo shooting,
Composite image data for construction photographs is generated by combining the object information with the captured image data generated in response to a still image recording instruction,
According to the setting of the information on the number of times of shooting of the object, the computer is caused to repeatedly generate the composite image data for the construction photograph by repeatedly using the object information until the still image recording of the number of times of shooting is completed. program. An information acquisition unit that acquires object information captured by the imaging apparatus according to claim 1;
An imaging assistance having an information extraction unit for extracting, from the target information, target information for synthesis to be combined with an image captured by the imaging device and user interface information that can be displayed on the display unit of the imaging device. server.   The imaging assistance server according to claim 8, further comprising a communication unit that transmits the synthesis target information extracted by the information extraction unit and the user interface information to the imaging apparatus. An imaging device according to claim 1;
Information acquisition unit for acquiring object information photographed by the imaging device, composition object information to be synthesized from the object information to an image photographed by the imaging device, and display on the display unit of the imaging device An imaging system comprising an imaging assistance server having an information extraction unit that extracts possible user interface information.