JP2013117943A - Application program and smart device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To maintain the efficiency of a photographing task when performing photographing task of site photographs at a job site and to improve the visibility and editing characteristic of the photographed site photographs.SOLUTION: An application program in this invention makes a smart device function as: photographing means for photographing a photographic image of a job site; first storage means for preliminarily storing a virtual display board image with prescribed entries provided; input means for inputting data about the job site to a prescribe entry of the virtual display board image; image editing means for superposing the virtual display board image with data inputted by the input means on the photographic image photographed by the photographing means to arrange the virtual display board image; and second storage means for storing the photographic image with the virtual display board image with the virtual display board image arranged by the image editing means.

Description

  The present invention relates to an application program and a smart device.

  Conventionally, one of the management work required at construction sites such as construction work and civil engineering work is a work of photographing a site photograph (evidence photo). In particular, in the case of public works ordered from the country (or local public bodies), it is required to submit a construction report. In the construction report, in order to report the details of the construction work, This is because the photograph is used (attached). Also, in the case of private-ordered construction, a construction report is usually created in the same way as in public construction, so that on-site photography is being carried out at most construction sites.

  Specifically, an operator (construction person) brings a digital camera to a construction site when taking a photo of the site, but first, it is necessary to prepare a blackboard to be photographed together with the shooting site. On the blackboard, for example, “construction name”, “construction place”, “constructor”, etc. are entered with chalk or a pen so that the contents of the photographing site (photographing target) to be photographed can be understood. In addition, sometimes survey data such as “measurement points” and “actual measurement dimensions” is also entered. When the blackboard is ready, one of the workers prepares for the shooting with the blackboard in his / her back against the shooting site (photographing target). Another worker uses a digital camera to shoot the shooting site including the blackboard.

  Site photographs taken at the construction site in this manner are stored in a digital camera and taken back to the office or office for editing work reports. For example, after taking a site photo into a PC, an operator checks information on the site photo while looking at a blackboard that appears in the site photo, and organizes the site photo. Also, sometimes, the construction report is created by attaching the photos of the site while inputting the information on the blackboard in the construction report.

  As a technique related to this, Patent Document 1 describes a construction album creation support system that makes it possible to easily create a construction album (construction report) for reporting construction results such as civil works to an orderer. . Specifically, in this construction album creation support system, a photograph image of a construction site photographed by an electronic still camera is taken into the main body of a microcomputer to create an image file, and a bean diagram data is stored, and at least a field photograph area Select the layout of the construction album editing screen that has a text area and a bean diagram area to display the construction album editing screen, and select a photo image of the image file in the site photo area for each station on the construction site. Paste and select the bean map corresponding to the type of work in the bean map area and paste the data into the text area and edit the construction album.

  Here, in most cases, the construction is carried out through multiple construction processes such as foundation work, main body work, etc., but after the main work, the foundation work part will be invisible, so even at the foundation work stage the site photo Need to shoot. Also, in each process in the foundation work and main body work, it is necessary to take on-site photographs according to the stage. For example, in the case of a relatively large building, the number of on-site photographs taken may reach several thousand. is there.

For this reason, the conventional field-photographing operation is an indispensable operation, but requires a great amount of labor. Specifically, for example, there are the following inefficiencies and problems.
・ One person takes a blackboard and the other person shoots, so two people need to work together.
-Even if one person performs work by placing a blackboard, the place where the blackboard can be placed is limited, and in this case, the position of the blackboard is limited to the lower side of the photo in terms of the photo configuration.
・ Depending on the construction site, standing with a blackboard itself can be dangerous.
・ It takes time and effort to manually write on the blackboard with a chalk or pen.
-If the handwritten characters are messy or habitual characters due to handwriting, it is difficult to recognize the characters on the blackboard.
・ Also affected by weather conditions, it becomes difficult to recognize characters on the blackboard due to rain.
・ Because of taking on-site photographs, even if a digital camera is necessary, the blackboard is carried around and struggles with its portability such as the storage location.
・ The on-site photo is saved in the digital camera and edited later, but the information on the blackboard is an image, so it is difficult to use the information. For example, an operator needs to input / transfer information on a site photograph into a construction report or other system while looking at a blackboard in the site photo. Also, mistakes are likely to occur during posting.

  In the present invention, in view of the above points, an application program for improving the visibility and editability of a photographed on-site photo while improving the efficiency of the on-site photo on the construction site. And providing a smart device.

  In order to achieve the above object, an application program according to the present invention stores a smart device, photographing means for photographing a photographic image of a construction site, and a virtual display board image provided with a predetermined entry in advance. 1 storage means, input means for inputting data relating to the construction site for a predetermined entry of the virtual display panel image, and a virtual image in which data is input by the input means on a photographic image taken by the photographing means The image editing means that superimposes and arranges the display board image, and the second storage means that stores the photographic image with the virtual display board on which the virtual display board image is arranged by the image editing means.

  In addition, what applied the arbitrary combination of the component of this invention, expression, or a component to a method, an apparatus, a system, a computer program, a recording medium, etc. is also effective as an aspect of this invention.

  According to the present invention, an application program and a smart device are provided which improve the efficiency of the work and improve the visibility and editability of the photographed on-site photograph when performing the on-site photograph on the construction site. be able to.

The whole block diagram concerning this embodiment is shown. It is a hardware block diagram which shows the main structures of the smart device 1 which concerns on this embodiment. An example of the functional block diagram of the smart device 1 which concerns on this embodiment is shown. An example of the TOP screen A according to the present embodiment is shown. An operation screen transition example according to the present embodiment is shown. An example of screen B1 concerning this embodiment is shown. An example of screen B2-1 according to the present embodiment is shown. The example of screen B3 concerning this embodiment is shown. An example of screen B2-2 according to the present embodiment is shown. A modification of screen B3 according to the present embodiment is shown. An example of screen B4 concerning this embodiment is shown. The arrangement | positioning position and size change operation example of the virtual blackboard which concern on this embodiment are shown. The screen D1 example (the 1) which concerns on this embodiment is shown. An example of screen E1 concerning this embodiment is shown. The example of the selection list of the initial value of each setting parameter concerning this embodiment is shown. It is a figure explaining the preservation | save method of the favorite virtual blackboard and the photograph with a virtual blackboard which concerns on this embodiment. 6 shows an example of favorite storage management information according to the present embodiment. The favorite virtual blackboard image example which concerns on this embodiment is shown. The management information example for photo preservation | save with a virtual blackboard which concerns on this embodiment is shown. The screen D1 example (the 2) which concerns on this embodiment is shown. The example (the 3) of screen D1 which concerns on this embodiment is shown. The example (the 4) of screen D1 which concerns on this embodiment is shown. The output JPEG image which concerns on this embodiment is shown. The example of EXIF data which concerns on a prior art example is shown. An example of EXIF data of an output JPEG image according to the present embodiment is shown. 4 shows a flowchart of outputting a JPEG image according to the present embodiment. An explanatory view of JPEG image output concerning this embodiment is shown. The example of a display accompanying the photograph image search which concerns on this embodiment is shown.

  DESCRIPTION OF EMBODIMENTS Embodiments for carrying out the present invention will be described with reference to the drawings. In recent years, portable information terminals such as mobile phones and PDAs have become widespread, and by operating the portable information terminals, e-mail, the Internet, etc. can be easily performed. In addition, recently, a so-called smart device, which is an evolution of such a conventional portable information terminal, has become widespread, and its share is expanding at a tremendous speed. This smart device is represented by a smart phone, a tablet terminal, etc., for example.

  A typical feature of smart devices is that, in addition to improving the processing performance, terminal operations can be performed only by touch operations on the screen. In conventional portable information terminals, terminal operation is performed by hardware key operations provided, but some smart devices do not have hardware keys at all, touch operations from the screen, software All terminal operations can be performed with just a key operation. The present invention pays attention to such operability characteristics of the smart device and performs on-site photo shooting using the smart device at the construction site. This will be described in detail below.

[System configuration]
(overall structure)
FIG. 1 is an overall configuration diagram according to this embodiment. The smart device 1 according to the present embodiment is an apparatus used for taking a site photograph at a construction site. Specifically, it can be realized by a smartphone, a tablet terminal, or the like. At the construction site, the worker uses the camera attached to the smart device 1 to shoot the shooting site (shooting target) that is the subject. As described above, it is necessary that a blackboard on which various kinds of information are entered is reflected in the photographed on-site photograph, but in the present embodiment, the blackboard as described above (the actual blackboard) is not used, and the smart device 1 The application inserts a virtual electronic blackboard (hereinafter referred to as a virtual blackboard) into the photo of the shooting site taken by the camera of the camera, thereby constructing the site photo (details will be described later).

  Note that a blackboard generally refers to a board coated with black or green paint for writing information such as letters and drawings. In this embodiment, a blackboard is not only a black or green board, but also a white board (white board). Board)). In short, a display board for displaying information such as characters and figures may be used.

  The surveying instrument / measuring instrument 2 and the construction document 3 provide the smart device 1 with information on the spot of the construction site. When entering survey data measured on the spot such as “Spot” and “Measured dimensions” on the virtual blackboard, the operator surveys and measures the survey data with the survey instrument / measurement instrument 2, and the survey instrument / measurement instrument The survey data is transmitted from 2 to the smart device 1 through data communication such as BlueTooth (registered trademark). In addition, when entering general construction information such as “construction name”, “construction location”, “constructor”, etc. on the virtual blackboard, the operator shoots the construction material 3 with the camera of the smart device 1 and works from the same image. Information is input as text, or construction information is input via various types of code information such as a barcode or QR code (registered trademark). These construction information is reflected in the virtual blackboard.

  The server 4 is a management server that is installed in an office, office, data center, or the like and is used for construction information management. For example, construction information is input to the smart device 1 via data communication such as a wireless LAN (WiFi, etc.), a telephone network / IP network line (3G, etc.), and vice versa. Upload site photos taken via data communication. In addition, when the surrounding communication situation is not good, for example, the construction site is located in the back of the mountain, the smart device 1 cannot communicate with the server 4. In this case, prior to entering the construction site, the construction information is obtained in advance. You can enter or upload site photos saved in the smart device 1 at a later date.

  The PC 5 is a terminal that creates a construction report. In creating the construction report, the worker obtains construction information and already uploaded site photos from the server 4. Alternatively, a field photograph is obtained from a digital camera via a USB or a recording medium.

  The MFP / LP 6 is a multifunction machine or a laser printer, and prints and outputs a photograph of the photographed site itself or a construction report created by the PC 5. It is also possible to transfer and store on-site photos from the smart device 1 to the MFP / LP 6 via data communication, USB, a recording medium, or the like.

  The cloud storage 7 is a storage device that is installed on a network such as the Internet and stores (accumulates) on-site photographs. For example, the smart device 1 uploads an on-site photograph taken via data communication such as a wireless LAN (such as WiFi) or a telephone / IP network line (such as 3G) to the cloud storage 7. Since the storage area for storing the on-site photos taken by the smart device 1 has a limited capacity, the cloud storage 7 can be used as an alternative storage area.

  The field photos stored in the cloud storage 7 can be used in various forms thereafter. For example, when the PC 5 creates a construction report, construction information and already uploaded site photos are acquired from the cloud storage 7. In addition, if linked with a print service such as cloud printing, it is possible to arbitrarily select and print on-site photos stored in the cloud storage 7. In the past, once the site photos were organized and printed by the PC 5, there is an advantage that printing can be performed directly from the smart device 1.

(hardware)
Here, the hardware configuration of the smart device 1 according to the present embodiment will be described. FIG. 2 is a hardware configuration diagram illustrating a main configuration of the smart device 1 according to the present embodiment. The smart device 1 includes a CPU 11, a storage device 12, a display device 13, an input device 14, a communication device 15, an external interface device 16, a photographing device 17, and a GPS 18 as main components.

  The CPU 11 is composed of a microprocessor and its peripheral circuits, and is a circuit that controls the entire apparatus. Processing based on an OS (Operating System) for smart devices, various application programs, and the like is executed.

  The storage device 12 is a memory that stores an OS for smart devices, various applications, and other various data. The storage device 12 includes a RAM used as a work area (work area) when the CPU 11 executes various programs and performs various controls, a non-volatile ROM storing predetermined control programs, and a relatively large amount of data. HDD etc. which memorize | stored. In this embodiment, it is assumed that a smart device application program (for example, “construction site blackboard application”) is installed in advance.

  The display device 13 is a display that displays various data on a display screen. The input device 14 is a device for a user to perform various input operations. The input device 14 of the smart device 1 according to the present embodiment includes a touch panel switch provided so as to be superimposed on the display screen of the display device 13 in addition to the hardware key. In this case, the software key is realized by the touch panel switch control by the OS input system program. That is, all terminal operations can be performed only by touch operations and software key operations from the screen.

  The communication device 15 is a device that communicates with other devices. Supports communication according to various network forms including wired and wireless networks. Specifically, the smart device according to the present embodiment supports, for example, a wireless LAN (WiFi, etc.), a telephone / IP network line (3G, etc.), Bluetooth (registered trademark), infrared communication, and the like.

  The external interface device 16 is an interface for connecting an external recording medium and inputting / outputting data in the recording medium in the terminal. For example, information from the outside can be acquired or output by setting a memory card such as a USB memory or an SD card.

  The photographing device 17 is a digital camera provided in the smart device 1. An imaging lens is provided, and the captured image (photo image) captured is taken into the smart device 1 as image data (photo data). When various types of code information such as a barcode or QR code (registered trademark) of the construction material 3 are imaged from the imaging device 17, it is possible to read text data in the code via a predetermined application.

  The GPS 18 is a GPS receiver that receives current position information on the earth from a Global Positioning System. That is, the GPS 18 acquires current position information (position coordinates) from a GPS satellite.

(function)
Next, the main functional configuration of the smart device 1 according to the present embodiment will be described. FIG. 3 shows an example of a functional block diagram of the smart device 1 according to the present embodiment. As shown in the figure, the smart device 1 includes a storage unit 101, a touch panel 102, a photographing unit 103, a communication unit 104, an input unit 105, an image editing unit 106, an image reproduction unit 107, and an image output unit 108. .

  The storage unit 101 is realized by the storage device 12, for example, and stores in advance a virtual blackboard image provided with predetermined entry items (unfilled). Further, when a photo image with a virtual blackboard (for example, a site photo with a virtual blackboard) in which a virtual blackboard image is arranged on a photo image (for example, a site photo) is created, it is stored. At this time, as a storage method, the storage unit 101 captures a photographed photo image, a virtual blackboard image stored in advance as a template, position information of the virtual blackboard image on the photo image, and a virtual blackboard image on the photo image. The size information and the data input to the predetermined entry items of the virtual blackboard image are stored in association with each other, details of which will be described later.

  The touch panel 102 is a touch panel display including an operation unit 102 a realized by the input device 14 and a display unit 102 b realized by the display device 13, for example. As described above, since the smart device 1 according to the present embodiment includes the touch panel display, it is possible to perform all terminal operations only by touch operations and software key operations from the screen.

  The photographing unit 103 is a digital camera that is realized by, for example, the photographing device 17 and is provided in the smart device 1. The captured image (photo image) taken is taken into the smart device 1 as image data (photo data). In addition, when various code information such as a barcode or QR code (registered trademark) of the construction material 3 is imaged from the imaging unit 103, it is also possible to read text data in the code via a predetermined application.

  The communication unit 104 is realized by, for example, the communication device 15 and performs communication with other devices. The smart device according to the present embodiment specifically supports a wireless LAN (WiFi, etc.), a telephone / IP network line (3G, etc.), Bluetooth (registered trademark), infrared communication, etc. , Communication with various devices such as the server 4, the PC 5, and the MFP / LP6.

  The input unit 105 inputs data related to the construction site to a predetermined entry item (unfilled) of the virtual blackboard image stored in the storage unit 101. As a result, predetermined data relating to the construction is input to the virtual blackboard image that has not been entered. In addition, although the data input here follow the entry provided in the virtual blackboard image, specifically, for example, survey data (“spot”, “measured dimension”) surveyed by the surveying instrument / measurement instrument 2 Etc.) and general construction information ("construction name", "construction location", "constructor", etc.) managed by the server 4 or various code information, etc.). In addition, as a data input method, it can be input by a software key input from the touch panel 102 by the user or can be input via the communication unit 104.

  The image editing unit 106 superimposes and arranges the virtual blackboard image in which data is input by the input unit 105 on the photographic image captured by the imaging unit 103. Thereby, a photographic image with a virtual blackboard (for example, a field photo with a virtual blackboard) is completed. The completed photo image with virtual blackboard is stored in the storage unit 101 as described above.

  The image reproduction unit 107 reproduces the photographic image with a virtual blackboard stored in the storage unit 101 and displays it on the display device. When reproducing the photographic image with the virtual blackboard, the image reproduction unit 107 acquires a virtual blackboard image associated with the photographic image from the storage unit 101, and data corresponding to a predetermined entry item of the virtual blackboard image. Is reproduced by superimposing the virtual blackboard image of the size specified by the corresponding size information on the photographic image based on the corresponding position information. This will be described in detail later. .

  The image output unit 108 outputs the photograph image with a virtual blackboard as a JPEG image in the JPEG format with the reproduced photo image with the virtual blackboard stored in the storage unit 101 as a control. More specifically, a virtual blackboard with data input is superimposed on a photographic image to generate and output a JPEG file of a photographic image with a virtual blackboard in which the virtual blackboard and the photographic image are integrally synthesized.

  These functions are actually realized in the computer by the smart device OS and the smart device application program (for example, “construction site blackboard application”) executed by the CPU 11 of the smart device 1.

[Operation screen transition example of smart device 1]
FIG. 4 shows an example of the TOP screen A according to this embodiment. The TOP screen A is a screen that is first displayed on the display screen when the user first activates the smart device application program (for example, “construction site blackboard application”). The TOP screen A is provided with operation buttons such as “favorite”, “blackboard selection”, “photographing”, “photo storage”, and “various settings” as shown in the figure.

FIG. 5 shows an operation screen transition example according to the present embodiment. When the user first activates the smart device application program and operates each operation button on the TOP screen A, the screen changes as follows.
“Favorites”: To screen C1-2 “Select blackboard”: To screen C1-1 “Photographing”: To screen B1 “Photo storage”: To screen D1 “Various settings”: To screen E1 This is a creation operation. In the B operation, a photographic image with a virtual blackboard is finally created through the steps of taking on-site photos, selecting a virtual blackboard, inputting management items, and arranging the virtual blackboard.

  The C operation is an operation for creating an on-site photograph in the same manner as the B operation, although the operation order is different from the B operation. In the C operation, a virtual blackboard-attached photo image is finally created through the steps of selecting a virtual blackboard, inputting management items, shooting a field photo, and arranging the virtual blackboard.

  The D operation is an operation for referring to a photograph with a virtual blackboard. Since the photo with virtual blackboard created by the B operation or the C operation is stored, the server 4, the PC 5, the MFP / It is possible to output to LP6 or a recording medium.

  The E operation is an operation for performing various settings. In the E operation, for example, the initial color, initial position, initial size, etc. of the virtual blackboard can be set.

  Hereinafter, each operation will be described in detail with reference to FIG.

(B operation example)
First, since the B operation will be described here, it is assumed that the operation button “shoot” is operated (for example, touched) on the TOP screen A, and at this time, the screen transits to the screen B1.

  FIG. 6 shows an example of a screen B1 according to the present embodiment. As shown in the figure, on the screen B1, the camera application built in the smart device 1 starts up and shifts to the shooting mode. On the screen of the smart device 1, a construction site (in the figure, an example of a cylindrical bench in a building site) that is captured through the photographing unit 103 is depicted, and the photograph is taken by the user performing a photographing operation.

  FIG. 7 shows an example of a screen B2-1 according to the present embodiment. When a picture is taken on screen B1, the screen transitions to screen B2-1. On the screen B2-1, as shown in the figure, a plurality of patterns of virtual blackboard templates (models) are pre-installed and provided, and the user touches and selects a virtual blackboard to be used.

  FIG. 8 shows an example of a screen B3 according to the present embodiment. (A) is the virtual blackboard selected by the user. Further, as shown in the figure, the virtual blackboard is provided with predetermined entry items (unfilled), and management information relating to the photographed images is input by the input unit 105 respectively. Note that the position information (position coordinates) of the current location automatically acquired from the GPS 18 has already been input to “position” among the entries on the virtual blackboard. It is also possible to automatically input a specific address here based on the position information.

  Then, as shown in (b), when the “construction name” blank is touched in order to input “construction name” among the unfilled items in the virtual blackboard, the software key will start up. Enter a specific construction name using the software key. Here, for example, “XX building renovation” is entered. In the same manner, the user inputs a specific work type using the software key. Here, for example, “architecture set (architecture)” is input.

  In the virtual blackboard, in the free space below “Position”, for example, it is possible to attach a construction drawing referred to as a bean figure, etc., or to input other construction information related to construction. is there.

  When the above input is completed, as shown in (c), the virtual blackboard is in a state where all entry items have been input. When all the inputs are completed, the user touches the operation button “apply blackboard” on the screen (c).

  If the operation button “blackboard registration” is touched in the screen (c), the virtual blackboard in which all the entry items have been entered is separately saved as a favorite virtual blackboard (screens B2-2, C1). -2).

  FIG. 9 shows an example of a screen B2-2 according to the present embodiment. Here, a virtual blackboard registered as “blackboard registration” is displayed as a favorite virtual blackboard. Since a virtual blackboard that has not been filled in is filled with items that have been entered once, the virtual blackboard can be reused to improve the efficiency of input work. For example, when a plurality of site photographs are taken within the same construction site, the input of the same information can be omitted by reusing this virtual blackboard.

  Reference is again made to FIG. For example, instead of the screen B2-1, the virtual blackboard 1 is selected from favorites through the screen B2-2. In this case, in the next screen B3, the favorite virtual blackboard in which all the entry items have been entered is called and displayed (see, for example, FIG. 8C), and the user needs to input anything here. In the screen (c), the operation button “apply blackboard” may be touched.

  FIG. 10 shows a modification of the screen B3 according to the present embodiment. (A) is the virtual blackboard selected by the user. As in FIG. 8A, the position information (position coordinates) of the current location automatically acquired from the GPS 18 is already input to “position” among the entries on the virtual blackboard. In this modification, the “construction name” is already entered. In the smart device 1 according to the present embodiment, as described above, the survey data (“measurement point”, “measured dimension”, etc.) surveyed by the surveying instrument / measurement instrument 2 via the communication unit 104, the server 4 or various codes. It is possible to input general construction information ("construction name", "construction location", "constructor", etc.) managed by information etc.). Accordingly, among the entries on the virtual blackboard, the “construction name” is automatically input by the input unit 105 based on construction information input from the outside.

  Subsequently, as shown in (b), when the user touches an empty column of “work type” in order to input “work type” among the unfilled items in the virtual blackboard, a selection list is displayed. In the case of “type of work”, a standard input value is input, and therefore a plurality of pieces of information on possible input values are held in advance in the selection list. Therefore, the user can easily input an input value by selecting one “work type” from the selection list. If the “construction type” of 1 is determined and entered from the construction information, the construction information entered from the outside is also entered in the “construction type” as in the above “construction name” without going through the selection list. The input value is automatically input based on the above.

  As described above, when the input is completed in the present modification, as shown in (c), the virtual blackboard is in a state where all the entry items have been input. When all the inputs are completed, the user touches the operation button “apply blackboard” on the screen (c).

  FIG. 11 shows an example of a screen B4 according to this embodiment. On the screen B4, the image editing unit 106 arranges a virtual blackboard on which the entry items have been input, superimposed on the photographed photo. Here, it can be seen that the virtual blackboard in which the entry items are input in FIG. 8C or FIG. 10C is arranged on the photograph taken in B1 of FIG. This photographic image is a photographic image (site photo) with a virtual blackboard.

  Here, the user can change the arrangement position and size of the virtual blackboard by an operation from the touch panel. The initial position of the virtual blackboard and the initial value of the size follow the initial settings. However, depending on the photograph taken, if the initial value remains the same, the image of the construction site may not be visible due to the presence of the virtual blackboard. Therefore, after confirming the screen B4, the user changes the placement position and size of the virtual blackboard if the initial placement position and initial size of the virtual blackboard are inconvenient.

  FIG. 12 shows an example of an arrangement position and size changing operation of the virtual blackboard according to the present embodiment. (A) shows change operation of the arrangement position of a virtual blackboard. As shown in the figure, the user can easily change the position of the virtual blackboard by operating the touch panel 102 to trace the virtual blackboard with a finger. Further, (b) shows an operation for changing the size of the virtual blackboard. As shown in the figure, the user can easily change the size of the virtual blackboard by operating the touch panel 102 to reduce (or enlarge) the virtual blackboard with a finger. Needless to say, the placement position and size of the virtual blackboard can be changed simultaneously.

  As described above, when the user finishes confirming the photo image with the virtual blackboard, the user saves the photo image by touching the “Save” operation button in the screen of FIG. In addition, the photograph with a virtual blackboard saved here is preserve | saved at the "photo storage" (screen D1) mentioned later on an application.

(C operation example)
The C operation is an operation for creating an on-site photograph in the same manner as the B operation, although the operation order is different from the B operation. In the C operation, a virtual blackboard-attached photo image is finally created through the steps of selecting a virtual blackboard, inputting management items, shooting a field photo, and arranging the virtual blackboard. This will be briefly described below.

  Refer to FIG. 4 again. In the case of the C operation, on the TOP screen A, the operation button “select blackboard” or “favorite” is operated (for example, touched).

  When “Select Blackboard” is operated, the screen changes to the screen C1-1. The screen C1-1 is provided with a plurality of patterns of virtual blackboard templates (models) pre-installed in advance, as in FIG. 7 (see FIG. 7). The user touches and selects the virtual blackboard to be used.

  In the screen C2, as shown in FIGS. 8 and 10, the selected virtual blackboard is provided with predetermined entry items (unfilled), and the user uses the software key for the unfilled items in the virtual blackboard. Then, a specific input value is input (see FIG. 8). Alternatively, as described above, in the smart device 1 according to the present embodiment, as described above, the surveying data measured by the surveying instrument / measurement instrument 2, the server 4 or various code information, etc. are managed via the communication unit 104. In this case, the input values are automatically entered in the entries on the virtual blackboard based on the construction information input from the outside. (See FIG. 10).

  On the other hand, when the operation button “favorite” is operated on the TOP screen A, the screen transitions to the screen C1-2. As in FIG. 9, a virtual blackboard registered as “blackboard registration” is displayed as a favorite virtual blackboard (see FIG. 9). If a virtual blackboard with entries already entered is stored (registered), one virtual blackboard can be selected from favorites. In this case, on the next screen C2, the virtual blackboard on which all the entry items have already been entered is called and displayed, and as described above, the user does not need any input work here.

  Next, the screen transitions to a screen C3. On the screen C3, as in FIG. 6, the camera application built in the smart device 1 starts up and shifts to the shooting mode. Since the construction site (in the figure, an example of a cylindrical bench in the building site) captured through the photographing unit 103 is projected on the screen of the smart device 1, the photograph is taken by the user performing a photographing operation (FIG. 6). reference).

  Next, the screen transitions to a screen C4. On the screen C4, a virtual blackboard on which entry items have been input is arranged so as to be superimposed on the photograph taken (see FIG. 11). Further, as described above, the user can change the arrangement position and size of the virtual blackboard by an operation from the touch panel.

  As described above, after confirming the photograph image with the virtual blackboard, the user touches the operation button “Save” on the screen to save the photograph image. In addition, the photograph with a virtual blackboard saved here is preserve | saved on a "photo storage" (screen D1) on an application.

(D operation example)
The D operation is an operation for referring to a photograph with a virtual blackboard. Since the photo image with a virtual blackboard created by the B operation or the C operation is stored, the user refers to the photo with the virtual blackboard already created from here or selects an arbitrary photo, and then the server 4 and the PC 5 , MFP / LP6, or a recording medium.

  FIG. 13 shows an example (part 1) of the screen D1 according to the present embodiment. When the operation button “photo storage” is operated on the TOP screen A, the screen changes to this screen. As shown in the figure, in the “photo storage” on the screen D1, the photos with virtual blackboards created so far by the B operation or the C operation are displayed in a list. Each photo is displayed in a reduced size in a thumbnail format. For example, when the user touches a desired photo, the photo is enlarged and displayed on the screen. When the operation button “slide show” is touched, the photos in the “photo storage” are sequentially displayed in a sliding manner.

  In the “photo storage”, one or a plurality of arbitrary photos can be selected and output to the server 4, the PC 5, the MFP / LP 6, or a recording medium. The user finally captures the photo image with virtual blackboard (site photo image) in the “photo storage” into the PC 5 and creates a construction report using the photo image with virtual blackboard.

(Example of E operation)
The E operation is an operation for performing various settings. In the E operation, initial values of the setting parameters regarding the virtual blackboard can be set.

  FIG. 14 shows an example of a screen E1 according to the present embodiment. On the screen E1, as shown in the figure, for example, initial values of “blackboard color”, “blackboard position”, “blackboard size”, and “blackboard shape” can be set. When the user changes the setting of the initial value, the corresponding selection list is displayed when the corresponding setting value column is touched.

  FIG. 15 shows an example of a selection list of initial values of the setting parameters according to the present embodiment. (A) "Blackboard color" selection list, (b) "Blackboard position" selection list, (c) "Blackboard shape" selection list, (d) "Blackboard size" selection It is a selection list example of a list. The user selects and sets a desired (arbitrary) initial value from the selection list.

  Refer to FIG. 11 again. On the screen B4, a virtual blackboard on which the entry items have been entered is superimposed on the photographed photo, and the color, position, size, and shape of the virtual blackboard arranged as a default (standard) here are as follows: The initial value set in the screen E1 is followed. In this way, the user sets the desired initial value in advance on the screen E1 for each setting parameter related to the virtual blackboard, so that the virtual blackboard that is most convenient to use is created in the initial state when creating the on-site photo with the virtual blackboard. Can be arranged as

  Of course, the initial value set on the screen E1 is merely for setting the state of the virtual blackboard arranged as the initial state. As described above, the user can change the placement position and size of the virtual blackboard by operating from the touch panel. Can be changed. In other words, the initial position of the virtual blackboard and the initial value of the size follow the initial settings, but if the initial position and size of the virtual blackboard are inconvenient, the virtual blackboard can be arbitrarily changed in position and size.

[How to save your favorite virtual blackboard and photos with virtual blackboard]
FIG. 16 is a diagram for explaining a method of saving a favorite virtual blackboard and a photograph with a virtual blackboard according to the present embodiment. As already described, the virtual blackboard used in the present embodiment is preinstalled and provided as a template (model) of a virtual blackboard having a plurality of patterns. Therefore, the storage unit 101 has predetermined entries ( A virtual blackboard image provided with (unfilled) is stored in advance. When a photographic image is taken by the photographing unit 103, the photographed photographic image is stored in the storage unit 101 as image data.

(My favorite virtual blackboard)
First, a method for saving a favorite virtual blackboard will be described. As described above, in the smart device 1 according to the present embodiment, a virtual blackboard in which entry items have been input can be separately stored as a favorite virtual blackboard. Accordingly, by calling and reusing a virtual blackboard saved from favorites on the application, it is possible to omit the input of the same information from the next time on (see FIG. 9).

  FIG. 17 shows an example of favorite storage management information according to this embodiment. The favorite storage management information is information for storing a virtual blackboard in which entry items have been input and reconstructing (reproducing) the image as an image. As described above, when a virtual blackboard into which entry items have been input is separately stored as a favorite virtual blackboard, “favorite storage management information” for storing and managing the favorite virtual blackboard is generated. In the case of FIG. 17, three virtual blackboards indicate favorite storage management information registered as favorites.

  For example, “favorite No.”: Template 01-1 holds input data for “Template 01.jpg” which is a virtual blackboard image of a predetermined entry item (unfilled) stored in the storage unit 101. In other words, “Favorite No.”: Template01-1 has “construction subject”: station square renovation work, “construction place”: XX station square, “constructor”: Tanaka Construction with respect to the virtual blackboard image template “Template01.jpg”. It is a virtual blackboard image that is reproduced by using (stock) as an input value in an entry.

  FIG. 18 shows a favorite virtual blackboard image example according to the present embodiment. The favorite virtual blackboard image (list) shown in the figure corresponds to the storage management information of FIG. 17 in which three virtual blackboards are registered as favorites. For example, in the case of the above-mentioned “favorite No”: Template01-1, the virtual blackboard image template “Template01.jpg” is acquired from the storage unit 101, and the “construction subject”: station square in the virtual blackboard image Renovation work, “construction place”: XX station square, “constructor”: Tanaka Construction Co., Ltd. is input and the virtual blackboard image reproduced.

  As described above, in the smart device 1 according to the present embodiment, when the virtual blackboard in which the entry item has been input is separately stored as a favorite virtual blackboard, the virtual blackboard “image” in which the entry item has already been input is not stored, Save the information in text format called management information for saving favorites. That is, while the virtual blackboard image template and the input data are stored separately, they are stored in association with each other. As described above, it can be said that the smart device 1 is not necessarily large by reproducing the favorite virtual blackboard image using the virtual blackboard image template and the favorite storage management information stored in advance in the storage unit 101. It is possible to improve the editability of the favorite virtual blackboard while saving the storage capacity.

(Photo image with virtual blackboard)
Next, a method for saving a photo with a virtual blackboard will be described. As described above, on the application, the photo with the virtual blackboard is stored in the “photo storage”. When the operation button “photo storage” is operated on the D operation, that is, the TOP screen A, the display transits to “photo storage” (see FIG. 14), and the user refers to the already created photo image with the virtual blackboard. Is possible.

  On the other hand, in the smart device 1, an actual photo with a virtual blackboard is stored in the storage unit 101. As a storage method, a photographed photo image, a virtual blackboard image stored in advance as a template, and a photo are stored. The position information of the virtual blackboard image on the image, the size information of the virtual blackboard image on the photographic image, and the data input to the predetermined entry items of the virtual blackboard image are stored in association with each other.

  As described above, when a photograph image is photographed by the photographing unit 103, the photographed photograph image is stored in the storage unit 101 as image data. Then, when the virtual blackboard image is arranged on the photographed photograph image and stored in the “photo storage” (see FIG. 14), “Photo Blackboard with Photo Blackboard Management” is stored and managed. Information "is generated.

  FIG. 19 shows an example of management information for storing photos with a virtual blackboard according to the present embodiment. The “virtual blackboard attached photo storage management information” is information for storing a virtual blackboard attached photo and reconstructing (reproducing) it as an image. As shown in (0), “Photo Image No”, which is a unique identifier for storage management of photo images, “Photo Image” (file name) for specifying a basic photo image, and a blackboard to be used A “blackboard image” (file name) for specifying an image template and an “initialization parameter for blackboard image”, which is each initial value related to the blackboard image, are managed in association with each other. Also, as shown in (1), (2), (3), etc., “Photo Image No” and input data (input value) for each blackboard image are managed in association with each other.

  Here, for example, with reference to (0), the smart device 1 (image reproduction unit 107) reconstructs (reproduces) a photographic image with a virtual blackboard stored as “Photo Image No”: 001 in the first row. Take the example. First, “photographic image”: 001. Get jpg file data. The blackboard image template to be used is “blackboard image”: Template02. jpg, so that Template02. Get jpg file data.

  Next, “blackboard image” which is a blackboard image template to be used: Template02. Refer to (2) to obtain each input value input to a predetermined entry on jpg. Corresponding to “Photo Image No”: 001 is “Construction Name”: XX Building Renovation, “Work Type”: Complete Architecture (Architecture), “Position”: (36.140), Free Space: Since there is nothing, each of these input values is acquired.

  It is assumed that the “blackboard image” is Template01. If it is jpg, refer to (1) in order to obtain each input value input to a predetermined entry on Template01.jpg, and if the “blackboard image” is Template03.jpg. If it is jpg, “(3) may be referred to in order to obtain each input value input to the predetermined entry on Template03.jpg. Since the predetermined entry differs depending on the“ blackboard image ”, Management information is sorted for each blackboard image template.

  Referring again to (0), “Photo Image No.”: “001 Blackboard Image”: Template02. Each initial value for jpg is “blackboard color”: black, “blackboard position”: upper left, “blackboard shape”: horizontal, “blackboard size”: W250 × H200, so obtain these initial values. To do.

  And "blackboard image": Template02. The blackboard image is edited so that “blackboard color”: black, “blackboard shape”: horizontal, and “blackboard size”: W250 × H200 with respect to jpg. Next, “blackboard image”: Template02. For the given entry on jpg, enter the input value of “construction name”: XX building renovation, “work type”: complete building (architecture), “position”: (36.140), free space: none By doing so, a blackboard image in which entry items have been entered is created. “Photo image” which is the last photo image taken: 001. By arranging this blackboard image at “upper left position”: upper left so as to be superimposed on jpg, the photographic image with virtual blackboard is reconstructed and displayed (see FIG. 11).

  As described above, in the smart device 1 according to the present embodiment, when the created photo with virtual blackboard is saved, the photo taken in the storage unit 101 without saving as the photo with virtual blackboard “image” itself. Image, virtual blackboard image template, and "virtual blackboard-attached photo storage management information" (position information and size information of the virtual blackboard image on the photo image, and data entered in predetermined entries of the virtual blackboard image) Store them in association with each other. As described above, the virtual blackboard image template stored in advance in the storage unit 101, the photographed photo image, and the virtual blackboard-added photo storage management information are used to reproduce the virtual blackboard-added photo image. The storage capacity of the smart device 1 that is not necessarily large can be saved, and the editability of the photo image with the virtual blackboard can be improved.

(About editing photo images with virtual blackboard)
Here, with respect to the method of saving a photo image with a virtual blackboard, data is input to all predetermined entries on the virtual blackboard, and the photo with the virtual blackboard in which the virtual blackboard is arranged on the photo image at a predetermined position, size, etc. ", That is, when saving as a picture" image "with a virtual blackboard in which the virtual blackboard and the photographic image are integrated, there is a problem that post-editing is difficult.

  As an example of post-editing this photo “image” with a virtual blackboard, for example, if the placement position of the virtual blackboard on the photographed photo image is changed, and the virtual blackboard is integrated on the photo image After the composition, it is difficult to change the position or size of the virtual blackboard by the user operating the touch panel 102.

  For example, when a virtual blackboard is integrated on a photographic image and the position of the virtual blackboard is to be changed, there is no photographic image information at the position of the virtual blackboard before the position change. After the change of the position of the virtual blackboard, there arises a problem that the position of the virtual blackboard before the position change becomes a blank image on the photographic image. Even if the size of the virtual blackboard is changed (reduced), there is no difference in the photo image information between the virtual blackboard before the size change and after the size change. In the vicinity, there will still be a problem that it becomes a blank image.

  On the other hand, in the smart device 1 according to the present embodiment, as described above, when the created photo with virtual blackboard is saved, the photo with the virtual blackboard is not saved as an image “image” itself but is taken in the storage unit 101. A photo image, a virtual blackboard image template, “management information for storing a photo with a virtual blackboard” (position information and size information of the virtual blackboard image on the photo image, and data input to predetermined entries of the virtual blackboard image), Are stored in association with each other.

  For this reason, in the smart device 1 according to the present embodiment, the “blackboard position” information or the “blackboard size” information in the “blackboard image setting parameters” in the “virtual blackboard attached photo storage management information”. You only have to rewrite and change it. For example, referring to (0), in the photo with virtual blackboard stored as “Photo Image No”: 003 in the third row, “position of blackboard” (position coordinates (10.10) on photo image) and “ The size of the blackboard ”(W120 × H100) is changed from the initial value (for example, see FIGS. 15B and 15D).

  However, the storage method of storing the photographed photograph image, the virtual blackboard image template, and the “virtual blackboard-added photo storage management information” in association with each other is “construction site blackboard application”. This is possible only with the smart device 1 or the PC that it has. Therefore, when a photographic image with a virtual blackboard as a construction report is submitted to a construction orderer or the like, it is finally necessary to generate a JPEG image in which the virtual blackboard is integrated with the photographic image.

  Therefore, the “construction site blackboard application” of the smart device 1 according to the present embodiment can finally output a JPEG image in which such a virtual blackboard is integrally synthesized on a photographic image. (Details will be described later). If no editing is required after the virtual blackboard is placed on the photographed image, the virtual blackboard is immediately photographed at the timing of “Save” (B4 in FIG. 5 and FIG. 11). It is also possible to generate and output a JPEG image integrated on the image.

  In addition, as described above, the photograph with a virtual blackboard stored in the smart device 1 is the server 4, the PC 5, the MFP / LP 6, or the recording medium after selecting one or a plurality of arbitrary photos in the “photo storage”. However, in this case, if the external receiving side supports the same storage management format stored in the smart device 1, it may be output as it is. On the other hand, when the external receiving side is not compatible with the same storage management format stored in the smart device 1, it can be output after being processed into a photo “image” with a virtual blackboard.

[How to output photos with virtual blackboard]
Next, a method for outputting a photo with a virtual blackboard will be described. In the “construction site blackboard application” of the smart device 1 according to the present embodiment, in consideration of editability, as described above, a photographic image taken in the storage unit 101, a virtual blackboard image stored in advance as a template, “Photograph management information with virtual blackboard” (position information and size information of the virtual blackboard image on the photo image and data input to the predetermined entry items of the virtual blackboard image) are associated with each other and stored.

  However, for example, when a photographic image with a virtual blackboard as a construction report is submitted to a construction orderer, the photographic image with a virtual blackboard in which the virtual blackboard is integrated on the photographic image is finally converted into a JPEG format. Etc. need to be generated. This is because a construction ordering PC or the like does not necessarily have a “construction site blackboard app”, and the submitted photo image with a virtual blackboard needs to be submitted in JPEG format or the like, which is a general-purpose standard. .

(D operation example)
When outputting a photograph with a virtual blackboard as a JPEG image, first, the user selects a target photo image with a virtual blackboard. Specifically, the D operation for referring to the photograph with the virtual blackboard is performed (FIG. 5). Since the created photo image with virtual blackboard is stored in the “photo storage”, the user selects an arbitrary photo from the photos with virtual blackboard already created from here, and is a general-purpose standard JPEG. Output in format etc.

  FIG. 20 shows an example (part 2) of the screen D1 according to the present embodiment. When the operation button “photo storage” is operated on the TOP screen A, the screen changes to this screen (same as FIG. 13). As shown in the figure, in the “photo storage” with the virtual blackboard on the screen D1, the photos with the virtual blackboard created so far by the B operation or the C operation are displayed in a list. Each photo is displayed in a reduced size in a thumbnail format. For example, when the user touches a desired photo, the photo is enlarged and displayed on the screen. Here, it is assumed that the rightmost figure in the figure is touched.

  FIG. 21 shows an example (part 3) of the screen D1 according to the present embodiment. On the screen D1, the selected photographic image with a virtual blackboard is displayed. Subsequently, when outputting a photographic image with a virtual blackboard as a JPEG image in JPEG format, the user touches the operation button “image output” on the screen to output the photographic image.

  The JPEG image output here is stored in an arbitrary memory of the smart device 1. Further, the storage destination can be output not only to the smart device 1 built-in memory and recording medium (for example, SD card), but also to the server 4, PC 5, MFP / LP 6, and the like.

  FIG. 22 shows an example (part 4) of the screen D1 according to the present embodiment. As shown in the figure, when the selected photo image with virtual blackboard is output as a JPEG image, a display to that effect is made.

  FIG. 23 shows an output JPEG image according to this embodiment. As shown in the figure, the JPEG image is obtained by combining the selected photographic image with the virtual blackboard on the photographic image and outputting it as a JPEG image. Next, Exif data of the output JPEG image according to the present embodiment will be described.

(Exif data)
First, general Exif data (also referred to as Exif metadata, Exif information) will be described. Generally, when a photograph is taken using a digital camera and the photographed photograph image is saved as a JPEG file, for example, metadata in Exif (Exchangeable Image File Format) format is automatically created. This metadata is called Exif data.

  Specifically, the digital camera embeds information such as the camera model and shooting conditions in the image as Exif data. This Exif data can be referred to together with a photographic image by an image viewer, Exif editing software, or the like. When a photographic image is printed by a printer or the like, the photographic image can be automatically optimized based on information at the time of shooting included in the Exif data and then printed out.

  FIG. 24 shows an example of EXIF data according to the conventional example. The EXIF data is data that is automatically created by a general digital camera (software included in a general digital camera) when a photographed photographic image is stored as a JPEG file. Specifically, it includes various information such as the camera model and shooting conditions as shown in the figure.

  On the other hand, FIG. 25 shows an example of EXIF data of the output JPEG image according to the present embodiment. The EXIF data shown in the figure is data that is automatically created by the smart device 1 according to the present embodiment (“construction site blackboard application” of the smart device 1) when a photographic image with a virtual blackboard is output as a JPEG image. It is. Specifically, in addition to information such as the camera model and shooting conditions as shown in the figure, the data and encrypted data input to the predetermined entry items of the virtual blackboard image are included.

  In the Exif data, in addition to information such as the camera model and shooting conditions, “manufacturer-specific information” can be added to the Exif data, so that the smart device 1 according to this embodiment (the “smart device 1 has” When a photo image with a virtual blackboard is output as a JPEG image by the construction site blackboard app ”), the data and encrypted data entered in the specified entry in the virtual blackboard in the“ maker-specific information ”of the Exif data Is added.

  Note that the encrypted data is data obtained by encrypting data input to a predetermined entry in the virtual blackboard or a part of the input data. In order to prevent / suppress the alteration of information, the data that is desired to be prevented / suppressed is particularly encrypted, and the encrypted data is included in the “manufacturer-specific information” of the Exif data. As a result, the data to be encrypted was decrypted using the same encryption algorithm, and it was verified whether it matched with the data in the “maker's unique information” of the Exif data. Data authenticity can be ensured.

(JPEG image output processing)
FIG. 26 shows a flowchart of JPEG image output according to this embodiment. A description will be given with reference to FIG.

  S1: The image output unit 108 determines whether there is an output request for a photographic image with a virtual blackboard. Specifically, as described above, when the operation button “image output” on the screen is touched with respect to the photographic image with the virtual blackboard being displayed, it can be determined that there is an output request (FIG. 21).

  S2: If the image output unit 108 determines that there is an output request, the image output unit 108 executes JPEG image generation processing on the photographic image with the virtual blackboard being displayed.

  Specifically, the image output unit 108 acquires a photo image, a virtual blackboard (template), a blackboard image setting parameter, and input data based on the virtual blackboard-added photo storage management information (FIG. 19). Input data to the virtual blackboard (template). Then, the virtual blackboard is superimposed on the photographic image according to the blackboard image setting parameters (size, position, etc. of the virtual blackboard).

  Note that the photographic image with a virtual blackboard itself has already been developed on the screen. For example, a JPEG image can also be generated by executing JPEG imaging processing on the display image itself on the screen.

  S4: The image output unit 108 encrypts data input to a predetermined entry in the virtual blackboard or a part of the input data using a predetermined encryption algorithm.

  The data to be encrypted may be all of the data entered in a predetermined entry in the virtual blackboard or a part of the data. However, since the data volume of the encrypted data can be reduced by setting the data to be prevented / suppressed in particular as a priority object, the data volume of the Exif data can be reduced as a result.

  Here, as the data to be encrypted, the data of “construction name” and “shooting date” among the input data are particularly targeted for encryption. In this case, the image output unit 108 encrypts a character string obtained by adding the character strings of “construction name” and “shooting date” using a predetermined encryption algorithm. Note that using a predetermined encryption algorithm can be realized by a predetermined encryption key or the like.

  S4: The image output unit 108 adds the data and the encrypted data input to the predetermined entry in the virtual blackboard in the “maker unique information” to the Exif data (FIG. 24) of the original photographic image. .

  S5: The image output unit 108 outputs the generated JPEG image (FIG. 25). Of course, this JPEG image includes Exif data.

  As described above, the photographic image with a virtual blackboard (JPEG image) according to the present embodiment is input not only to information such as the camera model and shooting conditions but also to predetermined entries in the virtual blackboard image in the Exif data. Data included. For this reason, when handling a photo image with a virtual blackboard (JPEG image) thereafter, using Exif data, the information related to the construction (for example, “construction name”, etc.) is searched, and the data is converted into text. It is possible to use images as well as to classify and organize images based on data. For searching, organizing, and classifying such photographic images, a Web application for photographic images stored in the cloud storage 7 or the like in FIG. 1 can be used. For example, in a Web application, a photographic image is searched using Exif data, and as shown in FIG. 28, the searched photographic image, construction information, and map information (for example, provided from another Web application using position information). Map information) can be displayed side by side on the client.

  Exif data includes encrypted data. The information on the virtual blackboard at the construction site is important information that proves the contents of the site photo. Even if the data in the Exif data is changed or altered with commercially available Exif editing software, If the encrypted data is decrypted, the original data can be obtained and restored to the original correct data. As a result, it is possible to ensure the authenticity of the data to be encrypted, and to prevent / suppress data tampering.

[Summary]
As described above, according to the present embodiment, when performing on-site photo shooting work at a construction site, the efficiency of the work is improved, and a smart device or the like that improves the visibility and editability of the taken on-site photo is provided. It becomes possible.

  Although the present invention has been described based on each embodiment, the present invention is not limited to the requirements shown here, such as combinations with other elements listed in the above embodiments. With respect to these points, the present invention can be changed within a range that does not detract from the gist of the present invention, and can be appropriately determined according to the application form. Moreover, what applied the component, expression, or arbitrary combinations of the component of this invention to a method, an apparatus, a system, a computer program, a recording medium, etc. is also effective as an aspect of this invention.

DESCRIPTION OF SYMBOLS 1 Smart device 2 Surveying instrument and measuring instrument 3 Construction material 4 Server 5 PC
6 MFP / LP
11 CPU
12 Storage Device 13 Display Device 14 Input Device 15 Communication Device 16 External Interface Device 17 Imaging Device 18 GPS
DESCRIPTION OF SYMBOLS 101 Memory | storage part 102 Touch panel 103 Image pick-up part 104 Communication part 105 Input part 106 Image editing part 107 Image reproduction part

JP 2000-287164 A

Claims (9)

Smart devices,
Photography means for taking photographic images of construction sites,
First storage means for storing in advance a virtual display board image provided with predetermined entries;
Input means for inputting data related to the construction site for the predetermined entry items of the virtual display panel image,
Image editing means for superimposing and arranging a virtual display board image in which data is input by the input means on the photographic image taken by the photographing means;
An application program for functioning as second storage means for storing a photographic image with a virtual display board in which a virtual display board image is arranged by the image editing means. When the second storage means stores the photographic image with the virtual display board, the photographic image taken by the photographing means, the virtual display board image stored by the first storage means, and the image editing means The position information of the virtual display board image on the specified photographic image, the size information of the virtual display board image on the photographic image, and the data input to the predetermined entry of the virtual display board image by the input means; Each of which is associated with each other,
The application program according to claim 1. Reproduce the photographic image with a virtual display board stored in the second storage means, function as an image reproduction means to be displayed on the display device,
The image reproduction means acquires a virtual display board image associated with the photographic image from the first storage means when reproducing the photographic image with a virtual display board stored in the second storage means, Data corresponding to a predetermined entry of the virtual display board image is input, and based on the corresponding position information, the virtual display board image having a size specified by the corresponding size information is superimposed on the photographic image. To reproduce by arranging,
The application program according to claim 2. The image editing means, on the photographic image with a virtual display board reproduced by the image reproducing means and displayed on the display device, on the photographic image, at a change position designated in accordance with an operation from the touch panel by the user. Arrange the virtual display board image superimposed,
When the second storage means stores the photographic image with the virtual display board, the photographic image, the virtual display board image, the position information after the change of the virtual display board image, and the size of the virtual display board image Storing information and the data in association with each other,
The application program according to claim 3. The image editing unit has a change size specified in accordance with an operation from a touch panel by a user on the photographic image with respect to the photographic image with a virtual display panel reproduced by the image reproducing unit and displayed on the display device. Arrange the virtual display board image superimposed,
When the second storage means stores the photographic image with the virtual display board, the photographic image, the virtual display board image, the position information of the virtual display board image, and the changed size of the virtual display board image Storing information and the data in association with each other,
The application program according to claim 3 or 4, characterized by the above-mentioned. Function as a communication means for acquiring the data from an external device;
The input means inputs data acquired by the communication means for a predetermined entry of the virtual display panel image, and inputs the selected data when there are a plurality of the data,
The application program according to claim 1, wherein: The photographic image with the virtual display board is caused to function as image output means for outputting as one image data,
The image output means, when outputting the photographic image with a virtual display board, appending data relating to the construction site input by the input means to the Exif data of the photographic image with the virtual display board;
The application program according to any one of claims 1 to 6. When the image output means outputs the photographic image with the virtual display board, the data relating to the construction site inputted by the input means or a part of the data is added to the Exif data of the photographic image with the virtual display board. Appending encrypted data encrypted with
The application program according to claim 7. Photographing means for photographing photographic images of construction sites;
First storage means for storing in advance a virtual display board image provided with predetermined entries;
Input means for inputting data relating to the construction site for the predetermined entry items of the virtual display panel image;
Image editing means for superimposing and arranging a virtual display board image in which data is inputted by the input means on the photographic image photographed by the photographing means;
Second storage means for storing a photographic image with a virtual display board in which a virtual display board image is arranged by the image editing means;
A smart device comprising: