JP7171637B2 - Image display system and image display program - Google Patents

Description

The present invention relates to an image display system and an image display program.

2. Description of the Related Art Conventionally, in business such as construction, use, or maintenance of buildings, data related to business is often managed in a field notebook. For example, Patent Literature 1 discloses a construction field notebook with a business card holder.

Here, for example, in the case of corrective work on a building (repair of walls, cleaning of stains, etc.), there is a case where the site manager takes a picture of the corrected part with a camera and instructs other workers, etc. on the corrected part. be. Specifically, by printing out the photographed photograph and entering the instructions on the photograph, as well as by entering the shooting position of the photograph on the spot (or while remembering the photograph later) on the drawing field book. , the position of the drawing field book and the photograph were associated with each other and given instructions.

JP-A-11-227363

Here, in the work method as described above, since the worker confirms and writes the photographing position on the drawing field notebook, there is manual intervention, which requires time and effort, and also makes a mistake in correspondence (for example, an erroneous Associating a photo with a position) sometimes occurred. In particular, when there are a large number of photographs, it takes a lot of time and effort to associate them with the drawing field notebook, and there is a possibility that the incidence of errors in association will increase. Also, for the workers who check the drawing field notebook and actually carry out the correction work, it is necessary to compare the drawing field notebook and the photograph to understand the corrected parts and correction details, so the correspondence between the photograph and the shooting position was difficult to grasp intuitively. Therefore, it is possible to reduce the possibility of erroneous correspondence between the drawing field notebook and the photograph, reduce the labor required for the correspondence, and furthermore, make it possible for the user to intuitively understand the correspondence between the photograph and the photographing position. There has been a demand for a system that can grasp the

The present invention has been made in view of the above, and can reduce the possibility of making a mistake in associating a drawing such as the above-mentioned drawing field notebook with an image such as the above-mentioned photograph, as well as the time and effort required for associating. It is an object of the present invention to provide an image display system capable of reducing the number of shots taken and allowing a user to intuitively grasp a shot image and shooting position.

In order to solve the above-described problems and achieve the object, the image display system according to claim 1 is an image display system for displaying images related to construction, use, or maintenance of a building. a photographing means for obtaining image information; a position obtaining means for obtaining position information specifying the position of the photographing means; a drawing information storing means for storing drawing information relating to the building; and the building obtained by the photographing means. and the position information acquired by the position acquisition means, which is related to the position where the image information was acquired by the photographing means. and display means, wherein when the photographing means performs photographing, the image information obtained by the photographing means, the position information obtained by the position obtaining means, and the The drawing information stored in the drawing information storage means is displayed in association with each other, and the image information stored in the image information storage means and the image information stored in the image information storage means are displayed when the image information photographed by the photographing means is browsed. and the display means for displaying the position information stored in the image information storage means and the drawing information stored in the drawing information storage means in association with each other, wherein the display means In both cases of photographing by the photographing means and viewing of the image information photographed by the photographing means, as the position information, a position corresponding to the position information in the drawing indicated by the drawing information , a position icon indicating the position of the photographing means is displayed, and when the photographing means is used for photographing , the image display system is based on the input from the user regardless of whether the photographing means has moved. and a movement reception means for moving the display position of the position icon.

The image display system according to claim 2 is the image display system according to claim 1, further comprising transmitting means for transmitting radio waves, the transmitting means being installed at a plurality of locations in the building, The position acquisition means acquires the position information based on the radio waves transmitted by the transmission means, and the drawing information storage means uniquely identifies the drawing information and the transmission means associated with the drawing information. and transmission means specifying information for the display are stored in association with each other, and the display means is stored in the drawing information storage means when the image display system receives the radio waves transmitted by the transmission means. and the drawing information associated with the transmitting means specifying information of the transmitting means that transmitted the radio waves received by the image display system.

3. The image display system according to claim 3 is the image display system according to claim 1 or 2, wherein the display means displays the image information captured by the image capturing means when the image is captured by the image capturing means. is displayed in the first area of the display means, and the image information relating to the construction, use, or maintenance of the building acquired by the photographing means is displayed in the first area of the display means, and the display means is the photographing means and when viewing the image information captured by the imaging means, the position icon and the drawing information stored in the drawing information storage means are displayed on the display The second area of the means is displayed in the second area below the first area, and the first area and the second area do not overlap each other.

The image display system according to claim 4 is the image display system according to claim 3, wherein the image information storage means stores a plurality of the image information, and the display means comprises the image information storage means. When at least one piece of image information is selected from among the plurality of pieces of image information stored in the drawing information, the selected at least one piece of image information is displayed in the first area, The drawing information corresponding to the selected at least one piece of image information among the drawing information stored in the storage means is displayed in the second area.

The image display program according to claim 5 is an image display program for an image display system that displays images relating to construction, use, or maintenance of a building, wherein the image display system acquires image information by photographing. position acquisition means for acquiring position information specifying the position of said photographing means; drawing information storage means for storing drawing information relating to said building; construction and use of said building acquired by said photographing means or image information storage for storing image information related to maintenance and management , and the position information acquired by the position acquisition means, which is related to the position where the image information was acquired by the photographing means. means, display means, wherein when the photographing means performs photographing, the image information obtained by the photographing means, the position information obtained by the position obtaining means, and the drawing information storing means. and the drawing information stored in the image information storage means are displayed in association with each other, and the image information stored in the image information storage means and the image information The position information stored in the storage means and the drawing information stored in the drawing information storage means are displayed in association with each other, and the display means functions as the imaging means. and in the case of viewing the image information captured by the image capturing means, as the position information, at a position corresponding to the position information in the drawing indicated by the drawing information , the A position icon indicating the position of the photographing means is displayed, and the image display program displays the image display system according to input from the user regardless of whether or not the photographing means has moved when photographing is performed by the photographing means. based on, it functions as a movement receiving means for moving the display position of the position icon.

According to the image display system according to claim 1 and the image display program according to claim 5, drawing information about the building, image information about construction, use, or maintenance of the building acquired by the photographing means, Positional information about the position where the image information was acquired by the photographing means is associated with each other and displayed. It is possible to reduce the possibility of an error in associating with the image, reduce the labor required for associating, and allow the user to intuitively grasp the correspondence between the photographed image and the photographing position. can. In addition, since the display position of the position icon can be moved based on the input from the user, if the acquired position information is incorrect, minor corrections can be made while checking the drawing, and the position information can be corrected to be more accurate. .

1 is a block diagram functionally conceptually showing a mobile terminal and a beacon according to an embodiment of the present invention; FIG. It is a figure which illustrates the information stored in image DB. It is a figure which illustrates the information stored in drawing DB. It is a figure which illustrates the information stored in transmission position DB. FIG. 4 is a plan view showing an example of arrangement of beacons; FIG. 5 is a diagram showing a display example in image display processing according to the embodiment of the present invention; FIG. 10 is a diagram showing a display example of a display according to a modification of the embodiment of the present invention;

Embodiments of an image display system according to the present invention will be described in detail below with reference to the accompanying drawings. First, [I] the basic concept of the embodiment will be described, then [II] the specific contents of the embodiment will be described, and finally [III] modifications of the embodiment will be described. However, the present invention is not limited by the embodiment.

[I] Basic concept of the embodiment First, the basic concept of the embodiment will be described. Embodiments relate to an image display system that displays images related to building construction, use, or maintenance. Here, "images related to construction, use, or maintenance of buildings" are images used by site managers and workers when constructing, using, or maintaining buildings. In the form of , it is assumed that the image is used during construction of the building, and is an image of the corrected portion of the construction site of the building. The “correction portion” is a portion of the building to be corrected, and is, for example, a portion different from the design drawing, a stain, a stain, a defect, or the like. In addition, the use of the image obtained by photographing the corrected portion is arbitrary. This is an image used to indicate specific contents. In the following description, when there is no particular need to distinguish between on-site managers and workers, they will be collectively referred to simply as "workers."

[II] Specific contents of the embodiment Next, specific contents of the embodiment will be described.

(Constitution)
First, the configuration of the image display system according to this embodiment will be described. FIG. 1 is a block diagram functionally conceptually showing a mobile terminal 10 and a beacon 20 according to this embodiment. Here, first, outlines of the mobile terminal 10 and the beacon 20 will be described. First, the "portable terminal" 10 is an image display system that displays images related to building construction, use, or maintenance management. A computer, smartphone, etc.) may also be used. Then, the mobile terminal 10 can receive radio waves from the beacon 20 and specify the current position of the mobile terminal 10 based on the radio wave intensity of the beacon 20 . Next, the "beacon" 20 is transmitting means for transmitting radio waves. A plurality of beacons 20 are placed at the construction site by workers, and although only two beacons 20 are shown in FIG. 1, each beacon 20 is similarly constructed. In addition, when it is necessary to distinguish between these two beacons 20, they are distinguished from each other as "first beacon" 21 or "second beacon" 22. FIG.

Next, details of the mobile terminal 10 and the beacon 20 will be described. First, as shown in FIG. 1, the mobile terminal 10 according to the present embodiment functionally and conceptually includes a touch pad 11, a display 12, a beacon radio wave receiving unit 13, an orientation obtaining unit 14, a camera 15, a communication unit 16, It comprises a control section 17 and a data recording section 18 .

(Configuration - mobile terminal - touch pad)
The touch pad 11 is an operation unit that receives various operation inputs from the user when pressed by the user's finger or the like. Although the specific configuration of the touch pad 11 is arbitrary, for example, a known one provided with operation position detection means such as a resistive film system or a capacitance system can be used.

(Configuration - mobile terminal - display)
The display 12 is display means for displaying various images. Further, the display 12 displays image information relating to construction, use, or maintenance of the building acquired by the camera 15, and position information acquired by a current position acquisition unit 17a (described later). Position information about the position where the image information was acquired, drawing information stored in a drawing database 18b (to be described later; the database is hereinafter referred to as “DB”), and the orientation acquired by the orientation acquisition unit 14 This is display means for displaying the information in association with the azimuth information related to the azimuth in which the image information was obtained by the camera 15 . Although the specific configuration of the display 12 is arbitrary, for example, a known liquid crystal display 12 or a flat panel display such as an organic EL display can be used. Note that the touch pad 11 and the display 12 may be integrally formed as a touch panel.

(Configuration - mobile terminal - beacon radio wave receiver)
The beacon radio wave receiving unit 13 is beacon radio wave receiving means for receiving radio waves transmitted from the beacon 20 . Although the specific type and configuration of the beacon radio wave receiving unit 13 are arbitrary, for example, known wireless communication means can be used.

(Configuration - mobile terminal - azimuth acquisition unit)
The orientation acquisition unit 14 is orientation acquisition means for acquiring orientation information that specifies the orientation of the image captured by the camera 15, and is, for example, a gyro compass, a magnetic compass, or an orientation compass, but is not limited thereto.

(Configuration - mobile terminal - camera)
The camera 15 is a photographing means for photographing and obtaining image information. Image information photographed by the camera 15 is input to the control section 17 and recorded in the data recording section 18 as appropriate. The specific configuration of the camera 15 is arbitrary, and for example, it is configured using known imaging elements such as a CMOS image sensor and a CCD image sensor, and known optical system components such as a fisheye lens and a prism.

(Configuration - mobile terminal - communication unit)
The communication unit 16 is communication means for performing communication with another mobile terminal 10 (not shown) via a network. wireless communication means can be used.

(Configuration - mobile terminal - control unit)
The control unit 17 is control means for controlling the mobile terminal 10 . Specifically, the CPU, various programs interpreted and executed on the CPU (including basic control programs such as OS and application programs that are started on the OS and realize specific functions), and programs and various data A computer configured with internal memory, such as RAM, for storage. In particular, the image display program according to the present embodiment substantially configures each section of the control section 17 by being installed in the mobile terminal 10 via any recording medium or network. The "image display program" is an image display program for displaying images related to the construction, use, or maintenance of a building. A current position acquisition unit 17a (to be described later) that acquires position information for specifying a position; image information related to building construction, use, or maintenance management acquired by the camera 15; This is an image display program that functions as a display 12 that correlates and displays position information, which is position information about a position where image information is acquired by a camera 15, and drawing information about a building. Also, the "computer" is the mobile terminal 10 such as a tablet terminal in the present embodiment, but is not limited to this, and includes any device (for example, a notebook computer, a smart phone, etc.). Here, the control unit 17 is functionally and conceptually configured to include a current position acquisition unit 17a and a movement reception unit 17b.

The current position acquisition unit 17 a is position acquisition means for acquiring position information specifying the position of the camera 15 . In addition, the current position acquisition unit 17a compares the strength of the radio wave received from the first beacon 21 and the strength of the radio wave received from the second beacon 22, and stores the comparison result in the transmission position DB 18c (described later). and a position obtaining means for obtaining the position information based on the transmitted position information. In the present embodiment, the device is configured to acquire position information based on the received radio wave from the beacon 20 received by the beacon radio wave receiving unit 13 as described above. It may be a device that acquires position information using a GPS receiver or acquires position information that is estimated by PDR technology using a gyro sensor or the like. A specific method for the current position acquisition unit 17a to acquire position information will be described later. The movement reception unit 17b is movement reception means for moving the display position of a position icon (described later) displayed on the display 12 based on an input from the user. Note that specific processing executed by each unit of the control unit 17 will be described later.

(Configuration - mobile terminal - data recording unit)
The data recording unit 18 is recording means for recording programs and various data necessary for the operation of the portable terminal 10, and is configured using, for example, a hard disk (not shown) as an external recording device. However, any other recording medium can be used in place of or in conjunction with the hard disk, including magnetic recording media such as magnetic disks, or optical recording media such as DVDs and Blu-ray discs.

The data recording unit 18 includes an image DB 18a, a drawing DB 18b, and a transmission position DB 18c.

The image DB 18a contains image information relating to construction, use, or maintenance of buildings acquired by the camera 15 and position information acquired by the current position acquisition unit 17a. It is an image storage means for storing the positional information related to the position in association with each other. FIG. 2 is a diagram illustrating information stored in the image DB 18a. As shown in FIG. 2, the image DB 18a stores an item "image information", an item "position information", an item "orientation information", and information corresponding to these items in association with each other.

Here, as information corresponding to the item "image information", image information (image data) relating to construction, use, or maintenance of the building acquired by the camera 15 is stored. For convenience of illustration, FIG. 2 shows only data numbers and extensions that uniquely specify the image information. Further, as information corresponding to the item "positional information", positional information obtained by the current position obtaining section 17a, and positional information relating to the position where the image information was obtained by the camera 15 is stored. . Specifically, when an image is captured by the camera 15, the current position acquisition unit 17a acquires the position information (two-dimensional position coordinates in the drawing) of the mobile terminal 10 by a known method, and the acquired Position information is stored as information corresponding to the item. Also, as information corresponding to the item "direction information", direction information specifying the direction of photographing by the camera 15 is stored. Specifically, when a photograph is taken by the camera 15, the azimuth acquisition unit 14 publicly announces the photographing azimuth of the camera 15 (in the illustration, the azimuth in a 360-degree horizontal plane with north as a reference of 0 degrees). and stores the acquired shooting direction as information corresponding to the item.

Returning to FIG. 1, the drawing DB 18b is drawing information storage means for storing drawing information about buildings. FIG. 3 is a diagram illustrating information stored in the drawing DB 18b. As shown in FIG. 3, the drawing DB 18b mutually associates the item "drawing information", the item "area information", the item "floor", the item "beacon ID", and the information corresponding to each of these items. Store.

Here, the information corresponding to the item "drawing information" is data of a drawing representing a building (hereinafter referred to as "floor plan"), for example, drawing data created by CAD. The data is not limited to this, and may be scan data or the like obtained by scanning a printed drawing. For convenience of illustration, FIG. 3 shows only data numbers and extensions that uniquely identify the drawing data of the plan views. Further, as information corresponding to the item "area information", area information specifying an area indicated by a drawing is stored, for example, a range of two-dimensional position coordinates is stored. As information corresponding to the item "floor", information specifying the floor of the floor plan indicated by the drawing information is stored. For example, "M0001.jpeg" is the floor plan of the first floor, and "M0002.jpeg" is the floor plan of the second floor. As information corresponding to the item "beacon ID", information for uniquely specifying the beacon 20 actually placed in the area shown in the drawing is stored. For example, a total of 50 beacons 20 with beacon IDs "B0001" to "B0050" are arranged on the first floor of the building at the construction site, and on the second floor of the building, the beacon IDs are "B0051" to " B0100", a total of 50 beacons 20 are arranged.

Here, the timing of storing the information corresponding to each item is arbitrary. downloaded to and stored in advance. For the information corresponding to the item "beacon ID", when the worker installs the beacon 20 at the actual construction site, the worker operates the touch pad 11 to input the beacon ID of the beacon 20 that he/she installed ( For example, the beacon ID is written on the surface of the beacon 20, and the input may be performed while looking at this notation. A specific procedure for this input will be described later.

Returning to FIG. 1, the transmission position DB 18c includes the first beacon 21 and the second beacon 22 that transmit radio waves, and the first beacon 21 arranged in one of the two spaces sandwiching the radio wave shielding member 30. , and the second beacon 22 arranged in the other of the two spaces sandwiching the radio wave shielding member 30. This is a transmission position storage means for storing transmission position information indicating the positions of the second beacons 22. FIG. FIG. 4 is a diagram illustrating information stored in the originating position DB 18c. As shown in FIG. 4, the transmitting position DB 18c stores the item "beacon ID", the item "transmitting position information", and the information corresponding to each of these items in association with each other.

Here, as information corresponding to the item "beacon ID", information for uniquely specifying each beacon 20 is stored. For example, beacon IDs such as "B0001" and "B0002" are stored. Information corresponding to the item "transmitting position information" includes the first beacon 21 (for example, the beacon 20 of B0001) and the second beacon 22 (for example, the beacon 20 of B0002) that emit radio waves, Positions of the first beacon 21 placed in one of the two spaces sandwiching the member 30 and the second beacon 22 placed in the other of the two spaces sandwiching the radio wave shielding member 30. is stored. For example, in the present embodiment, two-dimensional position coordinates for specifying the position of the beacon 20 such as (X035, Y020) and (X035, Y025) are stored. Here, the timing of storing the information corresponding to this item "transmitting position information" is arbitrary. A beacon icon (described later) indicating the position of the installed beacon 20 may be moved to the installation position of the beacon 20, and the control unit 17 may automatically specify the position coordinates based on the position of the beacon icon. A specific procedure for such input will be described later.

(configuration - beacon)
Returning to FIG. 1, the beacon 20 is a means of transmitting radio waves. Send out radio waves. The beacons 20 are installed at a plurality of locations on the construction site by workers as described above. Among the plurality of beacons 20, two of the first beacon 21 and the second beacon 22 will be focused on and described below. The “first beacon” 21 is a first transmitting means for transmitting radio waves, and is arranged in one of two spaces sandwiching the radio wave shielding member 30 . Further, the “second beacon” 22 is second transmitting means for transmitting radio waves, and is arranged in the other of the two spaces sandwiching the radio wave shielding member 30 .

Here, arrangement of the beacons 20 according to the present embodiment will be described. FIG. 5 is a plan view showing an arrangement example of the beacons 20. As shown in FIG. Hereinafter, the X-X' direction in each drawing will be referred to as the "width direction" as necessary, and the X direction will be particularly referred to as the "right direction" and the X' direction as the "left direction". Also, the Y-Y' direction is called the "depth direction", and in particular the Y direction is called the "forward direction" and the Y' direction is called the "backward direction". Also, the direction perpendicular to the XY plane is referred to as the “height direction”. As shown in FIG. 5, the beacons 20 are arranged at a plurality of locations in the building. For example, one beacon 20 is arranged in each room of the building (room A and room B in FIG. 5). In addition, they may be arranged at a plurality of locations at regular intervals in a wide area such as a passage.

The placement of the beacons 20 will now be described in more detail. As illustrated, in this embodiment, the first beacon 21, the second beacon 22, and the radio wave shielding member 30 are arranged as a set. It should be noted that these are all arranged at approximately the same height (for example, a point 1 m above the floor).

The first beacon 21 is a first transmitting means for transmitting radio waves, and is arranged in one space (room A) of two spaces (room A and passageway) sandwiching the radio wave shielding member 30. Specifically, it is a beacon 20 placed near the front wall in the room A. As described above, the first beacon 21 emits radio waves in all 360° surroundings, and the radio waves are given a beacon ID for identifying the first beacon 21 (the second beacon 22 also emit radio waves in the same way). The second beacon 22 is second transmitting means for transmitting radio waves, and is arranged in the other space (passageway) of the two spaces (room A and passageway) sandwiching the radio wave shielding member 30. , and more specifically, the beacon 20 disposed near the rear wall of the passage.

The radio wave shielding member 30 is radio wave shielding means for shielding radio waves, and is arranged between the first beacon 21 and the second beacon 22 . Here, "shielding radio waves" means weakening at least the above-mentioned radio waves from one space to the other space (or radio waves from the other space to one space). and absorbing radio waves. Note that "reflecting radio waves" specifically means that the radio wave shielding member 30 is made of a material that reflects radio waves, such as an aluminum plate, and "absorbing radio waves" means a member containing carbon. The radio wave shielding member 30 is made of a material that absorbs radio waves such as. In addition, "between the first beacon 21 and the second beacon 22" does not matter as long as it is arranged on a straight line connecting at least the first beacon 21 and the second beacon 22. 22 does not have to be in contact. For example, in the present embodiment, the rear side surface of the radio wave shielding member 30 abuts the first beacon 21, and the front side surface of the radio wave shielding member 30 abuts the wall that divides the room A (that is, the second beacon 22 is not in direct contact with). Here, although the shape and size of the radio wave shielding member 30 are arbitrary, in the present embodiment, it is a plate-like body having a square shape when viewed from the front, and has a width of 30 cm, a height of 30 cm, and a depth (thickness) of about 1 cm. is the body.

By providing the radio wave shielding member 30 between the first beacon 21 and the second beacon 22 in this manner, the radio wave intensity on the room A side and the radio wave intensity on the passage side can be made different. Specifically, first, radio waves have the characteristic of being attenuated in inverse proportion to distance. Strong reception. That is, when the radio wave shielding member 30 is not provided, for example, when the beacons 20 are arranged at substantially the same position like the first beacon 21 and the second beacon 22 shown in FIG. The radio wave intensities from the first beacon 21 and the second beacon 22 are substantially the same at any position. However, by providing the radio wave shielding member 30 between the beacons 20 as in the present embodiment, the radio wave shielding member 30 shields the radio wave from the first beacon 21 toward the room A side (rear direction, etc.). However, the radio wave shielding member 30 shields radio waves directed toward the aisle (forward direction, etc.). Also, radio waves directed toward the aisle side (forward direction, etc.) from the second beacon 22 are not blocked by the radio wave shielding member 30, but radio waves directed toward the room A side (backward direction, etc.) are blocked by the radio wave shielding member 30. shielded. Therefore, the radio wave intensity of the first beacon 21 is higher than that of the second beacon 22 in the room A, and the radio wave intensity of the second beacon 22 is higher than that of the first beacon 21 in the corridor.

Then, the beacon radio wave receiving unit 13 receives radio waves from a plurality of beacons 20 including the first beacon 21 and the second beacon 22, and the current position acquisition unit 17a acquires, for example, a known radio wave based on the received radio waves. The two-dimensional position coordinates of the current position are specified by a point positioning method or a three-point positioning method. Here, when the radio wave intensity from the first beacon 21 is greater than that of the second beacon 22, the current position acquiring unit 17a determines that the current position is located in a space closer to the first beacon 21 than the radio wave shielding member 30 (that is, room A). If the radio wave intensity from the second beacon 22 is greater than that of the first beacon 21, the current position is in the space on the second beacon 22 side of the radio wave shielding member 30 (i.e., the path side space). space). Therefore, it is possible to prevent the room A from being indicated even though the current position is a corridor, and the accuracy of the current position can be improved.

(process)
Next, various processes executed by the mobile terminal 10 according to this embodiment will be described.

(Processing - Beacon registration processing)
First, the beacon registration process executed by the control unit 17 of the mobile terminal 10 according to this embodiment will be described. Schematically, this beacon registration process is performed in preparation for photographing the construction site by having a worker go around the construction site while holding the mobile terminal 10, place the beacons 20 on the construction site, and This is a process executed when registering the information related to the drawing DB 18b or the calling position DB 18c with the touch pad 11 of the mobile terminal 10. FIG.

Specifically, first, the worker places the beacon 20 at the construction site. Subsequently, the worker registers the beacon ID and transmission position information of the beacon 20 placed by him/herself in the transmission position DB 18c of FIG. A specific method for this registration is arbitrary, and an example thereof will be described below.

First, the control unit 17 displays a beacon registration icon on the display 12, and when this icon is pressed by the worker, the beacon registration mode is entered. In this mode, first, the setting of the drawing for which the beacon 20 is to be registered is accepted. Specifically, the control unit 17 displays thumbnails of the drawing information stored corresponding to the item "drawing information" of the drawing DB 18b. Then, the drawing information is displayed on the display 12 . Furthermore, a beacon icon indicating the position of the beacon 20 is displayed in the center of the screen. Then, the movement reception unit 17b receives movement of the display position of the beacon icon. Specifically, for example, when an arrow-shaped beacon movement icon (not shown) displayed on the display 12 is pressed, the beacon icon may be moved in the direction indicated by the arrow. In a state where the display position is pressed by the worker's finger, the beacon icon may be moved along the slide when the finger slide is received. Then, when the confirmation icon (not shown) is pressed while the beacon icon is moved to the position where the beacon 20 is installed, a window for accepting the input of the beacon ID is displayed. Then, the user enters the beacon ID while confirming the beacon ID described on the beacon 20, and when the beacon ID is entered, the transmission specified by a known method based on the beacon ID and the position of the beacon icon. location information is stored in the transmission location DB 18c. Also, the beacon ID input as described above is stored in the information corresponding to the item "beacon ID" of the drawing to be registered in the drawing DB 18b of FIG. This completes the beacon registration process.

(Processing - image display processing)
Next, image display processing executed by control unit 17 of mobile terminal 10 according to the present embodiment will be described. Schematically, this image display processing is processing for displaying on the display 12 the drawing information stored in the drawing DB 18b and the image information, position information, and direction information stored in the image DB 18a in association with each other. As for the timing of such display, two patterns will be described below as examples, one when shooting with the camera 15 and the other when reviewing the shot image later, but the timing is not limited to this.

(Processing - Image display processing - When shooting with a camera)
First, the display on the display 12 when shooting with the camera 15 will be described. FIG. 6 is a diagram showing a display example of the display 12 in the image display processing according to this embodiment. As shown in FIG. 6, the control unit 17 generally displays an image captured by the camera 15 on the upper half of the display 12, a plan view on the lower half, a position icon indicating the current position of the worker, An orientation icon indicating the shooting orientation of the camera 15 is displayed.

Specifically, first, when the worker activates the camera 15 by a known method (for example, by tapping the camera icon displayed on the display 12), the control unit 17 displays the image captured by the camera 15 in real time. is displayed in the upper half of the display 12 with . Furthermore, based on the beacon ID attached to the radio wave received from the beacon 20, the control unit 17 refers to the drawing DB 18b of FIG. For example, when the radio waves received by the beacon radio wave receiving unit 13 are those of the beacon IDs "B0001" and "B0002", the corresponding drawing information in FIG. 3 is "M0001.jpeg". It is displayed in the lower half of the display 12. Further, the control unit 17 displays the current position of the worker (that is, the current position of the mobile terminal 10) at a position corresponding to the drawing. For example, the current position acquisition unit 17a identifies the current position based on the intensity of radio waves from the beacon 20 as described above. Then, the control unit 17 displays a position icon at a position corresponding to the worker's current position in the drawing. Although the display mode of this icon is arbitrary, the present embodiment uses a round icon. Further, since the position icon is displayed in real time, when the worker moves and the position of the mobile terminal 10 moves, the display position of the position icon also moves accordingly.

If the accuracy of the current position acquisition unit 17a is reduced for some reason, the position icon may be displayed at the wrong position. , the display position can be moved by the same method as the method for moving the display position of the beacon icon as described above. Specifically, when the movement reception unit 17b receives the pressing of the arrow-shaped current position movement icon (not shown) displayed on the display 12, the movement reception unit 17b may receive the position icon in the direction indicated by the arrow, Alternatively, in a state where the display position of the position icon is pressed by the worker's finger, the position icon may be moved along with the slide when the finger slide is received.

In addition, the control unit 17 identifies the direction in which the camera 15 of the mobile terminal 10 is facing and displays it on the display 12 . Specifically, the orientation acquisition unit 14 uses a known method such as a gyro sensor to identify the orientation of the camera 15 (for example, “260°”), and displays information about the identified orientation on the display 12. . This display mode is preferably a mode that is easy for the user to recognize. For example, in the present embodiment, a fan-shaped azimuth icon is displayed superimposed on the position icon. The drawing itself may be rotated so that the facing direction matches the rearward direction (Y' direction) on the drawing. Alternatively, a direction icon may be displayed at a position different from the position icon. Further, since the direction icon is displayed in real time, when the worker changes the orientation of the camera 15, the display of the direction icon also rotates accordingly. In this way, when photographing with the camera 15, drawing information (plan view of photographing position), image information (image captured by the camera 15), position information (position icon), and direction information (direction icon). ) are integrally displayed in real time, the worker can take pictures while grasping the shooting situation with the camera 15 .

Here, when the worker presses the shutter button (not shown) displayed on the display 12 while holding the camera 15 of the mobile terminal 10 toward the correction location R, the photographed image (upper part of FIG. 6) half image) is stored as information corresponding to the item "image information" in the image DB 18a of FIG. At this time, the information corresponding to the item "position information" of the image DB 18a stores the position information related to the current position specified by the current position acquisition unit 17a as described above, and the information corresponding to the item "direction information" is stored. stores information about the current direction specified by the direction acquisition unit 14 as described above. Thus, the image information, the position information, and the orientation information are associated with each other and stored in the image DB 18a. Then, the worker similarly takes pictures of the correction points R existing in various positions of the building with the camera 15, thereby obtaining a plurality of image information and the position information and direction information corresponding to the image information. It can be stored in the DB 18a.

In the above description, the image information, the position information, and the direction information are stored in the image DB 18a as separate information. For example, the entire display example shown in FIG. 6 may be stored in the image DB 18a as one image (an image in which the upper half and the lower half are integrally photographed).

(Processing - Image display processing - When reviewing captured images later)
Next, the display on the display 12 when reviewing the photographed image later will be described. In this case, the display contents are the same as those when the camera 15 is used for photographing, so the description will be made with reference to FIG. Specifically, first, for example, when an image viewing icon (not shown) for accepting an image viewing request is pressed by the worker, the control unit 17 displays the image information stored corresponding to the item "image information" in the image DB 18a. are displayed as thumbnails (not shown) or the like, and when one of these thumbnails is selected by the worker (by tapping or the like), the image information is displayed in the upper half of the display 12 as shown in FIG. Furthermore, a drawing corresponding to the selected image is displayed in the lower half. Specifically, the area of the two-dimensional position coordinates stored corresponding to the item "area information" in the drawing DB 18b of FIG. A drawing is specified, and the specified drawing is displayed in the lower half of the display 12 as shown in FIG. Further, referring to the image DB 18a of FIG. 2, a position icon is displayed at the position indicated by the item "position information" corresponding to the selected image information, and a direction icon of the direction indicated by the item "direction information" is displayed. do. Therefore, as shown in FIG. 6, the photographed image, the position icon, the direction icon, and the drawing can be associated with each other and displayed together, so that the worker can easily understand the photographed image, the photographing position, and the photographing direction. Correspondence can be easily recognized.

Moreover, as described above, when the entire display example shown in FIG. That is, since the photographed image, the position icon, the orientation icon, and the drawing are integrally displayed in the image, the worker can recognize the photographed image and the photographing position by visually recognizing the photographed image. It is possible to easily recognize the correspondence relationship with the photographing direction.

Note that the image DB 18a updated in this image display process, the drawing DB 18b updated in the above-described beacon registration process, and the transmission position DB 18c are shared with other mobile terminals 10 (not shown) via the communication unit 16. It is preferable to allow As a result, the image DB 18a can be efficiently updated by a plurality of workers taking pictures with the cameras 15 of the mobile terminals 10, and each worker can update the image information stored by other workers. etc. can be confirmed from the own portable terminal 10, so that work efficiency can be improved. The description of the image display processing is omitted above.

(Effect of Embodiment)
As described above, according to the mobile terminal 10 of the present embodiment, drawing information about the building, image information about construction, use, or maintenance of the building acquired by the camera 15, and image information acquisition by the camera 15 are possible. Since the location information related to the location where the image was taken is displayed in association with each other, the captured image can be automatically associated with the corresponding position on the drawing and displayed. In addition, the user can intuitively understand the correspondence relationship between the photographed image and the photographing position.

In addition to the drawing information, the image information, and the positional information, the direction information is displayed in association with each other. It is possible to allow the user to more intuitively grasp the correspondence relationship with the shooting direction.

In addition, since the image is displayed based on the comparison result of the strength of the radio wave in the first beacon 21 and the second beacon 22 partitioned by the radio wave shielding member 30 and the transmission position information thereof, It is possible to specify which of the areas on the side of the first beacon 21 or the side of the second beacon 22 the photographing was performed in, and the accuracy of the position information can be improved.

In addition, since the display position of the position icon can be moved based on the input from the user, if the acquired position information is incorrect, minor corrections can be made while checking the drawing, and the position information can be corrected to be more accurate. .

[III] Modifications to the Embodiments Although the embodiments according to the present invention have been described above, specific configurations and means of the present invention are within the scope of the technical ideas of each invention described in the claims. In can be optionally modified and improved. Such modifications will be described below.

(Problem to be solved and effect of invention)
First, the problems to be solved by the invention and the effects of the invention are not limited to the contents described above, and may differ depending on the details of the implementation environment and configuration of the invention. or only part of the effects described above.

(Regarding decentralization and integration)
Also, each electrical component described above is functionally conceptual, and does not necessarily need to be physically configured as illustrated. In other words, the specific forms of distribution and integration of each part are not limited to those illustrated, and all or part of them can be functionally or physically distributed or integrated in arbitrary units according to various loads and usage conditions. can be configured as For example, a management server (not shown) may include some of the functions provided in the mobile terminal 10 in the present embodiment. Specifically, for example, a plurality of portable terminals 10 transmit data to the management server via the communication unit 15, and the management server stores the received data in a recording unit (not shown) of the management server, thereby allowing a plurality of Data transmitted from the mobile terminal 10 may be accumulated. Further, by transmitting the data accumulated in this manner to each mobile terminal 10, each mobile terminal 10 may share the data.

(About dimensions and materials)
The dimensions, shapes, materials, ratios, etc. of each part of the image display system, the beacon 20, and the radio wave shielding member 30 described in the detailed description of the invention and the drawings are merely examples, and other arbitrary dimensions, shapes, materials, It can be a ratio or the like.

(Regarding position and direction)
In this embodiment, two-dimensional position coordinates are identified and stored and displayed as the position coordinates, but three-dimensional position coordinates including the position in the height direction may be stored and displayed. For example, the drawing DB 18b stores height position coordinates corresponding to each drawing (for example, (Z010) for the first floor, (Z020) for the second floor, etc.). can be specified. As the orientation, the orientation on the XY plane is stored and displayed. may be specified, stored and displayed.

(Display example)
In this embodiment, when reviewing the photographed image later, the image information is displayed in the upper half of the display 12, and the drawing information and the position information are displayed in association with each other. Although the position information is displayed, the display mode is not limited to this. FIG. 7 is a diagram showing a display example of display 12 according to a modification of the present embodiment. As shown in FIG. 7, the drawing information, the image information, and the position information may be displayed together on the entire display 12 . Specifically, first, for example, when a drawing viewing icon (not shown) for accepting a drawing viewing request is pressed by the worker, the control unit 17 displays the drawing information stored corresponding to the item "drawing information" of the map DB. are displayed as thumbnails S or the like, and when one of the thumbnails S is selected by the worker (by tapping or the like), the drawing information is displayed in the lower half of the display 12 (of course, displayed in the entire display 12). don't mind). Also, based on the information stored corresponding to the item "image information" and the item "position information" of the image DB 18a, the thumbnail S of the image information is displayed at the position where the selected image was taken. In this manner, drawing information, image information, and position information may be displayed in association with each other. In addition to this, orientation information may be displayed on the drawing. Also, when the worker taps the thumbnail S, a drawing that is an enlarged version of the thumbnail S is displayed, or the display shown in FIG. can be done.

(Appendix)
The image display system of Supplementary Note 1 is an image display system that displays images related to the construction, use, or maintenance of a building, and includes a photographing means for obtaining image information by photographing, and a position of the photographing means. position acquisition means for acquiring position information; drawing information storage means for storing drawing information related to the building; image information relating to construction, use, or maintenance of the building acquired by the photographing means; position information obtained in step 2, the position information relating to the position at which the image information was obtained by the photographing means, and the drawing information stored in the drawing information storage means are displayed in association with each other. and display means.

The image display system according to Supplementary Note 2 is the image display system according to Supplementary Note 1, further comprising direction acquisition means for acquiring direction information specifying the direction of photography by the photography means, and the display means obtains direction information obtained by the photography means. image information relating to the construction, use, or maintenance of the building; position information acquired by the position acquiring means, which is related to the position where the image information was acquired by the photographing means; The drawing information stored in the drawing information storage means and the direction information acquired by the direction acquisition means, which is the direction information related to the direction in which the image information was acquired by the photographing means, are associated with each other. displayed.

In the image display system according to appendix 3, in the image display system according to appendix 1 or 2, the first transmitting means and the second transmitting means for transmitting radio waves are arranged in one of the two spaces sandwiching the radio wave shielding member. A transmission position storing transmission position information indicating the positions of the first transmission means arranged in the space and the second transmission means arranged in the other of two spaces sandwiching the radio wave shielding member. Storage means is provided, and the position acquisition means compares the strength of the radio waves received from the first transmission means and the strength of the radio waves received from the second transmission means, and stores the comparison result and the transmission position storage means. The location information is obtained based on the originating location information stored in the .

The image display system according to appendix 4 is the image display system according to any one of appendices 1 to 3, wherein the display means displays, as the position information, at a position corresponding to the position information in the drawing indicated by the drawing information. A position icon is displayed, and the image display system includes a movement receiving means for moving the display position of the position icon based on an input from the user.

The image display program of Supplementary Note 5 is an image display program for displaying an image related to construction, use, or maintenance of a building, comprising: a computer configured to acquire image information by photographing; position acquisition means for acquiring position information specifying the building; image information relating to construction, use, or maintenance of the building acquired by the photographing means; and position information acquired by the position acquisition means, It functions as display means for displaying the position information about the position where the image information is acquired by the photographing means and the drawing information stored in the drawing information storage means in association with each other.

(Effect of Supplementary Note)
According to the image display system described in Supplementary Note 1 and the image display program described in Supplementary Note 5, drawing information about the building, image information about construction, use, or maintenance of the building acquired by the photographing means, and the photographing means Since the positional information related to the position where the image information was acquired by is associated with each other and displayed, the captured image can be automatically associated with the corresponding position on the drawing and displayed. It is possible to reduce the possibility of an association error, reduce the labor required for association, and allow the user to intuitively grasp the correspondence between the photographed image and the photographing position.

According to the image display system described in Supplementary Note 2, in addition to the drawing information, the image information, and the position information, the direction information is displayed in association with each other, so that the photographing position and the photographing direction can be reflected and displayed on the drawing. This allows the user to more intuitively grasp the correspondence between the captured image, the capturing position, and the capturing direction.

According to the image display system described in Supplementary Note 3, an image is displayed based on the result of comparison of the strength of the radio waves in the first transmission means and the second transmission means partitioned by the radio wave shielding member and the transmission position information thereof. Therefore, it is possible to identify in which of the areas partitioned by the radio wave shielding member, the area on the side of the first transmitting means or the side of the second transmitting means, where the image was taken, and the accuracy of the position information can be improved.

According to the image display system described in appendix 4, the display position of the position icon can be moved based on the input from the user, so if the acquired position information is incorrect, it is possible to make minor corrections while checking the drawing. can be corrected to more accurate location information.

10 Mobile terminal 11 Touch pad 12 Display 13 Beacon radio wave receiver 14 Orientation acquisition unit 15 Camera 16 Communication unit 17 Control unit 17a Current position acquisition unit 17b Movement reception unit 18 Data recording unit 18a Image DB
18b Drawing DB
18c Origination position DB
20 beacon 21 first beacon 22 second beacon 30 radio wave shielding member R correction location S thumbnail

Claims (5)

An image display system for displaying images related to building construction, use, or maintenance,
a photographing means for obtaining image information by photographing;
a position obtaining means for obtaining position information specifying the position of the photographing means;
drawing information storage means for storing drawing information about the building;
image information relating to the construction, use, or maintenance of the building acquired by the photographing means ; and the position information acquired by the position acquisition means, wherein the image information is acquired by the photographing means. image information storage means for storing the position information related to the position of the
a display means,
When photographing is performed by the photographing means, the image information acquired by the photographing means, the position information acquired by the position acquisition means, and the drawing information stored in the drawing information storage means; are displayed in relation to each other, and
The image information stored in the image information storage means, the position information stored in the image information storage means, and the drawing information storage means when viewing the image information captured by the image capture means. and the display means for displaying the drawing information stored in the
The display means displays the position in the drawing indicated by the drawing information as the position information in both cases of photographing by the photographing means and viewing of the image information photographed by the photographing means. displaying a position icon indicating the position of the photographing means at a position corresponding to the information;
The image display system includes movement reception means for moving the display position of the position icon based on an input from a user regardless of whether or not the image capturing means has moved when the image capturing means is used to capture an image. ,
Image display system. transmitting means for transmitting radio waves, the transmitting means being installed at a plurality of locations in the building;
The position acquisition means acquires the position information based on radio waves transmitted by the transmission means,
The drawing information storage means stores the drawing information and transmitting means specifying information for uniquely specifying the transmitting means associated with the drawing information in association with each other,
When the image display system receives the radio wave transmitted by the transmission means, the display means transmits the radio wave received by the image display system, which is the drawing information stored in the drawing information storage means. displaying the drawing information associated with the transmitting means specifying information of the transmitting means that has been sent;
The image display system according to claim 1. The display means displays the construction, use, or displaying image information related to maintenance in the first area of the display means,
The display means displays the position icon and the drawing information stored in the drawing information storage means in both cases of photographing by the photographing means and viewing of the image information photographed by the photographing means . displaying the drawing information in a second area of the display means that is lower than the first area;
the first region and the second region do not overlap each other;
3. The image display system according to claim 1 or 2. The image information storage means stores a plurality of the image information,
When at least one piece of image information is selected from the plurality of pieces of image information stored in the image information storage unit, the display unit displays the selected at least one piece of image information as the displaying in a first area, and displaying in the second area the drawing information corresponding to the selected at least one piece of the image information among the drawing information stored in the drawing information storage means;
The image display system according to claim 3. An image display program for an image display system that displays images related to building construction, use, or maintenance,
the image display system,
a photographing means for obtaining image information by photographing;
a position obtaining means for obtaining position information specifying the position of the photographing means;
drawing information storage means for storing drawing information about the building;
image information relating to the construction, use, or maintenance of the building acquired by the photographing means ; and the position information acquired by the position acquisition means, wherein the image information is acquired by the photographing means. image information storage means for storing the position information related to the position of the
a display means,
When photographing is performed by the photographing means, the image information acquired by the photographing means, the position information acquired by the position acquisition means, and the drawing information stored in the drawing information storage means; are displayed in relation to each other, and
The image information stored in the image information storage means, the position information stored in the image information storage means, and the drawing information storage means when viewing the image information captured by the image capture means. function as the display means for displaying the drawing information stored in the
The display means displays the position in the drawing indicated by the drawing information as the position information in both cases of photographing by the photographing means and viewing of the image information photographed by the photographing means. displaying a position icon indicating the position of the photographing means at a position corresponding to the information;
The image display program is
The image display system functions as movement receiving means for moving the display position of the position icon based on an input from the user regardless of whether or not the photographing means has moved when photographing is performed by the photographing means. let
Image viewing program.

Images