JP2020095749A - Image display system and image display program - Google Patents

Abstract

To provide an image display system that is capable of reducing the possibility of an associating mistake between a drawing and an image, and reducing associating time and labor, and that enables a user to intuitively understand the captured image or a photographing position.SOLUTION: A portable terminal 10 is provided with: a camera 15; a current position acquisition unit 17a; an image DB 18a that stores image information that is about the construction, the use or the maintenance management of a building and has been acquired by the camera 15, and position information that is about the image information acquiring position of the camera 15 and has been acquired by the current position acquisition unit 17a in association with each other; a drawing DB 18b that stores drawing information about the building; and a display 12 that displays the drawing information stored in the drawing DB 18b and the image information and the position information stored in the image DB 18a in association with each other.SELECTED DRAWING: Figure 1

Description

The present invention relates to an image display system and an image display program.

Conventionally, in business such as construction, use, or maintenance of a building, data related to the business may be managed by a field notebook. For example, Patent Document 1 discloses a construction field notebook with a business card holder.

Here, for example, when performing repair work on a building (such as repairing a wall surface or cleaning stains), the site manager, etc. may photograph the correction location with a camera and instruct other workers etc. on the correction location. is there. Specifically, by printing the photographed photograph, filling in the instructions on the photograph, and writing the photographing position of the photograph on the spot (or remembering the photograph later) on the drawing notebook. , The instruction was given by associating the position of the drawing field notebook with the photograph.

JP, 11-227363, A

Here, in the working method as described above, since the worker confirms and enters the photographing position on the drawing field notebook, there is intervention of human work, and it takes time and labor, and a matching error (for example, a mistake is made). The photo is associated with the position) in some cases. In particular, when a large number of photographs are present, there is a possibility that the work of associating with the drawing field notebook requires a great deal of work and the occurrence rate of the association error becomes high. In addition, even for workers who actually check the drawing field notebook and perform corrective work, it is necessary to understand the correction location and the content of the correction while comparing the drawing field notebook with the photo, so the correspondence relationship between the photo and the shooting position It was difficult to grasp intuitively. Therefore, it is possible to reduce the possibility of making a mistake in associating the drawing field notebook with the photograph, reduce the time and effort required for associating the photograph field notebook, and further, to make the correspondence between the photograph and the shooting position intuitive to the user. There was a demand for a system that can be grasped by.

The present invention has been made in view of the above, and it is possible to reduce the possibility of making a mistake in associating a drawing such as the above drawing field notebook with an image such as the above photograph, and to reduce the time and effort required for the association. It is an object of the present invention to provide an image display system that can reduce the number of captured images and allow the user to intuitively recognize the captured image and the captured position.

In order to solve the above-mentioned problems and achieve the object, the image display system according to claim 1 is an image display system that displays an image related to the construction, use, or maintenance of a building, and Image capturing means for obtaining image information, position acquisition means for obtaining position information for specifying the position of the image capturing means, drawing information storage means for storing drawing information about the building, and the building obtained by the image capturing means Information relating to construction, use, or maintenance of, and position information obtained by the position obtaining means, the position information relating to the position where the image information was obtained by the photographing means, and the drawing information. Display means for displaying the drawing information stored in the storage means in association with each other, and the display means, as the position information, at a position corresponding to the position information in the drawing indicated by the drawing information. The image display system includes a movement reception unit that displays the position icon and moves the display position of the position icon based on an input from the user regardless of whether or not the photographing unit has moved.

The image display system according to claim 2 is the image display system according to claim 1, further comprising transmitting means for transmitting a radio wave, the transmitting means being installed at a plurality of locations in the building, The position acquisition means acquires the position information based on the radio wave transmitted by the transmission means, and the drawing information storage means uniquely identifies the drawing information and the transmission means associated with the drawing information. And transmitting means identifying information for storing the information are stored in association with each other, and the display means is stored in the drawing information storing means when the image display system receives a radio wave transmitted by the transmitting means. The drawing information relating to the drawing information associated with the sending means specifying information of the sending means that sent the radio wave received by the image display system is displayed.

The image display system according to claim 3 is the image display system according to claim 1 or 2, wherein the display means displays image information relating to construction, use, or maintenance of the building acquired by the imaging means. The display means displays the position icon and the drawing information stored in the drawing information storage means in a first area of the display means, which is a second area of the display means and is the first area. It is displayed in the second area below the first area and the first area and the second area do not overlap each other.

The image display system according to claim 4 is the image display system according to claim 3, wherein the image information storage means for storing a plurality of the image information and the display means are stored in the image information storage means. When at least one of the plurality of pieces of image information is selected, at least one of the selected pieces of image information is displayed in the first area and stored in the drawing information storage means. The drawing information corresponding to the selected at least one piece of the image information among the drawn drawing information is displayed in the second area.

The image display program according to claim 5 is an image display program for an image display system that displays an image related to construction, use, or maintenance of a building, and the image display system captures image information by capturing an image. Image capturing means, position acquiring means for acquiring position information for specifying the position of the image capturing means, image information on construction, use, or maintenance of the building acquired by the image capturing means, and the position acquiring means. Display means for displaying the position information acquired by the image capturing means in relation to the position information acquired by the image capturing means and the drawing information stored in the drawing information storage means in association with each other. The display means displays a position icon at a position corresponding to the position information in the drawing indicated by the drawing information, as the position information, the image display program, the image display system, It is caused to function as movement receiving means for moving the display position of the position icon based on the input from the user regardless of whether or not the photographing means has moved.

According to the image display system according to claim 1 and the image display program according to claim 5, image information on a building, image information on construction, use, or maintenance of the building acquired by the photographing means, Since the position information regarding the position where the image information is acquired by the image capturing means is displayed in association with each other, the captured image can be automatically displayed in association with the corresponding position on the drawing. It is possible to reduce the possibility of making a mistake in associating with, reduce the time and effort required for the associating, and further to let the user intuitively understand the correspondence between the captured image and the shooting position. it can. Further, since the display position of the position icon can be moved based on the input from the user, when the acquired position information is incorrect, it is possible to make minor corrections while checking the drawing, and it is possible to correct to more accurate position information. ..

It is a block diagram which shows functionally the portable terminal and beacon which concern on embodiment of this invention functionally. It is a figure which illustrates the information stored in image DB. It is a figure which illustrates the information stored in drawing DB. It is a figure which illustrates the information stored in the transmission position DB. It is a top view which shows the example of arrangement|positioning of a beacon. It is a figure which shows the example of a display of the display in the image display process which concerns on embodiment of this invention. It is a figure which shows the example of a display of the display which concerns on the modification with respect to embodiment of this invention.

Embodiments of an image display system according to the present invention will be described in detail below with reference to the accompanying drawings. First, the basic concept of the [I] embodiment will be described, then the specific contents of the [II] embodiment will be described, and finally, a modified example of the [III] embodiment will be described. However, the present invention is not limited to the embodiments.

[I] Basic Concept of Embodiment First, the basic concept of the embodiment will be described. The embodiment relates to an image display system that displays an image regarding construction, use, or maintenance of a building. Here, the “image relating to the construction, use, or maintenance of the building” is an image that is used by the site manager or workers when performing the construction, use, or maintenance of the building. In the above form, it is assumed that the image is used when constructing a building and is an image of a corrected portion of the building construction site. In addition, the "correction location" is a portion to be corrected in the building, for example, a location different from the design drawing, a spot, a stain, a defect, or the like. Further, the use of the image of the corrected portion is arbitrary, for example, in the present embodiment, the site manager who found the corrected portion by investigating the building, tells the worker the position of the corrected portion and the corrected portion. It is an image used for instructing specific contents. In the following, when it is not necessary to distinguish between the site manager and the workers, they are collectively referred to as “workers” in the description.

[II] Specific Content of Embodiment Next, specific content of the embodiment will be described.

(Constitution)
First, the configuration of the image display system according to the present embodiment will be described. FIG. 1 is a block diagram functionally and conceptually showing the mobile terminal 10 and the beacon 20 according to the present embodiment. Here, first, the outline of the mobile terminal 10 and the beacon 20 will be described. First, the "portable terminal" 10 is an image display system that displays an image related to construction, use, or maintenance of a building, and is, for example, a tablet PC below, but other devices (for example, a notebook computer). PC or smartphone) Then, the mobile terminal 10 can receive the radio wave from the beacon 20 and specify the current position of the mobile terminal 10 based on the radio wave intensity of the beacon 20. Next, the "beacon" 20 is a transmitting means for transmitting a radio wave. A plurality of the beacons 20 are arranged on the construction site by a worker, and only two beacons 20 are shown in FIG. 1, but each beacon 20 is similarly configured. When it is necessary to distinguish these two beacons 20 from each other, they are referred to as the “first beacon” 21 or the “second beacon” 22.

Next, details of the mobile terminal 10 and the beacon 20 will be described. First, as shown in FIG. 1, the mobile terminal 10 according to the present embodiment is functionally conceptually composed of a touch pad 11, a display 12, a beacon radio wave reception unit 13, an azimuth acquisition unit 14, a camera 15, a communication unit 16, and the like. The control unit 17 and the data recording unit 18 are provided.

(Structure-Mobile device-Touchpad)
The touch pad 11 is an operation unit that receives various operation inputs from the user when pressed by the user's finger or the like. Although the specific configuration of the touch pad 11 is arbitrary, for example, a publicly known one provided with an operation position detecting means of a resistance film type or an electrostatic capacitance type can be used.

(Structure-Mobile terminal-Display)
The display 12 is a display unit that displays various images. In addition, the display 12 is the image information on the construction, use, or maintenance of the building acquired by the camera 15, and the position information acquired by the current position acquisition unit 17a (described later). The position information regarding the position where the image information is acquired, the drawing information stored in the drawing database 18b (described later, the database is referred to as "DB" hereinafter), and the azimuth acquired by the azimuth acquisition unit 14. It is a display unit that displays information, which is associated with the azimuth information regarding the azimuth in which the image information was acquired by the camera 15, in association with each other. Although the specific configuration of the display 12 is arbitrary, for example, a known liquid crystal display 12 or a flat panel display such as an organic EL display can be used. The touch pad 11 and the display 12 may be integrally formed as a touch panel.

(Structure-Mobile device-Beacon radio wave receiver)
The beacon radio wave receiving unit 13 is a beacon radio wave receiving unit that receives the radio wave transmitted from the beacon 20. Although the specific type and configuration of the beacon radio wave reception unit 13 are arbitrary, for example, a known wireless communication means can be used.

(Structure-Mobile device-Direction acquisition unit)
The azimuth acquisition unit 14 is an azimuth acquisition unit that acquires azimuth information that specifies a photographic azimuth by the camera 15, and is, for example, a gyro compass, a magnetic compass, or an azimuth magnetic needle, but is not limited thereto.

(Structure-Mobile device-Camera)
The camera 15 is a photographing means for photographing and acquiring image information. Image information captured by the camera 15 is input to the control unit 17 and appropriately recorded in the data recording unit 18. It should be noted that the specific configuration of the camera 15 is arbitrary, and is configured using a known image pickup device such as a CMOS image sensor or a CCD image sensor, and a known optical system component such as a fisheye lens or a prism.

(Structure-Mobile terminal-Communication unit)
The communication unit 16 is a communication unit that performs communication with another mobile terminal 10 (not shown) via a network, and the specific type and configuration of the communication unit 16 are arbitrary, but, for example, publicly known Wireless communication means can be used.

(Structure-Mobile terminal-Control unit)
The control unit 17 is a control unit that controls the mobile terminal 10. Specifically, a CPU, various programs (including a basic control program such as an OS and an application program that is started on the OS and realizes a specific function) interpreted and executed on the CPU, and programs and various data A computer configured with an internal memory such as a RAM for storing. In particular, the image display program according to the present embodiment is installed in the mobile terminal 10 via an arbitrary recording medium or network to substantially configure each unit of the control unit 17. The “image display program” is an image display program that displays an image related to construction, use, or maintenance of a building, and includes a camera 15 that captures image information by a computer, and a camera 15 that captures image information. The current position acquisition unit 17a (which will be described later) that acquires the position information that specifies the position, the image information regarding the construction, use, or maintenance of the building acquired by the camera 15, and the current position acquisition unit 17a. It is an image display program that is position information and functions as a display 12 that displays the position information regarding the position where the image information is acquired by the camera 15 and the drawing information regarding the building in association with each other. Further, the “computer” is the mobile terminal 10 such as a tablet terminal in the present embodiment, but is not limited to this, and includes any device (for example, a laptop computer or a smartphone). Here, the control unit 17 is functionally and conceptually configured to include a current position acquisition unit 17a and a movement reception unit 17b.

The current position acquisition unit 17a is a position acquisition unit that acquires position information that specifies the position of the camera 15. The current position acquisition unit 17a also compares the intensity of the radio wave received from the first beacon 21 with the intensity of the radio wave received from the second beacon 22, and stores the comparison result in the transmission position DB 18c (described later). It is a position acquisition unit that acquires position information based on the generated transmission position information. In addition, in the present embodiment, the device is configured to acquire the position information based on the received radio wave from the beacon 20 received by the beacon radio wave reception unit 13 as described above, but the present invention is not limited to this and, for example, a sound wave receiver or the like. It may be a device that acquires position information by a GPS receiver or position information estimated by PDR technology that utilizes a gyro sensor or the like. A specific method for the current position acquisition unit 17a to acquire position information will be described later. The movement reception unit 17b is a movement reception unit that moves the display position of a position icon (described later) displayed on the display 12 based on an input from the user. Note that specific processing executed by each unit of these control units 17 will be described later.

(Structure-Mobile terminal-Data recording unit)
The data recording unit 18 is a recording unit that records programs and various data necessary for the operation of the mobile terminal 10, and is configured using, for example, a hard disk (not shown) as an external recording device. However, in place of or together with the hard disk, any other recording medium including a magnetic recording medium such as a magnetic disk or an optical recording medium such as a DVD or a Blu-ray disc can be used.

The data recording unit 18 includes an image DB 18a, a drawing DB 18b, and a transmission position DB 18c.

The image DB 18a is the image information on the construction, use, or maintenance of the building acquired by the camera 15, and the position information acquired by the current position acquisition unit 17a. The image information is acquired by the camera 15. The image storage means stores the position information related to the position in association with each other. FIG. 2 is a diagram exemplifying information stored in the image DB 18a. As shown in FIG. 2, the image DB 18a stores the item “image information”, the item “position information”, the item “direction information”, and the information corresponding to these items in association with each other.

Here, as the information corresponding to the item “image information”, image information (image data) regarding the construction, use, or maintenance of the building acquired by the camera 15 is stored. In FIG. 2, for convenience of illustration, only the data number and extension for uniquely identifying the image information are shown. Further, as the information corresponding to the item “position information”, the position information acquired by the current position acquisition unit 17a and the position information regarding the position where the image information is acquired by the camera 15 is stored. .. Specifically, when the camera 15 takes an image, the current position acquisition unit 17a acquires the position information (two-dimensional position coordinates in the figure) of the mobile terminal 10 by a known method, and acquires the position information. The position information is stored as information corresponding to the item. Further, as the information corresponding to the item “azimuth information”, the azimuth information for specifying the shooting azimuth by the camera 15 is stored. Specifically, when the image is taken by the camera 15, the azimuth acquisition unit 14 knows the azimuth of the image taken by the camera 15 (in the figure, the azimuth on the horizontal plane of the 360° type with the north as a reference of 0°). Method, and the acquired shooting direction is stored as information corresponding to the item.

Returning to FIG. 1, the drawing DB 18b is a drawing information storage unit that stores drawing information regarding a building. FIG. 3 is a diagram showing an example of information stored in the drawing DB 18b. As shown in FIG. 3, the drawing DB 18b correlates the item "drawing information", the item "area information", the item "floor", and the item "beacon ID" with the information corresponding to each of these items. Store.

Here, the information corresponding to the item “drawing information” is data of a drawing (hereinafter, referred to as “plan view”) representing a building, for example, in the following, the drawing data created by CAD, The present invention is not limited to this, and may be scan data obtained by scanning a printed drawing. In FIG. 3, for convenience of illustration, only the data number and extension for uniquely identifying the drawing data of the plan view are shown. Further, as the information corresponding to the item "area information", area information for specifying an area shown in the drawing is stored, and for example, a range of two-dimensional position coordinates is stored. In addition, as the information corresponding to the item “floor”, information specifying the floor of the plan view indicated by the drawing information is stored. For example, “M0001.jpeg” is a plan view of the first floor, and “M0002.jpeg” is a plan view of the second floor. As the information corresponding to the item "beacon ID", information for uniquely identifying the beacon 20 actually arranged in the area shown in the drawing is stored. For example, a total of 50 beacons 20 having beacon IDs "B0001" to "B0050" are arranged on the first floor of a building on the construction site, and beacon IDs "B0051" to "B0051" on the second floor of the building. It is assumed that a total of 50 beacons “B0100” are arranged.

Here, the timing for storing the information corresponding to each item is arbitrary, and for example, for the information corresponding to the item “drawing information”, the item “area information”, and the item “floor”, the mobile terminal 10 is connected via the Internet or the like. Downloaded and stored in advance. As for the information corresponding to the item “beacon ID”, when the worker installs the beacon 20 at an actual construction site, he/she operates the touch pad 11 to input the beacon ID of the beacon 20 installed by himself ( For example, the beacon ID is written on the surface of the beacon 20, and it may be input while viewing this notation. The specific procedure of this input will be described later.

Returning to FIG. 1, the transmission position DB 18c is a first beacon 21 and a second beacon 22 that emit radio waves, and the first beacon 21 arranged in one of the two spaces sandwiching the radio wave shielding member 30. , And the transmission position information indicating the transmission position information indicating the position of the second beacon 22 arranged in the other space of the two spaces sandwiching the radio wave shielding member 30. FIG. 4 is a diagram exemplifying information stored in the transmission position DB 18c. As shown in FIG. 4, the transmission position DB 18c stores the item “beacon ID”, the item “transmission position information”, and the information corresponding to these items in association with each other.

Here, as the information corresponding to the item “beacon ID”, information for uniquely identifying each beacon 20 is stored, and for example, beacon IDs such as “B0001” and “B0002” are stored. The information corresponding to the item “transmission position information” is the first beacon 21 (for example, the beacon 20 of B0001) and the second beacon 22 (for example, the beacon 20 of B0002) that emit radio waves, Positions of the first beacon 21 arranged in one of the two spaces sandwiching the member 30 and the second beacon 22 arranged in the other space of the two spaces sandwiching the radio wave shielding member 30 Is stored. For example, in the present embodiment, two-dimensional position coordinates for identifying the position of beacon 20 such as (X035, Y020) and (X035, Y025) are stored. Here, the timing of storing the information corresponding to this item “transmission position information” is arbitrary, and for example, when the worker installs the beacon 20 at an actual construction site, he or she operates the touch pad 11 to A beacon icon (described later) indicating the position of the installed beacon 20 may be moved to the installation position of the beacon 20 and the control unit 17 may automatically specify the position coordinates based on the position of this beacon icon. The specific procedure of such input will be described later.

(Configuration-Beacon)
Returning to FIG. 1, the beacon 20 is a transmitting means for transmitting a radio wave, and specifically, attaches a beacon ID for uniquely identifying itself to the radio wave and directs it in all directions around 360°. Emit radio waves. As described above, the beacon 20 is installed by the worker at a plurality of locations on the construction site. Of the plurality of beacons 20, the first beacon 21 and the second beacon 22 will be focused on and described below. The “first beacon” 21 is a first transmitting means for transmitting a radio wave, and is a first transmitting means arranged in one of the two spaces sandwiching the radio wave shielding member 30. Further, the “second beacon” 22 is a second transmitting means for transmitting a radio wave and is a second transmitting means arranged in the other space of the two spaces sandwiching the radio wave shielding member 30.

Here, the arrangement of beacons 20 according to the present embodiment will be described. FIG. 5 is a plan view showing an arrangement example of the beacon 20. Hereinafter, the X-X′ direction in each drawing will be referred to as “width direction”, the X direction will be referred to as “right direction”, and the X′ direction will be referred to as “left direction”, as necessary. The Y-Y' direction is referred to as the "depth direction", the Y direction is referred to as the "forward direction", and the Y'direction is referred to as the "rear direction". Moreover, the direction orthogonal to the XY plane is referred to as the “height direction”. As shown in FIG. 5, the beacons 20 are arranged at a plurality of locations in the building, for example, one in each room (room A and room B in FIG. 5) of the building. Further, it may be arranged at a plurality of locations at regular intervals in a wide area such as a passage.

Here, the arrangement of the beacon 20 will be described in more detail. As illustrated, in the present embodiment, the first beacon 21, the second beacon 22, and the radio wave shielding member 30 are arranged as a set. It should be noted that these are all arranged at substantially the same height (for example, a point 1 m from the floor).

The first beacon 21 is a first transmitter that emits a radio wave, and is a first transmitter that is arranged in one space (room A) of the two spaces (room A and passage) that sandwich the radio wave shielding member 30. It is a means, specifically, the beacon 20 arranged near the front wall in the room A. As described above, the first beacon 21 emits a radio wave in all directions around 360°, and the radio wave is attached with a beacon ID for identifying the first beacon 21 (second beacon 22). For the same to emit radio waves). The second beacon 22 is a second transmitting means for transmitting a radio wave, and is a second transmitting means arranged in the other space (passage) of the two spaces (the room A and the passage) sandwiching the radio wave shielding member 30. That is, specifically, the beacon 20 arranged near the rear wall in the passage.

The radio wave shielding member 30 is a radio wave shielding unit that shields radio waves, and is arranged between the first beacon 21 and the second beacon 22. Here, "blocking radio waves" means weakening at least the above-mentioned radio waves from one space to the other space (or radio waves from the other space to one space), and reflects, for example, radio waves. And absorbing radio waves. Note that “reflecting radio waves” specifically means that the radio wave shielding member 30 is made of a material that reflects radio waves, such as an aluminum plate, and “absorbing radio waves” means a member containing carbon. That is, the radio wave shielding member 30 is made of a material that absorbs radio waves such as. Further, "between the first beacon 21 and the second beacon 22" may be at least arranged on a straight line connecting the first beacon 21 and the second beacon 22, and the first beacon 21 and the second beacon 22 does not have to be in contact with. For example, in the present embodiment, the rear side surface of the radio wave shielding member 30 is in contact with the first beacon 21, and the front side surface of the radio wave shielding member 30 is in contact with the wall that partitions the room A (that is, the second beacon 22). Is not in direct contact with). Here, the shape and size of the radio wave shielding member 30 are arbitrary, but in the present embodiment, it is a square plate-like body in a front view, and has a width of 30 cm, a height of 30 cm, and a depth (thickness) of about 1 cm. It is the body.

By thus providing the radio wave blocking member 30 between the first beacon 21 and the second beacon 22, the radio field intensity on the room A side and the radio wave intensity on the aisle side can be made different. Specifically, first, radio waves have the characteristic of being attenuated in inverse proportion to the distance. In other words, radio waves transmitted with the same intensity from the same position are the same radio waves at any position. We can receive with strength. That is, when the radio wave blocking member 30 is not provided, for example, when the beacon 20 is placed at substantially the same position as the first beacon 21 and the second beacon 22 shown in FIG. 5, both the room A side and the aisle side are provided. The radio wave intensities from the first beacon 21 and the second beacon 22 are substantially the same at any position. However, by providing the radio wave blocking member 30 between the beacons 20 as in the present embodiment, the radio wave from the first beacon 21 toward the room A side (rearward direction or the like) is blocked by the radio wave blocking member 30. However, radio waves directed to the passage side (forward direction or the like) are blocked by the radio wave blocking member 30. Further, the radio wave directed from the second beacon 22 to the aisle side (front direction or the like) is not shielded by the radio wave shielding member 30, but the radio wave directed to the room A side (rear direction or the like) is transmitted to the radio wave shielding member 30. Shielded. Therefore, the radio wave intensity of the first beacon 21 is larger than that of the second beacon 22 in the room A, and the radio wave intensity of the second beacon 22 is larger than that of the first beacon 21 in the passage.

Then, the beacon radio wave reception unit 13 receives radio waves from a plurality of beacons 20 including the first beacon 21 and the second beacon 22, and the current position acquisition unit 17a, based on the received radio waves, for example, a known 1 The two-dimensional position coordinates of the current position are specified by the point positioning method or the three-point positioning method. Here, when the radio wave intensity from the first beacon 21 is larger than that of the second beacon 22, the current position acquisition unit 17a has a space where the current position is closer to the first beacon 21 than the radio wave shielding member 30 (that is, room A). If the radio wave intensity from the second beacon 22 is larger than that of the first beacon 21, the current position is the space on the second beacon 22 side of the radio wave shielding member 30 (that is, the passage side). Space). Therefore, it is possible to prevent the situation in which the room A is shown even though the current position is the passage, and it is possible to improve the accuracy of the current position.

(processing)
Subsequently, various processes executed by the mobile terminal 10 according to the present embodiment will be described.

(Processing-Beacon registration processing)
First, the beacon registration process executed by the control unit 17 of the mobile terminal 10 according to the present embodiment will be described. This beacon registration processing is roughly performed as a preparation for photographing a construction site, in which a worker goes around the construction site while holding the mobile terminal 10 and arranges the beacon 20 on the construction site. This is a process that is executed when information about the information is registered in the drawing DB 18b or the transmission position DB 18c with the touch pad 11 of the mobile terminal 10.

Specifically, first, the worker places the beacon 20 on the construction site. Then, the worker registers the beacon ID and the transmission position information of the beacon 20 arranged by himself/herself in the transmission position DB 18c of FIG. 4 by using the portable terminal 10 possessed by the worker. The specific method of this registration is arbitrary, and an example thereof will be described below.

First, the control unit 17 displays a beacon registration icon on the display 12, and when the operator presses this icon, the beacon registration mode is set. In this mode, first, the setting of the drawing for which the beacon 20 is to be registered is accepted. Specifically, the control unit 17 displays thumbnails of the drawing information stored corresponding to the item “drawing information” in the drawing DB 18b, and one of the thumbnails is selected by the worker (by tapping or the like). Then, the drawing information is displayed on the display 12. Further, a beacon icon indicating the position of the beacon 20 is displayed in the center of the screen. Then, the movement receiving unit 17b receives the movement of the display position of the beacon icon. Specifically, for example, when the pressing of an arrow-shaped beacon movement icon (not shown) displayed on the display 12 is accepted, the beacon icon may be accepted in the direction indicated by the arrow, or the beacon icon When a finger slide is received while the display position is pressed by the operator's finger, the beacon icon may be moved along the slide. Then, when the confirmation icon (not shown) is pressed while the beacon icon is moved to the position where the beacon 20 is installed, a window for receiving the input of the beacon ID is displayed. Then, the user inputs the beacon ID while confirming the beacon ID described in the beacon 20, and when the beacon ID is input, the transmission identified by a known method based on the beacon ID and the position of the beacon icon. The position information is stored in the transmission position DB 18c. Further, the beacon ID input as described above is stored in the information corresponding to the item "beacon ID" of the drawing to be registered in the drawing DB 18b of FIG. This completes the beacon registration process.

(Processing-Image display processing)
Next, the image display processing executed by the control unit 17 of the mobile terminal 10 according to the present embodiment will be described. The image display process is a process for displaying on the display 12 the drawing information stored in the drawing DB 18b and the image information, the position information, and the orientation information stored in the image DB 18a in association with each other. As the timing for performing such display, two patterns for photographing with the camera 15 and for reviewing the photographed image will be described below as examples, but the timing is not limited to this.

(Processing-Image display processing-When shooting with a camera)
First, the display on the display 12 when the camera 15 takes an image will be described. FIG. 6 is a diagram showing a display example of the display 12 in the image display processing according to the present embodiment. As shown in FIG. 6, the control unit 17 schematically displays an image taken by the camera 15 on the upper half of the display 12, a plan view on the lower half, and a position icon indicating the current position of the worker. A direction icon indicating the shooting direction of the camera 15 is displayed.

Specifically, first, when the worker activates the camera 15 by a known method (for example, by tapping the camera icon displayed on the display 12), the control unit 17 displays the image captured by the camera 15 in real time. Is displayed on the upper half of the display 12. Further, the control unit 17 identifies the drawing to be displayed with reference to the drawing DB 18b in FIG. 3 based on the beacon ID attached to the radio wave received from the beacon 20, and displays the drawing in the lower half of the display 12. For example, when the radio wave received by the beacon radio wave reception unit 13 has the beacon ID “B0001” or “B0002”, the corresponding drawing information in FIG. 3 is “M0001.jpeg”, so this drawing Display on the lower half of the display 12. Further, the control unit 17 displays the current position of the worker (that is, the current position of the mobile terminal 10) at the position corresponding to the drawing. For example, the current position acquisition unit 17a specifies the current position based on the strength of the radio wave from the beacon 20 as described above. Then, the control unit 17 displays the position icon at the position corresponding to the current position of the worker in the drawing. The display mode of this icon is arbitrary, but this embodiment is a circle icon. Further, since this position icon is displayed in real time, when the worker moves and the position of the mobile terminal 10 moves, the display position of the position icon also moves accordingly.

If the accuracy of the current position acquisition unit 17a is reduced due to some reason, the position icon may be displayed at the wrong position. In this case, the position icon is not displayed. The display position can be moved by the same method as the method of moving the display position of the beacon icon as described above. Specifically, the movement receiving unit 17b may receive the position icon in the direction indicated by the arrow when the pressing of the arrow-shaped current position movement icon (not shown) displayed on the display 12 is received, Alternatively, when the display position of the position icon is pressed by the operator's finger and the finger slide is accepted, the position icon may be moved along the slide.

Further, the control unit 17 specifies the azimuth of the camera 15 of the mobile terminal 10 and displays it on the display 12. Specifically, the azimuth acquisition unit 14 specifies the azimuth the camera 15 is facing by a known method using a gyro sensor or the like (for example, “260°”), and displays information on the specified azimuth on the display 12. .. This display mode is preferably a mode that is easily recognized by the user. For example, in the present embodiment, the fan-shaped azimuth icon is displayed so as to be superimposed on the position icon. The drawing itself may be rotated so that the facing direction matches the backward direction (Y' direction) on the drawing. Alternatively, the orientation icon may be displayed at a position different from the position icon. Further, since the direction icon is displayed in real time, when the worker changes the direction of the camera 15, the display of the direction icon also rotates accordingly. As described above, when the image is taken by the camera 15, the drawing information (plan view of the shooting position), the image information (the image captured by the camera 15), the position information (the position icon), and the direction information (the direction icon). ) Is integrally displayed in real time, so that the worker can perform shooting while grasping the shooting status of the camera 15.

Here, when the worker presses the shutter button (not shown) displayed on the display 12 with the camera 15 of the mobile terminal 10 pointing toward the correction point R, a captured image (upper part of FIG. 6) is displayed. Half the image) is stored as information corresponding to the item "image information" in the image DB 18a of FIG. At this time, the information corresponding to the item “position information” of the image DB 18a stores the position information regarding the current position specified by the current position acquisition unit 17a as described above, and the information corresponding to the item “direction information”. The information on the current azimuth specified by the azimuth acquisition unit 14 as described above is stored in the. Thus, the image information, the position information, and the orientation information are stored in the image DB 18a in association with each other. Then, the worker images the correction points R existing at various positions of the building by the camera 15 in the same manner, so that the plurality of image information and the position information and the azimuth information corresponding to the image information are imaged. It can be accumulated in the DB 18a.

In the above description, the image information, the position information, and the azimuth information are stored as separate information in the image DB 18a, but the present invention is not limited to this, and these may be stored in the image DB 18a as a unit. For example, the entire display example shown in FIG. 6 may be stored in the image DB 18a as one image (an image in which the upper half and the lower half are integrally captured).

(Processing-Image display processing-When reviewing captured images later)
Next, the display on the display 12 when the captured image is reviewed again will be described. At this time, the display contents are the same as when the image is taken by the camera 15 described above, and therefore the description will be given with reference to FIG. Specifically, first, for example, when an image browsing icon (not shown) that receives an image browsing request is pressed by a worker, the control unit 17 causes the image information stored in association with the item “image information” in the image DB 18a. Is displayed as a thumbnail (not shown) or the like, and when any of the thumbnails is selected by the worker (by tapping or the like), the image information is displayed on the upper half of the display 12 as shown in FIG. Further, the drawing corresponding to the selected image is displayed in the lower half. Specifically, the area of the two-dimensional position coordinates stored corresponding to the item “area information” in the drawing DB 18b of FIG. 3 is referred to, and the two-dimensional position coordinates of the photographing position of the selected image are included. The drawing is specified, and the specified drawing is displayed on the lower half of the display 12 as shown in FIG. Further, referring to the image DB 18a of FIG. 2, the position icon is displayed at the position indicated by the item "position information" corresponding to the selected image information, and the azimuth icon of the azimuth indicated by the item "direction information" is displayed. To do. Therefore, as shown in FIG. 6, the photographed image, the position icon, the azimuth icon, and the drawing can be associated with each other and can be integrally displayed, so that the worker can display the photographed image, the photographing position, and the photographing azimuth. The correspondence can be easily recognized.

Further, as described above, when the entire display example shown in FIG. 6 is stored as one image in the image DB 18a, the image may be displayed on the display 12. That is, since the captured image, the position icon, the azimuth icon, and the drawing are integrally displayed in the image, the worker visually recognizes the image, and the worker can recognize the captured image and the capturing position. It is possible to easily recognize the correspondence with the shooting direction.

The image DB 18a updated in this image display process, the drawing DB 18b and the transmission position DB 18c updated in the beacon registration process described above are shared with other mobile terminals 10 (not shown) via the communication unit 16. It is preferable to be possible. As a result, a plurality of workers can efficiently update the image DB 18a by taking images with the cameras 15 of the respective mobile terminals 10, and each worker can obtain image information stored by other workers. Since it is possible to confirm the information from the mobile terminal 10 of the user, the work efficiency can be improved. Above, the explanation of the image display processing is omitted.

(Effects of the embodiment)
As described above, according to the mobile terminal 10 of the present embodiment, the drawing information regarding the building, the image information regarding the construction, use, or maintenance of the building acquired by the camera 15, and the acquisition of the image information by the camera 15. Since the positional information on the performed position is displayed in association with each other, it is possible to automatically display the captured image in correspondence with the corresponding position on the drawing, which may cause an error in associating the drawing with the image. It is possible to reduce the nature of the problem, reduce the time and effort required for the association, and moreover, allow the user to intuitively understand the association between the captured image and the capturing position.

In addition to the drawing information, the image information, and the position information, the azimuth information is displayed in association with each other. Therefore, the shooting position and the shooting direction can be reflected and displayed on the drawing. The user can more intuitively understand the correspondence with the shooting direction.

Moreover, since the image is displayed based on the comparison result of the radio wave intensities of the first beacon 21 and the second beacon 22 divided by the radio wave shielding member 30, and the transmission position information thereof, the radio wave shielding member 30 divides the image. It is possible to specify which of the areas on the first beacon 21 side or the second beacon 22 side the image was taken in, and the accuracy of the position information can be improved.

Further, since the display position of the position icon can be moved based on the input from the user, when the acquired position information is incorrect, it is possible to make minor corrections while checking the drawing, and it is possible to correct to more accurate position information. ..

[III] Modifications to Embodiments Although the embodiments according to the present invention have been described above, the specific configurations and means of the present invention are within the scope of the technical idea of each invention described in the claims. In, it can be arbitrarily modified and improved. Hereinafter, such a modified example will be described.

(About problems to be solved and effects of the invention)
First, the problem to be solved by the invention and the effect of the invention are not limited to the above-mentioned contents, and may differ depending on the implementation environment of the invention and details of the configuration, and only a part of the above-mentioned problem May be solved or only a part of the effects described above may be achieved.

(About distribution and integration)
Further, each of the above-described electrical components is functionally conceptual, and does not necessarily have to be physically configured as illustrated. That is, the specific form of distribution and integration of each unit is not limited to that shown in the drawings, and all or a part of them may be functionally or physically distributed or integrated in arbitrary units according to various loads and usage conditions. Can be configured. For example, a management server (not shown) may include some of the functions provided in the mobile terminal 10 in the present embodiment. Specifically, for example, the plurality of mobile terminals 10 transmit data to the management server via the communication unit 15, and the management server records the received data in the recording unit (not shown) of the management server, thereby The data transmitted from the mobile terminal 10 may be integrated. Further, by transmitting the data thus accumulated to the respective mobile terminals 10, the respective mobile terminals 10 may be able to share the data.

(About dimensions and materials)
The dimensions, shapes, materials, ratios and the like of the image display system, the beacon 20, and the radio wave shielding member 30 described in the detailed description and drawings of the invention are merely examples, and other arbitrary dimensions, shapes, materials, It can be a ratio or the like.

(About position and direction)
In the present embodiment, as the position coordinates, the two-dimensional position coordinates are specified and stored and displayed, but the three-dimensional position coordinates added with the position in the height direction may be stored and displayed. For example, the drawing DB 18b stores height position coordinates (for example, (Z010) for the first floor and (Z020) for the second floor) corresponding to each drawing, and based on the height position coordinates. May be specified. Further, as the azimuth, the azimuth on the XY plane is stored and displayed, but the inclination of the camera 15 in the height direction is provided by providing a known inclination sensor (not shown) for specifying the inclination of the mobile terminal 10. May be specified and stored and displayed.

(Display example)
In the present embodiment, when the photographed image is reviewed later, the drawing information, the image information, and the position information are displayed in association with each other as image information in the upper half of the display 12 and drawing information in the lower half. Although the position information is displayed, the display mode is not limited to this. FIG. 7 is a diagram showing a display example of the display 12 according to a modified example of this embodiment. As shown in FIG. 7, the drawing information, the image information, and the position information may be integrally displayed on the entire display 12. Specifically, first, for example, when a worker presses a drawing browsing icon (not shown) that receives a drawing browsing request, the control unit 17 causes the drawing information stored corresponding to the item “drawing information” in the map DB. Is displayed as a thumbnail S or the like, and when any one of the thumbnails S is selected by a worker (by tapping or the like), the drawing information is displayed on the lower half of the display 12 (obviously displayed on the entire display 12). It doesn't matter). Further, based on the information stored corresponding to the item “image information” and the item “positional information” of the image DB 18a, the thumbnail S of the image information is displayed at the position where the selected image was captured. In this way, the drawing information, the image information, and the position information may be displayed in association with each other. In addition to this, orientation information may be displayed on the drawing. Further, when the worker taps the thumbnail S, a display of a drawing in which the thumbnail S is enlarged or a display shown in FIG. 6 (image information is displayed in the upper half of the display 12, and drawing information and position information is displayed in the lower half) Do not mind.

(Appendix)
The image display system according to attachment 1 is an image display system that displays an image relating to construction, use, or maintenance of a building, and specifies a photographing means for photographing and acquiring image information and a position of the photographing means. Position acquisition means for acquiring position information, drawing information storage means for storing drawing information on the building, image information on construction, use, or maintenance of the building acquired by the imaging means, and the position acquisition means And the drawing information stored in the drawing information storage means are displayed in association with each other. Display means.

The image display system according to attachment 2 is the image display system according to attachment 1, which further comprises azimuth obtaining means for obtaining azimuth information for identifying the azimuth taken by the photographing means, and the display means is obtained by the photographing means. Image information relating to construction, use, or maintenance of the building, and position information obtained by the position obtaining means, and position information relating to a position at which the image information was obtained by the photographing means, and The drawing information stored in the drawing information storage means and the azimuth information acquired by the azimuth acquisition means, which is the azimuth information regarding the azimuth for which the image information was acquired by the imaging means, are associated with each other. To display.

The image display system according to attachment 3 is the image display system according to attachment 1 or 2, which is a first transmitting means and a second transmitting means for transmitting a radio wave, and is one of two spaces sandwiching a radio wave shielding member. A transmission position that stores transmission position information indicating the positions of the first transmission unit arranged in the space and the second transmission unit arranged in the other space of the two spaces sandwiching the radio wave shielding member. A storage means, wherein the position acquisition means compares the strength of the radio wave received from the first transmission means with the strength of the radio wave received from the second transmission means, and the comparison result and the transmission position storage means The position information is acquired based on the transmission position information stored in.

The image display system according to supplementary note 4 is the image display system according to any one of supplementary notes 1 to 3, wherein the display means sets the position information at a position corresponding to the position information in the drawing indicated by the drawing information. The image display system includes a movement reception unit that displays the position icon and moves the display position of the position icon based on an input from the user.

The image display program of Supplementary Note 5 is an image display program for displaying an image relating to the construction, use, or maintenance of a building, and a photographing means for photographing a computer to obtain image information, and a position of the photographing means. Position acquisition means for acquiring position information for identifying, construction of the building acquired by the imaging means, use, or image information related to maintenance, and position information acquired by the position acquisition means, The display unit causes the position information regarding the position where the image information is acquired by the image capturing unit and the drawing information stored in the drawing information storage unit to be displayed in association with each other.

(Effect of notes)
According to the image display system described in Supplementary Note 1 and the image display program described in Supplementary Note 5, the drawing information regarding the building, the image information regarding construction, use, or maintenance of the building acquired by the photographing means, and the photographing means. Since the position information regarding the position where the image information is acquired is displayed in association with each other, the captured image can be automatically displayed in association with the corresponding position on the drawing. It is possible to reduce the possibility that an association error will occur, reduce the time and effort required for association, and moreover, allow the user to intuitively understand the association relationship between the captured image and the capturing position.

According to the image display system described in appendix 2, in addition to the drawing information, the image information, and the position information, the azimuth information is displayed in association with each other. Therefore, the shooting position and the shooting azimuth are reflected and displayed on the drawing. Therefore, the user can more intuitively understand the correspondence relationship between the photographed image, the photographing position, and the photographing direction.

According to the image display system described in appendix 3, an image is displayed based on the comparison result of the radio wave intensities of the first transmission means and the second transmission means partitioned by the radio wave shielding member, and these transmission position information. Therefore, it is possible to specify which of the first transmitting unit side and the second transmitting unit side the image capturing is performed in the region divided by the radio wave shielding member, and the accuracy of the position information can be improved.

According to the image display system described in appendix 4, the display position of the position icon can be moved based on the input from the user. Therefore, when the acquired position information is incorrect, it is possible to make minor corrections while checking the drawing. Yes, it can be corrected to more accurate position information.

10 Mobile Terminal 11 Touch Pad 12 Display 13 Beacon Radio Wave Receiving Section 14 Direction Acquisition Section 15 Camera 16 Communication Section 17 Control Section 17a Current Position Acquisition Section 17b Movement Receiving Section 18 Data Recording Section 18a Image DB
18b Drawing DB
18c Originating position DB
20 Beacon 21 1st Beacon 22 2nd Beacon 30 Radio wave shielding member R Corrected location S Thumbnail

Claims (5)

An image display system for displaying an image of construction, use, or maintenance of a building,
A photographing means for photographing and acquiring image information,
A position acquisition unit that acquires position information that specifies the position of the image capturing unit;
Drawing information storage means for storing drawing information about the building,
The image information relating to construction, use, or maintenance of the building acquired by the image capturing unit and the position information acquired by the position acquiring unit, and the image information was acquired by the image capturing unit. Display means for displaying the positional information on the position and the drawing information stored in the drawing information storage means in association with each other,
The display means, as the position information, displays a position icon at a position corresponding to the position information in the drawing indicated by the drawing information,
The image display system includes a movement reception unit that moves the display position of the position icon based on an input from the user regardless of whether the photographing unit has moved.
Image display system. A transmitting means for transmitting an electric wave, comprising: the transmitting means installed in a plurality of places of the building,
The position acquisition unit acquires the position information based on the radio wave transmitted by the transmission unit,
The drawing information storage means stores the drawing information and sending means specifying information for uniquely specifying the sending means associated with the drawing information in association with each other,
When the image display system receives the radio wave transmitted by the transmitting unit, the display unit transmits the radio wave received by the image display system, which is the drawing information stored in the drawing information storage unit. Displaying the drawing information associated with the transmitting means specifying information of the transmitting means,
The image display system according to claim 1. The display means displays image information relating to construction, use, or maintenance of the building acquired by the imaging means in a first area of the display means,
The display means displays the position icon and the drawing information stored in the drawing information storage means in a second area of the display means, which is lower than the first area. Then
The first region and the second region do not overlap each other,
The image display system according to claim 1. Image information storage means for storing a plurality of the image information,
The display means, when at least one of the plurality of pieces of image information stored in the image information storage means is selected, displays the selected at least one piece of the image information. Displaying the drawing information corresponding to the selected at least one image information among the drawing information stored in the drawing information storage means in the second area,
The image display system according to claim 3. An image display program for an image display system for displaying an image relating to construction, use, or maintenance of a building,
The image display system,
A photographing means for photographing and acquiring image information,
A position acquisition unit that acquires position information that specifies the position of the image capturing unit;
The image information relating to construction, use, or maintenance of the building acquired by the image capturing unit and the position information acquired by the position acquiring unit, and the image information was acquired by the image capturing unit. Position information relating to the position and drawing information stored in the drawing information storage means, and a display means for displaying them in association with each other,
The display means, as the position information, displays a position icon at a position corresponding to the position information in the drawing indicated by the drawing information,
The image display program is
Causing the image display system to function as movement receiving means for moving the display position of the position icon based on an input from the user regardless of whether or not the photographing means has moved.
Image display program.

Images