JP7329823B2 - Building equipment display system, terminal device, building equipment display method and program - Google Patents

Description

The present invention relates to a building equipment display system, a terminal device and a program.

For example, Patent Document 1 discloses a piping drawing system that creates a piping diagram by arranging equipment icons and piping lines on a grid diagram displayed on a screen. , a pipe line cursor of a certain length will be displayed along each grid line radially from that intersection point, and any of the displayed pipe line cursors will be displayed. A piping drawing system is disclosed in which a piping line from a start point to an end point is drawn by setting an end point at a position.

JP 2011-90355 A

By the way, conventionally, when designing building facilities in a building, a drawing regarding the layout of the building facilities is created using, for example, a stationary PC terminal. At the construction site, the user compares, for example, the printed paper drawing and the actual building, and imagines the layout of the building equipment in the building. In this case, the image of the layout of the building equipment based on the paper drawing is left to the user. Also, even if you have an image of the layout of the building equipment in the actual building, if you want to change the layout of the building equipment, you can recreate the drawing on the PC terminal and print the created drawing. It was necessary to output and compare the actual building and the drawing again, which was time-consuming.

SUMMARY OF THE INVENTION An object of the present invention is to facilitate the preparation of drawings relating to the arrangement of building equipment in a building and the comparison of the prepared drawings with the actual building.

Based on this object, one invention is provided with a photographing means for photographing a building, a display means for displaying an image on a display screen, and a facility image showing the building facilities for the building image corresponding to the building. Receiving means for receiving a display of the arranged layout drawing from the user in a receiving image displayed on the display screen; a control means for performing control to display on a display screen a superimposed image obtained by superimposing the equipment image on the photographed image of the building photographed by the means, wherein the control means controls the display screen on which the layout plan is displayed. A building equipment display system characterized by displaying, on a display screen, estimate information relating to an estimate for construction of building equipment created based on a layout drawing in accordance with a user's operation on a third instruction image displayed in the is.
Further, one invention is provided with a photographing means for photographing a building, a display means for displaying an image on a display screen, and an arrangement in which a facility image representing a building facility is arranged with respect to the building image corresponding to the building. Receiving means for receiving the display of the drawing from the user in the reception image displayed on the display screen; a control means for controlling to display on a display screen a superimposed image obtained by superimposing the equipment image on the photographed image of the building, wherein the control means controls the movement of the display screen when the photographed image displayed on the display screen is displayed on the display screen. , the superimposed image is displayed by causing the facility image to follow the photographed image, and the reception means sets the reference for starting movement of the display screen by the user in the reception image on which the layout drawing is displayed. , and the control means displays the superimposed image based on the setting of a plurality of different standards.
Further, one invention is provided with a photographing means for photographing a building, a display means for displaying an image on a display screen, and an arrangement in which a facility image representing a building facility is arranged with respect to the building image corresponding to the building. Receiving means for receiving the display of the drawing from the user in the reception image displayed on the display screen; a control means for performing control to display on a display screen a superimposed image obtained by superimposing the equipment image on the photographed image of the building, and the receiving means is a facility penetrating the boundary part constituting the boundary in the building. The building equipment display system is characterized by receiving a setting of an image layout from a user.

Advantageous Effects of Invention According to the present invention, it is possible to easily create a drawing regarding the layout of building equipment in a building and compare the created drawing with the actual building.

1 is an overall view of a building facility display system according to this embodiment; FIG. BRIEF DESCRIPTION OF THE DRAWINGS It is explanatory drawing of the outline|summary of the building installation display system of this embodiment. It is a functional block diagram of the terminal device of this embodiment. It is a functional block diagram of the management server apparatus of this embodiment. It is an example of a facility information management table managed by the management server device. 3 is a functional block diagram of a layout drawing creation unit of the terminal device of the present embodiment; FIG. FIG. 4 is an explanatory diagram of a reception screen according to the embodiment; FIG. 4 is an explanatory diagram of a reception screen according to the embodiment; FIG. 3 is an explanatory diagram of a layer structure of a boundary image according to the embodiment; It is a figure which shows the functional block of the AR display part of this embodiment. FIG. 4 is an explanatory diagram of AR display by the AR display unit of the embodiment; FIG. 4 is an explanatory diagram of a follow-up operation in AR display according to the embodiment; FIG. 10 is an explanatory diagram of a button image displayed on a display screen on which AR display is performed; FIG. 4 is a flow diagram of the operation of the AR display section of the embodiment; It is a functional block of the estimate preparation part of this embodiment. It is an example of the estimate image which the estimate preparation part of this embodiment displays on a display screen. It is an example of a three-dimensional layout map displayed based on a layout map created in advance. It is an example of a two-dimensional layout map displayed based on a layout map created in advance. It is an example of a two-dimensional layout map displayed based on a layout map created in advance. It is an example of a two-dimensional layout map displayed based on a layout map created in advance.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments for carrying out the present invention will be described with reference to the accompanying drawings.

<Building equipment display system 1>
FIG. 1 is an overall view of a building facility display system 1 of this embodiment.
As shown in FIG. 1, the building facility display system 1 of the present embodiment includes a terminal device 10 that supports the design of building facilities in a building, and a management server device that manages information on building facilities handled by the terminal device 10. 20 and.

In the building equipment display system 1 of the present embodiment, the terminal device 10 and the management server device 20 are capable of mutual information communication via a network. Note that the network is not particularly limited as long as it is a communication network used for data communication between devices, and may be, for example, a LAN (Local Area Network), a WAN (Wide Area Network), the Internet, or the like. The communication line used for data communication may be wired or wireless, and both may be used.

The building equipment display system 1 of the present embodiment includes pipes through which liquids such as clean water and sewage and liquids such as refrigerants of air conditioning equipment flow, indoor units of air conditioning equipment installed indoors, and outdoor air conditioning equipment installed outdoors. It can be applied to the design of building facilities such as machines.
Note that the building facility display system 1 of the present embodiment is not limited to water pipes and sewer pipes, and is applicable to building facilities such as gas pipes through which gas such as gas flows, electric wire conduits through which electrical wiring and the like are passed. can also be applied. The building facility display system 1 of the present embodiment can also be applied to telecommunication-related facilities and gas-related facilities.

Here, an overview of the building equipment display system 1 of the present embodiment will be described.
FIG. 2 is an explanatory diagram of the outline of the building equipment display system 1 of this embodiment.
As shown in FIG. 2(1), the user uses the display screen 11D of the terminal device 10 to design building equipment to be installed in the building. In this embodiment, the building equipment is designed by the user arranging the equipment image 75 on the reception screen 400 displayed on the display screen 11D. As described above, in the building facility display system 1 of the present embodiment, the building facility can be designed by the user's tap operation on the display screen 11D as if it were a sketch.
Further, as shown in FIG. 2(2), in the terminal device 10, a layout drawing 71 of building facilities is created based on the design of the building facilities by the user. In the description of this embodiment, creating the layout drawing 71 of the building equipment is referred to as "layout drawing creation".

Then, as shown in FIG. 2C, the terminal device 10 displays, on the display screen 11D, a superimposed image 800 in which the facility image 75 is superimposed on the photographed image 120 of the building to be designed. . Here, the facility image 75 and the captured image 120 of the actual building are associated with each other in positional relationship. Then, in the terminal device 10, when the captured image 120 changes by moving the display screen 11D, the equipment image 75 follows the changed captured image 120, and the display direction of the equipment image 75 changes. In the description of the present embodiment, superimposing and displaying the equipment image 75 and the photographed image 120 is referred to as "augmented reality (AR) display." Here, Augmented Reality (AR) means adding information such as graphics and characters to an image of an actual landscape, thereby expanding the world seen by the user.

After that, as shown in FIG. 2(4), the terminal device 10 displays an estimate image 850 (an example of estimate information) showing an estimate amount for construction of building facilities based on the designed building facility layout drawing 71. create. Then, the terminal device 10 displays the created estimate image 850 on the display screen 11D. In the description of the present embodiment, creating the estimate image 850 and displaying it on the display screen 11D is called "estimate creation".

In addition, in the building equipment display system 1 of the present embodiment, "layout drawing creation", "AR display", and "estimate creation" are mutually linked. Therefore, the user can repeat the simulation on the terminal device 10 any number of times, such as redoing the placement of the building facilities based on the result of the AR display, or redoing the placement of the building facilities based on the result of the estimated amount. can. In particular, in the building facility display system 1 of the present embodiment, the user can collectively perform a series of operations such as layout drawing creation, AR display, and estimate creation on the display screen 11D.
Hereinafter, each component of the building equipment display system 1 described above will be described in detail.

[Terminal device 10]
FIG. 3 is a functional block diagram of the terminal device 10 of this embodiment.

As shown in FIG. 1, a terminal device 10 (an example of a display unit) can be a device that can be carried by a user, such as a tablet terminal or a portable terminal device such as a mobile phone such as a smart phone. . The terminal device 10 of the present embodiment has a touch panel unit 11 that displays images and receives user operations, and a camera 12 that takes pictures. The terminal device 10 also has a communication device (not shown) that receives information from other devices such as the management server device 20 and transmits information to other devices.
The touch panel unit 11 receives an operation or an instruction from the user on the image displayed on the display screen 11D by performing a touch operation on the display screen 11D by the user.

A camera 12 (an example of a photographing unit) is provided on the surface of the terminal device 10 opposite to the touch panel section 11 . Then, the camera 12 displays the captured image 120 on the touch panel section 11 . The terminal device 10 of the present embodiment is held and used by a user with the user (user's face) directly facing the display screen 11D of the touch panel section 11 . In this case, the shooting direction of the camera 12 of the terminal device 10 is the same as the direction in which the user's face faces (the user's line of sight). The captured image 120 displayed on the display screen 11D and the scenery seen by the user are the same.

Further, as shown in FIG. 3, the terminal device 10 includes a layout drawing creation unit 30 (an example of receiving means) that creates a layout drawing 71, and an image of building equipment based on the created layout drawing 71 as a photographed image 120. It is provided with an augmented reality (AR) display unit 40 (an example of control means) that is superimposed and shown to the user, and an estimate creation unit 50 that creates estimate information based on the created layout drawing 71 .

[Management server device 20]
FIG. 4 is a functional block diagram of the management server device 20 of this embodiment.
FIG. 5 is an example of the facility information management table 210 managed by the management server device 20. As shown in FIG.

As shown in FIG. 4, the management server device 20 includes a building facility database (DB) section 21 that stores information about building facilities used in the layout drawing creation section 30, and a layout drawing 71 created by the terminal device 10. A layout drawing storage unit 22 for storing information and a working drawing creation unit 23 for creating a working drawing used as a working drawing based on the layout drawing 71 are provided.

(Building facility DB unit 21)
The building facility DB unit 21 stores a facility information management table 210 that manages information on multiple types of building facilities. As shown in FIG. 5, the facility information management table 210 includes a "facility ID" that can identify building facilities, a "name" that is a specific name provided for each building facility, and a layout drawing 71. It has items of "facility image ID" for specifying the facility image 75 to be installed, "unit price" which is the price set for each building facility, and "product information" which indicates detailed information of the building facility.

For example, in the case of an indoor unit of an air conditioner as an example of building equipment, for "equipment ID": AC001, "name": air conditioner indoor unit, "equipment image ID": ac001. jpg, “unit price”: ¥200,000, and “product information”: URL001 are associated with each other. "Product information" stores address information for accessing a database in which product information is stored. Further, the product information includes detailed product information such as product images and blueprints of building equipment, model numbers of building equipment, manufacturer information of building equipment, and specifications of building equipment (such as dimensions and service life).

The building facility DB 21 transmits the contents of the facility information management table 210 to the terminal device 10 based on the request from the terminal device 10 . In addition, the building facility DB 21 manages the facility information management table 210 based on, for example, unit price settings and settings such as addition and deletion of facility images 75 received from the administrative user.

(Layout plan storage unit 22)
The layout drawing storage unit 22 acquires the information of the layout drawing 71 created by the terminal device 10 . Then, the layout plan storage unit 22 stores the acquired information of the layout plan 71 . In addition, the layout drawing storage unit 22 transmits the stored information of the layout drawing 71 to the terminal device 10 in response to a request from the terminal device 10 .

(Working drawing creation unit 23)
The construction drawing creation unit 23 acquires the information of the layout drawing 71 from the layout drawing storage unit 22 . Then, the working drawing creation unit 23 creates working drawings of the building based on the acquired layout drawing 71 . The construction drawing can use, for example, a CAD (Computer-aided Design) drawing format, and is a more detailed drawing than the layout drawing 71 in this embodiment. Then, the working drawing creation unit 23 transmits the information of the created working drawing to the requested destination. For example, the working drawing creation unit 23 can transmit information on the created working drawing to the terminal device 10, a printing device, and further to another device.

Next, each functional configuration in the terminal device 10 of this embodiment will be described in detail.
(Layout drawing creation unit 30)
FIG. 6 is a functional block diagram of the layout drawing creation unit 30 of the terminal device 10 of this embodiment.
7 and 8 are explanatory diagrams of the reception screen 400 of this embodiment.

As shown in FIG. 6 , the layout drawing creation unit 30 includes a facility information acquisition unit 31 that acquires information on building facilities, a reception screen display unit 32 that accepts an operation related to creation of a layout drawing 71 from the user, and a created layout drawing. and a layout management unit 33 that manages FIG.

The facility information acquisition unit 31 acquires the facility information management table 210 (see FIG. 5) from the management server device 20 . Then, the facility information acquisition unit 31 acquires information on building facilities stored in the facility information management table 210 . Furthermore, the facility information acquisition unit 31 sends the acquired information on the building facilities to the reception screen display unit 32 .

The reception screen display unit 32 draws the layout drawing 71 created by the user's operation on the display screen 11D. In this embodiment, the reception screen display unit 32 draws a three-dimensional layout 71 (hereinafter referred to as a three-dimensional layout 713), or two-dimensionally displayed layout 71 (two-dimensional layout). 712).

The layout management unit 33 manages the information of the layout 71 created by the user on the reception screen 400 described above. Specifically, the layout management unit 33 stores the boundary image 73 and the arrangement of the equipment images 75 in the boundary image 73 for each generated layout 71 .
In response to a request from the reception screen display section 32 , the layout management section 33 passes the information of the stored layout drawing 71 to the reception screen display section 32 . The layout management unit 33 also sends the stored information of the layout 71 to the AR display unit 40 and the estimate creation unit 50 . Further, the layout management unit 33 transmits the information of the layout 71 to the management server device 20 .

Next, the reception screen display unit 32 will be described in detail.
As shown in FIG. 7, the reception screen display unit 32 of the present embodiment displays a boundary image 73 indicating a boundary surface that partitions a space in a building, and an equipment image 75 indicating building equipment set in the building. 11D.
Then, the reception screen display unit 32 of the present embodiment displays the three-dimensional layout diagram 713 as a bird's-eye view. The 3D layout map 713 includes a 3D boundary image 733 that is the boundary image 73 that is displayed in 3D, and a 3D facility image 753 that is the facility image 75 that is displayed in 3D.

A three-dimensional boundary image 733 (an example of a building image) is an image showing a design space corresponding to an actual building in which the user arranges building equipment. The three-dimensional boundary image 733 is created based on numerical information regarding the size of the actual building received from the user. The three-dimensional boundary image 733 also includes an inner surface 73N representing the inner surface of the room space and an outer surface 73G representing the outer surface of the room space. The inner surface 73N and the outer surface 73G are formed for the vertically lower floor in the room space, the vertically upper ceiling in the room space, and the four horizontal walls, respectively. The space between the inner surface 73N and the outer surface 73G is the thick portion (inside) of each of the ceiling, floor, and wall.

In the description of the present embodiment, the ceiling, floor, and walls that constitute the boundaries between adjacent room spaces and the outside in a building are referred to as "boundaries" unless otherwise distinguished. explain.

The 3D facility image 753 is displayed based on the layout of the 2D facility image 752 arranged by the user in the 2D layout diagram 712, as will be described later. In this embodiment, the 3D facility image 753 cannot be edited in the 3D layout drawing 713 . However, the 3D equipment image 753 of the 3D layout drawing 713 may be edited.

Furthermore, when receiving a user's slide operation on the three-dimensional layout drawing 713 on the display screen 11D, the reception screen display unit 32 rotates the three-dimensional layout drawing 713 in any direction up, down, left, or right. Further, the reception screen display unit 32 enlarges and displays the three-dimensional layout diagram 713 when it receives a user's pinch-out operation on the three-dimensional layout diagram 713 on the display screen 11D, and when it receives a pinch-in operation on the display screen 11D. The dimension layout map 713 is reduced and displayed.

Further, as shown in FIGS. 8A and 8B, the reception screen display unit 32 of the present embodiment displays a two-dimensional layout diagram 712 in plan view. The two-dimensional layout map 712 includes a two-dimensional boundary image 732, which is the boundary image 73 displayed two-dimensionally, and a two-dimensional equipment image 752, which is the equipment image 75 displayed two-dimensionally.

The 2D layout map 712 is displayed on the display screen 11D in response to the user's touch operation on the 3D layout map 713 . That is, when the reception screen display unit 32 receives the user's tap operation on one boundary (wall, ceiling, floor) in the three-dimensional layout diagram 713 (see FIG. 7), the tap operation is performed. A two-dimensional layout diagram 712 of the other boundary is displayed on the display screen 11D. In this case, the reception screen display unit 32 does not display on the display screen 11D the two-dimensional layout diagram 712 of the other boundary portion where the tap operation was not performed.

Further, when the user performs a tap operation on the three-dimensional layout diagram 713, the reception screen display unit 32 displays the inner surface 73N side of the one boundary where the tap operation is performed as shown in FIG. 712 is displayed on the reception screen 400 . A two-dimensional layout diagram 712 showing the inner surface 73N side includes a two-dimensional boundary image 732 when the two-dimensional layout diagram 712 is viewed from the inner surface 73N side, and a two-dimensional boundary image 732 arranged on the inner surface 73N of the two-dimensional boundary image 732. A facility image 752 is displayed.

Here, in a building, building facilities are mainly provided inside the room space. In addition, the inside of the room space greatly affects the interior decoration of the room space. Therefore, the reception screen display unit 32 of the present embodiment preferentially displays the two-dimensional layout diagram 712 showing the inner surface 73N of the boundary portion on the reception screen 400 over the outer surface 73G in accordance with the tap operation on the three-dimensional layout diagram 713. It is displayed so that the user can perform the placement work first from the facility image 75 on the inner surface 73N of the boundary portion.

The reception screen display unit 32 also displays the grid 91 on the two-dimensional boundary image 732 . The grid 91 is displayed by arranging a plurality of lines in a grid pattern. The grid 91 allows the two-dimensional facility images 752, which are linear building facilities such as piping, to be arranged only along lines. Also, the grid 91 can be arranged so that the center of the two-dimensional facility image 752, which is a rectangular building facility such as facility equipment, lies on the intersection of the lines. Thus, in this embodiment, the layout of the two-dimensional equipment image 752 is designated to some extent by the grid 91 . As a result, in this embodiment, the user can easily install the two-dimensional facility image 752 or connect facilities by tapping the display screen 11D.

Then, the reception screen display unit 32 receives the layout of the two-dimensional facility image 752 with respect to the two-dimensional boundary image 732 from the user. The reception screen display unit 32 draws a two-dimensional layout drawing 712 based on the layout of the two-dimensional equipment image 752 received from the user. Further, the reception screen display unit 32 reflects the layout of the two-dimensional equipment image 752 in the two-dimensional layout diagram 712 in the three-dimensional layout diagram 713 . Further, the reception screen display unit 32 sends the information of the updated three-dimensional layout drawing 713 to the layout drawing management unit 33 .

When receiving a user's slide operation on the two-dimensional layout drawing 712 displayed on the display screen 11D, the reception screen display unit 32 displays the two-dimensional layout drawing 712 to move in any direction up, down, left, or right. Furthermore, when receiving a user's pinch-out operation on the two-dimensional layout diagram 712 displayed on the display screen 11D, the reception screen display unit 32 enlarges and displays the two-dimensional layout diagram 712, and when receiving a pinch-in operation, The two-dimensional layout map 712 is reduced and displayed.

Next, the operation button images displayed on the reception screen 400 with the three-dimensional layout drawing 713 displayed will be specifically described.
As shown in FIG. 7, the reception screen display unit 32 displays a new creation button 611, a read button 612, and a save button 613 on the reception screen 400 on which a three-dimensional layout drawing 713 is displayed.

The new creation button 611 is a button image that accepts a user's selection operation when creating a new layout drawing 71 of building equipment in a building. When the new creation button 611 is selected, the reception screen display unit 32 requests the user to set the room space of the building displayed as the three-dimensional boundary image 733 . Specifically, when receiving a selection operation of the new creation button 611, the reception screen display unit 32 receives input from the user of the size of the room space, that is, the distance of each boundary and the thickness of the boundary. Then, reception screen display unit 32 creates boundary image 73 (three-dimensional boundary image 733 and two-dimensional boundary image 732 ) based on the input numerical value of the distance, and displays it on reception screen 400 .

The read button 612 is a button image for accepting an operation from the user to read out the layout drawing 71 created and saved in the past by the user and display it on the display screen 11D. Also, the read button 612 is a button image for accepting an operation from the user to read out the layout drawing 71 created based on the measurement information measured by a measuring device, which will be described later, and display it on the display screen 11D.
The save button 613 is a button image for accepting an operation from the user to store and save the layout drawing 71 created by the user in the terminal device 10 . In addition, in the building equipment display system 1 of the present embodiment, the layout drawing 71 can be stored in the layout drawing management unit 33 of the terminal device 10 as well as in the management server device 20 .

Further, as shown in FIG. 7, the reception screen display unit 32 displays the layer management button 62 on the reception screen 400 on which the three-dimensional layout drawing 713 is displayed.
The layer management button 62 is a button image for accepting a management operation of the layer configuration of the boundary image 73 from the user. The layer management button 62 has a layer display switching button 621 and a layer addition button 622 .

FIG. 9 is an explanatory diagram of the layer structure of the boundary image 73 of this embodiment.
Here, the boundary image 73 of this embodiment is provided with a plurality of layers at each boundary portion, and it is possible to receive the layout of the facility image 75 for each layer. For example, as shown in FIG. 9A, the boundary image 73 of each boundary portion can be configured with a three-layer structure of a first layer 73a, a second layer 73b and a third layer 73c. Then, as shown in FIG. 9B, for example, the first layer 73a displays an equipment image 75 relating to air conditioning equipment, the second layer 73b displays an equipment image 75 relating to plumbing equipment, and the second layer 73b displays an equipment image 75 relating to plumbing equipment. A facility image 75 relating to electrical facilities is displayed on the third layer 73c. Note that the layer configuration of the boundary image 73 is reflected in both the 2D layout map 712 and the 3D layout map 713 . Moreover, in this embodiment, the display color of the equipment image 75 can be changed for each layer.

Then, the layer display switching button 621 accepts switching between display/non-display of the facility image 75 in each layer of the plurality of layers. A layer addition button 622 is used to add a new layer.
As described above, in the present embodiment, the layered structure allows building facilities to be managed for each different type of building facilities such as air conditioning equipment, plumbing equipment, and electrical equipment.

Furthermore, as shown in FIG. 7, the reception screen display unit 32 displays the AR display button 63 and the estimate creation button 64 on the reception screen 400 on which the three-dimensional layout drawing 713 is displayed.
The AR display button 63 (an example of an instruction image) is a button image that receives an AR display execution instruction from the user to display the created layout drawing 71 superimposed on the captured image 120 . When the AR display button 63 is selected, the reception screen display unit 32 causes the AR display unit 40 to perform AR display on the display screen 11D. The AR display will be described later in detail.

The estimate creation button 64 (an example of a third instruction image) is a button image for the user to attach an estimate creation instruction based on the created layout drawing 71 . When the estimate creation button 64 is selected, the reception screen display unit 32 causes the estimate creation unit 50 to display the estimate image 850 on the display screen 11D. The estimate display will be described later in detail.

Next, the operation button images displayed on the reception screen 400 with the two-dimensional layout drawing 712 displayed will be specifically described.
As shown in FIG. 8A, the reception screen display unit 32 of the present embodiment displays an equipment image related to the display of the two-dimensional equipment image 752 on the reception screen 400 on which the two-dimensional layout drawing 712 on the inner surface 73N side is displayed. The drawing button 65 is displayed. In this embodiment, the facility image drawing buttons 65 include a drawing button 651 , a delete button 652 , a connection button 653 , a punch button 654 and a facility selection button 655 .

The drawing button 651 is a button image that accepts a setting that makes it possible to add the two-dimensional facility image 752 of the selected building facility to the two-dimensional boundary image 732 . When the drawing button 651 is selected, the reception screen display unit 32 adds a two-dimensional equipment image 752 based on the tapped position each time the user taps the two-dimensional boundary image 732 thereafter. indicate.

As shown in FIG. 8A , when the drawing button 651 is selected after an indoor unit of an air conditioner is selected as building equipment, the reception screen display unit 32 displays A two-dimensional equipment image 752 corresponding to the indoor unit is displayed at the position where the user performed the tap operation.
Further, as shown in FIG. 8A, when the drawing button 651 is selected after, for example, piping is selected as building equipment, the reception screen display unit 32 displays the user's drawing in the two-dimensional boundary image 732. A two-dimensional facility image 752 corresponding to the piping is displayed so as to connect the positions where the tapping operations are continuously performed.

The delete button 652 is a button image that accepts settings for making the two-dimensional equipment image 752 in a deletable state. When the delete button 652 is selected, the reception screen display unit 32 deletes the two-dimensional equipment image 752 after which the user tapped.

The connection button 653 is a button image that accepts display of a joint that connects the intersecting portions when two-dimensional equipment images 752 displayed in a straight line such as piping are displayed in an intersecting manner.

The perforation button 654 is a button image that accepts an operation to display the two-dimensional facility image 752 in a direction penetrating the boundary. When the perforation button 654 is selected, the reception screen display unit 32 causes the two-dimensional facility image 752 tapped by the user thereafter to penetrate through the two-dimensional boundary image 732 . It should be noted that the reception screen display unit 32 is operated based on the perforation button 654 for any of the two-dimensional facility images 752 of the two-dimensional boundary image 732 on the inner surface 73N side and the two-dimensional boundary image 732 on the outer surface 73G side. , to perform a display that penetrates the boundary.

The equipment selection button 655 is a button image that accepts selection of building equipment as the two-dimensional equipment image 752 to be added to the two-dimensional boundary image 732 based on the operation of the drawing button 651 . When the equipment selection button 655 is selected, the reception screen display unit 32 displays a plurality of selectable building equipment options as the two-dimensional equipment image 752 on the reception screen 400 . Note that the reception screen display unit 32 displays options for a plurality of building equipment based on the equipment information management table 210 acquired by the equipment information acquisition unit 31 . Then, the reception screen display unit 32 displays the building equipment selected based on the operation of the equipment selection button 655 on the two-dimensional boundary image 732 according to the user's tap operation after the drawing button 651 is operated, as described above. indicate.

Further, as shown in FIG. 8A, the reception screen display unit 32 of the present embodiment displays a reference setting button 661 and a grid setting button on the reception screen 400 on which the two-dimensional layout 712 on the inner surface 73N side is displayed. 662, a cancel button 671, a redo button 672, an outside display button 681, and a bird's eye view button 69 are displayed.

The reference setting button 661 is a button image for receiving the setting of the reference image 95 that serves as a reference for starting movement of the display screen 11D of the terminal device 10 when AR display is performed. In this embodiment, the reference image 95 has an arrow shape. After the reference setting button 661 is selected, when the user performs a tap operation on one boundary, the tip of the arrow is displayed at the position of the tap operation in the two-dimensional boundary image 732 of the one boundary. A reference image 95 is displayed so as to face the back side of the screen 11D. Also, the display of the reference image 95 can be set for both the inner surface 73N and the outer surface 73G of the two-dimensional boundary image 732. FIG.

The setting of the reference image 95 on the two-dimensional layout drawing 712 is also reflected on the three-dimensional layout drawing 713 . As shown in FIG. 7, when the reference image 95 is set on the inner surface 73N, the arrow is directed toward the outer surface 73G. Further, when the reference image 95 is set on the outer surface 73G, the direction of the arrow is provided so as to face the inner surface 73N side.
Note that the reference image 95 will be described later in detail.

A grid setting button 662 accepts setting of the interval of the grid 91 from the user. Grid setting button 662 displays options indicating a plurality of intervals on reception screen 400 when selected. A plurality of types of intervals of the grid 91 are provided, and the user can arbitrarily select one.

The cancel button 671 is a button image that accepts an instruction to cancel the previous user operation.
Redo button 672 accepts an instruction to re-execute the operation canceled by cancel button 671 .

The outer display button 681 is a button image that accepts an operation to switch the display from the inner surface 73N side of the two-dimensional layout drawing 712 to the outer surface 73G side of the two-dimensional layout drawing 712 on the opposite side. As shown in FIG. 8A, when the inner surface 73N side of the two-dimensional layout drawing 712 is displayed, a two-dimensional equipment image 752 arranged on the inner surface 73N side of the two-dimensional boundary image 732 is displayed. On the other hand, when the outer display button 681 is selected, as shown in FIG. 8B, the state is switched to display the outer surface 73G side of the two-dimensional layout diagram 712, and the outer surface 73G side of the two-dimensional boundary image 732 is displayed. A two-dimensional facility image 752 arranged in is displayed.

In this embodiment, when the inner surface 73N side of the two-dimensional layout drawing 712 is displayed, the two-dimensional equipment image 752 arranged on the inner surface 73N is displayed, and the two-dimensional equipment image 752 arranged on the outer surface 73G is displayed. I try not to. On the other hand, when the outer surface 73G side of the two-dimensional layout drawing 712 is displayed, the two-dimensional equipment image 752 arranged on the outer surface 73G is displayed and the two-dimensional equipment image 752 arranged on the inner surface 73N is not displayed. there is This prevents the display of the two-dimensional layout map 712 from becoming complicated in this embodiment.

The bird's-eye view button 69 (an example of a second instruction image) is a button image that accepts an operation to switch the display from the state in which the 2D layout map 712 is displayed to the 3D layout map 713 . As shown in FIG. 8A, when the bird's-eye view button 69 is selected while a two-dimensional layout map 712 is displayed on the reception screen 400, a three-dimensional layout map 713 is displayed as shown in FIG. The reception screen 400 to be displayed is displayed.

Next, the reception screen 400 on which the two-dimensional layout drawing 712 on the outer surface 73G side is displayed will be described.
As shown in FIG. 8B, the reception screen display unit 32 of the present embodiment displays a two-dimensional layout diagram 712 showing the outer surface 73G side on the reception screen 400. As shown in FIG. A two-dimensional layout diagram 712 showing the outer surface 73G side includes a two-dimensional boundary image 732 when the two-dimensional layout diagram 712 is viewed from the outer surface 73G side, and a two-dimensional facility image arranged on the outer surface 73G of the two-dimensional boundary image 732. 752 is displayed.

Further, as shown in FIG. 8B, the reception screen display unit 32 of the present embodiment displays the inner surface shown in FIG. Basically the same button image as the reception screen 400 on which the two-dimensional layout drawing 712 on the 73N side is displayed is displayed. However, an inside display button 682 is displayed instead of the outside display button 681 on the reception screen 400 on which the two-dimensional layout drawing 712 on the outside surface 73G side is displayed.

The inner display button 682 is a button image that accepts an operation to switch the display from the state of displaying the outer surface 73G side of the two-dimensional layout drawing 712 to the inner surface 73N side of the two-dimensional layout drawing 712 on the opposite side. When the inner display button 682 is selected, the inner surface 73N of the two-dimensional layout diagram 712 is displayed from the state in which the outer surface 73G side of the two-dimensional layout diagram 712 shown in FIG. The display of the reception screen 400 is switched to the state in which the side is displayed.

(AR display unit 40)
FIG. 10 is a diagram showing functional blocks of the AR display unit 40 of this embodiment.
FIG. 11 is an explanatory diagram of AR display by the AR display unit 40 of this embodiment.
FIG. 12 is an explanatory diagram of the follow-up operation in the AR display of this embodiment.

As shown in FIG. 10 , the AR display unit 40 includes a photographed image acquisition unit 41 that acquires a photographed image 120, a motion specifying unit 42 that specifies the motion of moving the position and orientation of the display screen 11D, and a photographed image 120. A superimposed display unit 43 for superimposing and displaying the layout drawing 71 and an adjustment unit 44 for adjusting the display position of the layout drawing 71 are provided.

The captured image acquisition unit 41 acquires the captured image 120 captured by the camera 12 (see FIG. 1). Then, the photographed image acquisition unit 41 sends the acquired information of the photographed image 120 to the action specifying unit 42 and the superimposed display unit 43 . Note that the captured image acquisition unit 41 always acquires the captured image 120 from the camera 12 when the AR display is being performed.

The motion specifying unit 42 specifies the motion of the captured image 120 acquired from the captured image acquiring unit 41 . For example, when the user moves the terminal device 10, the direction of the camera 12 provided in the terminal device 10 changes, so the content of the captured image 120 captured by the camera 12 changes. That is, as the terminal device 10 moves, the captured image 120 also moves. Then, based on the feature points of the image displayed in the captured image 120, the motion specifying unit 42 specifies the amount of movement of the image in the up-down direction, the left-right direction, and the front-rear direction.
Then, the motion specifying unit 42 sends information on the specified movement amount of the captured image 120 to the superimposed display unit 43 .

Note that the motion specifying unit 42 may specify the position and orientation of the display screen 11D by using a motion sensor mounted on the terminal device 10, for example. In this case, the motion sensor includes a 3-axis gyro sensor that detects the angular velocity (rotational speed) of the terminal device 10, a 3-axis acceleration sensor that detects the acceleration of the terminal device 10, and an absolute direction of the terminal device 10 that detects geomagnetism. A three-axis geomagnetic sensor can be used to detect

The superimposed display unit 43 acquires the captured image 120 from the captured image acquisition unit 41 . Furthermore, the superimposed display unit 43 acquires the information of the layout drawing 71 from the layout drawing creating unit 30 . Then, as shown in FIG. 11 , the superimposed display unit 43 displays a superimposed image 800 in which the three-dimensional facility image 753 of the layout drawing 71 is superimposed on the captured image 120 on the display screen 11D of the terminal device 10 .
In addition, when displaying the 3D equipment image 753, the superimposed display unit 43 of the present embodiment arranges both the 3D equipment image 753 arranged on the inner surface 73N and the 3D equipment image 753 arranged on the outer surface 73G. do.

Also, the superimposed display unit 43 determines the display size of the three-dimensional facility image 753 based on the characteristics of the room space obtained from the captured image 120 . The superimposed display unit 43 extracts, from the captured image 120, features of the room space such as the corners of the room, the horizontal width of the walls, and the vertical width of the walls (the height of the ceiling from the floor). Then, the superimposed display unit 43 aligns the corners of the boundary portion of the three-dimensional boundary image 733 with the corners of the room in the captured image 120, and adjusts the size of the boundary portion such as the walls in the captured image 120 to match the three-dimensional boundary. For example, the size of the boundary portion in the image 733 is matched. In this manner, the superimposed display unit 43 of the present embodiment determines the display position and display size (scale) of the three-dimensional layout drawing 713 on the display screen 11D.

Here, in the building equipment display system 1 of the present embodiment, when the AR display is performed, the user holds the terminal device 10 (display screen 11D) at a predetermined position in the room space of the actual building, The user is requested to start the AR display with the display screen 11D directed in a predetermined direction. The position and orientation of the display screen 11D of the terminal device 10 requested by the user are determined by the position and orientation of the reference image 95 preset by the user in the boundary image 73 .

In the building equipment display system 1, the user moves the position and orientation of the display screen 11D from a state in which the display screen 11D is oriented in a predetermined position and in a predetermined direction as an initial state. Furthermore, in the building facility display system 1, the display of the three-dimensional facility image 753 is changed according to the amount of movement of the display screen 11D from the initial state. As a result, even if the user moves the display screen 11D, the three-dimensional facility image 753 is displayed at the position arranged by the user on the three-dimensional boundary diagram 733 with respect to the photographed image 120 showing the actual building. Display is realized. The AR display will be described in more detail below.

When starting to display the three-dimensional equipment image 753 of the layout drawing 71, the superimposed display unit 43 displays the three-dimensional equipment image 753 according to the position and direction based on the reference image 95 specified by the user when creating the layout drawing. . For example, as shown in FIG. 8(A), when creating a layout diagram, in the center of a two-dimensional layout diagram 712 displaying the inner surface 73N of one wall, a direction from the inner surface 73N side to the outer surface 73G side is displayed. is specified by the user.

In this case, when starting to display the three-dimensional facility image 753 of the layout drawing 71, the superimposed display unit 43 displays the three-dimensional facility image 753 viewed from the inner surface 73N of one wall on the display screen 11D. In addition, the superimposed display unit 43 displays a three-dimensional facility image 753 arranged on the inner surface 73N of one wall on the front side of the display screen 11D and a three-dimensional facility image 753 arranged on the outer surface 73G of one wall. Place and display on the back side.

Then, the superimposed display unit 43 changes the display content of the three-dimensional equipment image 753 displayed on the display screen 11D based on the information on the amount of movement of the photographed image 120 acquired from the action specifying unit 42 . For example, as shown in FIG. 12A, when the user moves the terminal device 10 in the horizontal direction, the three-dimensional equipment image is displayed so as to follow the change in the horizontal direction of the captured image 120 displayed on the display screen 11D. 753 is changed in the horizontal direction.
Note that this follow-up operation is the same for vertical movement of the terminal device 10 .

Furthermore, as shown in FIG. 12(B), when the position of the terminal device 10 moves in the front-rear direction due to the user's movement, the change in the front-rear direction of the captured image 120 displayed on the display screen 11D is followed. , changes the display direction of the three-dimensional facility image 753 in the front-rear direction.

Note that when a user who is inside a room in an actual building turns around to the outside of the room (wall), the three-dimensional facility image 753 seen from the inner surface 73N of the boundary portion is displayed in front of the display screen 11D. The three-dimensional facility image 753 viewed from the outer surface 73G side of the boundary is displayed on the front side of the display screen 11D.

As described above, when the captured image 120 displayed on the display screen 11D changes due to the user changing the orientation or moving the position of the terminal device 10, the superimposed display unit 43 converts the captured image 120 into a three-dimensional image. A facility image 753 is displayed following. As described above, in the building facility display system 1 of the present embodiment, when the user views the photographed image 120 of the actual building facility through the display screen 11D, the three-dimensional facility image 753 is displayed in the photographed image 120. You can feel as if the building equipment actually exists there.

Next, a button image displayed on the display screen 11D for AR display will be described.
FIG. 13 is an explanatory diagram of a button image displayed on the display screen 11D where AR display is performed.

As shown in FIG. 11, the superimposed display unit 43 displays the bird's eye view button 69 and the button ON image 81 on the display screen 11D on which the superimposed image 800 is displayed.
When the bird's-eye view button 69 is selected with the superimposed image 800 displayed, the superimposed display unit 43 displays the reception screen 400 (see FIG. 7) displaying the three-dimensional layout 713 on the display screen 11D. For example, it is assumed that the user wants to change the layout drawing 71 by grasping an image of the layout of the building equipment of the target building from the superimposed image 800 in the AR display. In such a case, in the present embodiment, the bird's-eye view button 69 is displayed on the display screen 11D on which the superimposed image 800 is displayed so that the user can immediately start changing the layout of the equipment images 75 in the layout drawing 71. I have to.

Further, in the present embodiment, by providing the bird's-eye view button 69 on the lower side of the display screen 11D and at the end in the left-right direction, the three-dimensional layout diagram 713 is displayed while the user holds the terminal device 10 with both hands. This improves the operability when shifting to the display screen 11D that is displayed.

The button ON image 81 is a button image for receiving an instruction to display a group of button images relating to display correction of the three-dimensional equipment image 753 on the display screen 11D on which the superimposed image 800 is displayed. When the button ON image 81 is selected, the superimposed display unit 43 causes the display screen 11D to display a group of button images relating to correction of the display of the three-dimensional facility image 753. FIG. Note that button images for correcting the display of the three-dimensional equipment image 753 will be described later.
In the present embodiment, when the superimposed image 800 is displayed, other button images are displayed under the condition that the button ON image 81 is operated in order to secure as wide an area for displaying the captured image 120 as possible. , and the button image group is not displayed unless the button ON image 81 is operated.

As shown in FIG. 13A, the adjustment unit 44 displays the button OFF image 82 and the reference designation button on the display screen 11D on which the superimposed image 800 is displayed in accordance with the selection of the button ON image 81 (see FIG. 11). 83, a rotation button 84, a horizontal movement button 85, a vertical movement button 86, and an enlargement/reduction button 87 are displayed. Then, the adjustment unit 44 accepts adjustment of the display position of the three-dimensional facility image 753 with respect to the photographed image 120 in the superimposed image 800 from the user in accordance with these button operations.
In this embodiment, the button OFF image 82, the reference designation button 83, the rotation button 84, the left/right movement button 85, the up/down movement button 86, and the enlarge/reduce button 87 are positioned on the lower side of the display screen 11D and at the ends in the left/right direction. to display.

The button OFF image 82 is a button image for receiving an operation from the user to hide the button image displayed on the display screen 11D in accordance with the operation of the button ON image 81 (see FIG. 11).

The reference specifying button 83 includes a reference 1 button 831, a reference 2 button 832 and a reference 3 button 833 in this embodiment. Then, as shown in FIG. 13B, a reference 1 button 831, a reference 2 button 832, and a reference 3 button 833 are the first image 95, which is the reference image 95 set at a predetermined position in the three-dimensional layout drawing 713. They correspond to a reference image 951, a second reference image 952, and a third reference image 953, respectively.

For example, the user selects the reference 1 button 831 at a position corresponding to the location where the first reference image 951 is displayed in the three-dimensional layout drawing 713 in the actual building. Then, when the reference 1 button 831 is operated, the adjustment unit 44 again displays the three-dimensional facility image 753 centered on the first reference image 951 on the display screen 11D. Then, the superimposed display unit 43 uses the position and orientation of the terminal device 10 when the reference 1 button 831 is operated as the origin, and follows the change of the captured image 120 after that, and starts displaying the three-dimensional equipment image again. 753 to change the display direction.

Similarly, the adjustment unit 44 displays the second reference image 952 by accepting the selection of the reference 2 button 832 at the position corresponding to the position where the second reference image 952 is displayed in the three-dimensional layout drawing 713 . The centered three-dimensional facility image 753 is again displayed on the display screen 11D. Further, the adjustment unit 44 accepts the selection of the reference 3 button 833 at a position corresponding to the position where the third reference image 953 is displayed in the three-dimensional layout drawing 713, thereby placing the third reference image 953 in the center of the display. 3D equipment image 753 is displayed again on the display screen 11D.
As described above, in this embodiment, the reference position of the display of the three-dimensional facility image 753 with respect to the photographed image 120 in the superimposed image 800 is adjusted based on a plurality of different references set in the three-dimensional layout drawing 713. ing.

As shown in FIG. 13A, the rotation button 84 is a button image that receives an operation to rotate the three-dimensional equipment image 753 in the superimposed image 800 around a predetermined virtual rotation axis.
The left/right movement button 85 is a button image that receives an operation to move the three-dimensional facility image 753 in the superimposed image 800 in parallel in the left/right direction of the display screen 11D as a whole.
The vertical movement button 86 is a button image that receives an operation to move the three-dimensional facility image 753 in the superimposed image 800 in parallel in the vertical direction of the display screen 11D as a whole.
The enlargement/reduction button 87 is a button image that receives an operation for enlarging or reducing the three-dimensional equipment image 753 in the superimposed image 800 as a whole.

In addition, in this embodiment, the display position of the three-dimensional facility image 753 is adjusted using the reference designation button 83, but it is not limited to this aspect. For example, in the terminal device 10 of the present embodiment, the superimposed image is based not on the reference designation button 83 but on the corners of the building obtained from the captured image 120 and the characteristic points of the room space such as predetermined reference markers. The display position of the three-dimensional facility image 753 in 800 may be adjusted automatically.

FIG. 14 is a flow chart of the operation of the AR display unit 40 of this embodiment.
As shown in FIG. 14, the AR display unit 40 determines whether or not the AR display button 63 (see FIG. 7) has been selected (step 101). If the AR display button 63 is not selected (NO at step 101), the process returns to step 101 again. On the other hand, if the AR display button 63 is selected (YES at step 101), the AR display unit 40 acquires the captured image 120 from the camera 12 (step 102). Furthermore, the AR display unit 40 superimposes the three-dimensional equipment image 753 based on the reference image 95 on the acquired photographed image 120, and starts displaying the superimposed image 800 on the display screen 11D (step 103).

After that, it is determined whether or not there is a change in the movement of the photographed image 120 (step 104). Then, if there is a change in the movement of the photographed image 120 (YES in step 104), a superimposed image 800 in which the three-dimensional equipment image 753 is made to follow the photographed image 120 is displayed on the display screen 11D (step 105).

Then, if there is no change in the movement of the captured image 120 (NO in step 104), or if the following display is performed in step 105, is it received from the user an instruction to adjust the position of the three-dimensional equipment image? It is determined whether or not (step 106). An instruction to adjust the position of the three-dimensional equipment image is determined based on the operation of any one of the button images of the rotation button 84, the left/right movement button 85, the up/down movement button 86, and the enlargement/reduction button 87 (see FIG. 13). Then, when an instruction to adjust the position of the 3D equipment image is received from the user (YES in step 106), the position adjustment of the 3D equipment image is executed (step 107).

After that, if the instruction for adjusting the position of the 3D equipment image is not received from the user (NO in step 106), or if the position adjustment of the 3D equipment image is performed in step 107, the reference designation button 83 (Fig. 13) has been received from the user (step 108). Then, when the operation of the reference designation button 83 is accepted (YES in step 108), the three-dimensional facility image 753 is redisplayed based on the reference designation button 83 (step 109).

Furthermore, when the operation of the reference designation button 83 is not accepted (NO in step 108), or when the three-dimensional facility image 753 is redisplayed based on the reference designation button 83 in step 109, the bird's eye view button 69 (see FIG. 13) is determined (step 110). When the bird's-eye view button 69 is operated (YES in step 110), the display screen 11D is shifted from the superimposed image 800 to the reception screen 400 on which the three-dimensional layout drawing 713 is displayed, and a series of processing for AR display is performed. exit. On the other hand, if the bird's-eye view button 69 is not operated (NO in step 110), the process returns to step 104 to determine again whether or not the photographed image 120 has changed in movement.
As described above, in the building equipment display system 1 of the present embodiment, AR display is performed on the terminal device 10 .

(Quotation preparation unit 50)
Next, the creation of an estimate according to this embodiment will be described.
FIG. 15 is a functional block of the estimate creation unit 50 of this embodiment.
As shown in FIG. 15, the estimate creating unit 50 (an example of an estimate creating means) includes a layout map information acquisition unit 51 that acquires information on a layout plan 71 and a price information acquisition unit 52 that acquires price information for building equipment. and an estimate image creating unit 53 for creating an estimate image.

The layout map information obtaining unit 51 obtains information on the layout map 71 created by the user from the layout map creating unit 30 . Then, the layout plan information acquisition unit 51 sends the acquired information of the layout plan 71 to the estimate image creation unit 53 .

The price information acquisition unit 52 acquires price information about the unit price of building equipment from the facility information management table 210 held by the layout drawing creation unit 30 . Then, the price information acquisition unit 52 sends the price information obtained for each building equipment to the estimate image creation unit 53 .

The estimate image creation unit 53 identifies the type and quantity of building equipment used in the layout drawing 71 from the information of the layout drawing 71 acquired from the layout drawing information acquisition unit 51 . Based on the price information of the building equipment received from the price information acquisition unit 52, the estimate image creating unit 53 calculates the price for constructing the building equipment created as the layout drawing 71. FIG.

In addition, the estimated image creating unit 53 of the present embodiment specifies the type and quantity of building equipment installed in the direction penetrating the boundary. For example, in an actual building, when building facilities are installed in a direction penetrating a boundary such as a wall, for example, construction work for drilling the wall is required. Therefore, when calculating the estimated cost, even if the same building equipment is used, the construction cost will differ between building equipment that requires drilling work and building equipment that does not require drilling work. Therefore, the estimated image creation unit 53 of the present embodiment sets a different amount of money, such as a higher amount than that of building equipment that does not require drilling work, for building equipment that is provided in a direction penetrating the boundary.

Then, the estimate image creating unit 53 creates an estimate image 850 based on the estimated price for construction of the building equipment calculated based on the layout drawing 71, and displays it on the display screen 11D.

FIG. 16 is a diagram of an example of an estimate image displayed on the display screen 11D by the estimate creation unit 50 of this embodiment.
As shown in FIG. 16, the display screen on which the estimate image 850 is displayed includes a three-dimensional layout diagram 713, a new button 611, a read button 612, a save button 613, a print estimate button 88, a close button 89, and an AR display button. 63 is displayed.

The estimate print button 88 is a button image for receiving an instruction from the user to print the estimate image 850 .
The close button 89 is a button image for accepting an instruction from the user to hide the estimate image 850 . When the close button 89 is operated, the display of the estimate image 850 disappears and the three-dimensional layout diagram 713 displayed behind the estimate image 850 is displayed. Then, the display screen 11D shifts to the reception screen 400 (see FIG. 7) on which the three-dimensional layout drawing 713 is displayed. In the terminal device 10 of the present embodiment, if the user wants to review the layout of the building equipment again after confirming the estimated amount, the user can immediately start by operating the close button 89 .

When the AR display button 63 is operated, the screen shifts to the display screen 11D on which the superimposed image 800 is displayed. In the terminal device 10 of the present embodiment, after confirming the estimated amount, if the user wants to see the image of the layout of the building equipment in the superimposed image 800 again, the confirmation can be immediately performed by operating the AR display button 63. It can be carried out.

In addition, in the present embodiment, the close button 89 and the AR display button 63 are provided on the lower side of the display screen 11D and at the ends in the horizontal direction. This improves the operability when switching to the display screen 11D on which the screen 400 and the superimposed image 800 are displayed.

Next, a specific example of using the layout drawing 71 created in advance will be described.
In the example described above, the layout drawing 71 is created in response to the user's operation on the reception screen 400 . Here, the layout drawing 71 is created based on measurement information obtained by measuring the layout of the building equipment already installed in the actual building (hereinafter, existing building equipment), and can be displayed on the reception screen 400. .

For example, if the existing building facilities are pipes such as water supply pipes, the arrangement of the pipes is specified using a measuring device that can move inside the pipes.
The measuring device has a photographing unit that can photograph the surroundings, a distance measuring unit that measures the movement distance of the device, and an orientation measuring unit that measures the posture of the device (that is, the direction in which the device faces). ing. Then, by actually moving this measuring device inside a pipe, for example, the layout (that is, structure) of the existing building equipment is identified based on the information on the movement distance and the posture. In addition, by moving the measuring device while photographing by the photographing unit, an equipment photographed image of the existing building equipment can be obtained. Furthermore, the equipment photographed image is associated with the information of the photographing position in the existing building equipment. Note that the equipment shot image may be a moving image or a still image.

Then, the measurement information of the existing building equipment measured by the measuring device is converted into a format that can be used as the layout drawing 71 and stored in the layout drawing storage unit 22 of the management server device 20 . Further, the photographing information of the existing building equipment measured by the measuring device is stored in the layout drawing storage unit 22 together with the information of the photographing position.

FIG. 17 is an example of a three-dimensional layout diagram 713 displayed based on the layout diagram 71 created in advance.
As shown in FIG. 17, according to the user's operation on the read button 612, a layout drawing 71 prepared in advance using the above-described measuring device or the like is read. The read layout drawing 71 is displayed on the reception screen 400 of the display screen 11D. FIG. 17 shows an example of a three-dimensional layout diagram 713. As shown in FIG. By referring to the 3D layout drawing 713, the user can confirm the layout of the existing building equipment in the building.

18, 19 and 20 are examples of a two-dimensional layout 712 displayed based on the layout 71 created in advance.
As shown in FIG. 18A, the reception screen display unit 32 displays a two-dimensional layout diagram 712 on the display screen 11D in response to the user's tap operation on the three-dimensional layout diagram 713 (see FIG. 17). As described above, the two-dimensional layout drawing 712 shown in FIG. 18A is not displayed by being drawn by the user on the reception screen 400, but is the layout drawing 71 created in advance acquired from the layout drawing storage unit 22. It is displayed based on

The reception screen display unit 32 also displays the detailed information button 90 on the reception screen 400 . A detailed information button 90 is a button image for accepting display of detailed information about the equipment image 75 .

As shown in FIG. 18B, the reception screen display unit 32 displays an imaging information button 901 and a product information button 902 when the detailed information button 90 is selected.
The photographing information button 901 is a button for displaying on the display screen 11D a facility photographed image obtained by photographing existing building facilities. In this example, the reception screen display unit 32 reproduces a moving image as the facility captured image in response to the user's operation on the shooting information button 901 .
Further, the product information button 902 is a button for displaying on the display screen 11D information related to the building equipment corresponding to the equipment image 75 displayed on the reception screen 400. FIG. The reception screen display unit 32 displays detailed information on the building equipment product according to the user's operation on the product information button 902 .

Then, as shown in FIG. 19A, after the shooting information button 901 (see FIG. 18B) of the detailed information button 90 is selected, the user performs a tap operation, the equipment photographed image 92 corresponding to the one two-dimensional equipment image 752 is reproduced. Further, when the equipment photographed image 92 is displayed, a mark 92M is superimposed on the two-dimensional equipment image 752 that is the display target of the equipment photographed image 92 . This mark 92M corresponds to the photographing position of the moving image reproduced as the facility photographed image 92. FIG. Then, as shown in FIG. 19B, the mark 92M moves on the two-dimensional facility image 752 according to the progress of the moving image of the facility photographed image 92 .
Note that the mark 92M can be moved on the two-dimensional facility image 752 by the user's slide operation. Then, when the user moves the mark 92M to a predetermined position, the reception screen display unit 32 displays the equipment photographed image 92 photographed at the predetermined position.

Further, as shown in FIG. 20A, the reception screen display unit 32 can receive changes to the layout drawing 71 created in advance from the user. The reception screen display unit 32 receives an operation for changing the layout drawing 71 by using the facility image drawing button 65 . For example, as described with reference to FIGS. 19(A) and 19(B), as a result of the user confirming the facility photographed image 92, the user may determine that there is a portion in the existing building facility that requires repair. I may judge. In such a case, as shown in FIG. 20A, the user performs an operation such as deletion or drawing of the two-dimensional facility image 752 of the target location on the reception screen 400 . Note that the two-dimensional facility image 752 indicated by the dashed line in FIG. 20A is the facility image 75 of the building facility that has been changed by the user.
Note that the layout drawing 71 for which the operation for changing the facility image 75 is performed is stored in the layout drawing storage unit 22 of the management server device 20 .

Furthermore, as shown in FIG. 20(B), after the product information button 902 (see FIG. 18(B)) of the detailed information button 90 is selected, the user touches the changed two-dimensional equipment image 752. When a tap operation is performed, product information 93 of building equipment corresponding to the two-dimensional equipment image 752 is displayed. The product information 93 is displayed based on the information for each building equipment stored in the equipment information management table 210. FIG. Specifically, the product information 93 displays the contents such as the name and model number, product image, manufacturer's name, price, service life, etc. of the building equipment that are published in the product catalog.

Further, in the above example, the equipment photographed image 92 is displayed on the display screen 11D according to the operation on the two-dimensional equipment image 752, but it may be displayed according to the operation on the three-dimensional equipment image 753. Further, the product information 93 may be displayed by the user tapping the column of building equipment in the estimate image 850, for example.
The product information 93 can also be displayed in response to a tap operation on the layout drawing 71 created by the user as described with reference to FIGS. 8A and 8B.

Here, hardware configurations of the terminal device 10 and the management server device 20 of this embodiment will be described.
The terminal device 10 and the management server device 20 each include a CPU (Central Processing Unit) as a computing means, a working memory as a main storage means, a magnetic disk device (HDD: Hard Disk Drive) as an auxiliary storage means, a network interface, It has a display mechanism including a display device, an audio mechanism, an input device such as a keyboard and a mouse, and the like.
The auxiliary storage means stores OS programs and application programs. These programs are loaded into the work memory and executed by the CPU, thereby realizing the functions of the components of the terminal device 10 and the management server device 20 .

Furthermore, the program for realizing a series of functions in the building facility display system 1 of the present embodiment in the terminal device 10 and the management server device 20 can be provided by communication means, for example, or can be stored in various recording media. you can provide.

In addition, in the building facility display system 1 of the present embodiment, the layout drawing 71 created by the user in the layout drawing creation unit 30 is superimposed on the photographed image 120 . It is not limited to creation in the unit 30 . For example, the terminal device 10 downloads from the management server device 20 a previously created layout drawing or another drawing that can be converted into a layout drawing such as a CAD drawing. The terminal device 10 may superimpose the equipment image on the captured image 120 based on the downloaded drawing.

Further, in the building facility display system 1 of the present embodiment, the superimposed image 800 displayed on the terminal device 10 is temporarily stored in the work memory, and is not stored in the auxiliary storage means and read out. However, in the building equipment display system 1 , the moving image or still image of the superimposed image 800 may be stored in the terminal device 10 or the auxiliary storage means of the management server device 20 .

DESCRIPTION OF SYMBOLS 1... Building equipment display system 10... Terminal device 11D... Display screen 12... Camera 30... Layout drawing preparation part 40... AR display part 50... Estimate preparation part 63... AR display button 64... Estimate preparation Button 69 Bird's-eye view button 71 Layout drawing 73 Boundary image 75 Equipment image 120 Photographed image 400 Reception screen 800 Superimposed image 850 Estimated image

Claims (16)

a display means for displaying an image on a display screen provided with a photographing means for photographing a building;
reception means for receiving from a user, in the reception image displayed on the display screen, a display of a layout plan in which equipment images representing building equipment are arranged with respect to a building image corresponding to a building;
a superimposed image obtained by superimposing the facility image on the photographed image of the building photographed by the photographing means in response to a user's operation on the instruction image displayed on the display screen displaying the layout plan, Control means for controlling display on the display screen;
with
The control means, in response to a user's operation on a third instruction image displayed on the display screen on which the layout plan is displayed, provides an estimate for construction of building equipment created based on the layout plan. A building equipment display system characterized by displaying information on the display screen. a display means for displaying an image on a display screen provided with a photographing means for photographing a building;
reception means for receiving from a user, in the reception image displayed on the display screen, a display of a layout plan in which equipment images representing building equipment are arranged with respect to a building image corresponding to a building;
a superimposed image obtained by superimposing the facility image on the photographed image of the building photographed by the photographing means in response to a user's operation on the instruction image displayed on the display screen displaying the layout plan, Control means for controlling display on the display screen;
with
The control means displays the superimposed image by causing the facility image to follow the captured image when the captured image displayed on the display screen changes as the display screen moves,
the reception means receives a setting of a reference for starting movement of the display screen from the user in the reception image on which the layout drawing is displayed;
The building equipment display system, wherein the control means displays the superimposed image based on the setting of a plurality of different criteria. a display means for displaying an image on a display screen provided with a photographing means for photographing a building;
reception means for receiving from a user, in the reception image displayed on the display screen, a display of a layout plan in which equipment images representing building equipment are arranged with respect to a building image corresponding to a building;
a superimposed image obtained by superimposing the facility image on the photographed image of the building photographed by the photographing means in response to a user's operation on the instruction image displayed on the display screen displaying the layout plan, Control means for controlling display on the display screen;
with
The building facility display system, wherein the reception means receives from the user a setting for the arrangement of the facility image penetrating a boundary portion forming a boundary in the building. an estimate creation means for creating an estimate for construction of building equipment based on the layout drawing received by the reception means;
4. The building equipment according to claim 3 , wherein, when the equipment image penetrating the boundary portion is selected, the estimate creating means sets an estimated amount different from that for the equipment image not penetrating the boundary portion. display system. a photographing means for photographing a building;
display means for displaying an image on a display screen;
reception means for receiving from a user, in the reception image displayed on the display screen, a display of a layout plan in which equipment images representing building equipment are arranged with respect to a building image corresponding to a building;
a superimposed image obtained by superimposing the facility image on the photographed image of the building photographed by the photographing means in response to a user's operation on the instruction image displayed on the display screen displaying the layout plan, Control means for controlling display on the display screen;
with
The control means, in response to a user's operation on a third instruction image displayed on the display screen on which the layout plan is displayed, provides an estimate for construction of building equipment created based on the layout plan. A terminal device characterized by displaying information on the display screen . a photographing means for photographing a building;
display means for displaying an image on a display screen;
reception means for receiving from a user, in the reception image displayed on the display screen, a display of a layout plan in which equipment images representing building equipment are arranged with respect to a building image corresponding to a building;
a superimposed image obtained by superimposing the facility image on the photographed image of the building photographed by the photographing means in response to a user's operation on the instruction image displayed on the display screen displaying the layout plan, Control means for controlling display on the display screen;
with
The control means displays the superimposed image by causing the facility image to follow the captured image when the captured image displayed on the display screen changes as the display screen moves,
the reception means receives a setting of a reference for starting movement of the display screen from the user in the reception image on which the layout drawing is displayed;
The terminal device, wherein the control means displays the superimposed image based on the setting of a plurality of different criteria . a photographing means for photographing a building;
display means for displaying an image on a display screen;
reception means for receiving from a user, in the reception image displayed on the display screen, a display of a layout plan in which equipment images representing building equipment are arranged with respect to a building image corresponding to a building;
a superimposed image obtained by superimposing the facility image on the photographed image of the building photographed by the photographing means in response to a user's operation on the instruction image displayed on the display screen displaying the layout plan, Control means for controlling display on the display screen;
with
The terminal device, wherein the reception means receives from the user a setting for the arrangement of the facility image that penetrates a boundary portion that constitutes a boundary in a building . an estimate creation means for creating an estimate for construction of building equipment based on the layout drawing received by the reception means;
8. The terminal device according to claim 7, wherein, when the equipment image that penetrates the boundary portion is selected, the estimation creation means sets an estimated amount different from that for the equipment image that does not penetrate the boundary portion. . A computer that functions as a portable terminal device photographs the building,
said computer displaying an image on a display screen;
the computer receives, from the user, a display of a layout plan in which facility images representing building facilities are arranged with respect to a building image corresponding to a building, in a reception image displayed on the display screen;
The computer superimposes the facility image on the photographed image of the building photographed by the photographing means in accordance with the user's operation on the instruction image displayed on the display screen on which the layout plan is displayed. displaying an image on the display screen;
Estimate information relating to an estimate for construction of building equipment created based on the layout plan by the computer in response to a user's operation on a third instruction image displayed on the display screen on which the layout plan is displayed. is displayed on the display screen . A computer that functions as a portable terminal device photographs the building,
said computer displaying an image on a display screen;
the computer receives, from the user, a display of a layout plan in which facility images representing building facilities are arranged with respect to a building image corresponding to a building, in a reception image displayed on the display screen;
The computer superimposes the facility image on the photographed image of the building photographed by the photographing means in accordance with the user's operation on the instruction image displayed on the display screen on which the layout plan is displayed. displaying an image on the display screen;
displaying the superimposed image by causing the equipment image to follow the captured image when the captured image displayed on the display screen changes as the display screen moves;
the computer receives a setting of a reference for starting movement of the display screen from the user in the reception image on which the layout drawing is displayed;
The building equipment display method, wherein the computer displays the superimposed image based on the setting of a plurality of different criteria. A computer that functions as a portable terminal device photographs the building,
said computer displaying an image on a display screen;
the computer receives, from the user, a display of a layout plan in which facility images representing building facilities are arranged with respect to a building image corresponding to a building, in a reception image displayed on the display screen;
The computer superimposes the facility image on the photographed image of the building photographed by the photographing means in accordance with the user's operation on the instruction image displayed on the display screen on which the layout plan is displayed. displaying an image on the display screen;
A building facility display method, wherein the computer receives from a user a setting for the arrangement of a facility image that penetrates a boundary portion that constitutes a boundary in a building. The computer creates an estimate for construction of building equipment based on the layout drawing received on the display screen,
12. The building facility display method according to claim 11, wherein, when the facility image that penetrates the boundary is selected, the computer sets an estimated amount different from that for the facility image that does not penetrate the boundary. . A computer that functions as a portable terminal device,
A function to shoot buildings,
a function to display an image on the display screen;
a function of receiving, from a user, a display of a layout plan in which facility images indicating building facilities are arranged with respect to a building image corresponding to a building, using a reception image displayed on the display screen;
A superimposed image in which the facility image is superimposed on the photographed image of the building photographed by the photographing means in response to the user's operation on the instruction image displayed on the display screen on which the layout plan is displayed is displayed. A function to display on the display screen,
In accordance with a user's operation on a third instruction image displayed on the display screen on which the layout plan is displayed, estimate information relating to an estimate for construction of building equipment created based on the layout plan is displayed on the display screen. and the ability to display on
program to make it happen. A computer that functions as a portable terminal device,
A function to shoot buildings,
a function to display an image on the display screen;
a function of receiving, from a user, a display of a layout plan in which facility images indicating building facilities are arranged with respect to a building image corresponding to a building, using a reception image displayed on the display screen;
A superimposed image in which the facility image is superimposed on the photographed image of the building photographed by the photographing means is displayed according to the user's operation on the instruction image displayed on the display screen displaying the layout plan. function to be displayed on the screen,
a function of displaying the superimposed image by causing the equipment image to follow the captured image when the captured image displayed on the display screen changes as the display screen moves;
a function of receiving a setting of a reference for starting movement of the display screen from the user in the reception image on which the layout drawing is displayed;
a function of displaying the superimposed image based on setting of a plurality of different criteria;
program to make it happen. A computer that functions as a portable terminal device,
A function to shoot buildings,
a function to display an image on the display screen;
a function of receiving, from a user, a display of a layout plan in which facility images indicating building facilities are arranged with respect to a building image corresponding to a building, using a reception image displayed on the display screen;
A superimposed image in which the facility image is superimposed on the photographed image of the building photographed by the photographing means is displayed according to the user's operation on the instruction image displayed on the display screen displaying the layout plan. function to be displayed on the screen,
A function to receive from the user the setting of the arrangement of equipment images penetrating the boundary that constitutes the boundary in the building;
program to make it happen. to the computer;
a function of creating an estimate for construction of building equipment based on the layout drawing received by the function of receiving;
A function of setting an estimated amount different from that of the equipment image that does not penetrate the boundary when the equipment image that penetrates the boundary is selected;
16. The program according to claim 15, for realizing