JP2014229020A - Information providing device and information providing system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide information capable of easily specifying the installation position of a device in a building.SOLUTION: A storage unit 16 stores unshielded image data representing an object device installed in a building and before being shielded from the outside in association with installation position information showing the installation position of the object device. An image processing unit 18 generates map data showing a positional relation between the object device and a portable terminal device 30 on the basis of present position information showing the present position of the portable terminal device 30 and the installation position information of the object device. A communication unit 12 transmits the map data and the unshielded image data to the portable terminal device 30.

Description

  The present invention relates to an information providing apparatus and an information providing system for providing information related to equipment installed in a building.

  Various devices such as lighting and air conditioners are installed in buildings such as buildings and plants. When performing maintenance and inspection of these devices, a work PC or the like may be connected to the device in order to check the information or operating state of the device.

  As a technique related to maintenance inspection, Patent Document 1 discloses that a captured image of a plant device and a device mask image received from a portable information terminal are subjected to matching processing, inspection region information is acquired from the captured image, and inspection region information is included in the device display image. Is disclosed. Note that Patent Document 2 discloses a method of displaying information associated with a captured image in a superimposed manner on the captured image.

Japanese Patent No. 4876103 JP 2011-55250 A

  By the way, among the devices installed in the building, there are devices shielded from the outside, such as temperature sensors and flow meters installed in the ceiling. Since such a device cannot be visually recognized from the outside, it is difficult to specify the installation position of the device when performing maintenance and inspection of the device.

  In some cases, the installation location of the device is managed. Even in such a case, the managed information usually includes the floor number (1F, B1F, etc.) of the floor where the device is installed, The room number (111) or the like is not necessarily managed to the exact installation position of the device. That is, in many cases, the location where the device is installed on the floor or the room is not managed. Therefore, even if the installation location of the device is managed, it may be difficult to grasp the exact position of the device.

  As described above, since it is difficult to grasp the installation position of a device, it takes time to search for a device for maintenance and inspection, and there is a possibility that the device for maintenance and inspection is erroneous.

  The objective of this invention is providing the information which can pinpoint the installation position of the apparatus in a building easily.

  The invention according to claim 1 is a storage unit that stores pre-shielding image data that represents a target device that is installed in a building and is not shielded from the outside, in association with installation position information that indicates an installation position of the target device; Position information acquisition for acquiring current position information indicating the current position of the mobile terminal device when an acquisition request for information about the target device before being shielded is received from the mobile terminal device after the target device is shielded from the outside Means, map generation means for generating map data indicating a positional relationship between the target device and the mobile terminal device based on the installation position information and the current position information, and the map data and the pre-shielding image data. An information providing apparatus comprising: a transmission unit configured to transmit to the portable terminal device.

  The invention according to claim 2 is the information providing apparatus according to claim 1, further comprising driving information acquisition means for acquiring driving information indicating a current driving state of the target device, wherein the transmitting means includes: The driving information is further transmitted to the mobile terminal device.

  The invention according to claim 3 is the information providing apparatus according to claim 1 or 2, wherein the peripheral equipment is schematically based on information indicating a structure in the building and peripheral equipment of the target device. Model data generating means for generating peripheral model data representing the target equipment, and generating target model data representing the target equipment and the peripheral equipment model data by combining the peripheral equipment model data. The means transmits the composite model data as the pre-shielding image data to the portable terminal device.

  The invention according to claim 4 is the information providing apparatus according to claim 3, wherein the model data generation unit obtains angle information indicating a current direction of the mobile terminal device, and Synthesizing model data that schematically represents the peripheral equipment and the target device when viewed from a position with a line of sight in the current direction is generated.

  The invention according to claim 5 is the information providing apparatus according to any one of claims 1 to 4, wherein the direction of the installation position of the target device based on the current position of the mobile terminal device is determined. It further has guide information generation means for generating guide information to be shown, and the transmission means further transmits the guide information to the portable terminal device.

  The invention according to claim 6 is an information providing system in which an information providing device and a mobile terminal device are connected via a communication path, and the information providing device is installed in a building before being shielded from the outside. Storage means for storing pre-shielding image data representing the target device in association with installation position information indicating the installation position of the target device, and information related to the target device before shielding after the target device is shielded from the outside When the acquisition request is received from the mobile terminal device, the target device is based on the location information acquisition means for acquiring current location information indicating the current location of the mobile terminal device, the installation location information, and the current location information. A map generating means for generating map data indicating a positional relationship between the mobile terminal device and the mobile terminal device, and a transmission for transmitting the map data and the pre-occlusion image data to the mobile terminal device. A means, wherein the portable terminal device has a control means for displaying on the display means at least one of said shield front image data and the map data is information providing system characterized in that.

  The invention according to claim 7 is the information providing system according to claim 6, wherein the information providing apparatus further includes driving information acquisition means for acquiring driving information indicating a current driving state of the target device. The transmission means of the information providing device further transmits the driving information to the portable terminal device, and the control means of the portable terminal device displays the driving information on the pre-shielding image data and displays it on the display means. It is characterized by that.

  The invention according to claim 8 is the information providing system according to claim 6 or claim 7, wherein the information providing apparatus is based on information indicating a structure in the building and peripheral equipment of the target device. Model data generating means for generating peripheral equipment model data that schematically represents peripheral equipment, and for generating synthesized model data by synthesizing the target equipment model data that schematically represents the target equipment and the peripheral equipment model data The transmitting unit of the information providing device further transmits the combined model data as the pre-shielding image data to the mobile terminal device, and the control unit of the mobile terminal device displays the combined model data. It is made to display on a means.

  The invention according to claim 9 is the information providing system according to claim 8, wherein the model data generation unit obtains angle information indicating a current direction of the mobile terminal device, and Synthesizing model data that schematically represents the peripheral equipment and the target device when viewed from a position with a line of sight in the current direction is generated.

  The invention according to claim 10 is the information providing system according to claim 8 or claim 9, wherein the portable terminal device further includes photographing means for generating image data by photographing. The control means of the terminal device is characterized in that the composite model data is superimposed on the image data generated by the photographing means and displayed on a display means.

  The invention according to claim 11 is the information providing system according to any one of claims 6 to 10, wherein the information providing apparatus is the target device based on a current position of the portable terminal device. Guidance information generating means for generating guidance information indicating the direction of the installation position of the information providing device, wherein the transmission means of the information providing device further transmits the guidance information to the mobile terminal device, and the mobile terminal device The control means displays the guidance information on a display means.

  According to the present invention, by transmitting map data indicating the positional relationship between the target device and the mobile terminal device to the mobile terminal device, the user of the mobile terminal device can easily grasp the installation location of the target device in the building. It becomes possible. In addition, by transmitting the pre-shielding image data to the mobile terminal device, it is possible to easily grasp the detailed installation position of the target device even after the target device is shielded from the outside.

It is a block diagram which shows an example of the information provision system which concerns on embodiment. It is a flowchart which shows an example of the flow of the work regarding a maintenance check. It is a figure for demonstrating an example of operation | movement of the information provision system which concerns on embodiment. It is a figure which shows the apparatus in a building typically. It is a figure which shows drawing in a building. It is a figure which shows an example of the image displayed with a portable terminal device. It is a figure for demonstrating an example of operation | movement of the information provision system which concerns on embodiment. It is a figure which shows an example of the image displayed with a portable terminal device. It is a figure which shows an example of the image displayed with a portable terminal device. It is a figure which shows an example of the image displayed with a portable terminal device.

  FIG. 1 shows an example of an information providing system according to an embodiment of the present invention. The information providing system according to the present embodiment includes an information providing device 10 and a mobile terminal device 30. An information providing apparatus 10 and a building management system 50 are connected to a network N as a communication path. In addition, a wireless router 60 is connected to the network N, and the information providing apparatus 10 and the mobile terminal apparatus 30 communicate with each other via the wireless router 60 and the network N, for example.

  The information providing apparatus 10 manages image data and position information of various devices installed in a building (not shown), and provides the portable terminal device 30 with image data and position information of various devices. As equipment installed in the building, for example, lighting, air conditioners, and the like are applicable. In addition, for example, equipment shielded from the outside in the building is also applicable. Examples of the equipment shielded from the outside include a temperature sensor and a flow meter installed in the ceiling. However, these devices are examples, and the devices targeted by the present invention are not limited to these devices.

  The mobile terminal device 30 is a terminal device such as a mobile device used by an operator who performs maintenance and inspection of the device, acquires image data and position information of the device from the information providing device 10, and displays them.

  The building management system 50 manages the operating state of various devices installed in a building (not shown). For example, the building management system 50 manages information such as device setting modes, setting values, measured values, and power consumption. If the managed device is an air conditioner, the building management system 50 manages the setting mode (cooling mode or heating mode) or the set temperature of the air conditioner. If the managed device is a temperature sensor, the building management system 50 Manage sensor readings.

  Next, the configuration of the information providing apparatus 10 will be described. The information providing apparatus 10 includes, for example, a communication unit 12, a registration unit 14, a storage unit 16, an image processing unit 18, a calculation unit 20, a driving information acquisition unit 22, and a control unit 24. The information providing apparatus 10 includes a processor such as a CPU (not shown), and the function of each unit of the information providing apparatus 10 is realized by the processor executing a program.

  The communication unit 12 is a network interface, and communicates with the mobile terminal device 30 and the building management system 50 via the network N. The registration unit 14 stores the image data of the device installed in the building and the installation position information indicating the installation position of the device in the storage unit 16 in association with each other. The storage unit 16 is a storage device such as a memory or a hard disk drive. The image processing unit 18 generates two-dimensional image data indicating a map in the building, three-dimensional image data schematically indicating the inside of the building, and the like based on the drawing data of the building. The computing unit 20 obtains the position of the mobile terminal device 30 in the building, the distance from the mobile terminal device 30 to the device, and the like. The operation information acquisition unit 22 acquires operation information indicating the operation state of the device from the building management system 50. The control unit 24 controls each unit of the information providing apparatus 10.

  Next, the configuration of the mobile terminal device 30 will be described. The mobile terminal device 30 includes an imaging unit 32, a communication unit 34, a position information acquisition unit 36, an angle detection unit 38, a user interface (UI unit) 40, and a control unit 42. The portable terminal device 30 includes a processor such as a CPU (not shown), and the functions of each unit of the portable terminal device 30 are realized by the processor executing a program.

  The imaging unit 32 functions as a camera and generates image data (still image data or moving image data) by performing imaging. The communication unit 34 is a network interface and connects to the network N via the wireless router 60. The position information acquisition unit 36 acquires current position information indicating the current position of the mobile terminal device 30 by using GPS (Global Positioning System) or the like. The angle detection unit 38 is an orientation sensor, for example, and detects the orientation (angle, orientation) of the mobile terminal device 30. That is, the angle detection unit 38 detects the direction of the camera. The user interface (UI unit) 40 includes a display unit that displays images and various types of information, and an operation unit that receives input from the user. The control unit 42 controls each unit of the mobile terminal device 30.

(Outline of work)
Next, with reference to FIG. 2, an outline of work related to maintenance inspection will be described. The entire work includes construction under construction (S01), construction completion (S02), survey / maintenance work (S03), and work completion (S04). In the present embodiment, registration processing of the image data of the target device and drawings in the building is performed during construction (S01), and information provision processing for the target device is performed in the survey / maintenance work (S03). Is called. Specifically, during construction (S01), the worker photographs the target device with a photographing device such as a digital camera. The image data of the target device generated by the shooting is registered in the information providing apparatus 10 in association with the installation position information indicating the installation position of the target device. Then, when the construction is completed (S02), and maintenance and inspection of the equipment is performed after the construction is completed (S03), the worker specifies the installation position of the target equipment by using the mobile terminal device 30. At this time, the installation position information of the target device, the image data of the target device, the operation information of the target device, and the like are provided from the information providing device 10 to the mobile terminal device 30 and displayed on the mobile terminal device 30. The worker identifies the installation position of the target device by referring to the information displayed on the mobile terminal device 30, and performs maintenance and inspection of the target device. When the maintenance inspection is completed, the operation is completed (S04).

(Information registration process during construction)
Next, information registration processing during construction (S01) shown in FIG. 2 will be described in detail with reference to FIGS.

  First, the worker photographs the target device with the photographing apparatus. The photographing device may be any photographing device as long as it can acquire photographing position information. In the present embodiment, a case where shooting is performed by the mobile terminal device 30 will be described as an example, but the present invention is not limited to this example, and shooting may be performed by a shooting device other than the mobile terminal device 30.

  For example, as shown in FIG. 4, the worker photographs the target device 120 installed in the ceiling of the building 100 with the mobile terminal device 30. Since the ceiling is not installed at the stage of construction, the pipe 110 and the target device 120 are exposed to the outside and are visible from the outside. When the ceiling is installed and the construction is completed, the pipe 110 and the target device 120 are shielded from the outside by the ceiling, and thus cannot be visually recognized from the outside. An operator photographs the target device 120 before being shielded from the outside by the portable terminal device 30 during construction. For example, an image 200 showing the target device 120 is displayed on the UI unit 40 of the mobile terminal device 30. In the following description, image data representing a target device before being shielded from the outside may be referred to as “pre-shielding image data”.

  In addition, the position information acquisition unit 36 of the mobile terminal device 30 acquires current position information (shooting position information) indicating the current position (shooting position) of the mobile terminal device 30 at the time of shooting by using GPS. The angle detection unit 38 detects the direction (angle, azimuth) of the mobile terminal device 30. In addition, the worker can select the floor number (2F, B1F, etc.) where the image was taken, height information indicating the height of the target device, and identification information for identifying the target device 120 (for example, the name of the device or the device). ID, etc.) are input by the UI unit 40.

  Then, as illustrated in FIG. 3, the communication unit 34 of the mobile terminal device 30 attaches shooting information to the pre-shielding image data of the target device 120 and transmits the image information to the information providing device 10 (S10). The shooting information includes shooting position information, angle information indicating the direction (angle, azimuth) of the mobile terminal device 30, height information, identification information, and other shooting conditions such as zoom.

  The communication unit 12 of the information providing apparatus 10 receives the pre-shielding image data and shooting information of the target device 120 from the mobile terminal device 30 (S11), and the registration unit 14 receives the pre-shielding image data and shooting information of the target device 120. It memorize | stores in the memory | storage part 16 (S12). The registration unit 14 may store the shooting position as the installation position of the target device 120 and store the shooting position information as installation position information in the storage unit 16 in association with the pre-shielding image data, or may be obtained from the shooting position. The installation position information indicating the position may be stored in the storage unit 16 in association with the pre-shielding image data. For example, the computing unit 20 refers to drawing data such as a design drawing showing the internal structure of the building 100 and photographing information, and refers to the photographing position, the orientation (angle, azimuth) of the mobile terminal device 30, the height of the target device 120, and the like. Based on the floor number, the installation position of the target device 120 in the building 100 is estimated. The registration unit 14 may store the installation position information indicating the installation position obtained by the calculation unit 20 in the storage unit 16 in association with the pre-shielding image data.

  On the other hand, the information providing apparatus 10 acquires position information of each part in the building 100 (S13). Further, the image processing unit 18 of the information providing apparatus 10 generates building 3D model data that schematically represents the inside of the building 100 in three dimensions based on, for example, the drawing data 130 of the building 100 illustrated in FIG. 5 (S14). The drawing data 130 is data such as a design drawing showing the internal structure of the building 100, for example. The drawing data 130 shows the structure of each floor in the building 100 and various facilities such as piping installed in the building 100. The drawing data 130 may indicate the installation position of the target device in design. Further, the image processing unit 18 generates floor map data that represents the map in the building 100 in two dimensions based on the drawing data 130. And the image processing part 18 produces | generates building 3D model data with a positional information by matching the positional information on each part in the building 100 with building 3D model data (S15). The 3D model data and floor map data generated in this way are stored in the storage unit 16 of the information providing apparatus 10. When targeting a plurality of buildings, the information providing apparatus 10 generates and stores 3D model data and floor map data of each building. The image processing unit 18 corresponds to an example of a map generation unit.

(Information provision processing at the time of maintenance inspection: search work)
Next, the information provision processing in the investigation / maintenance work (S03) shown in FIG. 2 will be described in detail with reference to FIGS. In the present embodiment, there are at least two examples of information providing processing. In the first embodiment (search operation 1), a building map showing the installation position of the target device and pre-shielding image data are provided. In Example 2 (search operation 2), a map of the building showing the installation position of the target device and 3D model data are provided. Hereinafter, Example 1 will be described first, and then Example 2 will be described.

(Example 1: Search operation 1)
The first embodiment (search operation 1) will be described with reference to FIG. First, the worker who performs the maintenance check designates the target device for the maintenance check using the mobile terminal device 30. For example, as illustrated in FIG. 6A, the control unit 42 of the mobile terminal device 30 causes the UI unit 40 to display a screen 300 for searching for a target device for maintenance inspection. The operator searches for a target device for maintenance inspection and designates a target target device by the UI unit 40. Then, when the worker instructs the UI unit 40 to obtain information about the target device, the communication unit 34 of the mobile terminal device 30 provides the identification information of the target device specified by the worker via the network N. Transmit to device 10. In the example shown in FIG. 6A, the temperature sensor is designated as the target device.

  Note that the target device search process may be performed by the information providing apparatus 10 or the mobile terminal apparatus 30. When the search process is performed by the information providing apparatus 10, the control unit 24 of the information providing apparatus 10 extracts the identification information of the target device corresponding to the search key transmitted from the mobile terminal device 30 from the storage unit 16. The communication unit 12 of the information providing device 10 transmits the extracted identification information of the target device to the mobile terminal device 30 as a search result. The operator selects a desired target device from the search results. When the search process is performed by the mobile terminal device 30, for example, identification information of the target device is stored in advance in a storage unit (not illustrated) of the mobile terminal device 30. And the control part 42 of the portable terminal device 30 should just extract the identification information of the object apparatus applicable to the search key designated by the operator from the said memory | storage part, and should display the extraction result on the UI part 40. FIG.

  When the control unit 24 of the information providing apparatus 10 receives an acquisition request for information related to the target device from the mobile terminal device 30, the control unit 24 acquires floor map data representing a map in the building in two dimensions from the storage unit 16. In addition, the control unit 24 acquires, from the storage unit 16, the pre-shielding image data of the target device to which the identification information transmitted from the mobile terminal device 30 is added, and the installation position information attached to the pre-shielding image data. To do. Then, the image processing unit 18 generates floor map data with position information in which the installation position of the target device is represented on the map in the building based on the floor map data and the installation position information. For example, the image processing unit 18 generates floor map data with position information in which a target device mark indicating the target device is superimposed on the installation position on the map. The communication unit 12 of the information providing apparatus 10 transmits the floor map data with position information and the pre-shielding image data of the target device to the mobile terminal device 30 via the network N.

  When the floor map data with position information and the pre-shielding image data of the target device are received by the mobile terminal device 30, the control unit 42 of the mobile terminal device 30 includes the position information as shown in FIG. 6B, for example. The floor map data is displayed on the UI unit 40. The floor map data represents a map 320 in the building, and a target device mark 322 indicating a target device is superimposed and displayed at an installation position on the map 320. The worker can grasp the place where the target device is installed by referring to the map displayed on the UI unit 40.

  Then, when the operator uses the UI unit 40 to instruct the switching of the image, the control unit 42 displays the pre-shielding image data 330 of the target device in place of the floor map data, as shown in FIG. 6C. Displayed on the unit 40. Since the pre-shielding image data 330 is image data taken during construction, the target device before being shielded from the outside is represented.

  As described above, by providing the mobile terminal device 30 with the floor map data representing the installation position of the target device, even if the target device is shielded from the outside with the completion of the construction, The person can easily specify the installation position of the target device. Also, by providing the pre-shielding image data to the mobile terminal device 30, the operator can easily grasp the detailed installation position of the target device, the positional relationship between the target device and peripheral equipment, and the like. . That is, since the target device and peripheral equipment (for example, piping) are represented in the pre-shielding image data, the user can feel the position of the target equipment and the peripheral equipment as if they were looking inside the ceiling. The relationship can be grasped. Thus, since the position of the target device shielded from the outside can be easily specified, the target device search operation can be performed efficiently, and the efficiency of operations such as maintenance and inspection can be improved.

  For example, until the worker moves to the vicinity of the target device, the worker can move quickly with reference to the floor map data. When the worker moves to the vicinity of the target device, the detailed installation position of the target device can be grasped by referring to the pre-shielding image data.

  In addition, when the current position of the mobile terminal device 30 is included within a predetermined distance from the installation position of the target device, the information providing apparatus 10 transmits the pre-shielding image data of the target device to the mobile terminal device 30, and the current position is If not included in the predetermined distance, the floor map data with position information may be transmitted to the mobile terminal device 30. In this case, the communication unit 34 of the mobile terminal device 30 transmits the current location information acquired by the location information acquisition unit 36 to the information providing device 10. The control unit 24 of the information providing apparatus 10 compares the installation position information associated with the pre-shielding image data of the target device with the current position information of the mobile terminal device 30, and the current position of the mobile terminal device 30 is the target device. Is included within a predetermined distance from the installation position, the transmission command of the pre-shielding image data of the target device is output to the communication unit 12. On the other hand, when the current position of the mobile terminal device 30 is not included within the predetermined distance, the control unit 24 outputs a transmission command of floor map data with position information to the communication unit 12. The communication unit 12 transmits the pre-shielding image data or the floor map data with position information to the mobile terminal device 30 under the control of the control unit 24. The control unit 42 of the mobile terminal device 30 causes the UI unit 40 to display the pre-occlusion image data or the floor map data with position information. As described above, the floor map data and the pre-occlusion image data may be automatically switched.

  Note that when the worker who has the mobile terminal device 30 moves to the vicinity of the target device, the control unit 42 of the mobile terminal device 30 may switch from the floor map data to the pre-shielding image data. In this case, the control unit 42 compares the installation position information attached to the shielding image data with the current position information acquired by the position information acquisition unit 36, and the current position of the mobile terminal device 30 is set as the installation of the target device. When not included within the predetermined distance from the position, the floor map data is displayed on the UI unit 40, and when the current position is included within the predetermined distance from the set position, the pre-shielding image data of the target device is replaced with the floor map data. Is displayed on the UI unit 40.

  As another example of the first embodiment, the control unit 42 of the mobile terminal device 30 may cause the UI unit 40 to display the pre-shielding image data in a translucent state. Thereby, the operator can grasp the current state with reference to the pre-shielding image data. For example, the operator can perform new photographing under the same photographing conditions as the pre-shielding image data (conditions with the same angle, distance, zoom, etc.). Note that the process of making the pre-shielding image data translucent may be performed by the image processing unit 18 of the information providing device 10 or the control unit 42 of the mobile terminal device 30.

  As yet another example, the driving information acquisition unit 22 of the information providing device 10 may acquire driving information indicating the current driving state of the target device from the building management system 50 and provide it to the mobile terminal device 30. . In this case, the control unit 42 of the mobile terminal device 30 causes the UI unit 40 to display the driving information on the pre-shielding image data. If the target device is a measuring instrument such as a temperature sensor or a flow meter, the measured values such as temperature and flow rate are displayed as operation information. If the target device is a device other than the measuring instrument, for example, information indicating power consumption, operation mode, etc. Displayed as driving information. Thereby, the worker can grasp the current operating state of the target device while referring to the pre-shielding image.

  Further, the current position of the mobile terminal device 30 may be displayed on the floor map data. In this case, the image processing unit 18 of the information providing apparatus 10 causes the target device mark indicating the target device to be superimposed on the installation position on the floor map, and further, the terminal mark indicating the mobile terminal device 30 is at the current position on the floor map. Generate superimposed floor map data with position information. Then, the control unit 42 of the mobile terminal device 30 causes the UI unit 40 to display the floor map data with position information. Thereby, the worker can grasp the relationship between his current position and the installation position of the target device.

  By the way, by referring to the design drawing of the building, it is also possible for the worker to try to grasp the installation position of the target device shielded from the outside. However, in a building under construction, the installation position of the target device may be changed depending on the situation at the site, so the target device is not always installed according to the installation position shown in the design drawing. . Therefore, even if the design drawing is referred to after completion of the construction, it is not always possible to grasp the exact position of the target device. In contrast, in this embodiment, the target device actually installed in the building is photographed before the target device is shielded from the outside, and the installation position of the target device is recorded. Can provide a more accurate installation position. Furthermore, a more detailed installation position can be grasped by referring to the pre-shielding image. Further, even when there is no blueprint for a building, it is possible to provide useful information to the worker by applying this embodiment.

(Example 2: Search work 2)
Next, Example 2 (search operation 2) will be described with reference to FIGS. If it demonstrates with reference to FIG. 7, the operator who performs a maintenance inspection will first specify the object apparatus of a maintenance inspection with the portable terminal device 30 (S20). For example, as described with reference to FIG. 6A, the target device may be specified by using a search screen or the like. In addition, the position information acquisition unit 36 of the mobile terminal device 30 acquires current position information indicating the current position of the mobile terminal device 30 (S21), and the angle detection unit 38 has the direction (angle, azimuth) of the mobile terminal device 30. Is detected (S22). When the worker instructs the UI unit 40 to obtain information about the target device, the communication unit 34 of the mobile terminal device 30 obtains the target device identification information, current position information, and angle information specified by the worker. The information is transmitted to the information providing apparatus 10 via the network N. The communication unit 12 of the information providing device 10 receives the above information from the mobile terminal device 30. The communication unit 12 corresponds to an example of a position information acquisition unit.

  When the calculation unit 20 of the information providing device 10 receives an acquisition request for information on the target device from the mobile terminal device 30, the calculation unit 20 obtains the position of the mobile terminal device 30 in the building based on the current position information (S23). Based on the installation position information associated with the pre-shielding image data of the device and the current position information, a distance between the current position of the mobile terminal device 30 and the target device is obtained (S24).

  Then, the image processing unit 18 is based on the building 3D model data with position information generated in the registration process, the current position and orientation of the mobile terminal device 30 in the building, and the distance from the current position to the target device. Peripheral equipment 3D model data schematically representing the equipment around the target device when viewed from the current position with the line of sight in the direction is generated (S25). Further, the image processing unit 18 is based on the pre-shielding image data of the target device, the current position and orientation of the mobile terminal device 30 in the building, and the distance from the current position to the target device. The target device 3D model data schematically representing the target device in three dimensions is generated.

  Further, the image processing unit 18 acquires, from the storage unit 16, floor map data of the floor on which the worker who has the mobile terminal device 30 is present based on the current position information (S26).

  Then, the image processing unit 18 generates combined model data by combining the peripheral equipment 3D model data generated in step S25 and the target device 3D model data (S27). The image processing unit 18 also superimposes the target device mark indicating the target device on the installation position on the floor map based on the floor map data, the installation position information, and the current position information. Generates floor map data with position information superimposed on the current position on the floor map. The image processing unit 18 corresponds to an example of a model data generation unit.

  Further, the image processing unit 18 determines the direction of the target device based on the current position of the mobile terminal device 30 based on the current position information of the mobile terminal device 30, the angle information of the mobile terminal device 30, and the installation position information of the target device. The guidance information shown is generated (S28). Examples of the guidance information include guidance marks that indicate the direction of the target device, voice guidance information that indicates the direction of the target device by voice, and the like. The image processing unit 18 corresponds to an example of guidance information generating means.

  And the communication part 12 of the information provision apparatus 10 transmits object apparatus 3D model data, synthetic | combination model data, floor map data with a positional information, and guidance information to the portable terminal device 30 (S29).

  The control unit 42 of the mobile terminal device 30 causes the UI unit 40 to display the image data generated by the imaging of the imaging unit 32, and further superimposes the information transmitted from the information providing device 10 on the image data to the UI unit 40. (S30).

  8 to 10 show examples of information displayed on the UI unit 40. FIG. For example, as shown in FIG. 8, it is assumed that the worker is photographing the inside of the building 100 after the completion of the construction with the mobile terminal device 30. In this case, the control unit 42 displays the image data 500 in the building 100 generated by the photographing unit 32 on the UI unit 40, and further overlays the floor map data 600 with position information on the image data 500 on the UI unit 40. Display. The floor map data 600 with position information shows a map in the building, and a terminal mark 602 indicating the mobile terminal device 30 is displayed overlaid on the current position on the map, and the installation position on the map is A target device mark 604 indicating the target device is displayed in an overlapping manner. The worker can grasp the relationship between the target device and the current position by referring to the map displayed on the UI unit 40. Further, the control unit 42 causes the UI unit 40 to display the target device 3D model data 610 superimposed on the image data 500. The target device 3D model data 610 is displayed on the image data 500 in the direction in which the target device exists. In addition, the control unit 42 causes the UI unit 40 to display a guidance mark 620 serving as guidance information on the image data 500. The guidance mark 620 indicates the direction in which the target device exists on the image data 500. When the guidance information is voice information, the control unit 42 may output the voice through a speaker or the like.

  Then, when the worker moves within the building 100, the information providing device 10 is based on the current position information, angle information, and distance information of the mobile terminal device 30, and the target device 3D model data, the synthesized model data, Floor map data with position information and guidance information are generated and transmitted to the mobile terminal device 30. Therefore, when the worker moves in the building 100, for example, as shown in FIG. 9, the control unit 42, the floor map data 600 with position information transmitted from the information providing apparatus 10 in response to the movement, the target device 3D model The data 610 and the guidance mark 620 are displayed on the UI unit 40 so as to overlap the image data 500.

  When the operator instructs to switch images using the UI unit 40, the control unit 42 causes the UI unit 40 to display the synthesized model data 630 instead of the target device 3D model data as illustrated in FIG. . Since the synthesized model data 630 is data obtained by synthesizing the peripheral equipment 3D model data and the target equipment 3D model data, the synthetic model data 630 schematically represents the target equipment 634 and the peripheral equipment 632. Yes. The peripheral facility 632 is a pipe, for example. The synthesized model data 630 is displayed on the image data 500 in the direction in which the target device exists. The model data of the target device shown in FIGS. 8 to 10 may be two-dimensional data instead of three-dimensional data.

  As described above, by providing the floor map data and the target device 3D model data to the mobile terminal device 30, even if the target device is shielded from the outside with the completion of the construction and cannot be visually recognized, The installation position of the target device can be easily identified. Also, by providing the composite model data to the mobile terminal device 30, the worker can easily grasp the detailed installation position of the target device, the positional relationship between the target device and peripheral equipment, and the like. In other words, the target model and peripheral equipment are schematically represented in the composite model data, so the user can feel the position of the target equipment and peripheral equipment as if they were looking inside the ceiling. Can be grasped. Thus, since the position of the target device shielded from the outside can be easily specified, the target device search operation can be performed efficiently, and the efficiency of operations such as maintenance and inspection can be improved.

  For example, until the worker moves to the vicinity of the target device, the direction in which the target device is installed can be confirmed by referring to the floor map data and the target device 3D model data. When the worker moves to the vicinity of the target device, the detailed installation position of the target device can be confirmed by referring to the composite model data.

  Further, when the current position of the mobile terminal device 30 is included within a predetermined distance from the installation position of the target device, the information providing apparatus 10 transmits the composite model data to the mobile terminal device 30 and the current position is within the predetermined distance. When not included, the target device 3D model data may be transmitted to the mobile terminal device 30. In this case, the control unit 24 of the information providing device 10 compares the installation position information associated with the pre-shielding image data of the target device with the current position information of the mobile terminal device 30 to determine the current position of the mobile terminal device 30. Is included within a predetermined distance from the installation position of the target device, a synthetic model data transmission command is output to the communication unit 12. On the other hand, when the current position of the mobile terminal device 30 is not included within a predetermined distance from the installation position of the target device, the control unit 24 outputs a transmission command for the target device 3D model data to the communication unit 12. The communication unit 12 transmits the floor map data with position information and the guidance information to the mobile terminal device 30 under the control of the control unit 24, and transmits either the composite model data or the target device 3D model data to the mobile terminal device 30. Send to. The control unit 42 of the mobile terminal device 30 displays the floor map data with position information and the guidance mark as guidance information on the UI unit 40, and further displays either the composite model data or the target device 3D model data as the UI unit. 40. In this way, the synthesized model data and the target device 3D model data may be automatically switched.

  Note that when the worker who has the mobile terminal device 30 moves to the vicinity of the target device, the control unit 42 of the mobile terminal device 30 may switch from the target device 3D model data to the synthesized model data. In this case, the control unit 42 receives the installation position information of the target device from the information providing apparatus 10, compares the installation position information with the current position information, and the current position of the mobile terminal device 30 is a predetermined distance from the installation position of the target device. If it is not included, the target device 3D model data is displayed on the UI unit 40. When the current position is included within a predetermined distance from the installation position, the composite model data is replaced with the target device 3D model data. To display.

  As another example of the second embodiment, the control unit 42 of the mobile terminal device 30 may cause the UI unit 40 to display the target device 3D model data or the synthesized model data in a translucent state. For example, by displaying the synthetic model data in a translucent manner, an operator can grasp the current state with reference to the synthetic model data. In addition, the worker may perform new photographing with reference to the target device represented in the composite model data. Note that the process of making the target device 3D model data and the combined model data translucent may be performed by the image processing unit 18 of the information providing apparatus 10 or the control unit 42 of the mobile terminal device 30. .

  As yet another example, the driving information acquisition unit 22 of the information providing device 10 may acquire driving information indicating the current driving state of the target device from the building management system 50 and provide it to the mobile terminal device 30. . In this case, the control unit 42 of the mobile terminal device 30 causes the UI unit 40 to display driving information superimposed on the vicinity of the target device 3D model data or the target device represented by the combined model data. Note that when the operator instructs to save the image data 500 using the UI unit 40, the control unit 42 may save the driving information displayed on the UI unit 40 together with the image data 500 to be saved. . At this time, the control unit 42 may store the driving information and the image data 500 together with the target device 3D model data or the synthesized model data, or may store only the driving information and the image data 500.

  The information providing apparatus 10 may not provide the guide information to the mobile terminal device 30. In this case, no guidance mark is displayed on the UI unit 40 of the mobile terminal device 30. Even without using the guidance information, the worker can easily specify the installation position of the target device by referring to the floor map, the target device 3D model data, and the synthesized model data. The control unit 42 of the mobile terminal device 30 may control display / non-display of the guidance mark.

  Further, the 3D model data schematically showing the inside of the building 100 may be displayed on the UI unit 40 without displaying the image data generated by photographing on the UI unit 40. In this case, in step S25 illustrated in FIG. 7, the image processing unit 18 three-dimensionally displays the inside of the building 100 at the current position based on the 3D model data with position information and the current position and orientation of the mobile terminal device 30 in the building. 3D model data schematically represented by is generated. When the worker moves in the building 100, the image processing unit 18 generates 3D model data corresponding to the movement based on the current position and orientation of the mobile terminal device 30. The control unit 42 of the mobile terminal device 30 causes the UI unit 40 to display the 3D model data and the floor map data with position information without displaying the image data generated by shooting on the UI unit 40. Further, the control unit 42 may display the target device 3D model data and the guidance mark on the UI unit 40. Thus, even if it is a case where 3D model data is provided to the portable terminal device 30, the operator can specify the installation position of an object apparatus easily.

  In the above-described embodiment, the description has been given for a device that is shielded from the outside. However, the present embodiment is applied to a device that can be seen without being shielded from the outside, such as an illumination or an air conditioner. Also good. Even in this case, the target device can be easily identified, so that the target device can be searched efficiently, and the efficiency of operations such as maintenance and inspection can be improved.

  DESCRIPTION OF SYMBOLS 10 Information provision apparatus, 12 Communication part, 14 Registration part, 16 Storage part, 18 Image processing part, 20 Calculation part, 22 Driving information acquisition part, 24, 42 Control part, 30 Portable terminal device, 32 Image | photographing part, 34 Communication part 36, position information acquisition unit, 38 angle detection unit, 40 user interface (UI unit), 50 building management system, 60 wireless router.

Claims (11)

Storage means for storing pre-shielding image data representing a target device before being shielded from the outside installed in a building, in association with installation position information indicating the installation position of the target device;
Position information acquisition for acquiring current position information indicating the current position of the mobile terminal device when an acquisition request for information about the target device before being shielded is received from the mobile terminal device after the target device is shielded from the outside Means,
Map generation means for generating map data indicating a positional relationship between the target device and the mobile terminal device based on the installation position information and the current position information;
Transmitting means for transmitting the map data and the pre-shielding image data to the mobile terminal device;
An information providing apparatus comprising: The information providing device according to claim 1,
It further has driving information acquisition means for acquiring driving information indicating the current driving state of the target device,
The transmission means further transmits the driving information to the mobile terminal device.
An information providing apparatus characterized by that. The information providing device according to claim 1 or 2,
Based on the information indicating the structure in the building and the peripheral equipment of the target device, peripheral equipment model data that schematically represents the peripheral equipment is generated, and the target equipment model data and the peripheral equipment that schematically represent the target equipment It further has model data generating means for generating synthesized model data by synthesizing with model data,
The transmission means transmits the composite model data as the pre-shielding image data to the mobile terminal device.
An information providing apparatus characterized by that. The information providing device according to claim 3,
The model data generation unit acquires angle information indicating the current orientation of the mobile terminal device, and schematically illustrates the peripheral equipment and the target device when viewed from the current position of the mobile terminal device with a line of sight in the current orientation. Generate synthetic model data
An information providing apparatus characterized by that. The information providing apparatus according to any one of claims 1 to 4, wherein:
Guidance information generating means for generating guidance information indicating the direction of the installation position of the target device based on the current position of the mobile terminal device;
The transmission means further transmits the guidance information to the mobile terminal device.
An information providing apparatus characterized by that. An information providing system in which an information providing device and a mobile terminal device are connected via a communication path,
The information providing apparatus includes:
Storage means for storing pre-shielding image data representing a target device before being shielded from the outside installed in a building, in association with installation position information indicating the installation position of the target device;
Position information for acquiring current position information indicating the current position of the mobile terminal device when an acquisition request for information on the target device before being shielded is received from the mobile terminal device after the target device is shielded from the outside Acquisition means;
Map generation means for generating map data indicating a positional relationship between the target device and the mobile terminal device based on the installation position information and the current position information;
Transmitting means for transmitting the map data and the pre-shielding image data to the mobile terminal device;
Have
The portable terminal device
Control means for causing a display means to display at least one of the pre-occlusion image data and the map data;
An information providing system characterized by that. The information providing system according to claim 6,
The information providing apparatus further includes driving information acquisition means for acquiring driving information indicating a current driving state of the target device,
The transmission means of the information providing device further transmits the driving information to the mobile terminal device,
The control means of the mobile terminal device causes the display means to display the driving information superimposed on the pre-shielding image data.
An information providing system characterized by that. The information providing system according to claim 6 or 7, wherein
The information providing apparatus includes:
Based on the information indicating the structure in the building and the peripheral equipment of the target device, peripheral equipment model data that schematically represents the peripheral equipment is generated, and the target equipment model data and the peripheral equipment that schematically represent the target equipment It further has model data generating means for generating synthesized model data by synthesizing with model data,
The transmission means of the information providing device transmits the composite model data as the pre-shielding image data to the mobile terminal device,
The control means of the portable terminal device displays the composite model data on a display means;
An information providing system characterized by that. The information providing system according to claim 8,
The model data generation unit acquires angle information indicating the current orientation of the mobile terminal device, and schematically illustrates the peripheral equipment and the target device when viewed from the current position of the mobile terminal device with a line of sight in the current orientation. Generate synthetic model data
An information providing system characterized by that. The information providing system according to claim 8 or 9, wherein
The portable terminal device further has a photographing means for generating image data by photographing,
The control means of the portable terminal device causes the display means to display the composite model data superimposed on the image data generated by the photographing means.
An information providing system characterized by that. The information providing system according to any one of claims 6 to 10,
The information providing device further includes guide information generating means for generating guide information indicating a direction of an installation position of the target device based on a current position of the mobile terminal device,
The transmission means of the information providing device further transmits the guidance information to the mobile terminal device,
The control means of the portable terminal device displays the guidance information on a display means;
An information providing system characterized by that.