JP6305149B2 - Equipment position automatic recognition device - Google Patents

Description

  The present invention relates to an apparatus for displaying equipment location information and equipment information on a mobile map on a mobile terminal.

  In recent years, companies that have a large amount of equipment, for example, electric power companies that have a large number of utility poles, have shifted from a business form in which equipment has been inspected on a paper basis until now to equipment inspection using a mobile terminal.

Naturally, the demand for displaying the location information of the equipment on the mobile terminal has increased, and an apparatus for displaying the location information of the equipment on the mobile terminal has been developed and can be used. (For example, see Patent Document 1)
In addition, operations such as mobile location information display using GPS (Global Positioning System) that acquires location information held by a mobile terminal and photography of equipment using a camera or the like are increasing.

JP 2013-222335 A (FIGS. 8 to 11)

  In equipment management using a map display device on a mobile terminal, the current position of a field worker (ie, the position of the mobile terminal) is displayed on a map using GPS information, and equipment near the display position is displayed. The equipment to be inspected is selected by the site worker. In this method, when there are multiple facilities in the vicinity of the field worker, the field worker can only determine which device matches the facility displayed on the map, and an error may occur. In addition, there is an inconvenience that a separate confirmation work is required to reliably perform the specific work.

Although it is possible to specify the facility position based on the GPS of the image as shown in Patent Document 1 and the orientation of the mobile terminal when the camera is used, the accuracy is sufficient because it depends on the accuracy of the GPS and the method of using the mobile terminal. is not.
The present invention has been made in view of the above problems, and by simply photographing equipment with a camera, the equipment can be accurately identified and displayed on a map of a mobile terminal, thereby improving work efficiency and labor saving. It is realized.

  The present invention relates to an image capturing device that captures an image on site, a position information acquisition device that acquires position information of a mobile terminal, an orientation acquisition device that acquires orientation information of a mobile terminal, and a captured image / mobile terminal Equipment search device for specifying equipment from position information / azimuth information of mobile terminal, image analysis processing device for specifying equipment from captured image, pre-captured equipment image used for image matching, and Equipment image database for storing captured position information / direction information, equipment position database in which equipment position information is registered, equipment database in which equipment attribute information is registered, and attributes for acquiring attribute information from equipment An information acquisition device and a display device for displaying the location information and attribute information of the facility, and the search result of the facility search device selects a plurality of facility candidates. In this case, the image of the selection candidate is enlarged or reduced in accordance with the distance between the site and the position of the selection candidate, so that the size of the image taken at the site matches the size of the image taken at the site. Superimpose the reduced images of the above selection candidates to calculate the matching rate, identify the selection candidate with the highest matching rate, and display the specified equipment target attribute information on the display screen of the mobile terminal It is.

  According to the equipment position automatic recognition apparatus according to the present invention, the target equipment can be accurately identified only by photographing the target equipment with the image photographing device built in the mobile terminal, and the attribute information of the equipment is stored in the mobile terminal. Can be displayed on the screen.

The block diagram which shows the outline | summary structure of the equipment position automatic recognition apparatus in this invention. The conceptual diagram which shows the usage example of this invention. FIG. 6 shows an example of a screen of the display device in Embodiment 1 of the present invention. Explanatory drawing of the registration condition of prior image data in this invention. The flowchart in Embodiment 1 of this invention. Explanatory drawing of the image analysis in Embodiment 1 of this invention. The figure which shows the example of a screen of the display apparatus in Embodiment 2 of this invention. The schematic block diagram of the equipment position automatic recognition apparatus in Embodiment 3 of this invention. Schematic configuration block diagram of an equipment position automatic recognition apparatus in Embodiment 4 of the present invention The flowchart in Embodiment 5 of this invention. The conceptual diagram which shows the usage example in Embodiment 6 of this invention.

Embodiment 1 FIG.
A first embodiment of the present invention will be described below with reference to FIGS.
FIG. 1 is a diagram showing the configuration of an apparatus according to Embodiment 1 of the present invention.

In FIG. 1, an image capturing device 2, a position information acquisition device 3, an orientation information acquisition device 4, an equipment search device 5, an image analysis processing device 7, an attribute information acquisition device 9, a map, The display device 11 is provided, the equipment position information is obtained from the equipment position database 6 through the equipment search device 5, the equipment image information is obtained from the equipment image database 8 through the image analysis processing device 7, and the attributes are acquired. Equipment attribute information is acquired from the equipment attribute database 10 via the information acquisition device 9.
In the following drawings, the same or similar reference numerals are given to the same or similar parts.

Hereinafter, Embodiment 1 of the present invention will be described with reference to FIG. 2 and FIG.
FIG. 2 shows an example in which the utility pole equipment is inspected by the mobile terminal 1.

  In FIG. 2, a worker 12 holds the mobile terminal 1 and goes to the inspection site. The first utility pole 13, the second utility pole 14, and the third utility pole 15 are adjacent to each other at the inspection site. The worker 12 photographs the first power pole 13 with a camera. As a result of the photographing, the map display device 11 of the mobile terminal 1 shown in FIG.

  The image capturing device 2 is a camera built in the mobile terminal 1 and is a device capable of capturing still images and moving images. The location information acquisition device 3 is a device capable of three-point survey using GPS built in the mobile terminal 1, radio waves from radio LAN and mobile phone base stations, and location information (latitude and longitude) of the mobile terminal 1. It is a device that acquires. The azimuth information acquisition device 4 is a device that acquires azimuth information (degrees) from the direction in which the camera of the mobile terminal 1 built in the mobile terminal 1 is facing. The equipment search device 5 uses the equipment image acquired from the image capturing device 2, the position information acquired from the position information acquisition device 3, and the azimuth information acquired from the azimuth information acquisition device 4 to use the equipment position database 6, the equipment image database 8, It is a device that acquires the location of equipment and equipment attributes from the equipment attribute database 10. The image analysis processing device 7 specifies the target facility from the plurality of facility data candidates in the facility search device 5 using the position information acquired from the position information acquisition device 3 and the direction information acquired from the direction information acquisition device 4. It is a device to do. The attribute information acquisition device 9 is a device that acquires the attribute information of the target facility from the facility attribute database 10. The map display device maps the facility position information acquired by the facility search device 5 to a position on the map, and displays the attribute information acquired by the attribute acquisition device 9 on the map in a list or other display method.

  Next, the facility image database 8 will be described. As shown in FIG. 4, in the equipment image database 8, equipment information such as IDs, image information, and positions when the equipment to be managed is photographed from a plurality of directions (8 directions in the example of FIG. 4). Information (latitude / longitude) and azimuth information (degree) are registered. This registration information is registered in advance before using the system.

The processing flow of the first embodiment will be described with reference to FIGS. In step S <b> 100, the worker 12 takes an image of the utility pole 13 using the mobile terminal 1. In step S101, the image capturing apparatus 2 creates a captured image. In step S <b> 102, the position information acquisition device 3 acquires position information of the mobile terminal 1. In step S103, the orientation information acquisition apparatus 4 acquires orientation information of the mobile terminal 1. In step S <b> 104, the facility search device 5 acquires facility information included within an arbitrary distance from the location information acquired in step S <b> 102 from the facility location database 6. The equipment information includes equipment ID and equipment position information.
In step S105, it is determined whether or not the target facility candidate has been narrowed down to one. If it is narrowed down to one case (YES in step S105), the process jumps to step S110.

When a plurality of candidates are selected in step S104 (NO in step S105), the facility candidates are narrowed down to one by the processing in steps S106 to S109.
In step S106, the image analysis apparatus 7 acquires from the facility image database 8 an image having azimuth information close to the azimuth information acquired in step S103 and the distance between the image and the facility, using the equipment ID selected in step S104 as a key. Select candidate candidates. There are two acquisition results, which are images 18 and 19 in FIG. In step S107, the images 20 and 21 are obtained by enlarging / reducing the target candidate images 18 and 19 according to the distance ratio with the equipment extracted in step S104.
In step S108, the edge information of the photographed image 17 is acquired, and the coincidence rate between this information and the enlarged / reduced images 20 and 21 of the target candidates 18 and 19 is compared. When comparing the images, the center positions of the images are matched, and the matching rate in the enlarged and reduced images is calculated. In step S109, the equipment with the highest matching rate is determined as the target equipment from the result of step S108.
In step S110, the attribute information of the equipment acquired in step S104 or step S109 is acquired from the equipment attribute database 10. In step S111, the position information acquired in step S104 or step S109 and the attribute information acquired in step S110 are displayed on the map of the mobile terminal 1.

  As described above, according to the first embodiment, the worker 12 can accurately identify the target facility only by image capturing by the mobile terminal 1 and can display necessary information on the screen of the mobile terminal. There is an effect that the retrieval of equipment objects, the map, and the attribute information display can be made efficient.

Embodiment 2. FIG.
In the first embodiment described above, the search result is displayed on the map at the same time as the position and the attribute information as shown in FIG. 3. As shown, only the attribute information may be displayed in a tabular format 22. Thereby, since the information of an equipment can be operated immediately, there exists an effect which can implement equipment information operation simply.

Embodiment 3 FIG.
In the above description, the image photographing device 2 is used as input information. However, the image photographing device 2 may be replaced with a moving image photographing device 23 as shown in FIG. As a result, the input information of the image search device 7 can be a plurality of images, and the number of search samples is increased, so that the search accuracy is further improved.

Embodiment 4 FIG.
Regarding the first embodiment, the position information acquisition device 3 uses the GPS built in the mobile terminal 1. This is used as a high-accuracy position information acquisition device 24 that uses position information acquired by a positioning method such as DGPS (Differential GPS) realized by a GPS dedicated terminal as shown in FIG. It is good also as composition to do. As a result, it is possible to perform alignment with higher accuracy and to improve the accuracy of facility search.

Embodiment 5. FIG.
In the above description, the image used in the image analysis processing device 7 is temporarily used. However, as shown in step S200 of FIG. 10, a process for registering the input image in the image database 8 may be added. Good. This increases the number of images to be sampled for each search, thereby improving the search accuracy.

Embodiment 6 FIG.
In the above description, the search method using the photographed image is used. However, when the marker is added to the equipment as shown in FIG. 11 and the marker can be recognized, the position information held by the marker is also displayed in the equipment search device 5. It is good also as an apparatus used as input information. For example, several types of markers are prepared according to the height and thickness of the utility pole, material, transmission voltage, address (town name), installation date, etc., and attached to the equipment. In this way, marker information is added as input information, which has the effect of improving search accuracy.

  DESCRIPTION OF SYMBOLS 1 Mobile terminal, 2 Image photographing device, 3 Position information acquisition device, 4 Direction information acquisition device, 5 Equipment search device, 6 Equipment position database, 7 Image analysis processing device, 8 Equipment image database, 9 Attribute information acquisition device, 10 Equipment Attribute database, 11 map display device, 12 worker, 13 first power pole, 14 second power pole, 15 third power pole, 16 attribute information screen, 17 photographed image, 18, 19 target candidate image, 20, 21 Image after enlargement / reduction, 22 Attribute information displayed in tabular form, 23 Movie shooting device, 24 High-accuracy position information acquisition device, 25 Marker.

Claims (7)

  An image photographing device built in the mobile terminal for photographing an image at the site, a position information obtaining device for obtaining the position information of the mobile terminal, a direction information obtaining device for obtaining the direction information of the mobile terminal, and a photographed image -Equipment search device for selecting equipment candidates from location information of mobile terminals-Orientation information of mobile terminals, image analysis processing device for specifying equipment from captured images, and pre-photographed equipment used for image matching Equipment image database for storing the image of the image and the location information / orientation information taken from it, the equipment location database in which the equipment location information is registered, the equipment database in which equipment attribute information is registered, and the attributes from the equipment Equipment position automatic recognition device comprising an attribute information acquisition device for acquiring information and a display device for displaying the position information and attribute information of the equipment And when the search result of the said equipment search device selected a plurality of equipment candidates, it was photographed on-site by enlarging or reducing the selection candidate image according to the distance between the site and the position of the selection candidate. After matching the size with the image, the image of the selection on the spot and the enlarged or reduced selection candidate image are overlapped to calculate the matching rate, and the selection candidate with the highest matching rate is identified and identified. An equipment location automatic recognition device that displays equipment target attribute information on a display screen of a mobile terminal.   The equipment position automatic recognition apparatus according to claim 1, wherein the attribute information of the specified equipment is displayed together with a map or a photographed image displayed on the display screen of the mobile terminal.   2. The equipment position automatic recognition apparatus according to claim 1, wherein the specified equipment attribute information is displayed in a table format on a display screen of a mobile terminal.   2. The equipment position automatic recognition device according to claim 1, wherein the amount of information to be searched is increased by replacing the image photographing device of the mobile terminal with a moving image photographing device.   2. The equipment position automatic recognition apparatus according to claim 1, further comprising means for replacing the position information acquisition apparatus with an external high-accuracy position information acquisition apparatus.   2. The facility according to claim 1, further comprising an image registration device for registering an image specified by the image analysis processing device, wherein the image specified by the image analysis processing device is used in a facility search from the next time. Automatic position recognition device.   2. The equipment position automatic recognition apparatus according to claim 1, wherein a marker is added to the target equipment, and the equipment search is performed by using the photographing information of the marker together with the photographed image of the equipment.

Images