JP5634925B2 - Maintenance information display device, maintenance information display method, and program - Google Patents

Description

  The present invention relates to a maintenance information display device that displays information related to a maintenance object.

  2. Description of the Related Art Conventionally, there has been known an apparatus that calculates a display position of display information related to a maintenance target device using a light emitting RFID tag attached to the maintenance target device and displays the display information at the calculated display position ( For example, see Patent Document 1).

JP 2007-18188 A

  However, in the above conventional example, display information corresponding to the maintenance target device can be displayed, but there is a problem that a display smaller than that cannot be performed. For example, for the entire maintenance target device, it is possible to display items that should be noted during maintenance, maintenance procedures, etc., but it is not possible to display maintenance information for that device part. could not.

  The present invention has been made to solve the above-described problems, and provides a maintenance information display device and the like that can display maintenance-related information not only on the maintenance target itself but also on the maintenance target part. Objective.

In order to achieve the above object, the maintenance information display device according to the present invention has one or more pieces of overall information including overall feature information that is information on characteristics of the entire maintenance target and overall maintenance information that is information on maintenance of the maintenance target. A partial information storage unit that stores one or more pieces of partial information including a whole information storage unit to be stored, partial specification information for specifying a maintenance target portion, and partial maintenance information that is information related to maintenance of the maintenance target portion And a reception unit that receives a shooting instruction, a shooting unit that performs shooting according to the shooting instruction received by the reception unit, and obtains a shot image, and overall feature information that matches the shot image acquired by the shooting unit, or When the specifying unit specifies the entire feature information, the general maintenance information corresponding to the entire feature information is displayed. When the specific portion identified the portion specifying information is obtained and a display unit for displaying the partial maintenance information corresponding to the partial identification information.
With such a configuration, the overall maintenance information can be displayed for the maintenance target, and the partial maintenance information can be displayed for the part to be maintained. As a result, it is possible to display detailed maintenance information even for the detailed parts of the maintenance object, and to appropriately support the maintenance of the maintenance object.

In the maintenance information display device according to the present invention, when the specifying unit specifies the entire feature information, the display unit displays the entire feature information in the photographed image acquired by the photographing unit. When the specifying unit specifies the part specifying information, the partial maintenance information corresponding to the part specifying information is specified by the part specifying information in the captured image acquired by the shooting unit. You may display corresponding to a part.
With such a configuration, it is possible to easily grasp which portion of the displayed maintenance information corresponds to which portion has been photographed.

In the maintenance information display device according to the present invention, the entire feature information may be an entire image to be maintained.
With such a configuration, it is possible to display maintenance information corresponding to the entire maintenance target by determining whether the entire image of the maintenance target matches the captured image.

  Further, in the maintenance information display device according to the present invention, the part specifying information may be information on characteristics relating to a part to be maintained.

In the maintenance information display device according to the present invention, the part specifying information may be an image of a part to be maintained.
With such a configuration, it is possible to display maintenance information corresponding to the maintenance target portion by determining whether the image of the maintenance target portion matches the captured image.

Further, in the maintenance information display device according to the present invention, the reception unit also receives an instruction for enlargement / reduction, and the display unit displays a captured image captured by the imaging unit,
The captured image displayed by the display unit is zoomed in / zoomed out in accordance with an enlargement / reduction instruction received by the reception unit, and the part specifying information is information indicating an entire region to be maintained, The specifying unit specifies partial specifying information indicating the zoomed-in area when a part of the part that matches the whole feature information is zoomed in after specifying the whole feature information that matches the captured image. Also good.
With such a configuration, the maintenance target portion is specified after the entire maintenance target is specified, and therefore, it is possible to specify with higher accuracy than when the maintenance target portion is suddenly specified.

In the maintenance information display device according to the present invention, the overall maintenance information may be information related to maintenance procedures.
With such a configuration, for example, first, information related to the maintenance procedure, which is overall maintenance information, is displayed corresponding to the entire maintenance target, and then the partial maintenance information is displayed corresponding to each part of the maintenance target. Detailed information such as a certain setting can be displayed.

In the maintenance information display device according to the present invention, the reception unit also accepts the end of the maintenance for the maintenance target, and provides maintenance target identification information for identifying the maintenance target and a route from the maintenance target to the next maintenance target. A maintenance route information storage unit that stores one or more maintenance route information having route information to be displayed, and the display unit identifies a maintenance target for which maintenance has been completed when the reception unit receives the completion of the maintenance. You may also perform the display regarding the route information corresponding to object identification information.
With such a configuration, it becomes possible to sequentially navigate the position of the maintenance target according to the maintenance route information, and support the maintenance work.

The maintenance information display device according to the present invention further includes a parent-child relationship information storage unit that stores parent-child relationship information, which is information for correlating overall feature information and partial identification information, corresponding to the same maintenance object, the identification unit After specifying the whole feature information compatible with the captured image (this is referred to as the first captured image), the partial specifying information compatible with the captured image and the other captured image (referred to as the second captured image) In the case of specifying, the part specifying information suitable for the second photographed image may be identified from the part specifying information associated with the whole feature information suitable for the first photographed image and the parent-child relationship information. .
With this configuration, even when there are parts that are similar to different maintenance targets, it is possible to reduce misjudgments when specifying the part identification information, and display more accurate partial maintenance information. Is possible. In addition, since the part specifying information for determining conformity is narrowed down, the processing speed is also improved. The second photographed image may be a photographed image photographed immediately after the first photographed image, or may not be so. In the latter case, for example, when a captured image that conforms to any of the overall feature information is acquired, the captured image becomes the first captured image. Until acquired, all acquired captured images may be the second captured image. Therefore, for example, when another captured image is acquired after the first captured image is acquired, it is determined whether the captured image matches any of the whole feature information. When the image becomes the first captured image newly and does not match, the captured image is used as the second captured image, and the second captured image is obtained from the partial specifying information corresponding to the overall feature information that is compatible with the first captured image. The part specifying information that conforms to the above may be specified.

  According to the maintenance information display device or the like according to the present invention, maintenance information can be displayed for the entire maintenance target or a part thereof, and the maintenance of the maintenance target can be supported.

The block diagram which shows the structure of the maintenance information display apparatus by Embodiment 1 of this invention. The flowchart which shows operation | movement of the maintenance information display apparatus by the embodiment The flowchart which shows operation | movement of the maintenance information display apparatus by the embodiment The figure which shows an example of the whole information in the embodiment The figure which shows an example of the whole characteristic information in the embodiment The figure which shows an example of the partial information in the embodiment The figure which shows an example of the partial specific information in the embodiment The figure which shows an example of the maintenance route information in the embodiment The figure which shows an example of the display in the embodiment The figure which shows an example of the display in the embodiment The figure which shows an example of the display in the embodiment The figure which shows an example of the display in the embodiment The figure which shows an example of the display in the embodiment The figure which shows an example of the display in the embodiment The figure which shows an example of the display in the embodiment The figure which shows an example of the parent-child relationship information in the embodiment The figure which shows an example of the area | region corresponding to the several part in the whole characteristic information in the embodiment The figure which shows another example of the partial information in the embodiment The figure which shows an example of the three-dimensional maintenance information in the embodiment Schematic diagram showing an example of the appearance of the computer system in the embodiment The figure which shows an example of a structure of the computer system in the embodiment

  Hereinafter, a maintenance information display device according to the present invention will be described using embodiments. In the following embodiments, components and steps denoted by the same reference numerals are the same or equivalent, and repetitive description may be omitted.

(Embodiment 1)
A maintenance information display apparatus according to Embodiment 1 of the present invention will be described with reference to the drawings. The maintenance information display device according to the present embodiment displays information related to maintenance on the whole and part of the maintenance target.

  FIG. 1 is a block diagram showing a configuration of a maintenance information display device 1 according to the present embodiment. The maintenance information display device 1 according to the present embodiment includes an overall information storage unit 11, a partial information storage unit 12, a reception unit 13, a shooting unit 14, a shot image storage unit 15, a specifying unit 16, and a current position. An acquisition unit 17, a map information storage unit 18, a maintenance route information storage unit 19, and a display unit 21 are provided. The maintenance information display device 1 may be, for example, a mobile phone or PDA (Personal Digital Assistant) having a photographing function, a map display function, a navigation function, or the like, or a PND (Personal Navigation Device).

  The overall information storage unit 11 stores one or more pieces of overall information. The overall information is information having overall feature information that is information on characteristics of the entire maintenance target and overall maintenance information that is information on maintenance of the maintenance target. The overall feature information and the overall maintenance information included in one overall information are information corresponding to the same maintenance object. The maintenance may be, for example, maintenance, processing performed for maintenance or management, repair, or other processing for preparing a maintenance target. The maintenance target may be anything as long as it is a target for maintenance. For example, it may be a certain device or machine, or may be a building such as a building or a plant. Further, the maintenance target may be the whole plant or system, or a part thereof. For example, a piping portion of a large-scale plant may be a maintenance target, and a power supply device for the plant may be a maintenance target. In addition, each device in the system including the A device, the B device, and the C device may be a maintenance target. The overall feature information is information used for identifying the maintenance target in the captured image, and may be, for example, the entire image of the maintenance target, or the maintenance target extracted from the entire image of the maintenance target. Features (for example, information indicating contours, corner points detected by corner detection, etc., information indicating feature points such as line end points, branch points, intersections, etc.) (Information indicating the characteristics of). The overall maintenance information is information relating to maintenance corresponding to the entire maintenance target. For example, the maintenance information may be information relating to maintenance procedures, or information indicating an internal structure corresponding to the entire maintenance target. It may be a set value corresponding to the entire object, a theoretical value or standard value related to output, and other information related to maintenance. The information related to the maintenance procedure may indicate, for example, the order of the parts to be maintained, may indicate the processing performed in maintenance in order, or may be information on other maintenance procedures. Good. In addition, the information indicating the internal structure corresponding to the entire maintenance target may be, for example, a two-dimensional image indicating the internal structure, or information of three-dimensional computer graphics corresponding to the internal structure, Information indicating other internal structures may be used. The set value may be, for example, a value set as a maintenance target. The theoretical value and the standard value may be, for example, a theoretical ideal value that is output by the maintenance target or a standard value based on experience. The overall maintenance information may be, for example, a password that must be input when starting the maintenance process. The overall information is usually information that associates the overall feature information and the overall maintenance information on a one-to-one basis, but the overall information is information that associates a plurality of overall feature information with a single overall maintenance information. Also good. That is, the overall feature information and the overall maintenance information may have a many-to-one relationship. For example, a plurality of pieces of overall feature information corresponding to images in a plurality of directions may be associated with one piece of overall maintenance information. In that case, for example, a plurality of pieces of whole feature information and one piece of whole maintenance information may be included in one piece of whole information. For example, for a certain maintenance target, overall feature information that is a front image, overall feature information that is an image on the right side, overall feature information that is an image on the left side, overall feature information that is a plane (upper surface) image, There may be general information including general feature information that is an image and general maintenance information.

  The process in which one or more whole information is memorize | stored in the whole information storage part 11 does not ask | require. For example, one or more overall information may be stored in the overall information storage unit 11 via a recording medium, and one or more overall information transmitted via a communication line or the like may be stored in the overall information storage unit 11. It may be stored, or one or more pieces of overall information input via the input device may be stored in the overall information storage unit 11. Storage in the overall information storage unit 11 may be temporary storage in a RAM or the like, or may be long-term storage. The overall information storage unit 11 can be realized by a predetermined recording medium (for example, a semiconductor memory, a magnetic disk, an optical disk, etc.). Further, the overall feature information and the overall maintenance information may be the overall feature information and the overall maintenance information itself, or may be a pointer or an address indicating a position where the overall feature information or the like is stored. The same applies to other information.

  The partial information storage unit 12 stores one or more pieces of partial information. The partial information is information having partial specifying information for specifying a maintenance target part and partial maintenance information that is information related to the maintenance of the maintenance target part. The part specifying information and the partial maintenance information included in one piece of partial information are information corresponding to the same part to be maintained. The maintenance target part is at least a part of the maintenance target. For example, when the maintenance target is an apparatus or a machine, one unit constituting the apparatus or machine may be a part to be maintained. Further, for example, when the maintenance target is a power supply device of a plant, the display panel of the power supply device may be a maintenance target portion. The part specifying information may be, for example, characteristic information regarding the part to be maintained. The feature information related to the maintenance target portion is the same information as the overall feature information except that the entire maintenance target is a portion. The feature information relating to the maintenance target part is information used to identify the maintenance target part in the photographed image. For example, the maintenance target part image may be an image of the maintenance target part. It may be the feature quantity of the part to be maintained extracted from the above. The partial maintenance information is information related to the maintenance corresponding to the part to be maintained, and is the same as the overall maintenance information except that the entire maintenance target is a part. The partial maintenance information may be, for example, information indicating the internal structure corresponding to the part to be maintained, such as a setting value corresponding to the part to be maintained, a theoretical value or standard value related to output, and other information related to maintenance. There may be. In addition, as with the overall information, the partial information is usually information that associates the partial identification information and the partial maintenance information on a one-to-one basis. However, the partial information includes a plurality of partial identification information and a piece of partial maintenance information. It may be information to be associated. That is, the part specifying information and the part maintenance information may have a many-to-one relationship. For example, a plurality of pieces of partial identification information corresponding to images in a plurality of directions may be associated with one piece of partial maintenance information. In that case, for example, one piece of partial information may include a plurality of pieces of partial identification information and one piece of partial maintenance information. For example, for a certain maintenance target part, part specifying information that is a front image, part specifying information that is a right side image, part specifying information that is a left side image, part specifying information that is a plane (top) image, There may be partial information including partial specifying information that is an image on the back and partial maintenance information.

  The process in which one or more partial information is memorize | stored in the partial information storage part 12 is not ask | required. For example, one or more pieces of partial information may be stored in the partial information storage unit 12 via a recording medium, and one or more pieces of partial information transmitted via a communication line or the like may be stored in the partial information storage unit 12. Alternatively, one or more pieces of partial information input via the input device may be stored in the partial information storage unit 12. The storage in the partial information storage unit 12 may be temporary storage in a RAM or the like, or may be long-term storage. The partial information storage unit 12 can be realized by a predetermined recording medium (for example, a semiconductor memory, a magnetic disk, an optical disk, etc.).

  The receiving unit 13 receives a shooting instruction. The shooting instruction may be, for example, an instruction for shooting a single still image, or may be an instruction to start shooting when shooting is performed continuously. For example, the reception unit 13 may receive a shooting instruction by pressing a shutter button, may receive a shooting instruction on a touch panel or the like, may receive a voice shooting instruction, or may perform shooting by other methods. An instruction may be accepted. The shutter button may be a dedicated button such as a digital still camera, or may be a button shared with other functions such as a mobile phone. The receiving unit 13 may also receive an enlargement / reduction instruction. The enlargement / reduction may be an instruction for enlargement / reduction of photographing or an instruction for enlargement / reduction of display. Moreover, the reception part 13 may also receive the completion | finish of the maintenance with respect to a maintenance object. In addition, the reception unit 13 may perform other receptions. For example, the receiving unit 13 may receive an instruction to perform processing by the specifying unit 16. The accepting unit 13 may accept, for example, a photographing instruction input from an input device (for example, a keyboard, a mouse, a touch panel, etc.), and a photographing instruction transmitted via a wired or wireless communication line. You may receive it. The accepting unit 13 may or may not include a device for accepting (for example, a modem or a network card). The receiving unit 13 may be realized by hardware, or may be realized by software such as a driver that drives a predetermined device.

  The imaging unit 14 performs imaging according to the imaging instruction received by the reception unit 13 and acquires a captured image. The imaging unit 14 accumulates the acquired captured image in the captured image storage unit 15. The captured image may be, for example, a still image or a moving image. In addition, the photographing unit 14 acquires a photographed image by using an imaging element such as a CCD or CMOS, an optical lens, or the like. The imaging unit 14 may perform zoom-in / zoom-out according to the enlargement / reduction instruction received by the reception unit 13. The data format of the captured image is not limited. For example, it may be JPEG, TIFF, or RAW data. The method of obtaining a photographed image by photographing is already known by a digital camera or the like, and detailed description thereof is omitted.

  The captured image storage unit 15 stores the captured image acquired by the imaging unit 14. The captured images are accumulated by the imaging unit 14 as described above. Storage in the captured image storage unit 15 may be temporary storage in a RAM or the like, or may be long-term storage. The captured image storage unit 15 can be realized by a predetermined recording medium (for example, a semiconductor memory, a magnetic disk, an optical disk, or the like).

  The specifying unit 16 specifies overall feature information that matches the captured image acquired by the capturing unit 14 or partial specifying information that matches the captured image acquired by the capturing unit 14. The whole feature information and the part specifying information that match the photographed image may be the whole feature information and the part specifying information that match at least part of the photographed image. The adaptation is performed using a so-called pattern matching technique. That is, the similarity between the captured image and the entire feature information is calculated, and when the similarity is equal to or greater than a threshold value, it may be determined that the two match. When the entire feature information or the partial specifying information is an image, the specifying unit 16 extracts a feature amount such as a contour or a feature point from the image and compares it with the feature amount extracted from the captured image. It may be determined whether or not it is suitable, or it may be determined by comparing the images themselves. In addition, when the entire feature information or the part specifying information is a feature amount of the image, the specifying unit 16 compares the entire feature information that is the feature amount and the feature amount extracted from the photographed image. Depending on the case, it may be determined whether or not it is suitable. In addition, when the captured image matches the entire feature information or the partial specification information, the specifying unit 16 may also specify the region of the captured image that matches. For example, the specifying unit 16 may store information indicating the area in a recording medium (not shown). The information indicating the area may be information indicating the outline of the area. Note that the specifying unit 16 first determines whether or not there is general feature information that matches the captured image. If there is, the specifying unit 16 does not specify the part specifying information, and if it does not exist, the portion that matches the captured image. It may be determined whether specific information exists. In addition, when it is determined by the photographing unit 14 that the entire maintenance target is photographed and then the maintenance target portion is photographed, the specifying unit 16 firstly captures the entire maintenance target image. The overall feature information may be specified for the part, and then the part specifying information may be specified for the captured image of the part to be maintained. When specifying the part specifying information, the part specifying information may be specified using only the part specifying information related to the maintenance object that is the same as the whole feature information that is adapted to the captured image in specifying the whole feature information. By doing in this way, first, the maintenance object can be narrowed down by the whole feature information, and then the portion in the maintenance object can be narrowed down. For example, even if the objects are different maintenance objects, the parts to be maintained may be similar to each other. For this reason, if the identification is performed using only the partial identification information, there is a possibility that erroneous identification is performed. On the other hand, even in such a case, after narrowing down the maintenance target, by narrowing down the portion of the maintenance target, it is possible to perform appropriate specification with fewer errors. Note that the processing by the specifying unit 16 is already known as image pattern matching processing, and a detailed description thereof will be omitted.

  The current position acquisition unit 17 acquires the current position of the maintenance information display device 1. The acquisition of the current position may be performed using, for example, a GPS (Global Positioning System) or an autonomous navigation device such as a gyro, and both may be used to compensate each other's drawbacks. May be. The current position acquisition unit 17 detects the movement of the maintenance information display device 1 using a three-dimensional acceleration sensor, a gyro, or the like, for example, by using the GPS if it is outdoors or by autonomous navigation if indoors. Then, by integrating the detected acceleration and angular velocity, the moving direction and the moving distance may be calculated to acquire the current position. In addition, the current position acquisition unit 17 may acquire a current position by performing three-point surveying indoors using an RFID (Radio Frequency Identification), a wireless LAN, Bluetooth (registered trademark), or the like. The current position may be acquired via a device fixed at a predetermined indoor location such as a camera or a camera. The current position acquisition unit 17 may include a three-dimensional orientation sensor (three-dimensional compass) and may acquire a three-dimensional orientation. Needless to say, the acquisition method of the current position is not limited to these. For example, the current position may be acquired using a base station nearest to the mobile phone. The current position acquired by the current position acquisition unit 17 may be coordinates indicating latitude and longitude, for example, or other coordinates. In the present embodiment, a case where the current position is latitude / longitude will be described.

  The map information storage unit 18 stores map information that is information about the map. The map information may be map image information, for example. This image information may be raster data (bitmap data) or vector data, for example. When the image information is raster data, the map information may include image information corresponding to a plurality of scales. For example, map information may include large-scale image information, medium-scale image information, and small-scale image information for the same region. Moreover, map information shows the map divided | segmented into the tile shape, The map of various area | regions can be displayed now by combining suitably. Here, the “map” may be a topographic map, a topographic map, a geological map, a land use map, a house map, a route map, a road map, a guide map, or the like. The map information can be used for route search. That is, the map information may indicate the position of the road, for example. In addition, the map information may be information that allows the user to know road attributes (for example, speed limit, main road, side road, etc.). For example, this map information may be in the KIWI format used for navigation. In addition, the “map” may be an aerial photograph or satellite photograph in which the topography, roads, etc. can be grasped, or those in which symbols or characters are entered. In the map information, it is assumed that the correspondence between each point on the map and the coordinates (position) can be known. The coordinates may be coordinates with an origin at a certain reference point (the coordinates may be distances, for example), may be latitude / longitude, or may be information that can identify other positions. . The coordinates themselves may be included in the map information. In the present embodiment, a case where the coordinates are latitude / longitude will be described. The “map” may be a floor plan or a bird's eye view corresponding to each floor of a building having a plurality of floors. In this case, it is assumed that the map information can know the correspondence between each point on the map and the three-dimensional coordinates (position) including the height (altitude) direction. The coordinate in the height direction may be indicated by, for example, a height distance (meter or the like), or may be indicated by a floor number. In addition, the map information may include character information related to place names and topography such as mountains and rivers. In the map information, it may be set which is a specific direction such as north. The map information is known as a two-dimensional online map, an electronic map, etc., and detailed description thereof is omitted.

  The process in which map information is memorize | stored in the map information storage part 18 is not ask | required. For example, map information may be stored in the map information storage unit 18 via a recording medium, and map information transmitted via a communication line or the like is stored in the map information storage unit 18. May be. The storage in the map information storage unit 18 may be temporary storage in RAM or the like, or may be long-term storage. The map information storage unit 18 can be realized by a predetermined recording medium (for example, a semiconductor memory, a magnetic disk, an optical disk, etc.).

  The maintenance route information storage unit 19 stores one or more maintenance route information. The maintenance route information is information having maintenance target identification information for identifying a maintenance target and route information indicating a route from the maintenance target to the next maintenance target. The route information may be information indicating the positions of a number of points that constitute a route from the start point to the end point, for example. The position may include coordinates in the height (altitude) direction. That is, the position may be information on three-dimensional coordinates. The route information may be created manually, for example, or may be automatically created using a route search method or the like. In the latter case, the route information may be generated and accumulated during use of the maintenance information display device 1, for example. For example, a route information generation unit (not shown) generates route information from a maintenance target position where maintenance has been completed to the next maintenance target using a route search technique, and the generated route information and maintenance that has been completed maintenance. Maintenance route information including maintenance object identification information for identifying a target may be stored in the maintenance route information storage unit 19. In the route search, for example, Dijkstra method may be used, A * algorithm may be used, Bellman-Ford method may be used, Warsal-Floyd method may be used, An algorithm may be used. This route generation process is already known and will not be described in detail. For example, in an online map, when a latitude / longitude of a start point and a latitude / longitude of an end point are input, a route from the start point to the end point is displayed (for example, “http://maps.google.co. jp / maps "). In the present embodiment, a case where two or more pieces of maintenance route information are stored in the maintenance route information storage unit 19 will be described. The maintenance target identification information may be, for example, a maintenance target name, a maintenance target ID, or information that can identify other maintenance targets. In the maintenance route information stored in the maintenance route information storage unit 19, for example, the order of maintenance objects to be maintained by the user of the maintenance information display device 1 may be known. For example, maintenance route information may be arranged in the order of maintenance, or information indicating the order of maintenance may be included in the maintenance route information. In addition, information such as a flag indicating whether or not the maintenance has been completed may or may not be included in the maintenance route information.

  The process in which one or more maintenance route information is memorize | stored in the maintenance route information storage part 19 is not ask | required. For example, one or more maintenance route information may be stored in the maintenance route information storage unit 19 via a recording medium, and one or more maintenance route information transmitted via a communication line or the like may be stored in the maintenance route information. It may be stored in the storage unit 19, or one or more maintenance route information input via the input device may be stored in the maintenance route information storage unit 19. The storage in the maintenance route information storage unit 19 may be a temporary storage in a RAM or the like, or may be a long-term storage. The maintenance route information storage unit 19 can be realized by a predetermined recording medium (for example, a semiconductor memory, a magnetic disk, an optical disk, etc.).

  The display unit 21 displays the overall maintenance information corresponding to the entire feature information when the specifying unit 16 specifies the entire feature information, and displays the partial specifying information when the specifying unit 16 specifies the partial specifying information. Display the corresponding partial maintenance information. In addition, when the specifying unit 16 specifies the entire feature information, the display unit 21 corresponds to the entire maintenance information corresponding to the entire feature information corresponding to the entire feature information in the captured image acquired by the shooting unit 14. When the specifying unit 16 specifies the part specifying information, the partial maintenance information corresponding to the part specifying information is associated with the part specified by the part specifying information in the captured image acquired by the shooting unit 14. May be displayed. Alternatively, the display unit 21 may display overall maintenance information and partial maintenance information separately from the captured image. Here, “displaying in association with each other” only requires that the correspondence is understood as a result. For example, the overall maintenance information is displayed on a portion that matches the overall feature information in the captured image acquired by the imaging unit 14. Alternatively, the overall maintenance information and a portion that matches the overall feature information in the captured image acquired by the imaging unit 14 may be displayed linked with a line or other graphic. The display unit 21 may display a captured image captured by the capturing unit 14. Further, the display unit 21 may enlarge or reduce the displayed captured image in response to the enlargement / reduction instruction received by the reception unit 13. Further, the display unit 21 may display a subject to be photographed when the photographing unit 14 performs photographing. This is because the user can confirm what kind of shooting is performed. In addition, when the receiving unit 13 receives the completion of maintenance, the display unit 21 may display the route information corresponding to the maintenance target identification information for identifying the maintenance target for which the maintenance has been completed. The route information corresponding to the maintenance target identification information is route information included in the same maintenance route information as the maintenance target identification information. As a display related to the route information, the display unit 21 may display a figure (usually a linear figure) corresponding to the route indicated by the route information on a map, which is a so-called intuitive navigation (registered trademark). As described above, an image for guiding the route to the destination may be displayed on the photographed image photographed by the photographing unit 14, or navigation using other route information may be performed. When displaying a map, the display unit 21 reads only the map information of the area to be displayed from the map information storage unit 18 and displays it. Displaying map information means displaying a map image in the map information. The map image may display a place name, an orientation figure indicating north, a scale display indicating scale, and the like. Moreover, the display part 21 may display the mark which shows the position of the maintenance information display apparatus 1 on a map. The mark may be displayed according to the current position acquired by the current position acquisition unit 17. When the display unit 21 displays the route indicated by the route information on the map, the entire route may be displayed, or only the route in the vicinity of the current position may be displayed. The display unit 21 may be held by hand, such as a display such as a mobile phone, a smartphone, or a PDA, or may be a head mounted display.

  The display unit 21 may or may not include a display device (for example, a liquid crystal display) that performs such display. The display target may be displayed on another device. In that case, the display unit 21 may transmit information to be displayed to the outside of the apparatus. The display unit 21 may be realized by hardware, or may be realized by software such as a driver that drives a display device.

  Of the entire information storage unit 11, the partial information storage unit 12, the captured image storage unit 15, the map information storage unit 18, and the maintenance route information storage unit 19, any two or more storage units are the same. These recording media may be realized, or may be realized by separate recording media. In the former case, for example, an area that stores the entire information is the entire information storage unit 11, and an area that stores the partial information is the partial information storage unit 12.

Next, operation | movement of the maintenance information display apparatus 1 is demonstrated using the flowchart of FIG.
(Step S <b> 101) The receiving unit 13 determines whether a shooting instruction has been received. If a shooting instruction is accepted, the process proceeds to step S102. If not, the process proceeds to step S104.

  (Step S102) The photographing unit 14 performs photographing and obtains a photographed image.

(Step S <b> 103) The imaging unit 14 accumulates the acquired captured image in the captured image storage unit 15. Then, the process returns to step S101.
Note that when the photographing unit 14 continuously performs photographing or when a moving image is photographed, the processes of steps S102 and S103 may be repeatedly executed. In addition, when a moving image is shot, the moving image is accumulated. However, when only moving images are taken and not a moving image, the latest shot image is taken. Only the captured image storage unit 15 may be stored.

  (Step S104) The specifying unit 16 determines whether to specify the entire feature information or the partial specifying information. For example, the reception unit 13 may determine that the specific process is to be performed when receiving an instruction to perform the specification, and when the shooting unit 14 acquires a captured image, the specific process is performed. It may be determined that the process is to be performed, or it may be determined that the specific process is to be performed at another timing.

  (Step S105) The identification unit 16 performs a specific process such as overall feature information. Details of this processing will be described later with reference to the flowchart of FIG. The captured image used in this process is usually the latest captured image. Also, even when the captured image is a moving image, the latest frame constituting the moving image is normally used in this process.

  (Step S106) The specifying unit 16 determines whether or not the entire feature information or the partial specifying information can be specified in step S105. If the identification can be performed, the process proceeds to step S107, and if not, the process returns to step S101. When returning to step S101, it may be displayed that the maintenance information corresponding to the photographed image does not exist, or not.

  (Step S107) When the specifying unit 16 specifies the overall feature information in Step S105, the display unit 21 displays the overall maintenance information corresponding to the entire feature information, and the specifying unit 16 specifies the part specifying information. In the case where it is done, the partial maintenance information corresponding to the partial identification information is displayed. The display may be, for example, a display associated with a portion of the captured image that matches the overall feature information. When photographing by the photographing unit 14 is continuously performed, a portion of the photographed image that conforms to the entire feature information may move on the display screen. In that case, for example, the position where the general maintenance information is displayed may be moved according to the movement.

  (Step S108) The receiving unit 13 determines whether or not the end of maintenance for the maintenance target has been received. And when the completion of the maintenance is received, it progresses to step S109, and when that is not right, it returns to step S101. Here, the reception unit 13 may also receive maintenance object identification information for identifying a maintenance object for which maintenance has been completed.

  (Step S109) The display unit 21 refers to the maintenance route information storage unit 19 and determines whether or not there is maintenance route information including maintenance target identification information for identifying a maintenance target for which maintenance has been completed. And when it exists, it progresses to step S110, and when it does not exist, it returns to step S101. When returning to step S101, it may be displayed that all maintenance has been completed, or it may not be.

(Step S110) The display unit 21 performs display regarding route information corresponding to maintenance object identification information for identifying a maintenance object for which maintenance has been completed. This display may be performed, for example, until the user reaches the destination of the route information. Then, the process returns to step S101.
In the flowchart of FIG. 2, when specific processing is performed after the captured image is accumulated, the process may proceed from step S103 to step S105. In the flowchart of FIG. 2, the process is ended by power-off or a process end interrupt.

FIG. 3 is a flowchart showing details of the specific process (step S105) in the flowchart of FIG.
(Step S201) The identifying unit 16 sets the counter i to 1.

  (Step S202) The identifying unit 16 determines whether or not the i-th overall feature information stored in the overall information storage unit 11 matches the captured image. If it matches, the process proceeds to step S205, and if not, the process proceeds to step S203.

  (Step S203) The identifying unit 16 increments the counter i by 1.

  (Step S204) The specifying unit 16 determines whether or not the i-th overall feature information exists. If the i-th overall feature information exists, the process returns to step S202. If not, the process proceeds to step S206.

  (Step S205) The identifying unit 16 identifies the i-th overall feature information. The identification of the entire feature information may be, for example, storing the entire feature information of the identification target in a recording medium (not shown), or setting a flag indicating that the identification is performed in association with the entire feature information. It may be to do. The specifying unit 16 may also specify information indicating a portion of the captured image that matches the overall feature information. And it returns to the flowchart of FIG.

  (Step S206) The identifying unit 16 sets the counter i to 1.

  (Step S207) The specifying unit 16 determines whether or not the i-th partial specifying information stored in the partial information storage unit 12 matches the captured image. If it matches, the process proceeds to step S210; otherwise, the process proceeds to step S208.

  (Step S208) The identifying unit 16 increments the counter i by 1.

  (Step S209) The specifying unit 16 determines whether or not the i-th partial specifying information exists. If the i-th partial specifying information is present, the process returns to step S207; otherwise, the process returns to the flowchart of FIG. When returning to the flowchart of FIG. 2, overall feature information or the like has not been specified for the captured image.

  (Step S210) The specifying unit 16 specifies the i-th partial specifying information. The identification of the partial identification information may be, for example, storing the partial identification information of the identification target in a recording medium (not shown), or setting a flag indicating that the identification is performed in association with the partial identification information. It may be to do. Note that the specifying unit 16 may also specify information indicating a portion of the captured image that matches the portion specifying information. And it returns to the flowchart of FIG.

  Next, operation | movement of the maintenance information display apparatus 1 by this Embodiment is demonstrated using a specific example. In this specific example, it is assumed that the maintenance information display device 1 is a tablet PC (Personal Computer) with a photographing function. Further, in this specific example, a case will be described in which a maintenance object is a copy machine and a user maintains a copy machine for each department in a certain factory. Further, in this specific example, it is assumed that the overall information storage unit 11 stores a plurality of overall information shown in FIG. In FIG. 4, the overall ID for identifying the overall information, the overall feature information, and the overall maintenance information are associated with each other. In this specific example, it is assumed that the overall feature information and the overall maintenance information are associated one-to-one. For example, in the first overall information (first record) of the overall ID “1”, the overall feature information “F001” and the overall maintenance information “procedure 1:... Step 2:. Are associated. The overall feature information is information for identifying an entire image to be maintained. It is assumed that the image itself identified by the information is separately stored in the overall information storage unit 11. However, for convenience of explanation, an image identified by the overall feature information “F001” may be referred to as overall feature information “F001”. The same applies to other overall feature information. It is assumed that the entire feature information “F001” is an entire image of the maintenance target shown in FIG. Therefore, the maintenance target shown in FIG. 5 is maintained according to the procedure indicated by the overall maintenance information corresponding to the image “F001”.

  In this specific example, it is assumed that the partial information storage unit 12 stores a plurality of pieces of partial information shown in FIG. In FIG. 6, the partial ID for identifying the partial information, the partial specifying information, and the partial maintenance information are associated with each other. In this specific example, it is assumed that the partial specifying information and the partial maintenance information are associated one-to-one. For example, in the first partial information (first record) of the partial ID “1”, the partial identification information “P001” and the partial maintenance information “standard AAA value:... Standard BBB value:. It has been. The part specifying information is information for identifying an image of a part to be maintained. The image itself identified by the information is separately stored in the partial information storage unit 12. However, for convenience of explanation, an image identified by the partial identification information “P001” may be referred to as partial identification information “P001”. The same applies to the other part specifying information. The part specifying information “P001” and “P002” is assumed to be an image of the part to be maintained shown in FIG. Accordingly, for the maintenance target portion shown in FIG. 7A, the standard AAA value corresponding to the partial maintenance information “standard AAA value:... Standard BBB value:...” Corresponding to the image “P001”, etc. Maintenance will be carried out so that Since the standard value can be known from the partial maintenance information, an abnormal value can be easily found.

  In this specific example, it is assumed that the maintenance route information storage unit 19 stores a plurality of maintenance route information shown in FIG. In FIG. 8, maintenance object identification information and route information are associated with each other. For example, in the first maintenance route information (first record), the maintenance object identification information “ABC room copier” and the route information R001 are associated with each other. The route information R001 is route information indicating a route from the maintenance target identified by the “ABC room copy machine” to the maintenance target identified by the next maintenance target identification information “XYZ room copy machine”. To do. The route information R001 may be information such as (X101, Y101, 1F), (X102, Y102, 1F), (X103, Y103, 1F)... (X110, Y110, 3F). Each coordinate (X101, Y101, 1F), etc. constituting the route information R001 is information including two-dimensional coordinate information and a height direction coordinate indicating a floor number.

  First, the user goes to the position of the copy machine in the ABC room with the tablet PC that is the maintenance information display device 1, and operates the maintenance information display device 1 to start the process of displaying the maintenance route information. To do. Then, the photographed image of the camera existing on the opposite side of the touch panel of the maintenance information display device 1 is confirmed on the touch panel, and when the copy machine is displayed as shown in FIG. 9, the “shoot” button on the touch panel is tapped. To do. Then, according to the operation, the accepting unit 13 accepts an instruction for photographing, and passes to the photographing unit 14 that the instruction for photographing is accepted (step S101). Then, the photographing unit 14 acquires a photographed image at that time and accumulates it in the photographed image storage unit 15 (steps S102 and S103). The photographed image is an image displayed on the touch panel in FIG. Further, when the user takes a picture, the display on the touch panel is fixed with an image at the time of the photography.

  Next, when the user taps a “specific” button on the screen, the reception unit 13 receives an instruction to start a specific process and passes the instruction to the specification unit 16 through a route (not shown). Upon receiving the instruction, the specifying unit 16 determines that it is time to specify (step S104), and performs specific processing (step S105). Specifically, the specifying unit 16 refers to the entire information shown in FIG. 4 and determines whether or not the first entire feature information “F001” matches the captured image (steps S201 and S202). In this case, since the entire feature information is “F001” shown in FIG. 5 and the captured image is displayed on the touch panel in FIG. “F001” is identified as being compatible with the captured image, the overall ID “1” for identifying the entire information including the entire feature information “F001”, and the area in the captured image corresponding to the image of the entire feature information. The information shown is passed to the display unit 21 (steps S205 and S106). Then, the display unit 21 reads out the overall maintenance information from the overall information identified by the overall ID “1”, and superimposes the overall maintenance information on the area corresponding to the overall feature information “F001” received from the specifying unit 16. It is displayed (step S107). As a result, as shown in FIG. 10, the overall maintenance information is displayed on the image of the copying machine. Then, the user can perform maintenance by sequentially performing processing while viewing this display.

  In the maintenance, it is assumed that the user wants to know maintenance information about a specific part of the copy machine to be maintained. Then, it is assumed that the user taps the “shoot” button on the touch panel. Then, the maintenance information display device 1 enters a shooting mode, and a captured image of the camera is displayed on the touch panel. Then, while confirming the display, when the user taps the “shoot” button again in the state shown in FIG. 11 in which the part for which maintenance information is desired is displayed on the touch panel, the shooting is performed as described above. Images are acquired and stored (steps S101 to S103). The photographed image is the image displayed in FIG. After that, when the user taps the “specific” button, specific processing is performed as described above (steps S104 and S105). In this case, it is assumed that there is no overall feature information that matches the captured image in the overall information (steps S201 to S204). Then, the specifying unit 16 refers to the partial information shown in FIG. 6 and determines whether or not the first partial specifying information “P001” matches the captured image (steps S206 and S207). In this case, since the part specifying information is “P001” shown in FIG. 7A and the photographed image is displayed on the touch panel in FIG. 11, the specifying unit 16 determines that it matches, A partial ID “1” for identifying the partial information including the partial identification information “P001” and information indicating the area in the captured image corresponding to the image of the partial identification information are passed to the display unit 21 (steps S210 and S106). ). Then, the display unit 21 reads the partial maintenance information from the partial information identified by the partial ID “1”, and superimposes the partial maintenance information on the area corresponding to the partial identification information “P001” received from the identification unit 16. It is displayed (step S107). As a result, as shown in FIG. 12, the partial maintenance information is displayed on the image of a certain part of the copier. Then, the user can perform maintenance by checking whether or not the inspection value for the portion matches the standard value while viewing this display. In this way, the copying machines that are the object of maintenance are sequentially maintained.

  After that, all the maintenance of the copier is completed. At that time, it is assumed that the “end” button on the touch panel is tapped. Then, the display unit 21 reads a list of maintenance object identification information from the maintenance route information storage unit 19 and displays it. Assume that the user taps “ABC room copier” in the display of the list. Then, the reception unit 13 determines that the end of the maintenance related to the maintenance target identified by the maintenance target identification information “ABC room copy machine” has been received, and the maintenance target identification information “ABC room copy machine” indicates that the maintenance has ended. To the display unit 21 (step S108). When the display unit 21 receives the information indicating that the maintenance has been completed, the display unit 21 refers to the plurality of maintenance route information stored in the maintenance route information storage unit 19 and includes the received maintenance target identification information “ABC room copy machine”. Determine whether route information exists. In FIG. 8, since there is maintenance route information (first record) including the maintenance object identification information “ABC room copy machine”, it is determined that route information exists (step S109), and the route information R001 is read. When the display unit 21 reads the route information R001, the display unit 21 reads the map image corresponding to the route indicated by the route information R001 from the map information storage unit 18, and the route graphic corresponding to the route information R001 is displayed on the map. Is displayed on the touch panel as shown in FIG. 13 (step S110). The user can easily know where to go next by viewing this display. When the vehicle arrives at the destination, appropriate maintenance can be performed by photographing the maintenance object and viewing the maintenance information displayed in association with the maintenance object. Until the user reaches the destination, navigation may be performed by displaying a graphic corresponding to the current position on the route shown in FIG. 13, or only the route is displayed without navigation. Also good.

  In addition, although FIG. 13 demonstrated the case where route information was displayed on a map, it may not be so. As described above, the user displays the captured image of the camera on the opposite side of the touch panel on the touch panel, and on the display, displays a guide image of the route to the destination like intuitive navigation (registered trademark). Also good. In that case, the display unit 21 uses, for example, the route information, the current position acquired by the current position acquisition unit 17 and the direction of the maintenance information display device 1 to indicate the current point on the route indicated by the route information. Specify the direction corresponding to the route from the specified current point to the destination. Then, on the photographed image, the character strings “forward”, “right”, “left”, “facing the opposite”, “to the third floor” and symbols “→” “←” “↑” “↓” ”Or the like may be displayed to navigate the user to the destination. In that case, for example, the display shown in FIG. 14 is performed. Note that character strings and symbols corresponding to the specified direction are stored in advance on a recording medium (not shown), and the display unit 21 may read an image corresponding to the specified direction and display it on the captured image. The captured image and the character string or symbol corresponding to the specified direction are displayed until the destination is reached.

  In this specific example, the case where character string information is displayed as overall maintenance information or partial maintenance information has been described, but this need not be the case. The overall maintenance information or the partial maintenance information may be an image, and the image may be displayed so as to be superimposed on the whole or part of the maintenance target. For example, as shown in FIG. 15, partial maintenance information that is an image showing the internal structure may be displayed in association with a certain part of the copier. By viewing this display, the user can know the internal configuration of the maintenance object, etc., and can appropriately perform maintenance while referring to it.

  Further, in this specific example, the case where the entire information and the partial information are used independently of each other has been described. However, as described above, using the partial specifying information corresponding to the specified entire characteristic information, You may specify the part after a specific. In that case, for example, as shown in FIG. 16, a parent-child relationship information corresponding to the same maintenance object, which is information for associating the whole information with the partial information, is not shown (this recording medium includes parent-child relationship information). It may be a storage unit), and the specifying unit 16 may specify the partial specifying information using it. In FIG. 16, the entire ID and the partial ID are associated with each other. The overall ID identifies the entire information, and the partial ID identifies the partial information. With this parent-child relationship information, the overall information and partial information about the same maintenance object are associated with each other. In general, in the parent-child relationship information, the whole ID and the partial ID are in a one-to-many relationship. For example, in the whole information storage unit 11, the whole feature information and the whole maintenance information are in a many-to-one relationship. In the parent-child relationship information, the whole ID and the partial ID may have a many-to-many relationship. In addition, the parent-child relationship information may be information in another format as long as it is information that associates at least the entire feature information and the partial identification information corresponding to the same maintenance object. When the parent-child relationship information exists, for example, in a specific process after the overall feature information included in the overall information identified by the overall ID “1” is specified, the captured image matches the overall feature information. If not (in the case of “N” in step S204), the specifying unit 16 refers to the parent-child relationship information shown in FIG. 17 and refers to the entire information corresponding to the entire information including the entire feature information specified immediately before. The partial IDs “1”, “2”, “3”, “4”,... Corresponding to the ID “1” are read, and only the partial information corresponding to the partial IDs “1”, “2”, “3”, “4”,. The part specifying information may be specified. By doing in this way, as described above, even when there is a part similar to a different maintenance object, it is possible to reduce misjudgment when specifying the part specifying information. Until the whole feature information matches the acquired captured image, the portion specifying information corresponding to the shot image is specified using the portion specifying information corresponding to the entire feature information specified immediately before. May be. Further, the parent-child relationship information may be other information as long as it can indicate the parent-child relationship between the whole and the same maintenance target as a result. For example, the parent-child relationship information may be information that associates the entire feature information and the partial specifying information corresponding to the same maintenance object.

  Also, in this specific example, the case where shooting is performed in response to the tap of the “shoot” button has been described, but as described above, continuous shooting is performed, and the entire feature of the latest shot image is displayed. Identification of information or the like may be performed continuously.

  As described above, according to the maintenance information display device 1 according to the present embodiment, the overall maintenance information can be displayed for the maintenance target, and the partial maintenance information can be displayed for the maintenance target part. Can do. As a result, it is possible to display detailed maintenance information even for the detailed parts of the maintenance object, and to appropriately support the maintenance of the maintenance object. In addition, since the navigation related to the position of the maintenance target can be performed, the maintenance work itself can be supported.

  In the present embodiment, the part specifying information may be information indicating a region in the entire maintenance target. That is, the information indicating a partial area in the entire maintenance target may be one piece of partial specifying information. For example, as shown in FIG. 17, the entire copy machine to be maintained may be divided into six areas, and information indicating each area may be partial specifying information. The part specifying information is, for example, information indicating the outline of the region (for example, information including a plurality of coordinates indicating the outline of the region) in the entire image (for example, the whole feature information) to be maintained. There may be. For example, as shown in FIG. 18, the partial specifying information in the partial information may include overall feature information and region information. Here, the overall feature information is, for example, information for identifying an entire image to be maintained. The area information is information indicating an area in the entire image to be maintained. For example, the region information R001 may be information indicating the region 1 in FIG. 17, and the region information R002 may be information indicating the region 2 in FIG. Further, when specifying using the partial specifying information, it is assumed that the display unit 21 displays a photographed image photographed by the photographing unit 14. Further, it is assumed that the accepting unit 13 accepts an enlargement / reduction instruction. The enlargement / reduction may be enlargement / reduction of a photographed image taken by the photographing unit 14, or may be enlargement / reduction of a photographed image displayed on the display unit 21. In any case, as a result, the captured image displayed on the display unit 21 is zoomed in / out according to the enlargement / reduction instruction received by the reception unit 13. Then, after specifying the entire feature information that matches the captured image, the specifying unit 16 specifies the portion specifying information that indicates the zoomed-in area when a part of the portion that matches the entire feature information is zoomed in. May be. For example, as shown in FIG. 9, the entire copy machine to be serviced is displayed, and thereafter, shooting or enlargement of display is performed, so that area 1 in FIG. 17 is displayed as shown in FIG. Suppose that zoom-in is performed on the part of. In that case, the specifying unit 16 first specifies the overall feature information “F001” (in this case, even if the overall maintenance information corresponding to the overall feature information is displayed as in the above-described specific example). Good). After that, the specifying unit 16 specifies a region in the zoomed-in whole feature information “F001”, and obtains region information included in the partial specifying information having the whole feature information “F001” having a large overlapping ratio with the region. Identify. The specification of the area in the zoomed-in overall feature information “F001” may be performed, for example, by performing pattern matching between the zoomed-in image and the entire image to be maintained. This may be done by tracking feature points when zooming in, or by other methods. In this case, it is assumed that the area information R001 has the largest overlapping rate. Then, the specifying unit 16 specifies partial specifying information including the region information R001. As a result, the partial maintenance information corresponding to the partial identification information is displayed as shown in FIG.

  In the present embodiment, the overall maintenance information and the partial maintenance information may be 3D computer graphics information as described above. The processing in that case will be briefly described. For example, it is assumed that the overall maintenance information is 3D computer graphics information. The overall maintenance information may be three-dimensional modeled information. Then, for example, the user first takes an image of the front of the maintenance target as shown in FIG. Then, the entire feature information is specified using the captured image. Further, the orientation of the maintenance information display device 1 is calculated using a three-dimensional azimuth sensor or the like included in the current position acquisition unit 17 or the like with reference to the orientation of the maintenance information display device 1 at the time of shooting. Thereafter, for example, when the photographed image shown in FIG. 19B is photographed, the three-dimensional orientation sensor or the like calculates the orientation from the reference of the maintenance information display device 1 at that time. Then, the display unit 21 obtains the two-dimensional image shown in FIG. 19C by rendering the overall maintenance information model with the direction as the line-of-sight direction. Thereafter, the display unit 21 displays the captured image shown in FIG. 19B and the overall maintenance information after rendering shown in FIG. Display. In this way, the three-dimensional internal structure can be displayed over the maintenance object. In this case, as shown in FIG. 19D, both the photographed image and the overall maintenance information may be displayed so as to be transmitted through the back side. Alternatively, as shown in FIGS. 12 and 15, the rendered image may be displayed on the front side, and the captured image may be displayed on the back side. Further, when the partial maintenance information is information of three-dimensional computer graphics, three-dimensional display can be performed in the same manner.

  Moreover, although this embodiment demonstrated the case where the maintenance information display apparatus 1 was provided with the present position acquisition part 17 and the map information storage part 18, it may not be so. For example, when navigation is performed without displaying map information, such as intuitive navigation (registered trademark), the maintenance information display device 1 may not include the map information storage unit 18. Further, when the navigation using the current position is not performed and only the route is shown as shown in FIG. 13, the maintenance information display device 1 may not include the current position acquisition unit 17.

  Further, in the present embodiment, the case where the display related to the route information is also described, but this need not be the case. When the display relating to the route information is not performed, the maintenance information display device 1 may not include the current position acquisition unit 17, the map information storage unit 18, and the maintenance route information storage unit 19.

  In the present embodiment, the main maintenance information and the partial maintenance information are mainly displayed in association with the portion of the photographed image corresponding to the whole maintenance information and the portion of the photographed image corresponding to the partial maintenance information. However, this need not be the case. The display unit 21 may display the overall maintenance information and the partial maintenance information regardless of the corresponding part of the shooting information.

  In the above embodiment, each process or each function may be realized by centralized processing by a single device or a single system, or may be distributedly processed by a plurality of devices or a plurality of systems. It may be realized by doing. For example, the overall information storage unit 11, the partial information storage unit 12, and the specifying unit 16 exist in the server, and other components exist in the client, and the above-described implementation is performed while performing communication between the server and the client. The maintenance information as described in the form may be displayed.

  In the above embodiment, the information exchange between the components is performed by one component when, for example, the two components that exchange the information are physically different from each other. It may be performed by outputting information and receiving information by the other component, or when two components that exchange information are physically the same, one component May be performed by moving from the phase of the process corresponding to to the phase of the process corresponding to the other component.

  In the above embodiment, information related to processing executed by each component, for example, information received, acquired, selected, generated, transmitted, or received by each component In addition, information such as threshold values, mathematical formulas, addresses, etc. used by each component in processing is retained temporarily or over a long period of time on a recording medium (not shown) even when not explicitly stated in the above description. It may be. Further, the storage of information in the recording medium (not shown) may be performed by each component or a storage unit (not shown). Further, reading of information from the recording medium (not shown) may be performed by each component or a reading unit (not shown).

  In the above embodiment, when information used by each component, for example, information such as a threshold value, an address, and various setting values used by each component may be changed by the user Even if it is not specified in the above description, the user may be able to change the information as appropriate, or it may not be. If the information can be changed by the user, the change is realized by, for example, a not-shown receiving unit that receives a change instruction from the user and a changing unit (not shown) that changes the information in accordance with the change instruction. May be. The change instruction received by the receiving unit (not shown) may be received from an input device, information received via a communication line, or information read from a predetermined recording medium, for example. .

  In the above embodiment, when two or more components included in the maintenance information display apparatus 1 have a communication device, an input device, etc., the two or more components have a physically single device. Or may have separate devices.

  In the above embodiment, each component may be configured by dedicated hardware, or a component that can be realized by software may be realized by executing a program. For example, each component can be realized by a program execution unit such as a CPU reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory. In addition, the software which implement | achieves the maintenance information display apparatus 1 in the said embodiment is the following programs. In other words, this program includes an overall information storage unit that stores one or more pieces of overall information including overall feature information that is information on characteristics of the maintenance target as a whole and overall maintenance information that is information on maintenance of the maintenance target. A computer that can access a partial information storage unit that stores one or more pieces of partial information including partial identification information that identifies a target portion and partial maintenance information that is information related to maintenance of a portion to be maintained. An accepting unit that accepts an instruction, photographing according to a photographing instruction accepted by the accepting unit, and overall feature information that matches a captured image acquired by the capturing unit that acquires the captured image, or a captured image acquired by the capturing unit When the specific part that specifies the relevant part specifying information and the specific part specifies the overall feature information, the overall maintenance information corresponding to the entire feature information is displayed, and the specific part When identifying the constant information is a program for functioning as a display unit for displaying the partial maintenance information corresponding to the partial identification information.

  In the program, the functions realized by the program do not include functions that can be realized only by hardware. For example, a function that can be realized only by hardware such as an input device or a display device in a reception unit that receives information or a display unit that displays information is not included in at least the function realized by the program.

  Further, this program may be executed by being downloaded from a server or the like, and a program recorded on a predetermined recording medium (for example, an optical disk such as a CD-ROM, a magnetic disk, a semiconductor memory, or the like) is read out. May be executed by Further, this program may be used as a program constituting a program product.

  Further, the computer that executes this program may be singular or plural. That is, centralized processing may be performed, or distributed processing may be performed.

  FIG. 20 is a schematic diagram showing an example of the external appearance of a computer that executes the program and realizes the maintenance information display apparatus 1 according to the embodiment. The above-described embodiment can be realized by computer hardware and a computer program executed on the computer hardware.

  20, a computer system 900 includes a computer 901 including a CD-ROM (Compact Disk Read Only Memory) drive 905 and an FD (Floppy (registered trademark) Disk) drive 906, a keyboard 902, a mouse 903, a monitor 904, and the like. Is provided.

  FIG. 21 is a diagram showing an internal configuration of the computer system 900. In FIG. 21, in addition to the CD-ROM drive 905 and the FD drive 906, a computer 901 is connected to an MPU (Micro Processing Unit) 911, a ROM 912 for storing a program such as a bootup program, and the MPU 911. A RAM (Random Access Memory) 913 that temporarily stores program instructions and provides a temporary storage space, a hard disk 914 that stores application programs, system programs, and data, and an MPU 911 and a ROM 912 are interconnected. And a bus 915. The computer 901 may include a network card (not shown) that provides connection to a LAN, WAN, or the like.

  A program that causes the computer system 900 to execute the function of the maintenance information display device 1 according to the above-described embodiment is stored in the CD-ROM 921 or the FD 922, inserted into the CD-ROM drive 905 or the FD drive 906, and the hard disk 914. May be forwarded to. Instead, the program may be transmitted to the computer 901 via a network (not shown) and stored in the hard disk 914. The program is loaded into the RAM 913 when executed. The program may be loaded directly from the CD-ROM 921, the FD 922, or the network.

  The program does not necessarily include an operating system (OS) or a third-party program that causes the computer 901 to execute the functions of the maintenance information display device 1 according to the above-described embodiment. The program may include only a part of an instruction that calls an appropriate function (module) in a controlled manner and obtains a desired result. How the computer system 900 operates is well known and will not be described in detail.

  Further, the present invention is not limited to the above-described embodiment, and various modifications are possible, and it goes without saying that these are also included in the scope of the present invention.

  As described above, according to the maintenance information display device or the like according to the present invention, it is possible to display the maintenance information for the entire maintenance target and also for the part. is there.

DESCRIPTION OF SYMBOLS 1 Maintenance information display apparatus 11 Whole information storage part 12 Partial information storage part 13 Reception part 14 Imaging | photography part 15 Captured image storage part 16 Identification | specification part 17 Current position acquisition part 18 Map information storage part 19 Maintenance route information storage part 21 Display part

Claims (10)

An overall information storage unit that stores one or more pieces of overall information including overall feature information that is information on characteristics of the entire maintenance target and overall maintenance information that is information on maintenance of the maintenance target;
A partial information storage unit that stores one or more pieces of partial information including partial identification information that identifies a portion to be maintained and partial maintenance information that is information related to maintenance of the portion to be maintained;
A reception unit that accepts shooting instructions;
An imaging unit that performs imaging according to an imaging instruction received by the reception unit and acquires a captured image;
Whole feature information that matches the shot image acquired by the shooting unit, or a specifying unit that specifies partial specification information that matches the shot image acquired by the shooting unit,
When the specifying unit specifies the overall feature information, the overall maintenance information corresponding to the overall feature information is displayed in association with a portion that matches the overall feature information in the captured image acquired by the imaging unit , When the specifying unit specifies the part specifying information, the partial maintenance information corresponding to the part specifying information is displayed in association with the part specified by the part specifying information in the captured image acquired by the imaging unit. A maintenance information display device comprising: a display unit; The whole feature information is an overall image of serviced claim 1 Symbol mounting maintenance information display device. The partial identification information is information for features relating to portions of serviced, maintenance information display apparatus according to claim 1 or claim 2, wherein. The maintenance information display apparatus according to claim 3 , wherein the part specifying information is an image of a part to be maintained. An overall information storage unit that stores one or more pieces of overall information including overall feature information that is information on characteristics of the entire maintenance target and overall maintenance information that is information on maintenance of the maintenance target;
A partial information storage unit that stores one or more pieces of partial information including partial identification information that identifies a portion to be maintained and partial maintenance information that is information related to maintenance of the portion to be maintained;
A reception unit that accepts shooting instructions;
An imaging unit that performs imaging according to an imaging instruction received by the reception unit and acquires a captured image;
Whole feature information that matches the shot image acquired by the shooting unit, or a specifying unit that specifies partial specification information that matches the shot image acquired by the shooting unit,
When the specifying unit specifies the whole feature information, the whole maintenance information corresponding to the whole feature information is displayed, and when the specifying unit specifies the part specifying information, the part corresponding to the part specifying information A display unit for displaying maintenance information;
A parent-child relationship information storage unit that stores parent-child relationship information, which is information for correlating overall information and partial information, corresponding to the same maintenance object,
When specifying the partial specification information after specifying the general feature information that matches the captured image, the specifying unit uses the partial information associated with the parent-child relationship information to the general information including the general feature information. Maintenance information display device that identifies partial identification information. An overall information storage unit that stores one or more pieces of overall information including overall feature information that is information on characteristics of the entire maintenance target and overall maintenance information that is information on maintenance of the maintenance target;
A partial information storage unit that stores one or more pieces of partial information including partial identification information that identifies a portion to be maintained and partial maintenance information that is information related to maintenance of the portion to be maintained;
A reception unit that accepts shooting instructions;
An imaging unit that performs imaging according to an imaging instruction received by the reception unit and acquires a captured image;
Whole feature information that matches the shot image acquired by the shooting unit, or a specifying unit that specifies partial specification information that matches the shot image acquired by the shooting unit,
When the specifying unit specifies the whole feature information, the whole maintenance information corresponding to the whole feature information is displayed, and when the specifying unit specifies the part specifying information, the part corresponding to the part specifying information A display unit for displaying maintenance information;
The reception unit also receives an instruction for enlargement / reduction,
The display unit displays a photographed image photographed by the photographing unit,
The captured image displayed by the display unit is zoomed in / zoomed out in accordance with an enlargement / reduction instruction received by the reception unit,
The part specifying information is information indicating a partial region in the entire maintenance target including the part to be maintained specified by the part specifying information ,
The specifying unit, after specifying the overall feature information that matches the captured image, when zoomed in on a part of the part that matches the overall feature information, a part of the entire maintenance target corresponding to the overall feature information a partial identification information indicating the area, identifying the portion specifying information indicating the zoomed-in area, integer Bei information display device. The maintenance information display device according to claim 1, wherein the overall maintenance information is information relating to a maintenance procedure. The reception unit receives the end of maintenance for a maintenance target,
A maintenance route information storage unit for storing at least one maintenance route information having maintenance target identification information for identifying a maintenance target and route information indicating a route from the maintenance target to the next maintenance target;
8. The display unit according to claim 1, wherein, when the reception unit receives the end of maintenance, the display unit also displays a route information corresponding to maintenance target identification information for identifying a maintenance target for which maintenance has ended. Any maintenance information display device. Identifies the overall information storage section that stores one or more pieces of overall information including overall feature information that is information on the characteristics of the entire maintenance target and overall maintenance information that is information on the maintenance target. Partial information storage unit that stores one or more partial information including partial identification information and partial maintenance information that is information related to maintenance of the maintenance target part, a reception unit, a photographing unit, a specific unit, A maintenance information display method processed using a display unit,
A reception step in which the reception unit receives a shooting instruction;
A shooting step in which the shooting unit performs shooting in accordance with a shooting instruction received in the receiving step, and acquires a shot image;
The specifying unit specifies overall feature information that matches the captured image acquired in the shooting step, or specific step that specifies partial specifying information that matches the captured image acquired in the shooting step;
When the display unit specifies the overall feature information in the specifying step, the overall maintenance information corresponding to the overall feature information corresponds to a portion that matches the overall feature information in the captured image acquired in the imaging step. When the part specifying information is specified in the specifying step, the partial maintenance information corresponding to the part specifying information is set to the part specified by the part specifying information in the captured image acquired in the shooting step. A maintenance information display method comprising: a display step for displaying the information in association with each other . Identifies the overall information storage section that stores one or more pieces of overall information including overall feature information that is information on the characteristics of the entire maintenance target and overall maintenance information that is information on the maintenance target. A computer capable of accessing one or more partial information storage units storing partial information having partial identification information and partial maintenance information that is information related to maintenance of the maintenance target part;
A reception unit that accepts shooting instructions,
Shooting in accordance with the shooting instruction received by the reception unit, and the whole feature information that matches the shot image acquired by the shooting unit that acquires the shot image, or the part specification that matches the shot image acquired by the shooting unit A specific part for identifying information,
When the specifying unit specifies the overall feature information, the overall maintenance information corresponding to the overall feature information is displayed in association with a portion that matches the overall feature information in the captured image acquired by the imaging unit , When the specifying unit specifies the part specifying information, the partial maintenance information corresponding to the part specifying information is displayed in association with the part specified by the part specifying information in the captured image acquired by the imaging unit. A program for functioning as a display unit.

Images