JP2007018188A - System, method and apparatus for information presentation through extended sense of reality, and computer program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable high-speed identification of the existence of a device for maintenance and the position and the direction thereof with a reduced image processing load, from a visual field image which varies every moment with the variation of the position and the posture a worker. <P>SOLUTION: A light emitting RFID tag 1 is mounted on a device 2 for maintenance, such as in-plant apparatus, pipe and measurement equipment, which is related to a maintenance work. By means of transmission from R/W 7 carried by a maintenance worker, the light emitting RFID tag 1 which is related to the device 2 for maintenance requiring information presentation is selectively emitted, so as to enable detection of the position and the direction of the device 2 for maintenance through simple image processing. For the above purpose, a processing unit 5 acquires images from a camera 3, and calculates the position of the light emitting RFID tag 1 currently emitting light. Using as a base point the coordinate of the light emitting RFID tag 1 calculated from the above image, information related to the work is converted into CG and displayed on a display device such as an HMD 4. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention utilizes augmented reality, and in particular, maintenance of plant measurement control equipment, etc., improves the efficiency of maintenance work by displaying information such as equipment specifications and maintenance procedures superimposed on the equipment to be worked on The present invention relates to an information presentation system based on augmented reality, an information presentation method, an information presentation device, and a computer program, which are suitable for use in supporting information.

  Many systems that support work by presenting necessary information using augmented reality that displays CG (Computer Graphics) superimposed on an actual scene have been proposed. Augmented reality adds virtual information to the real world using VR (Virtual Reality) technology and enables interaction between humans and the real world. Here, VR means that a space or an object that does not actually exist is perceived by applying artificially created stimuli to some sensory organs of human beings.

With the miniaturization of computers that generate images for HMD (Head-Mounted Display) and information presentation, work support based on augmented reality has become realistic. Systems that have a method of constantly displaying work-related books and the like in a part of the field of view using the HMD without specifying the display position with respect to the real space are already on the market. By using such a system, it is possible to obtain necessary information without blocking hands during work and without looking aside.
However, the original augmented reality is intended not only to display information but also to visually present the relationship between an object and information depending on the position where the information is displayed. For example, it is most effective in correctly transmitting information that is difficult to translate into language, such as displaying the internal wiring of the device covered with the cover in CG and displaying the instruction symbol superimposed on the device to be maintained. For this purpose, it is necessary to display information at an appropriate position in the visual field.

To determine the display position, first, it is necessary to detect whether an object associated with information is in the field of view, where it is in the field of view, and the like. For this purpose, an image processing technique is generally used. In the image processing, the maintenance target device is detected from the image using the color and shape of the object, or a marker for detecting a specific color or design, or both as feature points, and the display position is determined based on the detected position.
In addition, there is a method of determining the display position by detecting the position and posture of the person on the viewing side regardless of image recognition (see, for example, Patent Document 1).
Japanese Patent No. 3653196 (paragraphs “0015” to “0018”, FIG. 1)

  However, according to the technique disclosed in Patent Document 1, when information is to be presented in association with an actual object, it is essential that the position and direction of the object to be associated with the information can be accurately grasped. Therefore, in maintenance work such as inspection, it is necessary to grasp the arrangement and direction of all the objects in the plant to which information is related. If it is a plant designed using a CAD (Computer Aided Design) system, it is possible to obtain the arrangement coordinates from it, but for the equipment that may be relocated or added after the construction, such as a control device, the accurate arrangement coordinates. Can't hope. In addition, there is a disadvantage that it is not possible to deal with an object whose position changes from time to time, such as a portable measuring instrument.

In addition, there are the following inconveniences when image processing is used. In other words, when information is to be presented using augmented reality to a person who is working at a maintenance site, image processing that considers the movement of the field of view is necessary. For example, when an object is detected based on color or shape characteristics, it is necessary to take into consideration that the shape that appears as a two-dimensional image changes depending on the angle of shooting, and that the color changes depending on the position and type of the light source. .
As a method for solving such a problem, there has been a method of sticking a detection marker to the surface of a maintenance object. However, when using a detection marker, it is necessary to install the marker systematically so that the marker can be photographed without fail from the position where the object needs to be detected. When a human moves freely in a space where equipment and piping are involved like maintenance work in a plant, it is not easy to plan an appropriate marker arrangement.

The objects of maintenance work include equipment that is larger than the operator, such as turbines, and small equipment, such as meters and switches, that vary in shape and size. In addition, devices or parts having similar appearances such as a control panel are often concentrated in the same place, and it is difficult to distinguish individual maintenance target devices by feature points.
On the other hand, since the position and posture of the worker move with the work, when trying to determine the display position of information by image processing, high-speed image processing is required for a captured image that changes every moment. When displaying information by using augmented reality for a variety of maintenance target devices in the plant, the maintenance target device is used regardless of the features of the color or shape of the maintenance target device from the image of the real space. It is necessary to have a method for detecting the position and direction of the maintenance target device at high speed.

  The present invention has been made based on the above-described circumstances, for example, changes in the position and posture of an operator for an object that is difficult to distinguish individual maintenance target devices by feature points, such as equipment and piping in a plant. The presence of the maintenance target device and the position and direction of the maintenance target device can be identified at high speed with reduced image processing load, and the augmented reality that visualizes the relationship between objects and information can be realized. An object of the present invention is to provide an information presentation system, an information presentation method, an information presentation device, and a computer program based on augmented reality.

The present invention, for example, attaches a light emitting type RFID (Radio Frequency Identification) tag to maintenance target equipment related to maintenance work such as equipment, piping, and measuring instruments in a plant, and transmits from a reader / writer carried by a maintenance staff. Thus, the light emitting RFID tag related to the maintenance target device for information presentation is selectively made to emit light, and the position and direction of the maintenance target device can be detected by simple image processing.
For this reason, the information presenting apparatus captures an image from the photographing apparatus, calculates the position of the light emitting RFID tag that emits light, and uses the coordinates of the light emitting RFID tag calculated from the image as the base point to provide information related to the work. Is converted to CG and displayed on the display device.

  According to the present invention, for example, an object that is difficult to distinguish individual maintenance target devices by feature points such as equipment and piping in a plant, and the captured image that changes every moment according to a change in the position and posture of the worker. Therefore, the existence of the maintenance target device and the position and direction of the maintenance target device can be identified at high speed while suppressing the load of image processing, and an augmented reality that visualizes the relationship between the object and the information can be realized.

[system]
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 is a diagram showing an example of a system configuration of an information presentation system based on augmented reality according to an embodiment of the present invention. Here, a configuration in the case where the light emitting RFID tag 1 is attached to a device (maintenance target device) 2 to be maintained and information related to the device is displayed is illustrated.
The maintenance target device 2 has a light emitting RFID tag 1 attached (for example, attached) at a position to be used as a base point for displaying information. In addition, for example, a wearable computer as an information presentation device is mounted on the maintenance worker, and information related to the maintenance target device 2 is displayed using the wearable computer using CG.

[Wearable computer]
The wearable computer processes a camera (photographing device) 3 necessary for photographing a real space, an HMD (display device) 4 for displaying information, and an image photographed by the camera 3, and matches the real space. A processing device 5 that generates a CG with adjusted display and outputs it to the HMD 4, a storage device 6 that stores information related to maintenance work, and a reader / writer that reads and writes data from and to the light emitting RFID tag 1 It has (R / W) 7 and an input device 8 as components and is always carried by a maintenance worker.
The light emitting RFID tag 1 includes a light emitting unit added to a configuration of a normal RFID tag, and a switch that supplies power to the light emitting unit when a specific command is received. For example, it is disclosed by Unexamined-Japanese-Patent No. 2003-317050.

FIG. 2 is an operation sequence diagram quoted for explaining the operation of the information presentation system according to the augmented reality according to the embodiment of the present invention.
The operation of the information presentation system according to the augmented reality of the present invention shown in FIG. 1 will be described below with reference to the operation sequence diagram shown in FIG.

[System processing (sequence diagram)]
Prior to the operation, the storage device 6 stores information related to the work to be performed, for example, a maintenance procedure manual, identification information unique to the light emitting RFID tag 1 attached to the maintenance target device 2, circuit diagrams and maintenance related to the work. Records etc. shall be stored.
First, the maintenance worker activates the processing device 5 by operating the input device 8 (step S21). The activated processing device 5 reads the identification information of the light emitting RFID tag 1 attached to the maintenance target from the storage device 6, and identifies the identification information for the light emitting RFID tag 1 corresponding to the identification information in R / W7. A light emission request is made by transmitting a light emission request signal including (step S22). The R / W 7 that has received the issue request signal transmits a light emission request signal including identification information to the light emitting RFID tag 1 corresponding to the identification signal (step S23).

(Light emission and image processing)
The light emitting RFID tag 1 that has received the above-described light emission request signal compares the unique identification information written in itself with the received identification information (step S24), and sends a response signal (Ack) only when they match. Return (step S26). The corresponding light emitting RFID tag 1 emits light by turning on an internal switch (step S25).
The R / W 7 that has received Ack from the light emitting RFID tag 1 returns Ack indicating successful communication with the target light emitting RFID tag 1 to the processing device 5 (step S27). The processing device 5 that has received Ack from the R / W 7 captures an image from the camera 3 and performs image processing (step S28), and calculates the position of the light emitting RFID tag 1 that is emitting light (step S29). The processing device 5 further converts information related to the work read from the storage device 6 into CG based on the coordinates of the light emitting RFID tag 1 calculated from the camera image, and displays information corresponding to the HMD 4. (Step S30).

The processing device 5 transmits a light emission request signal to the light emitting RFID tag 1 at regular intervals via the R / W 7 until the maintenance worker operates the input device 8 to input a stop command (step S44) (step S22). , S23, S32 and S34), the target light emitting RFID tag 1 is caused to emit light.
Each time the light emitting RFID tag 1 receives the light emission request signal, the light emitting RFID tag 1 compares the unique identification information with the received identification information (steps S24 and S35), and the unique identification information and the received identification information are received. If the information matches, control for emitting light for a specified time is executed. Here, it is designed to emit light three times at short intervals in response to one light emission request (steps S25, S31 and S33 for step S23, and steps S36, S42 and S43 for step S34). Furthermore, if the identification information matches as a result of the comparison, the light emitting RFID tag 1 transmits Ack to the processing device 5 via the R / W 7 (steps S26, S27 and steps S37, S38). It prompts image processing, position calculation, and information display (steps S28, S29 and S30 / steps S39, S40 and S41).

(End of processing)
Finally, when the maintenance worker operates the input device 8 to input a stop command (step S44), the information display by the processing device 5 and the transmission of the light emission request signal are stopped (step S45). Further, the processing device 5 issues a stop command by transmitting a stop command signal to the corresponding light emitting RFID tag 1 via the R / W 7 (steps S46 and S47). The light emitting RFID tag 1 that has received the stop command signal stops light emission after a predetermined time (step S48).

[Identification of position of light emitting RFID tag (steps S28 and S29 in FIG. 2)]
FIG. 3 schematically shows an example of a method for specifying a position from images before and during light emission of the light emitting RFID tag used in the embodiment of the present invention.
With reference to FIG. 1, an example of a method for specifying the position from the images before and during light emission of the light emitting RFID tag used in the embodiment of the present invention will be described along FIG.
Here, the light emission coordinates of the light emitting RFID tag 1 are calculated from the difference image between the image 32 before light emission and the image 34 during light emission. Reference numerals 31 and 33 indicate positions of the light emitting RFID tag 1. By setting the shooting interval by the camera 3 to be sufficiently short, differences in the shooting direction of the image before and during the emission, the distance to the camera 3, the position of the external light source, and the like can be reduced to a negligible level.
In the difference image 36, the pixels in the portion that did not change before and after the light emission are erased, and only the light emitting portion 35 of the light emitting RFID tag 1 remains. For this reason, the processing device 5 can calculate, for example, the center point of the portion remaining as an image as the coordinates at which the light emitting RFID tag 1 emits light.

[Processing equipment]
FIG. 4 is a block diagram showing an expanded function of the internal configuration of the information presentation apparatus based on augmented reality according to the embodiment of the present invention, specifically, the processing apparatus 5 shown in FIG.
The processing device 5 functionally includes a light emission request transmission unit 51, a response signal reception unit 52, an image capture unit 53, a difference image calculation unit 54, a display control unit 55, a CG generation unit 56, and a guide. And an information generating unit 57.

The light emission request transmitter 51 reads identification information for uniquely identifying the light emitting RFID tag 1 from the storage device 6, and sends a light emission request signal including the identification information to the light emitting RFID tag 1 via the R / W 7. Has the ability to send. The response signal receiving unit 52 has a function of activating the image capturing unit 53 and the difference image calculating unit 54 by receiving a response signal (Ack) returned from the corresponding light emitting RFID tag 1.
Further, when the difference image calculation unit 54 receives a response signal from the light emitting RFID tag 1, the difference image calculation unit 54 calculates a difference between the captured images that are captured by the image capturing unit 53 before and during light emission via the camera 3. It has a function of calculating the light emission position of the corresponding light emitting RFID tag 1 from the difference image obtained as a result of the calculation. The display control unit 55 acquires display information related to the maintenance target device 2 from the storage device 6, calculates the display position as relative position coordinates based on the light emission position, and activates the CG generation unit 56. The computer graphics generated and output by the CG generation unit 56 has a function of displaying on the externally connected HMD 4.

  The display control unit 55 determines that the maintenance target device 2 that wants to display predetermined display information is out of the field of view when the response signal cannot be received from the light emitting RFID tag 1 or even when the response signal is received. When this is done, it also has a function of starting the guide information generation unit 57 and displaying the guide information necessary for reaching the maintenance target device 2 generated by the guide information generation unit 57 on the externally connected HMD 4.

[Processing device processing]
FIG. 5 is a flowchart cited for explaining the operation of the information presentation apparatus according to the augmented reality according to the embodiment of the present invention. FIG. 5 also shows the processing procedure of the computer program of the present invention.
Hereinafter, with reference to FIG. 1 and FIG. 4, the operation of the processing device 5 in which the information presentation device according to the augmented reality of the embodiment of the present invention is mounted will be described in detail along the flowchart shown in FIG. 5.

(Start-up-Ack reception: S21 to S27 in FIG. 2)
First, the maintenance worker activates the processing device 5 by operating the input device 8. The light emission request transmission unit 51 of the processing device 5 reads the identification information of the light emitting RFID tag 1 attached to the maintenance target from the storage device 6 and has the identification information read via the R / W 7. A light emission request signal including identification information unique to 1 (attached to the maintenance target device 2) is transmitted (step S51). Then, the response signal receiving unit 52 determines whether or not Ack, which is a response signal sent from the corresponding light emitting RFID tag 1 via the R / W 7, has been received (step S 52).
If the response signal receiving unit 52 of the processing device 5 does not receive Ack (step S52 → “none”), it is determined that there is no maintenance target device 2 within the communicable range (step S53), and the display control unit 55 and the guide The information generation unit 57 is activated and guide information for reaching the maintenance target device 2 is displayed on the HMD 4 instead of the related information (step S54). If the Ack can be received (Step S52 → “Yes”), the response signal receiving unit 52 determines that the maintenance target device 2 is within the communicable range, and executes the image processing after Step S55. In general, since the communicable range of the light emitting RFID tag 1 is narrow, if communication with the target light emitting RFID tag 1 is established, the maintenance target device 2 to which the light emitting RFID tag 1 is attached should also exist nearby.

(Image processing, position calculation, information display: S28 to S30 in FIG. 2)
Since the light emitting RFID tag 1 returns Ack and emits light intermittently at the same time, the image capturing unit 53 captures the state before the light emission and the state during the light emission at a time interval adjusted in advance so as to capture the state of light emission. The difference image calculation unit 54 calculates the difference between the two shot images (step S55), and sends the result to the display control unit 55. If the time interval is adjusted, only the light emission point remains in the difference image, and the coordinates of the light emission point can be easily calculated.
Next, the display control unit 55 determines the presence / absence of a light emitting point in the difference image that is the result of the process in step S55 (step S56).
When there is a light emission point (step S56 → “present”), the display control unit 55 acquires display information related to the maintenance target device 2 from the storage device 6, and the light emission whose display position is obtained from the difference image. The relative position coordinates are calculated based on the position, the CG generation unit 56 is activated, and the CG generation unit 56 converts the display information into computer graphics as related information of the maintenance target device 2 and displays it on the HMD 4 (step S40). S59).

(Processing when light emission of the light emitting RFID tag is not recognized)
When there is no light emission point in step S56 (step S56 → “none”), the display control unit 55 clearly shows that the maintenance worker has reached the vicinity of the maintenance target device 2 (from the light emitting RFID tag 1). Because Ack was received). Therefore, it is determined that the corresponding light emitting RFID tag 1 is within the communicable range, but the maintenance target device 2 is out of the field of view (step S57). Then, the processing device 5 activates the guide information generation unit 57, and displays guide information for searching for a light emitting point such as “look around” by the guide information generation unit 57 (step S58).

(End of processing: S44 to S48 in FIG. 2)
Finally, a stop command signal is input to the light emission request transmission unit 51 via the input device 8 to stop information display and transmission of the light emission request signal by the processing device 5. At the same time, the light emission request transmission unit 51 transmits a stop command signal to the corresponding light emission type RFID tag 1 via the R / W 7, and the light emission type RFID tag 1 that has received the stop command signal stops emitting light after a certain time. To do.

As a real problem, the maintenance target device 2 is not necessarily included in the captured area. Therefore, when the display position is calculated only by image processing as in the past, the target object is first included in the captured image. It is necessary to perform a calculation process by comparing with feature points registered in advance. Therefore, the maintenance target device 2 is extracted from the captured image, the position and direction thereof are recognized, and the display position of related information is calculated based on the extracted position and direction.
On the other hand, according to the above-described embodiment of the present invention, at the time when communication with the light emitting RFID tag 1 having unique identification information with respect to the maintenance target device 2 is established, at least the maintenance target device within the communicable range. 2 can be determined to exist, the process of extracting the maintenance target device 2 from the image becomes unnecessary. Furthermore, since the position that becomes the base point of the related information display can be calculated by a simple process of calculating the difference between the images, the load on the processing device 5 related to the image processing is greatly reduced.

  Further, according to the embodiment of the present invention, the processing device 5 acquires information to be displayed from the storage device 6, and further acquires the display position as relative coordinates from the light emission position. In this way, since the image processing necessary for determining the display position only needs to calculate the difference between the two images, the processing load can be greatly reduced, and the coordinates that become the base point of information display can be reduced by that amount. Since recalculation is possible, it is possible to construct an easy-to-use system that can easily follow changes in the position and line-of-sight direction of the operator.

According to the above-described embodiment of the present invention, one light emitting RFID tag 1 is attached to each maintenance target device 2 for which information is to be displayed. When associating information with one point, the display position can be determined as it is.
However, in the case of a display method in which a two-dimensional figure or the like is pasted on the maintenance target device 2, for example, a display in which a circuit diagram inside the device is overlapped with CG, the orientation, inclination, etc. of the maintenance target device 2 are image processed Need to be recognized.

[Calculation of image tilt using multiple light emitting RFID tags]
FIG. 6 is a diagram showing an example of a system configuration of an information presentation system based on augmented reality according to another embodiment of the present invention. Image processing is performed by attaching a plurality of light emitting RFID tags 1 to a maintenance target device 2. It was shown in order to explain an example of reducing the load.
An example of reducing the image processing load by attaching a plurality of light emitting RFID tags 1 to the maintenance target device 2 will be described with reference to FIG.
Also in this case, the wearable computer carried by the maintenance worker is the same as the embodiment shown in FIG. However, a plurality of light emitting RFID tags 61 to 63 are attached to the maintenance target device 2 here. The number of light emitting RFID tags 61 to 63 to be attached depends on the shape of the maintenance target device 2, but in the case of a box type, three light emitting RFID tags 61 to 63 are provided on the surface to be displayed in an overlapping manner. The purpose can be achieved by sticking.

Specifically, specific identification information is written in each light emitting RFID tag 1 to be affixed, and the maintenance target device 2 and its affixing position are associated with each other and stored in the storage device 6. To do.
The light emission request signal transmitted from the processing device 5 to the light emitting FID tags 61 to 63 via the R / W 7 includes unique identification information. Since each of the issuance type RFID tags 61 to 63 emits light only when the identification information assigned in advance matches the sent identification information, the processing device 5 has three issuance type RFID tags 61 to 63. By sequentially emitting light, the orientation of the display surface of the maintenance target device 2 can be uniquely specified. A method of specifying the orientation of the display surface of the maintenance target device 2 will be described later with reference to FIG.

FIG. 7 is a diagram showing an example of an augmented reality image display of an information presentation system based on augmented reality according to another embodiment of the present invention described above. Specifically, an example of overlay display of a circuit diagram on the maintenance target device 2 plane is shown.
With reference to FIG. 6, an example of the augmented reality image display of the information presentation system based on the augmented reality according to another embodiment of the present invention will be described with reference to FIG.
In FIG. 7, light emitting RFID tags 72 to 74 in which unique identification information is written are affixed to the plane 71 of the maintenance target device 2. The processing device 5 (display control unit 55) is an image 75 obtained by photographing the maintenance target device 2 with the camera 3, and is based on the coordinates in the image 75 of the light emitting RFID tags 72 to 74 and the relative coordinates in the real space. A conversion matrix of coordinates on the plane 71 of the device 2 can be generated. Here, based on the generated conversion matrix, a circuit diagram 77 obtained by transforming the circuit diagram 76 inside the maintenance target device 2 read from the storage device 6 is acquired, and this is superimposed on the captured image 75. Then, a display image 78 that matches the image of the real space can be obtained.

  As described above, in the embodiment of the present invention, for example, a light emitting RFID tag 1 is attached to a maintenance target device 2 related to maintenance work such as equipment, piping, and measuring instruments in a plant, and a maintenance worker carries it. The light emitting type RFID tag 1 related to the maintenance target device 2 that requires information presentation is selectively emitted by transmission from the R / W 7 to be able to detect the position and direction of the maintenance target device 2 by simple image processing. Is. Therefore, the processing device 5 captures an image from the camera 3, calculates the position of the light emitting RFID tag 1 that emits light, uses the coordinates of the light emitting RFID tag 1 calculated from the image as a base point, and relates to the work. The obtained information is converted into CG and displayed on a display device such as HMD4.

  According to the configuration described above, for example, a captured image that changes every moment according to a change in the position and posture of an operator, targeting an object that is difficult to distinguish the individual maintenance target devices 2 by feature points, such as devices and piping in a plant. Therefore, the existence of the maintenance target device 2 and the position and direction of the maintenance target device 2 can be specified at high speed while suppressing the load of image processing, and an augmented reality that visualizes the relationship between the object and the information can be realized.

  Note that the light emission request transmission unit 51, the response signal reception unit 52, the image capture unit 53, the difference image calculation unit 54, the display control unit 55, the CG generation unit 56, and the guide information generation illustrated in FIG. Specifically, the functions of each of the units 57 are as follows. The processing device 5 uses the camera 3, HMD 4, R / W 7, and input device 8 connected as peripheral devices, and stores the program recorded in the storage device 6. This is realized by sequentially reading and executing. Note that the above-described program includes program data downloaded via an OS (Operating System) or a communication line.

It is a figure which shows an example of the system configuration | structure of the information presentation system by the augmented reality concerning embodiment of this invention. It is the operation | movement sequence diagram quoted in order to demonstrate operation | movement of the information presentation system by the augmented reality concerning embodiment of this invention. 1 schematically shows an example of a method for specifying a position from images before and during light emission of a light emitting RFID tag used in an embodiment of the present invention. It is the block diagram which expanded and showed the function of the internal structure of the information presentation apparatus (processing apparatus) by the augmented reality concerning embodiment of this invention. It is the flowchart quoted in order to demonstrate operation | movement of the information presentation apparatus by the augmented reality concerning embodiment of this invention. It is a figure which shows an example of the system configuration | structure of the information presentation system by the augmented reality concerning other embodiment of this invention. It is a figure which shows an example of the augmented reality image display of the information presentation system by the augmented reality concerning other embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Light emission type RFID tag 2 Maintenance object apparatus 3 Imaging device (camera)
4. Display device (HMD: head mounted display)
5 Information presentation device (processing device)
6 Storage device 7 Reader / Writer (R / W)
DESCRIPTION OF SYMBOLS 8 Input device 51 Light emission request transmission part 52 Response signal reception part 53 Image capture part 54 Difference image calculation part 55 Display control part 56 CG generation part 57 Guide information generation part

Claims (7)

A light emitting RFID tag that is attached to a maintenance target device for which information is to be displayed,
The light emitting RFID tag is an information presentation system based on augmented reality that is connected via a reader / writer and includes at least an information presentation device including a photographing device, a display device, a storage device, and a processing device,
The processing device has a function of reading identification information for uniquely identifying the light emitting RFID tag from the storage device, and transmitting a light emission request signal including the identification information to the light emitting RFID tag,
The light emitting RFID tag compares the unique identification information written in itself with the identification information received from the processing device, and emits light intermittently at a predetermined time interval when they match. It has a function to send a response signal to the device,
The processing device calculates a difference between a photographed image captured before and during light emission at a time interval adjusted in advance through the photographing device, and the light emitting RFID tag is obtained from the difference image obtained as a result of the computation. The display position related to the maintenance target device for which the information is to be displayed is acquired from the storage device, and the display position of the display information is calculated as relative position coordinates based on the light emission position. An information presentation system based on augmented reality, wherein the display information is converted into computer graphics and displayed on the display device. A light emitting RFID tag that is attached to a maintenance target device for which information is to be displayed,
The light emitting RFID tag is an information presentation method based on augmented reality in an information presentation system that is connected via a reader / writer and includes at least an information presentation device including a photographing device, a display device, a storage device, and a processing device. And
The processing device is
Read identification information that uniquely identifies the issuing RFID tag from the storage device, and send a light emission request signal including the identification information to the light emitting RFID tag,
The light emitting RFID tag is
The unique identification information written in itself is compared with the identification information received from the processing device, and when they match, light is emitted intermittently at a predetermined time interval and a response signal is transmitted to the processing device. ,
The processing device is
The difference between the captured images captured before and during the light emission is calculated at a preset time interval via the imaging device, and the light emission position of the light emitting RFID tag is calculated from the difference image obtained as a result of the calculation. ,
The processing device is
The display information related to the maintenance target device for which the information is to be displayed is acquired from the storage device, the display position of the display information is calculated as relative position coordinates based on the light emission position, and the display information is calculated by computer graphics. Converting it into a display on the display device,
An information presentation method using augmented reality, characterized by comprising: Based on augmented reality, which is connected to a light-emitting RFID tag that is attached to a maintenance target device that wants to display information and that is attached to a maintenance target device via a reader / writer, and includes a photographing device, a display device, and a storage device An information presentation device,
A light emission request transmitter that reads identification information for uniquely identifying the issuing RFID tag from the storage device, and transmits a light emission request signal including the identification information to the light emitting RFID tag;
When a response signal is received from the light emitting RFID tag, the difference between the captured images captured before and during the light emission is calculated via the imaging device, and the difference between the light emitting RFID tag and the difference image obtained as a result of the calculation is calculated. A difference image calculation unit for calculating a light emission position;
The display information related to the maintenance target device is acquired from the storage device, the display position of the display information is calculated as relative position coordinates based on the light emission position, and the display information is converted into computer graphics. Display control unit for displaying on the display device,
An information presentation device with augmented reality characterized by comprising: The display control unit
When the response signal cannot be received from the light emitting RFID tag, or when it is determined that the maintenance target device for which the information is to be displayed is received out of the field of view even when the response signal is received, the information is to be displayed. 4. The information presentation apparatus with augmented reality according to claim 3, wherein guide information necessary for reaching the maintenance target device is generated and displayed. The light emission request transmitter is
5. The light emission request is sequentially transmitted to a plurality of light emitting RFID tags, each of which is attached to a maintenance target device for which the information is to be displayed and in which unique identification information is written, respectively. An information presentation device based on augmented reality described in 1. The display control unit
On the image of the maintenance target device to be displayed captured via the imaging device, the coordinates of the coordinate on the plane of the maintenance target device are determined from the base point position in the image of each light emitting RFID tag and the relative coordinates in the real space. 6. A conversion matrix is generated, display information related to the maintenance target device is converted in accordance with the conversion matrix, and is displayed superimposed on the captured image of the maintenance target device. The information presentation apparatus by the augmented reality as described in any one of the above. Augmented reality, which is connected to a light emitting RFID tag that is attached to a maintenance target device for which information is to be displayed and is attached via a reader / writer, and that includes a photographing device, a display device, and a storage device. A computer program used for an information presentation device according to
A process of reading identification information for uniquely identifying the issuing RFID tag from the storage device, and transmitting a light emission request signal including the identification information to the light emitting RFID tag;
When a response signal is received from the light emitting RFID tag, the difference between the captured images captured before and during the light emission is calculated via the imaging device, and the difference between the light emitting RFID tag and the difference image obtained as a result of the calculation is calculated. A process of calculating the light emission position;
The display information related to the maintenance target device is acquired from the storage device, the display position of the display information is acquired as relative position coordinates based on the light emission position, and the display information is converted into computer graphics. Processing to display on the display device,
A computer program that causes a computer to execute.

Images