JP3208939B2 - Monitoring device with head-mounted display device - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to, for example, performing maintenance of a production machine by superimposing two-dimensional image information of a subject displayed on a head-mounted display device with an actual visual image. Facilitates matching with the components of
It relates to a monitoring system that enables information utilization in actual work.

[0002]

2. Description of the Related Art At present, the operation status of production equipment is monitored in a room in which a control device is centrally installed in one place so that labor saving, predictive maintenance of the equipment, and quick investigation of the cause of failure are possible. For example, it is performed in a centralized monitoring room provided on the line side. In such a centralized monitoring room, a monitor device or the like is provided so that the state of the equipment can be visually recognized, and design information of each equipment and information collected from the control device can be used. Has become.

[0003]

In general, the centralized monitoring room is often installed at a place remote from the production equipment group.
Therefore, for example, when a production facility in a factory breaks down, the work place is away from the monitoring room.

For this reason, despite the fact that various types of management information can be viewed on the screen of the terminal in the centralized monitoring room, the design drawings, component arrangements, and electric wiring conditions are conventionally changed at the site of the actual repair work. There is a problem in that work is performed while collating a subject while using the drawn control drawing, or obtaining information from a centralized monitoring room using paging or communication means, thereby increasing the burden on maintenance work and repairing failures.

The present invention has been made to solve such a problem. For example, when performing maintenance of a production machine, two-dimensional image information of a subject displayed on a display device attached to a helmet is provided. Provision of a monitoring system that superimposes the actual visual image on the subject to make it easier to match with the constituent elements of the subject, reduces the burden on maintenance work and repairs, and uses the information accumulated in the actual work. With the goal.

[0006]

According to the present invention, there is provided a system for monitoring equipment information, wherein equipment information relating to a subject is extracted from design information of each equipment and accumulated information collected from a control device. Means for selecting, a display unit for displaying two-dimensional image information, a display means provided with a head-mounted display device having an observation unit for external scenery, and equipment instruction means for instructing the selection means on target equipment Conversion means for developing the extracted information as two-dimensional image information; mode designating means for designating the mode of development of subject information; and determining an imaging region based on the position of the operator and the direction in which the operator is looking. And generating a mask corresponding to the aspect instruction information and the imaging region, and generating a local image corresponding to the mask from the two-dimensional image information. And having a display control means composed of an image selecting means for extracting the information, and communication means for transmitting or receiving the facilities extracted information and the facility instruction information.

[0007]

According to the present invention constructed as described above, the information of the subject present around the operator, which is extracted from the design information of each facility and the accumulated information collected from the control device, is used to convert the image magnification ratio, image reduction ratio, operator In response to an instruction of the mode of expansion such as the elevation angle of the image, the image is expanded as a two-dimensional image and displayed on the head-mounted display device.

At this time, since a mask corresponding to the imaging region is applied and only the image of the portion where the mask is applied is extracted and output, only the image of the necessary portion which the operator is going to view is extracted. The information is displayed on the display, and can be viewed while being superimposed on the actual visual image.

[0009]

DESCRIPTION OF THE PREFERRED EMBODIMENTS One embodiment of the present invention will be described below with reference to the drawings.

FIG. 1 is a schematic diagram of a monitoring system according to one embodiment of the present invention, and FIG. 2 is a block diagram showing FIG. 1 in a functional configuration.

The selection means 1 includes a control device 11, a display device 1
2. It comprises an input device 13, an output device 14, a communication device 15, a control device 16, a data file 17, and the like. Normally, the operation status of each facility constituting the line is centrally monitored on a monitor screen, and design information of each facility and accumulated information collected from a control device are stored in a data file 17.

The equipment image is input as accurate image information by a general-purpose drawing tool or an image input device such as an image scanner.

The display means 2 includes a head-mounted display device having a display section for the two-dimensional image information and an external scene observation section.

FIG. 1 shows a so-called goggle type in which a gyro GR and a temperature sensor C are mounted. In this case, you can use both hands freely,
This is advantageous in that the position of the operator and the direction of the line of sight detected by the built-in gyro can be obtained extremely accurately, and that the appearance temperature of the subject can be obtained.

In this type of information display device, for example, a display is provided on a glass surface of goggles, and an image radiated from a very small high-brightness display is displayed on the glass surface via a light projecting lens. .

The display control means 3 is a data file 31 for temporarily storing information on a subject existing around the operator, which is obtained from the selection means 1 by indicating the target equipment.
And the data file 3 based on the instruction information of the development mode.
An image memory 32 for expanding and storing the extracted information stored in the image information 1 as a two-dimensional image; From the image memory 32, and the display means 2 has a display control device 33 for outputting.

The display control means 3 has a keyboard unit and a display unit for confirming the contents of instructions and detailed conditions for instructing target equipment and instructing how to develop subject information. I have. The keyboard is designed for work efficiency.
Frequently used instruction items, image enlargement / reduction ratio,
Providing a dedicated input key for the operator's elevation is advantageous.

The communication means 4a and 4b are communication devices for wirelessly transmitting and receiving the equipment instruction information and the equipment extraction information.

Next, the operation of this embodiment will be described with reference to the flowchart of FIG.

The operator inputs necessary subject-related equipment information, that is, equipment instruction information, to the display control means 3 using a keyboard (S1).

The communication means 4b transmits the equipment instruction information to the selection means 1 (S2).

Based on the equipment instruction information received via the communication means 4a, the selection means 1 reads a subject-related information from a data file 17 storing design information of each equipment and accumulated information collected from a control device. Equipment information, that is, equipment extraction information is extracted and transmitted to the display control means 3 via the communication means 4a (S3).

The display control means 3 stores the equipment extraction information received via the communication means 4b in the data file 31 (S4).

To adjust the magnification and elevation angle of the image displayed on the display, the operator uses the keyboard to provide instructions on the development mode, such as the magnification and reduction ratio of the image, the operator's elevation angle, etc., using the keyboard. Is input to the display control means 3 (S5).

The display control means 3 develops the equipment extraction information stored in the data file 31 as a two-dimensional image based on the mode instruction information, and
(S6).

The gyro GR is replaced with the current position of the operator and the front direction of the head-mounted display device, and is recognized by the operator (line of sight). Specifically, the head-mounted display device exists. A signal relating to the current position (Δx, Δy.Δz) and a direction signal (Δθx, Δθy, Δθ) indicating which direction the front direction of the information display device is facing and how much the elevation angle is.
z) is output (S7). The display control means 3 controls the direction signals (Δθx, Δθy,
Based on [Delta] [theta] z), the position of the operator and the direction of the line of sight are indirectly recognized, and a mask area to be applied to the image developed in the image memory is calculated (S8).

The display control means 3 extracts only the masked image information and displays it on the head-mounted display device 2 (S9).

The display control means 3 determines the presence or absence of an operator's instruction. If the result of this determination is that there is no change, the processing from step S7 is repeated. If it is determined that there is a change, the next step is performed. Proceed to (S10).

It is determined whether or not the magnification or the elevation angle of the image displayed on the display has been changed. If the result of this determination is that there has been a change, the processing from step S5 is repeated. (S11).

It is determined whether or not there is a change in the target equipment. If the result of this determination is that there is a change, the processing from step S1 is repeated. If it is determined that there is no change, the process ends (S12).

FIG. 4 is a display example on the head-mounted display device according to the present embodiment, and shows an actual view image R and an image pickup VR of a sectional view of the equipment.

C1 and C2 are the sensor values (temperatures)
AB indicates an abnormal part. In addition, the display of the abnormal location is, for example, red or blinking, so that the worker's recognition degree of the dangerous location can be increased.

For example, when an abnormality occurs in the equipment,
The operator inspects the equipment with reference to the device drawing and the control drawing, and investigates the cause of the occurrence of the abnormality. Once the cause has been determined, which part is most likely to be found, the troubled parts can be found by relying on wire numbers and the like.

This operation is not so difficult as to work on a very small device. However, when the target is a large-sized device, the number of parts is very large, and the work of searching for a failed part is extremely difficult.

On the other hand, a large-sized device often performs important work, and a failure location is generally liable to occur in a bad environment and the working environment is bad. It is desired to complete as soon as possible.

However, since the apparatus according to the present embodiment has a function of enlarging and reducing the sectional view of the equipment in addition to the above-described display example, an abnormal portion can be easily located by overlapping the outer shape of the equipment with the sectional view. It will be possible to respond quickly to failures.

FIG. 5 is another display example of the apparatus according to the present embodiment.

The present apparatus has a subject temperature detecting means, for example, a temperature sensor, and information display means for displaying the detected temperature on the display device, and can add the subject temperature information to the display contents. It was done.

For example, in a place such as a press factory, there are many high-temperature substances and high-temperature facilities, and these are difficult to distinguish from low-temperature ones in appearance, and it is not easy to satisfy work efficiency and safety.

However, in the present invention configured as described above, since the temperature of the subject can be detected on the spot, for example,
It is possible to judge instantly whether to grasp the subject with bare hands or use a tool, and it is possible to improve work efficiency while maintaining safety.

In addition, the display color of the temperature is made to correspond to the temperature. For example, when the temperature of the object is low, the color is changed to green, yellow or red as the temperature increases, so that the worker's recognition of the temperature can be increased. It is possible.

[0042]

As described above, according to the present invention, only the necessary portion of the image that the operator is trying to view is extracted and displayed on the display. Thus, at the time of work, it is possible to simultaneously recognize information and management information that cannot be grasped in appearance, thereby improving work efficiency and safety.

[Brief description of the drawings]

FIG. 1 is a schematic diagram of a monitoring system according to the present invention.

FIG. 2 is a block diagram showing FIG. 1 in a functional configuration.

FIG. 3 is a flowchart of the embodiment.

FIG. 4 is a display example on a head-mounted display device.

FIG. 5 is another display example on the head mounted display device.

[Explanation of symbols]

1 ... Selection means, 2 ... Display means, 3
... Display control means, 4a, 4b ... Communication means, C ... Temperature sensor, GR ... Gyro, R ... Real visual image, VR ... Imaging.

Continuation of the front page (56) References JP-A-6-213693 (JP, A) (58) Fields investigated (Int. Cl. ⁷ , DB name) G05B 23/02 G06F 3/14

Claims (1)

(57) [Claims] A system for monitoring equipment information, a selection means for extracting object-related equipment information from design information of each equipment and accumulated information collected from a control device.
A display unit (2) including a head-mounted display device having a display unit for two-dimensional image information and an observation unit for external scenery; and a target facility is instructed to the selection unit (1). Equipment instructing means, converting means for developing the extracted information as two-dimensional image information, mode instructing means for instructing the mode of developing the subject information, and imaging based on the location of the operator and the direction in which the operator is looking Display control means comprising: recognition means for determining an area; and image selection means for generating a mask corresponding to the aspect instruction information and the imaging area and extracting local image information corresponding to the mask from the two-dimensional image information. (3) A monitoring system comprising: communication means (4a, 4b) for transmitting or receiving the equipment instruction information and the equipment extraction information.