JPH11249587A - Information presentation system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information presentation system capable of improving operability by quickly providing an operator with necessary information. SOLUTION: A head-mounted display 2 mounted on an operator 4 and an operator side controller 7 connected with an operator side input device 3 are connected with an instruction side controller 51 having a storage device 52 of information concerning an operation object via communication devices 49, 56. A signal corresponding to information inputted from the input device 3 is transmitted to the instruction side controller 51 from the operator side controller 7. And an image generated by the instruction side controller 51 according to the inputted information and the information concerning stored operation object and transmitted to the operator side controller 7 is displayed by the head-mounted display 2.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information providing system, and is suitable for providing work support information to workers who patrol to perform work such as inspection, maintenance, and repair at various work sites. For example, large-scale industrial facilities such as steelmaking lines, petroleum and chemical plants, power generation plants, gas production plants, shipbuilding lines, various automation lines, garbage disposal plants, long bridges, tunnels, high-rise buildings, power plants, communications Network facilities, transportation facilities such as railways and roads, public facilities such as airports, harbors, and stations, large-scale structures such as munitions facilities, and large-scale construction machines such as energy machines such as turbines and boilers, and transport equipment such as aircraft, ships, and vehicles. In addition, information can be provided to workers at event venues such as large-scale farms, ballparks, and concert halls.

[0002]

2. Description of the Related Art Workers who visit a large-scale facility for maintenance and inspection, etc., check necessary items using a checklist held in their hands, and if necessary, replace, re-adjust, or repair equipment parts. Is going. In addition, parts are removed, replaced, refurbished, and commissioned while referring to the equipment manuals.

[0003] In recent years, due to the complexity of the device to be worked and the use of black boxes, work requiring advanced technology has been required. Therefore, the manuals for the apparatus are very thick. Referencing such manuals at the work site reduces work efficiency. Therefore, the information providing device mounted on the worker's body uses a CD-ROM
It has been attempted to obtain information by reading manuals stored in a storage medium such as a memory card or a memory card.

[0004]

However, when using such manuals, it takes time and effort to search for a target matter. Also, when performing work based on the situation,
Expert judgment is required.

[0005] In addition, since the judgment at the time of work is generally left to the individual worker, if an erroneous work is performed, the error is not clarified until a work report is made or an accident occurs.

[0006] When a plurality of workers work at places separated from each other, the work contents of each person may affect each other's work contents. However, such a case cannot be dealt with simply by reading the manuals from the storage medium.

[0007] An object of the present invention is to provide an information providing system capable of solving the above problem.

[0008]

An information providing system according to the present invention comprises a head-mounted display device that can be worn by an operator, an input device that can be carried by the worker, and a head-mounted display device. An operator-side control device connected to the input device, and a command-side control device connected to the operator-side control device via a communication device and having a storage device for information on a work target are provided. A signal corresponding to the information input from the input device can be transmitted from the worker-side control device to the command-side control device via the communication device. The command-side control device can generate a command signal in accordance with the input information and the stored information on the work target. An image corresponding to a command signal transmitted to the worker-side control device via the communication device can be displayed on the head-mounted display device. According to the configuration of the present invention, the signal corresponding to the information input by the worker through the input device is transmitted from the worker-side control device to the command-side control device via the communication device. The command-side control device transmits a command signal generated according to the input information and the information on the work target stored in the storage device to the worker-side control device via the communication device. An image corresponding to the command signal is displayed on the head-mounted display device so that the worker can visually recognize the image. Thus, the worker can obtain information on the work target according to the information input from the input device without carrying the manual.
Furthermore, when performing an operation by judging from a situation, information necessary for the situation can be obtained by inputting information corresponding to the situation from the input device.

Preferably, means for outputting information corresponding to information input from the input device is connected to the command-side control device. Thus, by inputting information corresponding to a work result from the input device, information corresponding to the work result is output from the command-side control device, and it can be determined whether an erroneous work has been performed.

[0010] In the information providing system according to the present invention, the command-side control device receives the information input from the at least one input device via the worker-side control device and the stored information on the work object. It is preferable that a command signal can be transmitted to another operator-side control device, and an image corresponding to the command signal can be displayed on another head-mounted display device. Thereby, when a plurality of workers work at places separated from each other, it is possible to cope with the influence on the work contents even if the work contents of each person affect each other's work contents.

[0011]

Embodiments of the present invention will be described below with reference to the drawings. The information providing system shown in FIG. 1 includes a plurality of worker terminals 1 and a host computer (command side control device) 51. Each terminal 1 is connected to a head-mounted display device 2 that can be worn by a worker, a worker-side input device 3 that can be carried by the worker, and the head-mounted display device 2 and the input device 3. And an operator-side control device 7 constituted by a computer.

As shown in FIG. 2, the head-mounted display device 2 has a holder 5 that can be mounted on the head of an operator 4 and a display 6 that is held by the holder 5. In the present embodiment, the display unit 6 allows the image to be visually recognized only by one eye of the worker 4, but may be configured to allow both eyes to visually recognize the image. The input device 3 and the worker-side control device 7 attach the belt 1 to the waist of the worker 4.
0 is provided in a case 11 which is mounted via the first case.

The holding portion 5 is in the form of a band sandwiching the head of the worker 4, but the form is not limited as long as it can be mounted on the head of the worker 4, and may be, for example, a helmet. . In the present invention, the head refers to a portion above the neck including the face.

The display unit 6 includes a display unit 6a that emits image display light, an optical system 6b that changes an optical path of the image display light and guides the image display light to a field of view of the worker 4, and the display unit 6a and the optical system. 6b connecting the arm 6c with the arm 6c. The display unit 6a is connected to the worker-side control device 7 via a cable 9.

As shown in FIG. 1, the display unit 6a includes a backlight 32 composed of a halogen lamp with a reflecting mirror and a voltage regulator 33 for the backlight 32.
A heat absorbing filter 34 for absorbing the heat of the backlight 32; a liquid crystal panel 35; and a scattering plate 36 for guiding the light of the backlight 32 to the liquid crystal panel 35 with uniformity.
And a liquid crystal driver 38 connected to the liquid crystal panel 35
And an input / output interface 39 connected to the liquid crystal driver 38. Image display light is emitted from the front surface of the liquid crystal panel 35 as shown by a chain line. In place of the liquid crystal panel 35 with the backlight 32, for example, C
An RT display may be used. Further, a cold cathode tube, a hot cathode tube, a metal halide lamp, or the like may be used as the backlight.

The image display light is reflected or diffracted by the optical system 6b to change the optical path and is led to the eyes of the worker 4, so that the image to be visually recognized can be located in front of the worker 4. It is formed. The optical system 6
b is configured by a combiner such as a half mirror or a hologram element that transmits light from the front. The optical system 6b may be configured by a mirror or the like that changes the optical path by totally reflecting the image display light, and may further include a condenser lens system.

The worker-side control device 7 functions as an interface for connection with the host computer 51,
A main memory 44 for storing a program, a CPU 45 for executing the program, an image memory 46 for storing image data, a character font memory 48 for storing character font data, and an image memory 46 and a character font memory controlled by the CPU 45 An image controller 47 that reads and writes data from and to the input device 3 is provided. A worker-side wireless communication device 49 with an antenna is connected to the input / output interface 43. The communication device 49 is provided in the case 11.

The host computer 51 includes a storage device 52 for storing information on a work target, a storage device 52 'for storing a program, and a CP for executing the program.
U53, a command input device 54 such as a keyboard, a printer 55, an input / output interface 57 connected to the input device 54 and the printer 55, an image signal output interface 58, and a monitor 59 connected to the interface 58. The command-side wireless communication device 56 with an antenna is connected to the input / output interface 57. By storing information on the work target in the storage device 52, a database managed by the host computer 51 is configured. In the database, information on the work target is stored in association with a predetermined classification. For example, in the example described later, the information is classified according to the model of the aircraft to be maintained and inspected. The host computer 51 and the worker-side control device 7 are connected via the communication devices 49 and 56.
The communication between the terminal 1 and the host computer 51 can use specific low-power wireless communication, infrared communication, PHS communication, or the like.

According to the above configuration, before the start of the work, the signal corresponding to the information input from the input device 3 by the operation of the worker 4 is transmitted from the worker-side control device 7 to the communication devices 49,5.
6 to the host computer 51. The input information is information for specifying the work such as the work target and the work content. The work identification information is associated in advance with, for example, codes corresponding to numbers and characters that can be input from an input device including a keyboard, a barcode that can be input from an input device including a barcode reader, and the like. When performing the maintenance and inspection work on the aircraft A as illustrated in FIG. 2, the worker 4 inputs a code corresponding to the aircraft number of the aircraft A to be worked and a code corresponding to the work content into the input device 3 as input information. Enter by. A signal corresponding to the input code is transmitted to the communication devices 49, 5
6 to the host computer 51. For the work content, for example, a predetermined code corresponding to the consumable part is input for maintenance of the consumable part, and a predetermined code corresponding to the part is input for function check of a specific part. Is done. It is preferable that a code corresponding to the maintenance target and the maintenance content is displayed on the head-mounted display device 2 and is input by selecting the displayed one by operating the input device 3.

The host computer 51 generates a command signal in accordance with a program created and stored in advance in accordance with the input information from the input device 3 and the information on the work object stored in the storage device 52. In the example shown in FIG. 2, the host computer 51 reads out information corresponding to the machine number to be worked out of the information stored in the storage device 52, and generates a command signal corresponding to the work content. When the code corresponding to the consumable part is input as the work content, the maintenance history data of the consumable part is read out, and it is determined whether or not it is necessary to replace the part at the present time based on the guaranteed time of the consumable part, A command signal corresponding to the determination result is generated. Further, when it is determined that the parts need to be replaced, data indicating the replacement procedure may be included in the command signal. When a code corresponding to a specific part is input as the work content, data relating to the function of the specific part is read, and data relating to the function determination procedure is generated as a command signal.

The command signal is transmitted to the worker control device 7 via the communication devices 49 and 56. In response to the command signal, the image controller 4 is
7, the image data and the character font data read from the memories 47 and 48 are output as image signals to the liquid crystal driver 38 via the input / output interface 39, and the liquid crystal driver 38 drives the liquid crystal panel 35, An image corresponding to the command signal is displayed. Thereby, information can be provided in an interactive manner according to the input information of the worker 4. In the example shown in FIG. 2, a character image indicating the necessity of component replacement, an image illustrating a component replacement procedure, a character image indicating a function determination procedure, and the like are displayed.

Also, during the operation, a signal corresponding to the information corresponding to the operation status input from the input device 3 by the operation of the operator 4 is transmitted from the operator-side control device 7 to the communication device 4.
The data can be transmitted to the host computer 51 via the terminals 9 and 56. In the example shown in FIG. 2, when the result of the function determination is abnormal, a predetermined code corresponding to the information indicating the content of the abnormality is transmitted to the host computer 51. It is preferable that the code is displayed on the head-mounted display device 2, and is input by selecting the displayed code by operating the input device 3. According to the input information corresponding to the work status from the input device 3 and the information on the work target stored in the storage device 52, the communication device 49, 5
A command signal is transmitted to the worker-side control device 7 through the control device 6. In the example shown in FIG. 2, when a code signal corresponding to the information indicating the content of the function abnormality is transmitted, the host computer 51 outputs data relating to the coping method as a command signal.

When the work is completed, a signal corresponding to the work completion information input from the input device 3 by the operation of the worker 4 is transmitted from the worker-side control device 7 to the communication devices 49 and 5.
6 to the host computer 51. The work end information is information corresponding to the result of the work performed by the worker 4, and is associated with codes corresponding to numbers and characters. It is preferable that the code is displayed on the head-mounted display device 2, and is input by selecting the displayed code by operating the input device 3. FIG.
In the example shown in (1), the presence / absence of replacement of consumable parts, the result of a function check of a specific part, the result of coping with a malfunction, and the like are input as work end information.

The host computer 51 outputs the information corresponding to the work end information input from the input device 3 by the hard copy by the printer 55 and the display by the monitor 59. The information output means is not limited to a printer or a display device, and may be output by recording on a recording medium by an external storage device such as an FD device or an MO device.

The host computer 51 updates the database by rewriting the information on the work target stored in the storage device 52 according to the work end information. In the example shown in FIG. 2, the maintenance history of the parts classified according to the model of the maintenance target aircraft is updated according to the work end information corresponding to the replacement of the consumable parts.

According to the above configuration, the worker 4 can obtain information on a work target according to the information input from the input device 3 without carrying a manual. Furthermore, when performing an operation based on a situation, information necessary for the situation can be obtained by inputting information according to the situation from the input device 3. Thus, the worker 4 can obtain appropriate instructions even in the case of, for example, maintenance and inspection work on an unfamiliar type of airplane.
The same work as a skilled person can be performed. In addition, by inputting information corresponding to the work result from the input device 3, information corresponding to the work result is output from the host computer 51, and it can be determined whether an erroneous work has been performed. Thereby, the quality of the work result can be quickly determined. Further, the host computer 51 can edit the information corresponding to the work result and print it out in a report format, or update the database by rewriting the information on the work target stored in the storage device 52 according to the work result. In addition, labor after work can be largely saved.

The host computer 51 further includes: work end information input from at least one input device 3;
The necessity of transmitting information to the worker 4 wearing another head-mounted display device 2 is determined in accordance with the information on the work target stored in the storage device 52. When the information transmission is necessary, the host computer 51 outputs a command signal generated according to the input information and the stored information on the work target,
The information is transmitted to another worker-side control device 7. An image corresponding to the command signal is displayed by another head-mounted display device 2. For example, in a manufacturing plant composed of a plurality of devices, if the function adjustment of one device requires adjustment of the function of another device, the host computer 51
When the signal corresponding to the end information of the function adjustment work of one device is transmitted, the signal before the start of the work for the other device is transmitted via another operator-side control device Thus, a command signal for adjusting the function of another device can be transmitted to the other worker-side control device, and an image corresponding to the command signal can be displayed on another head-mounted display device. Further, in a manufacturing plant including a plurality of devices, when the function of adjusting the functions of a group of a plurality of devices needs to be adjusted for the functions of other devices, the host computer 51 adjusts the functions of the group of a plurality of devices. If the signal corresponding to the work end information is transmitted, the signal before the start of the work for other equipment is transmitted through another worker side control device, and the other worker side A command signal for adjusting the function of another device is transmitted to the control device, and an image corresponding to the command signal can be displayed on another head-mounted display device. Thereby, when a plurality of workers work at places separated from each other, it is possible to cope with the influence on the work contents even if the work contents of each person affect each other's work contents.

FIG. 3 shows a first modification of the present invention. The difference from the above-described embodiment is that the wireless communication device 56 on the host computer 51 side is provided in a plurality and is separated from each other, and is connected to a client-side computer 56 ′ constituting a client-server system. Each computer 56 'functions as a station, and is connected to the server-side computer 51' connected to the host computer 51 via a general-purpose communication line or a dedicated line. In addition, the equipment, plant, facility, and the like, which are the objects of maintenance and the like by the worker 4, are provided with a self-monitoring device 80 for monitoring the operation status and status of the self-monitoring device. Is transmitted to the host computer 51 through a communication network or the like.
The self-monitoring device 80 can be constituted by various sensors and a computer connected to the sensors. Thus, in addition to the information input by the worker 4, the host computer 51 can send an accurate command signal to the worker-side control device 7 based on the monitoring information. Others are the same as the above embodiment.

FIG. 4 shows a second modification of the present invention. The difference from the above embodiment is that a voice input device is provided in addition to the input device 3. That is, a microphone 71 for converting the voice of the worker 4 into a voice signal, a band-pass filter 72 for removing noise of the voice signal, an amplifier 73 for amplifying the voice signal after passing through the filter 72, and digitizing the amplified voice signal In addition, a processor 74 for performing voice recognition by comparison with comparison reference data described later, a working memory 75 for storing a voice signal digitized by the voice recognition processor 74, and a comparison reference data with the working memory 75. A matching memory 76 for storing is provided, and a signal corresponding to the voice recognition result can be transmitted to the host computer 51 by the worker-side control device 7. Others are the same as the above embodiment.

It should be noted that the present invention is not limited to the above-described embodiment and modifications. For example, a function may be provided in which a command signal is transmitted to the operator-side control device by the operation of the command-side input device by the operator of the host computer. Further, image data taken by a camera carried by the worker may be sent as input information to the host computer. Thereby, for example, the presence or absence of cracks on the surface of the maintenance target is determined by the host computer or an operator on the host computer side based on the image data,
Necessary information can be given to the worker. Further, data such as biological information such as brain waves, brain waves, heartbeats, and facial expressions detected by a sensor carried by the worker 4 may be sent to the host computer as input information.

[0031]

According to the present invention, the required information can be promptly provided to the worker to improve the work efficiency, the quality of the work result can be quickly judged, and a plurality of works to be performed at places separated from each other. It is possible to provide an information providing system capable of coping with the influence of the persons on each other's work.

[Brief description of the drawings]

FIG. 1 is a configuration explanatory diagram of an information providing system according to an embodiment of the present invention;

FIG. 2 is a diagram showing a use state of the information providing system according to the embodiment of the present invention;

FIG. 3 is a configuration explanatory diagram of an information providing system according to a first modified example of the present invention.

FIG. 4 is a configuration explanatory view of an information providing system according to a second modification of the present invention;

[Explanation of symbols]

 2 Head-mounted display device 3 Input device 4 Worker 7 Worker-side control device 49, 56 Communication device 51 Host computer (command-side control device) 52 Storage device 55 Printer 59 Monitor

Claims (3)

[Claims] 1. A head-mounted display device that can be worn by a worker, a worker-side input device that can be carried by the worker, and a worker side that is connected to the head-mounted display device and the input device. A control device, a command-side control device connected to the worker-side control device via a communication device and having a storage device for information on a work target, and a signal corresponding to information input from the input device; Can be transmitted from the worker-side control device to the command-side control device via the communication device, and the command-side control device outputs a command signal in accordance with the input information and the stored information on the work target. An information providing system, wherein an image corresponding to a command signal transmitted to the worker-side control device via the communication device can be displayed by the head-mounted display device. 2. The information providing system according to claim 1, wherein means for outputting information corresponding to information input from the input device is connected to the command-side control device. 3. An operator-side control from the command-side control device according to information input from at least one input device via the worker-side control device and the stored information on the work target. The information providing system according to claim 1, wherein a command signal can be transmitted to the device, and an image corresponding to the command signal can be displayed on another head-mounted display device.