JP2013016020A - Work support system, apparatus, method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a work support system that allows a worker to confirm a visual instruction given from a remote place without looking away from a work object.SOLUTION: A work support system includes a head-mounted display device 1 which can display predetermined information, photographing means 2 which can take a photograph of a visual line direction of a worker fitted with the head-mounted display device 1, and information processor 3. The information processor 3 includes instruction image generation means 5 which generates an instruction image by superposing a predetermined image on the photographed image of the visual line direction of the worker photographed by the photographing means 2 according to the operation of an operator who instructs the worker. The head-mounted display device 1 includes control means 4 which performs control so as to superpose the instruction image on the visual field of the worker when the instruction image generated by the instruction image generation means 5 is displayed.

Description

  The present invention relates to a work support system, a head mounted display device, a work support method, and a work support program.

  When a failure occurs in the communication network, the suspected device that seems to be causing the failure is immediately identified, and the impact on the user is minimized by replacing the identified device with a good replacement. Is required. In such maintenance and replacement work for equipment, generally, the monitoring department of the communication network identifies the suspicious device remotely from a remote location, and the local worker who actually performs the replacement work follows the instructions from the operator of the monitoring department. A process of performing work is performed.

  In this process, it is common for an operator to verbally transmit instructions to the worker using a telephone or the like. For this reason, there are problems such as the possibility of inducing a communication error, and it is difficult for the operator to determine whether the operator is working exactly as instructed.

  As a technique capable of solving such a problem, for example, Patent Document 1 describes a technique for supporting work. Further, for example, Patent Document 2 describes techniques related to these.

JP 2004-101372 A JP 2009-279193 A

  Actually, replacement work may be mistakenly performed on a normal device instead of a malfunctioning device due to a communication error when an operator at a remote location gives an instruction or carelessness of an operator. is there. As a result, there is a case where a human error occurs that causes an extra communication failure.

  In addition, since the device mounting state is irregular, there are cases where it is difficult to perform the work by a normal procedure. In this case, since the operator does not always know the working environment around the target device, even if the operator transmits it verbally, it may not be accurately transmitted to the operator. For this reason, there is a risk of occurrence of a work error that the work is performed in a normal procedure without adjusting the work procedure, and as a result, the peripheral device is affected.

  Furthermore, in the process of performing the cause isolation work for the failure target device, there are cases where the device other than the device initially regarded as the suspicious device becomes the work target and the work environment and the work place change. In this case, it is necessary to send a replacement procedure manual for the target device to the worker again and start verbal instructions such as specifying the device from the beginning. Therefore, an oral instruction for changing the schedule is necessary, and the cause of communication errors increases. In addition, if specialized knowledge is required for the changed suspected device, assuming that an operator who has only knowledge of the original suspected device is engaged in the work, work with specialized knowledge of the changed device Must be assigned and run separately.

  In the method described in Patent Document 1, the supervisor monitors the captured image and sound received from the work support apparatus, and if there is an abnormal event, the instruction is distributed to the work support apparatus using the supervisor terminal. Then, the work support device displays the received instruction on the head mounted display or outputs the sound to the earphone. Therefore, if the method described in Patent Document 1 is used, the operator can grasp the state of the site while being at a remote place, and can give a visual instruction in addition to the instruction that has been given only verbally. However, the method of simply displaying instructions on the head-mounted display in this way may not be able to display well so as to overlap the field of view when the contents of the instructions are displayed in a small size, etc. Not exclusively.

  Also, in maintenance work, which is an equivalent work process, a work video is acquired, the work target is clearly shown in the three-dimensional real-time simulation image, and the difference is displayed by superimposing it on the work video so that the work target is clearly indicated, and the procedure There are technologies that support the performance of work that complies with the standards. For example, Patent Document 2 describes a technique related to this.

  However, in the technique described in Patent Document 2, it is necessary to prepare a model database of simulation images and specify a work target in advance. Patent Document 2 does not disclose that a visual instruction is given. For this reason, it is difficult to apply to maintenance work in which the work target device and the work environment are sequentially changed while the communication failure target is isolated.

  Accordingly, the present invention provides a work support system, a head-mounted display device, a work support method, and a work support system that can confirm a visual instruction given from a remote place more securely without removing the line of sight from the work target. The purpose is to provide a work support program.

  A work support system according to the present invention includes a head-mounted display device capable of displaying predetermined information, a photographing unit capable of photographing a line-of-sight direction of a worker wearing the head-mounted display device, and an information processing device. The apparatus includes an instruction image generation unit that generates an instruction image by superimposing a predetermined image on a photographed image of the operator's line of sight taken by the photographing unit in accordance with an operation of an operator that gives an instruction to the worker. Comprises control means for controlling the instruction image so as to overlap the field of view of the operator when the instruction image generated by the instruction image generation means is displayed.

  In the head mounted display device according to the present invention, when displaying an instruction image in which a predetermined image is superimposed on a photographed image obtained by photographing the line of sight of the worker wearing the head mounted display device, the instruction image overlaps the worker's field of view. It is characterized by comprising control means for controlling as described above.

  According to the work support method of the present invention, an instruction image is generated by superimposing a predetermined image on a photographed image of the worker's line of sight photographed by the photographing means in accordance with an operation of an operator who gives an instruction to the worker wearing the head mounted display device. When the generated instruction image is displayed on the head mounted display device, the instruction image is controlled so as to overlap the field of view of the operator.

  The work support program according to the present invention instructs a computer to superimpose a predetermined image on a photographed image of the worker's line of sight photographed by the photographing means in accordance with an operator's operation that gives an instruction to the worker wearing the head mounted display device. An instruction image generation process for generating an image and a control process for controlling the instruction image so as to overlap the field of view of the operator when the generated instruction image is displayed on the head mounted display device are performed.

  ADVANTAGE OF THE INVENTION According to this invention, the visual instruction | indication given from the remote place can be confirmed more reliably, without an operator removing eyes | visual_axis from work object.

It is a block diagram which shows an example of a structure of the work assistance system by this invention. It is explanatory drawing which shows an example of the work visual field 31 with an instruction | indication. It is a flowchart which shows the process example which a work assistance system performs. It is explanatory drawing which shows an example of a worker's and an operator's visual field. It is a block diagram which shows the minimum structural example of a work assistance system.

  Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram showing an example of the configuration of a work support system according to the present invention. As shown in FIG. 1, the work support system includes a one-eye goggle-type head-mounted display device 100 (hereinafter simply referred to as a head-mounted display device 100), a wearable terminal 200, and an operator information processing device 300. In the present embodiment, a wearable terminal that an operator can wear on the body is used, but a laptop personal computer or the like may be used instead of the wearable terminal.

  The head mounted display device 100 and the wearable terminal 200 are attached by an operator and are connected to each other by wire or wireless. The wearable terminal 200 and the operator information processing apparatus 300 are connected to each other via a communication network 400 such as a LAN or the Internet.

  In the present embodiment, the head mounted display device 100 is worn by an operator during work, and is specifically realized by a glasses-type display device. The head mounted display device 100 includes a transflective display device 120 at a portion corresponding to a lens on one side of the glasses.

  In this embodiment, the eyeglass-type head-mounted display device 100 is used. However, the present invention is not limited to this. For example, a helmet-type display device may be used as long as it can be attached to the head. In this embodiment, the optical head-mounted display device 100 is used. However, the present invention is not limited to this. For example, a device that projects an image on the retina may be used. Further, for example, a type of projecting an external image taken by a camera instead of directly viewing the outside may be used. In the present embodiment, in accordance with general usage, a spectacle type, a helmet type, an optical system type, a retina irradiation type, and the like are collectively referred to as a head mounted display device. In the present embodiment, an image is a moving image or a still image.

  The transflective display device 120 of the head mounted display device 100 can be adjusted to a position in accordance with the focal length of the wearing operator. For example, the control means 130 of the head mounted display device 100 controls the transflective display device 120 to move back and forth in accordance with the operator's adjustment operation. In the present embodiment, the enlargement ratio of the image displayed on the transflective display device 120 can be adjusted at hand. For example, the control unit 130 of the head mounted display device 100 performs control so as to change the enlargement ratio of the image displayed by the transflective display device 120 in accordance with the operator's adjustment operation. The control unit 130 may correct the position, angle, color, and the like of the image to be displayed without being limited to the enlargement ratio.

  Further, the head mounted display device 100 has the web camera 110 mounted at an angle at which the worker's field of view can be accurately photographed at a place where the worker's field of view is not obstructed. The Web camera 110 captures the worker's field of view and transmits the worker's field of view image 10 to the wearable terminal 200. In this embodiment, the head mounted display device 100 is configured to mount the Web camera 110. However, the present invention is not limited to this, and the head mounted display device 100 may be separately mounted by an operator.

  Specifically, the wearable terminal 200 is realized by a small information processing apparatus worn by the worker on the body, and operates according to a program. The wearable terminal 200 has a function of transmitting / receiving data to / from the head mounted display device 100 or the operator information processing device 300.

  Specifically, the operator information processing apparatus 300 is realized by an information processing apparatus such as a personal computer that operates according to a program. The operator information processing apparatus 300 includes a display device 310 that displays the worker's view image 10 received from the wearable terminal 200, and a real-time image editing tool 320 that can edit the displayed worker's view image 10 in real time. I have.

  The real-time image editing tool 320 is specifically image editing software installed in the operator information processing apparatus 300. Hereinafter, the real-time image editing tool 320 uses expressions such as editing the operator's view image 10 and creating the operator's instruction image 12. Specifically, the CPU of the operator information processing device 300 uses the real-time image. These processes are executed according to the editing tool 320.

  The real-time image editing tool 320, for example, superimposes a dynamic instruction image by a pointer operation or the like on the worker's view image 10 according to an operator's operation (operator's instruction operation 20 shown in FIG. 1), or by contour detection. Color a specific part. In this embodiment, the operator information processing apparatus 300 superimposes the instruction pointer image 11 by reflecting the operator's instruction operation 20 by the real-time image editing tool 320 on the worker's view image 10 displayed on the display device 310. The operator's instruction image 12 is created.

  The operator information processing apparatus 300 transmits the created operator instruction image 12 to the wearable terminal 200 via the communication network 400. The wearable terminal 200 transmits the received operator instruction image 12 to the head mounted display device 100. Then, the transflective display device 120 of the head mounted display device 100 displays the received operator instruction image 12.

  The worker's view 30 shown in FIG. 1 is in a state where nothing is displayed on the transflective display device 120. Further, the work visual field 31 with the operator's instruction shown in FIG. 1 is a state in which the operator's instruction image 12 is displayed on the transflective display device 120. That is, in the work visual field 31 with an instruction from the operator, the operator looks at the operator's instruction image 12 displayed on the transflective display device 120 with one eye and looks at the work object or the like as usual with the other eye. Is realized.

  FIG. 2 is an explanatory diagram illustrating an example of a work visual field with instructions. As shown in FIG. 2, the transflective display device 120 displays the operator instruction image 12 in which the instruction pointer image 11 is superimposed on the view image 10 corresponding to the view field of the right eye of the worker photographed by the Web camera 110. ing. The operator can view the operator's instruction image 12 displayed on the transflective display device 120 with the right eye as if the instruction image was added to the normal field of view.

  Further, since the transflective display device 120 is a transflective type, the operator can visually recognize the target device and the like through the transflective display device 120 while viewing the instruction image 12 of the operator. For example, the operator performs an adjustment operation to change the enlargement ratio, display position, angle, etc. of the image so that the operator's instruction image 12 overlaps the field of view through the transflective display device 120. By performing the adjustment operation in this way, the operator can suppress the uncomfortable feeling of viewing the operator's instruction image 12 with one eye.

  Next, the operation of the work support system will be described with reference to the drawings. FIG. 3 is a flowchart illustrating an example of processing executed by the work support system.

  Here, it is assumed that the worker wears the one-eye goggle-type head-mounted display device 100 and works on the communication device or the like while using the wearable terminal 200. Further, since the operator is monitoring the network of the communication device, it is assumed that the operator has information regarding the suspected device that is the work target. Furthermore, it is assumed that the operator and the operator can talk using a communication service such as Skype (registered trademark).

  When an operator specifies a target device, the periphery of the target device is captured in the field of view while receiving verbal instructions from an operator. Then, the Web camera 110 mounted on the head mounted display device 100 worn by the worker captures the worker's line-of-sight direction (step S1). In addition, the Web camera 110 transmits the worker's view image 10 obtained by photographing the worker's line-of-sight direction to the wearable terminal 200. Then, the wearable terminal 200 transmits the worker's visual field image 10 to the operator information processing device 300 via the communication network 400 such as the Internet (step S2).

  Next, the display device 310 of the operator information processing device 300 displays the received worker view image 10 (step S3). Then, the operator confirms the worker's view image 10 on the display device 310, and grasps which device the worker currently recognizes as a target together with the content of the conversation.

  Next, the operator verbally instructs the worker about the target device, and uses the real-time image editing tool 320 to point the target with the pointer, or to move the pointer and surround the target with a circle (for example, The operator's instruction operation 20) shown in FIG. 1 is performed. Then, the real-time image editing tool 320 superimposes the instruction pointer image 11 on the worker's view image 10 according to the instruction operation 20 of the operator, and generates the operator instruction image 12 (step S4).

  Next, the real-time image editing tool 320 transmits the generated operator instruction image 12 to the wearable terminal 200 via the communication network 400. Then, the wearable terminal 200 transmits the operator instruction image 12 to the head mounted display device 100 (step S5).

  Next, the transflective display device 120 of the head mounted display device 100 displays the received operator instruction image 12 (step S6).

  Here, it is possible to adjust the transflective display device 120 according to the focal length of the operator. Further, the enlargement ratio of the image displayed by the transflective display device 120 can also be adjusted by hand operation. For this reason, the worker can see the field of view that appears semi-transmissive through the semi-transmissive display device 120 and the field of view of the operator instruction image 12 displayed on the semi-transmissive display device 120 (specifically, the worker's view image 10). Can be adjusted to overlap. The control means 130 of the head mounted display device 100 controls the operator's instruction image 12 so as to overlap the operator's field of view 30 according to the operator's adjustment operation (step S7).

  Specifically, the control means 130 of the head mounted display device 100 controls the position of the transflective display device 120 to move back and forth so as to match the focal length of the worker according to the operator's adjustment operation. Further, for example, the control unit 130 of the head mounted display device 100 performs control so as to change the enlargement ratio of the image displayed by the transflective display device 120 in accordance with the operator's adjustment operation. By adjusting in this way, as shown in FIG. 2, the operator can see his normal field of view with one eye, and the field of view with the operator adding an instruction in real time with the other eye (specifically, the instruction) The worker's view image 10 (that is, the operator's instruction image 12) to which the pointer image 11 is added is viewed. In this embodiment, the visual field in this state is referred to as a work visual field 31 with instructions. The work field of view 31 with such an instruction allows the worker to perform an operation upon receiving a verbal instruction and a visual instruction from the operator when the work target is specified and the work is performed. In addition, the operator can see the visual instruction from the operator without moving the line of sight from the work target.

  Next, the field of view of the operator and the operator will be described with reference to FIG. FIG. 4 is an explanatory diagram illustrating an example of the field of view of the operator and the operator.

  The worker has a wearable terminal 200, a one-eye goggle-type head-mounted display device 100 including a translucent display device 120 that projects an image on one eye of the worker, and a Web camera 110 that captures the field of view of the worker. Suppose you are working with Further, it is assumed that the wearable terminal 200 and the operator information processing device 300 worn by the operator are transmitting and receiving image data in real time.

  The Web camera 110 captures the worker's field of view 30 (a1 in FIG. 4), and transmits the captured worker's field of view image 10 to the operator information processing apparatus 300 (a2 in FIG. 4).

  The display device 310 displays the received visual field image 10 of the worker. The operator confirms the visual field image 10 of the worker displayed on the display device 310. Then, the operator selects and displays the operation of an index such as a pointer by a mouse or a touch panel operation or coloring of an object by acquiring an outline from the image, using a tool capable of image editing in real time on the worker's view image 10. To add an instruction to the visual field image of the worker. The display device 310 displays the operator instruction image 12 in which an instruction is added to the worker's view image (a3 in FIG. 4).

  The transflective display device 120 displays the operator instruction image 12 received from the operator information processing device 300 (a4 in FIG. 4). An operator obtains a work visual field 31 with instructions by looking at his / her own field of view (worker's field of view 30) and the operator's instruction image 12 superimposed in real time, and accurately confirms it while confirming verbally with the operator. Work can be realized.

  Further, when displaying an instruction sheet or an instruction image on an information processing terminal or the like, the worker must move his / her line of sight from the work target to the information processing terminal or the like in order to view the instruction. For this reason, there is a risk of mistakenly looking at the work object when the view is returned. However, in this embodiment, since the instruction image can be visually recognized by being superimposed on its own field of view (specifically, a field of view image corresponding to the field of view), it is not necessary to move the line of sight in order to see the instruction. For this reason, the risk of mistakenly looking at the work object is reduced, and smooth work execution can be realized without interrupting the work.

  As described above, in the present embodiment, it is possible to add a visual instruction to the remote work instruction that has been performed only verbally. For this reason, the double check between the operator and the operator acts on the behavior of the worker, and there is an effect of greatly reducing the risk of misinterpretation of the instruction and wrong work.

  In addition, by giving a visual instruction from a remote location so that the operator's field of view overlaps the operator's field of view, it is not necessary for the operator to remove the line of sight from the work object to view the instruction. This has the effect of reducing the risk of mistakes. Furthermore, by performing the adjustment operation so that the operator's instruction image overlaps the field of view through the transflective display device, the operator can suppress the uncomfortable feeling of viewing the operator's instruction image with one eye.

  In addition, since the operator can give instructions in real time to the worker's field of view that changes from time to time, smooth operation is possible even when the work environment or target device is changed from the original suspected device due to the isolation of the fault location. It is possible to continue working. Even if the operator's expertise on the target device is insufficient, the operator can provide expertise and give detailed instructions at any time to compensate for the operator's lack of knowledge and work without changing the operator. Can be carried out.

  Even when the work environment is irregular, the operator can grasp the environment through the worker's view image, and the normal work procedure can be changed to a procedure according to the situation of the work environment.

  In addition, the application form of this invention is not restricted to the form shown above. For example, the present invention can be applied to a form for in-house work as shown below.

  In most cases, the communication line terminator is installed at the customer's office rather than at the telephone company office. When a failure occurs in the communication line delivered to this customer, the maintenance company worker will rush to the customer office to perform replacement maintenance work (home work) of the terminal equipment. It is a huge number.

  As described in the above description of the effect, if the present invention is applied, it is possible to compensate for the lack of expertise of the worker, so that the customer who is the delivery destination of the apparatus can work by himself instead of the maintenance company staff.

  Specifically, when a failure occurs in the house, there is usually a request for dispatch from the monitoring department to the maintenance company, and the operator assigns and arranges the delivery of spare parts, but when applying the present invention, It is only necessary to arrange for delivery of the apparatus and spare parts according to the present invention. The received customer wears a head-mounted display device, etc., and receives the operator's instruction to replace the terminal device. Thereafter, the work is completed if the failed member and the head mounted display device are returned.

  In the above application mode, it is possible to expect the effects of shortening the failure recovery time and reducing the worker resources by reducing the time required for the worker to rush. This reduction effect is significant for the maintenance company because the worker's resources are always secured in a constant amount so that they can always be rushed.

  Further, in the present embodiment, a case has been described in which an operator projects an image with an instruction on a semi-transmissive display device of a one-eye goggle-type head mounted display device while securing his / her field of view. However, the application form of the present invention is not limited to one using a one-eye goggles type head-mounted display device. For example, a binocular goggles type head provided with a translucent display device or a binocular goggles type head provided with a translucent display device by bringing an image with instructions displayed on the transflective display device closer to a real-time image in time. It can be replaced with a mount display device, and an operator can work by visually recognizing only an image instead of his own field of view.

  In that case, it is also possible to display a 3D image by binocular parallax on goggles by installing a camera at each eye position and acquiring an image for each eye. For example, a plurality of Web cameras are mounted on a head-mounted display device, and the operator information processing device generates a 3D image based on the field-of-view images of the workers photographed by the plurality of Web cameras, and transmits them to the head-mounted display device. To display. In that case, as a method of adding an instruction to the 3D image, a stereoscopic image of the hand may be used instead of the pointer. In addition, a display device having a touch panel function is provided as an input interface of an information processing device for an operator when the pointer image or a stereoscopic image of a hand is superimposed on an operator's view image. It may be used. Further, an interface for moving the stereoscopic image of the hand by moving the glove with a motion sensor by the operator may be used.

  Furthermore, the present invention provides not only work for the communication device, but also drawing assistance, ceramic art, medical surgery, etc. while providing some technical knowledge to the actual worker, while providing knowledge support based on instructions from an expert from a remote location It can also be applied to work that can be improved. Further, the present invention is applicable to route guidance and guidance from a remote place for complex routes such as finding a machine room and a work rack in a telephone company office.

  Next, the minimum configuration of the work support system according to the present invention will be described. FIG. 5 is a block diagram illustrating a minimum configuration example of the work support system. As shown in FIG. 5, the work support system includes, as the minimum components, a head mounted display device 1 that can display predetermined information, and imaging that can capture the direction of the line of sight of an operator wearing the head mounted display device 1. Means 2 and an information processing device 3 are provided. The head mounted display device 1 includes a control unit 4. Further, the information processing apparatus 3 includes an instruction image generation unit 5.

  In the work support system having the minimum configuration shown in FIG. 5, the instruction image generating means 5 superimposes a predetermined image on the photographed image in the visual line direction of the worker photographed by the photographing means 2 in accordance with the operation of the operator who gives an instruction to the worker. The instruction image is generated. Then, when the instruction image generated by the instruction image generating unit 5 is displayed on the head mounted display device 1, the control unit 4 performs control so that the instruction image overlaps the worker's field of view.

  Therefore, according to the work support system having the minimum configuration, it is possible to more surely confirm a visual instruction given from a remote place without removing the line of sight from the work target.

  In this embodiment, the characteristic configuration of the work support system as shown in the following (1) to (5) is shown.

  (1) The work support system is equipped with a head mounted display device (for example, the head mounted display device 100) capable of displaying predetermined information (for example, realized by the transflective display device 120) and the head mounted display device. An image processing unit (for example, realized by the Web camera 110) capable of capturing the line-of-sight direction of the worker and an information processing apparatus (for example, realized by the operator information processing apparatus 300), In accordance with an operator's operation for giving an instruction to the worker (for example, an instruction operation 20 by the operator), a predetermined image (for example, the worker's visual field image 10) taken by the photographing means in the sight line direction (for example, the worker's visual field image 10). An instruction image (for example, an operator instruction image 12) is superimposed on the instruction pointer image 11). The head-mounted display device displays the instruction image generated by the instruction image generating means when the instruction image is generated by the operator. It includes control means (for example, realized by the control means 130) that controls to overlap with the field of view (for example, the worker's field of view 30).

  (2) In the work support system, when the control unit displays the instruction image generated by the instruction image generation unit on the display unit (for example, the transflective display device 120) provided in the head mounted display device, You may be comprised so that it may control so that the position of a display part may be changed according to a focal distance.

  (3) In the work support system, the control unit may be configured to control to change the enlargement ratio of the instruction image when displaying the instruction image generated by the instruction image generation unit.

  (4) The work support system includes a plurality of photographing units, and the information processing apparatus generates a stereoscopic image based on the photographed images in the gaze direction of the worker photographed by the plurality of photographing units, and the head mounted display device The generated stereoscopic image may be displayed.

  (5) In the work support system, the instruction image generation unit is configured to generate an instruction image by superimposing a predetermined stereoscopic image on the generated stereoscopic image (for example, realized using a glove with a motion sensor). It may be.

  INDUSTRIAL APPLICABILITY The present invention can be applied to a use for supporting work based on an instruction from an operator at a remote place, or work whose work environment or work target changes at any time.

DESCRIPTION OF SYMBOLS 1 Head mounted display apparatus 2 Imaging | photography means 3 Information processing apparatus 4 Control means 5 Instruction image generation means 100 Head mounted display apparatus 110 Web camera 120 Transflective display apparatus 130 Control means 200 Wearable terminal 300 Information processing apparatus for operators 310 Display apparatus 320 Real time Image editing tools

Claims (8)

A head-mounted display device capable of displaying predetermined information;
Imaging means capable of imaging the line-of-sight direction of an operator wearing the head-mounted display device;
An information processing device,
The information processing apparatus includes:
In accordance with an operation of an operator that gives an instruction to the worker, an instruction image generating unit that generates a command image by superimposing a predetermined image on a photographed image of the worker's line of sight photographed by the photographing unit,
The head mounted display device is:
A work support system comprising: control means for controlling the instruction image so as to overlap the field of view of the worker when the instruction image generated by the instruction image generation means is displayed. The control means controls to change the position of the display unit in accordance with the focal length of the operator when the instruction image generated by the instruction image generation unit is displayed on the display unit provided in the head mounted display device. The work support system according to claim 1. The work support system according to claim 1, wherein the control unit performs control so as to change an enlargement ratio of the instruction image when the instruction image generated by the instruction image generation unit is displayed. A plurality of photographing means,
The information processing apparatus generates a three-dimensional image based on a photographed image in the line of sight of an operator photographed by each of the plurality of photographing means,
The work support system according to any one of claims 1 to 3, wherein the head mounted display device displays a stereoscopic image generated by the information processing device. The work support system according to claim 4, wherein the instruction image generation unit generates an instruction image by superimposing a predetermined stereoscopic image on the generated stereoscopic image. Control means for controlling the instruction image so that it overlaps the field of view of the operator when displaying an instruction image in which a predetermined image is superimposed on a photographed image obtained by photographing the line-of-sight direction of the worker wearing the head-mounted display device. A head mounted display device comprising the head mounted display device. In accordance with an operator's operation to give an instruction to the worker wearing the head-mounted display device, a predetermined image is superimposed on a photographed image of the worker's line of sight photographed by the photographing means, and an instruction image is generated.
When displaying the generated instruction image on the head-mounted display device, control is performed so that the instruction image overlaps the field of view of the worker. On the computer,
An instruction image generation process for generating an instruction image by superimposing a predetermined image on a photographed image of the worker's line of sight photographed by the photographing means according to an operation of an operator who gives an instruction to the worker wearing the head mounted display device;
A work support program for executing a control process for controlling the instruction image so as to overlap the field of view of the worker when the generated instruction image is displayed on the head mounted display device.

Images