JP2008123257A - Remote operation support system and display control method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a remote operation support system and a display control method for displaying a reference video of a size proper for an operation without imposing any labor on an operator or an instructor. <P>SOLUTION: This remote operation support system is provided with a headmount type video display device (HMD) equipped with a display unit for displaying a video and a server device for providing a reference video showing an operation object to the HMD, and configured to enable an instructor to give an operation instruction to an operator wearing the HMD by the server device. The HMD is provided with: a distance detection part for detecting the distance of an operation object; and a display control part for adjusting the display size of a reference video to be displayed at the display unit. The scale ratio information of the reference video with respect to the actual size of the operation object is attached to the reference video, and the display control part adjusts the display size of the reference video to be displayed at the display unit based on the distance detected by the distance detection part and the scale ratio information attached to the reference video provided from the server device. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a remote work support system and a display control method, and more particularly to a remote work support system and a display control method provided with a head-mounted video display device.

  Conventionally, an image (hereinafter also referred to as an image) that is detachably attached to the observer's head or face and obtained from an image display element such as a small CRT or a liquid crystal display element is displayed on the observer's eyeball by an eyepiece optical system. A head-mounted image display device, that is, an HMD (Head Mount Display) is known in which a virtual image can be observed as if the image is enlarged and projected in the air.

  The HMD is used as a display device for viewing content videos such as DVDs and videos, and for remote operation of industrial equipment or medical equipment, and has a wide variety of uses.

  For remote operation, an operator wears an HMD equipped with an electronic camera, and an instructor observes an image of a work object captured by the electronic camera on a monitor such as a host computer provided at a remote location. Various remote work support systems have been proposed in which appropriate information is provided to workers by voice or video and work instructions are given (see, for example, Patent Document 1).

  In such a remote work support system, the worker compares the video of the work object captured by the electronic camera displayed on the video display unit of the HMD with the reference video representing the work object transmitted from the host computer. However, when the work is performed, if the display size of the work object in the video captured by the electronic camera and the reference video transmitted from the host computer are different, it is not easy to compare the two and the workability is reduced. There was a fear.

Therefore, a method in which the operator adjusts the display size of the reference image by using the operation unit of the HMD so that the display size of the work object by the reference image is close to the display size of the work object by the electronic camera, Conventionally, a method of remotely adjusting the display size of the reference video displayed on the video display unit of the worker's HMD while observing the video of the work target captured by the camera on the monitor has been performed.
JP 2002-132487 A

  However, any of the above-described conventional methods requires complicated adjustment, increases the burden on the operator and the instructor, and is difficult to use.

  The present invention has been made in view of the above problems, and provides a remote work support system and a display control method capable of displaying a reference video of a size suitable for work without imposing a burden on the worker or the instructor. The purpose is to provide.

  The above object is achieved by the invention described in any one of 1 to 6 below.

1. A head-mounted video display device having a display unit for displaying video;
A server device that provides a reference video representing a work object to the head-mounted video display device,
A remote work support system in which an operator gives a work instruction by the server device to a worker wearing the head-mounted video display device,
The head-mounted video display device includes a distance detection unit that detects a distance from the head-mounted video display device to the work object;
A display control unit for adjusting a display size of the reference video to be displayed on the display unit,
The reference video is attached with scale ratio information of the reference video with respect to the actual size of the work object,
The display control unit displays the reference video to be displayed on the display unit based on the distance detected by the distance detection unit and the scale ratio information attached to the reference video provided from the server device. A remote operation support system characterized by adjusting the size.

2. The head-mounted image display device includes an electronic camera for photographing a work object,
The display control unit displays the reference video to be displayed on the display unit based on the distance detected by the distance detection unit and the scale ratio information attached to the reference video provided from the server device. 2. The remote work support system according to 1 above, wherein the size is adjusted to match a display size of an image captured by the electronic camera and displayed on the display unit.

3. The electronic camera includes a zoom lens,
The display control unit controls the display unit based on the zoom magnification of the zoom lens, the distance detected by the distance detection unit, and the scale ratio information attached to the reference image provided from the server device. 3. The remote work support system according to claim 2, wherein a display size of the reference video to be displayed is adjusted to match a display size of a video shot by the electronic camera and displayed on the display unit.

4). The display unit is capable of see-through the outside world by an operator wearing the head-mounted video display device,
The display control unit displays the reference video to be displayed on the display unit based on the distance detected by the distance detection unit and the scale ratio information attached to the reference video provided from the server device. 2. The remote work support system according to 1 above, wherein the size is adjusted to match the size of the optical image of the work object that can be observed through the see-through.

5. The distance detection unit detects a change rate of a distance from the head-mounted image display device to the work object,
The display control unit compares a change rate detected by the distance detection unit with a preset threshold value, and adjusts a display size of the reference video when the change rate exceeds the threshold value. The remote work support system according to any one of 1 to 4 above.

6). A display video display control method representing a work object provided from a server device to be displayed on a display unit provided in a head-mounted video display device worn by an operator,
The reference video is attached with scale ratio information of the reference video with respect to the actual size of the work object,
A distance detection step of detecting a distance from the head-mounted image display device to the work object;
A display size for adjusting the display size of the reference video to be displayed on the display unit based on the distance detected in the distance detection step and the scale ratio information attached to the reference video provided from the server device And a reference video display control method.

  According to the present invention, the display control unit displays the display size of the reference image displayed on the display unit based on the distance detected by the distance detection unit and the scale ratio information attached to the reference image provided from the server device. Was adjusted. Therefore, an operator wearing the head-mounted image display device can always observe a reference image having a display size appropriate for the work regardless of the distance from the work object. This makes it possible to obtain a reference video having a size suitable for the work without performing the complicated adjustment work as described above. As a result, the burden on the worker and the instructor can be reduced, and work efficiency can be improved.

  Embodiments of a remote work support system according to the present invention will be described below with reference to the drawings. In addition, although this invention is demonstrated based on embodiment of illustration, this invention is not limited to this embodiment.

  First, the configuration of the remote work support system 1 will be described with reference to FIG. FIG. 1 is a schematic diagram showing an outline of the overall configuration of a remote operation support system 1 according to the present invention.

  As shown in FIG. 1, the remote work support system 1 includes an HMD 2, a server device 4, and the like. The server device 4 includes a host computer 5, a video / audio recording server 6, a content server 7, and the like.

  The host computer 5 is connected to the video / audio recording server 6 and the content server 7 via the Ethernet EN, and the host computer 5 and the HMD 2 are connected to the Internet IN, mobile phone, PHS, a public network PN such as a wireless LAN, etc. Are tied together.

  In the remote work support system 1 having such a configuration, the operator B wears the HMD 2 equipped with the camera unit 28 described later, and the instructor A provides an image of the work object captured by the camera unit 28 at a remote place. While observing on the monitor 53 described later of the server device 4, the server device 4 provides the worker B with appropriate information by video and voice and gives a work instruction.

  Next, the configuration of the HMD 2 corresponding to the head-mounted image display device according to the present invention will be described with reference to FIG. FIG. 2 is an overall configuration diagram of the HMD 2 according to the present invention.

  As shown in FIG. 2, the HMD 2 includes temples 21R and 21L, a bridge 22, nose pads 23R and 23L, transparent substrates 24R and 24L, a display unit 25 (LCD display unit 26, an eyepiece optical system 27), a camera unit 28, and an earphone. 29R, 29L, a microphone 30, a control unit 31, and the like.

  The HMD 2 displays an image captured by the camera unit 28 or an image transmitted from the server device 4 on the LCD display unit 26 provided in the display unit 25, and the image obtained from the LCD display unit 26 is displayed. By directly projecting onto the eyeball of the wearer (hereinafter also referred to as worker B) by the eyepiece optical system 27, it is possible to observe a virtual image as if the image is enlarged and projected in the air.

  The temples 21R and 21L are long members made of a flexible elastic material or the like. The temples 21R and 21L are hooked on the wearer's ears or the temporal region and are held on the head of the wearer by the wearer. This is for adjusting the mounting position. The temples 21R and 21L are configured to be rotatable in the directions of arrows P and Q in the rotating portions 21Ra and 21La. When the HMD 2 is not used, the temples 21R and 21L are rotated in the directions of the arrows P and Q. It can be made compact by moving it along the transparent substrates 24R and 24L.

  The bridge 22 includes nose pads 23R and 23L that hold the HMD 2 on the face of the wearer, and is a short rod-like member that is stretched over a predetermined position on the transparent substrates 24R and 24L facing each other. The transparent substrate 24L is held in a relative positional relationship with a fixed gap.

  The transparent substrates 24R and 24L are substantially flat transparent bodies that form a U-shaped space 24Rs at a position corresponding to one eyeball. An eyepiece optical system 27 is fitted in a U-shaped space 24Rs formed by being surrounded by the transparent substrate 24R.

  The display unit 25 includes an LCD display unit 26, an eyepiece optical system 27, and the like. From the server device 4 via an image captured by the camera unit 28 or a network I / F 36 described later provided in the control unit 31. Display the transmitted video.

  The camera unit 28 corresponds to an electronic camera according to the present invention, and includes a zoom lens 281 (not shown), a CCD (Charge Coupled Device) 282, an image processing unit 284, and the like, and captures an external scene around the wearer. The subject optical image formed by the zoom lens 281 is photoelectrically converted by the CCD 282 to generate an image signal (video signal), and the image signal is subjected to predetermined image processing by the image processing unit 284 or the like. Video).

  Earphones 29R and 29L are inserted into the ears of the wearer and provide sound to the wearer.

  The microphone 30 converts the voice of the wearer into an audio signal.

  The control unit 31 includes a microcomputer and includes a power switch 351, an operation switch 352, and the like. The control unit 31 receives a signal from these various operation switches, a control signal from the server device 4, and the like. The image signal processing operation is comprehensively controlled.

  Here, the configuration of the display unit 25 will be described with reference to FIG. FIG. 3 is a side sectional view from the left side surface of the display unit 25 in the HMD 2 according to the present invention, and mainly shows the internal configuration of the display unit 25.

  As shown in FIG. 3, the display unit 25 includes a housing 261, an LED (Light Emitting Diode) 262, a collimator lens 263, an LCD (Liquid Crystal Display) 264 LCD display unit 26, a prism 271, and HOE (Holographic Optical). Element) 272 and the eyepiece optical system 27.

  In the state where the LED 262, the collimator lens 263, and the LCD 264 are built in the housing 261 of the LCD display unit 26, the housing 261 is diagonally upward and forward at the upper end portion of the prism 271 of the eyepiece optical system 27 (FIG. 3). Then, it is attached in such a manner as to protrude obliquely upward to the right.

  The LED 262 is a point light source composed of a white light emitting diode (LED) including a predetermined wavelength color.

  The collimator lens 263 converts the light from the LED 262 into substantially parallel light and projects it onto the LCD 264.

  The LCD 264 generates a video (image) based on a video signal photographed and generated by the camera unit 28 or a video signal transmitted from the server device 4 via a network I / F 36 described later provided in the control unit 31. For example, a transmissive liquid crystal display panel.

  The prism 271 is a substantially plate-shaped transparent member made of glass, transparent resin, or the like, and causes light from the LCD 264 to be reflected a plurality of times inside. The upper end portion of the prism 271 is formed in a wedge shape so that the front side (opposite side of the eyepiece surface) protrudes to be thicker upward so that most of the light from the LCD 264 can be collected inside. The thick part 271b thus formed is formed.

  An inclined surface 271a is formed at the lower end of the prism 271. The prism 271 is bonded (for example, bonded) to the inclined surface 24Ra formed on the transparent substrate 24R via the HOE 272. The front and back surfaces of the prism 271 are flush with the front and back surfaces of the transparent substrate 24R. Thereby, the prism 271 is integrated with the transparent substrate 24R in a single plate shape.

  The HOE 272 is a volume phase type holographic optical element having a positive power, which is constituted by a so-called free-form surface that is optically asymmetric with respect to the axis, and is supported at a lower end portion of the prism 271 with a predetermined inclination angle. The HOE 272 provides a hologram image to the eyeball E using the light interference phenomenon when irradiated with the light guided by the prism 271.

  In the display unit 25 having the above-described configuration, the light emitted from the LED 262 illuminates the LCD 264 through the collimator lens 263, and the image light generated by the LCD 264 by this illumination is a plurality of times in the prism 271. After reflection, the light is diffracted by the HOE 272 and guided to the wearer's eyeball E as a virtual image.

  Further, the prism 271 guides light incident from the front to the eyeball E of the wearer. As a result, the wearer can see through the outside world (front subject), and is transmitted from the server apparatus 4 via the video image captured and generated by the camera unit 28 or the network I / F 36 described later provided in the control unit 31. The recorded video is viewed with being superimposed on the outside world (front subject).

  Next, the electric circuit configuration of the HMD 2 will be described with reference to FIG. FIG. 4 is a block diagram of the electric circuit of the HMD 2 according to the present invention. In FIG. 4, the same members as those shown in FIGS. 1 to 3 are given the same numbers.

  The main circuit block of the HMD 2 includes a display unit 25, a camera unit 28, a control unit 31, and the like.

  The display unit 25 includes an LCD display unit 26 and an eyepiece optical system 27. Since the operations performed in each part have been described above, the description thereof will be omitted.

  The camera unit 28 includes a zoom lens 281, a CCD (Charge Coupled Device) 282, an AFE (Analog Front End) 283, an image processing unit 284, an AF motor 287, a zoom motor 288, and the like.

  The CCD 282 is a color area imaging sensor in which R (red) light, G (green) light, and B (blue) light transmission filters are arranged in a checkered pattern in pixel units (pixel units), and is connected by a zoom lens 281. The imaged subject light image is photoelectrically converted into image signals (signals consisting of a signal sequence of pixel signals received in units of pixels) of each color component of R (red) light, G (green) light, and B (blue) light. To convert.

  The AFE 283 controls the drive of the CCD 282 based on the reference clock transmitted from the control unit 31, performs a known analog signal processing on the video signal (image signal) read from the CCD 282, and converts it into a digital video signal To do.

  In this manner, the video signal read by the CCD 282 is subjected to predetermined processing by the AFE 283 and converted into a digital video signal. The digitized video signal is captured by the image processing unit 284 and subjected to predetermined processing. Hereinafter, the process for the digital video signal performed by the image processing unit 284 will be described.

  First, the digital video signal captured by the image processing unit 284 is written into an image memory 33 in the control unit 31 described later in synchronization with the readout of the video signal output from the CCD 282. That is, a digital video signal used for processing performed by the image processing unit 284 is once recorded in the image memory 33 and taken out from the image memory 33 and used for processing in each part in the image processing unit 284.

  The image processing unit 284 includes, for example, a black level correction unit, a pixel interpolation unit, a white balance control unit, a gamma correction unit, a matrix calculation unit, a shading correction unit, an image compression unit, and the like (not shown). The digital video signal is subjected to known image signal processing. Then, the digital video signal that has undergone predetermined processing at these parts is stored in the image memory 33 again.

  The control unit 31 includes a control unit 32, an image memory 33, a VRAM (Video Random Access Memory) 34, an operation unit 35, a network I / F 36, an AF / zoom motor drive circuit 371, an audio output circuit 381, an audio input circuit 382, and the like. Consists of

  The control unit 32 reads a ROM (Read Only Memory) that stores each control program (not shown), a RAM (Random Access Memory) that temporarily stores data such as arithmetic processing and control processing, and a control program from the ROM. CPU (central processing unit), etc. that execute the above, and in response to the signals from the aforementioned operation switches and the control signals from the server device 4, the display operation and image signal processing operation performed by the HMD 2 are integrated. To control.

  The AF control unit 321 performs AF (Auto Focus) control of the camera unit 28. Specifically, the AF control unit 321 reads video data related to a distance measurement area on the imaging surface set in advance from the video data (digital video signal) written in the image memory 33, and the read video data Ranging calculation for obtaining the in-focus position is performed by contrast detection, and AF control is performed by driving the AF motor 287 via the AF / zoom motor driving circuit 371 based on the result.

  The distance detection unit 322 detects the subject distance from stop position information of each lens group constituting the zoom lens lens 281 adjusted by the AF operation by the AF control unit 321. The AF operation by the AF control unit 321 is performed at a predetermined cycle (for example, a cycle of 5 seconds), and the distance detection unit 321 detects the subject distance every time the AF operation is performed, and detects this time for the previously detected distance. The rate of change of the distance is calculated.

  The display control unit 323 is attached to the zoom magnification of the zoom lens 281, the subject distance (the distance from the HMD 2 to the work target) detected by the distance detection unit 322, and a reference video described later transmitted from the server device 4. The display size of the reference video is adjusted based on the scale ratio information of the reference video with respect to the actual size of the work target. In addition, the display control unit 323 sets a threshold value (for example, 30%) in advance for the change rate of the subject distance, compares the change rate detected by the distance detection unit 322 with a preset threshold value, and changes the change rate. When the value exceeds the threshold, the display size of the reference video is adjusted.

  The image memory 33 is a temporary memory used as a work area for performing various processing on the digital video signal by the control unit 32 in the control unit 31.

  The VRAM 34 has a video signal recording capacity corresponding to the number of pixels of the LCD 264 in the LCD display unit 26, and is a video signal buffer memory that constitutes an image reproduced and displayed on the LCD 264.

  The network I / F 36 connects the HMD 2 to the public line network PN, communicates with the server device 4, and inputs and outputs video, audio, and various control signals.

  The AF / zoom motor drive circuit 371 generates drive signals for driving the AF motor 287 and the zoom motor 288 based on the control of the control unit 32.

  Next, returning to FIG. 1, the configuration of the server device 4 will be described. The server device 4 includes a host computer 5 (hereinafter referred to as a host PC 5), an audio / video recording server 6, a content server 7, and the like.

  As shown in FIG. 1, the host PC 5 is, for example, a personal computer including a computer main body 51, a monitor 53, a mouse 55, a keyboard 57, and the like.

  The host PC 5 displays on the monitor 53 an image of the work object taken by the camera unit 28 of the HMD 2 attached to the worker B. The instructor A operates the host PC 5 with the mouse 55, the keyboard 57, and the like while observing the image of the work object displayed on the monitor 53, and the later-described reference image recorded on the content server 7 by the operator B. The information necessary for such work is provided and work instructions are given.

  The audio / video recording server 6 stores work records such as video captured by the camera unit 28 of the HMD 2 and audio exchanged between the worker B and the instructor A.

  The content server 7 stores work support information such as video and audio necessary for the worker B to perform work. For example, the content server 7 records a reference video representing a work object. The reference video is attached with scale ratio information of the reference video with respect to the actual size of the work object. Here, the scale ratio information indicates the ratio of the display size of the reference image to the actual size of the work object. For example, the actual size of the work object is Xm, and the number of pixels of the reference image corresponding to the actual size Xm is Y pixels. Then, the scale ratio is represented by X / Y.

  In the work support system 1 having such a configuration, the present invention transmits the image of the work object captured by the camera unit 28 displayed on the display unit 25 of the HMD 2 by the worker B and the server device 4. The image of the work object captured by the camera unit 28 and the server device when the distance between the worker B and the work object changes when the work is performed while comparing the reference image representing the work object. 4, even when the display size of the reference video representing the work object transmitted from 4 becomes different, the display size of the reference video is adjusted so as to be close to the video display size by the camera unit 28. .

  Here, the flow of the display control operation performed in the work support system 1 will be described with reference to FIG. FIG. 5 is a flowchart showing the flow of the display control operation performed in the remote operation support system 1 according to the present invention.

  First, the distance detection unit 322 detects the subject distance (the distance from the HMD 2 to the work target) from the stop position information of each lens group constituting the zoom lens lens 281 adjusted by the AF operation by the AF control unit 321. (Step S1). Then, the distance detection unit 322 calculates the change rate of the currently detected subject distance with respect to the previously detected subject distance (step S2).

  The display control unit 323 compares the change rate of the subject distance detected by the distance detection unit 322 with a preset threshold value (step S3), and as a result of the comparison, the change rate of the subject distance exceeds the threshold value. In the case (step S4; Yes), the zoom magnification (zoom position) of the zoom lens 281 is acquired (step S5). Based on the acquired zoom magnification and the subject distance detected by the distance detection unit 322, the display control unit 323 sets the display size of the work object image captured by the camera unit 28 and displayed on the display unit 25. Calculate (step S6).

  Next, the display control unit 323 acquires the reference video scale ratio information with respect to the actual size of the work object attached to the reference video transmitted from the server device 4 (step S7). Then, the display control unit 323 determines the reference video based on the obtained scale ratio information of the reference video and the display size of the video of the work object that is captured by the camera unit 28 and displayed on the display unit 25 calculated in step S6. The display magnification is determined (step S8), and the reference video is enlarged or reduced at the determined display magnification and displayed on the display unit 25 (step S9). Step S1 corresponds to the distance detection step in the present invention, and steps S8 and S9 correspond to the display size adjustment step in the present invention.

  Here, an example of an image displayed on the display unit 25 of the HMD 2 in this way will be described with reference to FIG. FIG. 6A is a schematic diagram showing a state in which the display size of the video K1 taken by the camera unit 28 and the reference video S1 transmitted from the server device 4 substantially match, and FIG. FIG. 6C is a schematic diagram showing a state in which the display control operation is not performed when the worker B approaches the work target. FIG. 6C shows the display control when the worker B approaches the work target. It is a schematic diagram which shows a mode when operation | movement is performed.

  As shown in FIG. 6B, when the display control operation is not performed when the worker B approaches the work target, the display size of the video K2 captured by the camera unit 28 is the reference video S1. It can be confirmed that it is not easy to compare the two. On the other hand, as shown in FIG. 6C, when the display control operation is performed when the worker B approaches the work target, the reference video is displayed in the display size of the video K2 taken by the camera unit 28. By following the display size of S2, the two can be easily compared.

  Note that the video and the reference video captured by the camera unit 28 may be alternately switched and displayed at a predetermined cycle (for example, a 10-second cycle) as shown in FIG.

  Thus, in the remote operation support system 1 according to the embodiment of the present invention, the zoom magnification of the zoom lens 281 and the distance from the HMD 2 detected by the distance detection unit 232 to the work object and the server device 4 are provided. Based on the scale ratio information of the reference video, the display size of the reference video displayed on the display unit 25 is adjusted to match the display size of the video captured by the electronic camera 28 and displayed on the display unit 25. Therefore, for example, the worker B compares the video of the work target captured by the camera unit 28 displayed on the display unit 25 of the HMD 2 with the reference video representing the work target provided from the server device 4. When the worker B is working, the distance between the worker B and the work object changes as the worker B approaches the work object, and the image of the work object captured by the camera unit 28 and the server device 4. Even when the display size of the reference video representing the work object provided from the above is changed, the display size of the reference video can be adjusted to be close to the video display size by the camera unit 28. Further, the display size of the reference video can be made to follow the change in the video display size by the camera unit 28. This makes it possible to always obtain a reference video having a size suitable for the work without performing the complicated adjustment work as described above. As a result, the burden on the worker and the instructor can be reduced, and work efficiency can be improved.

  In addition, the display size of the reference video is adjusted only when the rate of change in the distance to the work object exceeds a predetermined threshold. Accordingly, it is possible to suppress a decrease in visibility due to a change in the display size of the reference image with respect to a slight change in the distance.

  The present invention has been described above with reference to the embodiments. However, the present invention should not be construed as being limited to the above-described embodiments, and can be changed or improved as appropriate.

  For example, in the remote operation support system 1 according to the above-described embodiment, the display size of the reference image is controlled to be close to the display size of the image by the camera unit 28. However, the worker B displays the display size of the reference image. You may control so that it may approximate to the size of the optical image of the work target which can be observed through the unit 25 by see-through.

  Specifically, a reference image is displayed on the display unit 25 at a reference distance (for example, 1 m), and the operator B observes the display size of the reference image displayed on the display unit 25 through the display unit 25 in a see-through manner. The display magnification of the reference image for matching the size of the optical image of the work object that can be obtained is obtained in advance. When the distance changes, the display magnification of the reference video is calculated in proportion to the distance, and the reference video is enlarged or reduced at the calculated display magnification to be displayed. As a result, the worker B can work while comparing the clear optical image of the actual work object that can be observed through the display unit 25 with the reference image, and the work efficiency can be further improved.

It is a schematic diagram which shows the whole structure of the remote work assistance system which concerns on this invention. 1 is an overall configuration diagram of an HMD according to the present invention. It is a sectional side view of the display unit in HMD concerning the present invention. It is an electric circuit block block diagram of HMD which concerns on this invention. It is a flowchart which shows the flow of the display control operation | movement of the remote operation assistance system which concerns on this invention. It is a schematic diagram which shows an example of the image | video displayed on the display unit in HMD which concerns on this invention. It is a schematic diagram which shows another example of the image | video displayed on the display unit in HMD which concerns on this invention.

Explanation of symbols

1 Remote work support system 2 Head-mounted video display device (HMD)
21R, 21L Temple 22 Bridge 23R, 23L Nose pad 24R, 24L Transparent substrate 25 Display unit 26 LCD display unit 261 Case 262 LED
263 Collimator lens 264 LCD
27 Eyepiece optical system 271 Prism 272 HOE
28 Camera Unit 281 Zoom Lens 282 CCD
283 AFE
284 Image processing unit 287 AF motor 288 Zoom motor 29R, 29L Earphone 30 Microphone 31 Control unit 32 Control unit 321 AF control unit 322 Distance detection unit 323 Display control unit 33 Image memory 34 VRAM
35 Operation Unit 351 Power Switch 352 Operation Switch 36 Network I / F
371 AF / zoom motor drive circuit 381 Audio output circuit 382 Audio input circuit 4 Server device 5 Host computer (host PC)
51 Computer Main Body 53 Monitor 55 Mouse 57 Keyboard 6 Video / Audio Recording Server 7 Content Server A Instructor B Worker EN Ethernet E Eye IN Internet PN Public Line Network

Claims (6)

A head-mounted video display device having a display unit for displaying video;
A server device that provides a reference video representing a work object to the head-mounted video display device,
A remote work support system in which an operator gives a work instruction by the server device to a worker wearing the head-mounted video display device,
The head-mounted video display device includes a distance detection unit that detects a distance from the head-mounted video display device to the work object;
A display control unit for adjusting a display size of the reference video to be displayed on the display unit,
The reference video is attached with scale ratio information of the reference video with respect to the actual size of the work object,
The display control unit displays the reference video to be displayed on the display unit based on the distance detected by the distance detection unit and the scale ratio information attached to the reference video provided from the server device. A remote operation support system characterized by adjusting the size. The head-mounted image display device includes an electronic camera for photographing a work object,
The display control unit displays the reference video to be displayed on the display unit based on the distance detected by the distance detection unit and the scale ratio information attached to the reference video provided from the server device. The remote work support system according to claim 1, wherein the size is adjusted to match a display size of an image captured by the electronic camera and displayed on the display unit. The electronic camera includes a zoom lens,
The display control unit controls the display unit based on the zoom magnification of the zoom lens, the distance detected by the distance detection unit, and the scale ratio information attached to the reference image provided from the server device. The remote work support system according to claim 2, wherein a display size of the reference video to be displayed is adjusted to match a display size of a video shot by the electronic camera and displayed on the display unit. The display unit is capable of see-through the outside world by an operator wearing the head-mounted video display device,
The display control unit displays the reference video to be displayed on the display unit based on the distance detected by the distance detection unit and the scale ratio information attached to the reference video provided from the server device. The remote work support system according to claim 1, wherein the size is adjusted to match the size of the optical image of the work object that can be observed by a worker through the see-through. The distance detection unit detects a change rate of a distance from the head-mounted image display device to the work object,
The display control unit compares a change rate detected by the distance detection unit with a preset threshold value, and adjusts a display size of the reference video when the change rate exceeds the threshold value. The remote work support system according to any one of claims 1 to 4. A display video display control method representing a work object provided from a server device to be displayed on a display unit provided in a head-mounted video display device worn by an operator,
The reference video is attached with scale ratio information of the reference video with respect to the actual size of the work object,
A distance detection step of detecting a distance from the head-mounted image display device to the work object;
A display size for adjusting the display size of the reference video to be displayed on the display unit based on the distance detected in the distance detection step and the scale ratio information attached to the reference video provided from the server device And a reference video display control method.

Images