JP2008070572A - Head mounted display - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a head mounted display capable of exactly informing a user of a state of an external apparatus without disturbing viewing of contents. <P>SOLUTION: The head mounted display includes a head mounted part mounted on the head of the user, an image display part which optically guides a display image to the eyes of the user and lets the user visually recognize the image, and a controller part which controls operation of an image display part, wherein an interface part to which a signal is input from the eternal apparatus is provided, and the controller part includes a predetermined signal detecting means which detects that a predetermined signal is input from the external apparatus through the interface part, and when the predetermined signal detecting means detects that the predetermined signal is input, the controller part performs control so that the user visually recognize the display image by causing the image display part to periodically change and display at least a part of the display image. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a head-mounted display, and in particular, a head-mounted unit that is mounted on a user's head, an image display unit that optically guides a display image to the user's eyes, and an image display The present invention relates to a head-mounted display having a control unit that controls the operation of the unit and an interface unit that receives a signal from an external device.

  2. Description of the Related Art Conventionally, a display main body having an image display unit that optically guides a display image to a user's eye for visual recognition, a control unit that controls the operation of the image display unit, and the display main body as a user's head A head mounted display (hereinafter referred to as “HMD”), which is equipped with a head mounting portion for mounting on the head, and allows the user to view the video content and the like by mounting on the head.

  While this HMD is small in size, it has an advantage that a video can be displayed on a large screen in the entire field of view of the user. On the other hand, while the user is viewing the video with the HMD, most of the user's field of view is displayed. In this case, a display image optically guided by the image display unit is displayed, which leaves a problem that it is difficult for the user to notice the situation occurring around the user.

  Specifically, when the user is viewing video content including video and audio such as a movie using the HMD, even if the mobile phone receives an incoming call or email, There are problems such as that the incoming call lamp of the mobile phone is lit and that it is impossible to notice that a ringtone is being emitted.

As an HMD that can solve such problems, the HMD includes a camera that can shoot the surrounding situation, a sensor that can detect surrounding sounds, and a vibrator that vibrates the main body of the HMD. When it is detected that a ringtone, etc. of the telephone is emitted in the vicinity, the telephone is received by switching the display image to an image captured by the camera or by transmitting vibrations from the vibrator to the user's head. There has been devised an HMD configured to notify a user that it is in a state (see, for example, Patent Document 1).
JP 2003-18498 A

  However, when the conventional HMD detects ambient sounds or the like with a sensor, the display image is switched to the image captured by the camera or the vibration of the vibrator is transmitted to the user's head. Therefore, the state of other electronic devices (hereinafter referred to as “external devices”) such as mobile phones and PDAs (Personal Digital Assistants) is accurately notified to the user. In addition, there is a possibility that the notification to the user may hinder viewing of the video content.

  In other words, in recent years, users of mobile phones and PDAs often set the manner mode so that the ringtone of a telephone call and the reception sound of an e-mail are not emitted in consideration of manners to the surroundings. In the conventional HMD, there is a case where it is not possible to accurately detect incoming calls or e-mails and notify the user.

  In addition, when the user is moving on a car or train, even if the HMD main body is vibrated by a vibrator and notified, the user may not notice the notification.

  Further, when the notification is made by switching the display image to the image captured by the camera, the user cannot view the video content by the HMD while the notification is being performed, and the notification is not made of the video content. There was a risk of obstructing viewing.

  Therefore, in the present invention according to claim 1, the head mounting unit that is mounted on the user's head, the image display unit that optically guides the display image to the user's eyes and visually recognized, and the operation of the image display unit A head-mounted display having a control unit for controlling the control unit, wherein an interface unit for inputting a signal from the external device is provided, and the control unit detects a predetermined signal input from the external device via the interface unit. Control that has a signal detection means, and when a predetermined signal is detected by the predetermined signal detection means, at least a part of the display image is periodically changed and displayed on the image display unit so that the user can visually recognize the display image. It was decided to do.

  According to a second aspect of the present invention, in the head-mounted display according to the first aspect, the image display unit performs the change display by reciprocating at least a part of the display image in a predetermined cycle. And

  According to a third aspect of the present invention, in the head-mounted display according to the first or second aspect, the image display unit includes an optical element that guides the display image to the eyes of the user, and an optical that vibrates the optical element. And an element vibration mechanism, and the change display is performed by operating the optical element vibration mechanism.

  According to a fourth aspect of the present invention, in the head-mounted display according to the first or second aspect, the image display unit includes an optical scanner that allows the user to visually recognize a display image by scanning a light beam, and an optical scanner. And an offset changing unit that changes the offset amount of the scanning mechanism of the scanner, and the change display is performed by periodically changing the offset amount by the offset changing unit.

  According to a fifth aspect of the present invention, in the head mounted display according to the first or second aspect, the image display unit includes a wavefront curvature modulation element that modulates a wavefront curvature of a light beam incident on a user's eye. And the change display is performed by moving the display image in the depth direction or the near side in the user's field of view by operating the wavefront curvature modulation element.

  According to a sixth aspect of the present invention, in the head mounted display according to the first or second aspect, the image display unit includes a vibration mechanism that vibrates the head mounted display, and the change display is performed by the vibration mechanism. This is performed by vibrating the head mounted display.

  Moreover, in this invention which concerns on Claim 7, in the head mounted display of any one of Claims 1-5, the change display image corresponding to the information contained in a predetermined signal is contained in a predetermined signal. A change display image storage unit that stores information in association with the information, and the control unit includes an information determination unit that determines information included in a predetermined signal input via the interface unit; the information determined by the information determination unit Control is performed to change and display the change display image corresponding to the above by the image display unit.

  Moreover, in this invention which concerns on Claim 8, in the head mounted display of any one of Claims 1-7, a predetermined signal is information which shows the telephone call output from the external device which has a telephone function, Alternatively, it includes information indicating reception of an e-mail output from an external device having an e-mail function.

  In the present invention according to claim 9, in the head mounted display according to claim 8, when the control unit determines that the information included in the predetermined signal is information indicating an incoming call by the information determination unit In addition, when the information display unit performs control to change and display the change display image indicating the mobile phone on the image display unit, and the information determination unit determines that the information included in the predetermined signal is information indicating reception of the e-mail, Control is performed to display the change display image indicating an e-mail on the display unit.

  Moreover, in this invention which concerns on Claim 10, in the head mounted display of any one of Claims 1-7, a predetermined signal is the information which shows the telephone call output output from the external device which has a telephone function. Information indicating the caller, and when the information discriminating means determines that the information included in the predetermined signal is information indicating the incoming call and information indicating the caller, the image display unit indicates the caller Control is performed to change and display a change display image showing a face corresponding to the information.

  According to the eleventh aspect of the present invention, in the head mounted display according to any one of the first to tenth aspects, the predetermined signal has a small remaining battery amount output from an external device powered by a battery. When the information determining unit determines that the information included in the predetermined signal is information indicating that the remaining battery level is low, the image display unit In addition, a control for changing and displaying a change display image showing the battery is performed.

  According to a twelfth aspect of the present invention, in the head mounted display according to any one of the first to eleventh aspects, an external device image corresponding to the type of the external device that outputs a predetermined signal is displayed on the external device. An external device image storage means for storing the image in association with the type, and the control unit includes an external device determination means for determining the type of the external device based on a predetermined signal input via the interface unit; Control is performed to change and display an external device image corresponding to the type of the external device determined by the determining means, using the image display unit.

  According to a thirteenth aspect of the present invention, in the head mounted display according to any one of the first to twelfth aspects, the head mounted display scans a light beam in accordance with an image signal in a two-dimensional direction, and performs the scanning. It is a retinal scanning display that guides the emitted light to the eye and forms a display image on the retina.

  According to the present invention, the following effects are produced. That is, according to the first aspect of the present invention, when the control unit detects that the predetermined signal is input from the external device via the interface unit by the predetermined signal detection unit, the control unit displays the display image on the image display unit. Since the control is performed so that the user can visually change at least a part of the display at least partially, even if the user himself / herself is moving, without disturbing the user to view the video content, The state of the external device can be accurately notified.

  According to the second aspect of the present invention, the control unit controls the image display unit to reciprocate at least a part of the display image in the user's field of view with a predetermined period, so that a predetermined signal is input to the head mounted display. Then, the user visually recognizes a display image that is at least partially oscillating in the field of view, so that even when the user himself / herself is moving, a predetermined signal is output from the external device to the head mounted display. You can be sure that you have entered.

  According to the third aspect of the present invention, it is possible to easily allow a user to visually recognize a display image in which at least a part is vibrated by only operating the optical element vibration mechanism without performing complicated image processing. it can.

  According to the fourth aspect of the present invention, a user can easily display a display image that is at least partially oscillating by only periodically changing the offset amount by the offset changing unit without performing complicated image processing. Can be visually recognized.

  According to the fifth aspect of the present invention, the display image is moved in the depth direction or the near side in the user's field of view, so that the user can be sure that a predetermined signal is input from the external device to the head mounted display. Can be notified.

  According to the sixth aspect of the present invention, a predetermined signal is input to the head mounted display by causing the head mounted display itself to vibrate in addition to visually recognizing a display image in which at least a part is vibrating. Can be used more reliably.

  According to the seventh aspect of the present invention, what is related to the predetermined signal input to the head mounted display by allowing the user to visually recognize a change display image corresponding to the information included in the predetermined signal. This can be clearly notified to the user.

  According to the eighth aspect of the present invention, it is possible to reliably notify a user who is viewing an image using a head mounted display of an incoming call or an e-mail.

  According to the present invention of claim 9, the user can easily know that the phone is in an incoming state by visually recognizing the change display image showing the mobile phone, and the change showing the e-mail. By visually recognizing the display image, it can be easily known that the e-mail has been received.

  According to the tenth aspect of the present invention, the user can call the user in addition to the incoming call state by causing the user to visually recognize the change display image indicating the face corresponding to the information indicating the incoming call source. It is also possible to notify even the other party who is calling.

  According to the eleventh aspect of the present invention, the user can easily know that the remaining battery level of the external device is low by visually recognizing the change display image indicating the battery.

  According to the present invention of claim 12, the user can easily determine from which external device a predetermined signal is input to the head mounted display by visually recognizing an external device image corresponding to the type of external device. I can know.

  According to the thirteenth aspect of the present invention, it is possible to provide a retinal scanning display that can accurately notify the user of the state of the external device without disturbing the viewing of the content.

  Hereinafter, an embodiment of the present invention will be specifically described with reference to the drawings. In the present embodiment, as a head-mounted display, a retinal scanning display that scans a light beam according to an image signal in a two-dimensional direction and guides the scanned light to the eye to form a display image on the retina is taken as an example. The present invention is not limited to this, but is provided with other image display devices such as a liquid crystal display and an organic EL (electroluminescence) display, and a user wears it on the head to view the image. It can be applied to a head mounted display.

  FIG. 1 is an external perspective view showing a head mounted display according to the present embodiment, FIG. 2 is a functional block diagram showing a control unit of the head mounted display, and FIG. 3 shows an image display unit of the head mounted display. FIG. 4 is an explanatory diagram showing a display image visually recognized by the user when a predetermined signal is input from the external device, and FIGS. 5 to 8 are control units of the head mounted display. FIG. 9 is an explanatory diagram showing a change display image display unit. FIG. 10 is an explanatory diagram showing a change display image that the user can visually recognize by operating the wavefront curvature modulation element.

(Description of the outline of the head mounted display)
As shown in FIG. 1A, the head mounted display (hereinafter referred to as “HMD1”) according to the present embodiment is an apparatus for viewing an image such as video content while the user A is wearing the head. There is a device that causes the user A to visually recognize the display image by projecting and scanning the light beam modulated with the image signal onto at least one retina of the user A and displaying the image (projection display).

  In particular, the HMD 1 is configured to be connectable to an external device such as a mobile phone 2 or a PDA (Personal Digital Assistants), and when a predetermined signal is input from the external device, at least a part of the display image is periodically generated. It is configured to notify the user that a predetermined signal has been input from the external device while the HMD 1 is mounted on the head by causing the user to visually change the display. In the present embodiment, a mobile phone 2 having a telephone function and an e-mail transmission / reception function will be described as an example of an external device connected to the HMD 1.

  As shown in FIG. 1B, the HMD 1 is integrally formed with a housing 3 that accommodates a retinal scanning image display device therein, a support frame 4 that supports the housing 3, and the support frame 4. And a head mounting portion 5 for mounting the HMD 1 on the user A's head.

  The casing 3 has a storage space in which the retinal scanning image display device can be stored. The casing 3 is arranged so as to cover the left eye portion and the left temple portion of the user A when the head is worn. It is comprised by the substantially L-shaped box.

  In addition, the housing 3 has a substantially rectangular front surface 3a that forms the forefront portion of the housing 3 in a state where the HMD 1 is mounted on the head, and a plan view that forms the uppermost portion of the housing 3. The substantially L-shaped top surface 3b is joined by an inclined surface 3c inclined from the top surface 3b toward the front surface 3a.

  A plurality of operation input units (hereinafter referred to as “operation switches 6”) operated by the user A are provided on the inclined surface 3 c, and the user A operates the operation switches 6, whereby the image in the HMD 1 is displayed. Various functions provided in the HMD 1 such as start and stop of display, fast forward and rewind of video, and the like are activated.

  Further, as will be described in detail later with reference to FIGS. 2 and 3, the retinal scanning image display device housed in the housing 3 optically guides the display image to the eyes of the user A. An image display unit C to be visually recognized and a control unit B that controls the operation of the image display unit C are provided. The control unit B includes an interface 13 to which a signal is input from the mobile phone 2.

  And the control part B has a predetermined signal detection means for detecting that a predetermined signal is input from the mobile phone 2 via the interface part, and that the predetermined signal is input by the predetermined signal detection means. When detected, at least a part of the display image is periodically changed and displayed on the image display unit so as to be visually recognized by the user A, and the user A is notified that a predetermined signal is input from the mobile phone 2 to the HMD 1. I am doing so. In the change display of the display image performed at this time, at least a part of the display image is changed and displayed at a cycle of 1 to several seconds as a predetermined cycle.

  The support frame 4 is a goggle-type support body having the same shape as the front part of the glasses. In this embodiment, when the HMD 1 is mounted on the head, the support frame 4 is mounted on a portion facing the left eye of the user A. The body 3 is attached.

  In addition, when the HMD 1 is mounted on the head, the support frame 4 is configured so that the portion facing the right eye of the user A is made of a translucent member so that the user A can view the image with the HMD 1. You can see the surroundings even while you are.

  The support frame 4 includes a notch 4a having a substantially trapezoidal shape in front view between a portion facing the left eye of the user A and a portion facing the right eye of the user A. However, when the HMD 1 is mounted on the head, the notch 4a is hooked on the nose of the user A.

  The head mounting portion 5 is configured by a member having a shape similar to that of a temple of glasses, the base end side of which is rotatably attached to both upper ends of the goggle-type support body, When the HMD 1 is mounted on the head, it is curved so that it can be hooked on the user's ear.

  When using the HMD 1, the user A hooks the notch 4a of the support frame 4 on the nose and hooks the curved portion on the terminal side of the head mounting portion 5 on both ears. The HMD 1 is supported at three points of both ears and nose, and the housing 3 is mounted on the head so as to be positioned in front of the right eye, and then the video content is viewed by operating the operation switch 6.

(Description of the control unit of the head mounted display)
Next, the control unit B of the HMD 1 will be specifically described with reference to FIG.

  As shown in FIG. 2, the control unit B includes a CPU (Central Processing Unit) 7, a ROM (Read Only Memory) 8, a RAM (Random Access Memory) 9, a video RAM 10, an audio CODEC 11, and a video CODEC 12. , An interface 13, a signal determination circuit 14, a speaker control circuit 15, and a microphone control circuit 16.

  The CPU 7, ROM 8, RAM 9, video RAM 10, signal discrimination circuit 14, audio CODEC 11, video CODEC 12, and interface 13 are each connected to a data communication bus, and various information is transmitted via this data communication bus. Send and receive.

  The CPU 7 is an arithmetic processing unit that operates various circuits constituting the control unit B such as the audio CODEC 11, the video CODEC 12, and the signal determination circuit 14 by executing various programs stored in the ROM 8.

  The ROM 8 includes various circuits constituting the control unit B such as a sound information reproduction program for operating the audio CODEC 11, a video information reproduction program for operating the video CODEC 12, and a signal determination program for operating the signal determination circuit 14. In addition to various programs executed by the CPU 7 for operation, the storage unit stores sound information and the like reproduced by the HMD 1.

  The RAM 9 is temporary storage means used as a work area when the CPU 7 executes various programs stored in the ROM 8.

  The interface 13 functions as an interface unit that outputs a predetermined signal input from an external device such as a mobile phone 2 or a personal computer connected to the HMD 1 to the signal determination circuit 14.

  The predetermined signal input to the interface 13 includes various types of information. For example, information indicating that a call is received by an external device (such as the mobile phone 2) having a telephone function, e-mail Information indicating that an external device (such as a mobile phone 2 or a personal computer) having a transmission / reception function has received an e-mail, or the remaining battery level of an external device (such as a mobile phone 2 or a PDA) operating with a battery as a power source has decreased. , Information indicating the type of external device that has output a predetermined signal, and the like are included.

  The signal discriminating circuit 14 operates as a signal discriminating program stored in the ROM 8 by the CPU 7 and serves as a predetermined signal detecting means for detecting that a predetermined signal is input from an external device through the interface 13. In addition to functioning, it is a circuit that functions as information discriminating means for discriminating information contained in a detected predetermined signal.

  The video RAM 10 is video information storage means provided individually for storing video information such as video content reproduced by the HMD 1.

  In addition, when a predetermined signal is input to the video RAM 10 from an external device such as a mobile phone 2 or a personal computer via the interface 13, at least a part of the display image is periodically changed and displayed. Information of a plurality of types of change display images for visual recognition is stored.

  The video RAM 10 does not simply store information on a plurality of change display images, but information on a plurality of types of change display images corresponding to information included in a predetermined signal input via the interface 13. Are stored in association with a plurality of types of information included in a predetermined signal, and function as a change display image storage means.

  The video RAM 10 also functions as an external device image storage unit that stores an external device image corresponding to the type of external device that outputs a predetermined signal input via the interface 13 in association with the type of external device. To do.

  Specifically, the video RAM 10 receives an e-mail corresponding to the information indicating the change display image indicating the mobile phone 2 corresponding to the information indicating the incoming call included in the predetermined signal, and the information indicating the reception of the e-mail. Information on the change display image to be displayed, information on the change display image indicating the battery corresponding to the information indicating that the remaining battery level of the external device has decreased, the mobile phone 2 corresponding to the type of the external device that outputs a predetermined signal, and the personal computer An external device image indicating a PDA or the like is stored.

  The video RAM 10 also stores face image information corresponding to the information indicating the caller as a change display image associated with the information indicating the incoming call and the information indicating the caller included in the predetermined signal. Yes.

  The audio CODEC 11 operates by the CPU 7 executing the sound information reproduction program stored in the ROM 8, decodes the sound information encoded in a predetermined file format stored in the ROM 8, and sends it to the speaker control circuit 15. In addition to outputting, the sound information conversion circuit encodes sound information input from the microphone control circuit 16 into a predetermined file format and outputs it to the RAM 9.

  The speaker control circuit 15 includes a D / A converter that converts digital sound information input from the audio CODEC 11 into an analog sound signal, and an amplifier that amplifies the analog sound signal converted by the D / A converter. This is a circuit for outputting sound from the speaker 17 by outputting the sound signal amplified by the amplifier to the speaker 17.

  The microphone control circuit 16 has an amplifier that amplifies the voice of the user A collected by the microphone 18 and the voice around the HMD 1 and an A / D converter that converts the analog sound signal amplified by the amplifier into a digital signal. , A circuit for outputting the sound information converted by the A / D converter to the audio CODEC 11.

  The video CODEC 12 operates when the CPU 7 executes a video information reproduction program stored in the ROM 8, and video information encoded in a predetermined file format stored in the video RAM 10 (information indicating video content, changes) This is a video information conversion circuit that decodes (information indicating a display image) to generate a video signal Sig and outputs it to the signal processing circuit 21 of the image display unit C shown in FIG.

  The video CODEC 12 is also a video information conversion circuit that encodes a video signal input from an external device via the interface 13 into a predetermined file format and outputs the video signal to the video RAM 10.

(Description of the image display part of the head mounted display)
Next, the image display unit C of the HMD 1 will be specifically described with reference to FIG.

  As shown in FIG. 3, the image display unit C reads the video signal Sig supplied from the control unit B shown in FIG. 2 for each dot clock, and generates a light beam whose intensity is modulated according to the read video signal Sig. And a laser beam (generated by the light beam generation unit 20 and emitted through the optical fiber 100) between the light beam generation unit 20 and the eye E of the user A. Hereinafter, the collimating optical system 61 for converting the light beam into a parallel light beam and the light beam converted into the parallel light beam by the collimating optical system 61 in the horizontal direction (primary direction) for image display. Unit 70, a vertical scanning unit 80 that scans a light beam scanned in the horizontal direction by the horizontal scanning unit 70 in the vertical direction (secondary direction), and a relay provided between the horizontal scanning unit 70 and the vertical scanning unit 80. With the optical system 75, like this Horizontal and vertical direction to the scanning light beam (hereinafter referred to. As "scanning light beam") is provided with a relay optical system 90 for emitting the pupil Ea.

  In addition, the light beam generation unit 20 is provided with a signal processing circuit 21 that receives the video signal Sig supplied from the control unit B and generates signals and the like as elements for synthesizing an image based on the video signal Sig. In the signal processing circuit 21, blue (B), green (G), and red (R) image signals 22a to 22c are generated and output. The signal processing circuit 21 outputs a horizontal synchronization signal 23 used in the horizontal scanning unit 70 and a vertical synchronization signal 24 used in the vertical scanning unit 80, respectively.

  Further, the light beam generation unit 20 converts the three image signals (B, R, G) 22a to 22c output for each dot clock from the signal processing circuit 21 into light beams, and these three light beams. A light combining unit 40 for generating an arbitrary light beam by combining with one light beam is provided.

  The light source unit 30 includes a B laser 34 that generates a blue light beam and a B laser driver 31 that drives the B laser 34, a G laser 35 that generates a green light beam, a G laser driver 32 that drives the G laser 35, and a red color. And an R laser driver 33 for driving the R laser 36. Each of the lasers 34, 35, and 36 can be configured as, for example, a semiconductor laser or a solid-state laser with a harmonic generation mechanism. When a semiconductor laser is used, the drive current can be directly modulated to modulate the intensity of the light beam. However, when a solid-state laser is used, each laser is equipped with an external modulator to modulate the intensity of the light beam. There is a need.

  The light combining unit 40 is provided with collimating optical systems 41, 42, and 43 that collimate the light beam incident from the light source unit 30 into parallel light, and dichroic mirrors 44, 45, and 46 for combining the collimated light beam. And a coupling optical system 47 for guiding the combined light flux to the optical fiber 100.

  Laser beams emitted from the lasers 34, 35, and 36 are collimated by collimating optical systems 41, 42, and 43, and then enter the dichroic mirrors 44, 45, and 46. Thereafter, these dichroic mirrors 44, 45, and 46 selectively reflect and transmit each light beam with respect to the wavelength.

  Specifically, the blue light beam emitted from the B laser 34 is collimated by the collimating optical system 41 and then enters the dichroic mirror 44. The green light beam emitted from the G laser 35 enters the dichroic mirror 45 through the collimating optical system 42. The red light beam emitted from the R laser 36 enters the dichroic mirror 46 through the collimating optical system 43.

  The three primary color beams incident on the three dichroic mirrors 44, 45, 46 are reflected or transmitted in a wavelength selective manner, reach the coupling optical system 47, and are collected and output to the optical fiber 100.

  The horizontal scanning unit 70 and the vertical scanning unit 80 scan in the horizontal direction and the vertical direction to form a scanning light beam so that the light beam incident from the optical fiber 100 can be projected as an image.

  The horizontal scanning unit 70 has a resonance type deflection element 71 having a deflection surface for scanning a light beam in the horizontal direction, and a drive signal for causing the resonance type deflection element 71 to resonate and swing the deflection surface of the resonance type deflection element 71. Based on the horizontal scanning drive circuit 72 as the drive signal generator to be generated and the displacement signal output from the resonance type deflection element 71, the oscillation range of the deflection surface of the resonance type deflection element 71 and the oscillation frequency etc. A phase detection circuit 73 that detects the state and a temperature detection unit 74 that detects the temperature of the resonant deflection element 71 are provided. The temperature detection unit 74 detects the temperature of the resonant deflection element 71, and detects the temperature of the resonant deflection element 71 by detecting the temperature around the resonant deflection element 71. It may be.

  The vertical scanning unit 80 includes a deflection element 81 for scanning a light beam in the vertical direction, and a vertical scanning control circuit 82 for driving the deflection element 81. In the present embodiment, the deflection element 81 of the vertical scanning unit 80 corresponds to an optical scanner that allows the user A to visually recognize a display image by scanning a light beam.

  The horizontal scanning drive circuit 72 and the vertical scanning control circuit 82 are driven based on the horizontal synchronizing signal 23 and the vertical synchronizing signal 24 output from the signal processing circuit 21, respectively.

  In addition, a relay optical system 75 that relays a light beam between the horizontal scanning unit 70 and the vertical scanning unit 80 is provided, and the light scanned in the horizontal direction by the resonant deflection element 71 passes through the relay optical system 75. Then, the beam is scanned in the vertical direction by the deflecting element 81 and emitted to the relay optical system 90 as a scanning beam.

  The relay optical system 90 includes lens systems 91 and 94 having a positive refractive power. The display scanning light beams emitted from the vertical scanning unit 80 are converted into convergent light beams by the lens system 91 so that the respective light beams have their center lines parallel to each other. The lens system 94 converts the light beams into substantially parallel light beams, and the center line of these light beams is converted so as to converge on the pupil Ea of the user A.

  In the present embodiment, the horizontal scanning unit 70, the relay optical system 75, the vertical scanning unit 80, and the relay optical system 90 correspond to optical elements that guide the display image to the eye E of the user A.

  In this embodiment, the light beam incident from the optical fiber 100 is scanned in the horizontal direction by the horizontal scanning unit 70 and then scanned in the vertical direction by the vertical scanning unit 80. The arrangement with the vertical scanning unit 80 may be exchanged, and after the vertical scanning unit 80 scans in the vertical direction, the horizontal scanning unit 70 may scan in the horizontal direction.

(Description of change display image)
Next, a change display image that the image display unit changes when a predetermined signal is input to the HMD 1 configured as described above from the mobile phone 2 via the interface 13 will be described in detail with reference to FIG. explain.

  When the user A wears the HMD 1 on the head and watches the video content, the control unit B of the present embodiment receives a predetermined signal from the mobile phone 2 via the interface 13 when the user A is viewing the video content. When the input is detected, the image display unit C is controlled so that the display image is changed and displayed to the user A so that a predetermined signal is input to the user A from the mobile phone 2. Control to notify is performed.

  At this time, the image display unit C performs change display of the display image by reciprocating at least a part of the display image in a predetermined cycle.

  That is, the control unit B prevents the image display unit C from viewing the video content by the user A as shown in FIG. 4A in a state where a predetermined signal is not input from the mobile phone 2. Control that displays still images of three icons side by side at an empty position (here, the lower right position of display image V): icon image P indicating a mobile phone, icon image M indicating an e-mail, and icon image Bat indicating a battery I do.

  Thereafter, when the signal determination circuit 14 detects that a predetermined signal is input from the mobile phone 2 and determines that the information included in the detected predetermined signal is information indicating an incoming call, the control unit B 4B is a control for causing the image display unit C to perform a change display (hereinafter referred to as “vibration display”) in which only the icon image P indicating the mobile phone is reciprocated at a predetermined cycle, as shown in FIG. 4B. I do.

  In the present embodiment, the icon image P indicating the mobile phone 2 is displayed in a changed manner so as to notify the user A that there is an incoming call, but the icon image indicating the mobile phone 2 is displayed. Instead of P, it is also possible to notify the user A that a telephone call has been received by changing and displaying the face image of the caller (caller).

  When the face image is changed and displayed as described above, the control unit B determines that the information included in the predetermined signal is information indicating the incoming call and information indicating the caller by the signal determination circuit 14. The face image information corresponding to the information indicating the call origin stored in the video RAM 10 is read out, and the information is decoded by the video CODEC 12 and output to the image display unit C. Change the face image.

  As described above, when the mobile phone 2 receives an incoming call, the incoming call partner's face image is changed and displayed to the user A so that the user A can receive an incoming call. In addition, it is possible to notify even the other party who is calling the user.

  Further, when the control unit B determines that the information included in the predetermined signal is information indicating reception of the e-mail by the signal determination circuit 14, the control unit B displays the image display unit C in FIG. As shown in (), control is performed to vibrate and display only the icon image M indicating the e-mail.

  In addition, when the control unit B determines that the information included in the predetermined signal is information indicating that the remaining battery level is low, the signal determination circuit 14 instructs the image display unit C to As shown in FIG. 4D, only the icon image Bat indicating the battery is vibrated and displayed, the color is changed, and the size of the icon image indicating the battery shown in FIG. Control is performed to display smaller than Bat.

  As described above, in this embodiment, the signal determination circuit 14 included in the control unit B outputs the predetermined signal based on the information included in the predetermined signal input from the external device via the interface 13. Here, it functions as an external device discriminating unit that discriminates the type of the mobile phone 2, and further functions as an information discriminating unit that discriminates the type (content) of information included in a predetermined signal.

  In this way, when the control unit B detects that the predetermined signal is input from the mobile phone 2 via the interface 13 by the signal determination circuit 14, at least a part of the display image V is displayed on the image display unit C. Since the control is performed so that the user can visually recognize and change periodically, the state of the mobile phone 2 such as incoming call, reception of e-mail, remaining battery power, etc. can be accurately determined without disturbing the viewing of the video content by the user A. The user can be notified.

  Moreover, since the image display unit C reciprocates at least a part of the display image V in the field of view of the user A as a change display of the display image V, the user A moves by himself / herself. Even if it is, it can be surely known that a predetermined signal is input from the mobile phone 2 to the HMD 1.

  In addition, the control unit B determines the type of the external device that has output the predetermined signal and the type of information included in the predetermined signal based on the information included in the predetermined signal input to the HMD 1. The image display unit C determines the type of icon image (icon image P indicating a mobile phone, icon image M indicating an e-mail, or icon image Bat indicating a battery) corresponding to the determination result by the image display unit C. Since A is visually recognized, it is possible to clearly notify the user A of which external device the predetermined signal input to the HMD 1 is output from and what the external device relates to. it can.

  That is, the user A can easily know that the telephone is in an incoming state by visually recognizing the icon image P indicating the mobile phone, and by visually recognizing the icon image M indicating the e-mail, It can be easily known that the e-mail has been received, and by visually recognizing the icon image Bat indicating the battery, it can be easily known that the remaining amount of the battery is low.

  Note that FIG. 4 shows the display image V in which only a part is displayed in vibration, but according to the present invention, the entire display image V can also be displayed in vibration.

  In addition, regarding the vibration display, the user A selects in advance one of the vibration display modes as to whether the entire display image V is vibration-displayed or only a part of the display image is vibration-displayed. can do. The vibration display form selected by the user A is stored in the RAM 9 as a vibration condition.

  In the present embodiment, when a predetermined signal is input from the external device to the HMD 1, each icon image corresponding to the signal is vibrated and displayed at a predetermined cycle as an example of a change display. The form is not limited to this, and may be changed and displayed in an arbitrary display form as long as each icon image corresponding to a predetermined signal input from the external device is changed and displayed at a predetermined cycle.

  For example, by performing change display in which each icon image corresponding to a predetermined signal input from the external device is moved in a vertical direction, a horizontal direction, a rotation direction, and a depth direction at a predetermined cycle, the HMD 1 receives a predetermined signal from the external device. You may comprise so that it may alert | report to a user that was input.

  In addition to these, by performing a change display that changes the color of each icon image to another color at a predetermined cycle, or a change display that repeatedly flashes display and non-display of each icon image at a predetermined cycle, The HMD 1 may be configured to notify the user that a predetermined signal has been input from an external device.

(Description of processing performed by the control unit of the head mounted display)
Next, a process executed when the control unit B of the HMD 1 causes the image display unit C to perform a change display of the display image V will be specifically described with reference to FIGS.

  As shown in FIG. 5, when the power of the HMD 1 is turned on, the control unit B first determines whether or not a predetermined signal is input from the mobile phone 2 that is an external device via the interface 13 ( Step S1).

  Here, the control unit B moves the process to step S2 when it is determined that a predetermined signal is input, and when it is determined that the predetermined signal is not input, until the input of the predetermined signal is detected. The process of step S1 is repeated.

  In step S2, the control unit B determines whether or not the information included in the predetermined signal is information indicating an incoming call, and if it is determined that the information is an information indicating an incoming call, the process proceeds to step S3. If it is determined that the information does not indicate an incoming call, the process proceeds to step S4.

  In step S3, the control unit B performs a process of notifying the user A that there is an incoming call according to the incoming call flow shown in FIG. 6, and then returns the process to step S1.

  In step S4, the control unit B determines whether the information included in the predetermined signal is information indicating reception of an e-mail, and determines that the information is information indicating reception of the e-mail. The process moves to step S5, and if it is determined that the information is not information indicating an incoming call, the process moves to step S6.

  In step S5, the control unit B performs a process of notifying the user A that an e-mail has been received according to the e-mail reception flow shown in FIG. 7, and then returns the process to step S1.

  In step S6, the control unit B determines whether the information included in the predetermined signal is information indicating that the remaining battery level of the mobile phone 2 has decreased, and the remaining battery level has decreased. If it is determined that the information is information indicating that the battery has been discharged, the process proceeds to step S7. If it is determined that the information is not information indicating that the remaining battery level has decreased, the process returns to step S1.

  In step S7, the control unit B performs processing for notifying the user A that the remaining battery level of the mobile phone 2 has decreased according to the remaining battery level decreasing flow shown in FIG. 8, and then returns the processing to step S1. .

(Explanation of incoming call flow)
In step S2 shown in FIG. 5, when the signal discriminating circuit 14 determines that the information included in the predetermined signal is information indicating an incoming call, the control unit B first receives the incoming call as shown in FIG. A credit icon information call process is performed (step S11).

  Here, the control part B performs the process which reads the information regarding the icon image P which shows the mobile telephone memorize | stored in the video RAM 10, and moves a process to step S12 after that.

  In step S12, the control unit B performs a vibration condition calling process. Here, the control unit B refers to the vibration condition stored in the RAM 9 to determine the vibration display form set in advance by the user A, and then moves the process to step S13.

  In step S13, the control unit B performs an image creation process. Here, the control unit B performs processing for decoding the information about the icon image P indicating the mobile phone read from the video RAM 10 in step S11 by the video CODEC 12 to generate the video signal Sig, and then the processing proceeds to step S14. Transfer.

  In step S14, the control unit B performs image display processing. Here, the control unit B transmits the video signal Sig generated by the video CODEC 12 to the image display unit C via the data communication bus, whereby the mobile phone described in FIG. A process of vibrating and displaying the icon image P indicating the telephone is performed, and then the process proceeds to step S15.

  In step S15, the control unit B determines whether or not a call has been started. Here, the control unit B determines whether or not the call is started by determining whether or not a signal indicating that the call is started from the mobile phone 2 is input to the HMD 1 by the signal determination circuit 14. .

  Then, the control unit B moves the process to step S16 when determining that the call is started, and moves the process to step S17 when determining that the call is not started.

  In step S16, the control unit B performs an image erasing process. Here, the control unit B performs a process of stopping the transmission of the video signal Sig transmitted to the image display unit C in order to change and display the icon image P indicating the mobile phone, and then the process is illustrated in FIG. Return to step S1.

  In step S17, the control unit B determines whether or not the incoming call has ended. Here, the control unit B determines whether or not the incoming call is terminated by determining whether or not the signal indicating the incoming call from the mobile phone 2 is continuously input by the signal determination circuit 14. .

  Then, the control unit B moves the process to step S16 when determining that the incoming call has ended, and moves the process to step S14 when determining that the incoming call has not ended.

(Explanation of email reception flow)
In step S4 shown in FIG. 5, when the signal discriminating circuit 14 determines that the information included in the predetermined signal is information indicating the reception of the e-mail, the control unit B first performs the electronic control as shown in FIG. The information reception process for the mail receiving icon is performed (step S21).

  Here, the control part B performs the process which reads the information regarding the icon image M which shows the email memorize | stored in the video RAM 10, and moves a process to step S22 after that.

  In step S22, the control unit B performs a vibration condition calling process. Here, the control unit B refers to the vibration condition stored in the RAM 9 to determine the vibration display form set in advance by the user A, and then moves the process to step S23.

  In step S23, the control unit B performs image creation processing. Here, the control unit B performs processing for decoding the information related to the icon image M indicating the electronic mail read from the video RAM 10 in step S21 by the video CODEC 12 to generate the video signal Sig, and then the processing proceeds to step S24. Transfer.

  In step S24, the control unit B performs image display processing. Here, the control unit B transmits the video signal Sig generated by the video CODEC 12 to the image display unit C via the data communication bus, thereby causing the image display unit C to display the electronic signal described in FIG. A process of vibrating and displaying the icon image M indicating mail is performed, and then the process proceeds to step S25.

  In step S25, the control unit B determines whether or not there is any input. Here, the control unit B opens a signal indicating that the mail center has inquired of the reception of the e-mail from the mobile phone 2, a signal indicating that the e-mail has been received, and the received e-mail from the mobile phone 2. It is determined whether or not there is any input by determining whether or not a signal indicating that it has been input.

  Then, the control unit B moves the process to step S26 when determining that there is any input, and moves the process to step S27 when determining that there is no input.

  In step S26, the control unit B performs an image erasing process. Here, the control unit B performs a process of stopping the transmission of the video signal Sig transmitted to the image display unit C in order to change and display the icon image M indicating the e-mail, and then the process is illustrated in FIG. Return to step S1.

  In step S27, the control unit B determines whether or not a predetermined time has elapsed after performing the image display process in step S24. If it is determined that the predetermined time has elapsed, the control unit B moves the process to step S26, and performs the predetermined time. If it is determined that has not elapsed, the process proceeds to step S24.

(Explanation of low battery level flow)
In step S6 shown in FIG. 5, when the signal discriminating circuit 14 discriminates that the information included in the predetermined signal is information indicating a decrease in the remaining battery level, the control unit B first starts as shown in FIG. Then, a process for determining the remaining battery level is performed (step S31).

  Here, the control unit B performs a process of determining the degree of the remaining battery level based on information included in a predetermined signal input from the mobile phone 2, and then moves the process to step S32.

  In step S <b> 32, the control unit B performs information call processing for the battery remaining amount icon. Here, the control unit B performs a process of reading information about the icon image Bat indicating the battery corresponding to the degree of the remaining battery level determined in step S31 from the video RAM 10, and then moves the process to step S33.

  In step S33, the control unit B performs a vibration condition calling process. Here, the control unit B refers to the vibration condition stored in the RAM 9 to determine the vibration display form set in advance by the user A, and then moves the process to step S34.

  In step S34, the control unit B performs an image creation process. Here, the control unit B performs processing for decoding the information regarding the icon image Bat indicating the battery read from the video RAM 10 in step S32 by the video CODEC 12 to generate the video signal Sig, and then moves the processing to step S35. .

  In step S35, the control unit B performs image display processing. Here, the control unit B transmits the video signal Sig generated by the video CODEC 12 to the image display unit C via the data communication bus, whereby the battery described in FIG. Is performed, and the process returns to step S1 shown in FIG.

  As described above, according to the HMD 1 of the present embodiment, when a mobile phone 2 connected to the HMD 1 receives an incoming call, the user A is in the middle of viewing video content or the like using the HMD 1. However, by visually recognizing the icon image P indicating the mobile phone 2 that is vibrated and displayed in the display image V, it is possible to easily and reliably know the incoming call.

  Further, the user A can easily know that the mobile phone 2 has received the e-mail by visually recognizing the icon image M indicating the e-mail that is vibrated and displayed in the display image V, similarly to the incoming call. It is possible to easily know that the remaining battery level of the mobile phone 2 has decreased by visually recognizing the icon image Bat indicating the battery that is vibrated and displayed in the display image V.

  Moreover, in the said embodiment, it is made to make a user visually recognize a change display image by displaying the moving image which is reciprocatingly moving the icon image with a predetermined period on the image display part C, but besides this, An optical element vibration mechanism that vibrates the optical element itself is provided in the image display unit C, and an icon image (an icon image P indicating a mobile phone, an icon image M indicating an e-mail, an icon image indicating a battery) is displayed on the image display unit C. The change display image may be visually recognized by the user A by causing the control unit B to control the operation of the optical element vibration mechanism while displaying Bat and the like.

  Here, the optical element vibration mechanism that vibrates the optical element integrally forms the entire optical element including the horizontal scanning unit 70, the relay optical system 75, the vertical scanning unit 80, and the relay optical system 90 shown in FIG. It can be constituted by a vibrator to be vibrated.

  Then, a vibration mechanism control program for controlling the operation of the optical element vibration mechanism is stored in a predetermined area in the ROM 8, and the image display unit is executed by causing the control unit B to execute the vibration mechanism control program. Let C display the change.

  As described above, if the change display is configured to be performed by operating the optical element vibration mechanism, the video RAM 10 only needs to store information for displaying a still image as the change display image information. Therefore, the storage area for the change display image in the video RAM 10 can be reduced, and the information storage area for the video content can be expanded correspondingly.

  Further, in place of the optical element vibration mechanism, an offset changing means for changing the offset amount of the optical scanner is provided in the scanning mechanism of the optical scanner provided in the optical element (deflection element 81 of the vertical scanning unit 80 in FIG. 3). Even when the offset amount of the optical scanner is periodically changed at a predetermined cycle by the offset changing means, the change display image can be visually recognized by the user A as in the case where the optical element vibration mechanism is provided.

  The offset changing means is provided with a rotating shaft moving device for periodically reciprocating (vibrating) the rotating shaft of the deflecting element 81 in the vertical scanning unit 80, and the control unit B controls the rotating shaft moving device. This can be realized by controlling the operation.

  At this time, the rotation axis moving device reciprocates the rotation axis of the deflection element 81 in a direction perpendicular to a straight line connecting the deflection element 81 and the pupil Ea of the user A.

  When the change display is performed by the offset changing means configured as described above, a rotating shaft moving device control program for controlling the operation of the rotating shaft moving device is stored in advance in a predetermined area of the ROM 8. By causing the control unit B to execute the rotation axis moving device control program, the image display unit C is caused to perform change display.

  According to this offset changing means, it is possible to perform change display only by moving the rotation axis of the optical scanner. Therefore, the change display is performed with less power than when the entire optical element is vibrated by the optical element vibration mechanism. Therefore, it is possible to reduce power consumption required for the change display of the HMD 1.

  The HMD 1 includes a wavefront curvature modulation element that modulates the wavefront curvature of a light beam incident on the eye E of the user A, instead of the optical element vibration mechanism and the offset changing unit. The change display image can be visually recognized by the user A also by controlling the operation of the curvature modulation element. The wavefront curvature indicates the degree of spread (parallelism) of the light beam. The parallel state of the light beam indicates an infinite image, and the closer the distance from the parallel (diffuse), the closer the image. It is.

  In this case, in addition to the image display unit C for displaying video content on the HMD 1, a change display image display unit for displaying a change display image is further provided, and a wavefront curvature modulation element is provided in the change display image display unit. By providing, only the change display image is moved and displayed three-dimensionally in the depth direction or the front direction in the field of view of the user A.

  Here, the change display image display unit will be described with reference to FIG. In the change display image display unit Ca shown in FIG. 9, the same components as those of the image display unit C shown in FIG.

  As shown in FIG. 9, the change display image display unit Ca is similar to the image display unit C shown in FIG. 4 with respect to its basic configuration, but between the collimating optical system 61 and the horizontal scanning unit 70. In addition, a wavefront curvature modulation element 61 a that modulates the wavefront curvature of the light beam output from the collimating optical system 61 and outputs the modulated light to the horizontal scanning unit 70 is different.

  The wavefront curvature modulation element 61a reflects or transmits a light beam incident from the collimating optical system 61, a converging lens for converging the light beam incident through the beam splitter, and a light beam converged by the converging lens. And a mirror driving device for driving the mirror unit.

  The wavefront curvature modulation element 61a reflects the light beam incident from the collimating optical system by the beam splitter, passes through the converging lens, and then reflects it by the mirror unit. Then, the light is again passed through the converging lens, and then transmitted through the beam splitter and output to the horizontal scanning unit 70.

  At this time, in the wavefront curvature modulation element 61a, the mirror driving device that drives the above-described mirror unit is operated to change the distance between the converging lens and the mirror unit, thereby entering from the collimating optical system 61 and the horizontal scanning unit 70. Change the wavefront curvature of the luminous flux toward

  Then, the wavefront curvature modulation element 61a is displaced by moving the mirror part in the direction approaching the converging lens or away from the converging lens by the mirror driving device, and changing the distance between the converging lens and the mirror part. By adjusting the imaging position of the light beam emitted to the eye E of the user A in the optical axis direction, the change display image is displayed in a three-dimensional manner in the depth direction or the front direction in the field of view of the user A. To be able to.

  As described above, when the change display by the wavefront curvature modulation element 61a is performed, the wavefront curvature modulation element control program for controlling the operation of the mirror driving device is stored in a predetermined area in the ROM 8, and the control unit B In addition, by executing the wavefront curvature modulation element control program, the change display image display unit Ca is caused to perform change display.

  When the control unit B determines that the information included in the predetermined signal input from the mobile phone 2 is information indicating reception of the e-mail, the control unit B indicates the e-mail. As shown in FIG. 10, in the display image V, the control is performed to display the icon image M, and the wavefront curvature modulation element 61a is operated by executing the wavefront curvature modulation element control program stored in the ROM 8. Only the icon image M indicating the e-mail is three-dimensionally moved to the near side in the depth direction at a predetermined cycle so as to be visually recognized by the user A.

  Thus, by moving only the icon image M indicating the e-mail three-dimensionally in the display image V, the user A can be effectively notified of the reception of the e-mail.

  In addition, the change display performed by operating the wavefront curvature modulation element 61a is not limited to the reception of an e-mail, but can be similarly performed with respect to an incoming call or the remaining battery level of the mobile phone 2, and in particular, the mobile phone 2 This is effective when notifying the user A that the remaining battery level has decreased.

  That is, when the control unit B determines that the information included in the predetermined signal input from the mobile phone 2 is information indicating a decrease in the remaining battery level, the signal discrimination circuit 14 determines the wavefront curvature. The modulation element 61a is operated, and the icon image Bat indicating the battery is moved and displayed in the direction away from the user A in the display image V.

  In this way, by performing a change display in which only the icon image Bat indicating the battery is moved away from the user A in the display image V, the icon A Bat indicating the battery moves away from the other icon. Since the image appears to be smaller than the images (P, M), it is possible to effectively notify the user A that the remaining battery level of the mobile phone 2 has decreased.

  The change display when the wavefront curvature modulation element 61a is provided in the HMD 1 in this way is a change display in which only an icon image corresponding to a predetermined signal is simply moved in the depth direction at a predetermined cycle as described above. For example, a change display in which each icon image corresponding to a predetermined signal input from an external device is moved in the depth direction while being moved in the vertical direction, the horizontal direction, the rotation direction, and the depth direction in a predetermined cycle is not limited. By performing, it may be configured to notify the user that a predetermined signal has been input to the HMD 1 from an external device.

  In addition to these, a change display in which the color of each icon image is changed in the depth direction while changing the color to another color at a predetermined cycle, and the display and non-display of each icon image are repeatedly blinked at a predetermined cycle. It may be configured to notify the user that a predetermined signal is input to the HMD 1 from an external device by performing a change display that moves in the depth direction.

  In addition, the HMD 1 according to the present invention includes a vibration mechanism that vibrates the HMD 1 itself inside the housing 3 and a vibration mechanism control program for controlling the operation of the vibration mechanism in a predetermined area in the RAM 9. I remember it.

  Then, when a predetermined signal is input from the external device, the control unit B operates the vibration mechanism by executing the vibration mechanism control program, and visually recognizes the display image V vibrating with respect to the user A. The vibration display (change display) is performed.

  In this way, by operating the vibration mechanism to display the change of the display image V, the user A can more reliably perform the predetermined display from the external device by the synergistic effect of the change display and the vibration transmitted to the head. It is possible to know that a signal has been input.

It is an external appearance perspective view which shows the head mounted display which concerns on this embodiment. It is a functional block diagram which shows the control part of a head mounted display. It is explanatory drawing which shows the image display part of a head mounted display. It is explanatory drawing which shows the display image which a user visually recognizes when a predetermined | prescribed signal is input from an external device. It is a flowchart which shows the process which the control part of a head mounted display performs. It is a flowchart which shows the process which the control part of a head mounted display performs. It is a flowchart which shows the process which the control part of a head mounted display performs. It is a flowchart which shows the process which the control part of a head mounted display performs. It is explanatory drawing which shows the image display part for a change display. It is explanatory drawing which shows the change display image which operates a wavefront curvature modulation element and makes a user visually recognize.

Explanation of symbols

A User B Control unit C Image display unit Ca Change display image display unit E Eye Ea Pupil Eb Retina 1 HMD
2 Mobile phone 3 Housing 4 Support frame 5 Head mounting part 7 CPU
8 ROM
9 RAM
10 Video RAM
11 Audio CODEC
12 Video CODEC
13 Interface 14 Signal discriminating circuit 20 Light flux generating unit 21 Signal processing circuit 30 Light source unit 40 Light combining unit 47 Coupling optical system 61 Collimating optical system 61a Wavefront curvature modulation element 70 Horizontal scanning unit 75 Relay optical system 80 Vertical scanning unit 81 Deflection element

Claims (13)

A head having a head mounting unit to be mounted on a user's head, an image display unit that optically guides and visually displays a display image to the user's eyes, and a control unit that controls the operation of the image display unit In the mount display,
Provide an interface unit that receives signals from external devices,
The controller is
Predetermined signal detection means for detecting that a predetermined signal is input from the external device via the interface unit;
When it is detected that the predetermined signal is input by the predetermined signal detection means, at least a part of the display image is periodically changed and displayed on the image display unit so that the user can visually recognize the display image. A head-mounted display characterized by that.   The head mounted display according to claim 1, wherein the image display unit performs the change display by reciprocating at least a part of the display image at a predetermined period. The image display unit
An optical element for guiding the display image to the user's eyes;
An optical element vibration mechanism for vibrating the optical element,
The head mounted display according to claim 1, wherein the change display is performed by operating the optical element vibration mechanism. The image display unit
An optical scanner that allows the user to visually recognize the display image by scanning a light beam;
Offset changing means for changing the offset amount of the scanning mechanism of the optical scanner,
The head mounted display according to claim 1 or 2, wherein the change display is performed by periodically changing the offset amount by the offset changing means. The image display unit
Having a wavefront curvature modulation element that modulates the wavefront curvature of the light beam incident on the user's eye;
The change display is performed by operating the wavefront curvature modulation element to move the display image in a depth direction or a near side direction in the user's field of view. Head mounted display. The image display unit
A vibration mechanism for vibrating the head-mounted display is provided.
The head mounted display according to claim 1 or 2, wherein the change display is performed by vibrating the head mounted display by the vibration mechanism. A change display image storage unit that stores a change display image corresponding to information included in the predetermined signal in association with information included in the predetermined signal;
The control unit has information determining means for determining information included in the predetermined signal input via the interface unit;
6. The head mount according to claim 1, wherein the change display image corresponding to the information determined by the information determination unit is controlled to be changed and displayed by the image display unit. display.   The predetermined signal includes information indicating an incoming call output from the external apparatus having a telephone function or information indicating reception of an e-mail output from the external apparatus having an e-mail function. The head mounted display of any one of Claims 1-7. The controller is
When the information determining unit determines that the information included in the predetermined signal is information indicating the incoming call, the control unit causes the image display unit to display the change display image indicating the mobile phone as the change display. Done
Control that causes the image display unit to change and display the change display image indicating an e-mail when the information determination unit determines that the information included in the predetermined signal is information indicating the e-mail reception. The head mounted display according to claim 8, wherein: The predetermined signal includes information indicating an incoming call output from the external device having a telephone function and information indicating a caller,
When the information determining means determines that the information included in the predetermined signal is information indicating the incoming call and information indicating the caller, the image display unit corresponds to the information indicating the caller The head mounted display according to claim 1, wherein the change display image showing a face is controlled to be changed and displayed. The predetermined signal includes information indicating that the remaining amount of battery output from the external device powered by a battery has decreased,
When the information determining unit determines that the information included in the predetermined signal is information indicating that the remaining battery level is low, the control unit changes the image display unit to indicate a battery. The head-mounted display according to claim 1, wherein the display image is controlled to be changed and displayed. An external device image storing means for storing an external device image corresponding to the type of the external device that outputs the predetermined signal in association with the type of the external device;
The control unit includes an external device determination unit that determines the type of the external device based on the predetermined signal input via the interface unit.
12. The control according to claim 1, wherein control is performed to cause the image display unit to display the change of an external device image corresponding to the type of the external device determined by the external device determination unit. Head mounted display.   The head-mounted display is a retinal scanning display that scans a light beam in accordance with an image signal in a two-dimensional direction and guides the scanned light to the eye to form a display image on the retina. The head mounted display of any one of 1-12.

Images