JP2017079389A - Display device, display device control method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow a display device to perform image display which has an enhanced presence and is less likely to visually induce motion sickness.SOLUTION: An HMD 100 with an image display section 20 displays an image such that a user wearing the image display section 20 can view the image with a first area giving a motion stimulation and a second area giving standstill stimulation superimposed to differentiate parallaxes.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a display device, a display device control method, and a program.

  2. Description of the Related Art Conventionally, a technique for displaying a video with a sense of speed and presence using a display device used for a driving simulator or the like is known (see, for example, Patent Document 1).

JP-A-9-269723

It is known that when motion stimulation is given through human vision, so-called video sickness is caused. In the method described in Patent Document 1, a control image is added when a 3D video is viewed. However, since motion stimulation is given by the 3D video, there is a concern that video sickness may occur when the immersive feeling is high.
The present invention has been made in view of the above circumstances, and an object of the present invention is to display an image with a sense of reality and less prone to motion sickness by a display device.

In order to achieve the above object, in the display device of the present invention, the display unit and the first region where the user who visually recognizes the display unit gives a motion stimulus and the second region where a stationary stimulus is given have different parallaxes. And a display control unit that displays an image on the display unit so that the display unit can be visually recognized.
According to the present invention, the first region for applying the motion stimulus and the second region for applying the static stimulus are combined with each other so that the parallax is different, and the user is made to perceive. This makes it possible to enhance or weaken the user's self-motion sensation without relying on a single 3D image, so that it is possible to display an image that is easy to induce realism and to reduce image sickness. Can be planned.

In the display device according to the aspect of the invention, the display control unit may be configured such that a viewing distance at which the user visually recognizes the first area is different from a viewing distance at which the user visually recognizes the second area. Thus, an image is displayed on the display unit.
According to the present invention, by combining images or images perceived at different distances, it is possible to effectively display a self-motion sensation or a display that does not easily induce a self-motion sensation to a user viewing a display device. The display having various visual effects is possible.

In the display device according to the present invention, the display control unit causes the display unit to display an image so that a viewing distance of the second region is farther from the user than the first region. It is characterized by this.
According to the present invention, the user is provided with a display that is more easily perceived as if the second region that gives a stationary stimulus is farther than the first region that gives a motor stimulus, thereby affecting the user's own self-motion sensation. Easy display.

In the display device according to the present invention, the display unit is configured to be visible to the user through the outside scene, and the display control unit overlaps the outside scene as the second region. The display unit displays an image of the first area.
ADVANTAGE OF THE INVENTION According to this invention, the display which is easy to influence a user's own self-motion sensation can be performed using the external scene visually perceived through a display part.

In the display device according to the aspect of the invention, the display unit may be configured to be visible to the user through the outside scene, and the display control unit may be visually recognized together with the outside scene as the first area. The image of the second area is displayed by the display unit.
According to the present invention, an outside scene that is visible through the display unit is used to watch a moving image or image, and the user's own self-motion sensation is not affected. Easy display.

In the display device according to the present invention, the display control unit causes the display unit to display each of the image of the first area and the image of the second area.
According to the present invention, by combining the images displayed by the display device, it is possible to perform a display that easily affects the user's own self-motion sensation while watching a moving image or image.

In the display device, the display control unit causes the display unit to display an image so that a viewing distance of the second region is closer to the user than the first region. It is characterized by this.
According to the present invention, the user perceives that the first region that gives the motor stimulus is farther than the second region that gives the static stimulus, so that the user can move with respect to the self-motion sense of the user. Can be easily affected.

In the display device according to the present invention, the display unit is configured to be visible to the user through the outside scene, and the display control unit overlaps the outside scene as the second region. The display unit displays an image of the first area.
ADVANTAGE OF THE INVENTION According to this invention, the display which is easy to give the influence which exercise | moves with respect to a user using the external scene visually permeate | transmitted through a display part can be performed.

In the display device according to the present invention, the display unit is configured to be visible to the user through the outside scene, and the display control unit overlaps the outside scene as the first region. The display unit displays an image of the second area.
ADVANTAGE OF THE INVENTION According to this invention, the display which is easy to give the influence which exercise | moves with respect to a user using the external scene visually permeate | transmitted through a display part can be performed.

In the display device according to the present invention, the display control unit causes the display unit to display each of the image of the first area and the image of the second area.
ADVANTAGE OF THE INVENTION According to this invention, the display which is easy to give the influence which a user exercises can be performed by combining the image which a display apparatus displays.

In the display device according to the present invention, the display control unit displays an image on the display unit such that a ratio of the second area occupied by the visual field of the user is equal to or higher than a predetermined ratio set in advance. It is characterized by making it.
According to the present invention, the effect of the static stimulus given to the user by the second region can be obtained more reliably.

In the display device according to the present invention, the display control unit displays an image on the display unit such that a ratio of the second area occupied by the visual field of the user is equal to or less than a predetermined ratio set in advance. It is characterized by making it.
According to the present invention, it is possible to more reliably obtain the effect of static stimulation given to the user by the combination of the first region and the second region.

In the display device according to the present invention, the display control unit may be configured such that the amount of movement per unit time of the first area is larger than the amount of movement per unit time of the second area. An image is displayed on the display unit.
According to the present invention, even if each of the first region and the second region has a motion, it is possible to obtain the effect of the motion stimulus by the first region and the effect of the static stimulus by the second region.

The display device may further include a motion detection unit that detects a motion of the user's head, and the display unit corresponds to the motion detected by the motion detection unit. The display state of at least one of the area and the second area is changed.
According to the present invention, it is possible to produce a more effective display or to transmit new information by changing the display according to the movement of the user's head.

According to the present invention, the display device includes an imaging unit, and displays at least one of the first region and the second region corresponding to a motion detected from a captured image captured by the imaging unit. It is characterized by changing the state.
According to the present invention, a captured image can be used to more effectively perform a display that easily affects the kinesthetic sense.

In the display device, the display control unit displays an image generated based on a captured image of the imaging unit as the first region or the second region. .
According to the present invention, it is possible to realize a display that gives a stimulus to the user's own kinesthetic sense by using a captured image.

In the display device according to the aspect of the invention, the display control unit may display an image on the display unit so as to improve visibility on a side of the first region or the second region on which the user pays attention. It is characterized by displaying.
According to the present invention, it is possible to realize video display that makes it easier to feel a sense of reality, and to reduce video sickness.

In the display device according to the present invention, the display control unit detects a movement of the user and controls a movement of an image displayed on the display unit in response to the detected movement. And
According to the present invention, so-called video sickness can be more effectively suppressed by controlling the movement of the image in response to the movement of the user.

In order to achieve the above object, the present invention provides a method for controlling a display device including a display unit, in which a user who visually recognizes the display unit provides a first region for applying a motion stimulus and a static stimulus. An image is displayed on the display unit so that the second region can be visually recognized with different parallax.
According to the present invention, the first region for applying the motion stimulus and the second region for applying the static stimulus are combined with each other so that the parallax is different, and the user is made to perceive. This makes it possible to enhance or weaken the user's self-motion sensation without relying on a single 3D image, so that it is possible to display an image that is easy to induce realism and to reduce image sickness. Can be planned.

In order to achieve the above object, the present invention is a program executable by a computer including a display unit, and a first region where a user who visually recognizes the display unit gives an exercise stimulus by the computer, A program for displaying an image on the display unit so that the second region to which a static stimulus is applied can be visually recognized with different parallaxes.
According to the present invention, the first region for applying the motion stimulus and the second region for applying the static stimulus are combined with each other so that the parallax is different, and the user is made to perceive. This makes it possible to enhance or weaken the user's self-motion sensation without relying on a single 3D image, so that it is possible to display an image that is easy to induce realism and to reduce image sickness. Can be planned.

  The present invention can also be realized in various forms other than the display device. For example, a computer program for realizing the above control method, a recording medium recording the computer program, a server device for distributing the computer program, a data signal including the computer program and embodied in a carrier wave, etc. It can be realized in the form.

Explanatory drawing which shows the external appearance structure of HMD. The figure which shows the structure of the optical system of an image display part. The figure which shows the principal part structure of an image display part. The functional block diagram of each part which comprises HMD. It is explanatory drawing of the effect | action of the movement stimulus by vision, (A) shows the example for which a foreground and a background are visually recognized, (B) shows the example for visually recognizing an image with a wide viewing angle, (C) is normal An example of visually recognizing an image at a viewing angle is shown. It is a figure which shows the example of a display of HMD, (A) shows the example which displays a game image and a background image, (B) shows the example which displays a game image, (C) shows the example which displays a background image Show. The flowchart which shows operation | movement of HMD.

FIG. 1 is an explanatory diagram showing an external configuration of an HMD (Head Mounted Display) 100 according to an embodiment to which the present invention is applied.
The HMD 100 is a display device that includes an image display unit 20 that allows a user to visually recognize a virtual image while being mounted on the user's head, and a control device 10 that controls the image display unit 20. The control device 10 also functions as a controller for the user to operate the HMD 100.

  The image display unit 20 is a wearing body that is worn on the user's head, and has a glasses shape in the present embodiment. The image display unit 20 includes a right holding unit 21, a right display driving unit 22, a left holding unit 23, a left display driving unit 24, a right optical image display unit 26, a left optical image display unit 28, and a camera 61. (Imaging part) and a microphone 63 are provided. The right optical image display unit 26 and the left optical image display unit 28 are arranged so as to be positioned in front of the right and left eyes of the user when the user wears the image display unit 20, respectively. One end of the right optical image display unit 26 and one end of the left optical image display unit 28 are connected to each other at a position corresponding to the eyebrow of the user when the user wears the image display unit 20.

  The right holding unit 21 extends from the end ER which is the other end of the right optical image display unit 26 to a position corresponding to the user's temporal region when the user wears the image display unit 20. It is a member. Similarly, the left holding unit 23 extends from the end EL which is the other end of the left optical image display unit 28 to a position corresponding to the user's temporal region when the user wears the image display unit 20. It is a member provided. The right holding unit 21 and the left holding unit 23 hold the image display unit 20 on the user's head like a temple of glasses.

  The right display drive unit 22 and the left display drive unit 24 are disposed on the side facing the user's head when the user wears the image display unit 20. The right display drive unit 22 and the left display drive unit 24 are collectively referred to simply as “display drive unit”, and the right optical image display unit 26 and the left optical image display unit 28 are simply referred to as “optical image display unit”. Also called.

The display driving units 22 and 24 include liquid crystal displays 241 and 242 (hereinafter referred to as “LCDs 241 and 242”), projection optical systems 251 and 252 described later with reference to FIGS.
The right optical image display unit 26 and the left optical image display unit 28 include light guide plates 261 and 262 (FIG. 2) and a light control plate 20A. The light guide plates 261 and 262 are formed of a light transmissive resin or the like, and guide the image light output from the display driving units 22 and 24 to the user's eyes. The light control plate 20A is a thin plate-like optical element, and is disposed so as to cover the front side of the image display unit 20 which is the side opposite to the user's eye side. As the light control plate 20A, various materials such as a material that has almost no light transmission, a material that is nearly transparent, a material that attenuates the amount of light and transmits light, and a material that attenuates or reflects light of a specific wavelength may be used. it can. By appropriately selecting the optical characteristics (light transmittance, etc.) of the light control plate 20A, the external light amount incident on the right optical image display unit 26 and the left optical image display unit 28 from the outside is adjusted to visually recognize the virtual image. You can adjust the ease. In the present embodiment, a case will be described in which at least a light control plate 20A having a light transmittance that allows a user wearing the HMD 100 to visually recognize an outside scene is described. The light control plate 20A protects the right light guide plate 261 and the left light guide plate 262, and suppresses damage to the right light guide plate 261 and the left light guide plate 262, adhesion of dirt, and the like.
The dimming plate 20A may be detachable from the right optical image display unit 26 and the left optical image display unit 28, or may be mounted by replacing a plurality of types of dimming plates 20A, or may be omitted. .

The camera 61 is disposed at the center position on the front surface of the image display unit 20. The camera 61 is a digital camera that includes an imaging element such as a CCD or CMOS, an imaging lens, and the like. The camera 61 may be a stereo camera. The camera 61 images at least a part of the outside scene (real space) in the front side direction of the HMD 100, in other words, the user's viewing direction when the HMD 100 is worn. In another expression, the camera 61 captures a range or direction that overlaps the user's field of view, and captures the direction in which the user gazes. Although the angle of view of the camera 61 can be set as appropriate, in the present embodiment, as will be described later, the camera 61 includes the outside world visually recognized through the right optical image display unit 26 and the left optical image display unit 28. Furthermore, it is more preferable that the imaging range of the camera 61 is set so that the entire field of view of the user through the light control plate 20A can be imaged.
The camera 61 executes imaging in accordance with the control of the imaging control unit 161 (FIG. 4) provided in the control unit 140, and outputs captured image data to the imaging control unit 161.

Here, the HMD 100 may include a distance sensor (not shown) that detects a distance to a measurement object positioned in a preset measurement direction. The distance sensor is disposed, for example, at the boundary between the right optical image display unit 26 and the left optical image display unit 28. In this case, when the user wears the image display unit 20, the position of the distance sensor 64 is substantially in the middle of both eyes of the user in the horizontal direction and above the eyes of the user in the vertical direction. is there. The measurement direction of the distance sensor 64 can be a direction that overlaps the imaging direction of the camera 61 in the front side direction of the HMD 100, for example.
The distance sensor can be configured to include, for example, a light source such as an LED or a laser diode, and a light receiving unit that receives reflected light that is reflected from the light to be measured. The distance sensor may perform a triangulation process or a distance measurement process based on a time difference according to the control of the control unit 140. The distance sensor may be configured to include a sound source that emits ultrasonic waves and a detection unit that receives ultrasonic waves reflected by the measurement object. In this case, the distance sensor may perform the distance measurement process based on the time difference until the reflection of the ultrasonic wave according to the control of the control unit 140.

FIG. 2 is a principal plan view showing the configuration of the optical system provided in the image display unit 20. FIG. 2 shows the user's left eye LE and right eye RE for explanation.
The left display driving unit 24 includes a left backlight 222 having a light source such as an LED and a diffusion plate, a transmissive left LCD 242 disposed on an optical path of light emitted from the diffusion plate of the left backlight 222, and a left LCD 242. A left projection optical system 252 including a lens group that guides the image light L that has passed through the lens. The left LCD 242 is a transmissive liquid crystal panel in which a plurality of pixels are arranged in a matrix.

The left projection optical system 252 includes a collimator lens that converts the image light L emitted from the left LCD 242 into a light beam in a parallel state. The image light L converted into a parallel light beam by the collimator lens is incident on the left light guide plate 262. The left light guide plate 262 is a prism formed with a plurality of reflecting surfaces that reflect the image light L, and the image light L is guided to the left eye LE side through a plurality of reflections inside the left light guide plate 262. The left light guide plate 262 is formed with a half mirror 262A (reflection surface) positioned in front of the left eye LE.
The image light L reflected by the half mirror 262A is emitted from the left optical image display unit 28 toward the left eye LE, and this image light L forms an image on the retina of the left eye LE so that the user can visually recognize the image.

  The right display driving unit 22 is configured to be symmetrical with the left display driving unit 24. The right display driving unit 22 includes a right backlight 221 having a light source such as an LED and a diffusion plate, a transmissive right LCD 241 disposed on an optical path of light emitted from the diffusion plate of the right backlight 221, and a right LCD 241. A right projection optical system 251 including a lens group that guides the image light L that has passed through the lens. The right LCD 241 is a transmissive liquid crystal panel in which a plurality of pixels are arranged in a matrix.

The right projection optical system 251 includes a collimator lens that converts the image light L emitted from the right LCD 241 into a light beam in a parallel state. The image light L converted into a parallel light beam by the collimator lens is incident on the right light guide plate 261. The right light guide plate 261 is a prism formed with a plurality of reflecting surfaces that reflect the image light L, and the image light L is guided to the right eye RE side through a plurality of reflections inside the right light guide plate 261. The right light guide plate 261 is formed with a half mirror 261A (reflection surface) located in front of the right eye RE.
The image light L reflected by the half mirror 261A is emitted from the right optical image display unit 26 toward the right eye RE, and this image light L forms an image on the retina of the right eye RE to make the user visually recognize the image.

  The image light L reflected by the half mirror 261A and the external light OL transmitted through the light control plate 20A are incident on the right eye RE of the user. The image light L reflected by the half mirror 262A and the external light OL transmitted through the light control plate 20A are incident on the left eye LE. In this way, the HMD 100 superimposes the image light L of the internally processed image and the external light OL on the user's eyes and allows the user to see the external scene through the light control plate 20A. The image by the image light L is visually recognized. As described above, the HMD 100 functions as a see-through display device.

  The left projection optical system 252 and the left light guide plate 262 are collectively referred to as “left light guide unit”, and the right projection optical system 251 and the right light guide plate 261 are collectively referred to as “right light guide unit”. The configuration of the right light guide and the left light guide is not limited to the above example, and any method can be used as long as a virtual image is formed in front of the user's eyes using image light. It may be used, or a semi-transmissive reflective film may be used.

  The image display unit 20 is connected to the control device 10 via the connection cable 40. The connection cable 40 includes a connector 46, and an earphone microphone having a right earphone 32, a left earphone 34, and a microphone 63 can be connected to the connector 46.

  For example, as shown in FIG. 1, the microphone 63 is arranged so that the sound collecting unit of the microphone 63 faces the user's line of sight, collects sound, and sends the sound signal to the sound processing unit 187 (FIG. 4). Output. For example, the microphone 63 may be a monaural microphone or a stereo microphone, may be a directional microphone, or may be an omnidirectional microphone.

  The connection cable 40 is fixedly connected to the image display unit 20, and is connected to the control device 10 so as to be able to contact and separate from a connector (not shown). The control device 10 and the image display unit 20 transmit and receive various signals and / or various data via the connection cable 40.

  The control device 10 controls the HMD 100. The control device 10 includes a key operation unit 11, an LED indicator 12, a track pad 14, an up / down key 15, a changeover switch 16, and a power switch 18 as an operation unit 111 (FIG. 4).

The key operation unit 11 includes a menu key, a home key, a return key, and the like for operating the operating system 150 (FIG. 4) executed by the control device 10.
The LED indicator 12 lights up or flashes in accordance with the operating state of the HMD 100. The up / down key 15 is used to input an instruction to increase / decrease the volume output from the right earphone 32 and the left earphone 34 and to input an instruction to increase / decrease the display brightness of the image display unit 20. The changeover switch 16 is a switch for changing an input corresponding to the operation of the up / down key 15. The power switch 18 is a switch for switching on / off the power of the HMD 100, and is configured by a slide switch, for example.

  The track pad 14 has an operation surface for detecting a contact operation, and outputs an operation signal according to an operation on the operation surface. The detection method on the operation surface is not limited, and an electrostatic method, a pressure detection method, an optical method, or the like can be adopted.

  3A and 3B are diagrams illustrating a configuration of a main part of the image display unit 20, where FIG. 3A is a main part perspective view of the image display unit 20 viewed from the user's head side, and FIG. 3B is an angle of view of the camera 61. It is explanatory drawing of. Note that the connection cable 40 is not shown in FIG.

FIG. 3A shows the side of the image display unit 20 in contact with the user's head, in other words, the side visible to the user's right eye RE and left eye LE. In other words, the back sides of the right optical image display unit 26 and the left optical image display unit 28 are visible.
In FIG. 3A, the half mirror 261A that irradiates the user's right eye RE with the image light and the half mirror 262A that irradiates the left eye LE with the image light appear as substantially rectangular areas. Further, the entire right optical image display unit 26 and left optical image display unit 28 including the half mirrors 261A and 262A transmit external light as described above. For this reason, the user sees the outside scene through the entire right optical image display unit 26 and left optical image display unit 28, and visually recognizes a rectangular display image at the positions of the half mirrors 261A and 262A.

  The camera 61 is arranged at the center position on the front surface of the image display unit 20 as described above, and images the direction in which both eyes of the user face, that is, the front for the user. FIG. 3B is a diagram schematically showing the position of the camera 61 in plan view together with the user's right eye RE and left eye LE. An angle of view (imaging range) of the camera 61 is indicated by C. FIG. 3B shows a horizontal angle of view C, but the actual angle of view of the camera 61 extends in the vertical direction as in a general digital camera.

The angle of view C includes the direction directly in front of the center position of the image display unit 20. For example, as shown in FIG. 3B, when the object OB is in the front direction of the image display unit 20, the object OB is included in the angle of view C. For this reason, the object OB appears in the captured image of the camera 61. Here, when the user gazes at the object OB, the user's line of sight is directed toward the object OB as indicated by reference signs RD and LD in the figure. In general, the viewing angle of a human is about 200 degrees in the horizontal direction and about 125 degrees in the vertical direction. Among them, the effective field of view with excellent information receiving ability is about 30 degrees in the horizontal direction and about 20 degrees in the vertical direction. Furthermore, the stable gaze field in which the gaze point that the human gazes at appears to be quickly and stably is about 60 to 90 degrees in the horizontal direction and about 45 to 70 degrees in the vertical direction.
Therefore, when the gazing point is the object OB, the effective visual field is about 30 degrees in the horizontal direction and about 20 degrees in the vertical direction around the lines of sight RD and LD, 60 to 90 degrees in the horizontal direction, and 45 degrees in the vertical direction. A stable viewing field of about ˜70 degrees is about 200 degrees in the horizontal direction and about 125 degrees in the vertical direction.

In addition, an actual field of view (FOV: Field Of View) is the actual field of view that the user wearing the HMD 100 sees through the image display unit 20 and the right optical image display unit 26 and the left optical image display unit 28. Call it. In the configuration of the present embodiment shown in FIGS. 1 and 2, the real field of view corresponds to an actual field of view that the user sees through the right optical image display unit 26 and the left optical image display unit 28. The real field of view is narrower than the viewing angle and stable focus field described with reference to FIG.
The camera 61 preferably has an angle of view that can capture a wider range than the field of view of the user. Specifically, the angle of view C is preferably at least wider than the effective field of view of the user. Further, it is more preferable that the angle of view C is wider than the actual field of view of the user. More preferably, the angle of view C is wider than the stable viewing field of the user, and most preferably, the angle of view C is wider than the viewing angle of the user.

  The camera 61 may include a so-called wide-angle lens as an imaging lens so that a wide angle of view can be captured. The wide-angle lens may include a lens called a super-wide-angle lens or a quasi-wide-angle lens, may be a single focus lens or a zoom lens, and the camera 61 includes a lens group including a plurality of lenses. There may be.

FIG. 4 is a functional block diagram of each part constituting the HMD 100.
The HMD 100 includes an interface 114 for connecting various external devices OA that are content supply sources. For example, an interface corresponding to a wired connection such as a USB interface, a micro USB interface, a memory card interface, or the like may be used as the interface 114, and the interface 114 may be configured by a wireless communication interface. The external device OA is an image supply device that supplies an image to the HMD 100, and a personal computer (PC), a mobile phone terminal, a portable game machine, or the like is used.

The control device 10 includes a control unit 140, an input information acquisition unit 110, and a storage unit 120.
The input information acquisition unit 110 is connected to the operation unit 111. The operation unit 111 includes the key operation unit 11, the track pad 14, the up / down key 15, and the changeover switch 16 as described above. The input information acquisition unit 110 receives a user operation based on a signal input from the operation unit 111. The input information acquisition unit 110 outputs data indicating the operation content in the operation unit 111 to the control unit 140. Further, the input information acquisition unit 110 may control lighting, blinking, and extinguishing of the LED indicator 12 (FIG. 1) according to the control of the control unit 140.
The control device 10 includes a power supply unit 130 and supplies power from the power supply unit 130 to each unit of the control device 10 and the image display unit 20. The power supply state from the power supply unit 130 is controlled by the control unit 140 according to the operation of the power switch 18 (FIG. 1) and the execution status of the program executed by the control unit 140.

The storage unit 120 is a nonvolatile storage device, and stores various computer programs and data related to these programs. This program includes a program for realizing the control method of the present invention.
The storage unit 120 may store still image data or moving image data to be displayed on the image display unit 20. In addition, the storage unit 120 stores setting data 121. The setting data 121 includes various setting values used by the control unit 140. The setting value included in the setting data 121 may be a value input in advance by the operation of the operation unit 111, or may be a setting value from an external device OA or another device (not shown) via the communication unit 117 or the interface 114. May be received and stored.

  The storage unit 120 also stores content data 122 and display setting data 123. The content data 122 includes image data of an image displayed by the image display unit 20 under the control of the control unit 140, such as a still image or a moving image. The content data 122 may include audio data. The content data 122 may include image data of a plurality of images. In this case, the plurality of images are not limited to images displayed on the image display unit 20 at the same time. The display setting data 123 will be described later.

A GPS 115 and a communication unit 117 are connected to the control unit 140.
The GPS 115 includes an antenna (not shown), receives a GPS (Global Positioning System) signal, and calculates the current position of the control device 10. The GPS 115 outputs the current position and the current time obtained based on the GPS signal to the control unit 140. The GPS 115 may have a function of acquiring the current time based on information included in the GPS signal and correcting the time counted by the control unit 140.

The communication unit 117 executes wireless data communication conforming to a standard such as a wireless LAN (WiFi (registered trademark)), Miracast (registered trademark), or Bluetooth (registered trademark).
When the external device OA is wirelessly connected to the communication unit 117, the control unit 140 acquires content data from the communication unit 117 and causes the image display unit 20 to display an image. On the other hand, when the external device OA is wired to the interface 114, the control unit 140 acquires content data from the interface 114 and causes the image display unit 20 to display an image. The communication unit 117 and the interface 114 function as a data acquisition unit DA that acquires content data from the external device OA.

  The control unit 140 stores a CPU (not shown) for executing a program, a RAM (not shown) for temporarily storing a program and data executed by the CPU, and a basic control program and data executed by the CPU in a nonvolatile manner. ROM (not shown). The control unit 140 reads and executes a computer program stored in the storage unit 120, and operates an operating system (OS) 150, an image processing unit 160, an imaging control unit 161, a motion detection unit 163, an AR display control unit 164, and a communication control unit. 170, functions as a sound processing unit 187 and a display control unit 190.

The image processing unit 160 generates a signal to be transmitted to the right display driving unit 22 and the left display driving unit 24 based on the image data of the content displayed by the image display unit 20. The signal generated by the image processing unit 160 may be a vertical synchronization signal, a horizontal synchronization signal, a clock signal, an analog image signal, or the like.
Further, the image processing unit 160 may perform resolution conversion processing for converting the resolution of the image data to a resolution suitable for the right display driving unit 22 and the left display driving unit 24 as necessary. The image processing unit 160 also performs image adjustment processing for adjusting the brightness and saturation of image data, 2D image data is created from 3D image data, or 2D / 3D conversion processing is performed to generate 3D image data from 2D image data. May be executed. When these image processes are executed, the image processing unit 160 generates a signal for displaying an image based on the processed image data, and transmits the signal to the image display unit 20 via the connection cable 40.

  The display control unit 190 generates a control signal for controlling the right display drive unit 22 and the left display drive unit 24, and generates and generates image light by each of the right display drive unit 22 and the left display drive unit 24 based on the control signal. Control injection. Specifically, the right LCD 241 is controlled to be turned on / off by the right LCD control unit 211, and the right backlight 221 is turned on / off by the right backlight control unit 201. Further, the display control unit 190 controls the driving of the left LCD 242 by the left LCD control unit 212 and the driving of the left backlight 222 by the left backlight control unit 202.

  The imaging control unit 161 controls the camera 61 to execute imaging, generates captured image data, and temporarily stores the captured image data in the storage unit 120. When the camera 61 is configured as a camera unit including a circuit that generates captured image data, the imaging control unit 161 acquires captured image data from the camera 61 and temporarily stores the captured image data in the storage unit 120.

  The audio processing unit 187 acquires an audio signal included in the content, amplifies the acquired audio signal, and outputs the amplified audio signal to the right earphone 32 and the left earphone 34. In addition, the sound processing unit 187 acquires sound collected by the microphone 63 and converts it into digital sound data. The voice processing unit 187 may perform a preset process on the digital voice data.

  The image display unit 20 includes a camera 61. The image display unit 20 includes an interface 25, a right display drive unit 22, a left display drive unit 24, a right light guide plate 261 as the right optical image display unit 26, a left light guide plate 262 as the left optical image display unit 28, and , A nine-axis sensor 66 is provided.

  The nine-axis sensor 66 is a motion sensor (inertial sensor) that detects acceleration (three axes), angular velocity (three axes), and geomagnetism (three axes). The 9-axis sensor 66 may be a sensor unit in which a plurality of sensors are integrated. The control unit 140 can detect the movement of the user's head based on the detection value of the 9-axis sensor 66 in a state where the image display unit 20 is mounted on the user's head.

The interface 25 is connected to the control device 10 by a connection cable 40 and outputs various data and signals transmitted by the control device 10 to the right display drive unit 22 and the left display drive unit 24. Further, the interface 25 outputs a control signal transmitted from the display control unit 190 to the corresponding right backlight control unit 201 or left backlight control unit 202.
The interface 25 connects the camera 61 and the 9-axis sensor 66 to the control device 10. The imaging data of the camera 61, the acceleration (three axes), the angular velocity (three axes), and the geomagnetism (three axes) detected by the nine-axis sensor 66 are sent to the control unit 140 via the interface 25.

The right display drive unit 22 includes the right backlight 221, the right LCD 241, and the right projection optical system 251 described above. The right display drive unit 22 includes a right backlight (BL) control unit 201 that controls the right backlight (BL) 221 and a right LCD control unit 211 that drives the right LCD 241.
The right backlight control unit 201 drives the right backlight 221 in accordance with a control signal transmitted from the display control unit 190. The right LCD control unit 211 drives the right LCD 241 based on the signal transmitted from the image processing unit 160 and the signal transmitted from the display control unit 190.

  The left display drive unit 24 has the same configuration as the right display drive unit 22. The left display driving unit 24 includes the left backlight 222, the left LCD 242 and the left projection optical system 252 described above. The left display drive unit 24 includes a left backlight control unit 202 that drives the left backlight 222 and a left LCD control unit 212 that drives the left LCD 242.

The left backlight control unit 202 drives the left backlight 222 according to the control signal transmitted from the display control unit 190. The left LCD control unit 212 drives the left LCD 242 based on the signal transmitted from the image processing unit 160 and the signal transmitted from the display control unit 190.
The right backlight control unit 201, the right LCD control unit 211, the right backlight 221 and the right LCD 241 are collectively referred to as a right “image light generation unit”. Similarly, the left backlight control unit 202, the left LCD control unit 212, the left backlight 222, and the left LCD 242 are collectively referred to as a left “image light generation unit”.

  The HMD 100 is configured to allow a user to visually recognize a plurality of images having different parallaxes, and at least some of the plurality of images give different motion stimuli. The image visually recognized by the user includes an image displayed by the image display unit 20 and a real space visually recognized by external light transmitted through the image display unit 20. In other words, the HMD 100 causes the user to visually recognize a plurality of areas including at least one of an image displayed by the image display unit 20 and a real space visually recognized by external light transmitted through the image display unit 20. One of the areas is a first area and the other is a second area. The user may visually recognize areas other than the first and second areas, and there is no upper limit on the number of areas.

  Here, the exercise stimulus refers to a stimulus that reminds the user of a sense of movement, and more specifically, an exercise stimulus that makes the user feel that he / she is moving, and the user himself / herself is stationary. Includes a static stimulus that makes you feel like you are.

  The first region is a region that gives a motion stimulus to the user, and the second region is a region that gives a static stimulus. When the image displayed by the image display unit 20 is the first region, the control unit 140 causes the image display unit 20 to display an image that moves relative to the user's line of sight. The first region may be a real space that is visually recognized by external light. That is, this is a case where the visual field of the user moves relative to the real space, and specifically, a case where the user is moving. Further, when the image displayed by the image display unit 20 is the second region, the control unit 140 does not move relative to the user's visual field by the image display unit 20, or the amount of movement per unit time, In other words, the image is displayed so that the moving speed is within a predetermined range. The second region may be a real space that is visually recognized by external light. That is, this is a case where the user's line of sight does not move relative to the real space or the movement speed is within a predetermined range. Specifically, this is a case where the user is not moving.

  When the action of the visual motion stimulus is generated, the distance from the user perceived by the user is different between the first area and the second area. The distance from the user's right eye RE and left eye LE to the first area and the distance from the right eye RE and left eye LE to the second area are perceived as different distances. When the first and second regions are real space images, the distance perceived by the user is the distance from the user to the real space. When the first and second regions are images displayed by the image display unit 20, the distance perceived by the user corresponds to the left and right parallax of the image. When the control unit 140 causes the image display unit 20 to display an image with large left and right parallaxes, the user perceives the display image at a close position and causes the image display unit 20 to display an image with small left and right parallaxes. The user perceives the displayed image in the distance.

FIG. 5 is an explanatory diagram of the action of visual motion stimulation. FIG. 5A shows an example in which the foreground FV and the background RV are visually recognized, and FIG. 5B allows the image to be viewed with a wide viewing angle. An example is shown, and FIG. 5C shows an example in which an image is visually recognized at a normal viewing angle.
In the example shown in FIG. 5A, the user visually recognizes the foreground FV and the background RV. The foreground FV may be an image displayed by the image display unit 20 or may be an object OB existing in real space. Further, the background RV may be an image displayed by the image display unit 20, or may be an outside scene (scenery) in real space.

In the example of FIG. 5A, when the background RV is a first region that gives a motion stimulus and the foreground FV is a second region that gives a static stimulus, the user senses that he is moving (self-motion). Perception. That is, exercise stimulation is given to the user.
Further, in the example of FIG. 5A, when the foreground FV is the first region that gives the motion stimulus and the background RV is the second region that gives the static stimulus, the user is not moving (stops). Perceived). That is, a motion stimulus that gives the user a perception of stillness is given.
When the movement stimulus given to the user is different from the actual movement of the user's body, the movement sensation that the user feels visually corresponds to a kind of illusion.

The motion stimulation of the first region is a movement with respect to the user's visual field, and is not necessarily a movement with respect to the user's line of sight. Even if the first region does not change at the intersection of the lines of sight RD and LD and the first region, if the image moves in the field of view (field of view) of the right eye RE and the left eye LE, the user is subjected to a motion stimulus. Is given. When there is an image movement at the intersection of the lines of sight RD and LD and the first region, the image movement is present in the field of view of the right eye RE and the left eye LE, so that the user is given a motion stimulus.
That is, the case where the image of the first region gives a motion stimulus is the case where the relative position of the image with respect to the field of view changes at least in part or all of the user's field of view, or the image with respect to the field of view. Is moving.

When the image of the second region gives a static stimulus, the change in the relative position of the image with respect to the field of view or the relative movement of the image with respect to the field of view is at least a predetermined range of the visual field of the user. This is the case. The predetermined ratio is, for example, half or more of the field of view, and preferably 70% or more. For example, when the foreground FV is a first region that gives a motion stimulus and the background RV is a second region that gives a static stimulus, the proportion of the user's visual field occupied by the second region is a predetermined rate or more. A stationary stimulus is more reliably applied, and a motion stimulus due to the movement of the first region is noticeable. The predetermined range of motion corresponds to the amount of motion per unit time of the image, that is, the speed of motion being equal to or less than a set upper limit.
That is, when the HMD 100 performs display so that the foreground FV and the background RV are visually recognized, the foreground FV is a first region that gives a motion stimulus, and the background RV is a second region that gives a static stimulus. Assume a case. In this case, it is preferable that the ratio of the background RV, which is the second region, in the user's visual field is equal to or greater than a predetermined ratio. In this case, it is possible to perform a display that easily induces a static stimulus to the user wearing the HMD 100. In this case, the user wears the HMD 100 and visually recognizes the foreground FV and the background RV. For example, the user feels that the user is stationary and watching the movement of the foreground FV. Can be displayed.
On the other hand, when the foreground FV and the background RV are visually recognized by the user and the foreground FV is used as the second area and the foreground FV gives a static stimulus, the foreground FV occupying the user's field of view (second area) The ratio may be a predetermined ratio or less. In this case, the ratio of the background RV occupying the user's field of view can be secured at a certain ratio or more. Therefore, it is easy to ensure exercise stimulation by the background RV (first region). The predetermined ratio in this case may be, for example, 80% or less of the field of view, more preferably 70% or less, and still more preferably 50% or less.
That is, when the HMD 100 performs display so that the foreground FV and the background RV are visually recognized, the background RV is a first region that gives a motion stimulus, and the foreground FV is a second region that gives a static stimulus. Assume a case. In this case, it is preferable that the proportion of the foreground FV that is the second region in the user's visual field is equal to or less than a predetermined proportion. In this case, it is possible to perform a display that easily induces a static stimulus to the user wearing the HMD 100. In this case, the user wears the HMD 100 and visually recognizes the foreground FV and the background RV. For example, the user feels that the user is stationary and watching the movement of the background RV. Can be displayed.
In these cases, the foreground FV may be an image displayed by the image display unit 20, and the background RV may be configured to be visually recognized by the user with external light transmitted through the image display unit 20. In addition, the background RV may be an image displayed by the image display unit 20, and the foreground FV may be configured to be visually recognized by the user with external light transmitted through the image display unit 20.

  In addition, when there is movement in both the first area and the second area, if the amount of movement (speed) per unit time of the first area is larger than that in the second area, the first area is subjected to exercise stimulation. The second region can provide a static stimulus. In this case, it is preferable that the difference in the amount of movement (speed) per unit time between the first area and the second area is a predetermined value or more.

  When the image display unit 20 displays an image corresponding to the foreground FV and an image corresponding to the background RV by the image display unit 20, the control unit 140 controls the movement of the foreground FV and the background RV to allow the user to visually move. Can give irritation.

  6 is a diagram illustrating a display example of the HMD 100. FIG. 6A illustrates an example in which the game image GV and the background image BV are displayed. FIG. 6B illustrates an example in which the game image GV is displayed. FIG. 6C shows an example of displaying the background image BV.

In the example of FIG. 6A, the image display unit 20 displays the game image GV as the foreground FV (FIG. 5A) and the background image BV as the background RV (FIG. 5A) under the control of the control unit 140. )).
In this example, the control unit 140 executes the game program, advances the game according to the user's operation on the control device 10, and displays a game image GV corresponding to the progress of the game.
In addition, the control unit 140 displays a background image BV that is viewed farther than the game image GV. The background image BV is an image displayed based on the background image data as described above. In order to further improve the sense of presence, the control unit 140 may display the background image BV based on the real space. In this case, the control unit 140 acquires a captured image of the camera 61, thereby acquiring an outside scene image in real space in the user's line-of-sight direction. The control unit 140 performs a process of providing parallax based on the captured image of the camera 61, generates image data of the background image BV, and causes the image display unit 20 to display the image data.

  In the example of FIG. 6A, the image display unit 20 displays both the game image GV visually recognized by the user as the foreground FV and the background image BV visually recognized by the user as the background RV by the control of the control unit 140. To do. For this reason, the control part 140 can control the visual motion stimulus given to a user. For example, when executing a game that increases the sense of presence by giving a sense of movement to the user, such as an action game or a racing game, and enhances the excitement, the control unit 140 displays the game image GV and the background image BV. A motor stimulus is given by a combination of movements. In this case, the control unit 140 gives a motion stimulus by the background image BV and gives a static stimulus by the game image GV. When the game image GV may move due to the progress of the game, the control unit 140 performs a process of changing the background image BV at a faster speed than the game image GV. Thereby, the user can play an action game, a racing game, etc. with a higher sense of reality.

  Further, in this case, it is less likely that the user is sick of video, compared to a case where the video visually recognized by the user by the image display unit 20 is a 3D video and the 3D video is moved greatly. This is because the user visually recognizes the background RV (background image BV) in addition to the game image GV. In other words, the user perceives that the game image GV is moving by comparing the background image BV and the game image GV. However, since the entire field of view is unlikely to move uniformly, an excessive immersive feeling is felt. Hard to occur. For this reason, the occurrence of video sickness can be suppressed.

  The game unit executed by the control unit 140 is stored in the storage unit 120 as the content data 122. Further, the background image BV data displayed by the control unit 140 may be stored as the content data 122.

  In the example of FIG. 6A, the control unit 140 may display the game image GV as the first area and the background image BV as the second area. In this case, it is only necessary that the movement of the background image BV is small or the movement speed of the background image BV is lower than that of the game image GV. In this case, a stationary stimulus can be given to the user. For example, when the user plays a puzzle game with the HMD 100, or when watching a movie, when the user is effective to give the user a feeling of being at rest and increase comfort, the control unit 140 A static stimulus is given by a combination of the movement of the image GV and the background image BV.

  In addition, when the real space is visually recognized as an outside scene in the direction of the user's line of sight RD or LD, the control unit 140 causes the image display unit 20 to display an image visually recognized as the foreground FV in front of the outside scene. Specifically, the control unit 140 generates image data for foreground using image data of an image visually recognized as the foreground FV. The foreground image data is composed of image data for the right eye displayed on the right optical image display unit 26 and image data for the left eye displayed on the left optical image display unit 28. The image data for the left eye has a parallax. The control unit 140 sets the parallax of the foreground image data to a parallax that is perceived at a position closer to the real space, and generates the foreground image data.

  The foreground FV displayed by the image display unit 20 is preferably viewed more clearly than in real space. Therefore, the control unit 140 sets the display brightness of the image displayed as the foreground FV to be higher than the external light OL (FIG. 2) that the user sees through the image display unit 20. Further, the visibility of the foreground FV may be improved by performing a process such as increasing the saturation. Thus, the process for improving the visibility of the foreground FV is effective when the user is gazing at the foreground FV. In addition, as an example of a technique or configuration for improving the visibility of the foreground FV, a light control shade configured using a transmissive liquid crystal or the like is included. In this case, by changing the transmittance of the light control shade for each pixel, for example, the transmission amount of the external light OL can be adjusted, and thereby the visibility of the foreground FV can be adjusted. For example, the visibility of the foreground FV can be relatively increased by reducing the transmittance of the light control shade to reduce the amount of external light OL.

  Further, for example, when the user is gazing at the background RV, a process for increasing the visibility of the background RV as compared to the foreground FV may be performed. This process includes various processes that result in an increase in the visibility of the background RV. For example, when the background RV is configured by the display of the image display unit 20 instead of the external light OL, the visibility is improved by performing processing such as increasing the display luminance of the background RV and increasing the brightness and / or saturation of the display color. May be increased. Further, a process of relatively increasing the visibility of the background RV compared to the foreground FV may be performed. For example, a process of reducing the visibility of the foreground FV so that the foreground FV does not hinder the visibility of the background RV. You may go. Specifically, the foreground FV image is reduced by reducing the display brightness of the foreground FV, reducing the brightness and / or saturation of the display color, reducing the occupied area of the foreground FV in the user's visual field VR, and For example, processing such as disposing at a position more than a predetermined distance around the line of sight.

Here, the control unit 140 determines whether the user is watching the foreground FV or the background RV, and increases the visibility of the foreground FV as described above, and the viewing of the background RV. Any of the processes for improving the performance may be selected and executed. In this case, the specific mode of detecting the user's line-of-sight direction is not limited. For example, a line-of-sight sensor that detects the direction of the line of sight by imaging the user's eyes is provided, and the control unit 140 determines the detection value of the line-of-sight sensor. A line of sight may be detected. A pair of the line-of-sight sensors may be provided at the center positions of the right optical image display unit 26 and the left optical image display unit 28 so as to correspond to the right eye RE and the left eye LE of the user. Further, for example, the eye gaze may be estimated by measuring the eye potential of the user's eye or the myoelectric potential of the eye muscle and detecting the eye movement. Further, the control unit 140 may specify the line-of-sight direction based on the captured image of the camera 61 and the movement of the image display unit 20 detected by the 9-axis sensor 66.
In addition, as an example of a configuration for determining whether the user is gazing at the foreground FV or the background RV, the gazes of the left eye and the right eye are estimated, and two gazes (both eyes gaze) are estimated. Based on the intersection of the two, there is a configuration in which the distance from “the position of the user” to “the place where the user is looking with both eyes” is obtained. In this case, based on the obtained distance, it can be determined whether the user is looking at the foreground or the background. Here, the position of the user is determined in advance as a reference for the position of the user, such as the position of each eye of the user, the position of the center or front of the user's head, the position of the image display unit 20, and the position of the camera 61. It may be a predetermined position.

Thus, the control unit 140 can display the display image of the image display unit 20 as an image of the foreground FV located closer to the real space.
A display example in this case is shown in FIG.
In the example of FIG. 6B, the control unit 140 executes the game program, advances the game according to the user's operation on the control device 10, and displays a game image GV corresponding to the progress of the game. Further, the user views the background RV through the image display unit 20. The background RV is a view of the real space that can be seen through the image display unit 20.

  In the example of FIG. 6B, the image display unit 20 displays the game image GV visually recognized by the user as the foreground FV under the control of the control unit 140. For this reason, the control part 140 can give a motion stimulus by the foreground FV. When the user is stationary and the background RV is not moving, the user receives a stationary stimulus regardless of the movement of the game image GV. In addition, the control unit 140 determines that the movement of the user's body or the head is faster than a set threshold based on the captured image of the camera 61 or the detection value of the 9-axis sensor 66. The game image GV may be changed at a higher speed than the movement. In this case, a stationary stimulus can be applied even when the user moves. Here, in the case where the background image BV is displayed as an image as the second region for applying a static stimulus, the correspondence between the movement of the user's head and the background image BV visually recognized by the user is not delayed. Processing to move the background image BV may be performed. The movement of the background image BV in this case can be a movement that follows the movement of the head detected from the captured image of the 9-axis sensor 66 or the camera 61. In this case, the background image BV is stationary relative to the user's head, or the movement becomes small, and the effect of stabilizing the background image BV can be obtained, and so-called video sickness can be effectively suppressed or prevented. In addition, when the background image BV is displayed as an image as a first region that gives a motion stimulus, if the user's head is stationary or the amount of movement per short time is equal to or less than a predetermined value, the background image BV is set in advance. The background image BV is moved by the pattern. When the amount of movement of the user's head per unit time exceeds a predetermined value, the movement corresponding to the movement of the user's head is added to the preset pattern, and the background image BV You may move. Also in this case, since the movement of the video contrary to the movement of the user's head can be suppressed, so-called video sickness can be effectively suppressed or prevented.

Further, when there is an object OB in real space in the user's line of sight RD, LD, the control unit 140 displays an image that is visually recognized as the background RV of the object OB by the image display unit 20. An example of this is shown in FIG.
In the example of FIG. 6C, the object OB existing in the real space is visually recognized, and the control unit 140 displays the background image BV so as to be visually recognized as the background of the object OB.
For example, the control unit 140 generates background image data by cutting out a range that is visually recognized by overlapping the object OB from the image data of the background image BV. The control unit 140 displays an image based on the background image data while avoiding a range that overlaps the object OB. As a result of these processes, pixel data is in a non-display state (black pixel) in a region overlapping the object OB in the image data of the background image BV. Alternatively, the image data of the background image BV is not processed, and, for example, the light is blocked or the light source is turned off so that the image light L constituting the pixels in the region overlapping the object OB is not output or the amount of light is reduced. May be.
The background image data is composed of right-eye image data displayed on the right optical image display unit 26 and left-eye image data displayed on the left optical image display unit 28, and the right-eye image data. The data and the image data for the left eye have parallax. The control unit 140 sets the parallax of the background image data to a parallax that is perceived farther than the object OB, and generates background image data. Thereby, the control part 140 can visually recognize the background image BV which the image display part 20 displays as an image located far from the target object OB in real space.

  Here, when the object OB moves relative to the user's field of view or moves at a speed equal to or less than the set upper limit, the foreground FV is a second region that gives a stationary stimulus. In this case, if the control unit 140 displays the background image BV as an image having movement, the background image BV becomes the first region, and it is possible to give an exercise stimulus to the user. Further, if the background image BV is displayed as an image having no movement or an image whose movement speed is slower than that of the object OB, the background image BV becomes the second region, and a static stimulus can be given to the user. .

In addition, there is an example in which a single region is used as an example in which a user is given a motion stimulus visually.
For example, as shown in FIG. 5B, in a configuration in which the user visually recognizes the image V, when the viewing angle at which the user visually recognizes the image V is large, the user is given a motion stimulus by moving the image V. It is done. This effect is known to occur when the viewing angle at which the user views the image V is greater than or equal to a predetermined angle (for example, 120 degrees) for the right-eye viewing angle RA and the left-eye viewing angle LA. ing. The image V may be a real space field of view or an image displayed by the image display unit 20.

  Further, for example, as shown in FIG. 5C, when the user visually recognizes the image V and the user visually recognizes the image V, when the image V is stationary, the user is stationary. Perceive. This effect is known to occur when the viewing angle at which the user views the image V occupies most of the user's field of view.

In this way, the control unit 140 can control the visual motion stimulus given to the user by controlling the display on the image display unit 20.
The HMD 100 can be used without being limited to a state where the user is stationary. For example, the user may wear the HMD 100 while riding on a moving body such as an automobile, a bicycle, an aircraft, a ship, or a roller coaster. In this case, if the user can visually recognize the outside scenery, the real space visually recognized by the user moves, and the user perceives a sense of self-motion. In such a case, an interesting display can be performed by giving a static stimulus to the user. Moreover, it is possible to perceive a sense of self-motion by displaying on the image display unit 20 while the user is stationary.

  The motion detector 163 detects the movement of the user's body and / or the movement of the user's head. The motion detection unit 163 may detect motion by acquiring and analyzing a captured image of the camera 61. Further, the motion detection unit 163 may detect the motion based on the detection value by acquiring the detection value of the 9-axis sensor 66.

  The AR display control unit 164 controls display of the game image GV and the background image BV displayed by the image display unit 20. For the image displayed by the image display unit 20, the AR display control unit 164 displays an image for the right eye displayed by the right optical image display unit 26 corresponding to the right eye RE, and a left optical image corresponding to the left eye LE. Based on the parallax with the image for the left eye displayed on the display unit 28, image data for display is generated. For example, the AR display control unit 164 generates image data having a predetermined parallax based on the content data 122 stored in the storage unit 120 or the captured image of the camera 61 and displays the image data at the determined display position. The display control unit 190 is controlled.

  In addition, the AR display control unit 164 can determine the position where the user visually recognizes the object OB by analyzing the captured image of the camera 61 in the process of determining the display position of the image. In this case, the image of the object OB is extracted from the captured image of the AR display control unit 164 and the camera 61. In this process, for example, a feature amount of a captured image obtained by capturing the object OB is used. Data indicating the feature amount of the object OB is stored in advance in the storage unit 120 as setting data 121. The feature amount data includes, for example, a feature amount indicating the color, shape, and other features of a captured image when the object is captured when the target is an object. In this case, the AR display control unit 164 performs a process of extracting the object image from the captured image data of the camera 61, calculates the feature amount of the extracted object image, and includes the calculated feature amount and the setting data 121. Compared with the feature amount to be checked. When the feature values are close or the same, the object of the image extracted from the captured image data is recognized as the object OB. In addition, when the setting data 121 includes a plurality of feature amounts for the object OB, the AR display control unit 164 may detect and recognize the object OB from the captured image data based on the plurality of feature amounts.

  When the AR display control unit 164 detects the object OB, the AR display control unit 164 specifies the position of the object OB in the user's visual field VR. Furthermore, the AR display control unit 164 determines the display position of the image so that the image is visually recognized at a position corresponding to the object OB. In this process, the AR display control unit 164 includes the visual field VR, the positions of the half mirrors 261A and 262A that are display areas of the image display unit 20, the angle of view of the camera 61, and the position of the camera 61 in the captured image data. Use data indicating relative positional relationships. These relative positional relationships are determined by the mechanical structure of the image display unit 20 and the specifications of the camera 61. This positional relationship is obtained by prior calibration, and data indicating the positional relationship is stored as setting data 121.

  As illustrated in FIG. 6C, the AR display control unit 164 can display an image so as to avoid the object OB or to overlap the object OB. The image displayed in this way corresponds to an image that exhibits a so-called AR (Augmented Reality) effect (hereinafter referred to as an AR image).

FIG. 7 is a flowchart showing the operation of the HMD 100.
The control unit 140 of the HMD 100 receives an instruction to start displaying the content image based on the operation of the control device 10 and the like, and selects the content to be displayed (step S11). The control unit 140 selects any of the contents that can be displayed based on the content data 122 based on, for example, an operation on the control device 10.

The control unit 140 refers to the display setting data 123 corresponding to the content selected in step S11, and acquires settings related to exercise stimulation (step S12). The display setting data 123 includes data that specifies an image display form in association with each content included in the content data 122. Specifically, it includes data for setting whether to perform display that gives exercise stimulation or display that does not give exercise stimulation in association with the content.
By using the display setting data 123, settings suitable for the content can be performed with respect to visual motion stimulation. In addition, when the user selects the content, the content is displayed in a mode suitable for the content of the visual stimulus, so that the user can perform an effective display without performing complicated settings. There is.

Based on the setting acquired in step S12, the control unit 140 determines whether or not to perform a display that gives a motion stimulus, that is, a display that recalls a sense of self-motion (step S13).
When the display which recalls the sense of self-motion is performed (step S13; Yes), the control unit 140 determines whether or not the background visually recognized by the user is real space (step S14). For example, when the content includes image data of the background image BV, the image data is used as the background, so the background is not real space. When the content does not include the image data of the background image BV, the real space is used as the background. In other words, the background is real space.

  When the real space is used as the background, that is, when the background is the real space (step S14; Yes), the control unit 140 is visually recognized as the background by detecting the motion by the motion detection unit 163 of the camera 61. The presence / absence of movement in the real space is determined (step S15). When there is a motion in the background (step S15; Yes), if the foreground gives a static stimulus, a display reminiscent of a self-motion sensation can be performed. In this case, the control unit 140 displays the content image as the foreground FV (FIG. 5A) (step S16), and proceeds to step S25 described later.

  Further, when the background is a real space (step S14; Yes) and there is no movement in the background (step S15; No), it is necessary to move the background in order to perform a display reminiscent of the sense of self-motion. For this reason, the control unit 140 generates data of the background image BV (step S17). In this case, in step S <b> 17, the control unit 140 generates a background image BV serving as a background with motion based on the captured image data of the camera 61 in order to display a background with motion based on the real space. . Then, the control unit 140 displays the content image as the foreground FV and displays the background image as the background RV based on the data of the background image BV (step S18), and proceeds to step S25.

  If it is determined that the background is not real space (step S14; No), the control unit 140 proceeds to step S17 and performs the above processing. In this case, when the background is not a real space and an image included in the content is used as the background, in step S17, the control unit 140 generates data of the background image BV based on the image data of the content. When displaying an image corresponding to the real space as the background, the control unit 140 generates data of the background image BV based on the captured image in step S17.

Moreover, when the display which recalls a self-motion sensation is not performed (step S13; No), the control part 140 determines whether the background which a user visually recognizes is real space (step S19).
When the background is real space (step S19; Yes), the control unit 140 displays the content image as the foreground FV (step S20), and proceeds to step S25.

  When it determines with a background not being real space (step S19; No), the control part 140 displays foreground FV and background RV based on the image data contained in a content (step S21), and transfers to step S25.

  In step S25, the motion detection unit 163 detects the user's movement based on the captured image of the camera 61 or the detection value of the 9-axis sensor 66, and determines whether or not the user has performed a specific operation (step S25). The specific action is a specific action specified in advance, for example, when the user bows his / her head. The HMD 100 is set so as to shift to an operation mode for displaying a game manual (operation description) when the user performs a specific operation, an operation mode for displaying a function setting menu of the HMD 100, and setting a function. can do.

When it is determined that the specific operation has been performed (step S25; Yes), the control unit 140 switches to display the operation mode corresponding to the specific operation (step S26), and waits until the specific operation is completed (step S26). S27). The end of the specific operation can be determined based on the detection result of the motion detection unit 163. The control unit 140 continues the display in step S26 until the specific operation ends (step S27; No). When the specific operation is finished (step S27; Yes), the control unit 140 resumes the display of the content (step S28), and proceeds to step S29.
Moreover, when it determines with specific operation | movement not being performed (step S25; No), the control part 140 transfers to step S29.

  In step S29, the control unit 140 determines whether or not to end the content display (step S29). When the display end of the content is instructed by an operation on the control device 10 or the like (step S29; Yes), the control unit 140 ends this process. If the end of content display is not instructed (step S29; No), the control unit 140 returns to step S25.

As described above, the HMD 100 according to the embodiment to which the present invention is applied includes the image display unit 20. The HMD 100 is arranged on the image display unit 20 so that a user who visually recognizes the image display unit 20 can visually recognize the first region that gives the motion stimulus and the second region that gives the static stimulus so that the parallax is different. A control unit 140 that displays an image is provided.
According to the configuration of the HMD 100 and the control method for controlling the HMD 100, the first region that gives the motion stimulus and the second region that gives the static stimulus are combined so that the parallaxes are different, and the user perceives them. As a result, it is possible to enhance or weaken the user's sense of self-motion in a manner that does not rely on a single 3D image. For example, it is possible to display an image that easily induces a sense of reality, and to reduce image sickness. A user using the HMD 100 can view a realistic video display. This control method can also be realized as a program that can be executed by the CPU of the control unit 140. In this case, the program may be stored in a ROM (not shown) included in the control unit 140 or in the storage unit 120 in a mode that can be read by the CPU of the control unit 140.

  In the HMD 100, the control unit 140 displays an image on the image display unit 20 so that the viewing distance at which the user visually recognizes the first area is different from the viewing distance at which the user visually recognizes the second area. Display. Accordingly, various visual effects such as a display that easily induces a self-motion sensation or a display that hardly induces a user who views the HMD 100 by combining images or images perceived at different distances. A display having The user of the HMD 100 can see a display that enhances or weakens the sense of self-motion, for example.

  In the HMD 100, the control unit 140 causes the image display unit 20 to display an image so that the viewing distance of the second region is farther from the user than the first region. Thereby, the display that is easy to perceive to the user as if the second region that gives the static stimulus is farther than the first region that gives the motor stimulus, and the display that easily affects the user's own self-motion sense. it can. In this case, for example, the user can easily perceive that the second area is farther than the first area, and uses a feeling that the user himself / herself does not move while watching moving images and images. It can produce to the person.

  Further, in the HMD 100, the image display unit 20 is configured to be visible to the user through the outside scene, and the control unit 140 causes the image display unit 20 to overlap the outside scene as the second area. Display an image. Thereby, the display which is easy to influence a user's own self-motion sense can be performed using the outside scene which permeate | transmits and can be seen through the image display part 20. FIG. For a user who uses the HMD 100, for example, it is possible to produce a feeling that the user himself / herself is not moving while watching a moving image or image.

  In the HMD 100, the image display unit 20 is configured to be visible to the user through the outside scene, and the control unit 140 causes the image display unit 20 to overlap the image of the second area so as to overlap the outside scene as the first area. Is displayed. Thereby, the user can produce a sense that the user himself / herself is not moving while viewing a moving image or image using an outside scene that is visible through the image display unit 20.

  In the HMD 100, the control unit 140 causes the image display unit 20 to display each of the first area image and the second area image. Thus, by combining the images displayed by the HMD 100, it is possible to perform a display that easily affects the user's own self-motion sensation while watching a moving image or image. Thereby, for example, the user can produce a feeling that the user is not moving.

  In the HMD 100, the control unit 140 causes the image display unit 20 to display an image so that the viewing distance of the second area is closer to the user than the first area. This allows the user to perceive that the first region that gives the motor stimulus is farther than the second region that gives the static stimulus, thereby exerting an influence on the user's own self-motion sensation. Easy to give display. Thereby, for example, it is possible to produce a feeling that the user himself / herself exercises.

  Further, in the HMD 100, the image display unit 20 is configured to be visible to the user through the outside scene, and the control unit 140 causes the image display unit 20 to overlap the outside scene as the second area. Display an image. Thereby, the display which is easy to give the influence which exercise | moves with respect to a user using the external view visually permeate | transmitted through the image display part 20 can be performed. Thereby, for example, it is possible to produce a feeling that the user himself / herself exercises.

  Further, in the HMD 100, the image display unit 20 is configured to be visible to the user through the outside scene, and the control unit 140 causes the second area to be overlapped with the outside scene as the first area. An image may be displayed. In this case, it is possible to produce a feeling that the user himself / herself exercises by using an outside scene that is visible through the image display unit 20.

  In the HMD 100, the control unit 140 causes the image display unit 20 to display each of the first area image and the second area image. Thus, by combining the images displayed by the HMD 100, it is possible to perform a display that easily influences the user to exercise. Thereby, for example, it is possible to produce a feeling that the user himself / herself exercises.

  In the HMD 100, the control unit 140 may cause the image display unit 20 to display an image so that the ratio of the second region occupied by the user's visual field is equal to or greater than a predetermined ratio set in advance. In this case, the effect of the static stimulus given to the user by the second region can be obtained more reliably.

  In the HMD 100, the control unit 140 may cause the image display unit 20 to display an image so that the ratio of the second region occupied by the user's visual field is equal to or less than a predetermined ratio set in advance. In this case, the effect of the static stimulus given to the user by the combination of the first region and the second region can be obtained more reliably.

  In the HMD 100, the control unit 140 causes the image display unit 20 to display an image so that the amount of movement per unit time of the first area is larger than the amount of movement per unit time of the second area. Also good. In this case, even if each of the first region and the second region has a motion, it is possible to obtain the effect of the motion stimulus by the first region and the effect of the static stimulus by the second region.

  In addition, the HMD 100 includes a motion detection unit that detects the motion of the user's head, and the image display unit 20 corresponds to the motion detected by the motion detection unit and is at least one of the first region and the second region. Change the display state. Thus, by changing the display according to the movement of the user's head, it is possible to produce a more effective display or to transmit new information.

  Further, the HMD 100 includes a camera 61, and changes the display state of at least one of the first area and the second area in response to a motion detected from a captured image captured by the camera 61. As a result, the captured image can be used for more effective display that easily affects the kinesthetic sense.

  In the HMD 100, the control unit 140 displays an image generated based on the captured image of the camera 61 as the first area or the second area. Thereby, the display which gives a stimulus to a user's own motor sensation using a captured image is realizable.

  Moreover, in HMD100, the control part 140 may display an image on the image display part 20 so that the visibility of the side which the user pays attention to either the 1st area | region or the 2nd area | region may be improved. In this case, more realistic video display can be realized, and video sickness can be reduced.

  In HMD100, control part 140 may detect a user's movement and may control a movement of an image displayed on image display part 20 corresponding to a detected movement. In this case, so-called video sickness can be more effectively suppressed by controlling the movement of the image in response to the movement of the user.

In addition, this invention is not restricted to the structure of said each embodiment, In the range which does not deviate from the summary, it can be implemented in a various aspect.
In the above embodiment, the configuration in which the user visually recognizes the outside scene through the display unit is not limited to the configuration in which the right optical image display unit 26 and the left optical image display unit 28 transmit external light. For example, the present invention can be applied to a display device that displays an image in a state where an outside scene cannot be visually recognized. Specifically, the present invention is applied to a display device that displays a captured image of the camera 61, an image or CG generated based on the captured image, video based on video data stored in advance or video data input from the outside, and the like. Can be applied. This type of display device can include a so-called closed display device in which an outside scene cannot be visually recognized. Of course, a display device that displays video data or an analog video signal input from the outside without performing processing such as AR display, MR display, or VR display is also included as an application target of the present invention.

  Further, for example, instead of the image display unit 20, another type of image display unit such as an image display unit worn like a hat may be adopted, and an image is displayed corresponding to the left eye of the user. And a display unit that displays an image corresponding to the right eye of the user. The display device of the present invention may be configured as a head mounted display mounted on a vehicle such as an automobile or an airplane. Further, for example, it may be configured as a head-mounted display built in a body protective device such as a helmet. In this case, the part for positioning the position with respect to the user's body and the part positioned with respect to the part can be used as the mounting portion.

Further, in the above embodiment, the image display unit 20 and the control device 10 are separated and connected via the connection cable 40 as an example. However, the control device 10 and the image display unit 20 are integrated. It is also possible to be configured to be mounted on the user's head.
As the control device 10, a notebook computer, a tablet computer, or a desktop computer may be used. The control device 10 may be a game machine, a portable phone, a portable electronic device including a smartphone or a portable media player, other dedicated devices, or the like. Further, the control device 10 may be configured separately from the image display unit 20, and various signals may be transmitted and received between the control device 10 and the image display unit 20 by wireless communication.

  For example, as a configuration for generating image light in the image display unit 20, a configuration including an organic EL (Organic Electro-Luminescence) display and an organic EL control unit may be used. Further, as a configuration for generating image light, LCOS (Liquid Crystal on silicon, LCoS is a registered trademark), a digital micromirror device, or the like can be used.

  The “display unit” in the present invention corresponds to a configuration that emits image light, and it has been described as “display” that the HMD 100 emits image light. That is, in each of the above embodiments, image light is generated by the left and right image light generation units, and images are directed toward the right eye and the left eye of the user by the right optical image display unit 26 and the left optical image display unit 28, respectively. The structure which irradiates light and makes image light inject into each of a user's right eye and left eye is illustrated. The configuration of the “display unit” is not limited to this. That is, any object that irradiates image light may be used. For example, in the configuration of the present embodiment, image light is emitted toward the user's eyes by the “right light guide” and “left light guide” having the half mirrors 261A and 262A. Further, as a configuration for generating image light, a right backlight 221 and a left backlight 222, and a right LCD 241 and a left LCD 242 are provided. The “display unit” does not require these configurations.

  For example, image light generated by a mechanism built in either or both of the right display driving unit 22 and the left display driving unit 24 of the image display unit 20 is transmitted to the user side of the image display unit 20, that is, the user's eyes. The light may be reflected by a reflection mechanism provided on the facing side and emitted to the user's eyes. Here, as the reflection mechanism, for example, a scanning optical system using a MEMS (Micro Electro Mechanical Systems) mirror can be adopted. In other words, a scanning optical system having a MEMS mirror that scans the light emitted from the image light generation unit may be provided, and the light scanned by the scanning optical system may be directly incident on the user's eyes. Further, an optical member on which a virtual image is formed by light scanned by the scanning optical system may be provided in the image display unit 20. This optical member forms a virtual image by scanning light scanned by the MEMS mirror. In this case, when the MEMS mirror scans light, a virtual image is formed on the virtual image forming surface, and the image is visually recognized (recognized) when the user catches the virtual image with eyes. The optical component in this case may be one that guides light through a plurality of reflections, such as the right light guide plate 261 and the left light guide plate 262 of the above embodiment, and may use a half mirror surface. .

Further, the scanning optical system is not limited to the configuration including the MEMS mirror. The mechanism that generates the image light may also be a laser light source that emits laser light. For example, the present invention can also be applied to a laser retinal projection type head mounted display. That is, the light emitting unit includes a laser light source and an optical system that guides the laser light source to the user's eyes, and the laser light is incident on the user's eyes to scan the retina and form an image on the retina. A configuration that allows the user to visually recognize an image may be employed.
Moreover, it may replace with the virtual image formation surface which receives the light scanned, and the structure which guides image light to a user's eyes using a diffraction grating may be sufficient. That is, the optical member is not limited to guiding the image light inside the optical member, and may have only a function of guiding the image light by refracting and / or reflecting it toward the user's eyes.

  In the configuration including the scanning optical system having MEMS or the like, the position where the user visually recognizes the image, that is, the display position of the image can be changed by changing the mounting angle of the scanning optical system in the image display unit 20. Therefore, in the process of changing the display position in each of the above embodiments, an operation of changing the angle of the scanning optical system may be performed instead of the operation of changing the display position of the image on the right LCD 241 and the left LCD 242.

  The optical system that guides the image light to the user's eyes may include an optical member that transmits external light that is incident on the apparatus from the outside and that is incident on the user's eyes together with the image light. Moreover, you may use the optical member which is located ahead of a user's eyes and overlaps a part or all of a user's visual field.

  Further, in each of the above embodiments, a configuration in which virtual images are formed by the half mirrors 261A and 262A on a part of the right optical image display unit 26 and the left optical image display unit 28 positioned in front of the user's eyes is illustrated. The present invention is not limited to this, and an image may be displayed on a display area having an area that occupies the entire surface or most of the right optical image display unit 26 and the left optical image display unit 28. In this case, a process of reducing the image may be included in the operation of changing the display position of the image.

  Furthermore, the optical element of the present invention is not limited to the right light guide plate 261 and the left light guide plate 262 having the half mirrors 261A and 262A, and may be any optical component that allows image light to enter the user's eyes. A diffraction grating, a prism, or a holographic display unit may be used.

  The display device of the present invention is not limited to a head-mounted display device, and can be applied to various display devices such as a flat panel display and a projector. The display device of the present invention may be any device that allows an image to be visually recognized by external light and image light. For example, a configuration in which an image by image light is visually recognized by an optical member that transmits external light is exemplified. Specifically, the above-described head-mounted display includes an optical member that transmits external light, and a light-transmitting plane or curved surface that is fixedly or movably installed at a position away from the user ( The present invention can also be applied to a display device that projects image light onto glass, transparent plastic, or the like. As an example, a configuration of a display device that projects image light onto a window glass of a vehicle and allows a user who is on board or a user outside the vehicle to visually recognize the scenery inside and outside the vehicle together with an image by the image light. It is done. In addition, for example, image light is projected onto a transparent, semi-transparent, or colored transparent display surface that is fixedly installed such as a window glass of a building, and is displayed together with an image by the image light to a user around the display surface. A configuration of a display device that visually recognizes a scene through the surface can be given.

  Also, at least a part of each functional block shown in FIG. 4 or the like may be realized by hardware, or may be realized by cooperation of hardware and software, as shown in the figure. It is not limited to a configuration in which independent hardware resources are arranged. The program executed by the control unit 140 may be stored in the storage unit 120 or another storage device (not shown) in the control device 10, or the program stored in an external device may be stored in the communication unit 117, or The configuration may be such that it is acquired through the interface 114 and executed. Moreover, only the operation part 111 among the structures formed in the control apparatus 10 may be formed as a single user interface (UI). Further, the configuration formed in the control device 10 may be formed in the image display unit 20 in an overlapping manner. For example, the control unit 140 may be formed in both the control device 10 and the image display unit 20, or a function performed by the control unit 140 formed in the control device 10 and the CPU formed in the image display unit 20. May be configured separately.

  DESCRIPTION OF SYMBOLS 10 ... Control apparatus, 20 ... Image display part (display part), 22 ... Right display drive part, 24 ... Left display drive part, 26 ... Right optical image display part, 28 ... Left optical image display part, 61 ... Camera (imaging) Part), 100 ... HMD (display device), 114 ... interface, 117 ... communication part, 120 ... storage part, 122 ... content data, 123 ... display setting data, 140 ... control part, 150 ... operating system, 160 ... image processing 161: Imaging control unit, 163 ... Motion detection unit, 164 ... AR display control unit (display control unit), 170 ... Communication control unit, 187 ... Audio processing unit, 190 ... Display control unit, 201 ... Right backlight control , 202 ... Left backlight control unit, 211 ... Right LCD control unit, 212 ... Left LCD control unit, 221 ... Right backlight, 222 ... Left backlight, 241 ... Right LC , 242 ... left LCD, 251 ... right projection optical system, 252 ... left projection optical system, 261 ... Migishirubekoban, 262 ... Hidarishirubekoban, FV ... foreground, RV ... background, OB ... object.

Claims (20)

A display unit;
Display that displays an image on the display unit so that a user who visually recognizes the display unit can visually recognize the first region that gives a motion stimulus and the second region that gives a stationary stimulus with different parallax. A control unit;
A display device comprising:   The display control unit displays an image on the display unit such that a viewing distance at which the user visually recognizes the first area is different from a viewing distance at which the user visually recognizes the second area. The display device according to claim 1, wherein:   3. The display unit according to claim 2, wherein the display control unit causes the display unit to display an image such that a viewing distance of the second region is farther from the user than the first region. Display device. The display unit is configured to be visible to the user through the outside scene,
The display device according to claim 3, wherein the display control unit causes the display unit to display an image of the first region so as to overlap an outside scene as the second region. The display unit is configured to be visible to the user through the outside scene,
The display device according to claim 3, wherein the display control unit causes the display unit to display an image of the second region so that the display unit is visually recognized together with an outside scene as the first region.   The display device according to claim 3, wherein the display control unit causes the display unit to display each of the image of the first region and the image of the second region.   3. The display control unit according to claim 2, wherein the display control unit displays an image on the display unit such that a viewing distance of the second region is closer to the user than the first region. Display device. The display unit is configured to be visible to the user through the outside scene,
The display device according to claim 7, wherein the display control unit causes the display unit to display an image of the first region so as to overlap an outside scene as the second region. The display unit is configured to be visible to the user through the outside scene,
The display device according to claim 7, wherein the display control unit causes the display unit to display an image of the second area so as to overlap an outside scene as the first area.   The display device according to claim 7, wherein the display control unit causes the display unit to display each of the image of the first area and the image of the second area.   The display control unit causes the display unit to display an image so that a ratio of the second region occupied by the field of view of the user is equal to or higher than a predetermined ratio set in advance. The display device according to any one of 10.   The display control unit causes the display unit to display an image so that a ratio of the second area occupied by the visual field of the user is equal to or less than a predetermined ratio set in advance. The display device according to any one of 10.   The display control unit causes the display unit to display an image such that the amount of movement per unit time of the first region is larger than the amount of movement per unit time of the second region. The display device according to claim 1. A movement detecting unit for detecting movement of the user's head;
14. The display unit according to claim 1, wherein the display unit changes a display state of at least one of the first region and the second region in accordance with the motion detected by the motion detection unit. The display apparatus in any one. With an imaging unit,
15. The display state of at least one of the first area and the second area is changed in accordance with a motion detected from a captured image captured by the imaging unit. The display apparatus in any one.   The display device according to claim 15, wherein the display control unit displays an image generated based on a captured image of the imaging unit as the first region or the second region.   The display control unit causes the display unit to display an image so as to improve visibility on a side of the first region or the second region on which the user pays attention. The display device according to any one of 1 to 16.   18. The display control unit according to claim 1, wherein the display control unit detects a movement of the user and controls a movement of an image displayed on the display unit in response to the detected movement. The display device described. A control method of a display device including a display unit,
Displaying an image on the display unit so that a user who visually recognizes the display unit can visually recognize the first region that gives a motion stimulus and the second region that gives a static stimulus with different parallax. ,
A control method of a display device characterized by the above. A computer executable program including a display unit,
By the computer
The user who visually recognizes the display unit displays an image on the display unit so that the first region for applying the motion stimulus and the second region for applying the static stimulus can be viewed with different parallaxes, program.

Images