JP6428024B2 - Display device, display device control method, and program - Google Patents

Description

  The present invention relates to a display device, a display device control method, and a program.

  2. Description of the Related Art Conventionally, an apparatus that displays an image corresponding to each of a user's right eye and left eye is known (for example, see Patent Documents 1 and 2). The devices described in Patent Documents 1 and 2 display images having different aspect ratios by recognizing two screens displayed on a pair of left and right liquid crystal displays as one connected screen. The device described in Patent Document 2 adjusts the luminance of the overlapping portion by adjusting the overlapping width of the two screens.

JP-A-7-302063 JP-A-7-302064

When displaying two images corresponding to the right and left eyes of the user as in the conventional display device, it is necessary to process an image larger than the input image. Patent Document 1 describes an example in which two liquid crystal panels of NTSC specifications (horizontal resolution 600 × vertical resolution 500) are used to display a MUSE high-definition image as a wide image of horizontal resolution 1200 × vertical resolution 500. There is. In this example, a process for converting the input image into a higher resolution image is required, and the load when processing the converted image is higher than when the input image is processed. As described above, the resolution of the display image obtained by combining the two screens is generally larger than that of the input image, and there is a concern that the processing load is high.
The present invention has been made in view of the above-described circumstances, and an object thereof is to reduce the processing load when a display device including a plurality of display units displays an input image.

In order to achieve the above object, a display device of the present invention includes a first display unit that displays an image corresponding to the left eye of the user, and a second that displays an image corresponding to the right eye of the user. A display unit; and an image processing unit that divides an image to be displayed and outputs a first image and a second image including the divided images to the first and second display units. And the second image includes an image region composed of images divided by the image processing unit and a pseudo image region, and the state of the one pseudo image region of the first image and the second image is And corresponding to the state of the other image area.
According to the present invention, the first display unit and the second display unit display the first and second images, and the first image and the second image are in an image area configured by an image obtained by dividing the display target image. In addition, a pseudo image area is included. For this reason, it is possible to suppress the processing load without increasing the resolution or enlarging the image to be displayed. Furthermore, the transfer speed for transferring the image to the display unit can be suppressed. Further, if the process of generating the pseudo image area and the pseudo image area are simplified, the load can be easily suppressed. Accordingly, it is possible to make the user visually recognize the target image while suppressing the load related to the display of the image.

In the display device according to the present invention, when the first image and the second image are displayed on the first display unit and the second display unit, they are visually recognized by the user as the display target image. It is an image to be displayed.
According to the present invention, by dividing the target image and displaying it on the first display unit and the second display unit, it is possible to suppress the processing load and display the target image using the two display units. .

In the display device according to the aspect of the invention, the image processing unit may correspond the position of the image area in the first image and the second image to the position of the divided image in the display target image. It is characterized by this.
According to the present invention, the image to be displayed is divided and displayed on the first and second display units without changing the position of the divided image. Therefore, one display target image is obtained using two display units. It can be visually recognized by the user.

In the display device according to the aspect of the invention, the first display unit and the second display unit may display the image so that the first display unit and the second display unit are transmitted through an outside scene and can be visually recognized together with the outside scene. The display form of the pseudo image area in at least one of the one image and the second image is adjusted.
According to the present invention, by adjusting the display form of the pseudo image area, it is possible to control the visibility of the outside scene that passes through the pseudo image area or the image area corresponding to the pseudo image area.

Further, according to the present invention, in the display device, the image processing unit extracts two images having overlapping portions from the image to be displayed, and the two images are respectively the first image and the first image. The image area of two images is used.
According to the present invention, the image displayed by the first display unit and the image displayed by the second display unit can be overlapped. Thereby, when the joint of the images displayed by the first and second display units gives a sense of incongruity, it is possible to eliminate the sense of incongruity and display a high-quality image.

Further, the present invention is characterized in that, in the display device, the image processing unit arranges the image area and the pseudo image area in a predetermined area in the first image and the second image. .
ADVANTAGE OF THE INVENTION According to this invention, the load of the process which the image process part divides | segments the image of a display target, and the process which produces | generates a 1st or 2nd image combining a pseudo image area | region can be reduced.

In the display device according to the present invention, the image processing unit arranges a plurality of the image areas and a plurality of the pseudo image areas in each of the first image and the second image. And
According to the present invention, the first image and the second image are combined in a more complicated shape to visually recognize the display target. For this reason, for example, the image to be displayed can be divided and displayed in a shape that is easy for the user to visually recognize.

According to the present invention, in the display device, a display size in which the first image is displayed on the first display unit and a display size in which the second image is displayed on the second display unit are set to be the same. It is characterized by.
According to the present invention, since the display sizes of the first and second display units are equal, the correspondence between the image displayed by the first display unit and the image displayed by the second display unit becomes clear, and the two display units There is an advantage that one display target image can be easily recognized from the image.

In the display device, the first image and the second image include a predetermined index at a common position.
According to the present invention, since there is an index at a common position in the images displayed on the first and second display units, the correspondence between the images displayed on the first display unit and the second display unit becomes clear. For this reason, there is an advantage that one display target image can be easily recognized from the images of the two display units.

In the display device, the first display unit and the second display unit display the first image and the second image at different timings.
According to the present invention, by changing the timing for displaying an image, the timing for transferring the image can be dispersed, and the transfer amount of the image per unit time can be suppressed.

In order to achieve the above object, the present invention provides a method for controlling a display device including first and second display units, wherein a display target image is divided and a first image corresponding to the divided image is obtained. And the second image is displayed on the first and second display units, the first image and the second image include an image area constituted by the divided images, and a pseudo image area, and The state of the one pseudo image area of the first image and the second image is an image corresponding to the state of the other image area.
According to the present invention, processing such as high resolution and enlargement of an image to be displayed is not involved, or the processing load can be suppressed. Furthermore, the transfer speed for transferring the image to the display unit can be suppressed. Further, if the process of generating the pseudo image area and the pseudo image area are simplified, the load can be easily suppressed. Accordingly, it is possible to make the user visually recognize the target image while suppressing the load related to the display of the image.

In order to achieve the above object, the present invention is a program executable by a computer that controls a display device including first and second display units, and the computer divides an image to be displayed, The first image and the second image including the divided images are caused to function as an image processing unit that outputs to the first and second display units, and the first image and the second image are divided by the image processing unit. Including an image area composed of the processed image and a pseudo image area, wherein the state of one pseudo image area of the first image and the second image corresponds to the state of the other image area, It is characterized by.
According to the present invention, processing such as high resolution and enlargement of an image to be displayed is not involved, or the processing load can be suppressed. Furthermore, the transfer speed for transferring the image to the display unit can be suppressed. Further, if the process of generating the pseudo image area and the pseudo image area are simplified, the load can be easily suppressed. Accordingly, it is possible to make the user visually recognize the target image while suppressing the load related to the display of the image.

It is explanatory drawing which shows the external appearance structure of a head mounted type display apparatus. It is a block diagram which shows the functional structure of a head mounted display apparatus. It is a flowchart which shows operation | movement of a head mounting type display apparatus. It is explanatory drawing which shows the example of the image which a head mounted display device displays. It is explanatory drawing which shows the example of the image which a head mounted display device displays. It is explanatory drawing which shows the example of the image which a head mounted display device displays. It is explanatory drawing which shows the example of the image which a head mounted display device displays. It is explanatory drawing which shows the example of the image which a head mounted display device displays. It is explanatory drawing which shows the example of the image which a head mounted display device displays.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is an explanatory diagram showing an external configuration of the head-mounted display device 100. The head-mounted display device 100 is a display device mounted on the head, and is also called a head mounted display (HMD). The head-mounted display device 100 of the present embodiment is an optically transmissive head-mounted display device that allows a user to visually recognize a virtual image and at the same time directly view an outside scene. In this specification, a virtual image visually recognized by the user with the head-mounted display device 100 is also referred to as a “display image” for convenience. Moreover, emitting image light generated based on image data is also referred to as “displaying an image”.

  The head-mounted display device 100 includes an image display unit 20 (display unit) that allows the user to visually recognize a virtual image when mounted on the user's head, and a control device (controller) 10 that controls the image display unit 20. And.

  The image display unit 20 is a mounting body that is mounted on the user's head, and has a glasses shape in the present embodiment. The image display unit 20 includes a right holding unit 21, a right display driving unit 22, a left holding unit 23, a left display driving unit 24, a right optical image display unit 26, a left optical image display unit 28, and a camera 61. And a microphone 63. The right optical image display unit 26 and the left optical image display unit 28 are arranged so as to be positioned in front of the right and left eyes of the user when the user wears the image display unit 20, respectively. One end of the right optical image display unit 26 and one end of the left optical image display unit 28 are connected to each other at a position corresponding to the eyebrow of the user when the user wears the image display unit 20.

  The right holding unit 21 extends from the end ER which is the other end of the right optical image display unit 26 to a position corresponding to the user's temporal region when the user wears the image display unit 20. It is a member. Similarly, the left holding unit 23 extends from the end EL which is the other end of the left optical image display unit 28 to a position corresponding to the user's temporal region when the user wears the image display unit 20. It is a member provided. The right holding unit 21 and the left holding unit 23 hold the image display unit 20 on the user's head like a temple of glasses.

  The right display drive unit 22 and the left display drive unit 24 are disposed on the side facing the user's head when the user wears the image display unit 20. Hereinafter, the right holding unit 21 and the left holding unit 23 are collectively referred to simply as “holding unit”, and the right display driving unit 22 and the left display driving unit 24 are collectively referred to simply as “display driving unit”. The right optical image display unit 26 and the left optical image display unit 28 are collectively referred to simply as “optical image display unit”.

The display driving units 22 and 24 include liquid crystal displays 241 and 242 (hereinafter referred to as “LCDs 241 and 242”), projection optical systems 251 and 252 (see FIG. 2). Details of the configuration of the display driving units 22 and 24 will be described later. The optical image display units 26 and 28 as optical members include light guide plates 261 and 262 (see FIG. 2). Moreover, you may equip the front side of the right optical image display parts 26 and 28 with a light control board (not shown). The light guide plates 261 and 262 are formed of a light transmissive resin or the like, and guide the image light output from the display driving units 22 and 24 to the user's eyes. The light control plate is a thin plate-like optical element, and may be disposed so as to cover the front side of the image display unit 20 which is the side opposite to the user's eye side. Various types of light control plates are used, such as those that have almost no light transmission, those that are nearly transparent, those that attenuate the amount of light and transmit light, and those that attenuate or reflect light of a specific wavelength. it can. By appropriately selecting the optical characteristics (light transmittance, etc.) of the light control plate, the amount of external light incident on the right optical image display unit 26 and the left optical image display unit 28 from the outside is adjusted to facilitate visual recognition of the virtual image. You can adjust the height. In the present embodiment, a case will be described in which at least a light control plate having such a light transmittance that a user wearing the image display unit 20 can visually recognize an outside scene is used. This light control plate protects the right light guide plate 261 and the left light guide plate 262, and is useful for suppressing damage to the right light guide plate 261 and the left light guide plate 262, adhesion of dirt, and the like.
The light control plate may be detachable with respect to the right optical image display unit 26 and the left optical image display unit 28, or a plurality of types of light control plates may be exchanged and may be omitted.

  The camera 61 is disposed at the end ER that is the other end of the right optical image display unit 26. The camera 61 captures an outside scene that is an external scenery in a direction opposite to the user's eye side, and acquires an outside scene image.

  The imaging direction, that is, the angle of view of the camera 61 is a direction in which the front side direction of the image display unit 20 is imaged. In other words, the angle of view of the camera 61 is a direction in which at least a part of the outside scene in the viewing direction of the user in a state where the image display unit 20 is mounted is imaged. In addition, although the angle of view of the camera 61 can be set as appropriate, the imaging range of the camera 61 is a range including the outside world that the user can visually recognize through the right optical image display unit 26 and the left optical image display unit 28. It is preferable. Furthermore, it is more preferable that the imaging range of the camera 61 is set so that the entire field of view of the user through the light control plate can be imaged.

  The image display unit 20 further includes a connection unit 40 for connecting the image display unit 20 to the control device 10. The connection unit 40 includes a main body cord 48 connected to the control device 10, a right cord 42, a left cord 44, and a connecting member 46. The right cord 42 and the left cord 44 are codes in which the main body cord 48 is branched into two. The right cord 42 is inserted into the casing of the right holding unit 21 from the distal end AP in the extending direction of the right holding unit 21 and connected to the right display driving unit 22. Similarly, the left cord 44 is inserted into the housing of the left holding unit 23 from the distal end AP in the extending direction of the left holding unit 23 and connected to the left display driving unit 24.

  The connecting member 46 is provided at a branch point between the main body cord 48, the right cord 42 and the left cord 44, and has a jack for connecting the earphone plug 30. A right earphone 32 and a left earphone 34 extend from the earphone plug 30. A microphone 63 is provided in the vicinity of the earphone plug 30. The earphone plug 30 to the microphone 63 are combined into one cord, and the cord branches from the microphone 63 and is connected to each of the right earphone 32 and the left earphone 34.

  It is also possible to combine the right code 42 and the left code 44 into one code. Specifically, the lead wire inside the right cord 42 is drawn into the left holding portion 23 side through the inside of the main body of the image display unit 20, and is covered with a resin together with the lead wire inside the left cord 44 to be combined into one cord. Also good.

  The image display unit 20 and the control device 10 transmit various signals via the connection unit 40. A connector (not shown) that fits each other is provided at each of the end of the main body cord 48 opposite to the connecting member 46 and the control device 10. By fitting / releasing the connector of the main body cord 48 and the connector of the control device 10, the control device 10 and the image display unit 20 are connected or disconnected. For the right cord 42, the left cord 44, and the main body cord 48, for example, a metal cable or an optical fiber can be adopted.

  The control device 10 is a device for controlling the head-mounted display device 100. The control device 10 includes switches including an enter key 11, a lighting unit 12, a display switching key 13, a luminance switching key 15, a direction key 16, a menu key 17, and a power switch 18. In addition, the control device 10 includes a track pad 14 that is touched by a user with a finger.

  The determination key 11 detects a pressing operation and outputs a signal for determining the content operated by the control device 10. The lighting unit 12 notifies the operation state of the head-mounted display device 100 by its light emission state. Examples of the operating state of the head-mounted display device 100 include power ON / OFF. For example, an LED (Light Emitting Diode) is used as the lighting unit 12. The display switching key 13 detects a pressing operation and outputs a signal for switching the display mode of the content video between 3D and 2D, for example.

  The track pad 14 detects the operation of the user's finger on the operation surface of the track pad 14 and outputs a signal corresponding to the detected content. As the track pad 14, various track pads such as an electrostatic type, a pressure detection type, and an optical type can be adopted. The luminance switching key 15 detects a pressing operation and outputs a signal for increasing or decreasing the luminance of the image display unit 20. The direction key 16 detects a pressing operation on a key corresponding to the up / down / left / right direction, and outputs a signal corresponding to the detected content. The power switch 18 switches the power-on state of the head-mounted display device 100 by detecting a slide operation of the switch.

FIG. 2 is a functional block diagram of the head-mounted display device 100. FIG. 2 also illustrates the image supply device OA connected to the head-mounted display device 100. The head-mounted display device 100 can constitute a display system together with the image supply device OA.
As shown in FIG. 2, the control device 10 includes a control unit 140, an operation unit 135, an input information acquisition unit 110, a storage unit 120, a power supply 130, an interface 180, a transmission unit (Tx) 51 and a transmission. Part (Tx) 52.
The operation unit 135 detects an operation by the user. The operation unit 135 includes the determination key 11, the display switching key 13, the track pad 14, the luminance switching key 15, the direction key 16, the menu key 17, and the power switch 18 shown in FIG.

The input information acquisition unit 110 acquires a signal corresponding to an operation input by the user. As a signal corresponding to the operation input, for example, there is an operation input to the track pad 14, the direction key 16, and the power switch 18.
The power supply 130 supplies power to each part of the head-mounted display device 100. As the power supply 130, for example, a secondary battery can be used.

The storage unit 120 stores various computer programs. The storage unit 120 is configured by a ROM, a RAM, or the like.
The control unit 140 includes a CPU, a ROM, a RAM, and the like, and controls each unit of the head-mounted display device 100 by executing a program stored in the ROM or the storage unit 120. The control unit 140 functions as an operating system (OS) 150 that is a basic control system of the head-mounted display device 100 by executing the program. Further, the control unit 140 executes the above-described program and functions as an image processing unit 160, a division control unit 164, an audio processing unit 170, and a display control unit 190. These functions may be part of the operating system 150, or may be functions of application programs that operate on the operating system 150.

The image processing unit 160 acquires an image signal included in the content. The image processing unit 160 separates synchronization signals such as the vertical synchronization signal VSync and the horizontal synchronization signal HSync from the acquired image signal. Further, the image processing unit 160 generates a clock signal PCLK using a PLL (Phase Locked Loop) circuit or the like (not shown) according to the period of the separated vertical synchronization signal VSync and horizontal synchronization signal HSync. The image processing unit 160 converts the analog image signal from which the synchronization signal is separated into a digital image signal using an A / D conversion circuit or the like (not shown). Thereafter, the image processing unit 160 stores the converted digital image signal in the DRAM in the storage unit 120 frame by frame as image data (Data in the figure) of the target image. This image data is, for example, RGB data.
Note that the image processing unit 160 may execute image processing such as various tone correction processing such as resolution conversion processing, brightness and saturation adjustment, and keystone correction processing on the image data as necessary. .

  The image processing unit 160 transmits the generated clock signal PCLK, vertical synchronization signal VSync, horizontal synchronization signal HSync, and image data Data stored in the DRAM in the storage unit 120 via the transmission units 51 and 52, respectively. To do. The image data Data transmitted via the transmission unit 51 is also referred to as “right eye image data”, and the image data Data transmitted via the transmission unit 52 is also referred to as “left eye image data”. The transmission units 51 and 52 function as a transceiver for serial transmission between the control device 10 and the image display unit 20.

  The display control unit 190 generates control signals for controlling the right display drive unit 22 and the left display drive unit 24. Specifically, the display control unit 190 controls driving of the right LCD 241 by the right LCD control unit 211, driving ON / OFF of the right backlight 221 by the right backlight control unit 201, and left LCD control unit according to control signals. The left LCD 242 driving ON / OFF by 212, the left backlight 222 driving ON / OFF by the left backlight control unit 202, and the like are individually controlled. Thus, the display control unit 190 controls the generation and emission of image light by the right display driving unit 22 and the left display driving unit 24, respectively. For example, the display control unit 190 may cause both the right display driving unit 22 and the left display driving unit 24 to generate image light, generate only one image light, or neither may generate image light.

  The display control unit 190 transmits control signals for the right LCD control unit 211 and the left LCD control unit 212 via the transmission units 51 and 52, respectively. In addition, the display control unit 190 transmits control signals to the right backlight control unit 201 and the left backlight control unit 202, respectively.

  The head-mounted display device 100 causes the image display unit 20 to display an image of content input via the interface 180 or the communication unit 117 described later by the functions of the image processing unit 160 and the display control unit 190. When the content to be displayed is a 2D (planar) still image or moving image, the right display driving unit 22 and the left display driving unit 24 display the same image. The image processing unit 160 transmits the image data stored in the DRAM in the storage unit 120 as image data for the right eye from the transmission unit 51 and transmits it as image data for the left eye from the transmission unit 52. That is, the image processing unit 160 processes two image data for the right eye and the left eye. When the image data has a high resolution or a high frame rate, the processing load on the image processing unit 160 increases. If the processing load is excessive, there is a concern about an increase in the amount of heat generated by the hardware constituting the control unit 140, an increase in power consumption, and generation of harmonics that cause unnecessary radiation. For this reason, heat dissipation measures commensurate with an increase in processing load, securing a sufficient power supply capacity, and enhancing hardware performance are performed, resulting in an increase in cost due to a complicated configuration and an increase in size of the apparatus.

The head-mounted display device 100 according to the present embodiment includes a division control unit 164 and performs division display using the function of the division control unit 164, thereby reducing the processing load on the image processing unit 160.
The split display is a method of dividing the content image and displaying it separately on the right display drive unit 22 and the left display drive unit 24. Since the image processing unit 160 generates the right-eye image data and the left-eye image data from the content image, an increase in the amount of image data due to copying can be suppressed, so that the processing load can be reduced. Details of the split display will be described later.

  The audio processing unit 170 acquires an audio signal included in the content, amplifies the acquired audio signal, and a speaker (not shown) in the right earphone 32 and a speaker in the left earphone 34 (not shown) connected to the connecting member 46. (Not shown). For example, when the Dolby (registered trademark) system is adopted, processing on the audio signal is performed, and different sounds with different frequencies or the like are output from the right earphone 32 and the left earphone 34, for example. In addition, the voice processing unit 170 acquires the voice collected and input by the microphone 63, converts it into digital voice data, and performs processing related to the voice. For example, the speech processing unit 170 performs speaker recognition that identifies a person who speaks for each voice by recognizing voices of a plurality of persons separately by extracting and modeling features from the acquired speech. May be.

A three-axis sensor 113, a GPS 115, and a communication unit 117 are connected to the control unit 140. The triaxial sensor 113 is a triaxial acceleration sensor, and the control unit 140 can detect the detection value of the triaxial sensor 113 and detect the movement and the direction of movement of the control device 10.
The GPS 115 includes an antenna (not shown), receives a GPS (Global Positioning System) signal, and obtains the current position of the control device 10. The GPS 115 outputs the current position and the current time obtained based on the GPS signal to the control unit 140. Further, the GPS 115 may have a function of acquiring the current time based on information included in the GPS signal and correcting the time counted by the control unit 140 of the control device 10.
The communication unit 117 performs wireless data communication conforming to a wireless LAN (WiFi (registered trademark)) or Bluetooth (registered trademark) standard.

The interface 180 is an interface for connecting various image supply apparatuses OA that are content supply sources to the control apparatus 10. The content supplied by the image supply device OA includes a still image or a moving image, and may include sound. Examples of the image supply device OA include a personal computer (PC), a mobile phone terminal, and a game terminal. As the interface 180, for example, a USB interface, a micro USB interface, a memory card interface, or the like can be used.
Here, it is also possible to connect the image supply device OA to the control device 10 by a wireless communication line. In this case, the image supply device OA performs wireless communication with the communication unit 117 and transmits content data using a wireless communication technique such as Miracast (registered trademark).

  The image display unit 20 includes a right display drive unit 22, a left display drive unit 24, a right light guide plate 261 as a right optical image display unit 26, a left light guide plate 262 as a left optical image display unit 28, and a camera 61. And a vibration sensor 65 and a nine-axis sensor 66.

  The vibration sensor 65 is configured using an acceleration sensor, and is arranged inside the image display unit 20 as shown in FIG. In the example of FIG. 1, the right holding unit 21 is built in the vicinity of the end ER of the right optical image display unit 26. When the user performs an operation of hitting the end ER (knock operation), the vibration sensor 65 detects vibration caused by this operation and outputs the detection result to the control unit 140. Based on the detection result of the vibration sensor 65, the control unit 140 detects a knocking operation by the user.

  The 9-axis sensor 66 is a motion sensor that detects acceleration (3 axes), angular velocity (3 axes), and geomagnetism (3 axes). Since the 9-axis sensor 66 is provided in the image display unit 20, when the image display unit 20 is mounted on the user's head, the movement of the user's head is detected. For example, the control unit 140 can determine the orientation of the image display unit 20 from the movement of the user's head detected by the 9-axis sensor 66, and can estimate the user's line-of-sight direction.

  The right display driving unit 22 includes a receiving unit (Rx) 53, a right backlight (BL) control unit 201 and a right backlight (BL) 221 that function as a light source, a right LCD control unit 211 that functions as a display element, and a right An LCD 241 and a right projection optical system 251 are provided. The right backlight control unit 201 and the right backlight 221 function as a light source. The right LCD control unit 211 and the right LCD 241 function as display elements. The right backlight control unit 201, the right LCD control unit 211, the right backlight 221 and the right LCD 241 are collectively referred to as “image light generation unit”.

  The receiving unit 53 functions as a receiver for serial transmission between the control device 10 and the image display unit 20. The right backlight control unit 201 drives the right backlight 221 based on the input control signal. The right backlight 221 is a light emitter such as an LED or electroluminescence (EL). The right LCD control unit 211 drives the right LCD 241 based on the clock signal PCLK, the vertical synchronization signal VSync, the horizontal synchronization signal HSync, and the right eye image data Data1 input through the reception unit 53. . The right LCD 241 is a transmissive liquid crystal panel in which a plurality of pixels are arranged in a matrix.

  The right projection optical system 251 is configured by a collimator lens that converts the image light emitted from the right LCD 241 to light beams in a parallel state. The right light guide plate 261 as the right optical image display unit 26 guides the image light output from the right projection optical system 251 to the right eye RE of the user while reflecting the image light along a predetermined optical path. The right projection optical system 251 and the right light guide plate 261 are collectively referred to as “light guide unit”.

The left display drive unit 24 has the same configuration as the right display drive unit 22. The left display driving unit 24 includes a receiving unit (Rx) 54, a left backlight (BL) control unit 202 and a left backlight (BL) 222 that function as a light source, a left LCD control unit 212 and a left that function as a display element. An LCD 242 and a left projection optical system 252 are provided. The left backlight control unit 202 and the left backlight 222 function as a light source. The left LCD control unit 212 and the left LCD 242 function as display elements.
The left backlight control unit 202, the left LCD control unit 212, the left backlight 222, and the left LCD 242 are also collectively referred to as “image light generation unit”. The left projection optical system 252 is configured by a collimating lens that converts the image light emitted from the left LCD 242 into a light beam in a parallel state. The left light guide plate 262 as the left optical image display unit 28 guides the image light output from the left projection optical system 252 to the left eye LE of the user while reflecting the image light along a predetermined optical path. The left projection optical system 252 and the left light guide plate 262 are collectively referred to as “light guide unit”.

  And the left display drive part 24 and the left light-guide plate 262 comprise the 1st display part which displays an image corresponding to a user's left eye. The right display drive unit 22 and the right light guide plate 261 constitute a second display unit that displays an image corresponding to the right eye of the user.

FIG. 3 is a flowchart showing the operation of the head-mounted display device 100, and particularly shows the operation related to split display using the function of the split control unit 164.
When the content is input through the interface 180 or the communication unit 117 and the display of the content is instructed by the operation of the operation unit 135, the image processing unit 160 and the display control unit 190 start split display (step S11).
Here, whether to perform normal image display or to perform divided display is set in advance. In addition, the image processing unit 160 and the display control unit 190 determine attributes such as an aspect ratio, a display size or a display resolution, and a display refresh rate for the content image input from the image supply device OA, and match the determined attributes. Thus, it may be determined whether or not to perform split display. Further, the determination may be automatically performed in association with the determined attribute, or the divided display may be executed when the attribute corresponds to the condition set by the user. Further, an input operation for selecting whether or not to perform divided display may be performed by the user.

The image processing unit 160 acquires an image signal included in the content, and converts the digital image signal constituting the image of the content into image data (Data in the figure) of the target image for each frame in the DRAM in the storage unit 120. (Step S12).
Subsequently, the division control unit 164 refers to the setting data 123 stored in the storage unit 120, for example, and acquires settings related to image division (step S13). The setting data 123 is data that is set for a mode of dividing image data of content acquired by the image processing unit 160. There are various modes of image data division, such as vertical (vertical direction) half, horizontal (horizontal direction) half, horizontal line unit, vertical line unit, dot unit, and the like. Alternatively, a marker may be attached. The mode of division will be described later with specific examples shown in FIGS. The marker includes, for example, a one-dimensional code such as a bar code, a two-dimensional code such as a QR code (registered trademark), or other machine-recognizable marker, and does not include information including information. It may be a thing.

The division control unit 164 causes the image processing unit 160 to divide the image data stored in the DRAM of the storage unit 120 (step S14). Furthermore, the division control unit 164 causes the image processing unit 160 to generate image data for the left eye (first image) and image data for the right eye (second image) including the image data after the division (step S15).
Thereafter, the image processing unit 160 transmits the right-eye image data to the right display driving unit 22 via the transmission unit 51, and transmits the left-eye image data to the left display driving unit 24 via the transmission unit 52. The right eye image and the left eye image are displayed (step S16).

  The control unit 140 determines whether or not there is an instruction regarding the end of the display (step S17). When the display end instruction is given by the operation unit 135 (step S17; YES), this process ends.

4 to 9 are diagrams illustrating specific examples of divided display.
FIG. 4 is a diagram illustrating an example in which an image is divided at predetermined positions in the vertical direction (vertical direction, height direction, vertical direction). 4A shows an image (content before division) 350 of content before division, (B) shows one divided image (divided image) 351, and (C) shows the other divided image ( A divided image) 353 is shown. 4D shows a left-eye image 352 based on the divided image 351, and FIG. 4E shows a right-eye image 354 based on the divided image 353.

In the example of FIG. 4, the image processing unit 160 divides the pre-division image 350 (display-symmetric image) into two in the vertical direction. The division position is the center of the pre-division image 350 in the vertical direction, and the pre-division image 350 is divided equally. The vertical size of the divided image 351 and the divided image 353 is the same. The horizontal size of the divided images 351 and 353 is the same as that of the pre-division image 350.
The divided image 351 corresponds to the upper half of the pre-division image 350. Since the divided image 351 has half the vertical resolution (number of pixels) of the pre-division image 350, the image processing unit 160 outputs the left-eye image 352 (first image) based on the divided image 351. . The left-eye image 352 includes an image area 352A and a pseudo image area 352B. The image area 352A is a divided image 351, and the pseudo image area 352B is dummy data added by the image processing unit 160 to adjust the vertical resolution.
Further, the image processing unit 160 outputs a right-eye image 354 (second image) based on the divided image 353. The right eye image 354 includes an image region 354A and a pseudo image region 354B. The image area 354A is a divided image 353, and the pseudo image area 354B is dummy data added by the image processing unit 160 in order to adjust the resolution in the vertical direction.

  In this example, the left-eye image 352 is output to the left display drive unit 24 and displayed by the left optical image display unit 28. The right-eye image 354 is output to the right display drive unit 22 and displayed by the right optical image display unit 26. Since the image light of the left eye image 352 is incident on the left eye and the image light of the right eye image 354 is incident on the right eye, the left eye image 352 is displayed on the left eye and the right eye is displayed on the right eye. An eye image 354 is visible. Experience has shown that the human brain has a function of synthesizing images that are visible to the left and right eyes, and the user can use the left-eye image 352 and the right-eye image displayed in this embodiment. The image 354 is synthesized. As a result, the user recognizes the synthesized pre-division image 350.

  In particular, the pseudo image area 352B of the left eye image 352 has the same size and the same number of pixels as the image area 354A of the right eye image 354, and the pseudo image area 354B of the right eye image 354 is the left eye image 354B. It has the same size and the same number of pixels as the image area 352A of the image 352. As described above, the pseudo image area 352B corresponds to the image area 354A, and the pseudo image area 354B corresponds to the image area 352A. That is, at a position where a part of the pre-division image 350 is visible to one eye of the user, dummy data is visible to the other eye. For this reason, when the image is synthesized by the action of the user's brain, the image and the dummy data are superimposed, so that the image is naturally superimposed, and the user can recognize the pre-division image 350 without difficulty. .

  The divided image 351 that is the upper half of the pre-division image 350 is an image region 352A that is the upper half of the left-eye image 352, and the divided image 353 that is the lower half of the pre-division image 350 is the right-eye image. An image region 354A which is the lower half of 354 is formed. That is, the image regions 352A and 354A are arranged at the same position as the position occupied by the corresponding divided image in the pre-division image 350. For this reason, the user can recognize the pre-division image 350 by overlapping images more naturally.

  Further, the display position of the left eye image 352 in the displayable area of the left optical image display unit 28 and the display position of the right eye image 354 in the displayable area of the right optical image display unit 26 are set to the same position. Is desirable. Furthermore, when the display size of the left-eye image 352 in the displayable region of the left optical image display unit 28 and the display size of the right-eye image 354 in the displayable region of the right optical image display unit 26 are the same size, More preferred. In this case, since the position of the left-eye image 352 that can be seen by the user's left eye and the position of the right-eye image 354 that can be seen by the right eye coincide, There is an advantage that the image 350 can be easily recognized. Here, the displayable area refers to an area where the right optical image display unit 26 and the left optical image display unit 28 can display an image.

As a result of the study by the inventors, the following has been clarified as the influence of the display size of the left-eye image 352 and the right-eye image 354 on the visibility of the user.
When the display size is large, the image areas 352A and 354A are visible, and the pseudo image areas 352B and 354B are clearly visible. For this reason, when the pseudo image areas 352B and 354B are conspicuous, the image areas 352A and 354A tend to appear blurred. It was also found that the left-eye image 352 and the right-eye image 354 appear brighter as the display size is larger. This is considered to be because the amount of light in the left-eye image 352 and the right-eye image 354 is large.
On the other hand, when the display size is small, the pseudo image areas 352B and 354B are not conspicuous and the image areas 352A and 354A tend to be clearly visible. In addition, the image areas 352A and 354A are small in deviation, and the pre-division image 350 can be viewed in a properly superimposed state. However, the smaller the display size, the darker the recognized image.
Therefore, the display size of the left eye image 352 and the right eye image 354 is preferably small. For example, the display size of the right optical image display unit 26 and the left optical image display unit 28 is vertical and horizontal. It is preferable that the size is half or less in any direction.

  In the present embodiment, the image data processed by the image processing unit 160 is dummy data constituting the pre-division image 350 and the pseudo image areas 352B and 354B. The pseudo image areas 352B and 354B are data of (R, G, B) = (0, 0, 0) indicating, for example, black. Further, it may be data indicating all white (in the case of RGB 24-bit data, (255, 255, 255)). Image data composed of continuous black or white pixels can be easily generated and compressed. For this reason, in this embodiment, compared with the case where the pre-division image 350 is output to each of the transmission units 51 and 52, the substantial amount of data processed by the image processing unit 160 can be reduced or compressed. The processing load on the processing unit 160 can be reduced.

  As described above, the image display unit 20 is a transmissive display device, and image light is incident on the user's eyes by the right optical image display unit 26 and the left optical image display unit 28 that transmit external light. When the pseudo image areas 352B and 354B are formed of black, there is no image light in the portions corresponding to the pseudo image areas 352B and 354B. For this reason, since the image light of the divided image 351 and the image light of the divided image 353 are incident on the user's eyes, the image light of the dummy data is not incident on the user's eyes, so the light amount of the image light incident on the user's eyes Is substantially equivalent to one screen of the pre-division image 350. Therefore, the user can easily recognize the pre-division image 350.

  In the above example, compared to the case where the pre-division image 350 is displayed on both the right optical image display unit 26 and the left optical image display unit 28, the amount of image light is almost halved and looks dark. As a countermeasure, the right optical image display unit 26 and the left optical image display unit 28 in the case where the image processing unit 160 performs divided display under the control of the division control unit 164 and the image processing unit 160, compared to the case where normal display is performed. It is good also as a structure which increases the light quantity of the image light which emits. Specifically, there are a method of increasing the amount of light of the right backlight 221 and the left backlight 222, and a method of increasing the luminance of the left-eye image 352 and the right-eye image 354 by performing luminance extension processing by the image processing unit 160. . Alternatively, when the right display drive unit 22 and the left display drive unit 24 include an aperture mechanism (a dimming mechanism) that stops image light, the image light may be increased by the function of the aperture mechanism.

  On the other hand, when the pseudo image areas 352B and 354B are configured of white, the image light of the pixel having the maximum luminance is irradiated to the portions corresponding to the pseudo image areas 352B and 354B. The image light of the divided image 351 and the image light of the divided image 353 are incident on the user's eyes, and further, white image light corresponding to the dummy data is incident. In this case, the amount of image light incident on the user's eyes does not prevent the user from recognizing the pre-division image 350 by synthesizing the divided images 351 and 353 because the color of the dummy data is achromatic. . Furthermore, when the image light in the pseudo image areas 352B and 354B is incident on the user's eyes, there is an advantage that the image light is less affected by external light. That is, when image light is incident, it is difficult to see the outside scene at the display positions of the pseudo image areas 352B and 354B. Therefore, for example, when the outside light is strong, the visibility of the pre-division image 350 can be expected to be improved.

  The position where the pre-division image 350 is divided, the pixel values of dummy data constituting the pseudo image areas 352B and 354B, etc. are set in advance in the head-mounted display device 100, and the setting contents are stored as setting data 123. .

  4B to 4E, the pre-division image 350 is divided at the center in the vertical direction, and a left-eye image 352 corresponding to the left eye is output based on the upper half image. The example which outputs the image 354 for right eyes corresponding to a lower half and a right eye was shown. The position where the pre-division image 350 is divided is not limited to the center of the pre-division image 350, and may be any position. In this case, the pseudo image areas 352B and 354B only need to correspond to the difference between the number of pixels in the image areas 352A and 354A and the number of pixels in the pre-division image 350. That is, if the pseudo image area 352B corresponds to the image area 354A and the pseudo image area 354B corresponds to the image area 352A, the same effect as the example shown in FIGS. 4B to 4E can be obtained. it can.

The image processing unit 160 may actually generate image data corresponding to the divided images 351 and 353 and store the image data in the storage unit 120. Alternatively, the image processing unit 160 may read the image data from the storage unit 120 and output the image data to the transmission units 51 and 52. The image may be divided by data processing when the image is processed.
For example, the image processing unit 160 reads the pre-division image 350 from the DRAM of the storage unit 120, writes the upper half as the divided image 351 on the DRAM, and writes the lower half as the divided image 353 on the DRAM. Subsequently, the image processing unit 160 adds the dummy data constituting the pseudo image area 352B to the divided image 351 on the DRAM to generate the left-eye image 352. Similarly, the image processing unit 160 generates dummy image 354 by adding dummy data to the divided image 353 on the DRAM. In this case, image data of the left-eye image 352 and the right-eye image 354 are stored on the DRAM. The image processing unit 160 reads the left-eye image 352 and the right-eye image 354 from the DRAM, and outputs them by the transmission units 51 and 52.

For example, the image processing unit 160 may be configured to perform image division and dummy data addition when outputting image data from the transmission units 51 and 52 based on the pre-division image 350 in the DRAM. In this case, the image processing unit 160 reads data from the upper end position of the pre-division image 350 in units of a predetermined byte or the predetermined number of lines, and outputs the data to the transmission unit 52. The image processing unit 160 reads the upper half data of the pre-division image 350 and then outputs dummy data to the transmission unit 52. The image processing unit 160 outputs dummy data of an amount corresponding to the number of lines in the pseudo image region 352B to the transmission unit 52. The data output by the image processing unit 160 to the transmission unit 51 in this process is the same as the data of the left-eye image 352 shown in FIG.
Further, the image processing unit 160 outputs dummy data corresponding to the pseudo image area 354B to the transmission unit 51, and after the output of the dummy data, reads the lower half data from the center position of the pre-division image 350. And output to the transmission unit 51. The data output by the image processing unit 160 to the transmission unit 51 in this process is the same as the data of the right-eye image 354 shown in FIG.
Thus, the image data of the left-eye image 352 and the right-eye image 354 are not actually stored on the DRAM, but the pre-division image 350 is divided, and the left image is divided based on the divided divided images 351 and 353. The operation of outputting the eye image 352 and the right eye image 354 can be realized.
Further, when the image processing unit 160 includes a processor that processes and outputs data output to the transmission unit 51 and data output to the transmission unit 52 in parallel, processing related to the upper half of the pre-division image 350 is performed. And processes related to the lower half can be executed in parallel. At this time, since the data read from the DRAM in each process is different data, the processes for the same address in the DRAM do not collide or compete with each other, and the necessity for the process for adjusting the contention is low. For this reason, compared with the case where the whole image 350 before division | segmentation is output to each of the transmission part 51 and the transmission part 52, the processing load of the control part 140 whole can be reduced.

Here, the image processing unit 160 may perform processing for shifting the display timing of the images of the right display driving unit 22 and the left display driving unit 24. Specifically, the timing for outputting the left-eye image 352 and the right-eye image 354 from the transmission units 51 and 52, or the vertical synchronization signal VSync, the horizontal synchronization signal HSync, and the like are adjusted.
In this case, the amount of image data per unit time output by the image processing unit 160 can be suppressed, and the processing load can be further reduced. Used when the left optical image display unit 28 and the right optical image display unit 26 display images at different timings, but the frame frequency of the displayed image is not extremely low (for example, several frames to several tens of frames / second). The afterimage perceived by the person is superimposed. Therefore, the user can recognize the pre-division image 350 by superimposing the display image of the right optical image display unit 26 and the display image of the left optical image display unit 28.

  4A to 4E, the upper half of the pre-division image 350 is the left eye image 352 corresponding to the left eye of the user, and the lower half of the pre-division image 350 is the user. The right-eye image 354 corresponding to the right eye is merely an example. The left eye image 352 may be an image including the lower half of the pre-division image 350. In this case, the right eye image 354 may be an image including the upper half of the pre-division image 350. That is, the left-eye image 352 and the right-eye image 354 have a relationship in which one pseudo image area corresponds to the other image area, and when the image areas 352A and 354A are combined, It suffices if the entire image is visible.

FIG. 4F shows a left-eye image 355 in which an overlapping position mark M is added inside the image, and FIG. 4G shows a corresponding right-eye image 356.
Both the left-eye image 355 and the right-eye image 356 include an overlapping position mark M (index). In the example of FIGS. 4F and 4G, the overlap position mark M is arranged at the center of the image. However, the position of the overlap position mark M in the left eye image 355 and the overlap position in the right eye image 356 are shown. The position of the mark M is the same position. That is, the left eye image 355 and the right eye image 356 have the same display size displayed on the right optical image display unit 26 and the left optical image display unit 28, and include the overlapping position mark M at a common position. . In this case, the overlapping position mark M is visible to both the right eye and the left eye of the user. For this reason, since it functions as an alignment guideline or reference when combining the image regions of the left-eye image 355 and the right-eye image 356, the user can use the left and right eyes with the overlapping position mark M as a reference. Can be recognized to recognize the pre-division image 350 before being divided.

FIGS. 4F and 4G show an example in which one overlapping position mark M is arranged in each of the left-eye image 355 and the right-eye image 356. The number of indices (here, the overlapping position marks) is shown. The shape and the like are arbitrary. For example, various shapes such as other graphics, characters, images, etc. can be used as the shape of the overlapping position mark, and the display color, brightness, etc. are arbitrary, and the user can select the left eye image 355 and the right eye image. It is only necessary that the overlapping position mark M arranged at 356 can be visually identified. For example, an icon or the like to be shown to the user on the menu screen related to the operation of the head-mounted display device 100 may be used as the overlapping position mark, a frame-shaped overlapping position mark may be used, and a plurality of figures and images may be displayed. Including overlapping position marks may be displayed. Further, the position of the overlapping position mark only needs to be in a position common to the left-eye image 355 and the right-eye image 356, and is not limited to the center of the left-eye image 355 and the right-eye image 356.
In addition, for example, the image processing unit 160 can adjust the display color and brightness of the overlap position mark, and the display color and brightness of the overlap position mark can be adjusted corresponding to the colors of the left eye image 355 and the right eye image 356. You may decide. When the overlapping position mark is composed of a plurality of figures and the like, the display forms of these figures and the like may be varied.

  FIG. 5 is a diagram illustrating an example of dividing an image at a predetermined position in the horizontal direction (horizontal direction) as another example of the process of dividing the image. 5A shows a pre-division image 350, FIG. 5B shows a divided image 357, and FIG. 5C shows a divided image 359. FIG. 5D shows a left-eye image 358 based on the divided image 357, and FIG. 5E shows a right-eye image 360 based on the divided image 359.

The divided images 357 and 359 are images obtained by dividing the pre-division image 350 at a preset position in the horizontal direction. The pre-division image 350 is equally divided into two at the horizontal center position, and the horizontal size of the divided image 357 and the divided image 359 is the same. The vertical size of the divided images 357 and 359 is the same as that of the pre-division image 350.
The image processing unit 160 generates a left-eye image 358 and a right-eye image 360 based on the divided images 357 and 359, and outputs them to the transmission units 51 and 52.

The left half of the left-eye image 358 is an image region 358A including a divided image 357, and the right half is a pseudo image region 358B. Similar to the pseudo image areas 352B and 354B, the pseudo image area 358B includes dummy data added by the image processing unit 160. The position and size of the image region 358A in the left-eye image 358 are the same as those of the divided image 357 in the pre-division image 350.
The right half of the right-eye image 360 is an image area 360A including the divided image 359, and the left half is a pseudo image area 360B. Similar to the pseudo image areas 352B and 354B, the pseudo image area 360B includes dummy data added by the image processing unit 160. The position and size of the image region 360A in the right-eye image 360 are the same as those of the divided image 359 in the pre-division image 350.

In the example of FIG. 5, the same effect as the example described with reference to FIG. 4 can be obtained.
That is, when each of the left optical image display unit 28 and the right optical image display unit 26 displays the left eye image 358 and the right eye image 360, the user recognizes the pre-division image 350. By dividing the pre-division image 350, the processing load of the entire control unit 140 can be reduced as compared with the case where the image processing unit 160 outputs the whole pre-division image 350 to each of the transmission unit 51 and the transmission unit 52. .
The pseudo-image area 358B of the left-eye image 358 has the same size and the same number of pixels as the image area 360A of the right-eye image 360, and the pseudo-image area 360B has the same size and the same number of pixels as the image area 358A. It has become. For this reason, when the image is synthesized by the action of the user's brain, the image and the dummy data are superimposed, so that the image is naturally superimposed, and the user can recognize the pre-division image 350 without difficulty. .
The divided image 357 that is the left half of the pre-division image 350 is an image region 358A of the left half of the left-eye image 358, and the divided image 359 that is the right half of the pre-division image 350 is the right-eye image. An image region 360 </ b> A that is the right half of the image 360 is formed. For this reason, the user can recognize the pre-division image 350 by overlapping images more naturally.
Further, the display position of the left eye image 358 in the displayable area of the left optical image display unit 28 and the display position of the right eye image 360 in the displayable area of the right optical image display unit 26 are set to the same position. Is desirable. Further, the display size of the left eye image 358 in the displayable area of the left optical image display unit 28 and the display size of the right eye image 360 in the displayable area of the right optical image display unit 26 are the same size. More preferred. In this case, there is an advantage that the user can easily recognize the pre-division image 350 by synthesizing the visual fields of the left and right eyes.

In the example of FIGS. 4 and 5, the example in which the pre-division image 350 is divided without overlapping has been described, but there may be overlapping portions. An example of this is shown in FIG.
6A and 6B are diagrams illustrating an example in which an image is divided at a predetermined position in the horizontal direction (horizontal direction) as in FIG. 5. FIG. 6A illustrates an image 350 before division, and FIG. 6B illustrates a divided image. 361 shows a divided image 363. 6D shows a left eye image 362 based on the divided image 361, and FIG. 6E shows a right eye image 364 based on the divided image 363. 6 (A) to 6 (E) indicate the center position in the horizontal direction of the pre-division image 350.

The divided image 361 is an image obtained by extracting a left half of the pre-division image 350 and a portion on the right side of the center in the width direction of the pre-division image 350. The divided image 363 is an image obtained by extracting the right half of the pre-division image 350 and the left side portion of the pre-division image 350 in the width direction. The left-eye image 362 includes an image region 362A composed of the divided images 361 and a pseudo image region 362B composed of dummy data added to the right side of the image region 362A. Each of the left-eye image 362 and the right-eye image 364 has the same size and the same number of pixels as the pre-division image 350.
The image processing unit 160 generates a left-eye image 362 and a right-eye image 364 based on the divided images 361 and 363 and outputs them to the transmission units 51 and 52.

The left half of the left-eye image 358 is an image region 358A including a divided image 357, and the right half is a pseudo image region 358B. Similar to the pseudo image areas 352B and 354B, the pseudo image area 358B includes dummy data added by the image processing unit 160. The position and size of the image region 358A in the left-eye image 358 are the same as those of the divided image 357 in the pre-division image 350.
The right half of the right-eye image 360 is an image area 360A including the divided image 359, and the left half is a pseudo image area 360B. Similar to the pseudo image areas 352B and 354B, the pseudo image area 360B includes dummy data added by the image processing unit 160. The position and size of the image region 360A in the right-eye image 360 are the same as those of the divided image 359 in the pre-division image 350.

When the left eye image 362 is displayed by the left optical image display unit 28 and the right eye image 364 is displayed by the right optical image display unit 26, the left eye image 358 shown in FIGS. The same effect as the right eye image 360 is obtained.
Here, unlike the left-eye image 358, the left-eye image 362 includes a portion on the right side of the center of the pre-division image 350. Similarly, the right-eye image 364 includes a portion on the left side of the center of the pre-division image 350 unlike the right-eye image 360. That is, the image area 362A and the image area 364A have an overlapping portion.

  The left eye image 362 and the right eye image 364 are visible to the user's eyes. Since the image for left eye 362 and the image for right eye 364 have the same center in the vicinity of the pre-division image 350 and the vicinity thereof, this common portion appears to overlap with both eyes of the user. In this case, the user recognizes the portion that appears to overlap both eyes as an index for superimposing the images, so that the pre-division image 350 can be easily recognized from the left-eye image 362 and the right-eye image 364.

When the display color of the pseudo image areas 362B and 364B is darker than the image areas 362A and 364A, the brightness of the overlapping area where the image areas 362A and 364A overlap is brighter than the image areas 362A and 364A other than the overlapping area. Become. In order to prevent this kind of discomfort, the luminance of the overlapping area may be reduced. Specifically, the image processing unit 160 performs a process of reducing the pixel value or luminance of the overlapping region on the left-eye image 362 and the right-eye image 364, and outputs the processed data from the transmission units 51 and 52. May be.
Further, when the display colors of the pseudo image areas 362B and 364B are brighter than the image areas 362A and 364A, or when the display area has the same luminance as the image areas 362A and 364A, the image areas 362A and 364A overlap. The brightness of the area may be equal to that other than the overlapping area. In this case, there is little possibility that the above-mentioned uncomfortable feeling will be caused.
Therefore, the image processing unit 160 may determine the colors of the set pseudo image areas 362B and 364B and determine whether or not the luminance of the overlapping area needs to be adjusted according to the colors. Then, when it is determined that adjustment is necessary, the process of adjusting the brightness of the image data in the overlapping region as described above may be performed to output the image data to the right display drive unit 22 and the left display drive unit 24. .

The size of the common part (overlapping part) of the image for left eye 362 and the image for right eye 364 is not limited to the example shown in FIG. If this overlapping part is large, it is effective for the user because the index for synthesizing the images that can be seen by the left and right eyes becomes clear. However, even if the overlapping part is small, the effect as an index is sufficient. .
Further, the larger the overlapping portion is, the closer the image to be processed by the image processing unit 160 is to two of the pre-division image 350. That is, the effect of dividing the pre-division image 350 to generate the left-eye image and the right-eye image is reduced. Therefore, it is preferable that the size of the overlapped portion has such a size that an effect as an index for the user to superimpose images is obtained and is small.

In addition, the pre-division image 350 can be divided into a number of regions to form a left-eye image and a right-eye image.
FIG. 7 is a diagram illustrating an example in which the pre-division image 350 is divided at a plurality of positions in the vertical direction. FIG. 7A shows a divided image 371 composed of a plurality of divided image pieces 371A, and FIG. 7B shows a divided image 373 composed of a plurality of divided image pieces 373A. FIG. 7C shows a left-eye image 372 based on the divided image 371, and FIG. 7D shows a right-eye image 374 based on the divided image 373.

  In this example, the aforementioned pre-division image 350 is divided in units of lines in the horizontal direction and divided into a plurality of divided image pieces 371A and 373A elongated in the horizontal direction. The divided image pieces 371A and 373A may be, for example, an image for one line or an image for a plurality of lines. The image processing unit 160 divides the image divided in line units into a divided image piece 371A for the left eye and a divided image piece 373A for the right eye. For example, the image processing unit 160 distributes the divided image piece 371A and the divided image piece 373A in order from the top of the pre-division image 350. By this processing, the image processing unit 160 obtains a divided image 371 that is a set of divided image pieces 371A for the left eye and a divided image 373 that is a set of divided image pieces 373A for the right eye.

The image processing unit 160 sets the divided image 371 as an image region 372A, adds a pseudo image region 372B made of dummy data to a blank portion between the image regions 372A, and obtains a left-eye image 372. Similarly, the image processing unit 160 sets the divided image 373 as an image region 374A, and adds a pseudo image region 374B made of dummy data to a blank portion between the image regions 374A to obtain a right-eye image 374. The size of the left eye image 372 and the right eye image 374 is the same as that of the pre-division image 350.
The pseudo image area 372B of the left-eye image 372 includes the same number of image pieces as the image area 374A of the right-eye image 374, and each image piece has the same size and the same number of pixels. The pseudo image area 374B includes the same number of image pieces as the image area 372A, and each image piece has the same size and the same number of pixels.

The image processing unit 160 outputs the left-eye image 372 from the transmission unit 52 and causes the left display drive unit 24 and the left optical image display unit 28 to display the right-eye image 374 from the transmission unit 51 and displays the right-side display. The image is displayed on the drive unit 22 and the right optical image display unit 26. Thereby, the same effect as the example demonstrated in FIGS. 4-6 is acquired.
That is, the user recognizes the pre-division image 350 in which the left-eye image 372 and the right-eye image 374 are superimposed. Then, by dividing the pre-division image 350, the processing load of the entire control unit 140 is reduced compared to the case where the image processing unit 160 outputs the whole pre-division image 350 to each of the transmission unit 51 and the transmission unit 52. Can be reduced.

The pseudo image area 372B corresponds to the image area 374A, and the pseudo image area 372B corresponds to the image area 374A. For this reason, when the image is synthesized by the action of the user's brain, the image and the dummy data are superimposed, so that the image is naturally superimposed, and the user can recognize the pre-division image 350 without difficulty. .
Furthermore, since the pre-division image 350 is divided in units of horizontal lines, the number of the divided image pieces 371A and 373A can be increased in the divided divided images 371 and 373. In this case, since each of the divided images 371 and 373 includes the upper part to the lower part of the pre-division image 350, the left-eye image 372 and the right-eye image 374 are images that are close to the pre-division image 350. Make users aware. Since the user can visually recognize an image close to the pre-division image 350 with both eyes, the user's discomfort can be reduced.

Further, as shown in FIG. 8, the image may be divided in units of vertical lines.
FIG. 8A shows a divided image 375 constituted by a plurality of divided image pieces 375A, and FIG. 8B shows a divided image 377 constituted by a plurality of divided image pieces 377A. 8C shows a left-eye image 376 based on the divided image 375, and FIG. 8D shows a right-eye image 378 based on the divided image 377.

  In this example, the aforementioned pre-division image 350 is divided in units of vertical lines and divided into a plurality of divided image pieces 375A and 375A that are elongated in the vertical direction. The divided image pieces 375A and 375A may be, for example, an image for one line or an image for a plurality of lines. The image processing unit 160 divides the image divided in line units into a divided image piece 375A for the left eye and a divided image piece 375A for the right eye. For example, the image processing unit 160 distributes the divided image piece 375A and the divided image piece 375A in order from the left in the pre-division image 350. By this processing, the image processing unit 160 obtains a divided image 375 that is a set of divided image pieces 375A for the left eye and a divided image 377 that is a set of divided image pieces 377A for the right eye.

  The image processing unit 160 sets the divided image 375 as an image region 376A, and adds a pseudo image region 376B made of dummy data to a blank portion between the image regions 376A to obtain a left-eye image 376. Similarly, the image processing unit 160 sets the divided image 377 as an image region 378A, and adds a pseudo image region 378B made of dummy data to a blank portion between the image regions 378A to obtain a right-eye image 378. The size of the left eye image 376 and the right eye image 378 is the same as that of the pre-division image 350. The pseudo image area 376B of the left-eye image 376 is composed of the same number of image pieces as the image area 378A of the right-eye image 378, and each image piece has the same size and the same number of pixels. The pseudo image area 378B includes the same number of image pieces as the image area 376A, and each image piece has the same size and the same number of pixels.

  The image processing unit 160 outputs the left-eye image 376 from the transmission unit 52 and displays it on the left display drive unit 24 and the left optical image display unit 28, and outputs the right-eye image 378 from the transmission unit 51 for right display. The image is displayed on the drive unit 22 and the right optical image display unit 26. In this case, the same effect as the example described with reference to FIG. 7 is obtained only in the direction in which the pre-division image 350 is divided.

FIG. 9 shows an example in which the pre-division image 350 is divided into rectangular image pieces.
FIG. 9A shows a divided image 379 made up of a plurality of divided image pieces 379A, and FIG. 9B shows a divided image 381 made up of a plurality of divided image pieces 381A. 8C shows a left-eye image 380 based on the divided image 379, and FIG. 8D shows a right-eye image 382 based on the divided image 381.

  In this example, the aforementioned pre-division image 350 is divided into rectangular divided image pieces including several dots of pixels in the vertical and horizontal directions. The image processing unit 160 divides the divided image piece into a divided image piece 379A for the left eye and a divided image piece 381A for the right eye. For example, the image processing unit 160 distributes the divided image pieces 379A and the divided image pieces 381A one by one in order from the upper left in the pre-division image 350.

The image processing unit 160 sets the divided image 379 as an image region 380A, and adds a pseudo image region 380B made of dummy data to a blank portion between the image regions 380A to obtain a left-eye image 380. Similarly, the image processing unit 160 sets the divided image 381 as an image region 382A, and adds a pseudo image region 382B made of dummy data to a blank portion between the image regions 382A to obtain a right-eye image 382. The size of the left eye image 380 and the right eye image 382 is the same as that of the pre-division image 350.
Further, the pseudo image area 380B of the left-eye image 380 has the same number of image pieces as the image area 382A of the right-eye image 382, and each image piece has the same size and the same number of pixels. The pseudo image area 382B has the same number of image pieces as the image area 380A, and each image piece has the same size and the same number of pixels.

  The image processing unit 160 outputs the left-eye image 380 from the transmission unit 52 and causes the left display drive unit 24 and the left optical image display unit 28 to display the right-eye image 382 from the transmission unit 51 to display the right-eye. The image is displayed on the drive unit 22 and the right optical image display unit 26. In this case, the same effect as the example described with reference to FIGS. 7 and 8 is obtained only in the direction in which the pre-division image 350 is divided.

  In this manner, the image processing unit 160 divides the display target image (the pre-division image 350) in various forms, and based on the divided images, the left eye image and the right eye image are transmitted to the transmission unit 51, 52. The image processing unit 160 may be able to execute only a part of the examples shown in FIGS. 4 to 9 or may be able to execute all the processes. Moreover, you may divide | segment the image of a display target with forms other than having illustrated in FIGS.

  As described above, the head-mounted display device 100 according to the embodiment to which the present invention is applied includes the left optical image display unit 28 that displays an image corresponding to the left eye of the user, and the right side of the user. A right optical image display unit 26 that displays an image corresponding to the eye is provided. The head-mounted display device 100 divides the image to be displayed, and the left-eye image and the right-eye image including the divided images are displayed on the left optical image display unit 28 and the right optical image display unit 26. An image processing unit 160 for outputting is provided. The left-eye image and the right-eye image include an image region composed of images divided by the image processing unit 160 and a pseudo-image region, and one of the left-eye image and the right-eye image is simulated. The state of the image area corresponds to the state of the other image area. As a result, processing such as higher resolution and enlargement of the image to be displayed is not involved, or the processing load can be suppressed. Furthermore, the transfer speed for transferring the image to the display unit can be suppressed. Further, if the process of generating the pseudo image area and the pseudo image area are simplified, the load can be easily suppressed. Accordingly, it is possible to make the user visually recognize the target image while suppressing the load related to the display of the image.

  Further, when the left-eye image and the right-eye image displayed by the head-mounted display device 100 are displayed on the left optical image display unit 28 and the right optical image display unit 26, the image to be displayed to the user. Therefore, the user can be shown an image similar to the image before the division. Therefore, the target image can be displayed by dividing the image using the two display units, reducing the processing load.

Further, the image processing unit 160 associates the position of the image area in the left eye image and the right eye image with the position of the divided image in the display target image, so that the position of the divided image does not change. Are displayed on the left optical image display unit 28 and the right optical image display unit 26. For this reason, a user can visually recognize one display target image using two display units.
In addition, the image display unit 20 displays an image so that it can be seen through the outside scene and the outside scene, and the image processing unit 160 displays a pseudo image area in at least one of the left-eye image and the right-eye image. The form may be adjusted. Specifically, when the pseudo image areas 352B and 354B (FIG. 4) are black, there is no image light in portions corresponding to the pseudo image areas 352B and 354B. In this case, since the image light of the divided image 351 and the image light of the divided image 353 are incident on the user's eyes, the image light of the dummy data is not incident on the user's eyes, so the amount of image light incident on the user's eyes Is substantially equivalent to one screen of the pre-division image 350. Therefore, the user can easily recognize the pre-division image 350. On the other hand, when the pseudo image areas 352B and 354B are configured in white, portions corresponding to the pseudo image areas 352B and 354B are irradiated with the image light of the pixel having the maximum luminance. In this case, the image light of the divided image 351 and the image light of the divided image 353 are incident on the user's eyes, and further, white image light corresponding to the dummy data is incident. In this way, the appearance of the pre-division image can be adjusted by changing the display form of the pseudo image region, for example, by changing the display color to black or white.
The display form of the pseudo image area is not limited to the display color when the pseudo image area is configured with a uniform color, and may be the hue and brightness of the pseudo image area. In the above example, since the color of the dummy data is an achromatic color, it does not hinder the user from recognizing the pre-division image 350 by combining the divided images 351 and 353. However, the color of the pseudo image area may be a chromatic color. In this case, the hue of the pre-division image 350 visually recognized by the user can be changed by the influence of the color of the pseudo image area.
Furthermore, when the luminance of the pseudo image areas 352B and 354B is low, an outside scene is easily seen at a position overlapping the pseudo image areas 352B and 354B, so that the user perceives external light. On the other hand, when the luminance of the pseudo image areas 352B and 354B is high, the outside scene is difficult to transmit, so that the user can visually recognize the pre-division image 350 without being influenced by the outside scene.
Note that the display form of the pseudo image area may not be constant and may be changed. In this case, the image processing unit 160 may change the display form (color, luminance, color tone, etc.) of the pseudo image area in accordance with the change in luminance and color tone of the pre-division image 350 to be displayed. Alternatively, when the pre-division image 350 does not change, the display form of the pseudo image area may be changed as time passes.

Further, as described with reference to FIG. 6, the image processing unit 160 extracts the divided images 361 and 363 having overlapping portions from the pre-division image 350, and each of the divided images 361 and 363 is left eye. The image regions of the image for use 362 and the image for right eye 364 may be used. In this case, since the joints of the images displayed by the left optical image display unit 28 and the right optical image display unit 26 are hardly noticeable, it is possible to reduce the user's uncomfortable feeling and display a high-quality image.
In addition, as described with reference to FIGS. 7 to 9, the image processing unit 160 arranges a plurality of image areas and a plurality of pseudo image areas in each of the left-eye image and the right-eye image. Also good. In this case, the image for the left eye and the image for the right eye are combined in a more complicated shape to allow the user to visually recognize the display target image. For this reason, for example, the image to be displayed can be divided and displayed in a shape that is easy for the user to visually recognize.
Further, in the head-mounted display device 100, the image processing unit 160 is positioned at a position common to the left-eye image and the right-eye image as described with reference to FIGS. 4 (F) and 4 (G). A predetermined index (overlapping position mark M) may be included. Furthermore, the display sizes of the left optical image display unit 28 and the right optical image display unit 26 may be made equal. In this case, since the index is arranged at a common position, the correspondence between the image displayed by the right optical image display unit 26 and the image displayed by the left optical image display unit 28 becomes clear. There is an advantage that the user can easily recognize one display target image from the images of the two display units.

  In addition, the image processing unit 160 arranges an image area and a pseudo image area in a predetermined area in the left eye image and the right eye image. For this reason, it is possible to reduce the load of processing for dividing the image to be displayed by the image processing unit 160 and processing for generating the image for the left eye and the image for the right eye by combining the divided image with the pseudo image area.

In addition, the right optical image display unit 26 and the left optical image display unit 28 constitute an image display unit 20 that displays an image so that the outside scene is transmitted and can be visually recognized together with the outside scene. The user can see the left-eye image and the right-eye image including the divided images so as to overlap the outside scene.
In this configuration, it is possible to adjust the appearance of the left-eye image and the right-eye image by adjusting the display color, display brightness, or light amount of the entire image of the left-eye image and right-eye image. For example, it is possible to adjust the luminance or the amount of light according to the amount of external light so that the image to be displayed can be seen more easily than the outside scene, or the outside scene can be seen easily.
Furthermore, by adjusting the color and / or brightness of the pseudo image area included in the left-eye image and the right-eye image, the appearance of the left-eye image and the right-eye image can be adjusted. For example, when the amount of external light is high, the luminance of the pseudo image area can be increased to make the display target image appear brighter. In addition, for example, when the amount of external light is low, the luminance of the pseudo image region can be lowered to darken the image to be displayed and make it easier to see according to the outside scene. Conversely, when the amount of external light is low, the luminance of the pseudo image area can be increased to make the display target image stand out.

In addition, this invention is not restricted to the structure of the said embodiment, In the range which does not deviate from the summary, it can be implemented in a various aspect.
For example, in the above-described embodiment, an example in which the rectangular pre-division image 350 is divided and displayed has been described. However, the size, shape, number of pixels, type of color image or black-and-white image, and moving image are displayed. It is not limited as to whether it is a still image.
Further, in the above-described embodiment, the image processing unit 160 has been described as a configuration in which a digital image signal constituting a content image is stored in a DRAM for each frame and divided to generate a divided image. The present invention is not limited to this. For example, when an analog image signal is input from the image supply device OA, the image processing unit 160 may divide the analog image signal. Further, the image processing unit 160 may generate and synthesize an analog image signal in the pseudo image area in a configuration in which analog image signals are output to the right display driving unit 22 and the left display driving unit 24, respectively. That is, the image processing unit 160 generates the first image and the second image by combining the analog image signal of the pseudo image region with the analog image signal output to the right display driving unit 22 and the left display driving unit 24. It may be output.
Further, one of the direction key 16 and the track pad 14 provided in the control device 10 is omitted, or in addition to the direction key 16 or the track pad 14 or in place of the direction key 16 or the track pad 14, an operation stick or the like. An operation interface may be provided. Moreover, the control apparatus 10 is a structure which can connect input devices, such as a keyboard and a mouse | mouth, and is good also as what receives an input from a keyboard or a mouse | mouth.

  Further, as the image display unit, instead of the image display unit 20, another type of image display unit such as an image display unit worn like a hat may be adopted, corresponding to the left eye of the user. What is necessary is just to provide the display part which displays an image, and the display part which displays an image corresponding to a user's right eye. The display device of the present invention may be configured as a head mounted display mounted on a vehicle such as an automobile or an airplane. Moreover, for example, it may be configured as a head-mounted display built in a body protective device such as a helmet, or may be a head-up display (HUD) used for a windshield of an automobile. Furthermore, for example, a binocular-type hand held display (Hand Held Display) that the user uses with both hands may be employed as the image display unit 20 of the present application. Furthermore, the user's eyeball forms an image on the retina such as a so-called contact lens type display that is worn on the user's eyes (for example, on the cornea) and an implant type display that is embedded in the eyeball. The display may be the image display unit 20. In either case, the display unit that causes the user's one eye to recognize the image can be the first display unit, and the display unit that causes the other eye to recognize the image can be the second display unit.

Furthermore, in the above embodiment, the image display unit 20 and the control device 10 are separated and connected by way of the connection unit 40, but the control device 10 and the image display unit 20 are integrated. It is also possible to be configured to be mounted on the user's head.
In addition, the control device 10 and the image display unit 20 are connected by a longer cable or a wireless communication line. As the control device 10, a notebook computer, a tablet computer or a desktop computer, a game machine, a portable phone, a smartphone, A portable electronic device including a portable media player, other dedicated devices, or the like may be used.

  Further, for example, as a configuration for generating image light in the image display unit 20, a configuration including an organic EL (Organic Electro-Luminescence) display and an organic EL control unit may be used, or an LCOS (Liquid crystal) may be provided. On silicon and LCoS are registered trademarks), and digital micromirror devices can also be used. Further, for example, the present invention can be applied to a laser retinal projection type head mounted display. That is, the image generation unit includes a laser light source and an optical system that guides the laser light source to the user's eye, makes the laser light enter the user's eye, scans the retina, and forms an image on the retina. A configuration that allows the user to visually recognize an image may be employed. When a laser retina projection type head-mounted display is employed, the “image light emitting area in the image light generation unit” can be defined as an image area recognized by the user's eyes.

  As an optical system that guides image light to the user's eyes, an optical member that transmits external light that is incident from the outside toward the apparatus and that enters the user's eyes together with the image light can be employed. Moreover, you may use the optical member which is located ahead of a user's eyes and overlaps a part or all of a user's visual field. Further, a scanning optical system that scans a laser beam or the like to obtain image light may be employed. Further, the optical member is not limited to guiding the image light inside the optical member, and may have only a function of guiding the image light by refracting and / or reflecting it toward the user's eyes.

  Further, the present invention can be applied to a display device that employs a scanning optical system using a MEMS mirror and uses MEMS display technology. That is, as an image display element, a signal light forming unit, a scanning optical system having a MEMS mirror that scans light emitted from the signal light forming unit, and an optical member on which a virtual image is formed by light scanned by the scanning optical system May be provided. In this configuration, the light emitted from the signal light forming unit is reflected by the MEMS mirror, enters the optical member, is guided through the optical member, and reaches the virtual image forming surface. When the MEMS mirror scans the light, a virtual image is formed on the virtual image forming surface, and the user recognizes the virtual image with the eyes, thereby recognizing the image. The optical component in this case may be one that guides light through a plurality of reflections, such as the right light guide plate 261 and the left light guide plate 262 of the above embodiment, and may use a half mirror surface. .

  The display device of the present invention is not limited to a head-mounted display device, and can be applied to various display devices such as a flat panel display and a projector. The display device of the present invention may be any device that allows an image to be visually recognized by external light and image light. For example, a configuration in which an image by image light is visually recognized by an optical member that transmits external light is exemplified. Specifically, the above-described head-mounted display includes an optical member that transmits external light, and a light-transmitting plane or curved surface (glass) that is fixedly or movably installed at a position away from the user. It is also applicable to a display device that projects image light onto a transparent plastic or the like. As an example, a configuration of a display device that projects image light onto a window glass of a vehicle and allows a user who is on board or a user outside the vehicle to visually recognize the scenery inside and outside the vehicle together with an image by the image light. It is done. In addition, for example, image light is projected onto a transparent, semi-transparent, or colored transparent display surface that is fixedly installed such as a window glass of a building, and is displayed together with an image by the image light to a user around the display surface. A configuration of a display device that visually recognizes a scene through the surface can be given.

  In addition, at least a part of each functional block shown in FIG. 2 may be realized by hardware, or may be realized by cooperation of hardware and software, as shown in FIG. It is not limited to a configuration in which independent hardware resources are arranged. The program executed by the control unit 140 may be stored in the storage unit 120 or the storage device in the control device 10, or the program stored in an external device is acquired via the communication unit 117 or the interface 180. It is good also as a structure to execute. Of the configurations formed in the control device 10, only the operation unit 135 may be formed as a single user interface (UI), or the power source 130 in the above embodiment is formed independently and is replaceable. It may be a configuration. Further, the configuration formed in the control device 10 may be formed in the image display unit 20 in an overlapping manner. For example, the control unit 140 illustrated in FIG. 2 may be formed in both the control device 10 and the image display unit 20, or the control unit 140 formed in the control device 10 and the CPU formed in the image display unit 20. It is good also as a structure by which the function to perform is divided | segmented separately.

  DESCRIPTION OF SYMBOLS 10 ... Control apparatus, 20 ... Image display part, 21 ... Right holding part, 22 ... Right display drive part (2nd display part), 23 ... Left holding part, 24 ... Left display drive part (1st display part), 26 ... right optical image display unit (second display unit), 28 ... left optical image display unit (first display unit), 100 ... head-mounted display device (display device), 117 ... communication unit, 120 ... storage unit, DESCRIPTION OF SYMBOLS 140 ... Control part, 150 ... Operating system, 160 ... Image processing part, 164 ... Division | segmentation control part, 170 ... Audio | voice processing part, 180 ... Interface, 190 ... Display control part, 201 ... Right backlight control part, 202 ... Left back Light control unit 211 ... Right LCD control unit 212 ... Left LCD control unit 221 ... Right backlight 222 ... Left backlight 241 ... Right LCD 242 ... Left LCD 251 ... Right projection optical system 252 ... Left Projection optics , 261 ... Migishirubekoban, 262 ... Hidarishirubekoban.

Claims (12)

A first display unit that displays an image corresponding to the left eye of the user, and a second display unit that displays an image corresponding to the right eye of the user;
An image processing unit that divides an image to be displayed and outputs a first image and a second image including the divided image to the first and second display units,
The first image and the second image having the same size and the same number of pixels as the image to be displayed are an image area composed of images divided by the image processing unit, and a pseudo image composed of dummy data Area and
The one position of the false image region of the first image and the second image is Rukoto included in the position of the other of the image area,
A display device.   The first image and the second image are images that are visually recognized as a display target image by a user when displayed on the first display unit and the second display unit. The display device according to claim 1. Wherein the image processing unit, a position of the image regions in the first image and the second image, and wherein to Rukoto, the position of the divided image in the image to be displayed according to claim 1 or 2 The display device described. The first display unit and the second display unit transmit the outside scene and display the image so as to be visible together with the outside scene.
The display according to claim 1, wherein the image processing unit is capable of adjusting a display color of the pseudo image area in at least one of the first image and the second image. apparatus. 5. The display device according to claim 1, wherein the image regions of the first image and the second image have portions that overlap each other . Wherein the image processing unit, each of the first image and the second image, the image area and the placing pseudo image areas one by one, from claim 1, wherein according to any one of the 5 Display device.   6. The image processing unit according to claim 1, wherein the image processing unit arranges a plurality of the image regions and a plurality of the pseudo image regions in each of the first image and the second image. The display device described.   The display size in which the first image is displayed on the first display unit and the display size in which the second image is displayed on the second display unit are set to be the same. 8. The display device according to any one of 7.   The display device according to claim 1, wherein the first image and the second image include a predetermined index at a common position.   The display device according to claim 1, wherein the first display unit and the second display unit display the first image and the second image at different timings. A control method of a display device including first and second display units,
Divide the image to be displayed,
Displaying a first image and a second image corresponding to the divided image on the first and second display units;
The first image and the second image having the same size and the same number of pixels as the image to be displayed , including an image area composed of the divided images and a pseudo image area composed of dummy data ; and that the image position of one the false image region of the first image and the second image is Ru contained in the position of the other of the image area,
A control method of a display device characterized by the above. A program that can be executed by a computer that controls a display device including first and second display units,
The computer,
Image processing for dividing a display target image and outputting the first image and the second image having the same size and the same number of pixels as the display target image including the divided image to the first and second display units Function as a part,
The first image and the second image include an image region composed of images divided by the image processing unit and a pseudo image region composed of dummy data, and the first image and the second image wherein the position of the false image region be included in the position of the other of the image area of one of the,
A program characterized by

Images