JP6339887B2 - Image display device - Google Patents

Description

  The present invention relates to an image display device, and more particularly, to an improvement of an image display device that displays an image on a display area visible to a user.

  An HMD (Head Mounted Display) is an image display device worn on a user's head, and projects a video on a screen arranged in front of both eyes or one of the eyes, thereby giving the user VR (Virtual Reality: Virtual Reality). ) Is known as one of wearable devices for experiencing (see, for example, Patent Document 1). In this type of image display device, since the user's field of view is blocked by the screen, it is not easy to visually check the positions of hands and fingers, and operations when operating input devices such as a keyboard and a mouse are not easy. There was a problem that the nature was not good.

  In Patent Document 1, an icon indicating an operation target is virtually displayed, while the operator's hand or finger is photographed by a camera, the operator's movement with respect to the icon is detected, and the movement of the hand or finger is displayed. Techniques for manipulating icons are disclosed. According to this technique, it is possible to operate a virtually displayed icon without actually confirming the position of the hand or the input device.

JP-A-8-6708

  However, the conventional image display apparatus as described above has a problem that the display range is narrowed by the amount of the icon because the icon indicating the operation target needs to be displayed in the display area. Further, since the icon is operated by detecting the movement of the hand or finger, there is a problem that the image being displayed in the display area cannot be enlarged or reduced when both hands are blocked.

  The present invention has been made in view of the above circumstances, and an image display device capable of improving the operability when enlarging or reducing an image being displayed in a display area without narrowing the display range. The purpose is to provide. In particular, an object of the present invention is to provide an image display apparatus capable of easily enlarging or reducing a display image even when both hands are closed.

  An image display device according to the present invention includes a head detection unit that detects a movement of a user's head, an image display unit that includes a display area that is visible to the user, and displays a display image on the display area; A scaling factor determining unit that determines a scaling factor based on the detection result of the head; and a scaling unit that scales the display image based on the scaling factor, wherein the scaling factor determining unit includes the head The scaling factor is changed according to the movement in the front-rear direction.

  According to such a configuration, since the movement of the user's head is detected and the scaling factor of the display image is changed according to the movement of the head in the front-rear direction, only by moving the head forward or backward, The display image on the display area can be enlarged or reduced. Further, since it is not necessary to display an operation object such as an icon in the display area, it is possible to prevent the display range from being narrowed by the operation object.

  According to the present invention, it is possible to provide an image display device with improved operability when enlarging or reducing an image being displayed in the display area without narrowing the display range. In particular, it is possible to provide an image display apparatus capable of easily enlarging or reducing a display image even when both hands are closed.

It is the perspective view which showed one structural example of the image display apparatus 1 by Embodiment 1 of this invention. It is explanatory drawing which showed typically the structural example of the image display part 12 of FIG. 1, and the case where the left eye display part 12L is seen from the top is shown. It is the figure which showed an example of operation | movement of the image display apparatus 1 of FIG. 1, and the left-eye display part 12L and the right-eye display part 12R which display the display image for left eyes and right eyes, respectively are shown. It is the block diagram which showed the structural example of the controller part 20 of FIG. It is explanatory drawing which showed typically an example of operation | movement of the image display apparatus 1 of FIG. 1, and the case where a user's head 5 is moved to the front-back direction and a display image is expanded or reduced is shown. FIG. 2 is a diagram showing an example of the operation of the image display apparatus 1 in FIG. 1, and a predetermined magnification change area AE is shown in the display area 126. 3 is a flowchart illustrating an example of an operation at the time of moving image shooting in the image display device 1 of FIG. 1. It is the perspective view which showed one structural example of the image display apparatus 1 by Embodiment 2 of this invention, and the HUD type image display part 30 installed in the inside of a motor vehicle is shown. It is the figure which showed an example of operation | movement of the image display apparatus 1 of FIG. 8, and the projection area 34 divided | segmented into the three display areas 34a-34c is shown. FIG. 9 is a block diagram illustrating a configuration example of a controller unit 40 in the image display device 1 of FIG. 8.

Embodiment 1 FIG.
<Image display device 1>
FIG. 1 is a perspective view showing a configuration example of an image display device 1 according to Embodiment 1 of the present invention. In the figure, an image display device 1 including a headset unit 10 and a controller unit 20 connected to each other via a connection cable 2 is shown. The image display device 1 is a glasses-type HMD, and includes a headset unit 10 that is worn on a user's head and a controller unit 20 that controls the headset unit 10.

  The headset unit 10 is a head-mounted unit, and includes an acceleration sensor 3, a line-of-sight detection camera 4 and a frame unit 11, and an image display unit 12 including a left-eye display unit 12L and a right-eye display unit 12R.

  The frame portion 11 is arranged in front of the eye and includes a lens holding portion 11a having a shape extending in the left-right direction along the face and a temple portion 11b having a shape extending in the front-rear direction along the temporal region. The image display unit 12 displays video and makes the user visually recognize it. The left-eye display unit 12L is a display unit for causing the user's left eye to visually recognize an image, and is disposed in front of the left eye. The right eye display unit 12R is a display unit for allowing the user's right eye to visually recognize an image, and is disposed in front of the right eye. The left eye display unit 12L and the right eye display unit 12R are held by the lens holding unit 11a of the frame unit 11.

  The acceleration sensor 3 is a sensor that detects acceleration generated in the frame unit 11 in order to detect movement of the user's head. For example, the acceleration sensor 3 is a mechanical displacement measurement type capacitive sensor that detects a minute change in position of a movable body connected to a return spring based on a change in capacitance. The acceleration sensor 3 is disposed on the temple portion 11 b of the frame portion 11.

  The camera 4 is an imaging device that photographs a user's eyes as a subject in order to detect the user's line of sight, and includes a light projecting device, an imaging lens, and an imaging element. The light projecting device is an illumination device that emits detection light toward an eyeball, and includes a light emitting element that generates detection light and a light projection lens that converts the detection light into parallel light. For example, infrared light is used as the detection light, and an LED (light emitting diode) is used as the light emitting element.

  The imaging lens is an optical element that forms an image of the detection light reflected by the cornea on the light receiving surface of the imaging element. The image sensor is an image sensor that receives detection light and converts the light and darkness of the imaged image into an electric signal to generate a captured image. For example, a CCD (Charge Coupled Device) image sensor is used for the imaging device. The camera 4 is disposed in the lens holding part of the frame part 11. This camera 4 is a camera for photographing the left eye, and is disposed above the left eye display unit 12L in the lens holding unit 11a.

  The controller unit 20 is a control unit that receives user operations and controls the headset unit 10, and is provided with a camera 21, a touch panel 22, and operation keys 23 on the front surface of a rectangular parallelepiped thin casing. For example, the controller unit 20 includes a mobile phone having various functions including a call function.

  The camera 21 is an imaging device that captures a scene in front of the controller unit 20 as a subject. The touch panel 22 is a display device that has a display screen on which various types of information are displayed and detects a touch operation on the display screen. The operation key 23 is a push-type contact switch, and various functions are assigned to it. For example, a function for switching between enabling and disabling a zoom function described later is assigned to the operation key 23.

  The controller unit 20 generates image data for projection, detects the movement of the head based on the output of the acceleration sensor 3, and detects the line of sight based on the image data captured by the camera 4. To do.

<Image display unit 12>
FIG. 2 is an explanatory diagram schematically showing a configuration example of the image display unit 12 of FIG. 1, and shows a case where the left eye display unit 12L is viewed from above. The left-eye display unit 12L is an optically transmissive display device that can directly recognize the appearance of the outside world, and includes a projection device 121, a light projection lens 122, a prism 123, a light guide plate 124, and a half mirror layer 125.

  The projection device 121 is a device that projects a display image, and is arranged facing forward. For example, the projection device 121 includes a liquid crystal panel that displays an image on a display screen, and a backlight that generates visible light by irradiating the display screen of the liquid crystal panel with visible light from the back side.

  The prism 123 is disposed in front of the projection device 121 and reflects image light incident from the projection device 121 via the light projection lens 122 toward the half mirror layer 125. The light guide plate 124 is a substantially rectangular flat plate-shaped optical element that accommodates the prism 123 and the half mirror layer 125. The light guide plate 124 is disposed so as to intersect the line of sight, and guides the video light incident on the right end to the half mirror layer 125. Shine. The half mirror layer 125 reflects the image light incident from the prism 123 rearward, and transmits external light incident from the front.

  FIG. 3 is a diagram illustrating an example of the operation of the image display device 1 of FIG. 1, and shows a left-eye display unit 12 </ b> L and a right-eye display unit 12 </ b> R that display a left-eye display image and a right-eye display image, respectively. In the figure, a state in which the lens holding portion 11a of the frame portion 11 is viewed from the rear is shown.

  In the left eye display unit 12L and the right eye display unit 12R, display areas 126 that are visible to the user are formed corresponding to the positions of the half mirror layer 125, and display images made of video light reflected by the half mirror layer 125 are displayed. Is displayed on the display area 126.

  For example, the display area 126 has a horizontally long rectangular shape. In the left and right display areas 126, left-eye and right-eye display images are displayed, respectively. By using such a headset unit 10, the user can view the video in an arbitrary posture.

  The video displayed on the image display unit 12 is obtained by receiving a captured image captured by the camera 21, an image acquired from an external device, a navigation map including a route from the current location to the destination, and broadcast waves. There is a TV image. For example, a moving image captured by the camera 21 is displayed on the image display unit 12. In addition, video content downloaded from a website on the Internet is displayed on the image display unit 12. These videos are supplied as a moving image or a still image consisting of a monochrome image or a color image.

  In the image display device 1, an operation of detecting the movement of the user's head and enlarging or reducing the image being displayed in the display area 126 is performed. The display image is enlarged or reduced with the line-of-sight position in the display area 126 as the center.

<Controller unit 20>
FIG. 4 is a block diagram showing a configuration example of the controller unit 20 of FIG. The controller unit 20 includes a camera 21, an operation key 23, a captured image storage unit 201, a head detection unit 211, a scaling magnification determination unit 212, a scaling unit 213, a display image storage unit 214, a communication unit 215, a line-of-sight detection unit 221, A scaling center determination unit 222 and a magnification change permission unit 223 are included.

  The captured image storage unit 201 holds captured images captured by the camera 21. The head detection unit 211 detects the movement of the user's head based on the output of the acceleration sensor 3, and outputs the detection result to the scaling magnification determination unit 212. For example, the movement of the head in the front-rear direction is detected based on the acceleration component in the front-rear direction. That is, the moving distance and moving direction of the head are detected.

  The scaling factor determination unit 212 determines a scaling factor that defines the size of the image displayed in the display area 126 based on the detection result of the head. Specifically, an operation for changing the scaling magnification is performed according to the movement of the head in the front-rear direction. For example, when the head moves forward beyond a predetermined distance D1, the scaling factor is changed by a certain amount to enlarge the display image. On the other hand, when the head moves backward beyond a predetermined distance D2, the scaling factor is changed by a certain amount to reduce the display image.

  The scaling unit 213 scales the display image based on the scaling factor. For example, the scaling unit 213 generates a display image to be displayed on the image display unit 12 by reading the captured image from the captured image storage unit 201 and converting the image size according to the scaling magnification. To store. Further, the scaling unit 213 updates the display image in the display image storage unit 214 when the scaling magnification is changed. The communication unit 215 communicates with the headset unit 10 via the connection cable 2, reads a display image from the display image storage unit 214, and transmits the display image to the image display unit 12.

  According to such a configuration, the scaling magnification is changed according to the movement of the head in the front-rear direction, and the display image is updated, so that the display image can be enlarged or moved by moving the head forward or backward. Can be reduced. Here, in order to prevent the display image from being enlarged or reduced by mistake, the scaling factor determination unit 212 activates the zoom function linked to the movement of the head based on the pressing operation of the operation key 23, Within the period in which the zoom function is valid, an operation of changing the scaling magnification according to the movement of the head is performed.

  The enlargement or reduction of the display image referred to here is an enlargement or reduction of the display size of the image in the display area 126. Therefore, when the number of pixels of the captured image is larger than that of the display image, the display image is produced by reducing the image size using the captured image as the original image. For example, the reduction process of the original image is performed by thinning out pixel data according to the scaling factor. Therefore, the process of enlarging or reducing the display image A to the display image B is performed by changing the reduction ratio when the display images A and B are generated from the common original image.

  Further, when the camera 21 can optically change the shooting magnification, the configuration may be such that the scaling magnification of the display image is changed by changing the shooting magnification of the camera 21.

  The line-of-sight detection unit 221 detects the user's line of sight based on the captured image captured by the camera 4 and outputs the detection result to the scaling center determination unit 222 and the magnification change permission unit 223. For example, the gaze direction is estimated from the rotation angle of the eyeball by analyzing the feature points of the captured image and specifying the outline of the eyeball, the cornea, and the position of the iris. Further, the line-of-sight position P on the display area 126 is estimated by specifying the relative positional relationship between the camera 4 and the eyeball.

  The scaling center determination unit 222 determines the scaling center SC on the display image based on the line-of-sight detection result. For example, the scaling center determination unit 222 specifies a position on the display image corresponding to the line-of-sight position P as the scaling center SC. The scaling unit 213 scales the display image without moving the scaling center SC of the display image.

  By scaling the display image around the scaling center SC in this way, it is possible to prevent the image at the line-of-sight position P from moving outside the display area 126 and becoming invisible when the displayed image is enlarged. be able to.

  The magnification change permission unit 223 determines whether or not the line of sight belongs to the magnification change area AE. If the line of sight is within the magnification change area AE, the scaling magnification determination unit 212 permits the scaling magnification to be changed. If the line of sight is outside the magnification change area AE, the magnification change permission unit 223 does not allow the scaling magnification to be changed. The magnification change area AE includes the center of the display area 126 and does not include the end of the display area 126.

  The scaling magnification determination unit 212 changes the scaling magnification when the magnification change is permitted, and does not change the scaling magnification when the magnification change is not permitted. In this way, by restricting the scaling center SC when changing the scaling magnification within the magnification changing area AE, it is possible to prevent the head movement and the scaling center SC from greatly deviating and to suppress the occurrence of sickness. Can do.

  FIG. 5 is an explanatory diagram schematically showing an example of the operation of the image display device 1 of FIG. 1, in which the display image is enlarged or reduced by moving the user's head 5 in the front-rear direction. Yes. In this figure, a state where a user wearing the headset unit 10 on the head 5 is viewed from the left side and a display area 126 for displaying a display image is shown.

  (A) in the drawing shows a case where the display image is enlarged by moving the head 5 forward. If the upper body is tilted forward around the waist, the head 5 moves forward. Specifically, by tilting the upper body forward and tilting the head 5 relatively rearward relative to the upper body, the head 5 is moved forward while maintaining the face facing forward. Can be made. The display image is enlarged by changing the scaling factor in conjunction with the movement of the head 5 in the front-rear direction.

  (B) in the figure shows a case where the display image is reduced by moving the head 5 backward. If the upper body is tilted rearward around the waist, the head 5 moves backward. Specifically, by tilting the upper body backward and tilting the head 5 relatively forward with respect to the upper body, the head 5 is moved rearward while maintaining the face facing forward. Can be made. The display image is reduced by changing the scaling factor in conjunction with the movement of the head 5 in the front-rear direction.

  The stationary object fixed in front of the user is perceived as a larger object in the field of view because the distance from the user's eyes to the stationary object is reduced by moving the head 5 forward. On the other hand, by moving the head 5 backward, it is perceived as a smaller object in the field of view. In the image display device 1 according to the present embodiment, the display image can be enlarged or reduced by intuitive body movement by changing the scaling factor in conjunction with the movement of the head 5 in the front-rear direction.

<Magnification change area AE>
FIG. 6 is a diagram showing an example of the operation of the image display device 1 of FIG. 1, and a predetermined magnification change area AE is shown in the display area 126. This magnification change area AE is an elliptical area centered on the center of the display area 126 and is designated not to include the peripheral edge of the display area 126.

  Depending on whether or not the line-of-sight position P belongs to the magnification change area AE, the change of the scaling magnification is permitted. That is, only when the line-of-sight position P belongs to the magnification change area AE, the change of the scaling magnification is permitted, and the scaling magnification is changed according to the movement of the head 5. The display image enlargement or reduction process is performed with the line-of-sight position P as the scaling center SC. In this way, by limiting the scaling center SC that is arbitrarily designated by the user within the magnification change area AE, it is possible to suppress the movement of the head 5 and the scaling center SC from greatly shifting and causing sickness. .

Central point of the display area 126 is the default position SC ₁ scaling center SC, and if you do not want to change the position of the scaling center SC by eye movement, the ability to determine the scaling center SC to detect a viewpoint position P is invalid the a certain case, enlargement or reduction of the displayed image around the default position SC ₁ is performed.

  Steps S101 to S115 in FIG. 7 are flowcharts showing an example of the operation at the time of moving image shooting in the image display apparatus 1 in FIG. This figure shows a processing procedure in the case where a surrounding landscape or the like is photographed as a subject using the camera 21 provided in the controller unit 20.

  First, the controller unit 20 activates the camera 21 based on a user operation instructing the start of shooting, starts moving image shooting, acquires a shot image, scales the display image, and displays the display area 126 of the image display unit 12. It is displayed above (step S101).

  Next, if the user instructs the controller unit 20 to activate the zoom function linked to the movement of the head 5 by pressing the operation key 23 (step S102), the controller unit 20 refers to the magnification setting (step S102). S103). For example, a face authentication process is performed on a captured image, and a function that limits the scaling magnification within a range where the subject's face does not protrude from the display area 126 indicates whether the function is valid or invalid. Selection information is held as a magnification setting.

  In addition, for the function for notifying the user that the zoom function linked to the movement of the head 5 is valid, selection information indicating whether the function is valid or invalid is held as the magnification setting. When this user notification function is selected, selection information on the notification method is held as a magnification setting. The notification method includes a method of notifying by lighting or blinking an indicator provided in the frame unit 11 or the image display unit 12 of the headset unit 10, a method of displaying and notifying an icon in the display area 126, and a frame unit A method of vibrating the vibrator provided in the notification unit 11, a method of outputting a notification sound from a speaker provided in the frame unit 11, a method of notification by lighting or blinking an indicator provided in the controller unit 20, and a touch panel 22 There are a method of displaying and displaying an icon in the display screen, a method of notifying by vibrating a vibrator provided in the controller unit 20, and a method of outputting a notification sound from a speaker provided in the controller unit 20, Can arbitrarily specify these notification methods.

  For the function of detecting the line-of-sight position P and determining the scaling center SC, selection information indicating whether the function is valid or invalid is held as a magnification setting. In addition, for a function that enlarges or reduces only the display image and does not enlarge or reduce the recording image for recording, selection information indicating whether the function is valid or invalid is held as a magnification setting. . In addition, selection information indicating the ratio between the moving distance of the head 5 and the amount of change of the scaling magnification is held as the magnification setting. For this ratio, either the case where the scaling magnification is changed by a fixed amount regardless of the movement distance of the head 5 or the case where the amount of change of the scaling magnification is changed according to the movement distance of the head 5 is selected. be able to.

  Here, the function for notifying the user that the zoom function linked to the movement of the head 5 is effective is selected, and only the display image is enlarged or reduced, and the recorded image is not enlarged or reduced. Is invalid.

  Next, the controller unit 20 detects the movement of the head 5, changes the scaling magnification according to the movement of the head 5 in the front-rear direction, and can change the magnification in conjunction with the movement of the head 5. Is notified to the user (steps S104 to S106). The processing procedure from step S104 to step S106 is repeated until a user operation for instructing the start of recording is detected (step S107).

  Next, the controller unit 20 starts a recording process for storing a captured image based on a user operation instructing the start of recording (step S108). Next, the controller unit 20 detects the movement of the head 5 and changes the scaling factor according to the movement of the head 5 in the front-rear direction (steps S109 and S110). The processing procedure from step S108 to step S110 is repeated until a user operation for instructing the end of recording is detected (step S111). If the end of the recording is instructed, this process ends.

  On the other hand, if the user is not instructed to enable the zoom function linked to the movement of the head 5 in step S102, the controller unit 20 continues to shoot moving images and maintains the display image display (step S112). ). Next, if a user operation instructing start of recording is detected (step S113), the controller unit 20 starts a recording process for storing a captured image (step S114). The processing procedure of step S114 is repeated until a user operation for instructing the end of recording is detected (step S115). If the end of recording is instructed, this process ends.

  In the image display device 1 according to the present embodiment, the movement of the user's head 5 is detected, and the scaling factor of the display image is changed according to the movement of the head 5 in the front-rear direction. The display image on the display area 126 can be enlarged or reduced simply by moving to. In addition, since it is not necessary to display an operation object such as an icon in the display area 126, it is possible to prevent the display range from being narrowed by the operation object. Therefore, it is possible to improve operability when enlarging or reducing the image being displayed in the display area 126 without narrowing the display range.

Embodiment 2. FIG.
In the first embodiment, an example in which the image display device 1 is composed of a glasses-type HMD has been described. On the other hand, in the present embodiment, a case will be described in which the image display device 1 includes a HUD (Head Up Display) type image display unit installed in a vehicle.

<Image display unit 30>
FIG. 8 is a perspective view showing an example of the configuration of the image display device 1 according to the second embodiment of the present invention, and shows a HUD type image display unit 30 installed in a vehicle. The image display device 1 includes an image display unit 30 installed in a car and a controller unit 40 that controls the image display unit 30. The image display unit 30 is an in-vehicle unit installed on the ceiling on the driver's seat side, and includes a projection device 31, a projection screen 32, and a head detection camera 33. The controller unit 40 is installed in the vehicle.

  The projection device 31 is a device that projects a display image onto the projection screen 32 and is arranged facing forward. For example, the projection device 31 includes a liquid crystal panel that displays an image on a display screen, and a backlight that irradiates the display screen of the liquid crystal panel with visible light from the back side to generate video light.

  The projection screen 32 is composed of a substantially rectangular flat optical element that accommodates the half mirror layer, and is disposed between the user's head 5 and the windshield so as to intersect the line of sight. The half mirror layer reflects image light incident from the projection device 31 rearward, and transmits external light incident from the front.

  The camera 33 is an imaging device that photographs the user's eyes as a subject in order to detect the movement and line of sight of the user's head 5. For example, the feature point of the image photographed by the camera 33 is analyzed and the distance from the camera 33 to the user's eyes is specified to detect the movement of the head 5 in the front-rear direction.

  Also, by specifying the outline of the eyeball, the cornea, and the position of the iris, the line-of-sight direction is estimated from the rotation angle of the eyeball. Further, the line-of-sight position P on the projection screen 32 is estimated by specifying the relative positional relationship between the camera 33 and the eyeball. The camera 33 is provided in the projection device 31.

  FIG. 9 is a diagram illustrating an example of the operation of the image display device 1 in FIG. 8, in which a projection area 34 divided into three display areas 34 a to 34 c is illustrated. In the image display device 1, by detecting the user's line of sight and specifying the line of sight position P on the projection screen 32, one of the three display areas 34a to 34c is selected as a scaling target area. The zoom function linked to the movement of the head 5 is performed based on the image being displayed in the scaling target area.

  The projection area 34 is a display area that can be visually recognized by the user, and includes an area on which the image light is projected on the projection screen 32. The projection area 34 is formed corresponding to the position of the half mirror layer, and displays a display image made up of video light reflected by the half mirror layer. In this example, map information including the current location, the route from the current location to the destination, the distance to the passing point, the traveling direction, the current time, and the like is displayed on the projection area 34.

  The display area 34a is formed at the left end of the projection area 34, and displays the distance to the passing point, the traveling direction, and the current time. The display area 34b is an area including the central portion and the right end portion of the projection area 34, and displays a map image in which the current location and the route from the current location to the destination are indicated by symbols, graphics, and the like. The display area 34 c is an area formed at the lower end of the projection area 34.

  The user moves the line of sight and selects any of the display areas 34a to 34c as a scaling target area, and then moves the head 5 forward or backward to enlarge or reduce the image being displayed in the display area. Can be made. For example, if the display area 34a is selected as a scaling target area and the head 5 is moved forward, a detailed map up to the passing point is displayed.

  If the display area 34b is selected as the scaling target area and the head 5 is moved in the front-rear direction, the scale of the map is changed according to the moving direction and moving distance of the head 5. Further, if the display area 34c is selected as the scaling target area and the head 5 is moved in the front-rear direction, the entire image being displayed in the projection area 34 is moved according to the moving direction and the moving distance of the head 5. The scaling factor is changed. Alternatively, when the display area 34c is selected as the area to be scaled, by moving the head 5 in the front-rear direction, the characters displayed superimposed on the map according to the moving direction and moving distance of the head 5 are displayed. The font size is enlarged or reduced.

<Controller unit 40>
FIG. 10 is a block diagram illustrating a configuration example of the controller unit 40 in the image display apparatus 1 of FIG. The controller unit 40 includes a map information storage unit 401, a head detection unit 411, a scaling magnification determination unit 412, a scaling unit 413, a display image storage unit 414, a communication unit 415, a line-of-sight detection unit 421, and a target area selection unit 422. Is done.

  The scaling factor determination unit 412, the scaling unit 413, the display image storage unit 414, the communication unit 415, and the line-of-sight detection unit 421 are the scaling factor determination unit 212, the scaling unit 213, the display image storage unit 214, and the communication in the controller unit 20 of FIG. The configuration is the same as that of the unit 215 and the line-of-sight detection unit 221, and redundant description is omitted.

  The map information storage unit 401 holds map information. The head detection unit 411 detects the movement of the user's head based on the captured image captured by the camera 33 and outputs the detection result to the scaling magnification determination unit 212. For example, the feature point of the captured image is analyzed, and the movement of the head 5 in the front-rear direction is detected from the change in the distance to the eyeball. That is, the moving distance and moving direction of the head are detected.

  The scaling unit 413 reads the map information from the map information storage unit 401, converts the image size according to the scaling factor, generates a display image to be displayed on the image display unit 30, and stores the display image in the display image storage unit 414. To do.

  The target area selection unit 422 selects one of the two or more display areas 34a to 34c as a scaling target area based on the line-of-sight detection result. The target area selection unit 422 determines which of the display areas 34a to 34c the line of sight belongs to. If the line of sight belongs to the same display area for a certain period of time, the display area is selected as the scaling target area. Select as. On the other hand, the target area selection unit 422 cancels the selection of the scaling target area when the line of sight comes out of the scaling target area. The scaling unit 413 scales the display image in the scaling target area.

  In the image display device 1 according to the present embodiment, the scaling target area can be selected by moving the line of sight. Further, when a line of sight belongs for a certain time in the same display area, the display area is selected as a scaling target area, and the image displayed in the scaling target area in the front-rear direction of the head 5 is selected. Since the scaling factor is changed according to the movement, it is possible to prevent the display image from being enlarged or reduced by mistake.

  In the first embodiment, an example in which a captured image captured by the camera 21 is displayed on the image display unit 12 has been described. In the second embodiment, an example in which map information is displayed on the image display unit 30 has been described. The present invention does not limit the image displayed on the image display unit. For example, a camera that captures a frontal landscape or the like as a subject is provided in the headset unit 10, and an image captured by the camera is displayed on the display area 126 of the image display unit 12, so that the user's field of view is virtually determined. The present invention can also be applied to a configuration that is reproduced.

  In the first embodiment, the example in which the motion of the user's head 5 is detected using the acceleration sensor 3 has been described. In the second embodiment, the example in which the movement of the head 5 is detected by analyzing the captured image captured by the camera 33 has been described. The present invention does not limit the method for detecting the movement of the head 5 to this. For example, a configuration in which the movement of the head 5 is detected using a gyro sensor that detects a change in posture using Coriolis force may be used.

  In the first and second embodiments, the example in which the image display unit and the controller unit are separate has been described. However, the present invention is not limited to the configuration of the image display device 1. For example, the present invention can be applied to an integrated image display unit and controller unit.

  In the first embodiment, an example in which the headset unit 10 and the controller unit 20 are connected via the connection cable 2 has been described. However, the present invention is a connection mode between the headset unit 10 and the controller unit 20. However, the present invention is not limited to this. For example, the headset unit 10 and the controller unit 20 may be connected by wireless communication such as short-range wireless communication or infrared communication.

The configuration of the image display device 1 according to the embodiment of the present invention and the corresponding operational effects are organized and summarized below.
The image display device 1 according to the first aspect of the present invention includes a head detection unit 211 that detects the movement of the user's head 5 and a display area 126 that is visible to the user, and displays a display image on the display area 126. An image display unit 12, a scaling factor determining unit 212 that determines a scaling factor based on the detection result of the head 5, and a scaling unit 113 that scales a display image based on the scaling factor. The unit 212 is configured to change the scaling factor according to the movement of the head 5 in the front-rear direction.

  According to such a configuration, since the movement of the user's head 5 is detected and the scaling factor of the display image is changed according to the movement of the head 5 in the front-rear direction, the head 5 is moved forward or backward. Only the display image on the display area 126 can be enlarged or reduced. In addition, since it is not necessary to display an operation object such as an icon in the display area 126, it is possible to prevent the display range from being narrowed by the operation object.

  In addition to the above configuration, the image display device 1 according to the second aspect of the present invention includes a line-of-sight detection unit 221 that detects the line of sight of the user, and a scaling center determination that determines a scaling center SC on the display image based on the line-of-sight detection result. And a scaling unit 213 configured to scale the display image without moving the scaling center SC of the display image. According to such a configuration, the user can arbitrarily designate the scaling center SC by moving the line of sight. Further, since the display image is scaled without moving the scaling center SC, it is possible to prevent the image at the line-of-sight position P from moving outside the display area 126 and becoming invisible when the display image is enlarged. Can do.

  In addition to the above-described configuration, the image display device 1 according to the third aspect of the present invention determines whether or not the line of sight belongs to the magnification change area AE that includes the center of the display area 126 and does not include the end portion. If it is within AE, it is provided with a magnification change permission unit 223 that permits the scaling magnification to be changed. When the scaling magnification determination unit 212 is permitted to change the magnification, the scaling magnification is changed, and the magnification change is permitted. If not, it is configured not to change the scaling factor. According to such a configuration, the movement of the head 5 and the scaling center SC are greatly deviated by limiting the scaling linked to the movement of the head 5 to the case where the line-of-sight position P exists in the magnification change area AE. It is possible to suppress the occurrence of sickness.

  In addition to the above configuration, the image display device 1 according to the fourth aspect of the present invention scales any one of the two or more display areas 34a to 34c based on the line-of-sight detection unit 421 that detects the line of sight of the user and the line-of-sight detection result. A target area selection unit 422 that selects the target area, and a scaling unit 413 is configured to scale the display image of the scaling target area. According to such a configuration, the user can arbitrarily designate the scaling target area by moving the line of sight.

  In the image display device 1 according to the fifth aspect of the present invention, in addition to the above configuration, the target area selection unit 422 determines which of the display areas 34a to 34c the line of sight belongs to, and exceeds a certain time within the same display area. When the line of sight belongs, the display area is set as a scaling target area, and when the line of sight comes out of the scaling target area, the selection of the scaling target area is canceled. According to such a configuration, when a line of sight belongs to the same display area for a certain period of time, the display area is set as the scaling target area, and the display image in the scaling target area is scaled to display the display image. Can be prevented from being enlarged or reduced by mistake.

DESCRIPTION OF SYMBOLS 1 Image display apparatus 10 Headset part 11 Frame part 11a Lens holding part 11b Temple part 12 Image display part 12L Left eye display part 12R Right eye display part 121 Projector 122 Projection lens 123 Prism 124 Light guide plate 125 Half mirror layer 126 Display area 20 Controller unit 21 Camera 22 Touch panel 23 Operation key 201 Captured image storage unit 211 Head detection unit 212 Scaling magnification determination unit 213 Scaling unit 214 Display image storage unit 215 Communication unit 221 Line of sight detection unit 222 Scaling center determination unit 223 Magnification change permission unit 30 Image display unit 31 Projection device 32 Projection screen 33 Head detection camera 34 Projection areas 34a to 34c Display area 40 Controller unit 401 Map information storage unit 411 Head detection unit 412 Scaling magnification determination unit 4 13 Scaling unit 414 Display image storage unit 415 Communication unit 421 Line of sight detection unit 422 Target area selection unit 2 Connection cable 3 Accelerometer 4 Camera for line of sight detection 5 Head AE Magnification change area SC ₁ Default position P of scaling center P line of sight position

Claims (1)

Head detection means for detecting the movement of the user's head;
An image display means having a display area visible to the user and displaying a display image on the display area;
A scaling factor determining means for determining a scaling factor based on the detection result of the head;
Scaling means for scaling the display image based on the scaling factor ;
Line-of-sight detection means for detecting the line of sight of the user;
A scaling center determining means for determining a scaling center on the display image based on the detection result of the line of sight;
It is determined whether or not the line of sight belongs to a magnification change area that includes the center of the display area and does not include an edge. If the line of sight is within the magnification change area, the magnification change permission that permits the change of the scaling magnification is permitted. Means and
The scaling factor determining means changes the scaling factor according to the movement of the head in the front-rear direction ,
The scaling means scales the display image without moving the scaling center of the display image,
The image display apparatus according to claim 1, wherein the scaling factor determination unit changes the scaling factor when the change of magnification is permitted, and does not change the scaling factor when the change of magnification is not permitted .

Images