JP2017187757A - Image display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image display device capable of easily initializing relation between a central position of a visual field region at a wanted posture of a user and a position in initial direction of a novel content image after switching of display to the novel content image.SOLUTION: When an adjustment button (display direction adjusting button) is selected, a display control part 121 makes direction adjustment for an image in a visual field region. At the time of such direction adjustment, the display control part 121 initializes relation between a central position of the visual field region at a time point when a specified time period has passed and a position in an initial direction which is pre-defined about an image being displayed, and allows a display part 125 to display an image of the position having the initialized relation as an image in the visual field region. As a result, an image for which a relation with the position in the initial direction which is pre-defined for an image which a user displays has been initialized is provided to the user as an image in the visual field region.SELECTED DRAWING: Figure 3

Description

  The present invention relates to an image display device, and more particularly to an image display device that displays an image capable of realizing virtual reality.

  In recent years, a technique that provides virtual reality by displaying an image on a head-mounted display has attracted attention. As such a technique, a technique for presenting the state of an apartment room by displaying the state of the apartment room with a so-called 360 ° image without visiting the model room of an actual apartment has been put into practical use (Non-Patent Document). Reference 1: hereinafter referred to as “conventional example”).

  In this conventional technique, an information processing device such as a smartphone having a posture change amount detection function, an image display function, a display image control function, and the like is attached to a goggle housing in a removable manner, thereby providing virtual reality. An image display device to be provided is configured. Then, by changing the visual field range of the user in the 360 ° image according to the detection result of the posture change amount, the image visually recognized by the user is changed according to the posture change.

  In the conventional technique, a soft button (hereinafter referred to as “individual menu selection button”) for selecting an image for displaying the state of another room in the 360 ° image for displaying the state of one room in the apartment. Called) is arranged. When the state where the viewpoint is aligned with the display area of one individual menu selection button continues for a predetermined time or more, it is determined that the one individual menu selection button is pressed (selected), and the one individual menu selection button is selected. An image corresponding to the menu selection button is displayed. For this reason, it is possible to select an image to be displayed without using hardware resources such as a mouse and a keyboard.

Team Lab, “Hako Mansion VR”, [online], 2015/04/02, [Search on March 1, 2016], Internet <URL: http://www.team-lab.com/hakomanshonvr2015-2>

  As described above, in the conventional technique, a plurality of individual menu selection buttons are arranged in a 360 ° image. For this reason, depending on the position of the selected individual menu selection button in the 360 ° image, the content is switched to a new content image selected in a posture in which the neck and the entire body are moved greatly.

  By the way, the new content image immediately after switching is an image whose initial direction (usually the front direction) defined in advance for the new content image is the center of the visual field area. When switching to a new image with a posture that greatly moves the neck or the entire body, there will be a large discrepancy between the original direction of the new content image in the field of view and the direction in which the user is actually facing. Will occur. And the means of eliminating the wrinkle is not prepared in the prior art.

  The present invention has been made in view of the above circumstances, and after switching the display to a new image, the center position of the visual field region in the user's desired posture and the initial position of the new image An object of the present invention is to provide an image display apparatus that can easily initialize the relationship.

  An image display device according to the present invention includes a housing member mounted on a user's head; a display unit fixed to the housing member; first image data defined in a first region; Display data is stored that is defined in a second area included in the first area and includes data of a second image displayed on the image corresponding to the data of the first image in the second area. A storage unit; a posture change amount detection unit that detects a relative change amount of the posture of the housing member; a display control unit that changes a display image on the display unit according to a detection result by the posture change amount detection unit; And the second image includes an image of a display direction adjustment button, and when the display direction adjustment button is selected, the display control unit includes a center position of a visual field region when a predetermined time elapses. , Predefined for the first image The image is determined in correspondence with the initial position, and an image determined in accordance with the initialization relationship is displayed on the display unit as an image in the visual field. The first image is horizontally horizontal. When the content image corresponds to the direction, the relationship after the initialization is as follows: (A) The horizontal direction perpendicular to the front direction when the user stands upright is the pitch axis direction, and the vertical direction is the yaw axis direction. In this case, regardless of the yaw angle component value of the line-of-sight direction in the posture at the time when the predetermined time has elapsed, the center position in the horizontal direction in the visual field region is the initial direction defined in advance for the first image. And the center position in the vertical direction in the visual field region becomes the vertical coordinate position in the first image corresponding to the pitch angle component value in the line-of-sight direction. 1 relationship, and an image display device comprising (B) the center position of the viewing area at the elapsed point of the predetermined time is selected from any one of the second relation of position of the initial direction, it.

  In this image display device, when the display direction adjustment button is selected and the selected state continues for a predetermined time, the display control unit performs direction adjustment on the image in the visual field region. When adjusting the direction, the display control unit initializes the relationship between the center position of the visual field region at the time when the predetermined time has elapsed and the position in the initial direction defined in advance for the first image. An image determined correspondingly is displayed on the display unit as an image in the visual field area. As a result, an image in the visual field area in which a user has a desired posture direction as an initial direction defined in advance for the first image is provided to the user.

  Therefore, according to the image display device of the present invention, after switching the display to a new image, initialization of the relationship between the center position of the visual field region in the user's desired posture and the position in the initial direction of the new image Can be performed easily.

  In the image display device of the present invention, when the first image is a content image in which the horizontal direction corresponds to the actual horizontal direction, the center position of the visual field region in the desired posture of the user and the new image are displayed. One of the above (A) and (B) is selected as the initialization relationship with the position of the initial image in the initial direction.

  When the first relationship (A) described above is selected as the initialization relationship, the horizontal direction of the visual field region in the desired posture is maintained while maintaining the relationship reflecting the horizontal sensation felt by the user in the actual posture. The portion of the first image whose center position is the horizontal coordinate position of the position in the initial direction (hereinafter also referred to as “initial direction position”) defined in advance for the content image is displayed on the display unit as the in-view field image. Is displayed. For this reason, for example, if you are lying on your back and maintaining the sensation of facing the sky, you can change the position of the head to view a starry sky image in the desired sky region. can do.

  When the second relationship (B) described above is selected as the initialization relationship, the relationship reflecting the horizontal sensation felt by the user in the actual posture is not maintained. However, it is appropriate for users who want to view an image centered on the initial position of the content image while changing the posture of the head in a comfortable posture for the user (for example, lying on its back). can do.

  In the image display device of the present invention, the content image can be a 360 ° content image.

  In the image display device of the present invention, when the first image is a menu image, the relationship after the initialization can be the second relationship. In this case, when the menu image is displayed as the first image, when the display direction adjustment button is selected and the selection state continues for a predetermined time, the center position of the display image in the visual field region is the menu image. An image that is easy to select from the menu and can be displayed as an in-view field image.

  In the image display device of the present invention, the display control unit may set the area of the display direction adjustment button to either the upper side or the lower side of the center position of the visual field area. In this case, when the display direction adjustment button is selected, the display direction adjustment button can be selected by a simple posture change that faces upward or downward.

  As described above, according to the image display device of the present invention, after switching the display to a new content image, the center position of the visual field region in the user's desired posture is set to the position in the initial direction of the new content image. It is possible to achieve an effect that the setting can be easily performed.

1 is a perspective view showing an appearance and a partially expanded state of an image display device according to an embodiment of the present invention. It is a figure for demonstrating the division | segmentation aspect of the display area in the display surface of FIG. 1, and the image in a visual field area | region. FIG. 2 is a block diagram illustrating a schematic configuration of the display processing device of FIG. 1. It is a figure which shows an example of the data for a display of FIG. It is a figure for demonstrating the area | region structure of the image based on menu image data. It is a figure for demonstrating the area | region structure of the image based on separate content image data. FIG. 6 is a diagram (No. 1) for explaining changes in a visual field region and a display control button region due to a change in posture of an image display device. FIG. 11 is a diagram (No. 2) for explaining changes in the visual field region and the display control button region due to the posture change of the image display device. It is FIG. (1) for demonstrating the change of the image in a visual field area relevant to selection of an adjustment button. It is FIG. (2) for demonstrating the change of the image in a visual field area relevant to selection of an adjustment button. It is a figure for demonstrating the relationship between the initial direction position of the 1st image area after initialization by selection of an adjustment button, and the center position of a visual field area | region. It is FIG. (1) for demonstrating the change of the image in a visual field area relevant to selection of a back button. It is FIG. (2) for demonstrating the change of the image in a visual field area relevant to selection of a back button.

  Hereinafter, an embodiment of the present invention will be described with reference to FIGS. In the following description and drawings, the same or equivalent elements are denoted by the same reference numerals, and redundant description is omitted.

[Constitution]
As shown in FIG. 1A, an image display device 100 according to an embodiment is a goggle type device. The image display device 100 includes a housing member 110 and a display processing device 120. The user holds the image display device 100 in his hand and changes the posture of the head while pressing the rear side of the image display device 100 against both eyes of the face, so that the virtual reality image based on the virtual reality image is obtained. Can be tasted.

  The housing member 110 is a plastic member, for example. As shown in FIG. 1B, the housing member 110 includes a frame member 111, an eye shield member 112, and a lid member 113.

  The frame member 111 is a cylindrical member. The frame member 111 is fixed with an eye shield member 112 and is connected with a lid member 113.

  The eye-shielding member 112 is a flat plate member that extends in the front-rear direction and the up-down direction, and is fixed to the center of the frame member 111. The eye-shielding member 112 makes the left eye area of the display surface DSP in the display processing device 120 visible to the user's left eye, and to the right of the display surface DSP in the display processing device 120 to the user's right eye. The ophthalmic region becomes visible.

  The lid member 113 is connected to the lower edge portion in front of the frame member 111 so as to be opened and closed. The display processing device 120 is detachably attached to the lid member 113. Then, by closing the lid member 113 with respect to the frame member 111 with the display processing device 120 attached, the state shown in FIG.

  As shown in FIG. 2A, a left-eye image is displayed in the left-eye region LVP of the display surface DSP in the display processing device 120. Further, a right eye image is displayed in the right eye region RVP of the display surface DSP in the display processing device 120. By viewing the image for the left eye with the left eye and the image for the right eye with the right eye, as shown in FIG. 2B, the binocular vision with a stereoscopic effect as the image in the visual field region VSP is obtained. You can see the image.

<Configuration of Display Processing Device 120>
Next, the configuration of the display processing device 120 will be described.

  As illustrated in FIG. 3, the display processing device 120 includes a display control unit 121 and a storage unit 122. In addition, the display processing device 120 includes an attitude change amount detection unit 123, a wireless communication unit 124, and a display unit 125.

  The display control unit 121 performs overall control of the entire display processing device 120. The display control unit 121 will be described later.

  The storage unit 122 includes a nonvolatile storage element. The storage unit 122 stores various information data used by the display control unit 121. Such information data includes a program executed by the display control unit 121, display data IMD, and the like. The display control unit 121 can access the storage unit 122.

  The contents of the display data IMD will be described later.

  The posture change amount detection unit 123 includes a three-dimensional gyro sensor and the like. The posture change amount detection unit 123 detects a three-dimensional angular velocity at each time point. The detection result by the posture change amount detection unit 123 is sent to the display control unit 121.

  The wireless communication unit 124 communicates with an external server device via a network. In this embodiment, by using the wireless communication unit 124, the display control unit 121 communicates with an external content server and downloads display data.

  The display unit 125 includes a display device such as a liquid crystal display. The display surface of this display device is the display surface DSP described above.

  The display unit 125 receives image data sent from the display control unit 121. Then, the display unit 125 displays an image according to the image data.

  Here, the display data IMD stored in the storage unit 122 will be described. The display data IMD includes menu image data MND and content image data CTD as shown in FIG.

The menu image data MND includes first area data FMD and second area data SMD. Here, in the present embodiment, the first area data FMD is a soft button image for selecting an individual content image corresponding to individual content image data CTD _j (j = 1,..., N), which will be described later, and will be described later. Includes a soft button image to select a mode for initializing the relationship between the position in the initial direction defined in advance for the display of the individual content image and the center position of the in-view image when the individual content image is displayed Data for displaying a menu selection image.

  The second area data SMD is an image for displaying the image of the display control button for the in-field image while the menu selection image is being displayed on the menu selection image. Here, in this embodiment, there are two types of display control buttons, an adjustment button and a back button. The adjust button in the menu selection image is a button for setting the center position of the in-view image to the position in the initial direction defined in advance for the menu selection image. Further, the back button in the menu selection image is a button for returning to the display of the image that is the display target one stage before the menu image being displayed.

The content image data CTD includes individual content image data CTD _j (j = 1,...).

The individual content image data CTD _j includes first area data FCD _j and second area data SCD _j . Here, the first area data FCD _j is 360 ° image data in which the horizontal direction corresponds to the actual horizontal direction.

The second area data SCD _j is an image for displaying the image of the display control button for the in-field image during the display of the 360 ° image based on the individual content image data CTD _j so as to be superimposed on the 360 ° image. . Here, as the display control button, in this embodiment, there are two types of buttons, an adjustment button and a back button, as in the case of the second area data SMD described above. In the following, an image obtained by combining the 360 ° image and the display control button image is referred to as an “individual content image”.

  The adjustment button in the individual content image is a button for initializing the relationship between the center position of the in-view image and the position in the initial direction defined in advance for the individual content image being displayed. Further, the back button in the individual content image is a button for returning to the display of the image that has been displayed one stage before the individual content image being displayed.

Here, one of the following (a) and (b) is selected as a mode for initializing the relationship between the position in the initial direction defined in advance for the individual content image being displayed and the center position of the in-view image. It can be done.
(A) When the horizontal direction perpendicular to the front direction when the user stands upright is the pitch axis direction and the vertical direction is the yaw axis direction, regardless of the yaw angle component value in the gaze direction in the posture after initialization The center position in the horizontal direction in the visual field area becomes the horizontal coordinate position of the initial direction position of the individual content image, and the central position in the vertical direction in the visual field area corresponds to the pitch angle component value in the line-of-sight direction. "Normal mode" for initializing the first relationship to be the vertical coordinate position in
(B) “Lie down mode” for performing initialization with a second relationship in which the center position of the visual field area after initialization is a position in the initial direction defined in advance for the individual content image.

  In the present embodiment, using the menu selection image displayed based on the first area data FMD, the individual content image corresponding to the individual content image data that the user desires to display is selected. Here, the menu selection image is an image of a different layer from the individual content image. Therefore, the menu selection image can be displayed in the visual field region VSP regardless of the posture of the image display device 100 according to the posture of the head or body.

Here, the area configuration of the menu selection image based on the menu image data MND and the area configuration of the 360 ° image based on the individual content image data CTD _j will be described. In the following description, the initial direction defined in advance will be described as 0 ° in the horizontal direction and 0 ° in the vertical direction.

FIG. 5 shows the area configuration of the menu selection image based on the menu image data MND. As shown in FIG. 5, in the present embodiment, the first area FMA, which is the entire area of the menu selection image, includes a main area MMA and two second areas SMA ₁ and SMA ₂ .

Here, the first region FMA has a lateral range of (−θ) to θ (θ <180 °) and a vertical range of (−φ) to φ (φ <180 °). It has become. The main area MMA is lateral range with a range of (- [theta]) through?, Vertical extent is in the range of _{(-ψ M) ~ψ M (ψ} M <φ).

Further, the second area SMA ₁ is an area arranged above the main area MMA, has a lateral range of (−θ) to θ, and a vertical range of ψ _M to φ. It has become. The second region SMA ₂ is a region arranged below the main region MMA, has a lateral range of (−θ) to θ, and a vertical range of (−ψ _M ) to ( -Φ).

The vertical width of the main area MMA is wider than the vertical width of the visual field area VSP. Further, the lateral width of the main area MMA and the second areas SMA ₁ and SMA ₂ is wider than the lateral width of the visual field area VSP.

FIG. 6 shows a region configuration of the individual content image based on the individual content image data. As shown in FIG. 6, in the present embodiment, the first area FCA that is the entire area of the individual content image includes a main area MCA and two second areas SCA ₁ and SCA ₂ .

Here, the first region FCA has a lateral range of (−180 °) to 180 ° and a vertical range of (−180 °) to 180 °. The main area MCA, the horizontal direction range with the range of (-180 °) ~180 °, vertical range is in the range of _{(-ψ C) ~ψ C (ψ} C <180 °) .

Further, the second area SCA ₁ is an area arranged in the upper direction of the main area MCA, and has a lateral range of (−180 °) to 180 ° and a vertical range of ψ _{C to} 180 °. It is the range. The second area SCA ₂ is an area arranged below the main area MCA, has a lateral range of (−180 °) to 180 °, and a vertical range of (−ψ _C ). It is the range of-(-180 degrees).

The vertical width of the main area MCA is wider than the vertical width of the visual field area VSP. The lateral width of the main area MCA and the second areas SCA ₁ and SCA ₂ is wider than the lateral width of the visual field area VSP.

  Returning to FIG. 3, the display control unit 121 will be described. The display control unit 121 includes a central processing unit (CPU). The display control unit 121 executes the following processing by executing various programs.

[Display Control Processing by Display Control Unit 121]
The display control unit 121 uses the wireless communication unit 124 to communicate with an external server device to download display data. The display control unit 121 stores the downloaded display data in the storage unit 122 as display data IMD.

  Further, when display of the menu selection image is designated, the display control unit 121 generates image data for displaying the menu selection image based on the menu image data MND. Then, the display control unit 121 sends the generated image data to the display unit 125. As a result, the menu selection image is displayed on the display screen DSP of the display unit 125.

  The menu selection image can be displayed even while the individual content image is being displayed. When display of the menu selection image is specified during display of the individual content image, the menu selection image is displayed in the visual field region VSP so as to overlap the individual content image being displayed in the visual field region VSP. .

  When one of the individual content images is selected using the displayed menu selection image as described later, the display control unit 121 determines that the position in the initial direction defined for the selected individual content image is the same. Then, the image data of the aspect that becomes the center position of the visual field region VSP is generated. Then, the display control unit 121 sends the generated image data to the display unit 125. As a result, an image in a form in which the position in the initial direction defined for the selected individual content image is the center position of the visual field region VSP is displayed on the display screen DSP of the display unit 125.

  After the display of the selected individual content image starts, when the posture of the head or body changes and the posture of the image display device 100 changes, the three-dimensional angular velocity corresponding to the change is detected by the posture change amount detection unit 123. The detection results are sequentially sent to the display control unit 121. Upon receiving the detection result by the posture change amount detection unit 123, the display control unit 121 calculates a change in posture of the image display device 100. Then, the display control unit 121 specifies the visual field region VSP corresponding to the calculated posture, and generates image data of the image in the specified visual field region VSP. Then, the display control unit 121 sends the generated image data to the display unit 125. As a result, an image in the visual field region VSP corresponding to the attitude of the image display device 100 is displayed on the display screen DSP of the display unit 125.

<Positional relationship between visual field region VSP and display control button region>
Next, during the display of the individual content image, the visual field area when the attitude of the image display apparatus 100 changes, the adjustment (ADJ) button area in the second area SCA _1, and the back button in the second area SCA ₂ The relationship with the area will be described.

At the beginning of the display of the individual content image, as shown in FIG. 7A, the display control unit 121 displays the visual field region VSP as a main region where the center of the visual field region VSP is the position in the initial direction of the individual content image. Set to a position in the MCA. Further, the display control unit 121 sets the adjustment button area ABA at a position in the second area SCA ₁ above the center position of the visual field area VSP. Further, the display control unit 121 sets the back button area BBA at a position in the second area SCA ₂ below the center position of the visual field area VSP.

For example, when the posture of the image display device 100 changes to the right from the state shown in FIG. 7A, the display control unit 121 changes the visual field region VSP to the main region as shown in FIG. Move to the right in the MCA. Further, the display control unit 121 moves the adjustment button area ABA to the right in the second area SCA ₁ so as to maintain the position in the second area SCA ₁ above the center position of the visual field area VSP. Move. Further, the display control unit 121 moves the back button area BBA to the right in the second area SCA ₂ so that the position is in the second area SCA ₂ below the center position of the visual field area VSP. Move.

Although not shown, when the attitude of the image display device 100 changes to the left from the state shown in FIG. 7A, the display control unit 121 sets the visual field region VSP within the first region FCA. Move to the left. In addition, the display control unit 121 moves the adjustment button area ABA to the left in the second area SCA ₁ so that the position is within the second area SCA ₁ above the center position of the visual field area VSP. Move. Further, the display control unit 121 moves the back button area BBA to the left in the second area SCA ₂ so as to maintain the position in the second area SCA ₂ below the center position of the visual field area VSP. Move.

  That is, when the posture of the image display device 100 changes in the horizontal direction, the display control unit 121 links the visual field region VSP, the adjustment button region ABA, and the back button region BBA in the horizontal direction by a movement amount corresponding to the posture change amount. Move to.

  On the other hand, for example, when the attitude of the image display device 100 changes from the state shown in FIG. 8A where FIG. 7A is re-displayed, the display control unit 121 is shown in FIG. 8B. Thus, the visual field region VSP is moved upward. In this case, the display control unit 121 maintains the setting position of the adjustment button area ABA and the setting position of the back button area BBA without changing them.

  Although not shown, when the attitude of the image display device 100 changes downward from the state shown in FIG. 8A, the display control unit 121 moves the visual field region VSP downward. Also in this case, the display control unit 121 does not change the setting position of the adjustment button area ABA and the setting position of the back button area BBA.

  That is, when the posture of the image display device 100 changes in the vertical direction, the display control unit 121 moves the visual field region VSP in the vertical direction by a movement amount corresponding to the posture change amount. On the other hand, even if the attitude of the image display device 100 changes in the vertical direction, the setting position of the adjustment button area ABA and the setting position of the back button area BBA are not changed.

It should be noted that during the display of the menu selection image, the visual field area when the posture of the image display device 100 changes, the adjustment (ADJ) button area in the second area SCA _1, and the back button area in the second area SCA ₂ Is the same as that when the individual content image is being displayed.

<Adjust button selection process>
Next, an adjustment button selection process by the display control unit 121 will be described.

  For example, as shown in FIG. 9A, the orientation of the image display device 100 is changed upward in order to select the adjustment button in the state where the image in the main area is displayed in all areas in the visual field area VSP. As a result, the display control unit 121 generates image data in which the visual field region VSP changes upward, and sends the generated image data to the display unit 125. As a result, an image in a mode in which the visual field region VSP changes upward is displayed on the display unit 125. Then, as shown in FIG. 9B, the adjustment button image appears lightly as an image in the upper part of the visual field region VSP.

  When the attitude of the image display device 100 is further changed upward from the state of FIG. 9B and the center position of the visual field region VSP is above the main region image, the display control unit 121 normally displays the adjustment button image. At the same time, image data for displaying a cursor image (a black cross in the figure) at the center position of the visual field region VSP is generated, and the generated image data is sent to the display unit 125. As a result, the image shown in FIG. 10A is displayed in the visual field region VSP.

  When the attitude of the image display device 100 is further changed upward from the state of FIG. 10A and the center position of the visual field area VSP (that is, the cursor position) reaches the adjustment button area, the display control unit 121 Image data for highlighting the adjustment button image is generated, and the generated image data is sent to the display unit 125. As a result, an image in which the adjustment button image is highlighted in the visual field region VSP is displayed in the visual field region VSP.

  Thereafter, when the state where the cursor position is within the adjustment button region continues for a first predetermined time (for example, 3 seconds), the display control unit 121 determines that the adjustment button has been selected, and moves to the desired posture. Image data for displaying a message prompting the change is generated, and the generated image data is sent to the display unit 125. As a result, the image shown in FIG. 10B is displayed in the visual field region VSP.

  The first predetermined time is determined in advance based on experiments, simulations, experiences, and the like from the viewpoint of preventing erroneous selection of the adjustment button.

  Thereafter, when a second predetermined time (for example, 3 seconds) elapses, the display control unit 121 performs display according to the initialization mode selected before the display of the individual content image being displayed on the visual field region VSP is started. The relationship between the initial position of the first region image in the middle and the center position of the visual field region VSP is initialized. Then, the display control unit 121 generates image data according to the initialized relationship, and sends the generated image data to the display unit 125. As a result, the image shown in FIG. 10C is displayed in the visual field region VSP.

  The second predetermined time is determined in advance based on experiments, simulations, experiences, and the like from the viewpoint of securing a change time to a desired posture.

  FIG. 11A shows the initial direction of the first region image being displayed when the first region image is an individual content image and initialization is performed when the initialization mode is “normal mode”. And the center position of the visual field region VSP is shown. FIG. 11B shows the first region image being displayed when the first region image is an individual content image and the initialization is performed when the initialization mode is the “laying down mode”. The relationship between the position in the initial direction and the center position of the visual field region VSP is shown.

As shown in FIG. 11A, when the “normal mode” is initialized, the front direction for the user when standing is the roll axis direction, the horizontal direction is the pitch axis direction, and the vertical direction is the yaw direction. In the case of the axial direction, regardless of the yaw angle component value in the line-of-sight direction in the post-initialization posture, the central position in the horizontal direction in the visual field region VSP (the horizontal position of the center point VSC) is displayed. This is the center position (horizontal coordinate position corresponding to θ = 0 °) regarding the horizontal coordinate in the area image. In the first region image, the center position (vertical position of the center point VSC) regarding the vertical coordinate in the visual field region in the posture after initialization corresponds to the pitch angle component value (ψ = ψ _I ) in the line-of-sight direction. This is the vertical coordinate position.

  Further, as shown in FIG. 11B, when the “laying down mode” is initialized, the center position VSC of the visual field area VSP after initialization is changed to the center position (( (the position corresponding to θ = 0 °, ψ = 0 °). When the first region image is a menu image and the initialization is performed by selecting an adjustment button, the center of the visual field region VSP after initialization is the same as in the case of FIG. 11B. The position VSC is the position in the initial direction that is the center position of the first region image being displayed (position corresponding to (θ = 0 °, ψ = 0 °)).

<Back button selection process>
Next, the back button selection process by the display control unit 121 will be described.

  For example, as shown in FIG. 12A, in the state where the image in the main area is displayed in all areas in the visual field area VSP, the posture of the image display device 100 is changed downward in order to select the back button. As a result, the display control unit 121 generates image data in which the visual field region VSP changes downward, and sends the generated image data to the display unit 125. As a result, an image in a mode in which the visual field region VSP changes downward is displayed on the display unit 125. Then, as shown in FIG. 12B, the back button image appears as a thin image in the lower portion in the visual field region VSP.

  When the posture of the image display device 100 is further changed downward from the state of FIG. 12B and the center position of the visual field region VSP is lower than the image in the main region, the display control unit 121 displays the back button image as a normal image. At the same time, image data for displaying a cursor image at the center position of the visual field region VSP is generated, and the generated image data is sent to the display unit 125. As a result, the image shown in FIG. 13A is displayed in the visual field region VSP.

  When the attitude of the image display device 100 is further changed downward from the state of FIG. 13A and the center position of the visual field region VSP (that is, the cursor position) reaches the back button region, the display control unit 121 While highlighting the back button image, it is determined that the back button is selected, image data for displaying a message to return to the previous image is generated, and the generated image data is sent to the display unit 125. As a result, the image shown in FIG. 13B is displayed in the visual field region VSP.

  Thereafter, when a third predetermined time (for example, 3 seconds) elapses, the display control unit 121 generates image data in which the position in the initial direction of the previous-stage image is the center position of the visual field region VSP, and the generated image Data is sent to the display unit 125. As a result, the image shown in FIG. 13C is displayed in the visual field region VSP.

  The third predetermined time is determined in advance based on experiments, simulations, experiences, and the like from the viewpoint of preventing erroneous selection of the back button.

  Even when the displayed image is a menu selection image, the adjustment button selection process and the back button selection process are executed as in the case where the displayed image is an individual content image.

  As described above, in the present embodiment, when an adjustment button (display direction adjustment button) is selected, the display control unit 121 performs direction adjustment on an image in the visual field region. At the time of such direction adjustment, the display control unit 121 initializes the relationship between the center position of the visual field area at the elapse of a predetermined time and the position in the initial direction that is defined in advance for the image being displayed, and the initialization relationship. An image determined corresponding to the above is displayed on the display unit 125 as an image in the visual field area.

  Here, in the present embodiment, when the first image is an individual content image in which the horizontal direction corresponds to the actual horizontal direction, the center position of the visual field region in the desired posture of the user and the individual content As an initialization relationship with the position in the initial direction, one of the following (A) and (B) can be selected.

(A) When the horizontal direction perpendicular to the front direction when the user stands upright is the pitch axis direction and the vertical direction is the yaw axis direction, the yaw angle component value in the gaze direction in the posture at the time when a predetermined time has elapsed Regardless, the center position in the horizontal direction in the visual field area is the horizontal coordinate position of the position in the initial direction defined in advance for the individual content image, and the central position in the vertical direction in the visual field area is the pitch angle in the visual line direction. A first relationship that is a vertical coordinate position in the individual content image corresponding to the component value;
(B) A second relationship in which the center position of the visual field area at the time when a predetermined time has elapsed is a position in the initial direction that is predefined for the individual content image.

  When the above relationship (A) is selected, the horizontal position of the visual field region in the desired posture is maintained while maintaining the corresponding relationship reflecting the horizontal sensation felt by the user in the actual posture. However, the part of the individual content image that is the central position in the horizontal direction in the individual content image is displayed on the display unit as the in-view field image. For this reason, for example, it is also suitable for the case of trying to view a starry sky image in a desired sky region by changing the posture of the head while maintaining the sense of facing the sky while lying on its back Can be used.

  Further, when the relationship (B) is selected, the corresponding relationship reflecting the horizontal sensation felt by the user in the actual posture is not maintained. However, when the user wants to view an image in an area centered on the initial direction position of the individual content image by changing the posture of the head in a posture that is easy for the user (eg, lying on his back). It can be suitably used.

  Therefore, according to the present embodiment, after switching the display to a new image, the initialization of the relationship between the center position of the visual field region in the desired posture of the user and the position in the initial direction of the new image can be easily performed. It can be carried out.

  In the present embodiment, when the menu image is displayed, the relationship after initialization is the second relationship described above. For this reason, when the adjust button is selected during display of the menu image, the center position of the display image in the visual field region becomes the center position of the menu image. As a result, an image that allows easy menu selection can be displayed as an in-view field image.

  In the present embodiment, the display control unit 121 sets the adjustment button region above the center position of the visual field region VSP. For this reason, when the adjustment button is selected, the adjustment button can be selected by simply changing the posture of facing upward.

[Modification of Embodiment]
The present invention is not limited to the above-described embodiment, and various modifications are possible.

  For example, in the above embodiment, the adjustment button area is above the visual field area, and the back button area is below the visual field area. On the other hand, the adjustment button area may be below the visual field area and the back button area may be above the visual field area.

  In the above-described embodiment, the display control buttons are two types of the adjust button and the back button, but other types of display control buttons may be added.

  In addition, although the individual content image in the above embodiment is a 360 ° image, it may be another type of image. Furthermore, the individual content image may be a moving image or a still image.

  Further, in the above embodiment, the initial direction predetermined for the individual content image is set to 0 ° in the horizontal direction and 0 ° in the vertical direction. However, any other direction may be set as the initial direction.

  In the above embodiment, the left eye area of the display surface DSP in the display processing device 120 is visible to the user's left eye, and the display surface DSP of the display processing device 120 is visible to the user's right eye. In order to make the right eye region visible, only the eye blocking member 112 is used. On the other hand, an optical system including a lens system may be further used.

  In the above embodiment, the display data is downloaded from the external server device. However, it may be provided to the image display device using a portable storage device such as a USB memory.

  In the above embodiment, the display data is downloaded from an external server device. On the other hand, display data may be provided to the image display device using a portable storage device such as a USB memory. The display data may be provided to the image display device in a streaming format that is a continuous image format.

  In the above embodiment, the number of types of display data held in the image display device is one, but a plurality of types may be used. In this case, a menu selection image for selecting display data is required. In such a case, display and selection control similar to those in the above-described embodiment may be performed.

  In addition, a general-purpose device such as a smartphone can be adopted as the display processing device of the above embodiment. The display processing device is not limited to a smartphone.

  In the above embodiment, the display processing device is detachably attached to the housing member. However, the display processing device may be fixedly attached to the housing member.

  Needless to say, the present invention can be applied to any image display device that functions as a head-mounted display.

  As described above, the present invention can be applied to an image display device that provides a user with an image that can realize virtual reality.

  DESCRIPTION OF SYMBOLS 100 ... Image display apparatus, 110 ... Housing member, 111 ... Frame member, 112 ... Eye shield member, 113 ... Cover member, 120 ... Display processing apparatus, 121 ... Display control part, 122 ... Memory | storage part, 123 ... Attitude change Quantity detection unit, 124... Wireless communication unit, 125.

Claims (4)

A housing member mounted on the user's head;
A display unit fixed to the housing member;
The first image data defined in the first region and the second image included in the first region are defined and displayed in an overlapping manner with the image corresponding to the first image data in the second region. A storage unit storing display data including the second image data;
A posture change amount detection unit for detecting a relative change amount of the posture of the housing member;
A display control unit that changes a display image on the display unit according to a detection result by the posture change amount detection unit;
The second image includes an image of a display direction adjustment button,
When the display direction adjustment button is selected, the display control unit initializes the relationship between the center position of the visual field area at the time when a predetermined time has elapsed and the position in the initial direction defined in advance for the first image. , An image determined corresponding to the initialization relationship is displayed on the display unit as an image in the visual field area,
When the first image is a content image whose horizontal direction corresponds to the actual horizontal direction, the relationship after the initialization is
(A) The yaw angle component of the line-of-sight direction in the posture when the predetermined time has elapsed when the horizontal direction perpendicular to the front direction when the user is upright is the pitch axis direction and the vertical direction is the yaw axis direction Regardless of the value, the central position in the horizontal direction in the visual field area is the horizontal coordinate position of the position in the initial direction defined in advance for the first image, and the central position in the vertical direction in the visual field area is A first relationship that is a vertical coordinate position in the first image corresponding to the pitch angle component value in the line-of-sight direction; and
(B) The image display device, wherein the center position of the visual field region at the time when the predetermined time has elapsed is selected from any one of the second relations that are the positions in the initial direction.   The image display apparatus according to claim 1, wherein the content image is a 360 ° content image.   3. The image display device according to claim 1, wherein when the first image is a menu image, the relationship after the initialization is the second relationship. 4.   The said display control part sets the area | region of the said display direction adjustment button to either one of the upper side of the center position of the said visual field area | region, and the downward direction, The Claim 1 characterized by the above-mentioned. The image display device described.

Images