JP2014225727A - Display control device, display control method, and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technique enabling stereoscopic display of a virtual object so that a user can more easily browse it.SOLUTION: A display control device comprises: a viewpoint acquisition unit that acquires a user's viewpoint detected by a viewpoint detection unit; and a display control unit that controls a display unit so that a virtual object is stereoscopically displayed by the display unit. The display control unit controls the position in a depth direction of the virtual object presented to the user on the basis of the viewpoint.

Description

  The present disclosure relates to a display control device, a display control method, and a recording medium.

  In recent years, development of HMD (Head Mounted Display) as a display to be worn on a user's head has been progressing. The display operation of the content by the HMD attached to the user's head is assumed to be constant without depending on the user's situation, but is also assumed to be controlled based on the user's situation. For example, a technique for controlling a content display operation according to a user's situation is disclosed (for example, see Patent Document 1).

JP 2008-65169 A

  However, an HMD that presents a virtual object to a user by stereoscopic display has also been developed. Therefore, it is desirable to realize a technique capable of performing a stereoscopic display of a virtual object so that the user can more easily browse.

  According to the present disclosure, a viewpoint acquisition unit that acquires the viewpoint of the user detected by the viewpoint detection unit, and a display control unit that controls the display unit so that a virtual object is stereoscopically displayed by the display unit, A display control device is provided, wherein the display control unit controls a position in the depth direction of the virtual object presented to the user based on the viewpoint.

  In addition, according to the present disclosure, the viewpoint includes: acquiring a user's viewpoint detected by the viewpoint detection unit; and controlling the display unit so that a virtual object is stereoscopically displayed by the display unit. A display control method including controlling a position in the depth direction of the virtual object presented to the user.

  In addition, according to the present disclosure, the computer includes a viewpoint acquisition unit that acquires the viewpoint of the user detected by the viewpoint detection unit, and a display control unit that controls the display unit so that the virtual object is stereoscopically displayed by the display unit. The display control unit controls a position in the depth direction of the virtual object presented to the user based on the viewpoint, and records a program for causing the computer to function as a display control device. A readable recording medium is provided.

  As described above, according to the present disclosure, it is possible to provide a technique capable of performing a stereoscopic display of a virtual object so that the user can more easily browse.

It is a figure showing an example of composition of an information processing system concerning an embodiment of this indication. It is a figure showing an example of functional composition of an information processing system concerning an embodiment of this indication. It is a figure for demonstrating the example of the method of controlling the position of the depth direction of the virtual object shown to a user. It is a figure which shows the example of the presentation of the weather forecast screen to the user at the time of stationary. It is a figure which shows the example of the presentation of the weather forecast screen to the user at the time of a walk. It is a figure which shows the example of the presentation of the weather forecast screen to the user at the time of driving | running | working. It is a figure which shows the example of the presentation of the weather forecast screen to the user at the time of a driving | operation. It is a figure which shows the example of presentation of the navigation screen to the user at the time of stillness. It is a figure which shows the example of the presentation of the navigation screen to the user at the time of a walk. It is a figure which shows the example of the presentation of the navigation screen to the user at the time of driving | running | working. It is a figure which shows the example of the presentation of the running application screen to the user at the time of stillness. It is a figure which shows the example of the presentation of the running application screen to the user at the time of walking. It is a figure which shows the example of the presentation of the running application screen to the user at the time of driving | running | working. It is a figure which shows the example which controls the display position of a virtual object based on the luminance information of a captured image. It is a figure which shows the example which controls the display position of a virtual object based on the color information of a captured image. It is a figure which shows the example which controls the light shielding amount based on the luminance information of a captured image. It is a figure which shows the example which controls the light shielding amount based on the luminance information of a captured image. 5 is a flowchart showing a flow of operations of a display control apparatus according to an embodiment of the present disclosure. FIG. 3 is a diagram illustrating a hardware configuration example of a display control device according to an embodiment of the present disclosure.

  Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In the present specification and drawings, components having substantially the same functional configuration are denoted by the same reference numerals, and redundant description is omitted.

  In the present specification and drawings, a plurality of constituent elements having substantially the same functional configuration may be distinguished by attaching different alphabets or numbers after the same reference numeral. However, when it is not necessary to particularly distinguish each of a plurality of constituent elements having substantially the same functional configuration, only the same reference numerals are given.

Further, the “DETAILED DESCRIPTION OF THE INVENTION” will be described according to the following item order.
1. Embodiment 1-1. Configuration example of information processing system 1-2. Functional configuration example of information processing system 1-3. Detailed function of display control device 1-4. Operation of display control apparatus 1-5. 1. Hardware configuration example Conclusion

<< 1. Embodiment >>
First, an embodiment of the present disclosure will be described.

[1-1. Configuration example of information processing system]
First, a configuration example of the information processing system 1 according to the embodiment of the present disclosure will be described. FIG. 1 is a diagram illustrating a configuration example of an information processing system 1 according to an embodiment of the present disclosure. As illustrated in FIG. 1, the information processing system 1 includes a display control device 10, an imaging unit 130, a sensor unit 140, a display unit 150, and a light shielding unit 160.

  The imaging unit 130 has a function of imaging the imaging range. For example, the imaging unit 130 is mounted on the user's head so that the user's line-of-sight direction can be captured. The captured image 30 obtained by imaging by the imaging unit 130 is provided to the display control device 10 by, for example, a wireless signal or a wired signal. In the example illustrated in FIG. 1, the imaging unit 130 is configured separately from the display control device 10, but the imaging unit 130 may be integrated with the display control device 10.

  The sensor unit 140 detects sensor data. For example, the sensor unit 140 captures an image of the user U's eye area and obtains an imaging result. In the following description, it is mainly assumed that both eye regions of the user U are imaged by the sensor unit 140, but the sensor unit 140 may image one eye region of the user U. The imaging result 40 obtained by imaging by the sensor unit 140 is provided to the display control device 10 by a wireless signal or a wired signal, for example.

  In addition, in this specification, although the case where the sensor part 140 images mainly the user's U eye area | region is mainly demonstrated, you may perform the other measurement regarding the user's U body. For example, the sensor unit 140 may measure the myoelectricity of the user U. In such a case, the myoelectric measurement result obtained by being imaged by the sensor unit 140 is provided to the display control device 10 by, for example, a wireless signal or a wired signal.

  In the example illustrated in FIG. 1, the sensor unit 140 is configured separately from the display control device 10, but the sensor unit 140 may be integrated with the display control device 10. Further, as will be described later, the information processing system 1 may include a sensor in addition to the sensor unit 140.

  The display unit 150 has a function of displaying a virtual object according to a control signal provided from the display control device 10 by a wireless signal or a wired signal. The type of virtual object displayed by the display unit 150 is not particularly limited. Further, in this specification, it is assumed that the display unit 150 is a transmissive HMD (Head Mount Display). In the example illustrated in FIG. 1, the display unit 150 is configured separately from the display control device 10, but the display unit 150 may be integrated with the display control device 10.

  The light shielding unit 160 has a function of adjusting the amount of light reaching the eye area of the user U. The light blocking unit 160 may block only a part of the light that has passed through the display unit 150, may block all of the light, or may transmit all of the light. In the example illustrated in FIG. 1, the light shielding unit 160 is provided outside the display unit 150, but the position where the light shielding unit 160 is provided is not particularly limited. The light shielding unit 160 may be configured by a liquid crystal shutter, for example. In the example illustrated in FIG. 1, the light shielding unit 160 is configured separately from the display control device 10, but the light shielding unit 160 may be integrated with the display control device 10.

  The configuration example of the information processing system 1 according to the embodiment of the present disclosure has been described above.

[1-2. Functional configuration example of information processing system]
Subsequently, a functional configuration example of the information processing system 1 according to the embodiment of the present disclosure will be described. FIG. 2 is a diagram illustrating a functional configuration example of the information processing system 1 according to the embodiment of the present disclosure. As illustrated in FIG. 2, the display control apparatus 10 according to the embodiment of the present disclosure includes a control unit 110 and a storage unit 120. As described above, each of the imaging unit 130, the sensor unit 140, the display unit 150, and the light shielding unit 160 is connected to the display control device 10 wirelessly or by wire.

  The control unit 110 corresponds to a processor such as a CPU (Central Processing Unit), for example. The control unit 110 exhibits various functions of the control unit 110 by executing a program stored in the storage unit 120 or another storage medium. The control unit 110 includes a viewpoint detection unit 111, a viewpoint acquisition unit 112, a display control unit 113, an action recognition unit 114, an action acquisition unit 115, an image acquisition unit 116, and a light shielding control unit 117. The functions of each of these functional blocks will be described later.

  The storage unit 120 stores a program for operating the control unit 110 using a storage medium such as a semiconductor memory or a hard disk. For example, the storage unit 120 can also store various data used by the program (for example, an image for stereoscopically displaying a virtual object). In the example illustrated in FIG. 2, the storage unit 120 is integrated with the display control device 10, but the storage unit 120 may be configured separately from the display control device 10.

  The functional configuration example of the information processing system 1 according to the embodiment of the present disclosure has been described above.

[1-3. Detailed functions of display control unit]
Subsequently, functional details of the display control apparatus 10 according to the embodiment of the present disclosure will be described. First, the display control unit 113 has a function of controlling the display unit 150 so that the virtual object is stereoscopically displayed by the display unit 150, and has a function of controlling the depth direction position of the virtual object presented to the user. doing. Therefore, an example of a method for controlling the position in the depth direction of the virtual object presented to the user will be described.

  FIG. 3 is a diagram for explaining an example of a technique for controlling the position in the depth direction of the virtual object presented to the user. Referring to FIG. 3, the left eye position el and the right eye position er of the user are shown. Here, the display control unit 113 displays the left eye image presented to the user's left eye at the display position dl of the display unit 150L and displays the right eye image presented to the user's right eye at the display position of the display unit 150R. When displayed on dr, the virtual object is stereoscopically displayed at the display position P. The display position P corresponds to the intersection of a straight line connecting the left eye position el and the display position dl and a straight line connecting the right eye position er and the display position dr.

  In the example shown in FIG. 3, a distance from the display position P to a straight line connecting the user's left eye position el and right eye position er is a convergence distance D, and a line segment connecting the left eye position el and the display position P An angle formed by a line segment connecting the right eye position er and the display position P is defined as a convergence angle a. The display control unit 113 increases the distance between the display position dl and the display position dr, thereby increasing the convergence distance D (or decreasing the convergence angle), and the position of the virtual object presented to the user in the depth direction. Can be kept away from the user.

  On the other hand, the display control unit 113 reduces the interval between the display position dl and the display position dr, thereby reducing the convergence distance D (or increasing the convergence angle), and the depth direction of the virtual object presented to the user. Can be brought closer to the user. In this way, the display control unit 113 can control the position in the depth direction of the virtual object presented to the user by controlling the display position dl of the left eye image and the display position dr of the right eye image. Is possible. However, the technique described here is merely an example. Therefore, the method for controlling the position in the depth direction of the virtual object presented to the user is not particularly limited.

  For example, the display control unit 113 controls the position of the virtual object in the depth direction that is presented to the user by controlling the size of the virtual object by using the characteristic that the larger virtual object appears to exist in the foreground. May be. Further, the display control unit 113 may control the position in the depth direction of the virtual object presented to the user by controlling the position where the virtual object is focused. Furthermore, the display control unit 113 may control the position in the depth direction of the virtual object presented to the user by controlling the magnitude of the parallax.

  The example of the method for controlling the position in the depth direction of the virtual object presented to the user has been described above. Here, in a case where a shift occurs between the position of the virtual object in the depth direction and the user's viewpoint, a situation may occur in which it is difficult to view the virtual object. Therefore, the present specification proposes a technique capable of performing a stereoscopic display of a virtual object so that the user can more easily browse.

  The viewpoint detection unit 111 detects the user's viewpoint based on the sensor data detected by the sensor unit 140. For example, the viewpoint detection unit 111 detects the user's viewpoint based on the imaging result 40 captured by the sensor unit 140. As a viewpoint detection method by the viewpoint detection unit 111, for example, the technique disclosed in Japanese Patent Application Laid-Open No. 2012-8746 can be used, but the viewpoint detection method by the viewpoint detection unit 111 is not particularly limited.

  For example, the viewpoint detection unit 111 may detect the user's viewpoint based on the measurement result of myoelectricity by the sensor unit 140. In the example illustrated in FIG. 2, the viewpoint detection unit 111 is provided in the display control device 10, but may be provided in the sensor unit 140 instead of the display control device 10. The viewpoint of the user detected by the viewpoint detection unit 111 is acquired by the viewpoint acquisition unit 112.

  The behavior recognition unit 114 recognizes user behavior. For example, the behavior recognition unit 114 can employ a technique disclosed in, for example, Japanese Patent Application Laid-Open No. 2006-345269 as a method for recognizing a user's behavior. According to this technique, for example, a user's movement is detected by a sensor, and the detected movement is analyzed by the action recognition unit 114, whereby the user's action is recognized.

  However, the action recognition method by the action recognition unit 114 is not limited to such an example. For example, when an action input is received from the user, the action recognition unit 114 may acquire the action for which the input from the user is received. In the example illustrated in FIG. 2, the action recognition unit 114 is provided in the display control device 10, but may be provided in the sensor unit 140 instead of the display control device 10. The action of the user recognized by the action recognition unit 114 is acquired by the action acquisition unit 115.

  Subsequently, the display control unit 113 controls the position in the depth direction of the virtual object presented to the user based on the viewpoint acquired by the viewpoint acquisition unit 112. Such control makes it possible to control the position in the depth direction of the virtual object presented to the user according to the perspective of the user's viewpoint, and to perform a stereoscopic display of the virtual object so that the user can more easily view it. Is possible.

  Hereinafter, an example of a technique for controlling the position in the depth direction of the virtual object presented to the user will be described in more detail. First, a case where the virtual object is a weather forecast screen will be described with reference to FIGS. However, since the type of the virtual object is not particularly limited as described above, it goes without saying that the virtual object is not limited to the weather forecast screen.

  4-6 is a figure which shows the example of presentation of the weather forecast screen 50-A1-50-A3 to a user at the time of stillness, a walk, and each time of a run. As shown in FIGS. 4 to 6, the viewpoint of the user is farther when walking than when stationary, and the viewpoint of the user is farther when traveling than when walking. Therefore, for example, the display control unit 113 only needs to move the position in the depth direction of the weather forecast screen presented to the user as the viewpoint is farther from the user.

  In addition, the case where only a viewpoint was changed temporarily is assumed. In such a case, if the position in the depth direction of the virtual object presented to the user is changed every time the perspective of the user changes, there is a possibility that the user will be bothered. Therefore, the display control unit 113 may control the position in the depth direction of the virtual object presented to the user when the viewpoint has not been changed even after the predetermined time.

  Each of the weather forecast screens 50-A1 to 50-A3 includes content (for example, character data, image data, etc.). The content may be constant without depending on the user's behavior, but may be changed according to the user's behavior. For example, the display control unit 113 may control content included in the weather forecast screen based on the behavior acquired by the behavior acquisition unit 115.

  The content included in the weather forecast screen may be controlled in any way, but the display control unit 113 may control the information amount of the content included in the virtual object based on the user's behavior. For example, as shown in FIGS. 4 to 6, a situation may occur in which it is more difficult to view content when walking than when stationary. In addition, it may occur that it is more difficult to browse content when running than when walking. Therefore, the display control unit 113 may perform control so that the information amount of the content included in the weather forecast screen presented to the user decreases as the action movement speed increases.

  Further, the display control unit 113 may control the display size of the content included in the virtual object based on the user's action. For example, as described above, a situation may occur where it is more difficult to view content when walking than when stationary. In addition, it may occur that it is more difficult to browse content when running than when walking. Therefore, the display control unit 113 may perform control so that the display size of the content included in the weather forecast screen presented to the user increases as the action movement speed increases.

  Further, the display control unit 113 may control the position of the content included in the virtual object in the virtual object based on the user's action. For example, as described above, a situation may occur where it is more difficult to view content when walking than when stationary. In addition, it may occur that it is more difficult to browse content when running than when walking. Therefore, the display control unit 113 may perform control so that the position of the content included in the weather forecast screen presented to the user in the virtual object is biased toward the end of the virtual object as the action movement speed increases.

  The weather forecast screen corresponding to the user's action may be created in advance or may be created every time display is required. For example, when a weather forecast screen is created in advance, the display control unit 113 may present a weather forecast screen corresponding to the user's behavior to the user. Further, the display control unit 113 may create a weather forecast screen based on the information amount of content corresponding to the user's action.

  Similarly, the display control unit 113 may create a weather forecast screen based on the display size of content corresponding to the user's action. The display control unit 113 may create a weather forecast screen based on the position of the content in the virtual object.

  The display control unit 113 may control the depth direction position of the virtual object presented to the user based on the user's behavior. For example, the display control unit 113 may perform control so that the position in the depth direction of the weather forecast screen presented to the user becomes farther as the movement speed indicated by the action increases.

  The display control unit 113 may control the depth direction position of the virtual object presented to the user based on either the user's behavior or the viewpoint, but based on both the user's behavior and the viewpoint. Then, the position in the depth direction of the virtual object presented to the user may be controlled. Alternatively, the display control unit 113 may determine which of the user's action and viewpoint is used with priority according to the situation.

  FIG. 7 is a diagram illustrating an example of presentation of the weather forecast screen 50-A4 to the user during driving. As shown in FIG. 7, when the user is driving a car, the behavior is “at rest”, but the viewpoint is often far from the user. Therefore, the display control unit 113 may use the viewpoint with priority over the action, and may control the position in the depth direction of the weather forecast screen 50-A4 presented to the user based on the viewpoint.

  8-10 is a figure which shows the example of presentation of navigation screen 50-B1-50-B3 to a user at the time of stillness, a walk, and a driving | running | working, respectively. As shown in FIGS. 8 to 10, when the virtual object is the navigation screen, the depth direction position of the virtual object presented to the user is controlled in the same manner as when the virtual object is the weather forecast screen. obtain. Needless to say, the virtual object is not limited to the navigation screen.

  11 to 13 are diagrams showing examples of presentation of the running application screens 50-C1 to 50-C3 to the user when stationary, walking and running. As shown in FIGS. 11 to 13, when the virtual object is the running application screen, the depth direction position of the virtual object presented to the user is controlled in the same manner as when the virtual object is the weather forecast screen. Can be done. Needless to say, the virtual object is not limited to the running application screen.

  In the example described above, the method of controlling the virtual object based on the user's own viewpoint and behavior has been described, but it is also conceivable to control the virtual object based on various other factors. As an example, the image acquisition unit 116 acquires the captured image 30 captured by the imaging unit 130, and the display control unit 113 controls the virtual object based on the captured image 30 acquired by the image acquisition unit 116. Good. According to such control, it becomes possible to control the virtual object according to the environment around the user.

  The method for controlling the virtual object based on the captured image 30 is not particularly limited. For example, the display control unit 113 may control the display position of the virtual object based on the luminance information of the captured image 30. FIG. 14 is a diagram illustrating an example of controlling the display position of the virtual object 50 based on the luminance information of the captured image 30. Referring to FIG. 14, the captured image 30-A includes a region 30-A1 and a region 30-A2.

  Here, it is assumed that the display control unit 113 detects that the luminance of the region 30-A1 is higher than the threshold value when trying to display the virtual object 50 in the region 30-A1. On the other hand, it is assumed that the display control unit 113 detects that the brightness of the region 30-A2 is lower than the threshold value. In such a case, the display control unit 113 can change the display position of the virtual object 50 to the region 30-A2. In this way, it is possible to present the virtual object 50 that is easier for the user to browse.

  Although the example in which the display control unit 113 controls the display position of the virtual object 50 has been described, the display control unit 113 may control the luminance of the virtual object based on the luminance information of the captured image 30. For example, in the example illustrated in FIG. 14, the display control unit 113 may increase the brightness of the virtual object 50 instead of changing the display position of the virtual object 50 to the region 30 -A 2. Even in this way, it is possible to present the virtual object 50 that is easy for the user to browse.

  Further, the display control unit 113 may control the display position of the virtual object based on the color information of the captured image 30. FIG. 15 is a diagram illustrating an example of controlling the display position of the virtual object 50 based on the color information of the captured image 30. Referring to FIG. 15, the captured image 30-B includes a region 30-B1 and a region 30-B2.

  Here, it is assumed that the display control unit 113 detects that the region 30-B1 and the virtual object 50 have similar colors when attempting to display the virtual object 50 in the region 30-B1. On the other hand, it is assumed that the display control unit 113 detects that the region 30-B2 and the virtual object 50 are not similar colors. In such a case, the display control unit 113 can change the display position of the virtual object 50 to the region 30-B2. In this way, it is possible to present the virtual object 50 that is easier for the user to browse.

  For example, when the distance between the color of the region 30-B2 and the color of the virtual object 50 is less than the threshold, the display control unit 113 detects that the region 30-B2 and the virtual object 50 are similar colors. The distance between the color of the region 30-B2 and the color of the virtual object 50 is obtained by plotting the R value, G value, and B value of the region 30-B2 on the X axis, the Y axis, and the Z axis. When the G value and the B value are plotted on the X axis, the Y axis, and the Z axis, they can be calculated from a three-dimensional distance between the two points.

  Although the example in which the display control unit 113 controls the display position of the virtual object 50 has been described, the display control unit 113 may control the color of the virtual object based on the color information of the captured image 30. For example, in the example illustrated in FIG. 15, the display control unit 113 may change the color of the virtual object 50 instead of changing the display position of the virtual object 50 to the region 30 -B 2. The display control unit 113 may change the color of the virtual object 50 to the complementary color of the color of the region 30-B2. Even in this way, it is possible to present the virtual object 50 that is easy for the user to browse.

  For example, the display control unit 113 may control the display position of the virtual object 50 based on the feature amount extracted from the captured image 30. Reference is again made to FIG. Here, when the display control unit 113 tries to display the virtual object 50 in the region 30-A1, since an object is reflected in front of the wall in the region 30-A1, the feature extracted from the region 30-A1. Detect that quantity stability is less than threshold. On the other hand, the display control unit 113 detects that the stability of the feature amount extracted from the region 30-A2 is larger than the threshold because no object is reflected in front of the wall in the region 30-A2.

  In such a case, the display control unit 113 can change the display position of the virtual object 50 to the region 30-A2. In this way, it is possible to present the virtual object 50 that is easier for the user to browse. For example, the display control unit 113 calculates higher stability as the difference value between the maximum value and the minimum value of the feature amount in each region is smaller. You can do it.

  For example, when an object is detected from the captured image 30, the display control unit 113 may control the position of the virtual object 50 presented to the user based on the position of the object. Again, referring to FIG. 14, a description will be given by taking a wall as an example of an object. Here, it is assumed that the display control unit 113 recognizes that a wall is reflected in the region 30-A2 when trying to display the virtual object 50. In such a case, the display control unit 113 may display the virtual object 50 in the region 30-A2 that has been recognized that the wall is reflected.

  Further, the display control unit 113 may control the position of the virtual object 50 in the depth direction. For example, the display control unit 113 measures the distance from the imaging unit 130 to the focused target as the position in the depth direction of the wall, and the position in the depth direction of the virtual object 50 matches the position in the depth direction of the wall. You can do it. In this way, the position of the virtual object 50 in the depth direction is also adjusted according to the position of the object in the depth direction, so that the virtual object 50 can be presented more naturally.

  Here, as described above, the information processing system 1 includes the light shielding unit 160 that adjusts the amount of light reaching the eye area of the user U. The light shielding amount by the light shielding unit 160 may be constant, but may be controlled according to the situation. For example, the light shielding control unit 117 may control the light shielding amount by the light shielding unit 160 based on the luminance information of the captured image 30. 16 and 17 are diagrams illustrating an example of controlling the light shielding amount based on the luminance information of the captured image 30. FIG.

  In the example illustrated in FIG. 16, the captured image 30 -C 1 is acquired by the image acquisition unit 116. Here, it is assumed that the brightness is high because the captured image 30-C1 is captured in a bright place. In such a case, the light shielding control unit 117 may control the light shielding unit 160 (the light shielding unit 160L and the light shielding unit 160R) so that the amount of light shielding increases.

  On the other hand, in the example illustrated in FIG. 17, the captured image 30 -C 2 is acquired by the image acquisition unit 116. Here, it is assumed that the brightness is low because the captured image 30-C2 is captured in a dark place. In such a case, the light shielding control unit 117 may control the light shielding unit 160 (the light shielding unit 160L and the light shielding unit 160R) so as to reduce the light shielding amount.

  In this way, the light shielding control unit 117 may control the light shielding unit 160 so that the light shielding amount by the light shielding unit 160 increases as the brightness of the captured image 30 increases. According to such control, the brighter the user's field of view, the smaller the amount of light incident on the user's eyes, and it can be expected that the user can more easily view the virtual object 50.

  The function details of the display control apparatus 10 according to the embodiment of the present disclosure have been described above.

[1-4. Operation of display control device]
Subsequently, a flow of operations of the display control apparatus 10 according to the embodiment of the present disclosure will be described. FIG. 18 is a flowchart illustrating an operation flow of the display control apparatus 10 according to the embodiment of the present disclosure. Note that the example illustrated in FIG. 18 is only an example of the operation flow of the display control apparatus 10 according to the embodiment of the present disclosure. Therefore, the operation flow of the display control apparatus 10 according to the embodiment of the present disclosure is not limited to the example illustrated in FIG.

  As illustrated in FIG. 18, first, the viewpoint acquisition unit 112 acquires the user's viewpoint detected by the viewpoint detection unit 111 (S <b> 11), and the behavior acquisition unit 115 recognizes the user's behavior recognized by the behavior recognition unit 114. Is acquired (S12). Further, the image acquisition unit 116 acquires a captured image captured by the imaging unit 130 (S13). The display control unit 113 controls the position in the depth direction of the virtual object presented to the user based on the viewpoint acquired by the viewpoint acquisition unit 112 (S14).

  Further, the display control unit 113 controls the content included in the virtual object based on the behavior acquired by the behavior acquisition unit 115 (S15). Further, the display control unit 113 controls the virtual object based on the captured image captured by the imaging unit 130 (S16). The light shielding control unit 117 controls the light shielding amount by the light shielding unit 160 based on the luminance information of the captured image (S17). After the operation of S17 ends, the control unit 110 may return to the operation of S11 again or may end the operation.

  The flow of operations of the display control apparatus 10 according to the embodiment of the present disclosure has been described above.

[1-5. Hardware configuration example]
Subsequently, a hardware configuration example of the display control apparatus 10 according to the embodiment of the present disclosure will be described. FIG. 19 is a diagram illustrating a hardware configuration example of the display control apparatus 10 according to the embodiment of the present disclosure. However, the hardware configuration example illustrated in FIG. 19 is merely an example of the hardware configuration of the display control apparatus 10. Therefore, the hardware configuration of the display control apparatus 10 is not limited to the example shown in FIG.

  As shown in FIG. 19, the display control device 10 includes a CPU (Central Processing Unit) 901, a ROM (Read Only Memory) 902, a RAM (Random Access Memory) 903, an input device 908, an output device 910, and the like. A storage device 911 and a drive 912.

  The CPU 901 functions as an arithmetic processing device and a control device, and controls the overall operation in the display control device 10 according to various programs. Further, the CPU 901 may be a microprocessor. The ROM 902 stores programs used by the CPU 901, calculation parameters, and the like. The RAM 903 temporarily stores programs used in the execution of the CPU 901, parameters that change as appropriate during the execution, and the like. These are connected to each other by a host bus including a CPU bus.

  The input device 908 receives input of sensor data measured by the sensor unit 140 (for example, an imaging result captured by the sensor unit 140) and a captured image captured by the imaging unit 130. The sensor data and captured image whose input is received by the input device 908 are output to the CPU 901. Further, the input device 908 may output a detection result detected by another sensor to the CPU 901.

  The output device 910 provides output data to the display unit 150. For example, the output device 910 provides display data to the display unit 150 according to control by the CPU 901. When the display unit 150 is configured by an audio output device, the output device 910 provides audio data to the display unit 150 according to control by the CPU 901.

  The storage device 911 is a data storage device configured as an example of the storage unit 120 of the display control device 10. The storage device 911 may include a storage medium, a recording device that records data on the storage medium, a reading device that reads data from the storage medium, a deletion device that deletes data recorded on the storage medium, and the like. The storage device 911 stores programs executed by the CPU 901 and various data.

  The drive 912 is a storage medium reader / writer, and is built in or externally attached to the display control device 10. The drive 912 reads information recorded on a removable storage medium 71 such as a mounted magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and outputs the information to the RAM 903. The drive 912 can also write information into the removable storage medium 71.

  Heretofore, the hardware configuration example of the display control apparatus 10 according to the embodiment of the present disclosure has been described.

<< 2. Conclusion >>
As described above, according to the embodiment of the present disclosure, the viewpoint acquisition unit 112 that acquires the viewpoint of the user detected by the viewpoint detection unit 111 and the virtual object 50 are displayed so as to be stereoscopically displayed on the display unit 150. A display control unit 113 that controls the unit 150, and the display control unit 113 controls the position in the depth direction of the virtual object 50 presented to the user based on the viewpoint. . According to this configuration, it is possible to perform a stereoscopic display of the virtual object so that the user can more easily browse.

  In addition, although preferred embodiment of this indication was described in detail, referring an accompanying drawing, the technical scope of this indication is not limited to this example. It is obvious that a person having ordinary knowledge in the technical field of the present disclosure can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that it belongs to the technical scope of the present disclosure.

  In addition, it is possible to create a program for causing hardware such as a CPU, ROM, and RAM incorporated in a computer to exhibit functions equivalent to the configuration of the display control apparatus 10 described above. Also, a computer-readable recording medium that records the program can be provided.

The following configurations also belong to the technical scope of the present disclosure.
(1)
A viewpoint acquisition unit that acquires the viewpoint of the user detected by the viewpoint detection unit;
A display control unit that controls the display unit so that the virtual object is stereoscopically displayed by the display unit,
The display control unit controls the position in the depth direction of the virtual object presented to the user based on the viewpoint.
Display control device.
(2)
The display control device includes:
An action acquisition unit for acquiring the user's action recognized by the action recognition unit;
The display control unit controls content included in the virtual object based on the behavior.
The display control device according to (1).
(3)
The display control unit controls an information amount of content included in the virtual object based on the behavior;
The display control apparatus according to (2).
(4)
The display control unit controls a display size of content included in the virtual object based on the behavior;
The display control apparatus according to (2).
(5)
The display control unit controls a position of the content included in the virtual object in the virtual object based on the behavior;
The display control apparatus according to (2).
(6)
The display control device includes:
An action acquisition unit for acquiring the user's action recognized by the action recognition unit;
The display control unit controls the position in the depth direction of the virtual object presented to the user based on the action.
The display control device according to (1).
(7)
The display control device includes:
An image acquisition unit that acquires a captured image captured by the imaging unit;
The display control unit controls the virtual object based on the captured image;
The display control apparatus according to any one of (1) to (6).
(8)
The display control unit controls a display position of the virtual object based on luminance information of the captured image;
The display control apparatus according to (7).
(9)
The display control unit controls the luminance of the virtual object based on luminance information of the captured image.
The display control apparatus according to (7).
(10)
The display control unit controls a display position of the virtual object based on color information of the captured image;
The display control apparatus according to (7).
(11)
The display control unit controls a color of the virtual object based on color information of the captured image;
The display control apparatus according to (7).
(12)
The display control unit controls a display position of the virtual object based on a feature amount extracted from the captured image;
The display control apparatus according to (7).
(13)
The display control device includes:
An image acquisition unit for acquiring a captured image captured by the imaging unit;
A light shielding control unit that controls a light shielding amount by the light shielding unit based on luminance information of the captured image;
Further comprising
The display control apparatus according to any one of (1) to (12).
(14)
The display control unit is presented to the user by controlling a display position of a left eye image presented to the left eye of the user and a display position of a right eye image presented to the right eye of the user. Control the position of the virtual object in the depth direction,
The display control apparatus according to any one of (1) to (13).
(15)
The display control device includes:
An image acquisition unit that acquires a captured image captured by the imaging unit;
The display control unit, when an object is detected from the captured image, controls the position of the virtual object presented to the user based on the position of the object.
The display control apparatus according to any one of (1) to (14).
(16)
The display control unit increases the depth direction position of the virtual object presented to the user as the viewpoint is farther from the user.
The display control apparatus according to any one of (1) to (15).
(17)
Obtaining the user's viewpoint detected by the viewpoint detector;
Controlling the display unit such that the virtual object is stereoscopically displayed by the display unit,
Controlling the position in the depth direction of the virtual object presented to the user based on the viewpoint;
Including a display control method.
(18)
Computer
A viewpoint acquisition unit that acquires the viewpoint of the user detected by the viewpoint detection unit;
A display control unit that controls the display unit so that the virtual object is stereoscopically displayed by the display unit,
The display control unit controls the position in the depth direction of the virtual object presented to the user based on the viewpoint.
A computer-readable recording medium having recorded thereon a program for causing it to function as a display control device.

DESCRIPTION OF SYMBOLS 1 Information processing system 10 Display control apparatus 30 Captured image 40 Imaging result 50 Virtual object 110 Control part 111 View point detection part 112 View point acquisition part 113 Display control part 114 Action recognition part 115 Action acquisition part 116 Image acquisition part 117 Light-shielding control part 120 Storage Unit 130 imaging unit 140 sensor unit 150 (150L, 150R) display unit 160 (160L, 160R) light shielding unit

Claims (18)

A viewpoint acquisition unit that acquires the viewpoint of the user detected by the viewpoint detection unit;
A display control unit that controls the display unit so that the virtual object is stereoscopically displayed by the display unit,
The display control unit controls the position in the depth direction of the virtual object presented to the user based on the viewpoint.
Display control device. The display control device includes:
An action acquisition unit for acquiring the user's action recognized by the action recognition unit;
The display control unit controls content included in the virtual object based on the behavior.
The display control apparatus according to claim 1. The display control unit controls an information amount of content included in the virtual object based on the behavior;
The display control apparatus according to claim 2. The display control unit controls a display size of content included in the virtual object based on the behavior;
The display control apparatus according to claim 2. The display control unit controls a position of the content included in the virtual object in the virtual object based on the behavior;
The display control apparatus according to claim 2. The display control device includes:
An action acquisition unit for acquiring the user's action recognized by the action recognition unit;
The display control unit controls the position in the depth direction of the virtual object presented to the user based on the action.
The display control apparatus according to claim 1. The display control device includes:
An image acquisition unit that acquires a captured image captured by the imaging unit;
The display control unit controls the virtual object based on the captured image;
The display control apparatus according to claim 1. The display control unit controls a display position of the virtual object based on luminance information of the captured image;
The display control apparatus according to claim 7. The display control unit controls the luminance of the virtual object based on luminance information of the captured image.
The display control apparatus according to claim 7. The display control unit controls a display position of the virtual object based on color information of the captured image;
The display control apparatus according to claim 7. The display control unit controls a color of the virtual object based on color information of the captured image;
The display control apparatus according to claim 7. The display control unit controls a display position of the virtual object based on a feature amount extracted from the captured image;
The display control apparatus according to claim 7. The display control device includes:
An image acquisition unit for acquiring a captured image captured by the imaging unit;
A light shielding control unit that controls a light shielding amount by the light shielding unit based on luminance information of the captured image;
Further comprising
The display control apparatus according to claim 1. The display control unit is presented to the user by controlling a display position of a left eye image presented to the left eye of the user and a display position of a right eye image presented to the right eye of the user. Control the position of the virtual object in the depth direction,
The display control apparatus according to claim 1. The display control device includes:
An image acquisition unit that acquires a captured image captured by the imaging unit;
The display control unit, when an object is detected from the captured image, controls the position of the virtual object presented to the user based on the position of the object.
The display control apparatus according to claim 1. The display control unit increases the depth direction position of the virtual object presented to the user as the viewpoint is farther from the user.
The display control apparatus according to claim 1. Obtaining the user's viewpoint detected by the viewpoint detector;
Controlling the display unit such that the virtual object is stereoscopically displayed by the display unit,
Controlling the position in the depth direction of the virtual object presented to the user based on the viewpoint;
Including a display control method. Computer
A viewpoint acquisition unit that acquires the viewpoint of the user detected by the viewpoint detection unit;
A display control unit that controls the display unit so that the virtual object is stereoscopically displayed by the display unit,
The display control unit controls the position in the depth direction of the virtual object presented to the user based on the viewpoint.
A computer-readable recording medium having recorded thereon a program for causing it to function as a display control device.

Images