WO2013108298A1

WO2013108298A1 - Device for controlling stereoscopic image display, method for controlling stereoscopic image display, and program

Info

Publication number: WO2013108298A1
Application number: PCT/JP2012/003310
Authority: WO
Inventors: 聖治久保; 明弘海老名
Original assignee: パナソニック株式会社
Priority date: 2012-01-19
Filing date: 2012-05-21
Publication date: 2013-07-25

Abstract

This device for controlling a stereoscopic image display is provided with: an output unit for outputting a stereoscopic image to a display device; an input acceptance unit (12) for accepting from the user a change instruction input for changing the stereoscopic image being displayed on the display device; a variation prediction unit (131) for predicting the variation per unit of time in the degree to which an element appears to protrude from the stereoscopic image and the degree to which an element appears to withdraw into the stereoscopic image when the stereoscopic image has been changed in accordance with the change instruction accepted by the input acceptance unit (12); and a display control unit (132) for delaying the rate of change of the stereoscopic image outputted from the output unit when the variation per unit of time in either the amount of overshoot or the amount of convergence predicted by the variation prediction unit (131) exceeds a predetermined threshold.

Description

Stereoscopic image display control device, stereoscopic image display control method, and program

The present invention relates to a stereoscopic image display control apparatus capable of displaying a stereoscopic image.

In recent years, TVs and the like that can enjoy viewing stereoscopic (3D) images by using the parallax between the left-eye image and the right-eye image have become widespread. Further, such a stereoscopic image can be displayed not only on a TV but also on a mobile terminal such as a portable terminal, and an environment in which a stereoscopic image can be easily viewed at home or outdoors has become widespread. Then, it is expected to develop a device that allows a user to freely view a stereoscopic image from various angles by moving the stereoscopic image freely by the user's intention, and to view the stereoscopic image without feeling tired.

In Patent Document 1, in order to prevent a stereoscopically-viewed object included in image data from being perceived as moving at a speed equal to or greater than a predetermined value in the user direction, the left eye is directed in a direction that reduces user discomfort. An apparatus is disclosed that adjusts and displays the amount of parallax between the image for use and the image for the right eye.

JP 2011-55421 A

However, in the apparatus described in Patent Document 1, attention is paid to a change in the amount of projection of the stereoscopically viewed object in the user direction, and user fatigue due to movement of the stereoscopically viewed object in the depth direction (retraction direction) is considered. It has not been. Further, the apparatus described in Patent Document 1 adjusts the amount of popping out by adjusting image data, and there is a problem that it does not take into consideration that the size and shape of the object itself are kept constant.

The present invention has been made in view of the above-described problems, and an object thereof is to provide a stereoscopic image display control device capable of reducing fatigue given to a viewer.

The stereoscopic image display control device according to an aspect of the present invention displays a stereoscopic image on the display device. Specifically, the stereoscopic image display control device includes an output unit that outputs a stereoscopic image to the display device, and an input reception unit that receives an input of a change instruction for changing the stereoscopic image displayed on the display device from a user. A change amount predicting unit that predicts a change amount of the pop-out amount and the retraction amount per unit time of the stereoscopic image when the stereoscopic image is changed according to the change instruction received by the input receiving unit, and the input A display control unit that changes a stereoscopic image output from the output unit in accordance with the change instruction received by the reception unit. Then, the display control unit, when the change amount of the pop-out amount or the retraction amount per unit time predicted by the change amount prediction unit exceeds a predetermined threshold, the stereoscopic image output from the output unit The change rate of the stereoscopic image is slowed so that the amount of change of the pop-out amount or the amount of retraction per unit time is equal to or less than the threshold value.

These general or specific aspects may be realized by a system, a method, an integrated circuit, a computer program, or a recording medium, and are realized by any combination of the system, method, integrated circuit, computer program, and recording medium. May be.

According to the present invention, it is possible to reduce fatigue given to viewers of stereoscopic images.

FIG. 1 is a block diagram of the stereoscopic image display control apparatus according to the first embodiment. FIG. 2 is a flowchart of the stereoscopic image display control method according to the first embodiment. FIG. 3 is a diagram illustrating an example of rotation of a stereoscopic image displayed on the display unit. FIG. 4 is a diagram illustrating a control result of the rotation speed of the stereoscopic image of FIG. FIG. 5 is a diagram illustrating another example of rotation of a stereoscopic image displayed on the display unit. FIG. 6 is a diagram illustrating a control result of the rotation speed of the stereoscopic image of FIG. FIG. 7 is a diagram illustrating another example of rotation of a stereoscopic image displayed on the display unit. FIG. 8 is a diagram illustrating a control result of the rotation speed of the stereoscopic image of FIG. FIG. 9 is a flowchart of the stereoscopic image display control method according to the second embodiment. FIG. 10 is a diagram illustrating an example of rotation of a stereoscopic image displayed on the display unit. FIG. 11 is a diagram illustrating a control result of the rotation speed of the stereoscopic image of FIG. FIG. 12 is a block diagram of the stereoscopic image display control apparatus according to the third embodiment. FIG. 13 is a flowchart corresponding to FIG. 2 of the stereoscopic image display control method according to the third embodiment. FIG. 14 is a flowchart corresponding to FIG. 9 of the stereoscopic image display control method according to the third embodiment. FIG. 15 is a flowchart of a stereoscopic image display control method according to a modification of the third embodiment. FIG. 16 is a diagram illustrating an example of rotation of a stereoscopic image that is asymmetric with respect to the rotation center. FIG. 17 is a diagram illustrating a control result of the rotation speed of the stereoscopic image of FIG. FIG. 18 is a diagram illustrating an example of rotating a stereoscopic image having a pattern on the surface.

As in the above configuration, when changing the stereoscopic image, if the amount of change per unit time of the pop-out amount or the retraction amount exceeds the threshold, the change rate is slowed to reduce the fatigue given to the viewer. it can.

Note that “changing a stereoscopic image according to a change instruction” refers to changing the stereoscopic image according to, for example, a change amount, a change time, or a change speed indicated in the change instruction. Further, “reducing the change speed of the stereoscopic image” means changing the stereoscopic image at a speed slower than the change speed indicated in the change instruction.

As an example, the change amount prediction unit may calculate a difference in the amount of protrusion of a point on the stereoscopic image that protrudes most from the display surface of the display device before and after a unit time as a change amount of the amount of protrusion per unit time. The difference in the amount of retraction of the point on the stereoscopic image most retracted from the display surface of the display device before and after the unit time may be predicted as the amount of change in the amount of retraction per unit time. Good.

As described above, the first point farthest from the display surface before the change of the stereoscopic image and the second point different from the first point farthest from the display surface after the change of the stereoscopic image are used to jump out. The amount of change per unit time of the amount and the amount of retraction can be predicted.

As another example, the change amount prediction unit may predict a difference in pop-out amount before and after a unit time of a specific point of a stereoscopic image as a change amount of the pop-out amount per unit time. The difference in the amount of retraction before and after the unit time at this point may be predicted as the amount of change in the amount of retraction per unit time.

Also, it is possible to predict the amount of change per unit time of the pop-out amount and the retraction amount using the distance from the display surface before and after the change of the stereo image of a specific point (same point) on the stereo image. The “specific point” may be, for example, a pattern (texture) attached to the surface of the stereoscopic image, and when the stereoscopic image is changed by moving a finger superimposed on the stereoscopic image, It is also possible that the finger is superimposed.

As an example, the change instruction may include information specifying a change amount of the stereoscopic image and a change time required to change the stereoscopic image by the change amount. Then, when the change amount of the pop-out amount or the retraction amount per unit time predicted by the change amount prediction unit exceeds the threshold value, the display control unit takes only the change amount over a longer time than the change time. The stereoscopic image may be changed.

Thus, by changing the stereoscopic image by the same amount as the change amount indicated by the change instruction, it is possible to slow down the change speed of the stereoscopic image by taking a longer time than the change time indicated by the change instruction.

As another example, the change instruction may include information specifying a change amount of a stereoscopic image and a change time required to change the stereoscopic image by the change amount. The display control unit, when the change amount of the pop-out amount or the retraction amount per unit time predicted by the change amount prediction unit exceeds the threshold value, is less than the change amount during the change time. The stereoscopic image may be changed.

Also, the change speed of the stereoscopic image can be slowed by changing the stereoscopic image by an amount smaller than the change amount indicated by the change instruction during the same time as the change time indicated by the change instruction.

As yet another example, the display control unit, when the change amount of the pop-out amount or the retraction amount per unit time predicted by the change amount prediction unit exceeds the threshold, the stereoscopic image according to the change instruction The change may not be performed.

Furthermore, the change speed of the stereoscopic image can be reduced by not changing the stereoscopic image indicated by the change instruction at all (changing the change speed to 0).

For example, the stereoscopic image change instruction received by the input receiving unit may include movement, rotation, enlargement, or reduction of the stereoscopic image.

As an example, the input receiving unit may receive the change instruction of a predetermined change amount by a predetermined input operation by a user.

The above example corresponds to a case where, for example, when the user presses the right rotation button (an example of a predetermined operation), the stereoscopic image is rotated to the right by 45 ° (an example of a predetermined change amount).

As another example, the input receiving unit may receive the change instruction with a change amount corresponding to the magnitude of the input operation by the user.

In the above example, for example, the change amount of the stereoscopic image is changed in an analog manner according to the slide amount (an example of the size of the input operation) when the user slides the finger on the display screen. To do.

Furthermore, the stereoscopic image display control device may include the display device.

As described above, the stereoscopic image display control device may include a display device, or may control display on an external display device.

The stereoscopic image display control method according to an aspect of the present invention is a method for displaying a stereoscopic image on a display device. Specifically, the stereoscopic image display control method includes an output step of outputting a stereoscopic image to the display device, and an input receiving step of receiving an input of a change instruction for changing the stereoscopic image displayed on the display device from a user. A change amount prediction step for predicting a change amount of the pop-out amount and the retraction amount per unit time of the stereoscopic image when the stereoscopic image is changed according to the change instruction received in the input receiving step; A display control step of changing the stereoscopic image output in the output step in accordance with the change instruction received in the reception step. In the display control step, when the amount of change of the pop-out amount or the amount of retraction per unit time predicted in the change amount prediction step exceeds a predetermined threshold, the stereoscopic image output in the output step The change rate of the stereoscopic image is slowed so that the amount of change of the pop-out amount or the amount of retraction per unit time is equal to or less than the threshold value.

The program according to an embodiment of the present invention causes a computer to display a stereoscopic image on a display device. Specifically, the program includes an output step of outputting a stereoscopic image to the display device, an input receiving step of receiving an input of a change instruction for changing the stereoscopic image displayed on the display device, and the input A change amount prediction step for predicting a change amount of the pop-out amount and the retraction amount per unit time of the stereoscopic image when the stereoscopic image is changed in accordance with the change instruction received in the reception step; The computer is caused to execute a display control step of changing the stereoscopic image output in the output step in accordance with the change instruction. In the display control step, when the amount of change of the pop-out amount or the amount of retraction per unit time predicted in the change amount prediction step exceeds a predetermined threshold, the stereoscopic image output in the output step The change rate of the stereoscopic image is slowed so that the amount of change of the pop-out amount or the amount of retraction per unit time is equal to or less than the threshold value.

Hereinafter, specific modes for carrying out the present invention will be described with reference to the drawings. Note that each of the embodiments described below shows a specific example of the present invention. Numerical values, shapes, materials, components, arrangement and connection forms of components, steps, order of steps, and the like shown in the following embodiments are merely examples, and are not intended to limit the present invention. In addition, among the constituent elements in the following embodiments, constituent elements that are not described in the independent claims indicating the highest concept are described as optional constituent elements.

(Embodiment 1)
FIG. 1 is a block diagram of a stereoscopic image display control apparatus 10 according to the first embodiment. The stereoscopic image display control device 10 shown in FIG. 1 is a device that can display a stereoscopic image (3D object), and can change the display of the stereoscopic image (3D object) in accordance with a user operation. .

In the first embodiment, when changing a stereoscopic image in response to a user operation, the amount of projection of the stereoscopic image and the amount of change per unit time of the retraction amount are calculated, and the calculation result is determined in advance. A stereoscopic image display control apparatus and a stereoscopic image display control method for suppressing a sudden change in the pop-out amount and the retracted amount by controlling the change speed of the stereoscopic image when exceeding the threshold value will be described.

Here, the pop-out amount is the distance from the display unit 14 display surface of the stereoscopic image protruding from the display surface of the display unit 14 in the direction in which the user exists. The amount of retraction is the distance from the display unit 14 (display surface) of a stereoscopic image that is retracted from the display surface of the display unit 14 in the direction opposite to the direction in which the user exists (depth direction).

(Block diagram of stereoscopic image display control apparatus 10 according to Embodiment 1)
In FIG. 1, a stereoscopic image display control device 10 receives an image data acquisition unit 11 that acquires stereoscopic image data in order to display a stereoscopic image, and an input that receives an operation (change instruction) from a user for operating the stereoscopic image. The reception unit 12, the control unit 13 that controls the stereoscopic image to be displayed based on the change instruction, the display unit 14 that displays the stereoscopic image using the left-eye image and the right-eye image, and the image data acquisition unit 11 The data storage unit 15 stores the acquired stereoscopic image data and the stereoscopic image data of the stereoscopic image currently displayed on the display unit 14.

The “change instruction” is an instruction to change the stereoscopic image displayed on the display unit 14, and a part of change type, change amount, time required to complete the change, change speed, etc. Includes information that directly or indirectly identifies everything. The “variation type” includes movement, rotation, enlargement, or reduction of the stereoscopic image.

The control unit 13 predicts the change amount prediction unit 131 that predicts the amount of projection of the stereoscopic image and the change amount of the retraction amount per unit time in response to the change instruction received by the input reception unit 12 and the change amount prediction unit 131. The display control unit 132 controls the change rate of the stereoscopic image in accordance with the change amount per unit time of the pop-out amount and / or the retraction amount.

Specifically, the change amount predicting unit 131 acquires a change instruction from the input receiving unit 12 and acquires the data of the stereoscopic image displayed on the display unit 14 from the data holding unit 15. Then, the change amount predicting unit 131 predicts the change amount of the pop-out amount and the retraction amount per unit time of the stereo image when the stereo image is changed according to the change instruction. Then, the display control unit 132 displays the stereoscopic image displayed on the display unit 14 when the amount of change of the pop-out amount or the amount of retraction per unit time predicted by the change amount prediction unit 131 exceeds a predetermined threshold. The change rate of the stereoscopic image is reduced so that the amount of change in the pop-out amount or the retraction amount per unit time is less than or equal to the threshold value.

A specific example of the change instruction receiving method in the input receiving unit 12 is not particularly limited. For example, an input by a touch operation on a touch panel arranged so as to be superimposed on the display unit 14 of the stereoscopic image display control device 10 may be received, or a camera, an infrared method, a capacitance method, an ultrasonic method, It may be received by a method of recognizing a finger or hand movement (gesture) using a sensor such as a magnetic field detection method, or input from a mouse, a touch pad, or a joystick externally connected to the stereoscopic image display control device 10 is accepted. Alternatively, an input from a remote controller may be accepted. That is, any method can be used as long as it can accept input from the user.

In addition, a specific example of a method for acquiring stereoscopic image data for displaying a stereoscopic image in the image data acquisition unit 11 is not particularly limited. For example, it may be acquired from various memories (USB memory or SD card (registered trademark)), or may be acquired via a network such as a wired LAN, a wireless LAN network, and a mobile phone line. That is, any method may be used as long as it can acquire stereoscopic image data. Further, when stereoscopic image data is held in advance in a built-in memory (data holding unit 15) or the like, the stereoscopic image display control device 10 can be configured even if the image data acquisition unit 11 does not exist. It is.

Also, a specific example of the display method of the display unit 14 that displays a stereoscopic image using the left-eye image and the right-eye image is not particularly limited. For example, in the autostereoscopic display method, a parallax barrier, a lenticular, an integral method, or the like may be used. Alternatively, an active shutter type using glasses, a frame sequential method, or the like may be used. That is, any method can be used as long as a stereoscopic image can be displayed.

Further, the image for the left eye and the image for the right eye may normally be images taken by cameras placed at two different positions, or rendered from two different viewpoints using three-dimensional computer graphics. It may be a computer graphics image obtained by performing (a process in which a computer generates a two-dimensional image in consideration of three-dimensional shape data and a viewpoint position). That is, any combination of a left-eye image and a right-eye image that can be recognized as a stereoscopic image may be used.

The display unit 14 is not an essential component for the stereoscopic image display control apparatus 10 according to the first embodiment, and can be omitted. That is, the stereoscopic image display control apparatus 10 according to Embodiment 1 may be an apparatus that outputs a stereoscopic image (that is, an image for the left eye and an image for the right eye) to an external display device. In that case, the stereoscopic image display control device 10 further includes an output unit (not shown) that outputs a stereoscopic image to an external display device.

The data holding unit 15 is a memory that stores stereoscopic image data, state transition states and predicted values, stereoscopic image states, and the like, and can read them out as necessary. Specific examples of the memory are not particularly limited. For example, any means such as DRAM (Dynamic Random Access Memory), SDRAM (Synchronous Dynamic Access Memory), flash memory, ferroelectric memory, and the like can be recorded. You can use things.

(Operation of stereoscopic image display control apparatus 10 according to Embodiment 1)
Hereinafter, the rotation time of the stereoscopic image displayed on the display unit 14 is changed according to the change instruction information received by the input receiving unit 12 and the state of the stereoscopic image currently displayed on the display unit 14. An example of the method according to the first embodiment for controlling the rotation speed by means of FIG. 2 will be described with reference to FIG.

(Step S2001) When the control unit 13 detects that a change instruction from the user is received by the input receiving unit 12 (YES in step S2001), the control unit 13 proceeds to step S2002, and when not detected (NO in step S2001). The process returns to step S2001.

(Step S2002) The change amount prediction unit 131 of the control unit 13 performs a stereoscopic image according to the change instruction based on the change instruction received by the input reception unit 12 and the state of the stereoscopic image currently displayed on the display unit 14. The amount of pop-out per unit time and the amount of change in the amount of retraction when predicting is changed, and the process proceeds to step S2003.

The amount-of-change prediction unit 131 according to the first embodiment calculates the difference in the amount of protrusion per unit time by using the difference in the amount of protrusion of a point on the stereoscopic image that protrudes most from the display surface of the display unit 14 before and after the unit time. Predict as change. Similarly, the change amount prediction unit 131 uses, as the change amount of the retraction amount per unit time, the difference in the retraction amount of the point on the stereoscopic image most retracted from the display surface of the display unit 14 before and after the unit time. Predict.

(Step S2003) The display control unit 132 of the control unit 13 determines that at least one of the pop-out amount predicted by the change amount prediction unit 131 and the change amount of the retraction amount per unit time exceeds a threshold (YES in Step S2003). ) Proceeds to step S2004, and when both of the predicted change amounts (both the pop-out amount and the change amount per unit time of the retraction amount) are equal to or less than the threshold (NO in step S2003), the process proceeds to step S2005.

(Step S2004) The display control unit 132 controls the display content of the display unit 14 so that the stereoscopic image currently displayed on the display unit 14 transitions under the transition condition A, and the stereoscopic image data after the state transition is stored as data. It is held by the holding unit 15.

Here, the transition condition A is a condition for controlling the rotation speed of the stereoscopic image and displaying it on the display unit 14 in order to suppress a sudden change in the protruding amount and / or the retracting amount of the stereoscopic image. That is, the display control unit 132 rotates the stereoscopic image displayed on the display unit 14 at a rotation speed slower than the rotation speed indicated by the change instruction. In the following description of the first embodiment, a method of controlling the rotation speed of the stereoscopic image displayed on the display unit 14 by changing (slowing) the time required to complete the rotation will be described.

(Step S2005) The display control unit 132 controls the display content of the display unit 14 so that the stereoscopic image currently displayed on the display unit 14 transitions according to the transition condition B, and the stereoscopic image data after the state transition is stored as data. It is held by the holding unit 15.

Here, the transition condition B is a transition condition when it is predicted that there is no sudden change in the pop-out amount and / or the retraction amount of the stereoscopic image, and the rotational speed of the stereoscopic image displayed on the display unit 14 It is a condition not to change. That is, the display control unit 132 rotates the stereoscopic image displayed on the display unit 14 at the rotation speed indicated by the change instruction.

(Step S2006) The display unit 14 displays a stereoscopic image using the left-eye image and the right-eye image based on the control of the rotation speed of the stereoscopic image of the display control unit 132 in step S2004 or step S2005. To do.

Here, the display control unit 132 reads the state of the stereoscopic image before the transition stored in the data holding unit 15 when the display state is changed in Steps S2004 and S2005, and Steps S2004 and The data holding unit 15 again holds the state of the stereoscopic image after the transition made under the condition of step S2005.

(Example of stereoscopic image display control of stereoscopic image display control apparatus 10 according to Embodiment 1)
An example in which the stereoscopic image display control apparatus 10 according to Embodiment 1 controls a stereoscopic image displayed on the display unit 14 based on a change instruction will be described with reference to FIGS. 3 and 4.

In FIG. 3, the rectangular parallelepiped is stereoscopically displayed on the stereoscopic image display control device 10, and the rectangular parallelepiped displayed on the display unit 14 in response to a single operation of the user (for example, tapping the display surface of the display unit 14). Is assumed to rotate by 45 degrees. That is, the change instruction received by the input receiving unit 12 in this example is an instruction indicating that the rectangular parallelepiped is rotated by 45 degrees for a predetermined time (for example, time T41 in FIG. 4). Here, “45 degrees” corresponds to a change amount of the stereoscopic image. The “time T41” corresponds to a change time required to change the stereoscopic image by a predetermined change amount (45 degrees).

First, in the initial state ST300 in FIG. 3, the protrusion amount of the most protruding point of the rectangular parallelepiped that is a stereoscopic image displayed on the display unit 14 is “0”, and the retracting amount of the most retracting point is “ A state of “0” is shown. Next, when the user performs one operation, the rectangular parallelepiped displayed on the display unit 14 changes from the initial state ST300 to the state ST301 rotated by 45 degrees. In the state ST301, the amount of protrusion at the most protruding point is about “0.7H”, and the amount of protrusion at the most retracted point is about “−0.7H”.

Next, when the user performs one more operation, the rectangular parallelepiped displayed on the display unit 14 changes from the state ST301 to the state ST302 rotated by 45 degrees. In the state ST302, the amount of protrusion at the most protruding point is “H”, and the amount of retracting at the most retracted point is “−H”. Here, “H” is ½ of the length of the longest side of the rectangular parallelepiped. The rectangular parallelepiped rotates about a straight line that passes through the center of gravity and is parallel to the short side of the display unit 14 (display surface).

Next, a specific method for controlling the rotation speed of the stereoscopic image in each of the transitions from the initial state ST300 to the state ST301 and from the state ST301 to the state ST302 illustrated in FIG. 3 will be described using FIG. To do.

The vertical axis in FIG. 4 indicates the pop-out amount and retraction amount of the stereoscopic image, and the horizontal axis indicates time.

First, the initial state ST300 in FIG. 3 corresponds to the state St41 in FIG. 4 (the amount of protrusion at the most protruding point is “0” and the amount of retracting at the most retracted point is “0”). The amount of change predicting unit 131 is a pop-up amount per unit time when the cuboid rotates 45 degrees (ie, changes to the state ST301 in FIG. 3) due to the user's operation from this state St41, and Predict the amount of change in retraction.

That is, the change amount predicting unit 131 changes the difference between the amount of protrusion at the most protruding point in the state St42 and the amount of protrusion at the most protruding point in the state St41, from the state St41 to the state St42. By dividing by the time required, the amount of change in the pop-out amount per unit time (the slope of the broken line in FIG. 4) is calculated.

Similarly, the change amount predicting unit 131 changes the difference between the retracted amount of the most retracted point in the state St42 and the retracted amount of the most retracted point in the state St41 from the state St41 to the state St42. The amount of change in the amount of retraction per unit time (the slope of the broken line in FIG. 4) is calculated by dividing by the time required for.

As a result, the change amount of the pop-out amount per unit time is about “0.7H”, and the change amount of the retraction amount is about “−0.7H” (time T41 is calculated as a unit time). Since these change amounts both exceed a threshold value (in the example, the threshold value is set to 0.25H), the display control unit 132 decreases the rotation speed of the rectangular parallelepiped.

When considering the amount of retraction with a sign, “the amount of change in the amount of retraction exceeds the threshold” means that the absolute value of the amount of change in the retraction (0.7H in the above example) is the threshold (0.25H). It may be considered that the amount of change is larger or the amount of change in the amount of retraction (−0.7H in the above example) is lower than the threshold value of the amount of retraction (−0.25H).

The transition from the state St41 to the state St42 shown in FIG. 4 is a predicted value, and shows a case where the rectangular parallelepiped rotates 45 degrees at time T41, but if this is the case, the amount of protrusion and the amount of retraction per unit time will change. Too big. Therefore, based on this predicted value, the rotation speed of the rectangular parallelepiped is changed (slow) so that the rectangular parallelepiped rotates 45 degrees at time T42 (longer than time T41) from state St41 to state St43.

In other words, when the rotational speed is not controlled, the rectangular parallelepiped rotates 45 degrees at time T41, so that the amount of protrusion and the amount of retraction suddenly change. However, since the rectangular parallelepiped rotates 45 degrees during the time T42 (> T41) by controlling the rotation speed, it is possible to suppress sudden changes in the pop-out amount and the retraction amount. The state St43 after the transition corresponds to the state ST301 in FIG.

Next, from the state St43 to the state St44 in FIG. 4, there is a time zone in which there is no user operation and the display state of the rectangular parallelepiped does not change. Next, the amount of protrusion and the amount of change per unit time when the rectangular parallelepiped is rotated 45 degrees due to the operation by the user in the state St44 (that is, the state changes to the state ST302 of FIG. 3). Predicting the change amount of the pop-out amount per unit time is about “0.3H”, and the change amount of the retraction amount is about “−0.3H”. Since these change amounts both exceed a threshold value (in the example, the threshold value is set to 0.25H), the display control unit 132 decreases the rotation speed of the rectangular parallelepiped.

The transition from the state St44 to the state St45 shown in FIG. 4 is a predicted value, and shows a case where the rectangular parallelepiped has rotated 45 degrees at time T43, but if this is the case, the amount of protrusion and the amount of retraction per unit time will change. Too big. Therefore, based on this predicted value, the rotation speed of the rectangular parallelepiped is changed (slow) so that the rectangular parallelepiped rotates 45 degrees during time T44 (longer than time T43) from state St44 to state St46.

In other words, when the rotational speed is not controlled, the rectangular parallelepiped rotates 45 degrees at time T43, so that the amount of protrusion and the amount of retraction suddenly change. However, since the rectangular parallelepiped rotates 45 degrees during the time T44 (> T43) by controlling the rotation speed, it is possible to suppress sudden changes in the pop-out amount and the retraction amount. The state St46 after the transition corresponds to the state ST302 in FIG.

Further, in the transition from the state St41 (= ST300) to the state St43 (= ST301) and the transition from the state St44 (= ST301) to the state St46 (= ST302), the amount of pop-out and the amount of retraction per unit time Therefore, the rotation speed, that is, the rotation time for the same rotation amount (45 degrees) is controlled to be different at time T42 and time T44.

In the case of FIG. 4, the amount of popping out and the amount of popping out are larger for the time T42 required for the change from the state St41 (= ST300) to the state St43 (= ST301) where the amount of change per unit time is relatively large. The amount of change per unit time of the retraction amount is set to be longer than the time T44 required for the change from the state St44 (= ST301) to the state St46 (= ST302).

This indicates that the rotational speed is adjusted according to the amount of change per unit time of the pop-out amount and the retraction amount. In other words, if attention is paid to the amount of change in the pop-out amount and the retraction amount, the state St41 to the state St43 and the state St44 to the state St46 rotate at the same speed (that is, the inclination of the solid line in FIG. 4 is the same). Will be. On the other hand, focusing on the rotation amount (rotation angle), the state St41 to the state St43 are rotating more slowly (that is, taking a longer time) from the state St44 to the state St46.

5 and 6, a case will be described in which the rectangular parallelepiped in the state ST302 in FIG. 3 is further rotated by further operating the rectangular parallelepiped.

The state ST500 in FIG. 5 corresponds to the state ST302 in FIG. In FIG. 5, as in the case of FIG. 3, it is assumed that the rectangular parallelepiped rotates 45 degrees for each user operation.

First, in the state ST500, the protrusion amount of the most protruding point of the rectangular parallelepiped displayed on the display unit 14 is “H”, and the retracting amount of the most retracted point is “−H”. Next, when the user performs one operation, the rectangular parallelepiped displayed on the display unit 14 changes from the state ST500 to the state ST501 rotated by 45 degrees. In the state ST501, the amount of protrusion at the most protruding point is about “0.7H”, and the amount of retracting at the most retracted point is about “−0.7H”.

Next, when the user performs one more operation, the rectangular parallelepiped displayed on the display unit 14 changes from the state ST501 to a state ST502 rotated by 45 degrees. In the state ST502, the protruding amount of the most protruding point is “0”, and the retracting amount of the most retracted point is “0”.

Next, a specific method for controlling the rotation speed of the stereoscopic image in each of the transition from the state ST500 to the state ST501 and the state ST501 to the state ST502 shown in FIG. 5 will be described with reference to FIG. .

The vertical axis in FIG. 6 indicates the pop-out amount and retraction amount of the stereoscopic image, and the horizontal axis indicates time.

First, state ST500 in FIG. 5 corresponds to state St61 in FIG. 6 (the amount of protrusion at the most protruding point is “H” and the amount of retracting at the most retracted point is “−H”). When the rectangular parallelepiped is rotated 45 degrees as a result of the user's operation from this state ST500 (that is, when the state changes to state ST501 in FIG. 5), the amount of protrusion per unit time and the amount of change in the amount of retraction are predicted. The change amount of the pop-out amount per unit time is about “0.3H”, and the change amount of the retraction amount is about “−0.3H”. Since these change amounts both exceed a threshold value (in the example, the threshold value is set to 0.25H), the display control unit 132 decreases the rotation speed of the rectangular parallelepiped.

The transition from the state St61 to the state St62 shown in FIG. 6 is a predicted value, and shows a case where the rectangular parallelepiped has rotated 45 degrees at time T61, but if this is the case, the amount of protrusion and the amount of retraction per unit time will change. Too big. Therefore, based on the predicted value, the rotation speed of the rectangular parallelepiped is changed (slow) so that the rectangular parallelepiped rotates 45 degrees during the time T62 (longer than the time T61) from the state St61 to the state St63.

In other words, when the rotational speed is not controlled, the rectangular parallelepiped rotates 45 degrees at time T61, so that the pop-out amount and the retraction amount change suddenly. However, by adding control of the rotational speed, the rectangular parallelepiped rotates 45 degrees during time T62 (> T61), so that sudden changes in the pop-out amount and the retraction amount can be suppressed. The state St63 after this transition corresponds to the state ST501 in FIG.

Next, the state St63 to the state St64 in FIG. 6 shows a time zone in which there is no operation and the state of the rectangular parallelepiped is not changing. Next, the amount of protrusion and the amount of change per unit time when the rectangular parallelepiped rotates 45 degrees due to the user's operation in state St64 (that is, the state changes to state ST502 in FIG. 5). Predicting the change amount of the pop-out amount per unit time is about “0.7H”, and the change amount of the retraction amount is about “−0.7H”. Since these change amounts both exceed a threshold value (in the example, the threshold value is set to 0.25H), the display control unit 132 decreases the rotation speed of the rectangular parallelepiped.

The transition from the state St64 to the state St65 shown in FIG. 6 is a predicted value, and shows a case where the rectangular parallelepiped has rotated 45 degrees at time T63, but if this is the case, the amount of protrusion and the amount of retraction per unit time will change. Too big. Therefore, based on the predicted value, the rotation speed of the rectangular parallelepiped is changed (slow) so that the rectangular parallelepiped rotates 45 degrees during the time T64 (longer than the time T63) from the state St64 to the state St66.

In other words, when the rotational speed is not controlled, the rectangular parallelepiped rotates 45 degrees at time T63, so that the amount of protrusion and the amount of retraction suddenly change. However, by controlling the rotation speed, the stereoscopic image rotates 45 degrees during time T64 (> T63), so that sudden changes in the pop-out amount and the retraction amount can be suppressed. The state St66 after the transition corresponds to the state ST502 in FIG.

Further, in the transition from the state St61 (= ST500) to the state St63 (= ST501) and the transition from the state St64 (= ST501) to the state St66 (= ST502), the amount of protrusion and the amount of retraction per unit time Therefore, the rotation speed, that is, the rotation time with respect to the same rotation amount of 45 degrees is controlled to be different at time T62 and time T64. This indicates that the rotational speed is adjusted according to the amount of change per unit time of the pop-out amount and the retraction amount.

The examples described with reference to FIGS. 3 to 6 are all shown in the case where the state transition is performed under the transition condition A in step S2004 in FIG.

Another example when the stereoscopic image display control apparatus 10 according to Embodiment 1 controls the stereoscopic image displayed on the display unit 14 based on a change instruction from the user will be described with reference to FIGS. 7 and 8. To do.

In FIG. 7, it is assumed that a spherical object is stereoscopically displayed on the stereoscopic image display control device 10 and the sphere rotates 45 degrees around its center of gravity for one operation of the user. First, the initial state ST700 is a state in which the pop-out amount of the most popped point of the sphere displayed on the display unit 14 is “H” and the pull-in amount of the most retracted point is “−H”. Show.

Next, when the user performs one operation, the sphere displayed on the display unit 14 changes from the initial state ST700 to a state ST701 rotated by 45 degrees. The amount of protrusion at the most protruding point in state ST701 is “H”, and the amount of retracting at the most retracted point is “−H”, which is the same as in the initial state ST700.

Next, when the user performs one more operation, the sphere displayed on the display unit 14 changes from the state ST701 to the state ST702 rotated by 45 degrees. The amount of protrusion at the most protruding point in state ST702 is “H”, and the amount of retracting at the most retracted point is “−H”, which is the same as in state ST701.

Next, a specific method for controlling the rotation speed of the stereoscopic image in each of the transitions from the initial state ST700 to the state ST701 and from the state ST701 to the state ST702 shown in FIG. 7 will be described using FIG. To do.

The vertical axis in FIG. 8 indicates the pop-out amount and retraction amount of the stereoscopic image, and the horizontal axis indicates time.

First, the initial state ST700 in FIG. 7 corresponds to the state St81 in FIG. 8 (the amount of protrusion at the most protruding point is “H” and the amount of retracting at the most retracted point is “−H”). Prediction of the amount of popping out and the amount of retraction per unit time when the sphere rotates 45 degrees as a result of the user's operation from this state St81 (that is, the state changes to state ST701 in FIG. 7) Then, the change amount of the pop-out amount per unit time is “0”, and the change amount of the retraction amount is “0”.

That is, since there is no change in the pop-out amount and the retraction amount, and neither exceeds the threshold value (in this example, the threshold value is 0.25H), the display control unit 132 does not change the rotation speed of the sphere. That is, the display control unit 132 rotates the sphere displayed on the display unit 14 in accordance with the change instruction received by the input receiving unit 12.

The transition from the state St81 to the state St83 shown in FIG. 8 is a predicted value, and shows a case where the sphere rotates 45 degrees at time T81. However, the change in the amount of protrusion and the amount of retraction per unit time is small. There is no change in the example). Therefore, the display control unit 132 causes the display unit 14 to display without changing the rotation speed of the sphere so as to change from the state St81 to the state St83 based on the predicted value. This means that the operation by the user is reflected on the display as it is without changing the rotation speed of the sphere when there is no sudden change in the pop-out amount and the retraction amount. The state St83 after the transition corresponds to the state ST701 in FIG.

From state St83 to state St84, there is no user operation and the time zone in which the display state of the sphere has not changed is shown. Next, the pop-out amount and the amount of change per unit time when the sphere is rotated 45 degrees due to an operation performed by the user in the state St84 (that is, the state changes to the state ST702 in FIG. 7). As predicted, the amount of change in the pop-out amount per unit time is “0”, and the amount of change in the retraction amount is “0”, both of which do not exceed the threshold value (in the example, the threshold value is 0.25H). The display control unit 132 displays on the display unit 14 without changing the rotation speed of the sphere.

The transition from the state St84 to the state St86 shown in FIG. 8 is a predicted value, and shows a case where the sphere has rotated 45 degrees at time T83, but the change in the amount of protrusion and the amount of retraction per unit time is small. There is no change in the example). Therefore, the display control unit 132 causes the display unit 14 to display without changing the rotation speed of the sphere so as to transit from the state St84 to the state St86 based on the predicted value. The state St86 after this transition corresponds to the state ST702 in FIG.

In the example shown in FIG. 7 and FIG. 8, since there is no sudden change in the pop-out amount and the retraction amount (there is no change in this example), it is displayed without changing the rotation speed, that is, both This shows a case where the state transition is performed under the transition condition B in step S2005 of FIG.

By doing as described above, the stereoscopic image can be rotated in response to the user's operation while keeping the size and shape of the stereoscopic image itself constant. On the other hand, when rotating the stereoscopic image in accordance with the operation, if at least one of the amount of projection of the stereoscopic image and the amount of change per unit time of the retraction amount exceeds a predetermined threshold, the rotational speed of the stereoscopic image is decreased. To do. As a result, it is possible to suppress a sudden change in the amount of protrusion and the amount of retraction, so that it is possible to reduce the fatigue given to the viewer.

(Embodiment 2)
In the first embodiment, at least one of the pop-out amount of the stereoscopic image and the change amount per unit time of the retraction amount when rotating the stereoscopic image in response to the user's operation using FIGS. 2 to 8. In order to slow down the stereoscopic image rotation speed when the value exceeds a predetermined threshold, the example in which the rotation time is longer than the rotation time indicated by the change instruction and the predetermined rotation amount indicated by the change instruction is rotated has been described. .

On the other hand, in the second embodiment, when rotating a stereoscopic image in response to a user operation using FIGS. 9 to 11, per unit time of the protruding amount of the stereoscopic image and the retracting amount. An example will be described in which when at least one of the change amounts exceeds a predetermined threshold, the rotation amount is rotated by a smaller rotation amount at a predetermined time in order to slow the stereoscopic image rotation speed.

In the second embodiment of the present invention, the configuration of the stereoscopic image display control apparatus 10 shown in FIG. 1 is the same as that of the first embodiment of the present invention, and thus the description thereof is omitted here. In addition, a detailed description of points common to the first embodiment will be omitted, and the description will focus on the differences.

(Operation of stereoscopic image display control apparatus 10 according to Embodiment 2)
Hereinafter, the rotation speed is changed by changing the amount of rotation of the stereoscopic image displayed on the display unit 14 according to the change instruction information received by the input receiving unit 12 and the state of the currently displayed stereoscopic image. An example of the method of Embodiment 2 to control is demonstrated with reference to FIG. In the second embodiment, step S2004 described in FIG. 2 is replaced with step S2008 in FIG. 9, and the amount of rotation is controlled.

(Step S2002) Based on the change instruction received by the input reception unit 12 and the state of the stereoscopic image currently displayed on the display unit 14, the change amount prediction unit 131 changes the stereoscopic image according to the change instruction. The projection amount per unit time and the change amount of the retraction amount are predicted, and the process proceeds to step S2003.

(Step S2003) When at least one of the pop-out amount predicted by the change amount prediction unit 131 and the change amount per unit time of the retraction amount exceeds the threshold (YES in step S2003), the display control unit 132 performs step S2008. If both of the predicted change amounts (both the pop-out amount and the change amount per unit time of the retraction amount) do not exceed the threshold value (NO in step S2003), the process advances to step S2005.

(Step S2008) The display control unit 132 controls the display content of the display unit 14 so that the stereoscopic image currently displayed on the display unit 14 transitions according to the transition condition A ′, and also displays the stereoscopic image data after the state transition. The data is held in the data holding unit 15.

Here, the transition condition A ′ is a condition for controlling the display speed (rotation speed) of the stereoscopic image to display it on the display unit 14 in order to suppress a sudden change in the pop-out amount and the retraction amount of the stereoscopic image. is there. In the following description of the second embodiment, a method for controlling the rotation speed of the stereoscopic image by changing the rotation amount (reducing the rotation amount) that rotates at a predetermined time indicated by the change instruction will be described. To do.

Here, the transition condition B is a transition condition when it is predicted that there is no sudden change in the pop-out amount and the retraction amount of the stereoscopic image, and the rotation amount of the stereoscopic image is not changed (indicated by the change instruction). The condition is to rotate at the rotation speed).

(Step S2006) The display unit 14 displays a stereoscopic image using the left-eye image and the right-eye image based on the control of the rotation amount of the stereoscopic image of the display control unit 132 in step S2008 or step S2005. .

Here, the display control unit 132 reads the state of the stereoscopic image before the transition stored in the data holding unit 15 when the display state is changed in Steps S2008 and S2005, and Steps S2008 and The data holding unit 15 again holds the state of the stereoscopic image after the transition made under the condition of step S2005.

(Example of stereoscopic image display control of stereoscopic image display control apparatus 10 according to Embodiment 2)
An example in which the stereoscopic image display control apparatus 10 according to Embodiment 2 controls a stereoscopic image displayed on the display unit 14 based on a change instruction will be described with reference to FIGS. 10 and 11.

In FIG. 10, the rectangular parallelepiped is stereoscopically displayed on the stereoscopic image display control device 10, and the rectangular parallelepiped displayed on the display unit 14 is determined according to changes in the pop-out amount and the retraction amount with respect to one operation of the user. It is assumed that the rotation amount is the same as the rotation amount. When the change amount per unit time does not exceed the threshold value, the rotation amount is 45 degrees.

First, the initial state ST1000 shows a state in which the protruding amount of the most protruding point of the rectangular parallelepiped displayed on the display unit 14 is “0” and the retracting amount of the most retracted point is “0”. Yes. Next, the state ST1001 is a state in which the rectangular parallelepiped is rotated 45 degrees from the initial state ST1000 so as to suppress a sudden change in the pop-out amount and the retraction amount due to one operation performed by the user. is there. In the state ST1001, the protruding amount of the most protruding point is “0.7H”, and the retracting amount of the most retracted point is “−0.7H”.

Next, a specific method for controlling the amount of rotation of the stereoscopic image when transitioning from the initial state ST1000 shown in FIG. 10 to the state ST1001 will be described with reference to FIG.

The vertical axis in FIG. 11 indicates the pop-out amount and the retraction amount of the stereoscopic image, and the horizontal axis indicates time. *

First, the initial state ST1000 of FIG. 10 corresponds to the state St111 of FIG. 11 (the amount of protrusion at the most protruding point is “0” and the amount of retracting at the most retracted point is “0”). When the rectangular parallelepiped rotates 45 degrees as a result of the user's operation from this state St111 (that is, changes to the state ST1001 in FIG. 10), the amount of change per unit time of the amount of withdrawal and the amount of retraction is predicted. The change amount of the pop-out amount per unit time is about “0.7H”, and the change amount of the retraction amount is about “−0.7H”. Since these change amounts both exceed a threshold value (in the example, the threshold value is set to 0.25H), the display control unit 132 decreases the rotation speed of the rectangular parallelepiped.

The transition from the state St111 to the state St112 shown in FIG. 11 is a predicted value, and shows a case where the rectangular parallelepiped rotates 45 degrees at time T111 (corresponding to the state ST1001 in FIG. 10). The change in the amount of protrusion and the amount of retraction is too large. Therefore, the amount of rotation of the rectangular parallelepiped during the time T111 from the state St111 to the state St113 is reduced based on the predicted value. As a result, the rotation speed of the rectangular parallelepiped becomes slower than the rotation speed indicated in the change instruction.

In other words, the transition time from state St111 to state St112 and the transition time from state St111 to state St113 are both the same at time T111. However, in the transition from the state St111 to the state St112, the rectangular parallelepiped rotates 45 degrees, whereas in the transition from the state St111 to the state St113, the rectangular parallelepiped rotates only by an angle smaller than 45 degrees (for example, 30 degrees). The state St43 after this transition corresponds to the state ST1002 in FIG.

As described above, the rotational speed of the rectangular parallelepiped can also be reduced by suppressing the amount of rotation of the rectangular parallelepiped at the same time. And also by such control, the sudden change of the amount of protrusion and the amount of retraction can be suppressed. Therefore, in order for the user to rotate the stereoscopic image by a predetermined angle (45 degrees), a stereoscopic image rotation instruction may be input several times.

This indicates that the rotation speed of the rectangular parallelepiped is adjusted in accordance with the amount of change per unit time of the pop-out amount and the retraction amount, and that the state transition has occurred under the transition condition A ′ in step S2008 of FIG. It is shown. Although description is omitted in the second embodiment, if the change in the amount of protrusion and the amount of retraction per unit time does not exceed the threshold value, the rotation amount (and rotation speed) of the stereoscopic image is changed. It is displayed on the display unit 14 without corresponding (corresponding to step S2005 in FIG. 9).

By doing as described above, it is possible to rotate the stereoscopic image corresponding to the user's operation while keeping the size and shape of the stereoscopic image itself constant. On the other hand, in the case where the stereoscopic image is rotated in accordance with the operation by the user, when at least one of the projection amount of the stereoscopic image and the amount of change per unit time of the retraction amount exceeds a predetermined threshold, Reduce the amount of rotation. As a result, sudden changes in the pop-out amount and the retract amount can be suppressed. For this reason, the effect that the fatigue given to a viewer can be reduced is produced.

(Embodiment 3)
In the first and second embodiments, the stereoscopic image display control device 10 that changes the display of a stereoscopic image (3D object) in response to an operation from the user has been described. The first and second embodiments have been described on the assumption that the stereoscopic image is rotated by 45 degrees with respect to one operation from the user.

On the other hand, the third embodiment corresponds to changing the rotation amount in an analog manner according to the actual operation amount of the user. Furthermore, when rotating a stereoscopic image, if at least one of the amount of projection of the stereoscopic image and the amount of change per unit time of the withdrawal amount exceeds a predetermined threshold, the rotational speed of the stereoscopic image is reduced. A stereoscopic image display control device 20 that suppresses a sudden change in the pop-out amount and the retract amount will be described with reference to FIG.

(Configuration of stereoscopic image display control apparatus 20 according to Embodiment 3)
FIG. 12 is a block diagram for explaining an overview of the stereoscopic image display control apparatus 20 according to the third embodiment. In addition, about the part which has the structure similar to the stereo image display control apparatus 10 of Embodiment 1, the same code | symbol is attached | subjected and the description is abbreviate | omitted. In addition, detailed description of points common to Embodiments 1 and 2 will be omitted, and the description will focus on the differences.

In FIG. 12, the stereoscopic image display control device 20 in the third embodiment has a configuration in which an operation amount calculation unit 133 is provided in the control unit 13 in addition to the configuration of the stereoscopic image display control device 10 in the first embodiment. . The operation amount calculation unit 133 calculates the rotation amount from the user operation amount received by the input reception unit 12. That is, the change instruction according to the third embodiment includes the operation amount of the user. The “user operation amount” is information that indirectly specifies the rotation amount (change amount).

The specific example of the rotation amount calculation method in the operation amount calculation unit 133 is not particularly limited. For example, when accepting a touch operation on a touch panel arranged so as to be superimposed on the display unit 14 of the stereoscopic image display control device 20, the faster the operation speed on the touch panel, the larger the rotation amount, and the slower the operation speed on the touch panel. The amount of rotation may be reduced. As another example, the rotation amount may be increased as the operation distance to the touch panel is longer, and the rotation amount may be decreased as the operation distance to the touch panel is shorter. Further, when operating a button such as a mouse or a joystick, the rotation amount may be changed according to the button pressing time (for example, the longer the pressing time, the larger the rotation amount, and the shorter the pressing time). Reduce the amount of rotation). In other words, any method may be used as long as the rotation amount can be calculated from the actual operation amount of the user.

Further, not only the rotation amount but also the time (rotation time) required for rotation by the rotation amount calculated as described above, the rotation speed, and the like may be calculated from the actual operation amount of the user. For example, the rotation time may be shortened (rotation speed is increased) as the operation speed on the touch panel is increased, and the rotation time may be increased (rotation speed is decreased) as the operation speed on the touch panel is decreased.

Also, the rotation amount calculated by the operation amount calculation unit 133 is notified to the change amount prediction unit 131. The change amount prediction unit 131 predicts the change amount per unit time of the stereoscopic image pop-out amount and the retraction amount according to the rotation amount acquired from the operation amount calculation unit 133.

(Operation of stereoscopic image display control apparatus 20 according to Embodiment 3)
13 and 14 are diagrams illustrating an example of a control operation for a stereoscopic image of the stereoscopic image display control apparatus 20 according to the third embodiment. Note that portions similar to those described in FIG. 2 of the first embodiment and FIG. 9 of the second embodiment are denoted by the same reference numerals and description thereof is omitted.

FIG. 13 illustrates a stereoscopic image displayed on the display unit 14 according to the rotation amount calculated from the operation amount received by the input receiving unit 12 and the state of the stereoscopic image currently displayed on the display unit 14. It is a figure which shows an example of operation | movement of the control part 13 which controls the rotational speed of. FIG. 13 adds step S2007 to FIG. 2 of the first embodiment, and when the user's operation is detected, the rotation amount is calculated from the actual operation amount of the user in an analog manner to rotate according to the operation amount. It corresponds to the amount changing.

Hereinafter, the operation of step S2001, step S2007, and step S2002 will be described with a focus on step S2007. Note that the operations after step S2003 are the same as those in FIG.

(Step S2001) When the control unit 13 detects that a change instruction from the user is received by the input receiving unit 12 (YES in step S2001), the control unit 13 proceeds to step S2007, and when not detected (NO in step S2001). The process returns to step S2001.

(Step S2007) The operation amount calculation unit 133 calculates the rotation amount of the stereoscopic image according to the operation amount included in the change instruction received by the input reception unit 12, and the process proceeds to step S2002.

(Step S2002) Based on the rotation amount calculated by the operation amount calculation unit 133 and the state of the stereoscopic image currently displayed on the display unit 14, the change amount prediction unit 131 calculates the stereoscopic image by the calculated rotation amount. The amount of pop-out per unit time and the amount of change in the amount of retraction when rotating is predicted, and the process proceeds to step S2003.

FIG. 14 shows a method of controlling the rotation speed of a stereoscopic image according to the rotation amount calculated from the operation amount received by the input receiving unit 12 and the state of the stereoscopic image currently displayed on the display unit 14. It is a figure which shows an example. FIG. 14 adds step S2007 to FIG. 9 of the second embodiment, and when the operation by the user is detected, the rotation amount is changed according to the operation amount by calculating the rotation amount from the actual operation amount of the user. It corresponds to doing. Step S2001, step S2007, and step S2002 are the same as those in FIG. 13 described above, and the operations after step S2003 are the same as those in FIG.

By doing as described above, it is possible to calculate the rotation amount of the stereoscopic image corresponding to the actual operation amount of the user. Further, when changing the stereoscopic image in accordance with the operation, the rotation speed of the stereoscopic image is set when at least one of the protruding amount of the stereoscopic image and the amount of change per unit time of the retracting amount exceeds a predetermined threshold. Slow down. As a result, it is possible to suppress a sudden change in the amount of protrusion and the amount of retraction, so that it is possible to reduce the fatigue given to the viewer.

(Other embodiments)
In Embodiments 1 to 3, when the stereoscopic image is changed in accordance with the user's operation as the operation of the stereoscopic image display control devices 10 and 20, the amount of projection and the amount of withdrawal of the stereoscopic image per unit time are changed. A method has been described in which when at least one of the amounts exceeds a predetermined threshold, a rapid change in the pop-out amount and the retraction amount is suppressed by slowing the rotation speed of the stereoscopic image. However, the method for suppressing the rapid change in the pop-out amount and the retraction amount is not limited to the above.

For example, as shown in FIG. 15, when at least one of the projection amount of the stereoscopic image and the amount of change per unit time of the retraction amount exceeds the threshold value, the rotation operation is not performed as shown in step S2009 (rotation speed). The transition condition A ″ may be adopted. By such a method, it is only necessary to reduce the fatigue given to the viewer by suppressing the rapid change in the pop-out amount and the retraction amount of the stereoscopic image.

In the first to third embodiments, examples of a rectangular parallelepiped and a sphere in which the pop-out amount and the retraction amount change in the same way have been described. However, as shown in FIG. Even if it exists, the control method which concerns on said each embodiment is applicable. Hereinafter, in the case where a stereoscopic image with different pop-out amount and retracted amount is rotated with reference to FIGS. 16 and 17, the stereoscopic image display control apparatus 10 according to Embodiment 1 controls the rotation speed of the stereoscopic image. Another example will be described.

In FIG. 16, it is assumed that a stereoscopic image is stereoscopically displayed on the stereoscopic image display control device 10, and the stereoscopic image displayed on the display unit 14 is rotated by 45 degrees in response to a single user operation. . First, the initial state ST1600 indicates a state in which the pop-out amount of the most popped point of the stereoscopic image displayed on the display unit 14 is “H” and the pull-in amount of the most retracted point is “0”. ing.

Next, when the user performs one operation, the stereoscopic image displayed on the display unit 14 changes from the initial state ST1600 to the state ST1601 rotated by 45 degrees. In the state ST1601, the protruding amount of the most protruding point is “H”, and the retracting amount of the most retracted point is about “−0.7H”. Next, when the user performs one more operation, the stereoscopic image displayed on the display unit 14 changes from the state ST1601 to the state ST1602 rotated by 45 degrees. In the state ST1602, the protruding amount of the most protruding point is “H”, and the retracting amount of the most retracted point is “−H”.

Next, with reference to FIG. 17, a specific method for controlling the rotation speed of the stereoscopic image in each of the transitions from the initial state ST1600 to the state ST1601 and from the state ST1601 to the state ST1602 shown in FIG. To do.

The vertical axis in FIG. 17 indicates the pop-out amount and retraction amount of the stereoscopic image, and the horizontal axis indicates time. *

First, the initial state ST1600 in FIG. 16 corresponds to the state St171 in FIG. 17 (the amount of protrusion at the most protruding point is “H” and the amount of retracting at the most retracted point is “0”). When the pop-up amount when the stereoscopic image is rotated by 45 degrees due to the user's operation from this state St171 and the change amount per unit time of the retraction amount are predicted, the change amount of the pop-up amount per unit time is “0” and the amount of change in the retraction amount are about “−0.7H”.

Here, although the amount of change per unit time of the pop-out amount does not exceed a threshold (in the example, the threshold is 0.25H), the amount of change per unit time of the retracted amount is the threshold (in the example, the threshold is set to 0. 0). 25H), the display control unit 132 decreases the rotation speed of the stereoscopic image.

The transition from the state St171 to the state St172 shown in FIG. 17 is a predicted value, and shows a case where the stereoscopic image is rotated 45 degrees at time T71. However, if the state is kept as it is, the change in the amount of retraction per unit time is too large. Therefore, based on this predicted value, the rotation speed of the stereoscopic image is changed (slowed) so that the stereoscopic image rotates 45 degrees at time T172 (longer than time T171) from state St171 to state St173.

In other words, when the rotational speed is not controlled, the stereoscopic image rotates 45 degrees at time T171, so that the amount of retraction suddenly changes. However, by controlling the rotation speed, the stereoscopic image rotates 45 degrees during time T172 (> T171), so that a rapid change in the amount of retraction can be suppressed. The state St173 after this transition corresponds to the state ST1601 in FIG.

Next, from the state St173 to the state St174 in FIG. 17, there is a time zone in which there is no user operation and the display state does not change. Next, when the pop-out amount and the retraction amount when the stereoscopic image rotates 45 degrees due to the operation performed by the user in the state St174, the change amount of the pop-out amount per unit time is “0”, and The amount of change in the retraction amount is about “−0.3H”. That is, although the amount of change per unit time of the pop-out amount does not exceed the threshold (in the example, the threshold is 0.25H), the amount of change in the amount of withdrawal per unit time is the threshold (in the example, the threshold is 0.25H). Therefore, the display control unit 132 decreases the rotation speed of the stereoscopic image.

The transition from the state St174 to the state St175 shown in FIG. 17 is a predicted value, and shows a case where the stereoscopic image is rotated by 45 degrees at time T173. However, the change in the amount of retraction per unit time is too large as it is. Therefore, based on this predicted value, the rotational speed of the stereoscopic image is changed (slowed) so that the stereoscopic image rotates 45 degrees during time T174 (longer than time T173) from state St174 to state St176.

In other words, when the rotational speed is not controlled, the stereoscopic image rotates 45 degrees at time T173, and the amount of retraction suddenly changes. However, by controlling the rotation speed, the stereoscopic image rotates 45 degrees during time T174 (> T173), so that a rapid change in the amount of retraction can be suppressed. The state St176 after this transition corresponds to the state ST1602 in FIG.

As described above, even when changing the stereoscopic image in which the amount of change per unit time of the pop-out amount and the retract amount is different, at least one of the change amount per unit time of the pop-out amount and the retract amount exceeds the threshold value Adjust the rotation speed to. Thereby, the rotational speed can be adjusted even in a stereoscopic image in which the pop-out amount per unit time and the retraction amount are different.

Note that the examples described with reference to FIGS. 16 and 17 both show the case where the state transition is performed under the transition condition A in step S2004 of FIG. As described above, the control method of the first embodiment can be applied even when the amount of change per unit time of the pop-out amount and the retraction amount is different, and the methods described in the second and third embodiments are also applicable. The same applies.

In each of the first to third embodiments described above, in the case as shown in FIG. 7, the display control unit 132 determines that the amount of change per unit time of the pop-out amount and the retract amount does not exceed the threshold value. To do. In the example of FIG. 7, the most popped point (the most retracted point) of the stereoscopic image before the unit time and the most popped point (the most retracted point) of the stereoscopic image after the unit time are the pop-out amount ( (Retraction amount) is the same.

That is, the change amount predicting unit 131 according to each of the above first to third embodiments pays attention to the difference between the protrusion amounts of the most protruding points (retraction amounts of the most retracted points) before and after the unit time. The amount of change in the amount of protrusion (retraction amount) per unit time is predicted.

However, as shown in FIG. 18, when a sphere having a pattern on its surface (in the example of FIG. 18, a Japanese archipelago pattern) is rotated, the user may continue to follow the pattern with his eyes. There is.

In such a case, the change amount predicting unit 131 may predict the difference in the pop-out amount before and after the unit time of a specific point of the stereoscopic image as the change amount of the pop-out amount per unit time. Similarly, the change amount predicting unit 131 may predict a difference in the amount of retraction before and after a unit time of a specific point of the stereoscopic image as a change amount of the retraction amount per unit time.

First, an initial state ST1800 in FIG. 18 shows a state in which the pop-out amount of the Japanese archipelago (an example of a specific point) on the surface of the sphere displayed on the display unit 14 is “0.2H”. Next, when the user performs one operation, the sphere displayed on display unit 14 rotates (rotates so that the Japanese archipelago moves in the zenith direction) and changes to state ST1801. The amount of popping out of the Japanese archipelago in state ST1801 is “H”.

At this time, the change amount predicting unit 131 determines that the difference between the pop-out amount “0.2H” of the Japanese archipelago before the rotation and the pop-out amount “H” of the Japanese archipelago after the rotation is “0.8H”, and the ball is in the state ST1800 By dividing by the time required to change from state to state ST1801, the amount of change in the pop-out amount per unit time can be predicted. Then, the display control unit 132 decreases the rotation speed of the sphere when the pop-out amount calculated by the change amount prediction unit 131 exceeds the threshold value.

Next, when the user performs one more operation, the sphere displayed on the display unit 14 rotates (rotates so that the Japanese archipelago approaches the equator on the back side) and changes to the state ST1802. The amount of popping out of the Japanese archipelago in state ST1802 is “0.2H”.

At this time, the change amount predicting unit 131 indicates that the sphere has a difference of “−0.8H” between the popping amount “H” of the Japanese archipelago before the rotation and the popping amount “0.2H” of the Japanese archipelago after the rotation. By dividing by the time required to change from ST1801 to state ST1802, it is predicted as the amount of change in the pop-out amount per unit time. Then, the display control unit 132 decreases the rotation speed of the sphere when the pop-out amount calculated by the change amount prediction unit 131 exceeds the threshold value.

The above processing can be applied not only when predicting the amount of change in the amount of protrusion per unit time but also the amount of change in the amount of withdrawal per unit time. That is, when the sphere shown in FIG. 18 is rotated in the opposite direction to the above example, the amount of change in the amount of retraction per unit time may be predicted by the above processing.

Further, the above processing need not be applied to all patterns (textures) attached to the stereoscopic image. For example, the above-described processing may be selectively applied to a pattern located at the most protruding point or the most retracted point on the stereoscopic image before or after the rotation.

Furthermore, the points on the stereoscopic image to which the above processing is applied are not limited to the patterns attached to the stereoscopic image. For example, a finger (not limited to the finger but may be an indicator such as a hand or an indicator stick held in the hand) is superimposed on the stereoscopic image displayed on the display unit 14, and the finger is moved. Thus, when the stereoscopic image is rotated (changed) by the amount moved in the direction in which the finger is moved, the above processing may be applied to the point where the finger of the stereoscopic image is superimposed.

Further, in each of the first to third embodiments, the stereoscopic image display changing method has been described by taking an example of rotating a stereoscopic image. However, the change of the stereoscopic image in response to an operation is not limited to rotation, and movement , Enlargement, reduction, etc.

In each of the first to third embodiments described above, as an example of the method of changing the display of a stereoscopic image, the stereoscopic image is rotated around its center of gravity. However, the rotational center of the stereoscopic image with respect to the operation is the rotation center of the stereoscopic image. This control is not limited to the center of gravity, and can be applied even when a stereoscopic image is rotated around an arbitrary position.

Although the present invention has been described based on the above embodiment, it is needless to say that the present invention is not limited to the above embodiment. The following cases are also included in the present invention.

(1) Specifically, each of the above devices can be realized by a computer system including a microprocessor, a ROM, a RAM, a hard disk unit, a display unit, a keyboard, a mouse, and the like. A computer program is stored in the RAM or the hard disk unit. Each device achieves its functions by the microprocessor operating according to the computer program. Here, the computer program is configured by combining a plurality of instruction codes indicating instructions for the computer in order to achieve a predetermined function.

(2) A part or all of the components constituting each of the above devices may be configured by one system LSI (Large Scale Integration). The system LSI is an ultra-multifunctional LSI manufactured by integrating a plurality of components on a single chip, and specifically, a computer system including a microprocessor, ROM, RAM, and the like. . A computer program is stored in the ROM. The system LSI achieves its functions by the microprocessor loading a computer program from the ROM to the RAM and performing operations such as operations in accordance with the loaded computer program.

(3) Part or all of the constituent elements constituting each of the above devices may be configured from an IC card or a single module that can be attached to and detached from each device. The IC card or module is a computer system that includes a microprocessor, ROM, RAM, and the like. The IC card or the module may include the super multifunctional LSI described above. The IC card or the module achieves its functions by the microprocessor operating according to the computer program. This IC card or this module may have tamper resistance.

(4) The present invention may be realized by the method described above. Further, these methods may be realized by a computer program realized by a computer, or may be realized by a digital signal consisting of a computer program.

The present invention also relates to a computer-readable recording medium that can read a computer program or a digital signal, such as a flexible disk, hard disk, CD-ROM, MO, DVD, DVD-ROM, DVD-RAM, BD (Blu-ray Disc), You may implement | achieve with what was recorded on the semiconductor memory etc. Moreover, you may implement | achieve with the digital signal currently recorded on these recording media.

In the present invention, a computer program or a digital signal may be transmitted via an electric communication line, a wireless or wired communication line, a network represented by the Internet, a data broadcast, or the like.

The present invention is also a computer system including a microprocessor and a memory. The memory stores a computer program, and the microprocessor may operate according to the computer program.

Also, the program or digital signal may be recorded on a recording medium and transferred, or the program or digital signal may be transferred via a network or the like, and may be implemented by another independent computer system.

(5) You may combine the said embodiment and said modification, respectively.

As mentioned above, although embodiment of this invention was described with reference to drawings, this invention is not limited to the thing of embodiment shown in figure. Various modifications and variations can be made to the illustrated embodiment within the same range or equivalent range as the present invention.

According to the present invention, it is possible to reduce the fatigue given to the viewer in a form that can automatically control the rotation speed and rotation amount of the stereoscopic image with respect to the operation, and suddenly change the projection amount and the retraction amount of the stereoscopic image. The stereoscopic image display control device and the stereoscopic image display control method capable of suppressing the image are mainly used for AV equipment such as a mobile terminal such as a TV, a mobile terminal, and a tablet terminal. The image display control device and the stereoscopic image display control method can be applied to any device that can display a stereoscopic image, and can also be applied to a display that can display a general stereoscopic image.

DESCRIPTION OF SYMBOLS 10,20 Stereoscopic image display control apparatus 11 Image data acquisition part 12 Input reception part 13 Control part 14 Display part 15 Data holding part 131 Change amount estimation part 132 Display control part 133 Operation amount calculation part

Claims

A stereoscopic image display control device for displaying a stereoscopic image on a display device,
An output unit for outputting a stereoscopic image to the display device;
An input receiving unit that receives, from a user, an input of a change instruction that changes a stereoscopic image displayed on the display device;
A change amount predicting unit for predicting a change amount of the pop-out amount and the retraction amount per unit time of the stereoscopic image when the stereoscopic image is changed according to the change instruction received by the input receiving unit;
A display control unit that changes a stereoscopic image output from the output unit according to the change instruction received by the input receiving unit;
The display control unit is configured to output a unit time of a stereoscopic image output from the output unit when a change amount of the pop-out amount or the retraction amount per unit time predicted by the change amount prediction unit exceeds a predetermined threshold value. A stereoscopic image display control device that slows the change rate of a stereoscopic image so that the amount of change in the amount of popping out or retracting is equal to or less than the threshold value.
The change amount prediction unit
Predicting the difference in the amount of protrusion of a point on the stereoscopic image that protrudes most from the display surface of the display device before and after the unit time as the amount of change in the amount of protrusion per unit time,
The stereoscopic image according to claim 1, wherein a difference in the amount of retraction of a point on the stereoscopic image most retracted from the display surface of the display device is predicted as a change amount of the retraction amount per unit time before and after the unit time. Display control device.
The change amount prediction unit
Predict the difference in the amount of pop-up before and after the unit time of a specific point in the stereoscopic image as the amount of change in the amount of pop-out per unit time,
The stereoscopic image display control apparatus according to claim 1, wherein a difference in the amount of retraction before and after a unit time of a specific point of the stereoscopic image is predicted as a change amount of the amount of retraction per unit time.
The change instruction includes information for specifying a change amount of the stereoscopic image and a change time required to change the stereoscopic image by the change amount,
When the change amount of the pop-out amount or the retraction amount per unit time predicted by the change amount prediction unit exceeds the threshold value, the display control unit takes a longer time than the change time to generate the stereoscopic image by the change amount. The stereoscopic image display control apparatus according to any one of claims 1 to 3, wherein:
The change instruction includes information for specifying a change amount of the stereoscopic image and a change time required to change the stereoscopic image by the change amount,
The display control unit, when the change amount of the pop-out amount or the retraction amount per unit time predicted by the change amount prediction unit exceeds the threshold, the stereoscopic image by an amount smaller than the change amount during the change time. The stereoscopic image display control apparatus according to any one of claims 1 to 3, wherein:
The display control unit does not change a stereoscopic image according to the change instruction when a change amount of a pop-out amount or a retraction amount per unit time predicted by the change amount prediction unit exceeds the threshold value. 4. The stereoscopic image display control device according to any one of 1 to 3.
The stereoscopic image display control apparatus according to any one of claims 1 to 6, wherein the stereoscopic image change instruction received by the input reception unit includes movement, rotation, enlargement, or reduction of the stereoscopic image.
The stereoscopic image display control apparatus according to any one of claims 1 to 7, wherein the input receiving unit receives the change instruction of a predetermined change amount by a predetermined input operation by a user.
The stereoscopic image display control apparatus according to any one of claims 1 to 7, wherein the input receiving unit receives the change instruction of a change amount according to a magnitude of an input operation by a user.
The stereoscopic image display control device according to any one of claims 1 to 9, wherein the stereoscopic image display control device further includes the display device.
A stereoscopic image display control method for displaying a stereoscopic image on a display device,
An output step of outputting a stereoscopic image to the display device;
An input receiving step of receiving from the user an input of a change instruction for changing the stereoscopic image displayed on the display device;
A change amount prediction step for predicting a change amount of the pop-out amount and the retraction amount per unit time of the stereoscopic image when the stereoscopic image is changed according to the change instruction received in the input receiving step;
A display control step of changing the stereoscopic image output in the output step according to the change instruction received in the input reception step,
In the display control step, the unit time of the stereoscopic image output in the output step when the amount of change of the pop-out amount or the retraction amount per unit time predicted in the change amount prediction step exceeds a predetermined threshold value A stereoscopic image display control method that slows the change rate of a stereoscopic image so that the amount of change in the amount of popping out or retracting is equal to or less than the threshold value.
A program for causing a computer to display a stereoscopic image on a display device,
An output step of outputting a stereoscopic image to the display device;
An input receiving step of receiving from the user an input of a change instruction for changing the stereoscopic image displayed on the display device;
A change amount prediction step for predicting a change amount of the pop-out amount and the retraction amount per unit time of the stereoscopic image when the stereoscopic image is changed according to the change instruction received in the input receiving step;
In accordance with the change instruction received in the input receiving step, causing the computer to execute a display control step of changing the stereoscopic image output in the output step,
In the display control step, the unit time of the stereoscopic image output in the output step when the amount of change of the pop-out amount or the retraction amount per unit time predicted in the change amount prediction step exceeds a predetermined threshold value A program that slows the change rate of a stereoscopic image so that the amount of change in the amount of popping out or the amount of retraction becomes equal to or less than the threshold.