JP2012147132A - Video generating apparatus and video generating method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide technology for easily realizing display with stereoscopic effect by using a regular image which is not for stereoscopic display without the need of special hardware.SOLUTION: A subframe generating section generates respective display subframes of an output video signal so that one video is formed by N-pieces (N is integer larger than 1) of continuous display subframes. The subframe generating section decides light emission intensity at every region in N-pieces of display subframes so that the light emission intensity of a background region in the video does not relatively change among N-pieces of display subframes and the light emission intensity of a region of a target which rises to the surface much more than a background relatively changes among N-pieces of display subframes.

Description

  The present invention relates to a technique for performing display with a stereoscopic effect.

  In recent years, as a display device that performs display with a stereoscopic effect, a stereoscopic display device using binocular parallax (difference in convergence angle) has been commercialized. That is, a display device is prepared in which images for the left eye and right eye are prepared so that the image for the left eye is visible only to the left eye of the observer, and the image for the right eye is visible only to the right eye of the observer.

For example, the left and right images are displayed alternately in a stripe pattern, and the left image is incident only on the left eye of the observer and the right image is incident only on the right eye by a striped lenticular lens or slit arranged in front of the display panel. This is realized by a liquid crystal display (LCD) or the like.
In addition, by providing striped polarizing plates corresponding to the left and right images in front of the display panel, the left and right images are displayed with different polarizations, and only the images corresponding to the left and right eyes of the observer can be seen through the polarizing glasses. The method of doing so is also realized.
In the projector display device, a method is also realized in which the display frame frequency is doubled and the left and right frames are alternately displayed with different polarizations, and only the images corresponding to the left and right eyes can be seen through the polarizing glasses. ing.
In liquid crystal display devices (LCD) and plasma display devices (PDP), methods using liquid crystal shutter glasses have already been commercialized. In this method, left and right frames are alternately displayed, and in synchronization with this, transmission / shading of the left and right liquid crystal shutters of the shutter glasses is switched so that only images corresponding to the left and right eyes can be seen.

Patent Document 1 proposes a stereoscopic display method that uses motion parallax in addition to binocular parallax. This method detects movement of the observer's viewpoint, displays the same viewpoint image with both motion parallax only when the observer's viewpoint movement speed is high, and binocular parallax image when the viewpoint movement speed is low Is displayed. In Patent Document 1, an image to be displayed is a virtual space image formed by using a technique such as CG (Computer Graphics), and a display method for displaying to an observer with a head mounted display (HMD) or the like is disclosed. .

  The conventional stereoscopic display method described above requires special hardware such as providing a lenticular lens or a slit in the display device, or allowing an observer to wear polarized glasses, shutter glasses, or an HMD. There is also a problem that stereoscopic display cannot be performed unless the image is a special image in which binocular parallax or motion parallax is set. That is, the conventional stereoscopic display method cannot realize a stereoscopic display with a low cost and simple configuration.

JP 11-338457 A

  The present invention has been made in view of the above circumstances, and an object of the present invention is to realize a display with a stereoscopic effect easily using a normal image that is not for stereoscopic display without requiring special hardware. It is to provide technology that can be used.

  A first aspect of the present invention is a video generation device that generates an output video signal for performing stereoscopic video display, a subframe generation unit that generates a display subframe constituting the output video signal, An output unit that sequentially outputs display subframes to a display device at a display frame frequency, wherein the subframe generation unit includes one video image by N (N is an integer greater than 1) consecutive display subframes. Each of the display subframes is generated so that the light emission intensity of the background region in the video does not change relatively between the N display subframes, and compared to the background. Provided is an image generation device that determines the light emission intensity for each region in N display subframes so that the light emission intensity of a region of an object to be raised changes relatively between N display subframes. That.

  According to a second aspect of the present invention, there is provided a video generation method for generating an output video signal for performing stereoscopic video display, a subframe generation step for generating a display subframe constituting the output video signal, An output step of sequentially outputting display subframes to a display device at a display frame frequency, and in the subframe generation step, one video is generated by N consecutive display subframes (N is an integer greater than 1). Each display sub-frame is generated so that the emission intensity of the background region in the video does not change relatively between the N display sub-frames, and the object is raised compared to the background. Image generation in which the light emission intensity for each area in the N display subframes is determined such that the light emission intensity in each of the areas changes relatively between the N display subframes. The law provides.

  According to the present invention, it is possible to easily realize a stereoscopic display using a normal image that is not for stereoscopic display without requiring special hardware.

1 is a block diagram showing a first embodiment of the present invention. The block diagram which shows the modification of the 1st Embodiment of this invention. The block diagram which shows the 2nd Embodiment of this invention. The block diagram which shows the 4th Embodiment of this invention. The block diagram which shows the 6th Embodiment of this invention. The timing diagram of the 1st Embodiment of this invention. The figure which shows the example of the corresponding | compatible table of the distance of a target object, and a 1st coefficient. The figure explaining the follow-up vision in case a target object moves. The figure explaining follow-up vision when an observer moves. The figure which shows typically the generation | occurrence | production principle of the motion parallax by a sub-frame display. The figure which shows the image | video used for the observation experiment of the motion parallax by a sub-frame display. The figure which shows typically the example of the image in 1st Embodiment, and the 1st coefficient k1. The figure which shows the example of the image in 2nd Embodiment, and the 1st coefficient k1 typically. The figure which shows the example of the image in 3rd Embodiment, and the 1st coefficient k1 typically.

  The present invention relates to a video generation apparatus and a video generation method for generating an output video signal for simply displaying a stereoscopic image. The present invention can be applied to a video processing circuit mounted on an image display device such as a TV device, a computer monitor, or a digital photo frame. The present invention can also be applied to video processing circuits mounted on various video devices (for example, personal computers, digital cameras, video cameras, video recorders, etc.) that output video signals to an image display device. . The present invention can also be applied to display-integrated electronic devices such as notebook computers, mobile phones, smartphones, and tablet terminals.

(Motion parallax)
First, motion parallax will be described. Motion parallax means that, for example, when a moving object is observed, a stereoscopic effect is generated by changing the positional relationship between the object and another object (background). Similarly, even if the observer's viewpoint moves, the positional relationship between the object and another object (background) changes, so that the observer recognizes a three-dimensional effect.

  The case where the target object is moving will be described. FIG. 8A is a diagram schematically showing a follow-up view when the object moves. In FIG. 8A, reference numeral 100 denotes the observer's eyes, and 101a, 101b, 101c, 101d, and 101e denote objects at times Tn-2, Tn-1, Tn, Tn + 1, and Tn + 2. That is, the object is moving. Reference numerals 102a, 102b, 102c, 102d, and 102e denote other objects as backgrounds. In the following description of the present invention, it will be simply referred to as background. Reference numerals 110a, 110b, 110c, 110d, and 110e are dotted lines that schematically show the lines of sight of the moving objects 101a, 101b, 101c, 101d, and 101e, respectively.

  FIG. 8B schematically shows an image of the moving object formed on the retina. In FIG. 8B, reference numerals 101a, 101b, 101c, 101d, and 101e denote objects at times Tn-2, Tn-1, Tn, Tn + 1, and Tn + 2, respectively. In Tn-2, Tn-1, Tn, Tn + 1, and Tn + 2, the object is located at the center on the retina. Reference numeral 102c denotes a background. 111 is a line indicating the movement of the objects 101a, 101b, 101c, 101d, and 101e on the retina, and 112 is a result of following the objects 101a, 101b, 101c, 101d, and 101e, and on the retina of a certain background 102c. It is a straight line showing the movement of. As can be seen from FIG. 8B, it can be seen that the positional relationship between the object and the background changes by following the movement of the object. The observer recognizes this change as a three-dimensional effect empirically.

  Next, the case where the observer's viewpoint is moving will be described. FIG. 9A is a diagram schematically showing the following vision when the observer moves. In FIG. 9A, 100a, 100b, 100c, 100d, and 100e are the eyes of the observer at time Tn-2, Tn-1, Tn, Tn + 1, and Tn + 2, and 101 indicates the object. Reference numerals 102a, 102b, 102c, 102d, and 102e are backgrounds. Reference numerals 110a, 110b, 110c, 110d, and 110e are dotted lines that schematically show the line of sight when the object 101 is viewed.

  FIG. 9B schematically shows an image formed on the retina when the observer moves. In FIG. 9B, reference numeral 101 denotes an object at times Tn-2, Tn-1, Tn, Tn + 1, and Tn + 2. As a result of the observer performing follow-up, time Tn-2, Tn-1, Tn , Tn + 1, Tn + 2 are located at the center on the retina. Reference numeral 102c denotes a background. Reference numeral 111 denotes a line indicating the movement of the object 101 on the retina, and 112 indicates a straight line indicating the movement of the background 102c on the retina as a result of the object 101 being viewed. As can be seen from FIG. 9B, it can be seen that the positional relationship between the object and the background changes as the observer moves and the observer follows the object. The observer recognizes this change as a three-dimensional effect empirically.

  As described above, the stereoscopic effect is generated by the motion parallax, that is, the displacement of the position of the object on the retina with respect to the background. The stereoscopic effect due to motion parallax is perceived by a change in the positional relationship between the object and the background, and thus has a characteristic that the observer can perceive it stereoscopically even with a single eye.

(Motion parallax by sub-frame display)
Next, a method for obtaining the same effect as the stereoscopic effect by the motion parallax described above by devising the video displayed on the display device will be described.

The inventor used SED (Surface-conduction Electron-emitter Display), and 120
When an image was displayed at a display frame frequency of Hz and the object and the background were observed, the following was found.

  FIG. 10A and FIG. 10B schematically show the generation principle of motion parallax by subframe display. In FIG. 10A, the horizontal axis is a space direction, for example, an axis indicating the X direction, and the vertical axis is an axis indicating the time direction. The vertical axis schematically shows the display at frame times Tn-2, Tn-1, Tn, Tn + 1, and Tn + 2. In FIG. 10A, reference numeral 101 denotes an object, reference numerals 102a, 102b, 102d, and 102e denote backgrounds, and reference numeral 110 schematically illustrates a minute viewpoint movement that occurs unconsciously called a microsaccade. It is the line shown. In FIG. 10A, the object 101 displays a frame frequency of 120 Hz, for example, only odd frames. The backgrounds 102a, 102b, 102d, and 102e display all frames at a frame frequency of 120 Hz. At this time, since the object 101 is displayed by being decimated by half in the time direction, the luminous intensity is doubled, and the luminance is the same as when displayed at 120 Hz without decimating (the same brightness as viewed by the observer). Adjust so that

  FIG. 10B is a diagram schematically showing a sub-frame display image formed on the retina of the observer. In FIG. 10B, reference numeral 101 denotes an object, and 102a, 102b, 102d, and 102e denote backgrounds. The relationship between the object 101 and the backgrounds 102a, 102b, 102d, and 102e at the times Tn-2, Tn-1, Tn, Tn + 1, and Tn + 2 is schematically shown. Reference numeral 112 is a line schematically showing the movement of the background 102 b on the retina caused by the observer's unconscious movement of the minute viewpoint, and 111 is a line showing the position on the retina that can be seen by the afterimage of the object 101.

  As can be seen from FIG. 10B, the background 102 b moves on the retina as indicated by the line 112 by the minute movement of the observer's unconscious minute viewpoint. On the other hand, for example, the object 101 is lit at double emission intensity at time Tn-2 and does not emit light at time Tn-1. Therefore, as shown by the line 111, the object 101 appears to be fixed on the retina due to the afterimage. At the next time Tn, since the object 101 emits light, it appears that the object 101 has moved between the backgrounds 102b and 102d. As a result, the observer perceives (an illusion) that different movements (relative movements of the background and the object) occur between the backgrounds 102a, 102b, 102d, and 102e, and the motion parallax. This creates a three-dimensional effect.

  When such a sub-frame display is performed, the backgrounds 102a, 102b, 102d, and 102e move in the same manner as the frame of the display device, so that the background can be recognized as the same distance as the frame of the display device. Then, the object 101 is recognized as being in front of the backgrounds 102a, 102b, 102d, and 102e, resulting in a three-dimensional effect.

  In addition, when the inventor observed that the background is plain, it is difficult to recognize the movement of the background, so it is difficult to recognize the relative movement between the background and the object, and the stereoscopic effect is reduced. It was. In addition, when a pattern that assists in a stereoscopic effect is selected as the background, the relative movement between the background and the object becomes easy to recognize, so the stereoscopic effect caused by the generation of motion parallax due to subframe display can be enhanced. .

Specifically, images displayed by the inventor on the SED and observed are shown in FIGS. 11 (a), 11 (b), 11 (c), and 11 (d). The above-described phenomenon will be described in more detail using these images.
FIG. 11A is a diagram showing an image of the first frame observed by subframe display, and FIG. 11B is a diagram showing an image of the second frame. Hereinafter, in this specification, this subframe is referred to as a display subframe.

  First, in order to confirm the effect of the present invention, the present inventor displayed the images of FIGS. 11A and 11B alternately at a frame frequency of 120 Hz. The darkness in the figure corresponds to the emission intensity of the display device. For the images in FIGS. 11A and 11B, data adjusted so that the luminance of the left and right circular portions is the same when displayed at a frame frequency of 120 Hz is used. That is, the observer evaluated by setting the brightness of the left and right circular portions in FIGS. 11A and 11B to be the same. Specifically, the light intensity of the left circle part is 100% for the first frame, the second frame is 0%, the light intensity of the right circle part is 50% for the first frame, and the second frame is 50%. Set to. The light emission intensity of the background was set to the same value in the first frame and the second frame.

  On the other hand, in order to evaluate the background pattern, the images of FIGS. 11C and 11D were also created. FIG. 11 (c) is a diagram showing an image of the first frame obtained by adding a pattern to help the stereoscopic effect to the background and observing by subframe display, and FIG. 11 (d) shows an image of the second frame. FIG. A different part from the images of FIGS. 11A and 11B is that a figure for assisting the left and right circles to be viewed stereoscopically is added under the left and right circles. This auxiliary figure is an oblique figure that appears to have depth and an elliptic figure that appears to be a shadow of a circle. The other parts were exactly the same as the images in FIGS. 11 (a) and 11 (b).

As a result of displaying such an image with SED at a frame frequency of 120 Hz and comparing the stereoscopic effect, the following was found.
The right circles in FIGS. 11A and 11B appear to be the same as the background (the picture written on the background). On the other hand, the left circle looked different from the right circle. In other words, the left circle appears to be different from the background, and the left circle appears to be slightly raised.
On the other hand, FIGS. 11 (c) and 11 (d) are more three-dimensional (circles are raised) than the display using FIGS. 11 (a) and 11 (b). In particular, for the left circles in FIGS. 11C and 11D, it was found that the circles looked different from the background and appeared more prominent than the right circles.
Further, as another experiment, even when a pattern (texture) is simply added to the background, it is not as large as in FIGS. 11 (c) and 11 (d). I can see that.

  That is, as a result of the above observation experiment, the following was found. An object whose light emission intensity has not changed between display subframes (the right circle) looks the same as the background (looks like a circle is written on the background). However, when the emission intensity is relatively changed between display subframes, the background and the object (left circle) look different, and the object appears to protrude from the background. Furthermore, if there is a pattern in the background, particularly a pattern that promotes a three-dimensional effect, the three-dimensional effect increases.

  In summary, an object having a large light emission intensity ratio (high light emission intensity / small light emission intensity) between two display subframes appears to be raised compared to the background (when the light emission intensity ratio is 1, the normal display is displayed. Can't see). Then, by determining the emission intensity of each display subframe so that the luminance obtained as a result of displaying two display subframes is the luminance that should be displayed regardless of the target, the target when the observer sees it It is possible to achieve a three-dimensional effect without changing the brightness.

  In the SED, which is an impulse type display, the above-mentioned effects can be clearly recognized. In an LCD that is a hold-type display, the above-described effect is reduced, but the same effect can be obtained in principle. In recent years, in order to bring the LCD closer to the characteristics of an impulse display, black insertion, control of the light emission time of the backlight, and the like are performed. In such an LCD, the effects of the present invention can be easily obtained.

Based on the above examination, the present invention generates an output video signal as follows. That is, the video generation device according to the present invention includes a subframe generation unit that generates display subframes that constitute an output video signal, and an output unit that sequentially outputs the display subframes to the display device. The subframe generation unit generates each display subframe so that one video is formed by a plurality (N) of consecutive display subframes. At this time, between the N display subframes, the light emission intensity of the background region does not change relatively, and the light emission intensity of the object region to be raised relatively changes compared to the background. The light emission intensity for each display subframe region is determined. If the output video signal generated in this way is output to the display device, motion parallax is perceived by the minute eye movement of the observer, and the object appears to be raised from the background.
In the present invention, “N consecutive display subframes” in the output video signal are referred to as “frames” for convenience. Further, the number N of display subframes forming one frame is referred to as “unit display frame number”. The unit display frame number N is an integer greater than 1, and is preferably about 2 to 4, for example.

(First embodiment)
The first embodiment of the present invention generates two subframes from each frame of an input video signal of 60 Hz, and adjusts the emission intensity of each subframe based on distance information of each object in the video. , A 120 Hz output video signal is generated.

A block diagram of the first embodiment of the present invention is shown in FIG. 1, and a timing diagram is shown in FIG.
In FIG. 1, 1 is a distance information extraction unit that extracts distance information of an object from an input video signal, and 2 is a coefficient of a first display subframe based on distance information that is output from the distance information extraction unit 1. It is the 1st coefficient production | generation part to determine. Here, the distance information is information representing the distance in the depth direction of each target object in the video (that is, the distance from the observer or the photographer to the target object). Reference numeral 3 denotes an inverse gamma converter for converting an input video signal into a video signal having a characteristic proportional to luminance, and 4a and 4b denote multipliers. Reference numeral 5 denotes a low-pass filter in the spatial direction or in the spatial direction and the temporal direction. Since the low-pass filter 5 can be omitted, it is shown by a broken line. Reference numeral 6 denotes a second coefficient calculation unit that calculates the coefficient of the second display subframe from the coefficient of the first display subframe. Reference numerals 7a and 7b denote time axis compression units that compress the time axis in order to create a display subframe by doubling the input frame frequency. Reference numeral 8 denotes a switch for switching and outputting the doubled video signal. A gamma conversion unit 9 converts the characteristics of the video signal into gamma characteristics corresponding to the display device. Reference numeral 99a is an input terminal for inputting a video signal, 99b is an output terminal for outputting a doubled video signal, and 500 is a display device for displaying the doubled video signal. In the present embodiment, the first coefficient generation unit 2, the low-pass filter 5, the second coefficient calculation unit 6, and the multipliers 4a and 4b constitute the subframe generation unit of the present invention, and the time axis compression units 7a and 7b and the switch 8 Thus, the output unit of the present invention is configured.

  In FIG. 6, the horizontal axis schematically represents time, and the vertical axis schematically represents signal intensity. S11 to S16 in FIG. 6 respectively correspond to the signal waveforms of the wirings indicated by S11 to S16 in FIG.

  Next, a video generation method according to the first embodiment of the present invention will be described with reference to FIGS. In FIG. 1, a video signal having a frame frequency of 60 Hz, for example, is input to the input terminal 99a. The video signal is subjected to, for example, (1 / 2.2) power gamma conversion that cancels the gamma characteristic of the CRT. Signal. The inverse gamma conversion unit 3 is a 2.2 power conversion table, which converts the video signal input to the input terminal 99a into a video signal proportional to the luminance and outputs the video signal. The output video signal (S11) is schematically shown in FIG. The waveform of S11 in FIG. 6 shows an image signal of one frame (1/60 second) as an example. S11 indicates a video signal having a bright horizontal band in the center of the screen, for example. Of course, this is a video signal for explanation, and any video signal may be used.

  On the other hand, the video signal input to the input terminal 99a is converted by the distance information extraction unit 1 into a signal of distance information between the imaging apparatus and the target object. For this conversion, for example, the distance between the camera and the subject may be obtained by a method disclosed in Japanese Patent Application Laid-Open Nos. 07-244735 and 2007-077844, and a frame of distance information may be generated.

  Alternatively, a method may be used in which distance information is generated from a shift amount having a high correlation by moving within a search range for each block from two images captured by a twin-lens camera, detecting a correlation with the block of the other image. That is, the distance where the block shift amount is 0 is a distance determined by the camera setting, and is a known value for the designer. Based on the distance of the shift amount 0, the distance between the camera and the subject may be calculated based on the size and direction of the shift amount and the shooting angle of view of the camera (the focal length of the lens and the size of the imaging plate). This distance information frame is input to the input terminal 99a together with one of the two video signals used for the distance information calculation (the other is not used). In this case, the distance information extraction unit 1 is simply a functional block that only separates the frame of distance information. Of course, the above-described processing for obtaining distance information from two images taken by a twin-lens camera may be a function of the distance information extraction unit 1.

  In the case of a computer graphic image, the position of the camera and the position of the object are known as the coordinates of the virtual space. Therefore, when the video signal is generated, the distance from the camera is calculated, frame data having distance information is generated, and the frame data is output to the input terminal 99a simultaneously with the video signal. In this case, the distance information extraction unit 1 is simply a functional block that only separates the frame of distance information.

  Further, the distance information frame is preferably the same size as the image size of the video signal and has a data width as required. For example, as will be described later, if the resolution of the distance information is not required, the data width may be 1 or 2 bits.

  The output of the distance information extraction unit 1 is input to the first coefficient generation unit 2 and converted into a coefficient (hereinafter simply referred to as a first coefficient) to be multiplied by the first display subframe corresponding to the distance information. An example of the first coefficient output for the input distance information is shown in FIG. In FIG. 7A, the horizontal axis is distance information (logarithmic axis), and the vertical axis is the first coefficient. In the characteristics shown in FIG. 7A, the first coefficient has a maximum value of 1.0 at a distance closer than 1 m, and the first coefficient gradually decreases as the distance increases between 1 m and 10 m where the distance is easily recognized. It is a table in which the first coefficient has a minimum value of 0.5 at a distance exceeding 10 m. Of course, other characteristics may be used. For example, it is possible to emphasize the stereoscopic effect in the vicinity of 1 m with a downward convex characteristic.

The first coefficient, which is the output of the first coefficient generation unit 2, is input to the second coefficient calculation unit 6, and the second coefficient is calculated. If the first coefficient is k1 and the second coefficient is k2, the second coefficient calculator 6

k2 = 1-k1 (Formula 1)

Is preferably calculated.

Subsequently, the video signal proportional to the luminance, which is the output of the inverse gamma conversion unit 3, is multiplied by the first coefficient S12 and the second coefficient S13, respectively. As a result, for example, the emission intensity of the object at a distance of 1 m is 100% and 0% in the first and second display subframes. For example, the emission intensity of the background at a distance of 10 m is 50% in the first and second display subframes. , 50% (S14a, S14b). Here, for easy understanding, the light emission intensity of the display subframe is expressed not as an absolute value (video signal value) but as a ratio to the light emission intensity of the input video signal. That is, “100%” means that the value of the video signal in the display subframe is the same as the value of the input video signal.

  The video signals S14a and S14b corresponding to the first and second display subframes are converted from the frame frequency of 60 Hz into video signals S15a and S15b in which the frame time is compressed by the time axis compression units 7a and 7b. Next, the video signal S16 having a frame frequency of 120 Hz is obtained by the switch 8 alternately selecting the video signals S15a and S15b whose time is compressed. Since the video signal S16 having a frame frequency of 120 Hz is a video signal proportional to the luminance, the gamma conversion unit 9 performs, for example, (1 / 2.2) power gamma conversion on the video signal in accordance with the characteristics of the display device 500 to be displayed. Apply to S16 and output to output terminal 99b. The video signal output to the output terminal 99b is displayed on the display device 500. The display device 500 is a display device that receives a video signal having a frame frequency of 120 Hz and displays the video signal at a frame frequency of 120 Hz. As described above, the display device 500 is preferably an impulse display for the present invention. However, even if it is a hold type display, the effects of the present invention can be obtained.

  The calculation of Equation 1) indicates that the sum of the first coefficient and the second coefficient is 1. This means that the sum of the emission intensities of the first and second display subframes is always the same regardless of the value of the distance of the object, that is, the emission intensity ratio set for the object. By adjusting the emission intensities of the first and second display subframes in this way, the luminance that is observed as a result of displaying the two display subframes regardless of the distance of the target object is required by the input video signal. Proportional to (brightness to be displayed). Therefore, the luminance ratio between the objects in the video is maintained, and a video with good quality can be displayed.

  In the first coefficient generation unit 2 having the characteristics shown in FIG. 7A, the background (10 m or more in this characteristic) is a normal display of 120 Hz. As described above, the background moves on the retina together with the minute movement of the observer's eyes. On the other hand, as the distance approaches 1 m, the emission intensity of the first display subframe increases and the emission intensity of the second display subframe decreases, so that the object appears to be fixed on the retina. Therefore, a stereoscopic effect due to motion parallax occurs. Since this stereoscopic effect is recognized by motion parallax caused by the observer's minute eye movement, the stereoscopic effect may be difficult to understand from the image. In that case, the stereoscopic effect can be enhanced by making the emission intensity ratio extremely different between the background region and the region of the object to be raised compared to the background. This is because the light emission intensity ratio is not continuously changed according to the distance as shown in FIG. 7A, but the light emission intensity ratio is switched stepwise (for example, about 2 to 4 steps) according to the distance. realizable.

  FIG. 7B and FIG. 7C show the characteristics of the first coefficient generation unit 2 for changing the emission intensity ratio stepwise. In FIG. 7B and FIG. 7C, the horizontal axis is distance information, and the vertical axis is the first coefficient. FIG. 7B shows an example in which the distance is divided into three stages and the emission intensity of the display subframe is controlled. Specifically, at a distance smaller than 2 m, the emission intensity ratio of the first and second display subframes is 100%: 0%, and at a distance from 2 m to 10 m is 75%: 25%, and at a distance exceeding 10 m. 50%: 50%. In FIG. 7 (c), an object having a distance of 3 m or more is used as a background, and the emission intensities of the first and second display subframes are the same. %: The stereoscopic effect is made extreme by setting it to 0%. The characteristics of the first coefficient generation unit 2 may be optimally selected depending on the image of the video signal, the size of the display device, the display frame frequency, and the like.

Up to this point, the operation when the low-pass filter 5 is not described has been described. However, when the low-pass filter 5 is not provided, there is a possibility that a sense of interference occurs in which the boundary between the object and the background looks black or bright due to the observer's unintentional movement of the viewpoint. Therefore, it is preferable to suppress the feeling of interference by applying a spatial low-pass filter to the first coefficient by the low-pass filter 5 to moderate the spatial change (change in the screen) of the emission intensity ratio. In addition, when displaying moving images, there may be a sense of incongruity at the boundaries of moving objects, so by applying a temporal low-pass filter in addition to a spatial low-pass filter, the temporal intensity ratio It is more preferable to moderate the change (change between frames).

An important characteristic in the present embodiment, that is, the ratio of the emission intensity of the first and second display frames is referred to as the emission intensity ratio H. That is, H is

H = max [(k1 / k2), (k2 / k1)]
= Max [(k1 / (1-k1)), ((1-k1) / k1)] Equation 2)

It is defined as

  When the emission intensity ratio H is 1, there is no feeling that the two display subframes have the same emission intensity. Therefore, H is preferably 1 or a value close to 1 in the background region. On the other hand, when the light emission intensity ratio H is the largest (infinite), the second coefficient is 0, and the difference between the light emission intensities of the two display subframes is the largest, so that the object appears most prominent. Therefore, it is better to set H to a larger value for an object that is more prominent than the background.

  In the present embodiment, the range of the first coefficient k1 is 1 to 0.5, the multiplier of the first display subframe is 1 to 0.5, and the multiplier of the second display subframe is 0 to 0.5. However, the same effect can be obtained even if the values of the first coefficient and the second coefficient are reversed. That is, even if the range of the first coefficient k1 is 0 to 0.5, the multiplier of the first display subframe is 0 to 0.5, and the multiplier of the second display subframe is 1 to 0.5, the same effect is obtained. can get. Therefore, in Equation 2), the maximum value of (k1 / k2) and (k2 / k1) is defined as the emission intensity ratio H.

The processing of the first embodiment described above is expressed in the form of a mathematical expression.
The input video signal is Si, each video signal of the display subframe of the output video signal is So1, So2, and the output of the low-pass filter 5 to which the first coefficient is input is k1 (configuration without the low-pass filter 5). If so, the first coefficient is k1). The video signals So1, So2 of the first and second display subframes can be expressed as follows.

So1 = [k1 × Si ^2.2 ] ^{(1 / 2.2)} Expression 3)
So2 = [(1-k1) × Si ^2.2 ] ^{(1 / 2.2)}
= [K2 × ^Si2.2 ] ^{(1 / 2.2)} Formula 4)

Here, the equations 3) and 4) are modified,

So1 = (k1) ^{(1 / 2.2)} × Si ⁽ formula 5)
So2 = (1-k1) ^{(1 / 2.2)} .times.Si = (k2) ^{(1 / 2.2)} .times.Si ⁽ Expression 6)

Both can be expressed.

From equations (5) and (6), it can be seen that the inverse gamma conversion processing and the final gamma conversion processing for the video signal can be omitted by performing gamma conversion on the first coefficient and the second coefficient. FIG. 2 shows a block diagram of a circuit configuration that realizes this operation. In FIG. 2, symbols different from those in FIG. 1 will be described. In FIG. 2, reference numerals 3a and 3b denote gamma converters which are the same as the gamma of the video signal, for example, (1 / 2.2). Also with the configuration shown in FIG. 2, the same result as the configuration of FIG. 1 can be obtained.

  An example of the first coefficient k1 according to the first embodiment of the present invention will be specifically described with reference to FIGS. 12 (a) and 12 (b). FIG. 12A is a diagram schematically showing an image captured by an imaging device (not shown), and FIG. 12B is a diagram output by the first coefficient generation unit 2 according to the first embodiment of the present invention. It is the figure which showed 1 coefficient k1 typically. In FIG. 12A, 201 is a rectangle indicating an image area, 201a is an object in the foreground, 201b is an object at a medium distance, and 201c and 201d are objects in the background that are the background. The distance information of the video signal shown in FIG. 12A may be obtained by measuring with, for example, infrared rays or ultrasonic waves, or may be calculated from the video signal by the method described above. From the distance information, it is understood that the distance of the object 201a is 1 m, the distance of the object 201b is 5 m, and the distances of the objects 201c and 201d as the background are 100 m or more. For example, in the case of having the characteristics of the first coefficient generation unit 2 shown in FIG. 7B, the first coefficient k1 of the object 201a is “1”, the first coefficient k1 of the object 201b is “0.75”, The first coefficient k1 of the backgrounds 201c and 201d is “0.5”.

  The first coefficient k1 is schematically shown in FIG. In FIG. 12B, 211 is a rectangle indicating the frame area of the first coefficient, 211a is the first coefficient k1, 201b of the object 201a in the foreground, and the first coefficients k1, 211c of the object 201b at the intermediate distance are The first coefficient k1 of the background is shown. In the figure, the first coefficient k1 of the part shown in black is “1”, and the first coefficient k1 of the part shown in gray is “0.75”. The first coefficient k1 of the portion shown in white is “0.5”. The emission intensity of the first and second display subframes is 100% and 0% in the region where the first coefficient k1 is “1”, 75% and 25% in the region where the first coefficient k1 is “0.75”, In the region where the one coefficient k1 is “0.5”, they are 50% and 50%. That is, the closer the object is, the larger the emission intensity ratio is displayed.

  In the first embodiment of the present invention, a video signal having a frame frequency of 60 Hz is input, and one frame is formed by two display subframes having a frame frequency of 120 Hz. As described above, since it is determined that the sum of the first coefficient k1 and the second coefficient k2 is 1, the luminance obtained by displaying the display subframes as the number of unit display frames (here, two) is the input video signal. Becomes a value proportional to the required luminance (the luminance to be displayed). That is, the luminance obtained by displaying the display subframes as the number of unit display frames does not change depending on the distance of the object.

  According to the first embodiment of the present invention, a display method of dividing one frame into a plurality of display subframes and changing the light emission intensity ratio between the display subframes according to the distance of the target object enables simple three-dimensional display. An image with a feeling can be displayed. Since this method can be realized only by video signal processing, special hardware such as polarized glasses, shutter glasses, HMDs, lenticular lenses, slits, and a viewpoint moving speed detector is not required unlike conventional stereoscopic display devices. . Also, a special video signal including information on binocular parallax and motion parallax is not necessary. Accordingly, a complicated and expensive configuration is not required, and a stereoscopic display can be performed using a normal display device and a normal video signal.

  In addition, it is possible to easily realize mixing and switching between normal display and display with a stereoscopic effect. Furthermore, since the stereoscopic effect due to motion parallax according to the present invention is recognized by a change in the positional relationship between the object and the background, there is an advantage that the observer can perceive stereoscopically even when viewing the display device with a single eye.

(Second Embodiment)
As described above, the three-dimensional effect of the present invention is caused by a minute movement of the observer's viewpoint. Therefore, the stereoscopic effect is relatively difficult to understand compared to a stereoscopic display device that uses binocular parallax. Therefore, the method of the present invention is more suitable for a simple use of a three-dimensional effect than a content that requires a realistic three-dimensional effect such as a movie. Therefore, in the second embodiment, one preferred application example of the present invention will be described.

  In the second embodiment of the present invention, in a display device that synthesizes and displays an additional image (second video) such as a telop on a normal video (first video), only the portion of the additional image is raised. A configuration to be shown will be described.

  FIG. 3 is a block diagram for realizing the second embodiment of the present invention. FIG. 3 has substantially the same configuration as FIG. 1 which is the block diagram described in the first embodiment. The difference from FIG. 1 is that the distance information extraction unit 1 does not extract the distance from the video signal but determines the distance information directly from the telop image. The information of the telop image is simply extracted from the video signal of only the telop image, not the video signal in which the telop image is synthesized. For example, in the second embodiment of the present invention, the distance information extraction unit 1 sets the distance information of the telop image area to 1 m and the other area (normal video signal) in order to make the telop image portion appear three-dimensionally. Outputs the distance information to the first coefficient creating unit 2 as 100 m, for example. The subsequent processing is performed in the same manner as in the first embodiment. The normal image corresponding to the background has a light emission intensity of 50% and 50% for the first and second display subframes, and the telop image has the first and second display subframes. The light emission intensity of the frame is 100% and 0%. Of course, the configuration of FIG. 2 described in the first embodiment may be applied to the second embodiment.

  The determination of the first coefficient k1 in the second embodiment of the present invention will be specifically described with reference to FIGS. 13 (a) and 13 (b). FIG. 13A is a diagram schematically showing an image of a video signal obtained by adding a telop image to a normal video signal captured by an imaging device (not shown), and FIG. 13B is a second embodiment of the present invention. It is the figure which showed typically the 1st coefficient k1 which the 1st coefficient production | generation part 2 of the form output. In FIG. 13A, 202 is a rectangle indicating an image area, 202a is a picture indicating an image of a normal video signal, and 202b is a character ("GOAL") inserted by a telop. In the distance information of the video signal shown in FIG. 13A, the distance information extraction unit 2 determines, for example, 100 m and the telop image area as 1 m so that the normal video signal becomes the background.

  The characteristic of the first coefficient generation unit 2 is, for example, the characteristic shown in FIG. In this case, the first coefficient k1 is “0.5” for the normal video signal 202a, and the first coefficient k1 is “1” for the telop image region. In FIG. 13B, 212 is a rectangle indicating an image area, 212a is an area indicating a normal video signal image, the first coefficient k1 is “0.5”, and 212b is a character (“ GOAL "), and the first coefficient k1 is" 1 ". That is, the emission intensity of the first and second display subframes is 100% and 0% in the telop image portion, and is 50% and 50% in the portion other than the telop image.

  As in the first embodiment, since the sum of the first coefficient k1 and the second coefficient k2 is determined to be 1, the luminance obtained by displaying the display subframe as the number of unit display frames is the input video signal. Becomes a value proportional to the required luminance (the luminance to be displayed). That is, the luminance obtained by displaying the display sub-frames as the number of unit display frames is proportional to the luminance to be displayed on the telop determined by the original video and the content producer.

  According to the second embodiment of the present invention, a complicated and expensive configuration is not required, and a normal display device can be displayed as it is, and a portion such as a telop image that a content producer wants to emphasize can be displayed easily and stereoscopically. Become. Further, since only a necessary telop image can be displayed with a stereoscopic effect, a display with a stereoscopic effect can be performed with less fatigue. Furthermore, there is an advantage that the observer can perceive stereoscopically even when viewing the display device with a single eye.

(Third embodiment)
Next, a third embodiment of the present invention will be described. The third embodiment is a method that can be suitably applied to, for example, a monitor display of a personal computer, a smartphone, a tablet PC, a mobile phone, a digital photo frame, a digital camera, a video camcorder, etc. (hereinafter simply referred to as “PC”). It is. More specifically, the third embodiment is a display device / method that enables three-dimensional display of an icon, a cursor, or a photographic image that is desired to be noticed.

  Since the video output of the PC is not strictly defined as in the existing TV, it is possible to prepare a video signal at a high frame frequency in advance. With this configuration, the block that doubles the frame frequency described above can be omitted. It is also possible to create a video signal by calculating the processing of the video signal having the above-described configuration with software of a PC. Hereinafter, this will be described in detail.

  Assume that the output of the PC is output at a frame frequency of 120 Hz, for example. In the third embodiment of the present invention, the processing of Equation 3), Equation 4), or Equation 5) and Equation 6) described above is calculated by the PC, and the video signal output from the PC is set to a frame frequency of 120 Hz. It is displayed as it is.

  The first coefficient k1 can be obtained from the distance information as in the first embodiment. For example, when the content creator wants to display an icon in a three-dimensional manner, the distance information of the icon is determined to be 1 m, for example. Similarly, the content creator determines that the menu bar has a distance information of 5 m in order to make the menu bar look somewhat stereoscopic, and the background has a distance information of 100 m.

  FIG. 14A schematically shows an image displayed on an actual PC, and FIG. 14B schematically shows the first coefficient k1. In FIG. 14A, reference numeral 203 denotes a square indicating a display area, 203a denotes a desktop background, 203b denotes a menu bar on which an icon is placed, and 203c denotes an icon. When the content creator determines the distance information as described above, the first coefficient k1 is set to a value as shown in FIG. In FIG. 14B, reference numeral 213 denotes a square indicating the display area, 213a denotes first coefficients k1, 213b corresponding to the desktop background 203a, and first coefficients k1, 213c corresponding to the menu bar 203b denote first coefficients k1, 213c corresponding to the icon 203c. One coefficient k1 is shown in white, gray, and black, respectively. In the figure, the first coefficient k1 of the part shown in black is “1”, the first coefficient k1 of the part shown in gray is “0.75”, and the first coefficient k of the part shown in white is “0.5”. That is, the light emission intensity of the frames sequentially displayed at 120 Hz alternately changes between 100% and 0% in the portion of the icon 203c, and alternately changes between 75% and 25% in the portion of the menu bar 203b. The light emission intensity of the background 203a portion remains unchanged at 50%.

  In the present embodiment, each frame of the video signal generated and output by the PC corresponds to the display subframe in the first and second embodiments described above. That is, in this embodiment, the number of unit display frames is 2, and the total luminance formed by the display subframes corresponding to the number of unit display frames does not change regardless of the value of the first coefficient k1.

  FIG. 14A illustrates the desktop screen of the PC, but the method of the present embodiment can be suitably applied to the case of synthesizing the second video to be raised on the first video as the background. . For example, on the screen of a display dedicated to digital photography called a digital photo frame, the user's photograph may be displayed so as to appear against a background image such as wallpaper. In this case, as described with reference to FIGS. 11C and 11D, it is also preferable to display a pattern (texture) or a figure assisting a three-dimensional effect on the background image. It is also possible to combine and display information such as the time and date on the displayed user's photo so that it can be seen. In addition, on an operation monitor such as a digital camera, a GUI such as a button or a slider, an alert message, or the like can be displayed three-dimensionally on an image being shot.

In the present embodiment, since a video signal having a display frame frequency (for example, 120 Hz) is generated from the beginning in a PC (video generation device), processing such as double speed conversion is unnecessary, and the present invention is obtained only by calculation of display data by software. Can be realized. The display frame frequency is not limited to 120 Hz. Although depending on the screen size and the first coefficient k1, the frame frequency may be in a range where flicker is not noticeable. In general, a video signal having a frame frequency of 75 Hz or more is less likely to be disturbed by flicker, and is therefore suitable for the method of the third embodiment. However, when the screen size is small, flicker interference is small, so that display can be suitably performed even at a frame frequency of about 60 Hz.

  In the third embodiment, the PC can also output a moving image. In this case, it is preferable to use the low-pass filter (reference numeral 5 in FIG. 1) described in the first embodiment and apply a spatial and temporal low-pass filter to the first coefficient. At that time, the distance information may be determined by the content creator by calculating the position of the object from the average of either frame or a plurality of frames.

  When the input video signal is a still image, the first coefficient and the first coefficient are set so that the luminance obtained by displaying the display sub-frames by the unit display frame number is the same as the luminance required by the input video signal (luminance to be displayed). Two coefficients may be determined. In the case of a moving image, since different frames are displayed as display subframes, the luminance required for the input video signal (the luminance to be displayed) cannot be accurately reproduced, but it should be approximately the same (some errors may occur). Even so, there is little degradation in image quality).

  According to the third embodiment of the present invention, the image generation device simply adjusts the light emission intensity for each frame area by calculation, and easily displays a portion that the content producer wants to emphasize, such as an icon, in three dimensions. Display can be realized. As described above, this stereoscopic effect uses motion parallax due to minute eye movements called microsaccades that occur unconsciously by the observer. Furthermore, in a portable device such as a smartphone, in addition to the movement of the eyeball, there is a movement of the display device itself, so that a motion parallax is generated and a three-dimensional effect can be expected to be further improved. Moreover, since the method of this embodiment can perform a display with a three-dimensional effect only about necessary parts, such as an icon, it can display with a three-dimensional effect with little fatigue. Furthermore, there is an advantage that the observer can perceive stereoscopically even when viewing the display device with a single eye.

(Fourth embodiment)
As described in the third embodiment, when the frame frequency is 75 Hz or more, the frame frequency conversion for increasing the frame frequency shown in the first and second embodiments may not be performed. Although depending on the size and brightness of the display device, when the frame frequency is approximately 75 Hz or more, flicker interference is small.

  For example, in a video signal imaged at 120 Hz, a frame of the video signal may be handled as a display subframe. At this time, the number of unit display frames is determined in advance (for example, “2”), and the processing shown in the first embodiment is performed. Of course, as shown in the third embodiment, there is no need to increase the frame frequency. That is, the time axis compression units 7a and 7b and the switch 8 shown in FIGS. 1 and 2 are not necessary.

FIG. 4 shows a block diagram of a fourth embodiment in which frame frequency conversion is not performed. In FIG. 4, symbols different from those in FIG. 1 will be described. In FIG. 4, 8a is a switch. In the block diagram shown in FIG. 4, the distance information extraction unit 1 calculates the position and distance information of the object from one of the frames within the unit display frame number or the average. The output of the first coefficient generator 2 is input to a low-pass filter 5 and subjected to a spatial and temporal low-pass filter. The second coefficient calculation unit 6 calculates the second coefficient k2 as in the first embodiment. The switch 8a switches the first coefficient k1 and the second coefficient k2 for each frame of the input video signal. The output of the switch 8a is multiplied by the video signal proportional to the luminance by the multiplier 4a to obtain the first display subframe and the second display subframe.

  When the input video signal is a still image, the first coefficient and the first coefficient are set so that the luminance obtained by displaying the display sub-frames by the unit display frame number is the same as the luminance required by the input video signal (luminance to be displayed). Two coefficients may be determined. In the case of a moving image, since different frames are displayed as display subframes, the luminance obtained by displaying the display subframes as the number of unit display frames is approximately the same as the luminance required by the input video signal (luminance to be displayed). Like that.

  Also, for example, a 120 Hz video signal created by inserting an interpolation frame between original frames of a 60 Hz video signal and doubling the frame frequency may be input. In this case, since the image quality of the original frame is small, the interpolation frame is used as the second subframe multiplied by the small value (second coefficient) as the first subframe multiplied by the large value (first coefficient). The number of unit display frames is preferably 2.

  In the present invention, when the frame frequency of the input video signal is high as described above, it is possible to perform processing without converting the frame rate of the input video signal. That is, the frame of the input video signal can be handled as a display subframe as it is.

(Fifth embodiment)
In the first embodiment, the sum of the first coefficient k1 and the second coefficient k2 is designed to be 1. In this case, although the first and second display subframes can be displayed with 100% emission intensity (that is, a total of 200%), 100% in total such as 100% and 0%, 50% and 50%. The display is performed so that the emission intensity becomes. That is, it means that the display can be performed only at a luminance that is 1/2 of the display capability of the display device.

Therefore, in order to improve the luminance, the following first coefficient and second coefficient may be used.

k2 = A−k1 (Expression 7)

That is,

A = k1 + k2 (Formula 8)

It is. Here, when A = 1, it is the same as the coefficient of the first embodiment.

For example, if A is 1.5, the sum of the first coefficient k1 and the second coefficient k2, that is, the sum of the coefficients multiplied by the video data proportional to the luminance, is 1.5, which is compared with the first embodiment. 1.5 times the luminance is obtained. However, when k1 = 1, since k2 = 0.5, the ratio between coefficients, that is, the emission intensity ratio cannot be obtained, and the stereoscopic effect may be reduced.
The coefficient A may be determined based on the brightness and stereoscopic effect requested by the user.

(Sixth embodiment)
In the first embodiment, the case where the number of unit display frames is 2 has been described. The effect of the present invention of obtaining a stereoscopic effect by changing the emission intensity ratio between display subframes can be obtained even when the number of unit display frames is two or more. When the number of unit display frames is N, the frame frequency of the input video signal is 1 / N of the display frame frequency of the output video signal.

For example, when the frame frequency of the input video signal is 50 Hz, one frame may be formed by three display subframes having a 150 Hz frame frequency (the number of unit display frames is 3). By setting the emission intensity ratio of the objects close to each other in three display subframes to 100%, 0%, and 0%, it is possible to generate more pseudo motion parallax, particularly in a hold-type display. . In a hold-type display, if more display subframes are provided than necessary, flicker interference occurs. Therefore, the number of display subframes may be determined within a range where flicker is not noticeable.

  Furthermore, it demonstrates concretely using FIG. FIG. 5 is a block diagram showing a sixth embodiment for generating three display subframes. A different point from 1st Embodiment of FIG. 1 is demonstrated. In FIG. 5, 6a is a second and third coefficient calculation unit, 4c is a multiplier, 7c is a time axis compression unit, and 8b is a switch. The second and third coefficient calculator 6a calculates the second coefficient k2 and the third coefficient k3 from the first coefficient k1. The first display subframe is multiplied by the first coefficient k1, the second display subframe is multiplied by the second coefficient k2, the third display subframe is multiplied by the third coefficient k3, and the time axis compression units 7a, 7b, 7c and the switch The frame frequency is tripled by 8b. The video signal is subjected to gamma conversion by the gamma conversion unit 9 and then output to the display device 500.

  The first coefficient generation unit 2 determines the first coefficient k1 to be multiplied by the first display subframe. As described above, the determination of the first coefficient k1 may be a characteristic that continuously changes from the distance information of the object, or may be a characteristic that changes discretely.

For example, it is preferable to determine the second coefficient k2 and the third coefficient k3 for the first coefficient k1 as follows.

A = k1 + k2 + k3 (Equation 9)

  Here, as described above, since the luminance required by the input video signal can be reproduced when A = 1, the case where A = 1 will be described below. In this case, the first coefficient generation unit 2 outputs, for example, 1/3 to 1 as the value of the first coefficient k1, and a value that changes according to the distance of the object. The first coefficient k1 becomes a larger value (a value closer to 1) as the distance of the object is smaller.

Since k2 and k3 cannot be determined only by Expression 9), the constraint conditions for k2 and k3 are determined in advance. For example, the condition k2 = k3 may be used, or the condition k2 = J × k3 (J is a constant equal to or greater than 1) may be used. For example, in the condition of k2 = k3,

k2 = k3 = (1-k1) / 2 (Equation 10)

It is obtained.

Here, the emission intensity ratio H is

H = k1 / min (k2, k3) Equation 11)
However, k1 ≧ k2, k1 ≧ k3

It is defined as

When the emission intensity ratio H is 1, the stereoscopic intensity does not occur because the emission intensities of the first, second, and third display subframes are the same. In this case, k1 = 1/3. On the other hand, when the emission intensity ratio H is the largest (infinite), since the second coefficient k2 and the third coefficient k3 are 0, the corresponding object appears to protrude most. As described above, the display subframe to be multiplied by the first coefficient k1 may not be the first frame among the three display subframes, and the second or third frame may be multiplied by the first coefficient k1. A similar three-dimensional effect can be obtained.

  The frame frequency of the input video signal, the display frame frequency of the output video signal, the number of unit display subframes, and the like can be arbitrarily selected. For example, 180 Hz display using three display subframes may be performed on an input video signal of 60 Hz, or 240 Hz display using four display subframes may be performed. The coefficient to be multiplied to each display subframe may be set according to each embodiment described above. At this time, the stereoscopic effect increases as the luminance concentrates on one display subframe.

  For example, when a video signal having a frame frequency of 240 Hz is directly input, the input frame may be regarded as a display subframe and the same processing may be performed. Alternatively, the number of unit display frames may be set to 2, and the same processing as that of the first embodiment may be performed in units of two frames.

(Other embodiments)
As described above, the essence of the present invention is that the sub-frame display is performed, and the light emission intensity ratio between the display sub-frames of a certain object is increased, thereby the motion parallax due to the minute eye movement of the observer unconsciously. , Making the object appear to stand out against the background. Therefore, in the first embodiment, the light emission intensity ratio corresponding to the distance of the target is set by acquiring or calculating the distance information of each target in the image. However, in the case of synthesizing another video such as a telop or icon on the background video like the video handled in the second and third embodiments, the concept of distance does not exist originally. Therefore, as long as such a synthesized image can be viewed three-dimensionally, there is no need to add or calculate distance information, and processing for directly setting the emission intensity ratio may be performed.

  1: distance information extraction unit, 2: first coefficient generation unit, 4a, 4b: multiplier, 6: second coefficient calculation unit, 7a, 7b: time axis compression unit, 8: switch, 500: display device

Claims (10)

A video generation device that generates an output video signal for displaying a stereoscopic image,
A subframe generation unit for generating display subframes constituting the output video signal;
An output unit that sequentially outputs the display subframe to a display device at a display frame frequency;
The subframe generation unit includes:
Each display subframe is generated so that one video is formed by N (N is an integer greater than 1) consecutive display subframes,
The light emission intensity of the background area in the video does not change relatively between the N display subframes, and the light emission intensity of the object area to be raised compared to the background is between the N display subframes. A video generation device that determines the light emission intensity for each region in the N display subframes so as to change relatively. When the ratio of the maximum emission intensity to the minimum emission intensity of the same region between the N display subframes is defined as the emission intensity ratio,
The video generation apparatus according to claim 1, wherein the sub-frame generation unit increases the light emission intensity ratio as the degree of protrusion increases compared to the background. A distance information extraction unit that acquires distance information representing the distance in the depth direction of the object in the video;
The video generation device according to claim 2, wherein the subframe generation unit determines a light emission intensity ratio of each object based on distance information of each object acquired by the distance information extraction unit.   The sub-frame generation unit determines the light emission intensity in each display sub-frame so that the total light emission intensity in the N display sub-frames of a certain object has the same value regardless of the light emission intensity ratio of the target object. The video generation apparatus according to claim 2, wherein the video generation apparatus is a video generation apparatus.   5. The video generation device according to claim 2, wherein the sub-frame generation unit switches the light emission intensity ratio in a stepwise manner in accordance with a degree of protrusion compared to the background.   3. The subframe generation unit includes a low-pass filter for moderating a spatial change in the light emission intensity ratio or a spatial and temporal change in the light emission intensity ratio. The video production | generation apparatus of any one of -5.   The subframe generation unit generates N subframes from each frame of the input video signal having a frame frequency of 1 / N of the display frame frequency, and adjusts the light emission intensity for each region of the N subframes. The video generation device according to claim 1, wherein a display subframe of the output video signal is generated. The output video signal is a video signal in which a second video is synthesized on a first video as a background,
The subframe generation unit does not relatively change the light emission intensity of the first video area between display subframes, and relatively changes the light emission intensity of the second video area between display subframes. The video generation device according to claim 1, wherein the video generation device is changed to:   The video generation device according to claim 1, wherein the display device is an impulse display. A video generation method for generating an output video signal for displaying a stereoscopic image,
A subframe generating step for generating a display subframe constituting the output video signal;
And sequentially outputting the display subframe to a display device at a display frame frequency,
In the subframe generation step,
Each display subframe is generated so that one video is formed by N (N is an integer greater than 1) consecutive display subframes,
The light emission intensity of the background area in the video does not change relatively between the N display subframes, and the light emission intensity of the object area to be raised compared to the background is between the N display subframes. A video generation method, wherein the light emission intensity for each region in N display subframes is determined so as to be relatively changed.

Images