JP2011176523A - Stereo video signal control method, control device, and control program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To display a highly realistic stereo video which does not make each viewer feel eye fatigue very much even when being viewed by a plurality of viewers. <P>SOLUTION: A parallax variation measurement part 103 obtains a parallax variation being a temporal variation of parallax between frames of a representative parallax amount inputted from a parallax amount measurement part 102. An output control part 104 determines a frame update period FT in accordance with an input video frame rate, a display video frame rate, a frame update period scale factor, character presence/absence information from a character detection part 101, and the parallax variation from the parallax variation measurement part 103. A frame interpolation part 106 outputs respective frames of a video signal for right eye and a video signal for left eye in accordance with the frame update period FT from the output control part 104. If a display time exists during the frame update period FT, the frame interpolation part 106 generates and outputs respective interpolation frames of the video signal for right eye and the video signal for left eye. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a stereo video signal control method, a control device, and a control program, and in particular, stereo video signal control for displaying a stereo video as a stereoscopic video on a display device having a display video frame rate higher than the frame rate of the input video. The present invention relates to a method, a control device, and a control program.

  Conventionally, various stereo image display methods using binocular parallax have been proposed. As a typical method, there is a stereo image method using binocular parallax in which an observer observes a stereoscopic image (stereo image) with liquid crystal shutter glasses or polarized glasses. In the stereo video system using the liquid crystal shutter, the left-eye video and the right-eye video are displayed on the monitor in a time-sharing manner, and an observer wearing liquid crystal shutter glasses displays the left-eye video with the left eye and the right-eye video. Observe stereoscopic images by viewing the images with the right eye. Further, in the stereo video system using polarized glasses, the parallax video for the left eye and the parallax video for the right eye are displayed on the monitor by spatial division, and the observer wearing the polarized glasses displays the parallax video for the left eye with the left eye, A stereoscopic image is observed by viewing the parallax image for the right eye with the right eye.

  It is known that an observer experiences eye strain and discomfort in viewing a stereo video system using such binocular parallax. One of the main causes of eye strain and discomfort is convergence and misalignment. A brief explanation of the inconsistency between congestion and coordination will be given. Humans concentrate their eyes on stereoscopic images (convergence distance). On the other hand, the crystalline lens of the human eye adjusts the focus on the image on the monitor (adjustment distance). In the natural state, the convergence distance and the adjustment distance are the same, but the monitor using the binocular parallax does not match the convergence distance and the adjustment distance. This mismatch is known to cause eye strain and discomfort. It is also known that eye strain and discomfort increase when this convergence and adjustment mismatch continues for a long time or changes rapidly.

  Inventions for reducing such inconsistency between congestion and adjustment have been made conventionally.

  In the invention described in Patent Document 1, when generating a left-eye image from a right-eye image and depth information, a moment when the depth information changes greatly is detected as a scene change, and the greatly changing depth information is gently converted to generate congestion. And reconciliation inconsistencies.

  In the invention described in Patent Document 2, the parallax is detected, the fatigue level is evaluated according to the detected parallax amount, and the flat image and the stereo video are switched according to the evaluated fatigue level. Has been reduced.

Japanese Patent Laid-Open No. 10-40420 JP 11-355808 A

  However, in the invention described in Patent Document 1, since the left-eye video is generated from the right-eye video, when applied to a stereo video that is originally composed of a left-eye video and a right-eye video, a different depth sensation from the original stereo video is obtained. Therefore, it is impossible to realize a highly realistic stereo image that the original stereo image has. Further, it is necessary to create a left-eye video from a right-eye video.

  Further, in the invention described in Patent Document 2, there is no problem as long as it is an environment that allows individual viewing such as a head-mounted display, but in an environment where a single display is viewed by a large number of people in a living room or the like, Due to differences in individual fatigue levels, there are people who are unable to see the highly realistic stereo images that can be originally viewed.

  The present invention has been made in view of the above points, and a stereo video signal control method capable of displaying a highly realistic stereo video in which each individual does not feel much eye strain even when viewed by a plurality of observers, An object is to provide a control device and a control program.

  In order to achieve the above object, a stereo video signal control method according to a first aspect of the present invention is a method for measuring a parallax amount between a right-eye video signal and a left-eye video signal included in an input stereo video signal for each frame. 1 step, a second step of measuring a parallax change amount that is a temporal change amount of parallax between frames of the parallax amount measured in the first step, and a parallax change amount measured in the second step. The larger the value, the longer the frame update period of the right-eye video signal and left-eye video signal included in the input stereo video signal is within the range up to the maximum value set longer than the steady-state frame update period at the time of input. The predetermined table in which the frame update period of the right-eye video signal and the left-eye video signal is set as a minimum value shorter than the steady-state frame update period as the parallax change amount is smaller. The third step of determining the frame update period so as to be shorter within the range up to the frame period, and the frame update period of the right-eye video signal and the left-eye video signal included in the input stereo video signal include the third step. The adjustment time for the right-eye video signal and the left-eye video signal is controlled in units of frames so as to be the frame update period determined in the step, and the predetermined time in the right-eye video signal and the left-eye video signal in which the frame update period is controlled The interpolated frame generated for each of the right-eye video signal and the left-eye video signal is inserted into a frame update period longer than the display frame period of the fourth, and the stereo video signal is used as a signal of a predetermined display frame period. These steps are included.

  In order to achieve the above object, the stereo video signal control method according to the first aspect of the invention determines whether or not character information is included in video information in a preset screen area of the input right-eye video signal and left-eye video signal. The fourth step further includes a step of detecting a frame update period for the right-eye video signal and the left-eye video signal detected to include character information in the fifth step. The adjustment time is controlled so as to become the frame update period of the state, and the minimum value set in advance for the right-eye video signal and the left-eye video signal detected to contain no character information in the fifth step The adjustment time is controlled in units of frames so that the frame update period is set in accordance with the amount of parallax change within the range from the maximum value to the maximum value.

  In order to achieve the above object, in the stereo video signal control method according to the third aspect of the present invention, in the fourth step, the frame set according to the amount of parallax change is set in a frame that is a target for setting a frame update period. From the update period, the adjustment time given to the right-eye video signal and the left-eye video signal so that the set frame update period is obtained, and the frame update period in the steady state, the next frame of the frame to be set , The delay time for the case where all the frame update periods are in the steady state is calculated, the delay time of the next frame is longer than the preset maximum delay time, and the set frame update period is a frame in the steady state When the update period is longer than the update period, the set frame update period is corrected to a steady-state frame update period.

  In order to achieve the above object, a stereo video signal control apparatus according to a fourth aspect of the present invention provides a parallax amount between a right-eye video signal and a left-eye video signal included in an input stereo video signal for each frame. A parallax amount measuring means for measuring, a parallax change amount measuring means for measuring a parallax change amount that is a temporal change amount of parallax between frames of the parallax amount input from the parallax amount measuring means, an input video signal for the right eye, and A frame that inserts an interpolation frame generated for each left-eye video signal into each of the input right-eye video signal and left-eye video signal and outputs a stereo video signal with a frame period as a predetermined display frame period The larger the amount of parallax change measured by the interpolation means and the parallax change amount measuring means, the higher the video signal for the right eye and the video signal for the left eye that the input stereo video signal has. The frame update period of the right-eye video signal and the left-eye video signal become longer as the parallax change amount becomes smaller as the frame update period becomes longer in the range up to the maximum value set longer than the steady-state frame update period at the time of input. The adjustment time for the video signal for the right eye and the video signal for the left eye by the frame interpolation means is set so that the period becomes shorter within a range up to a predetermined display frame period set as a minimum value shorter than the frame update period in the steady state. A stereo video signal is displayed in a predetermined manner by inserting an interpolation frame in a frame update period longer than a predetermined display frame period in the right-eye video signal and the left-eye video signal in which the frame update period is controlled. Output control means for controlling the frame interpolation means so that it is output as a signal of the frame period. To.

  In order to achieve the above object, the stereo video signal control apparatus according to the fifth aspect of the present invention includes whether character information is included in video information in a preset screen area of the input right-eye video signal and left-eye video signal. And the output control means has a steady frame update period for the right-eye video signal and the left-eye video signal detected by the character detection means. For the right-eye video signal and the left-eye video signal, which are detected to contain no character information by the character detection means, the adjustment time by the frame interpolation means is controlled so as to be the frame update period. The adjustment time by the frame interpolation means is controlled in units of frames so that the frame update period is set according to the amount of parallax change within the range from the minimum value to the maximum value.

  In order to achieve the above object, in the stereo video signal control apparatus according to the sixth aspect of the present invention, the output control means updates the frame that is set according to the amount of parallax change in the frame for which the frame update period is set. Of the frame to be set from the period, the adjustment time given to the right-eye video signal and the left-eye video signal in the frame interpolation means so that the set frame update period is obtained, and the steady-state frame update period. The delay time for the next frame when the all frame update period is in the steady state is calculated, the delay time of the next frame is longer than the preset maximum delay time, and the set frame update period is steady. If it is longer than the state frame update period, the set frame update period is corrected to the steady state frame update period. And wherein the door.

  Furthermore, in order to achieve the above object, the stereo video signal control program of the present invention is characterized by causing a computer to execute each step in the stereo video signal control method of the first invention.

  According to the present invention, the frame update period is made longer than that in the steady state in a frame with a large amount of parallax change in the stereo video signal, and the frame update period is made shorter than in the steady state in a frame with a small amount of parallax change. The amount of parallax change during viewing can be averaged, and the eye strain and discomfort of the observer can be reduced.

  In addition, according to the present invention, even in an environment where a single display is viewed by a large number of people in a living room or the like, a highly realistic stereo image can be provided to all observers.

1 is a block diagram of a first embodiment of a stereo video signal control apparatus of the present invention. FIG. It is a flowchart for operation | movement description of the apparatus of this invention shown in FIG. It is a figure explaining an example of operation | movement of the frame interpolation part of FIG. It is a figure explaining the other example of operation | movement of the frame interpolation part of FIG. It is a timing chart explaining an example of the relationship between the input video frame and display video frame of a steady state. It is a flowchart explaining an example of the determination method of the frame update period FT of the apparatus of this invention shown in FIG. It is a figure which shows an example of the function regarding the frame update period FT. It is a figure which shows the example of determination of the frame update period FT of the apparatus of this invention shown in FIG. 2 is a timing chart for explaining the relationship between an input video frame and a display video frame by the apparatus of the present invention shown in FIG. It is a block diagram of 2nd Embodiment of the stereo video signal control apparatus of this invention. It is a flowchart explaining an example of the determination method of the frame update period FT of the apparatus of this invention shown in FIG. It is a timing chart explaining the relationship between the input video frame and display video frame of the apparatus of the present invention shown in FIG. It is a figure which shows the example of determination of the frame update period FT of the apparatus of this invention shown in FIG.

  Next, embodiments of the present invention will be described with reference to the drawings.

(First embodiment)
FIG. 1 shows a block diagram of a first embodiment of a stereo video signal control apparatus according to the present invention. As shown in the figure, the stereo video signal control apparatus 100 according to the first embodiment includes a character detection unit 101, a parallax amount measurement unit 102, a parallax change amount measurement unit 103, an output control unit 104, a frame memory 105, and a frame. The interpolation unit 106 is configured.

  The stereo video signal control apparatus 100 receives a right-eye video signal and a left-eye video signal in units of frames. For example, when the right-eye video signal and the left-eye video signal are interlaced signals, it is assumed that they are progressive in advance. The video display unit 150 displays the left-eye video signal and the right-eye video signal output from the frame interpolation unit 106 in a stereo video format using known binocular parallax, respectively.

  Next, the operation of the stereo video signal control apparatus 100 of the present embodiment will be described with reference to the flowchart of FIG.

  The right-eye video signal is supplied to the character detection unit 101, the parallax amount measurement unit 102, and the frame memory 105. On the other hand, the video signal for the left eye is supplied to the parallax amount measurement unit 102 and the frame memory 105 and is not supplied to the character detection unit 101. The supply destination of the right-eye video signal and the left-eye video signal may be reversed.

  The character detection unit 101 detects the presence or absence of characters in the frame by obtaining a histogram in block units for the luminance level of a predetermined area set in advance in the input right-eye video signal (step S11). The character detection unit 101 detects that there is a character when the above histogram is larger than a predetermined threshold in a certain block compared to the surrounding blocks. The character detection unit 101 supplies character output information L detected from a predetermined area in the frame to the output control unit 104. The predetermined area is generally an area where characters such as subtitles are frequently displayed, but may be an area of the entire screen.

  The parallax amount measuring unit 102 measures the parallax amount between the input right-eye video signal and left-eye video signal (step S12). The parallax amount measurement unit 102 calculates the parallax obtained for each block corresponding to both video signals out of each block when one screen area of the right-eye video signal and the left-eye video signal is divided into a plurality of rectangular blocks. With respect to the amount, the parallax amount measurement is performed using a predetermined value among the average value of the entire frame, the maximum value in the frame, the maximum value of the parallax amount of one or more attention points, and the like as the representative parallax amount P. The parallax amount measuring unit 102 supplies the measured representative parallax amount P to the parallax change amount measuring unit 103.

  Here, an example of a method for measuring the amount of parallax will be further described. As is well known, the parallax in the stereo video can be observed as a horizontal shift amount between the right-eye video signal and the left-eye video signal. Accordingly, the parallax is measured by block matching on the same horizontal line (epipolar line) as the horizontal position of the target pixel block, for example, in block units of 4 pixels in the horizontal direction and 4 pixels in the vertical direction.

  The parallax change amount measuring unit 103 obtains a parallax change amount λ that is a temporal change amount of parallax between frames of the representative parallax amount P input from the parallax amount measuring unit 102 (step S13). Here, the parallax change amount measuring unit 103 calculates the parallax change amount λ (i) at time i from the representative parallax amount P (i) at time i and the representative parallax amount P (i−1) at time i−1. Calculated as follows:

λ (i) = P (i) − P (i-1) (1)
The parallax change amount measuring unit 103 supplies the obtained parallax change amount λ to the output control unit 104.

  In the output control unit 104, the display video frame rate PFR of the video display unit 150, the input video frame rate IFR of the input video signal, and the frame update period magnification β are set from the terminal 110. The output control unit 104 receives the input video frame rate IFR, the display video frame rate PFR, and the frame update period magnification β, the character presence / absence information L input from the character detection unit 101, and the parallax change amount measurement unit 103. The frame update period FT is determined in accordance with the parallax change amount λ (step S14). Here, the frame update period FT is output from the stereo video signal control device 100 to the video display unit 150 in the frames originally included in the right-eye video signal and the left-eye video signal input to the stereo video signal control device 100. The frame interval in each signal is shown. The output control unit 104 supplies the frame interpolation unit 106 with the frame update period FT. The detailed operation of the output control unit 104 will be described later.

  The frame memory 105 temporarily stores the input right-eye video signal and the left-eye video signal for one frame each, and if the frame interpolation unit 106 has a space, the right-eye video signal and the left-eye video signal for one frame. Are supplied to the frame interpolation unit 106. The frame memory 105 holds the right-eye video signal and the left-eye video signal in units of frames until the frame interpolation unit 106 has no space, and the frame interpolation unit 106 has time if the frame interpolation unit 106 has space. In other words, the right-eye video signal and the left-eye video signal of the old frame are supplied to the frame interpolation unit 106.

  The frame interpolation unit 106 stores up to two frames each of the right-eye video signal and the left-eye video signal input from the frame memory 105, and the right-eye video signal according to the frame update period FT from the output control unit 104. And each frame of the left-eye video signal is output. Each frame of the right-eye video signal and the left-eye video signal after output in the frame interpolation unit 106 is deleted after the frame update period FT has elapsed. If there is a display time during the frame update period FT, the frame interpolation unit 106 generates and outputs interpolation frames for the right-eye video signal and the left-eye video signal (step S15). Thus, the frame interpolation unit 106 converts the stereo video signal composed of the right-eye video signal and the left-eye video signal, or the stereo video signal composed of the interpolated frames into a frame unit in a predetermined display frame period (predetermined display frame rate). Output to.

  Here, an example of an interpolation frame generation method by the frame interpolation unit 106 will be described with reference to FIGS. 3 and 4. FIG. 3 is a diagram for explaining an interpolation method. When generating an interpolated frame by an interpolation method, the frame interpolating unit 106 first divides the input video frame F (k) into block units of, for example, 4 pixels in the horizontal direction and 4 pixels in the vertical direction, and references A motion vector MVF (k) as shown in FIG. 3A is obtained by a general block matching method for each block with a frame as an input video frame F (k−1).

  Now, the frame period of the input video frames F (k−1) and F (k) is “4”, and the frame period of the input video frame F (k−1) and the interpolation frame G (k) is “1”. Then, the frame interpolation unit 106 obtains a motion vector MVG (k) of the interpolation frame G (k) by the following equation, and generates an interpolation frame G (k) by motion compensation prediction.

MVG (k) = MVF (k) × 1/4 (2)
FIG. 3B shows the relationship between the motion vector MVG (k) and the motion vector MVF (k) of the interpolation frame G (k).

  The frame interpolation unit 106 similarly obtains the motion vectors MVG (k + 1) and MVG (k + 2) of each of the interpolation frames G (k + 1) and G (k + 2) by the following equation.

MVG (k + 1) = MVF (k) × 2/4 (3)
MVG (k + 2) = MVF (k) × 3/4 (4)
FIG. 4 is a diagram for explaining an extrapolating interpolation method. When generating an interpolation frame by an extrapolation method, the frame interpolation unit 106 first divides the input video frame F (k) into block units of, for example, 4 pixels in the horizontal direction and 4 pixels in the vertical direction, A motion vector MVF (k) as shown in FIG. 4A is obtained by a general block matching method for each block with a frame as an input video frame F (k−1).

  Now, the frame period of the input video frames F (k−1) and F (k) is “1”, and the frame period of the input video frame F (k−1) and the interpolation frame G (k) is “2”. Then, the frame interpolation unit 106 obtains a motion vector MVG (k) of the interpolation frame G (k) by the following equation, and generates an interpolation frame G (k) by motion compensation prediction.

MVG (k) = MVF (k) × 2 (5)
FIG. 4B shows the relationship between the motion vector MVG (k) and the motion vector MVF (k) of the interpolation frame G (k).

  The frame interpolation unit 106 similarly obtains the motion vectors MVG (k + 1) and MVG (k + 2) of each of the interpolation frames G (k + 1) and G (k + 2) by the following equation.

MVG (k + 1) = MVF (k) × 3 (6)
MVG (k + 2) = MVF (k) × 4 (7)
Hereinafter, unless otherwise specified in the present embodiment, a case where an interpolation method is used will be described. A detailed operation of the output control of the frame interpolation unit 106 will be described later.

  The video display unit 150 displays each frame of the right-eye video signal and the left-eye video signal input from the frame interpolation unit 106 in a stereo video system using a known binocular parallax (step S16).

  Next, each part of the present embodiment will be described in detail.

  First, the relationship between the display video frame rate PFR and the input video frame rate IFR will be described. The display video frame rate PFR is a display video frame rate of the video display unit 150. The input video frame rate IFR is a frame rate of a progressive stereo video signal (right-eye video signal and left-eye video signal) input to the stereo video signal control apparatus 100. The input video frame rate IFR is a rate corresponding to the original steady state frame update period of the right-eye video signal and the left-eye video signal input to the stereo video signal control apparatus 100.

  When the ratio of the display video frame rate PFR and the input video frame rate IFR is a double rate α, the following relationship is established.

α = PFR / IFR (PFR ≧ IFR) (8)
In the present embodiment, the input video frame rate IFR is set to 60 (frames / second), and the display video frame rate PFR is set to 120 (frames / second). Therefore, the double speed rate α of the present embodiment is “2” from the equation (8). However, the display video frame rate PFR and the input video frame rate IFR are not limited to the above example.

  Next, the relationship between the input video frame and the display video frame in a steady state where the amount of parallax change does not change will be described with reference to FIG. 5A shows the display frame interval of the display video frame rate PFR, FIG. 5B shows the input video frame of the input video frame rate IFR, and FIG. 5C shows the state of the display video frame of the display video frame rate PFR. This is shown schematically. FIG. 5 shows the state of the right-eye video signal, but the same applies to the left-eye video signal.

  In the input video frame shown in FIG. 5B, the frame F (j) is input at the time t (i), the frame F (j + 1) is input at the time t (i + 2), and hereinafter the time t (i + n). ) Shows a state in which a frame F (j + n / 2) is input (n = 0, 1, 2, 3,...).

  In the display video frame shown in FIG. 5C, the frame F (j) is displayed at the time t (i + 1), the interpolation frame G (j) is displayed at the time t (i + 2), and the time t (i + 3). The frame F (j + 1) is displayed at time t, the interpolation frame G (j + 1) is displayed at time t (i + 4), and the state of frames that are sequentially displayed is shown below.

  Here, the interpolated frame G (j) is interpolated from the frame F (j) and the frame F (j + 1), and the interpolated frame G (j + 1) is similarly converted into the frame F (j + 1) and the frame F (j + 2). Is interpolated from Note that a delay occurs because the interpolation frame is generated, and the time for displaying the frame F (j) is time t (i + 1) as shown in FIG.

  Note that it is possible to eliminate the delay when the interpolation frame is generated extrapolated.

  Next, the operation of determining the frame update period FT in step S14 of the output control unit 104 will be described in detail.

  First, the output control unit 104 obtains the minimum value FTmin and the maximum value FTmax of the frame update period FT from the double speed rate α and the frame update period magnification β by the following equation.

FTmin = 1 (9)
FTmax = α × β (10)
The frame update period FT takes an integer value between FTmin and FTmax. In this embodiment, α = 2 from equation (8) and β = 2 from FIG. 5C, so FTmax = 4 from equation (10).

  The frame update period magnification β is a parameter for adjusting the maximum value FTmax of the frame update period. By increasing the frame update period magnification β, the maximum value FTmax of the frame update period is increased, and the frame display speed can be adjusted more slowly and easily.

  Next, the output control unit 104 determines the frame update period FT from the character presence / absence information L and the parallax change amount λ in units of frames, and supplies the determined frame update period FT to the frame interpolation unit 106.

  A method for determining the frame update period FT will be described with reference to the flowchart shown in FIG. The output control unit 104 first checks whether or not the character presence / absence information L is YES (characters are present) (step S21).

  If the character presence / absence information L is YES, the frame update period FT is set to the same value as the double speed rate α (step S22). As a result, for an input video frame in which a telop flows, the frame display period can be set to a steady state.

  When the character presence / absence information L is NO (no character), the output control unit 104 obtains the frame update period FT by the following equation (step S23).

FT = f (λ) (11)
Here, in Equation (11), f (λ) is a provisional frame period, and is a natural number unit from FTmin (here 1) to FTmax (here 4) in proportion to the parallax change amount λ as shown in FIG. And FT = α (here, 2) is a function having the characteristic that is most easily selected.

  Next, the operation of the frame interpolation unit 106 will be described in detail with reference to FIGS. FIG. 8 is a diagram showing an example of determining the frame update period FT, and FIG. 9 is a timing chart for explaining the relationship between the input video frame and the display video frame by the stereo video signal control apparatus 100 of the present embodiment.

  For example, assume that the output control unit 104 determines the frame update period FT of each input video frame from F (0) to F (7) as shown in FIG. At this time, the frame interpolation unit 106 outputs the input video frame so that the video frame is displayed as schematically shown in FIG. That is, the frame interpolation unit 106 first outputs the input video frame F (0) at time t0 schematically shown in FIG. 9B at time t1 as schematically shown in FIG. 9C. Subsequently, since the frame update period FT of F (0) is “4” for the input video frame F (1) at time t2 schematically shown in FIG. As schematically shown in c), the data is output at time t5, which is four frames after the output time t1 of F (0). For the times t2, t3, and t4 between the time t1 and the time t5, the frame interpolation unit 106 performs interpolation frames G (0), G (1) as schematically shown in FIG. 9C. , G (2) is generated and output.

  In the subsequent input video frame F (2), the frame update period FT of F (1) is “3” as shown in FIG. 8, so that the frame interpolation unit 106 is schematically shown in FIG. 9C. In addition, the input video frame F (2) is output at time t8, which is three frames after the output time t5 of the immediately preceding video frame F (1). For times t6 and t7 between time t5 and time t8, the frame interpolation unit 106 generates interpolation frames G (3) and G (4) as schematically shown in FIG. 9C. And output. The frame interpolation unit 106 performs the same operation thereafter. The video display unit 150 displays the video frames of the right-eye video signal and the left-eye video signal that are input in synchronization with the timing schematically shown in FIG. 9C. Therefore, the time when the frame interpolation unit 106 outputs the input video frame or the interpolation frame to the video display unit 150 is equal to the display time.

  As described above, according to the stereo video signal control apparatus 100 of the present embodiment, the frame update period FT is set to the steady state (display video frame rate PFR) for input video frames in which the parallax change amount λ is larger than the double rate α. For the input video frame in which the parallax change amount λ is smaller than the double rate α, the parallax change amount can be averaged by making the frame update period FT shorter than the steady state. As a result, eyestrain and discomfort can be reduced.

  Further, according to the stereo video signal control apparatus 100 of the present embodiment, the high realistic sensation and eyes of the original stereo video are controlled by controlling the number of interpolation frames according to the delay time from the display time of the original input video. It is possible to achieve both reduced fatigue and discomfort. Further, since there is no need to adjust the sense of depth, there is no need to impair the sense of depth of the original stereo image, and no extra device for adjusting the sense of depth is required.

  Furthermore, according to the stereo video signal control apparatus 100 of the present embodiment, the present invention is not limited to an environment such as a head-mounted display that is viewed by individuals, but an environment where a single display is viewed by a large number of people in a living room or the like. However, it is possible to provide highly realistic stereo images for all observers.

(Second Embodiment)
Next, a second embodiment of the present invention will be described with reference to the drawings.

  FIG. 10 shows a block diagram of a second embodiment of the stereo video signal control apparatus according to the present invention. In the figure, the same components as those in FIG. In FIG. 10, the stereo video signal control apparatus 200 according to the second embodiment includes a character detection unit 101, a parallax amount measurement unit 102, a parallax change amount measurement unit 103, a frame memory 105, an output control unit 201, and a frame update period correction. Section 202 and frame interpolation section 106. The stereo video signal control apparatus 200 according to the present embodiment is provided with a frame update period correction unit 202 in addition to the configuration of the stereo video signal control apparatus 100 according to the first embodiment, and the output control unit 201 corrects the frame update period. The frame update period FT is supplied to the unit 202 and the corrected frame update period FT from the frame update period correction unit 202 is input.

  The frame update period correction unit 202 is set with a maximum delay time LTmax from the terminal 120. The frame update period correction unit 202 corrects the frame update period FT input from the output control unit 201 as necessary and supplies the corrected frame update period FT to the output control unit 201.

  Next, a method of correcting the frame update period FT by the frame update period correction unit 202 will be described in detail with reference to the flowchart of FIG. In FIG. 11, the processing operation of the output control unit 201 in steps S31, S32, and S33 is the same as the processing operation of the output control unit 104 in steps S21, S22, and S23 of the first embodiment shown in FIG. Therefore, the description is omitted.

  When the frame update period FT determined in step S32 or S33 is input from the output control unit 201, the frame update period correction unit 202 calculates the following from the frame update period FT and the steady state frame update period FTO according to the following equation. A frame delay time NLT is calculated (step S34). In the following equation, LT is the delay time of the input video frame, and the initial value is “0”. The steady-state frame update period FTO is equal to the double speed rate α.

NLT = LT + (FT-FTO) (12)
Next, the frame update period correction unit 202 compares whether the calculated delay time NLT of the next frame is longer than the maximum delay time LTmax input from the terminal 120 (step S35). When the delay time NLT of the next frame is longer than the maximum delay time LTmax, the frame update period correction unit 202 compares whether or not the frame update period FT is greater than the double speed rate α (step 36). Then, if the frame update period FT is larger than the double speed rate α, the frame update period correction unit 202 corrects the frame update period FT to the same value as the double speed rate α (step S37).

  In other cases, that is, when the delay time NLT of the next frame is less than or equal to the maximum delay time LTmax (NO in step S35), or when the frame update period FT is less than or equal to the double speed rate α (NO in step S36), The update period correction unit 202 does not correct the frame update period FT. Finally, the frame update period correction unit 202 calculates the delay time LT from the frame update period FT and the steady state frame update period FTO by the following equation (step S38).

LT = LT + (FT-FTO) (13)
In this way, the delay time LT calculated by the frame update period correction unit 202 is supplied to the output control unit 201 in FIG.

  Next, a specific example of the correction of the frame update period FT will be described in detail with reference to FIGS. 12A and 12B are timing charts for explaining the correction operation in the frame update period FT. FIG. 12A is a display frame interval, FIG. 12B is an input video frame, and FIG. 12C is a steady-state display video frame. FIG. 4D schematically shows a display video frame according to the first embodiment (Embodiment 1), and FIG. 4E schematically shows a display video frame according to the present embodiment. FIG. 13 shows changes in values of input video frames in the delay time LT, the frame update period FT before correction, the delay time NLT of the next frame, and the frame update period FT after correction.

  First, the delay time of the display video frame in the first embodiment will be described. Assume that the output control unit 104 shown in FIG. 1 determines the frame update period FT of each input video frame as shown in the frame update period FT before correction in FIG. In the first embodiment, since the frame update period FT determined by the output control unit 104 is used as it is, each display video frame is as shown in FIG.

  Accordingly, the delay time LT of the display video frame with respect to the display video frame in the steady state at this time is the delay time LT (0) of the display video frame F (0) as shown in FIGS. The delay time LT (1) of the 0 frame, the display video frame F (1) is 2 frames, the delay time LT (2) of the display video frame F (2) is 4 frames, and the delay time LT of the display video frame F (3) (3) is 6 frames, and the delay time LT (4) of the display video frame F (4) is 7 frames.

  Next, the display video frame delay time in this embodiment will be described. Assume that the output control unit 201 shown in FIG. 10 determines the frame update period FT of each input video frame as shown in the frame update period FT before correction in FIG.

  As described above, the stereo video signal control apparatus 200 according to the present embodiment does not use the determined frame update period FT as it is, but calculates the update period NLT of the next frame using the FT according to the equation (12). The update period NLT of the next frame is compared with the maximum delay time LTmax. If NLT is longer than LTmax and FT is larger than α, the frame update period FT is corrected to the same value as the double speed rate α. Therefore, when the maximum delay time LTmax is 4 frames and the double speed rate α is “2” as in the first embodiment, the frame update period FT is as shown by “FT after correction” in FIG. The display video frames F (2) and F (3) in which the update period NLT of the next frame exceeds the maximum delay time LTmax are corrected to “2 frames”.

  Therefore, according to the stereo video signal control apparatus 200 of the present embodiment, each display video frame is as shown in FIG. The delay time LT of the display video frame with respect to the display video frame in the steady state at this time is 0 frame, as shown in FIGS. 12C and 12E, the delay time LT (0) of the display video frame F (0) is 0 frame. The delay time LT (1) of the display video frame F (1) is 2 frames, the delay time LT (2) of the display video frame F (2) is 4 frames, and the delay time LT (3 of the display video frame F (3) ) Is 4 frames, and the delay time LT (4) of the display video frame F (4) is 4 frames.

  Thus, according to the present embodiment, when a scene with a large amount of parallax change continues by setting the maximum delay time LTmax, in the first embodiment, LT (3) and LT (4) are In contrast to display delays such as 6 frames and 7 frames, LT (3) and LT (4) are limited to 4 frames of the maximum delay time LTmax, respectively, and the display delay increases without limit. Can be prevented. In addition, this embodiment can obtain the same effects as those of the first embodiment. That is, the present embodiment also controls the frame update period FT according to the parallax variation amount so as to average the parallax variation amount, thereby reducing eye strain and discomfort, Even in an environment where a single display is viewed by a large number of people, it is possible to provide high-quality stereo images to all observers.

  Note that the present invention is not limited to the above-described embodiment, and includes a stereo video display program that causes a computer to execute the configuration and operation of the above-described embodiment. This stereo video display program may be read into a computer from a recording medium, may be distributed via a network and may be taken into the computer, or may be incorporated into the computer as firmware.

100, 200 Stereo video signal control device 101 Character detection unit 102 Parallax amount measurement unit 103 Parallax change measurement unit 104, 201 Output control unit 105 Frame memory 106 Frame interpolation unit 110, 120 Terminal 150 Video display unit 202 Frame update period correction unit

Claims (7)

A first step of measuring, for each frame, a parallax amount between a right-eye video signal and a left-eye video signal included in an input stereo video signal;
A second step of measuring a parallax change amount that is a temporal change amount of parallax between frames of the parallax amount measured in the first step;
As the amount of parallax change measured in the second step is larger, the frame update period of the right-eye video signal and the left-eye video signal included in the input stereo video signal is a steady-state frame at the time of input. The frame update period of the right-eye video signal and the left-eye video signal becomes longer in the range up to the maximum value set longer than the update period, and the frame update period of the steady-state frame update period decreases as the parallax change amount decreases. A third step of determining a frame update period so as to be shorter within a range up to the predetermined display frame period set as a shorter minimum value;
The right-eye video signal and the left-eye so that the frame update period of the right-eye video signal and the left-eye video signal included in the input stereo video signal is the frame update period determined in the third step. Adjusting the adjustment time for the video signal for each frame, and for the frame update period longer than the predetermined display frame period in the video signal for the right eye and the video signal for the left eye whose frame update period is controlled. And a fourth step of inserting an interpolated frame generated for each of the video signal and the left-eye video signal to make the stereo video signal a signal of the predetermined display frame period. Video signal control method. A fifth step of detecting whether or not character information is included in video information of a preset screen area of the input right-eye video signal and the left-eye video signal;
In the fourth step, the frame update period is the steady-state frame update period for the right-eye video signal and the left-eye video signal that are detected to include character information in the fifth step. The adjustment time is controlled so that the character information is not included in the fifth step. For the right-eye video signal and the left-eye video signal detected in the fifth step, the preset minimum value 2. The stereo video signal control method according to claim 1, wherein the adjustment time is controlled in units of frames so that the frame update period is set in accordance with the amount of parallax change within a range from a maximum value to a maximum value. In the fourth step, for the frame for which the frame update period is to be set, the frame update period set according to the parallax change amount and the set frame update period so as to obtain the set frame update period. From the adjustment time given to the video signal and the left-eye video signal and the frame update period in the steady state, the case where the entire frame update period in the frame next to the frame to be set is in the steady state A delay time is calculated, and when the delay time of the next frame is longer than a preset maximum delay time and the set frame update period is longer than the steady-state frame update period, the setting is performed. 3. The frame update period according to claim 1, wherein the frame update period is corrected to the steady-state frame update period. Leo the video signal control method.
Leo video signal control method. Parallax amount measuring means for measuring the amount of parallax between the right-eye video signal and the left-eye video signal included in the input stereo video signal for each frame;
A parallax change amount measuring unit that measures a parallax change amount that is a temporal change amount of parallax between frames of the parallax amount input from the parallax amount measuring unit;
An interpolation frame generated for each of the input right-eye video signal and the left-eye video signal is inserted into each of the input right-eye video signal and the left-eye video signal, and a frame period is set to a predetermined value. Frame interpolation means for outputting a stereo video signal having a display frame period;
The larger the parallax change amount measured by the parallax change amount measuring means, the more the frame update period of the right-eye video signal and the left-eye video signal included in the input stereo video signal is in the steady state at the time of input. The frame update period of the right-eye video signal and the left-eye video signal becomes longer in the steady state frame update as the parallax change amount becomes longer as it becomes longer than the set maximum value longer than the frame update period. The frame interpolation means controls the adjustment time for the right-eye video signal and the left-eye video signal in units of frames so as to be shorter within the range up to the predetermined display frame period set as the minimum value shorter than the period. And the predetermined display frame in the video signal for the right eye and the video signal for the left eye whose frame update period is controlled. Output control means for controlling the frame interpolation means so that the interpolated frame is inserted in a frame update period longer than the interval, and the stereo video signal is output as a signal of the predetermined display frame period. Stereo video signal control device characterized by the above. Further comprising character detection means for detecting whether or not character information is included in video information of a preset screen area of the input video signal for the right eye and the video signal for the left eye.
The output control means has the frame update period as the steady-state frame update period for the right-eye video signal and the left-eye video signal detected by the character detection means to include character information. As described above, the adjustment time by the frame interpolation means is controlled, and the right eye video signal and the left eye video signal detected by the character detection means to contain no character information are set in advance. 5. The adjustment time by the frame interpolation unit is controlled in units of frames so that the frame update period is set according to the amount of parallax change within a range from a minimum value to a maximum value. Stereo video signal control device.   The output control means includes the frame interpolation means so as to obtain the frame update period set according to the parallax change amount and the set frame update period in a frame that is a setting target of the frame update period. The adjustment time given to the right-eye video signal and the left-eye video signal and the steady-state frame update period, the entire frame update period in the next frame of the frame to be set is in the steady state. When the delay time for a certain case is calculated and the delay time of the next frame is longer than a preset maximum delay time and the set frame update period is longer than the steady-state frame update period The set frame update period is corrected to the steady-state frame update period. Motomeko 4 or 5 stereo video signal control apparatus according. On the computer,
A first step of measuring, for each frame, a parallax amount between a right-eye video signal and a left-eye video signal included in an input stereo video signal;
A second step of measuring a parallax change amount that is a temporal change amount of parallax between frames of the parallax amount measured in the first step;
As the amount of parallax change measured in the second step is larger, the frame update period of the right-eye video signal and the left-eye video signal included in the input stereo video signal is a steady-state frame at the time of input. The frame update period of the right-eye video signal and the left-eye video signal becomes longer in the range up to the maximum value set longer than the update period, and the frame update period of the steady-state frame update period decreases as the parallax change amount decreases. A third step of determining a frame update period so as to be shorter within a range up to the predetermined display frame period set as a shorter minimum value;
The right-eye video signal and the left-eye so that the frame update period of the right-eye video signal and the left-eye video signal included in the input stereo video signal is the frame update period determined in the third step. Adjusting the adjustment time for the video signal for each frame, and for the frame update period longer than the predetermined display frame period in the video signal for the right eye and the video signal for the left eye whose frame update period is controlled. Inserting an interpolation frame generated for each of the video signal and the left-eye video signal, and executing the fourth step of using the stereo video signal as a signal of the predetermined display frame period. Stereo video signal control program.

Images