JPH10150608A - User-side terminal of digital broadcasting system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To convert three-dimensional video information from, for example, a broadcasting station into a three-dimensional video signal with which a stereoscopic display device on a user terminal side produces an excellent stereoscopic effect by reproducing the video information from the broadcasting station of the digital broadcasting system according to control information for video reproduction from the broadcasting station. SOLUTION: The user-side terminal receives video data, audio and sound data, control data for stereoscopy effect adjustment, and data for sound image control from the broadcasting station and after digital demodulation, a demultiplexing circuit 13 separates stereoscopic video data, audio and sound data, control data for stereoscopic effect adjustment, and data for sound image control. The video data are decoded and sent to the stereoscopic display device 16 through a stereoscopic effect adjusting circuit 15. The circuit 15 adjusts the parallax between a left-eye video signal and right-eye video signal, pixel by pixel, according to the control data of stereoscopic effect adjustment. Further, the audio and sound data are decoded by an audio and sound decoder 17 and sent to left and right speakers 19 and 20 through a sound image control circuit 18.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] The present invention relates to a user terminal of a digital broadcasting system.

[0002]

2. Description of the Related Art In a digital television broadcasting system, various information can be provided to a user terminal in addition to video information and sound information. At present, in a digital television broadcasting system, in addition to video information and sound information, program guide information for allowing a viewer to select a program is provided to a user terminal.

[0003]

SUMMARY OF THE INVENTION An object of the present invention is to provide a user terminal of a digital broadcasting system for reproducing video information transmitted from a broadcast station based on video reproduction control information transmitted from the broadcast station. To provide.

Another object of the present invention is to provide a three-dimensional display device on a user terminal side for transmitting three-dimensional video information transmitted from a broadcast station based on video reproduction control information transmitted from a broadcast station. An object of the present invention is to provide a user terminal of a digital broadcasting system that can convert a three-dimensional video signal into a three-dimensional video signal that can provide a three-dimensional effect.

Another object of the present invention is to easily generate a three-dimensional video signal from two-dimensional video information transmitted from a broadcast station based on video reproduction control information transmitted from a broadcast station. It is an object of the present invention to provide a user terminal of a digital broadcasting system that can perform the above.

[0006]

According to the present invention, a user terminal of a digital broadcasting system transmits an image transmitted from a broadcasting station of the digital broadcasting system based on control information for video reproduction transmitted from the broadcasting station. It is characterized by comprising a reproducing means for reproducing information.

[0007] The video information sent from the broadcasting station is 3
In the case where the control information for video reproduction is information relating to the size of a three-dimensional display device capable of obtaining a suitable three-dimensional effect when the three-dimensional video information transmitted from the broadcast station is reproduced as it is, Means that the three-dimensional video information sent from the broadcasting station is transmitted to the user terminal based on the video reproduction control information and the information related to the size of the three-dimensional display device at the user terminal. A three-dimensional display device having a three-dimensional effect adjusting means for converting a three-dimensional image signal into a three-dimensional video signal that provides a suitable three-dimensional effect is used.

The three-dimensional effect adjusting means includes, for example,
A parallax amount detection unit that detects a parallax amount for each pixel of the three-dimensional video information sent from the broadcast station, and a parallax amount for each pixel detected by the parallax amount detection unit; By performing horizontal phase control on the three-dimensional video information transmitted from the broadcast station based on the information on the size of the three-dimensional display device on the user terminal side, the three-dimensional display device on the user terminal side The one provided with a horizontal phase control means for obtaining a three-dimensional video signal having a parallax amount capable of obtaining a suitable stereoscopic effect is used.

[0009] The video information sent from the broadcasting station is 2
When the control information for video reproduction is control information for two-dimensional / three-dimensional conversion for converting the two-dimensional video information transmitted from the broadcasting station into a three-dimensional video signal, As the reproducing means, a two-dimensional / three-dimensional video converting means for generating a three-dimensional video signal from the two-dimensional video information transmitted from the broadcasting station based on the two-dimensional / three-dimensional conversion control information is used. Can be

The two-dimensional / three-dimensional video conversion means includes, for example, a main video as a reference from the two-dimensional video information sent from the broadcasting station based on the two-dimensional / three-dimensional conversion control information. A video that generates a sub-video delayed from a main video, outputs one of the main video and the sub-video as a left-eye video, and outputs the other as a right-eye video. As the control information for two-dimensional / three-dimensional conversion, the control information includes delay amount information indicating a delay amount of the sub-picture with respect to the main picture for each predetermined number of fields, and the main information for each predetermined number of fields. Left-eye / right-eye selection information indicating which of the video and the sub-video is the left-eye video and which is the right-eye video is used.

[0011]

BEST MODE FOR CARRYING OUT THE INVENTION

An embodiment of the present invention will be described below with reference to the drawings.

[1] Description of Configuration of User Terminal in Digital Television Broadcasting System

FIG. 1 shows a configuration of a user terminal in a digital television broadcasting system. In this embodiment, video data, audio / sound data, control data for three-dimensional effect adjustment (control data for video reproduction), and data for sound image control (control data for sound reproduction) are transmitted from a broadcasting station. . Hereinafter, a case where three-dimensional video data including left-eye video data and right-eye video data is transmitted as video data will be described.

The user-side terminal includes a CPU 1 for controlling the entire user-side terminal. The CPU 1 includes a ROM 2 for storing the program and the like and a RAM 3 for storing necessary data. A signal from the remote controller 4 is input to the CPU 1.

A signal from the antenna 11 is input to the tuner 12. The tuner 12 performs processing such as frequency conversion and digital demodulation. The output of the tuner 12 is sent to the demultiplexing circuit 13. The demultiplexing circuit 13 converts the data sent from the tuner 12 into video data (3
Dimensional video data), audio / sound data, control data for stereoscopic effect adjustment, and data for sound image control.

The video data is sent to the video decoder 14 and decoded. The video signal (three-dimensional video signal) obtained by the video decoder 14 is converted
Is sent to the three-dimensional display device 16 via. The control data for three-dimensional effect adjustment separated by the demultiplexing circuit 13 is also sent to the three-dimensional effect adjustment circuit 15. Stereoscopic adjustment circuit 1
5 adjusts the parallax between the left-eye video signal and the right-eye video signal for each pixel based on the stereoscopic effect adjustment control data. The three-dimensional effect adjustment control data is, for example, data indicating the size of a three-dimensional display device that can provide a suitable three-dimensional effect even when a three-dimensional video signal is supplied as it is.

The voice / sound data is sent to the voice / sound decoder 17 and decoded. The sound signal obtained by the sound / sound decoder 17 is sent to the left speaker 19 and the right speaker 20 via the sound image control circuit 18. The sound image control circuit 18 is also supplied with the sound image control data separated by the demultiplexing circuit 13. Data (r, θ, ψ) representing the position of each sound source with respect to the viewer is used as the sound image control data. The sound image control circuit 18 controls the sound image based on the sound image control data.

[2] Description of the sound image control circuit 18

[0020] The sound image control circuit 18 is based on data (sound image control data) representing the position of the sound source with respect to the viewer.
By controlling the sound output from the left and right speakers 19 and 20,
The sound image is formed such that the sound source is located at the position indicated by the sound image control data. For example, if an image is provided in which a bird is singing and flying, based on sound image control data representing the position of the bird with respect to the viewer, the bird's singing can be heard from the position of the bird with respect to the viewer. , And controls the sound output from the left and right speakers 19 and 20.

FIG. 2 shows the configuration of the sound image control circuit 18.

The voice / sound signal obtained by the voice / sound decoder 17 includes a plurality of sound source signals (input si
gnal 1 to input signal n). For each sound source signal (input signal 1 to input signal n), the left channel filters F _{L1 to} F _Ln and the right channel filter F _R1
To F _Rn are provided one by one. As these filters, FIR filters are used, and their filter characteristics are determined by multiplication coefficients. Each sound source signal is sent to a corresponding set of a left channel filter and a right channel filter.

All the left-channel filters F _{L1 to} F _Ln
Are added by the adder 21. Adder 21
Is converted to an analog signal by the D / A converter 22, and then sent to the left speaker 19.

All the right channel filters F _{R1 to} F _Rn
Are added by the adder 23. Adder 23
Is converted to an analog signal by the D / A converter 24, and then sent to the right speaker 20.

The filter characteristic control section 25 determines the filter characteristic of each filter based on the sound image control data.

A method for determining the filter characteristics will be described.

As shown in FIG. 3, for example,
When a sound source O is disposed diagonally to the left rear and the sound output from the left and right speakers S _L and S _R disposed in front of the viewer 30 is actually input to both ears of the viewer 30, this input sound Is equivalent to the sound input from the sound source O to both ears of the viewer 30, the viewer 30 sounds as if the sound source is at the position of O.

The definition of each symbol in FIG. 3 is as follows. K _L, K _R: transmission from a sound source to the left and right each ear function H: transfer function E _L from the left and right speakers to the left and right of each ear, E _R: the sound is inputted to both ears of the viewer 30 signal T _L, T _R : Left and right FIR filters (F _L , F _R )
Filter characteristics

[0029] The transfer function H from the left and right speakers to the left and right each of the ears, the transfer function H _LL from the left speaker S _L to the left ear, the transfer function H _LR from the left speaker S _L to the right ear,
There is a right speaker S transfer function H _RR from the transfer function H _RL and right speakers S _R from the _R to the left ear to the right ear. The transfer function H _LL is a time response of a sound signal input to the left ear of the viewer 30 when a unit impulse is applied to the left speaker S _L at time t = 0. Transfer function H _LR ,
The same applies to H _RL and H _RR .

When the sound source signal S is output from the position of the sound source O, the sound signals E _L and E _R input to the left and right ears, respectively.
Is as shown in Expression 1.

[0031]

(Equation 1)

Further, the sound source signal S is converted into filter characteristics T _L , T
_When reproduced from the speakers S _L and S _R through the _R FIR filters (F _L and F _R ), the sound signals E _L and E _R input to the left and right ears are as shown in Expression 2.

[0033]

(Equation 2)

From the above equations (1) and (2), the filter characteristic T
_{When L} and T _R are obtained, the following Expression 3 is obtained.

[0035]

(Equation 3)

Filter characteristics satisfying the relational expression of equation (3)
FIR filter (F_L, F _R) By the sound source
By performing convolution operation on the signal, the sound source
A certain sound image is formed.

In this embodiment, the filter characteristics T for various sound source positions (r, θ, ψ) centered on the viewer.
_L, T _R has been required respectively, are stored as the filter characteristic table in ROM 2. Filter characteristic control section 25, data for sound image control for each sound source signal sent from the demultiplexing circuit 13 (r, θ, ψ) filter characteristics T _L corresponding to the T _R, the filter characteristic table in the ROM2 Each of them is read out and the filter characteristics of each of the FIR filters F _{L1 to} F _Ln and F _{R1 to} F _Rn are determined.

Therefore, when the signal after the convolution operation is performed is sent to the speakers 19 and 20, the sound source position represented by the sound image control data sent from the broadcasting station is output for each sound source. Then, a sound image having a sound source is formed.

In the above embodiment, the audio / sound data is sent from the broadcasting station. However, the FM sound source parameter may be sent from the broadcasting station, and the audio / sound signal may be generated based on this parameter. .

[3] Description of the stereoscopic effect adjusting circuit 15

The control data for adjusting the three-dimensional effect is data indicating the size of the three-dimensional display device which can provide a suitable three-dimensional effect even when the three-dimensional video signal is supplied as it is.

FIG. 4 shows the configuration of the stereoscopic effect adjusting circuit 15.

The three-dimensional effect adjusting circuit 15 includes a video decoder 14
-Eye video signal L and right-eye video signal R obtained from
And a parallax amount detection circuit 41 that detects the parallax amount of the left and right images for each pixel based on the parallax amount and the stereoscopic effect adjustment control data for each pixel detected by the parallax amount detection circuit 41. By performing horizontal phase control on the left-eye video signal L and the right-eye video signal R obtained from the decoder 14, the three-dimensional display device 1 of the user-side terminal
6, a horizontal phase control circuit 42 for generating a three-dimensional video signal from which a suitable stereoscopic image can be obtained.

FIG. 5 shows the configuration of the parallax amount detection circuit 41.

The luminance signal YL of the left-eye video signal from the video decoder 14 is input to the input terminal 50L. The left-eye video signal YL input to the input terminal 50L is sent to the correlation value calculation circuit 52 via the filter circuit 51L.

The filter circuit 51L includes a vertical interpolation circuit 6
1. A pair of horizontal LPFs 62 and 63 and a vertical LPF 64
It has. The left-eye video signal input to the input terminal 50L is added and averaged by the vertical interpolation circuit 61 with the data one horizontal scanning period ago to generate interpolation data. The vertical interpolation circuit 61 outputs both input data and interpolation data. Both of these data are stored in horizontal LPF6
2, 63, plus one vertical LPF
Filtered at 64. Thereby, a left-eye video signal (luminance signal) from which noise has been removed is obtained.

The luminance signal YR of the right-eye video signal from the video decoder 14 is input to the input terminal 50R. The right-eye video signal YR input to the input terminal 50R is sent to the correlation value calculation circuit 52 via the filter circuit 51R.
The configuration of the filter circuit 51R is the same as that of the filter circuit 51L.
And the description is omitted.

In the correlation value calculation circuit 52, as shown by the equation 4, the left-eye video signal of a pixel within the range of i = ± k in the horizontal direction around the pixel with respect to the right-eye video signal of each pixel. The absolute value (correlation value) of the difference from the above is calculated.

[0049]

(Equation 4)

In Equation 4, Rn is the luminance value of the right-eye video signal at pixel position n. L (n + i) is the luminance value of the left-eye video signal at the pixel position (n + i), where i is −
All integers from k to + k. Sni is a correlation value between the video signal for the right eye at the pixel position n and each video signal for the left eye at the pixel position (n + i).

As shown in FIG. 6, for example, the tip of the rocket 70L included in the image for the left eye and the tip of the rocket 70R included in the image for the right eye are on the same horizontal line. It is assumed that the tip exists at the pixel position “20” and the tip of the rocket 70R exists at the pixel position “12”. The distance (the number of pixels) between the tip of the rocket 70L and the tip of the rocket 70R is the amount of parallax.

The luminance value of the video signal for the right eye of the pixel where the tip of the rocket 70R is present is substantially equal to the luminance value of the video signal for the left eye of the pixel where the tip of the rocket 70L is present. The value is close to zero. Therefore, among the correlation values obtained for the right-eye video signal at the predetermined pixel position, i corresponding to the smallest value can be considered to be the parallax amount of the subject.

The minimum value detection circuit 53 detects, for each pixel, i corresponding to the minimum value among a plurality of correlation values obtained for the target pixel n as the amount of parallax for the target pixel n. The parallax table generation unit 55 basically calculates each pixel n
In each case, the parallax amount i detected by the minimum value detection circuit 53 is generated as a parallax table based on the right-eye image.

The average value calculation circuit 54 calculates, for each pixel, an average value of a plurality of correlation values obtained for the target pixel n. The reason why the average value calculation circuit 54 is provided will be described.

Even in the case of the left-eye image and the corresponding right-eye image, there is a case where there is a portion that exists in one but does not exist in the other. In such a portion, there is no corresponding pixel between the left-eye image and the right-eye image. For such a portion, when the i corresponding to the minimum value among the plurality of correlation values obtained for the pixel of interest n is detected as the amount of parallax for the pixel of interest n, an erroneous amount of parallax is detected. Become. Since the average value of the correlation values for such a portion becomes a relatively large value,
When the average value calculated by the average value calculation circuit 54 is larger than the predetermined value, the parallax amount for the pixel position n detected by the minimum value detection circuit 53 is canceled.

The parallax table generation unit 55 performs smoothing (securing continuity in the horizontal direction and removing noise) on the parallax table based on the right-eye image generated as described above, and FIG. Final parallax table S as shown
Generate _R (n).

The parallax table generation unit 55 also generates a parallax table S _R based on the finally generated right-eye image.
Based on (n), a parallax table S _L (n) based on the left-eye video as shown in FIG. 7 is generated. Note that the parallax table S _L (n) based on the left-eye video may be generated in the same manner as the parallax table S _R (n) based on the right-eye video.

FIG. 8 shows the horizontal phase control circuit 42.

The left-eye video signal obtained from the video decoder 14 includes a luminance signal YL, a color difference signal (RY) L, and a color difference signal (BY) L. Similarly, video decoder 1
4 includes a luminance signal YR, a color difference signal (RY) R, and a color difference signal (BY) R. FIG. 8 shows only a horizontal phase control portion for the luminance signal YL of the left-eye video signal and the luminance signal YR of the right-eye video signal, but the same horizontal phase control is performed for the other color difference signals.

The luminance signal YR-IN of the right-eye video signal obtained from the video decoder 14 is equal to an arbitrary pixel delay F for the right video.
It is sent to the IFO 202. The luminance signal YL-IN of the left-eye video signal obtained from the video decoder 14 is sent to the left-video arbitrary pixel delay FIFO 201. Each of the arbitrary pixel delay FIFOs 201 and 202 includes two line memories 201a, 201b, 202a and 202b to perform horizontal phase control in units smaller than one pixel.

A luminance signal YR of a right-eye video signal is input to a first line memory 202a and a second line memory 202b constituting the right video arbitrary pixel delay FIFO 202, respectively. Arbitrary pixel delay FIFO20 for left image
1, the first line memory 201a and the second line memory 201b have the luminance signal YL of the left-eye video signal.
Are each entered.

The read address counter 103 generates a read address for the first line memory 201a in the left video arbitrary pixel delay FIFO 201. The read address counter 104 generates a read address for the first line memory 202a in the right video arbitrary pixel delay FIFO 202.

The standard address generation circuit 102
O201, 202 each line memory 201a, 201
b, 202a, and 202b, and generates a reset signal H-Reset for each of the read address counters 103 and 104.

The parallax magnification calculating circuit 101 calculates the parallax magnification Z based on the following equation (5). In Equation 5, D
S1 is the display size of the three-dimensional display device 16 of the user terminal. DS2 is the display size indicated by the stereoscopic effect adjustment control data separated by the demultiplexing circuit 13.

[0065]

(Equation 5)

Here, the display size DS1 of the three-dimensional display device 16 of the user terminal is 32 inches,
The display size DS2 sent from the broadcasting station is 1
The case of 6 inches will be described. In this case,
The magnification Z is 0.5.

When the display size DS2 sent from the broadcasting station is 16 inches and the display size DS1 of the three-dimensional display device 16 of the user terminal is 32 inches, the three-dimensional video signal sent from the broadcasting station is used. Is displayed on the three-dimensional display device 16 as it is, there is a problem that the parallax amount becomes too large. Therefore, in this example, the parallax amount of the three-dimensional video signal sent from the broadcasting station is converted into a value multiplied by the magnification Z, that is, the parallax amount is reduced.

The parallax change table calculation circuit 111 calculates the parallax
Based on the left-eye image obtained by the amount detection circuit 41,
Parallax table S_LParallax change table based on (n)
Le S _L’(N). Parallax change table calculation circuit
113 is for the right eye obtained by the parallax amount detection circuit 41
Parallax table S based on video_RBased on (n)
Parallax change table S_R’(N).

The parallax change tables S _L '(n), S _R '
(N) is created based on the following equation (6). FIG. 7 shows a disparity change table S _R ′ (n) created based on the disparity table S _R (n) of FIG. 7 and a disparity change table created based on the disparity table S _L (n) of FIG. Table S
An example of _L ′ (n) is shown.

[0070]

(Equation 6)

The meaning of the parallax change table will be described with reference to the image of FIG. 6 as an example.

Rocket 70L included in left eye image
It is assumed that the amount of parallax between the tip of the rocket 70R and the tip of the rocket 70R included in the right-eye image is changed to よ う as indicated by the magnification Z. Since the amount of parallax between the tip of the rocket 70L and the tip of the rocket 70R is “8 pixels”, half thereof is “4 pixels”.

In order to make the amount of parallax between the tip of the rocket 70L and the tip of the rocket 70R "4 pixels", the image of the tip of the rocket 70R at the horizontal position "12" is moved to the right by two pixels, and the horizontal position is changed. Rocket 70 at "20"
What is necessary is to move the image at the tip of L two pixels to the left. That is, the image of the tip of the rocket 70R at the horizontal position “12” may be moved to the horizontal position “14”, and the image of the tip of the rocket 70L at the horizontal position “20” may be moved to the horizontal position “18”. .

When the pixel position of the image is moved, the pixel position before the image movement and the pixel position between the pixel position before the image movement and the pixel position after the image movement are calculated. In, the image at the pixel position before the movement of the image and the image at the pixel position adjacent to the left or right thereof may be interpolated to generate the image at the pixel position.

According to the above equation (6), when the image is moved to the right, the pixel position n of the image before the movement is placed in FIG.
In the example, data representing how many pixels the image should be moved to the right side at the pixel position "12" is obtained as a positive value. When the image is moved to the left, the pixel position {n + Z · S (n) / 2} after the image is moved is shown in FIG.
In the example of, data indicating how many pixels to move the video before moving to the left side at the pixel position “18” is obtained as a negative value. Note that the parallax change table value S ′ (n) for the pixel position for which the parallax change table value S ′ (n) is not calculated by Equation 6 is the previous and next parallax change table values S ′.
It is obtained by interpolating the value of (n).

The horizontal phase control amount calculation circuit 112 obtains a left-eye image for obtaining a parallax amount corresponding to the parallax magnification Z based on the parallax change table S _L ′ (n) obtained by the parallax change table calculation circuit 111. The horizontal phase control amount H _L (n) of each pixel is calculated. Horizontal phase control amount calculation circuit 114
Is based on the parallax change table S _R ′ (n) obtained by the parallax change table calculation circuit 113.
The horizontal phase control amount H _R (n) of each pixel of the image for the right eye for obtaining the amount of parallax according to is calculated.

The horizontal phase control amounts H _L (n) and H _R (n) of each pixel of the left-eye image and the right-eye image are created based on the following equation (7).

[0078]

(Equation 7)

FIG. 7 shows the parallax change table S _R ′ of FIG.
The horizontal phase control amount H _R (n) obtained based on (n) and the horizontal phase control amount H _L (n) obtained based on the parallax change table _SL ′ (n) of FIG. 7 are shown. I have.

In the horizontal phase control amount H _R (n), the integer part is a control value for controlling the read address of the first line memory 202a in the right image arbitrary pixel delay FIFO 202, and the decimal part is the interpolation coefficient. It is. The control value is sent to the read address counter 104, and the read address of the first line memory 202a is advanced by the control value.

In the horizontal phase control amount H _L (n), an integer part is a control value for controlling a read address of the first line memory 201a in the left video arbitrary pixel delay FIFO 201, and a decimal part is an interpolation coefficient. It is. The control value is sent to the read address counter 103, and the read address of the first line memory 201a is advanced by the control value.

Equation 7a indicates that the parallax change table value S ′ (n) at the target pixel position is equal to the parallax change table value S ′ (n−1) at the pixel position on the left of the target pixel position. Is the horizontal phase control amount H for the target pixel position.
(N) represents 1.0. When the horizontal phase control amount H (n) for the target pixel position is 1.0, the count value of the read address counter 103 or 104 is advanced by one.

B in Equation 7 indicates that if the parallax change table value S ′ (n) at the target pixel position is larger than the parallax change table value S ′ (n−1) at the pixel position on the left of the target pixel position, For example, the horizontal phase control amount H when the pixel position “12” of the parallax change table S _R ′ (n) in FIG.
4 shows a calculation formula of (n).

In this case, S '(n) -S' (n-
1) is required. The target pixel position is the parallax change table S
_If the pixel position of _R ′ (n) is “12”, S ′
(N) −S ′ (n−1) = 2.

Accordingly, the horizontal phase control amounts H (n) for the pixel positions “12”, “13”, and “14” corresponding to i = 0, 1, 2 are “1/3 = 0.
3 ”,“ 2/3 = 0.7 ”,“ 3/3 = 1.0 ”, and the horizontal phase control amount H (n) for the pixel position“ 15 ”corresponding to i = 3 is“ 3.0 ".

For example, in the table of the horizontal phase control amount H _R (n) for the right-eye image, the pixel position “12” is set.
The horizontal phase control amount H _R (n) for .about. "15" and the outline of the control performed in this embodiment will be described.

At the pixel position “12”, the horizontal phase control amount H_R
Since (n) is 0.3, the pixel position “1” of the original video
The image at 2 "and the image at pixel position" 13 "on the right are
An image interpolated at a ratio of 7: 3 is output. Pixel position
In the case of “13”, the horizontal phase control amount H _R(N) is 0.7
Therefore, the image at the pixel position “12” of the original image and its right neighbor
Of the pixel position “13” is interpolated at a ratio of 3: 7.
The output video is output.

At the pixel position “14”, the horizontal phase control amount H _R
Since (n) is 1.0, the pixel position “1” of the original video
Since the horizontal phase control amount H _R (n) is 3.0 at the pixel position “15”, the image at the pixel position “15” of the original image is output.

C in Equation 7 indicates that the parallax change table value S ′ (n) of the target pixel position is smaller than the parallax change table value S ′ (n−1) of the pixel position on the left of the target pixel position. For example, the horizontal phase control amount H when the pixel position “18” of the parallax change table S _L ′ (n) in FIG.
4 shows a calculation formula of (n).

In this case, S '(n-1) -S'
(N) is required. If the target pixel position is the pixel position “18” in the parallax change table S _L ′ (n), S ′
(N-1) -S '(n) = 2.

Therefore, the pixel position corresponding to i = 0 "
The horizontal phase control amount H (n) for 18 ″ is “3.” Further, the pixel position “1” corresponding to i = 1, 2, 3
Horizontal phase control amount H for 9 "," 20 "," 21 "
(N) are “1/3 = 0.3” and “2/3 =
0.7 "and" 3/3 = 1.0 ".

For example, in the table of the horizontal phase control amount H _L (n) for the left-eye image, the pixel position “18”
The horizontal phase control amount H _L (n) for .about. "21" and the outline of the control performed in this embodiment will be described.

At the pixel position “18”, the horizontal phase control amount H _R
Since (n) is 3.0, the pixel position “2” of the original video
Since the horizontal phase control amount H _R (n) is 0.3 at the pixel position “19”, the image at the pixel position “20” of the original image and the pixel position to the right thereof are output. An image obtained by interpolating the image “21” at a ratio of 7: 3 is output.

At the pixel position “20”, the horizontal phase control amount H_R
Since (n) is 0.7, the pixel position “2” of the original video
The image at 0 ”and the image at the pixel position“ 21 ”on the right are
An image interpolated at a ratio of 3: 7 is output. Pixel position
In the case of “21”, the horizontal phase control amount H _R(N) is 1.0
Therefore, the image at the pixel position “21” of the original image is output.
You.

The read address RADR output from the read address counter 104 is input to the first line memory 202a in the right video arbitrary pixel delay FIFO 202. Therefore, the YR signal is read from the address corresponding to the address RADR of the first line memory 202a. The read YR signal is input to the first right video multiplier 401.

The address value (RADR + 1) obtained by adding 1 to the read address RADR output from the read address counter 104 is equal to the arbitrary pixel delay F for the right image.
A read address is input to the second line memory 202b in the IFO 202. Therefore, the YR signal is read from the address corresponding to the address (RADR + 1) of the second line memory 202b. The read YR signal is input to the second right video multiplier 402.

Since the read address for the first line memory 202a and the read address for the second line memory 202b differ by one, the YR signal read from the first line memory 202a and the read address from the second line memory 202b are different. The read YR signal is a signal whose horizontal position is shifted by one.

Decimal part (interpolation coefficient) PRR of the horizontal phase control amount calculated by horizontal phase control amount calculation circuit 114
Is input to the second right image multiplier 402 as a second right image interpolation coefficient. A value (1-PRR) obtained by subtracting the interpolation coefficient PRR from 1 is input to the first right image multiplier 401 as a first right image interpolation coefficient.

Therefore, the first right video multiplier 401
Now, the YR read from the first line memory 202a
The signal is multiplied by a first right video interpolation factor (1-PRR). The second right video multiplier 402 multiplies the YR signal read from the second line memory 202b by a second right video interpolation coefficient PRR. Then, each multiplier 401,
The YR signal obtained by 402 is added by the adder 403, and then output as a right video Y signal YR-OUT. As a result, a Y signal for the right image for obtaining a parallax amount according to the parallax magnification Z is obtained.

The read address RADL output from the read address counter 103 is input to the first line memory 201a in the left video arbitrary pixel delay FIFO 201. Therefore, the YL signal is read from the address corresponding to the address RADL of the first line memory 201a. The read YL signal is input to the first left video multiplier 301.

The address value (RADL + 1) obtained by adding 1 to the read address RADL output from the read address counter 103 is equal to the left image arbitrary pixel delay F
The read address is input to the second line memory 201 b in the IFO 201. Therefore, the YL signal is read from the address corresponding to the address (RADL + 1) of the second line memory 201b. The read YL signal is input to the second left video multiplier 302.

Since the read address for the first line memory 201a and the read address for the second line memory 201b are different by one, the YL signal read from the first line memory 201a and the read address from the second line memory 201b are different. The read YL signal is a signal whose horizontal position is shifted by one.

Decimal part (interpolation coefficient) PRL of the horizontal phase control amount calculated by horizontal phase control amount calculation circuit 112
Is input to the second left video multiplier 302 as a second left video interpolation coefficient. The value (1-PRL) obtained by subtracting the interpolation coefficient PRL from 1 is input to the first left video multiplier 301 as a first left video interpolation coefficient.

Therefore, the first left video multiplier 301
Now, the YL read from the first line memory 201a
The signal is multiplied by a first left video interpolation factor (1-PRL). In the second left video multiplier 302, the YL signal read from the second line memory 201b is multiplied by a second left video interpolation coefficient PRL. Then, each multiplier 301,
The YL signal obtained by 302 is added by an adder 303, and then output as a left video Y signal YR-OUT. As a result, a left video Y signal for obtaining a parallax amount corresponding to the parallax magnification Z is obtained.

When the video information transmitted from the broadcasting station is two-dimensional video data, a two-dimensional / three-dimensional video signal for converting the two-dimensional video data transmitted from the broadcasting station into a three-dimensional video signal. The control data for conversion may be sent from the broadcast station as control data for video reproduction. In this case, the user terminal receives 2
A two-dimensional / three-dimensional video conversion means for generating a three-dimensional video signal from two-dimensional video data sent from a broadcasting station based on the three-dimensional / three-dimensional conversion control data is provided.

The two-dimensional / three-dimensional video conversion means is based on the two-dimensional / three-dimensional conversion control information sent from the broadcasting station, and serves as a reference from the two-dimensional video information sent from the broadcasting station. A video that generates a video and a sub-video delayed from the main video, outputs one of the main video and the sub-video as a left-eye video, and outputs the other as a right-eye video. For example, as the main video, a video obtained by directly reproducing the two-dimensional video information transmitted from the broadcasting station is used, and as the sub video, a video delayed by a field memory is used.

The two-dimensional / three-dimensional conversion control information includes, for example, delay amount information indicating a delay amount of a sub-picture with respect to a main picture in a predetermined field number unit (for example, one field unit) and a predetermined field number unit (for example, The left-eye / left-eye image indicates which of the main image and the sub-image is the left-eye image and which is the right-eye image for each field unit.
It consists of right eye selection information.

That is, the two-dimensional / three-dimensional video conversion means
Based on the delay amount information sent from the broadcasting station, a reference main image and a sub-image delayed with respect to the main image are generated from the two-dimensional image information sent from the broadcasting station. Also, based on the left-eye / right-eye selection information sent from the broadcasting station, one of the main video and the sub-video is output as a left-eye video, and the other is output as a right-eye video. With this configuration, it is possible to relatively easily generate a three-dimensional video signal from the two-dimensional video information transmitted from the broadcasting station.

[0109]

According to the present invention, a user terminal of a digital broadcasting system capable of reproducing video information transmitted from a broadcast station based on video reproduction control information transmitted from the broadcast station is obtained. Can be

Further, according to the present invention, based on the video reproduction control information sent from the broadcast station, the three-dimensional video information sent from the broadcast station is preferably used in the three-dimensional display device on the user terminal side. A user-side terminal of a digital broadcast system that can convert a three-dimensional video signal into a three-dimensional video signal that provides a three-dimensional effect is obtained.

Further, according to the present invention, it is possible to easily generate a three-dimensional video signal from two-dimensional video information transmitted from a broadcast station based on video reproduction control information transmitted from a broadcast station. A user terminal of the digital broadcasting system that can be obtained is obtained.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of a user terminal in a digital television broadcasting system.

FIG. 2 is a block diagram illustrating a configuration of a sound image control circuit.

FIG. 3 is a schematic diagram showing a state of a transfer characteristic to a speaker, a sound image, and a viewer.

FIG. 4 is a block diagram illustrating a configuration of a three-dimensional effect adjustment circuit.

FIG. 5 is a block diagram illustrating a configuration of a parallax amount detection circuit.

FIG. 6 is a schematic diagram showing an example of a three-dimensional video.

FIG. 7 is a schematic diagram illustrating a parallax table, a parallax change table, and a horizontal phase control amount table.

FIG. 8 is a block diagram illustrating a configuration of a horizontal phase control circuit.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 12 Tuner 13 Demultiplexing circuit 17 Audio / sound decoder 15 Three-dimensional impression adjustment circuit 16 Three-dimensional display device 41 Parallax amount detection circuit 42 Horizontal phase control circuit

Claims (5)

[Claims] 1. A user of a digital broadcasting system comprising a reproducing means for reproducing video information transmitted from a broadcasting station based on video reproducing control information transmitted from a broadcasting station of the digital broadcasting system. Terminal. 2. The video information transmitted from the broadcast station is three-dimensional video information, and the control information for video reproduction is suitable when the three-dimensional video information transmitted from the broadcast station is reproduced as it is. This is information on the size of the three-dimensional display device from which a three-dimensional effect can be obtained. The reproduction means is sent from the broadcasting station based on the video reproduction control information and the information on the size of the three-dimensional display device on the user side terminal. 2. The user of the digital broadcasting system according to claim 1, further comprising a three-dimensional effect adjusting means for converting the obtained three-dimensional image information into a three-dimensional image signal capable of obtaining a preferable three-dimensional effect on a three-dimensional display device at the user terminal. Side terminal. 3. The parallax adjustment means includes: a parallax amount detection unit configured to detect a parallax amount of each pixel of the three-dimensional video information transmitted from the broadcast station; and each pixel detected by the parallax amount detection unit. Based on the amount of parallax for each image, the control information for video reproduction, and information on the size of the three-dimensional display device on the user terminal side.
By performing horizontal phase control on 2D video information,
3. The user terminal of the digital broadcasting system according to claim 2, further comprising a horizontal phase control unit that obtains a three-dimensional video signal having a parallax amount capable of obtaining a suitable stereoscopic effect in the three-dimensional display device on the user terminal side. 4. The video information transmitted from the broadcasting station is two-dimensional video information, and the control information for video reproduction converts the two-dimensional video information transmitted from the broadcasting station into a three-dimensional video signal. 3D conversion control information, and the reproducing means converts the 2D video information sent from the broadcasting station into a 3D video signal based on the 2D / 3D conversion control information. 2. The user terminal of the digital broadcasting system according to claim 1, further comprising a two-dimensional / three-dimensional video converting means for generating. 5. The two-dimensional / three-dimensional video conversion means, based on the two-dimensional / three-dimensional conversion control information, determines a reference main video and a main video from two-dimensional video information sent from the broadcasting station. And generating a delayed sub-picture with respect to the picture, outputting one of the main picture and the sub-picture as a left-eye picture, and outputting the other as a right-eye picture. Control information for each predetermined number of fields, delay amount information indicating the amount of delay of the sub-image with respect to the main image, and for each predetermined number of fields, any of the main image and the sub-image for the left eye The digital broadcast system user-side terminal according to claim 4, further comprising left-eye / right-eye selection information indicating a video and a right-eye video.