JP2012253707A - Stereoscopic video display device and sound reproduction device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a stereoscopic video display device with a simple structure, which appropriately realizes stereoscopic viewing effect and acoustic effect even if a viewer moves out of an optimum point, and to provide a sound reproduction device.SOLUTION: The sound reproduction device includes: a sensor 4 for sensing a position of the viewer 15; a human detection controller 6 for generating control data on the basis of position information of the detected viewer 15; a three-dimensional depth adjusting circuit 8 as a correcting section for correcting a three-dimensional depth parameter used for regulating depth feeling in a video on the basis of the control data when a three-dimensional parallax image is generated from inputted video data; and a display 2 as a video output section for outputting the video on the basis of the video data in which the three-dimensional depth parameter is corrected in the three-dimensional depth adjusting circuit 8.

Description

  The present invention relates to a stereoscopic video display device and an audio playback device, and more particularly to a stereoscopic video display device having a video stereoscopic effect correction function and an audio playback device having a sound field correction function.

  A stereoscopic video display device is a device capable of stereoscopically viewing a video to be displayed, and a viewer views the video displayed on the device in a predetermined location so that the video is stereoscopically viewed. Can watch. In this case, the stereoscopic effect differs depending on the distance and angle from the apparatus, and there exists a distance and angle (optimum point of the stereoscopic effect) at which the effect is optimal.

  On the other hand, an audio playback device is a device that allows a viewer to view a sound with a sense of presence, and the viewer listens to the sound output from the device at a predetermined location, and the sound is reproduced. It can be heard as a realistic sound. At this time, there is an optimum point of the acoustic effect that can effectively provide the realistic sensation due to the distance and angle from the apparatus and the influence of the sound field formed in the listening room.

  In the stereoscopic video display device and the audio reproduction device, if the viewer views the video and audio at a position deviating from the optimum point, the effects may not be fully exhibited.

  As an improvement measure, the stereoscopic image display device is corrected by using a video controller and a spatial light modulator so that an optimal stereoscopic effect can be obtained by following the viewer even when the viewer moves. Is disclosed (for example, see Patent Document 1).

  The audio playback device has a transmitting element on the viewer side and a receiving element on the device side, and the viewer moves by adjusting the equalizer of the audio playback device by calculating and processing both data. However, what maintains the optimal point of the acoustic effect is disclosed (for example, see Patent Document 2).

JP-A-9-149433 JP 2003-32799 A

  In the conventional viewer-following type stereoscopic video display device, the signal from the video controller is optically corrected by the spatial light modulator, so there is a problem that the device becomes large and expensive to realize. .

  Further, in a conventional audio reproduction device having a sound field adjustment function, a viewer moves with a transmission element that generates ultrasonic waves, and it is necessary to always carry the transmission element. Further, there has been a problem that the ultrasonic transmission cable has to connect elements (transmitting element and receiving element) between the audio reproduction device and the viewer.

  The present invention has been made to solve the above-described problems, and can easily realize a stereoscopic effect and a sound effect even when the viewer moves outside the optimum point. It is an object of the present invention to provide a stereoscopic video display device and an audio playback device having a configuration.

  A stereoscopic image display apparatus according to the present invention includes a sensor that detects the position of a viewer, a controller that generates control data based on the position information of the viewer detected by the sensor, and a three-dimensional view from input video data. When generating a parallax image, a correction unit that corrects a three-dimensional depth parameter used to define a sense of depth in a video based on the control data, and the correction unit that has corrected the three-dimensional depth parameter And a video output unit that outputs video based on the video data.

  In addition, an audio reproduction device according to the present invention includes a sensor that detects the position of a viewer, a controller that generates control data based on the position information of the viewer sensed by the sensor, and input audio data. Then, when the beam sound is generated from the speaker array that outputs the beam sound and the sound data, the sound directivity parameter used for defining the directivity of the beam sound is corrected based on the control data. The speaker array outputs the beam sound based on the sound data in which the directivity parameter of the sound is corrected.

  According to the stereoscopic video display apparatus according to the present invention, a sensor that detects the position of the viewer, a controller that generates control data based on the position information of the viewer detected by the sensor, and the input video data When generating a three-dimensional parallax image, a correction unit that corrects a three-dimensional depth parameter used for defining a sense of depth in a video based on the control data, and the correction unit corrects the three-dimensional depth parameter. In addition, by providing a video output unit that outputs video based on the video data, a stereoscopic effect can be appropriately realized even if the viewer moves outside the optimum point.

  In addition, according to the audio reproduction device of the present invention, a sensor that detects the position of the viewer, a controller that generates control data based on the position information of the viewer detected by the sensor, and the input audio data Based on the control data, a speaker array that outputs a beam sound, and a sound directivity parameter used to define the directivity of the beam sound when generating the beam sound from the sound data is based on the control data. The speaker array outputs the beam sound based on the sound data in which the sound directivity parameter is corrected, so that the viewer moves out of the optimum point. However, the acoustic effect can be appropriately realized.

1 is a configuration diagram of a stereoscopic video display apparatus according to Embodiment 1; 3 is a configuration diagram of a stereoscopic video display apparatus according to Embodiment 2. FIG.

<Embodiment 1>
FIG. 1 is a configuration diagram of a stereoscopic video display apparatus according to the present invention. In FIG. 1, the stereoscopic video display apparatus 1 includes a function as an audio reproduction apparatus. Even when the function as the audio reproduction device is not included, the function as the stereoscopic video display device can be realized.

  First, the stereoscopic video display device will be described. The stereoscopic video display device 1 receives an input signal input from an input terminal 13 (antenna in the figure) at a video and audio data processing circuit 14. In the first embodiment, the video and audio data processing circuit 14 is capable of separating and extracting video data and audio data related to video from the input signal, and further performing noise removal and correction processing. Although shown, only video data may be processed. Here, the processing path related to the video data is indicated by a solid line, and the processing path related to the audio data is indicated by a broken line. Note that when only the audio data is processed, it functions as a configuration of an audio reproduction device to be described later.

  Video data processed by the video and audio data processing circuit 14 is input to a three-dimensional DSP (Digital Signal Processor) 7.

  On the other hand, the stereoscopic video display device 1 includes a sensor 4 that can sense the position of a person (viewer), for example, in the vicinity of a display 2 that displays video. The sensor 4 is preferably a wireless sensor such as an infrared sensor, and the distance and direction of an area (sensing area) sensed by the tracking system 5 is controlled.

  The follow-up system 5 controls the operation of the sensor 4 so as to make the sensed viewer 15 follow, and further receives a human signal relating to the position of the person sensed by the sensor 4. Then, the human motion signal is output to the human motion controller 6. Even if the tracking system 5 is not provided, it is only necessary to have the sensor 4 that can sense the position of a person in the sensing area.

  The human motion controller 6 as a controller analyzes the human motion signal, and based on information such as the number of people present in the sensing area, the distance to the existing location, and the direction (angle), control including such information is performed. Calculate the data. Then, the calculated control data is output to the three-dimensional DSP 7 for feedback.

  The three-dimensional DSP 7 includes therein a three-dimensional depth adjustment circuit 8 as a correction unit. In the three-dimensional depth adjustment circuit 8, the video data input from the video and audio data processing circuit 14 is corrected based on the control data input from the human controller 6.

  The video data is processed by the 3D DSP 7 to become 3D parallax image data. When generating a 3D parallax image from the video data, the 3D depth is a parameter used to define a sense of depth in the video. The parameter is a processing target in the present embodiment. In the three-dimensional depth adjustment circuit 8, in particular, this three-dimensional depth parameter is adjusted. In accordance with the control data, the three-dimensional depth parameter is adjusted so that the optimal point of the stereoscopic effect corresponds to the position where the viewer 15 has moved or the position where the viewer 15 currently exists.

  For example, in the case of an active shutter-type stereoscopic image display device using three-dimensional glasses, a combination of three-dimensional parallax images switched between the left and right of the glasses is adjusted by adjusting the three-dimensional depth parameter.

  The video data in which the three-dimensional depth parameter is adjusted is input to the display driving circuit 9.

  The display drive circuit 9 displays a video on the display 2 as a video display unit based on the input video data. Since the video is displayed based on the video data in which the three-dimensional depth parameter is adjusted, the video is a stereoscopic video considering the position of the viewer 15 and the like.

  Next, an audio playback device will be described. As shown in the figure, the audio playback device may be a device for playing back audio corresponding to a 3D video as a part of the 3D video display device, or may function as an audio playback device alone. Good.

  As shown in FIG. 1, the video and audio data processing circuit 14 receives an input signal input from the input terminal 13.

  The audio data processed and extracted by the video and audio data processing circuit 14 is input to the audio DSP 10.

  On the other hand, the tracking system 5 controls the operation of the sensor 4 as described above, and further receives a human signal relating to the position of the person sensed by the sensor 4. Then, the human motion signal is output to the human motion controller 6.

  The motion controller 6 analyzes the motion signal, and calculates control data that is information such as the number of people present in the sensing area, the distance to the existing location, and the direction (angle). The calculated control data is output to the audio DSP 10 for feedback.

  The audio DSP 10 includes therein a beam control circuit 11 as a correction unit. In the beam control circuit 11, the audio data input from the video and audio data processing circuit 14 is corrected based on the control data input from the human controller 6.

  The audio data is processed by the audio DSP 10 to become beam sound data. When generating a beam sound in the speaker array 3 (to be described later) from the audio data, the audio data is a parameter used for defining the directivity of the beam sound. The directivity parameter is a processing target in the present embodiment. In the beam control circuit 11, the directivity parameter of this sound is particularly adjusted. In accordance with the control data, the sound directivity parameter is adjusted so that the optimal point of the acoustic effect corresponds to the position where the viewer 15 has moved or the position where the viewer 15 currently exists.

  The sound data in which the sound directivity parameter is adjusted is input to the n-channel audio Amp12.

  The n-channel audio Amp 12 adjusts the directivity of the sound in the speaker array 3 based on the input sound data, and outputs the sound. The sound emitted from the speaker array 3 is emitted in a beam shape from, for example, 12 to 16 consecutive small speakers. This beam-like sound (beam sound) is reflected on the wall surface of the listening room 18. By controlling the directivity of the sound, the sound field is adjusted with an increased sense of reality in consideration of the effect of the reflection.

  Since the sound in the present invention is output based on the sound data in which the sound directivity parameter is adjusted, the sound is amplified by considering the position of the viewer 15 and the like.

  Through the operation as described above, the viewer 15 watches the video displayed on the display 2 and listens to the audio output from the speaker array 3 in the listening room 18 (showing the wall surface in the figure). At this time, even when the viewer 15 moves, the viewer 15 is adjusted so that the position where the viewer 15 is present is the optimum point for the stereoscopic effect and the acoustic effect. Optimal stereoscopic effects and acoustic effects can be obtained.

<Effect>
According to the embodiment of the present invention, in the stereoscopic image display device, the sensor 4 that detects the position of the viewer 15 and the human controller 6 that generates control data based on the detected position information of the viewer 15. And a three-dimensional depth adjustment circuit as a correction unit that corrects a three-dimensional depth parameter used for defining a sense of depth in the video based on the control data when generating a three-dimensional parallax image from the input video data 8 and a display 2 as a video output unit that outputs video based on video data in which the 3D depth parameter is corrected in the 3D depth adjustment circuit 8, the viewer moves off the optimum point. However, by correcting the video data parameters, it is possible to achieve a stereoscopic effect appropriately without optical adjustment. That.

  Further, according to the embodiment of the present invention, the sensor 4 that senses the position of the viewer 15 in the audio reproduction device and the person who generates the control data based on the position information of the viewer 15 sensed by the sensor 4. The directivity of the sound used to define the directivity of the beam sound when generating the beam sound from the sense controller 6, the speaker array 3 that outputs the beam sound based on the input sound data, and the sound data A beam control circuit 11 as a correction unit that corrects the parameters based on the control data, and the speaker array 3 outputs the beam sound based on the sound data in which the sound directivity parameter is corrected. Even if the viewer moves away from the optimum point, the sound effect can be realized appropriately by correcting the parameters of the audio data. It can be.

  Further, according to the embodiment of the present invention, in the stereoscopic video display device and the audio reproduction device, the sensor 4 is a wireless sensor, so that the viewer needs to carry a transmitter (transmitting element) and the like. The configuration of the apparatus can be simplified.

  Further, according to the embodiment of the present invention, the stereoscopic video display device and the audio reproduction device further include the tracking system 5 that moves the sensor 4 to follow the sensed viewer 15, thereby correcting the existing stereoscopic video correction. By using the function and the sound field adjustment function, it is possible to provide a stereoscopic video display device and an audio reproduction device with a simple configuration.

<Embodiment 2>
FIG. 2 is a configuration diagram of a stereoscopic video display apparatus according to the present invention. The same components as those in the first embodiment are given the same reference numerals, and detailed description thereof is omitted.

  In the stereoscopic video display apparatus 100 according to the second embodiment, it is assumed that there are a plurality of viewers (viewer 15 and viewer 19) in the listening room 18.

  The follow-up system 5 controls the operation of the sensor 4 as described above, and further receives human motion signals related to the positions of a plurality of people detected by the sensor 4. Then, the human motion signal is output to the human motion controller 6.

  The motion controller 6 analyzes the motion signal and calculates control data that is information such as the distribution of people in the sensing area. Here, for example, as shown in FIG. 2, the distribution of distribution can be assumed to be a virtual viewer 20 at the center of the distribution of viewers 15 and viewers 19 (the range indicated by the chain line in the figure). The human controller 6 can calculate control data so that the optimal point of the stereoscopic effect and the sound effect corresponds to the position where the virtual viewer 20 exists.

  The setting of the arrangement distribution by this method gives the same degree of stereoscopic effect and acoustic effect to the viewers in the arrangement distribution, and provides a highly effective stereoscopic effect and acoustic effect as a whole distribution. Optimizing to enhance the stereoscopic effect and the sound effect for a specific viewer existing in the arrangement distribution (or the direction of the viewer closest to the sensor 4 where the sensing intensity of the sensor 4 is the strongest, etc.) It is also possible to set points.

  The calculated control data is output to the three-dimensional DSP 7 and the audio DSP 10 for feedback.

  As described above, even when there are a plurality of viewers, it is possible to appropriately determine the arrangement distribution and obtain a more effective stereoscopic effect and acoustic effect.

<Effect>
According to the embodiment of the present invention, in the stereoscopic video display device and the audio reproduction device, the sensor 4 senses the positions of the plurality of viewers 15 and viewers 19 in the sensing area, and the human controller 6 By generating control data based on the position distribution of the plurality of viewers 15 and viewers 19, even when the plurality of viewers 15 and viewers 19 are present in the sensing area, appropriate stereoscopic effects and sound can be obtained. An effect can be obtained.

  Further, according to the embodiment of the present invention, in the stereoscopic video display device and the audio reproduction device, the human controller 6 controls the control data based on the distribution center position information of the plurality of viewers 15 and viewers 19. Can generate appropriate stereoscopic effects and sound effects in a balanced manner for the plurality of viewers 15 and viewers 19.

  Further, according to the embodiment of the present invention, in the stereoscopic video display device and the audio reproduction device, the human controller 6 generates control data based on information in a direction in which the sensor 4 has a strong sense intensity. For example, it is possible to give priority to the viewer who is closest to the sensor 4 with the strongest sensing intensity, and to obtain appropriate stereoscopic effects and sound effects.

  1,100 stereoscopic image display device, 2 display, 3 speaker array, 4 sensor, 5 tracking system, 6 human motion controller, 7 3D DSP, 8 3D depth adjustment circuit, 9 display drive circuit, 10 audio DSP, 11 beam Control circuit, 12 n-channel audio Amp, 13 input terminal, 14 video and audio data processing circuit, 15, 19 viewers, 18 listening room, 20 virtual viewers.

Claims (13)

A sensor that senses the viewer's position;
A controller that generates control data based on viewer position information sensed by the sensor;
A correction unit that corrects, based on the control data, a three-dimensional depth parameter used to define a sense of depth in the video when generating a three-dimensional parallax image from the input video data;
A video output unit configured to output a video based on the video data in which the three-dimensional depth parameter is corrected in the correction unit;
3D image display device. The sensor is a wireless sensor,
The stereoscopic image display apparatus according to claim 1. The sensor senses the position of a plurality of viewers within a sensing area,
The controller generates the control data based on a position distribution of a plurality of the viewers,
The stereoscopic image display apparatus according to claim 1 or 2. The controller generates the control data based on position information of a distribution center of the plurality of viewers;
The stereoscopic image display apparatus according to claim 3. The controller generates the control data based on information in a direction in which the sensor has a strong sensing intensity.
The stereoscopic image display apparatus according to claim 3. It further comprises a tracking system that moves the sensor to track the sensed viewer.
The three-dimensional image display apparatus in any one of Claims 1-5. A speaker array that outputs beam sound based on the input audio data;
The correction unit corrects the directivity parameter of the sound used to define the directivity of the beam sound based on the control data when generating the beam sound from the sound data;
The speaker array outputs the beam sound based on the sound data in which the directivity parameter of the sound is corrected.
The three-dimensional image display apparatus in any one of Claims 1-6. A sensor that senses the viewer's position;
A controller that generates control data based on viewer position information sensed by the sensor;
A speaker array that outputs beam sound based on the input audio data;
A correction unit that corrects the directivity parameter of the sound used to define the directivity of the beam sound based on the control data when generating the beam sound from the sound data;
The speaker array outputs the beam sound based on the sound data in which the directivity parameter of the sound is corrected.
Audio playback device. The sensor is a wireless sensor,
The sound reproducing device according to claim 8. The sensor senses the position of a plurality of viewers within a sensing area,
The controller generates the control data based on a position distribution of a plurality of the viewers,
The sound reproducing device according to claim 8 or 9. The controller generates the control data based on position information of a distribution center of the plurality of viewers;
The sound reproducing device according to claim 10. The controller generates the control data based on information in a direction in which the sensor has a strong sensing intensity.
The sound reproducing device according to claim 10. It further comprises a tracking system that moves the sensor to track the sensed viewer.
The sound reproducing device according to claim 8.

Images