JP5500645B2 - Video adjustment device, television receiver, and program - Google Patents

Description

  The present invention relates to a 3D video adjustment technique, and more particularly to a technique for adjusting the amount of pop-up of a 3D video, that is, a difference between the position of a subject recognized by a 3D video viewer and the position of a TV screen.

  Three-dimensional video for viewers by displaying right-eye and left-eye images simultaneously or alternately and presenting right-eye images to the right eye and left-eye images to the left eye with a deflection film or liquid crystal shutter 3D movies and 3D television receivers that can perceive video have been put into practical use (see Non-Patent Document 1, for example).

  At present, 3D video images for 3D television receivers are distributed to homes using optical recording media that store them, but in the future, optical recording media may be used via broadcast signals or via the Internet. It is expected that it will be distributed directly to each home without intervention.

[Online], Panasonic Corporation, [searched on June 02, 2010], Internet <URL: http: panasonic.jp/viara/products/vt2/>

  The content for movies is usually sold as a DVD after a predetermined period of time has passed since the movie was released, and this is the same for content for 3D movies. However, the size of the screen (display) and the distance to the screen are different between a movie theater and a home TV, and even if it is an appropriate image in a movie theater, the amount of popping out is too large at home, and eyestrain Cause problems.

  In addition, there are various display sizes for 3D TV receivers, and the distance to the 3D TV apparatus and the viewing method vary depending on each household. Depending on the attitude of the viewer, etc.

  Therefore, the present invention prevents the eye strain of the viewer by adjusting to a 3D image having an appropriate pop-out amount according to the viewing environment, or by suppressing the pop-out amount to a predetermined value or less based on the viewing environment. It is an object of the present invention to provide a video adjustment device, a television receiver having the video adjustment device, and a program that causes a computer to function as the video adjustment device.

According to the video adjustment device of the present invention,
Receiving means for receiving a signal including a right-eye video and a left-eye video , optimal parallax angle information indicating an optimal parallax angle of a subject indicated by each pixel, and depth information about each pixel; and for the right eye based on the depth information A determination means for determining a correspondence relationship between each pixel of the image and the image for the left eye; a size of a display for displaying the image; a distance from the display to a given position; and a pupil interval. as parallax angle of each object viewer in a position to see is the optimum parallax angle, and characterized in that it comprises a processing means for adjusting the pixel shift amount of the corresponding pixel of the right-eye video and the left-eye video To do.

According to another embodiment of the video adjustment device of the present invention,
It is also preferable that a notification unit that notifies the processing unit of the maximum parallax angle is provided, and the processing unit limits the maximum value of the optimal parallax angle to the maximum parallax angle.

Furthermore, according to another embodiment of the video adjustment device of the present invention,
It is also preferable that a means for specifying a viewer is provided, and the notification means determines the maximum parallax angle based on the specified viewer and notifies the processing means.

Furthermore, according to another embodiment of the video adjustment device of the present invention,
It is also preferable that the notifying means determines the maximum parallax angle based on the age of the viewer.

Furthermore, according to another embodiment of the video adjustment device of the present invention,
Posture determining means for determining an angle with respect to a horizontal direction of a direction connecting the eyes of the viewer and / or an angle with respect to a normal direction of a display that displays an image of the orientation of the viewer; It is also preferable to change the maximum parallax angle or the optimum parallax angle to a smaller value depending on the angle and / or the angle with respect to the normal direction.

Furthermore, according to another embodiment of the video adjustment device of the present invention,
Synchronization judging means for judging whether or not the operation of the liquid crystal shutter / glasses used by the viewer is synchronized with the display period of the right-eye video and the left-eye video; When the glasses are not in a synchronized state, it is also preferable to adjust the pixel shift amount of the corresponding pixels of the right-eye video and the left-eye video to zero, or to change the maximum parallax angle or the optimal parallax angle to a smaller value.

Furthermore, according to another embodiment of the video adjustment device of the present invention,
When there are a plurality of viewers, the given position is preferably the position of the viewer closest to the display, and the pupil interval is preferably the widest pupil interval.

Furthermore, according to another embodiment of the video adjustment device of the present invention, the processing means is such that the pixel of the right-eye video is on the right side of the display surface of the display from the corresponding pixel of the left-eye video, and When the distance between the corresponding pixels is larger than the minimum value of the viewer's pupil interval, it is also preferable to adjust the pixel shift amount so that the distance between the pixels is equal to or less than the minimum value of the pupil interval.

According to the television receiver of the present invention,
The image adjusting apparatus is included.

According to the program of the present invention,
A computer is caused to function as the video adjusting device.

  Regardless of the viewing environment, by adjusting the parallax angle of each subject viewed by the viewer based on the optimal parallax angle set by the video producer, or by suppressing it to less than the maximum parallax angle, it does not burden the eyes Video can be provided to viewers.

1 is a configuration diagram of a video adjustment device according to a first embodiment of the present invention. FIG. It is a block diagram of the image | video adjustment apparatus by 2nd Embodiment of this invention. It is a block diagram of the image | video adjustment apparatus by 3rd Embodiment of this invention. It is a block diagram of the image | video adjustment apparatus by 4th Embodiment of this invention. It is a figure explaining a parallax angle.

  EMBODIMENT OF THE INVENTION The form for implementing this invention is demonstrated in detail below using drawing.

  First, the term “parallax angle” necessary for describing the present invention will be described with reference to FIG. Reference numeral 10 in FIG. 5 is a top view of the display of the television receiver, reference numeral 21 is the viewer's left eye, and reference numeral 22 is the viewer's right eye. As shown in FIG. 5 (a), when the viewer sees an arbitrary point on the display, the angle formed by the viewer's right and left eye gaze directions, that is, the angle γ in FIG. 5 (a). Is called the reference convergence angle.

  5B and 5C, reference numeral 31 denotes one point of a subject when the left-eye video is displayed on the display 10, and reference numeral 32 denotes a right-eye video corresponding to the left-eye video. This is a point corresponding to the point indicated by the reference numeral 31 of the subject when displayed on the display 10. That is, reference numerals 31 and 32 represent the same point on the same subject. In FIGS. 5B and 5C, the viewer perceives that a point of the subject exists at the intersection of the line connecting reference numerals 21 and 31 and the line connecting reference numerals 22 and 32. That is, FIG. 5B shows a state where the subject is protruding from the screen, and FIG. 5C shows a state where the subject is in a position recessed from the screen.

  The parallax angle is a value defined by angle α−angle γ or angle β−angle γ in FIG. 2. That is, when the viewer views the same subject of the corresponding video with each eye, the value obtained by subtracting the reference convergence angle from the angle formed by the line of sight of the right eye and the left eye is the parallax angle. The parallax angle is an index that determines how far the subject is perceived from the display, or how far behind the subject is perceived. The smaller the value, the closer to the rear of the display, and in the case of near zero, the position is almost the same as the display.

  Next, the first embodiment of the image adjustment apparatus according to the present invention will be described with reference to FIG. As shown in FIG. 1, the video adjustment apparatus includes a receiving unit 1, a correspondence determination unit 2, an image shift amount recognition unit 3, a video processing unit 4, a distance measuring unit 5, and a pupil interval holding unit 6. It has.

  The receiving unit 1 receives a 3D video signal from the outside. The source of the 3D video signal may be an optical recording medium or a broadcasting station. However, in the present invention, the 3D video signal includes optimal parallax angle information and depth information about each pixel, that is, a depth map, in addition to the right-eye video and the left-eye video. Note that the optimal parallax angle information is information indicating the optimal parallax angle of the subject indicated by each pixel of one video, that is, the video for the right eye or the video for the left eye, for example, by the video producer. It is set. The depth information indicates the distance from the display (or photographed camera) of the subject represented by each pixel, and is created for each of the right-eye video and the left-eye video.

  The correspondence determination unit 2 determines the correspondence between each pixel in the right-eye video and the left-eye video based on the depth information, that is, a set of a subject and a pixel indicating the same point of each subject, and determines the correspondence. The pixel shift amount recognition unit 3 outputs the difference between corresponding pixels of the right-eye video and the left-eye video. That is, for example, the difference between the pixels 31 and 32 in FIGS. 5B and 5C is calculated. As shown in FIG. 5B, when the position in the right-eye image is on the left side of the display 10 with respect to the corresponding position in the left-eye image, the deviation amount is a positive value. When it is on the right side as shown in 5 (c), the amount of deviation is a negative value.

  The video processing unit 4 acquires display size information from the 3D-compatible television receiver 50, and the distance measuring unit 5 uses various ranging means such as infrared rays to display from the display of the television receiver 50 to the viewer. , And the measured distance is output to the video processing unit 4. The display size may not be acquired from the television receiver 50 but may be manually set in the video processing unit 4 by the viewer. Further, regarding the distance from the display to the viewer, the distance measuring unit 5 is not provided, but a normal position where the viewer views the TV can be manually set in the video processing unit 4 in advance. good. The pupil interval holding unit 6 holds information about the viewer's pupil interval, which is set in advance by the viewer.

  The video processing unit 4 performs viewing based on the optimum parallax angle of each pixel received from the receiving unit 1, the distance to the viewer, the pupil interval of the viewer acquired from the pupil interval holding unit 6, and the display size. The pixel shift amount of each pixel so that the parallax angle of each subject viewed by the person becomes the optimal parallax angle is calculated, and the corresponding pixels of the right-eye video and the left-eye video are moved so as to be the calculated pixel shift amount. At this time, only the right eye image or the left eye image may be moved, or both pixels may be moved by substantially the same amount. The video processing unit 4 outputs the changed 3D video signal, that is, a signal including the changed right-eye video and left-eye video to the television receiver 50. When an area that is not displayed in the original image is generated by adjusting the pixel shift amount, the pixel value of the area is obtained by interpolation processing from the surrounding pixel values.

  As described above, by adjusting the pixel shift amount of each subject based on the display size, the distance to the viewer, and the pupil interval of the viewer so that each subject has the optimum parallax angle, it is related to the viewing environment. Therefore, an image with an optimal parallax angle can be provided.

  In addition, if a plurality of persons are viewing on the television receiver 50, the identifiers of the persons and their pupil intervals are set in the pupil interval holding unit 6 in advance, for example, those who are currently viewing When the viewer inputs the identifier, the video processing unit 4 acquires the pupil distance of the current viewer. When there are a plurality of viewers, the video processing unit 4 determines the parallax angle based on, for example, the largest pupil interval and the distance of the viewer at the closest position. That is, assuming that the viewer having the largest pupil interval is at the closest position, the pixel shift amount is adjusted so that the parallax angle of each subject viewed from the viewer becomes the optimal parallax angle.

  Next, a second embodiment of the image adjustment device according to the present invention will be described with reference to FIG. In addition, the same reference number is given to the same component as 1st Embodiment, and description is abbreviate | omitted. According to FIG. 2, the video adjustment device further includes a maximum parallax angle notifying unit 7 and a viewer specifying unit 8.

  In the viewer specifying unit 8, the identifier of the viewer who uses the television receiver 50 is stored in association with information for identifying the viewer. The information for identifying the viewer is information that identifies the feature when using the face recognition technology. When identifying by the portable terminal that is owned, Information identifying an individual transmitted using short-range wireless technology. The viewer specifying unit 8 specifies the current viewer based on face recognition technology, a signal from the form terminal, and the like, and outputs the specified viewer identifier to the pupil interval holding unit 6 and the maximum parallax angle notifying unit 7. The pupil interval holding unit 6 outputs the viewer's pupil interval corresponding to the notified identifier to the video processing unit 41.

  The maximum parallax angle notification unit 7 holds the correspondence between the age and the maximum parallax angle, the identifier of each viewer preset by the viewer, and the correspondence between the ages, and is notified from the viewer specifying unit 8 Based on the age of the viewer of the identifier, the maximum parallax angle is obtained for each person currently viewing the television receiver 50 and the smallest value is notified to the video processing unit 41.

  The video processing unit 41 has a mode in which the optimal parallax angle information from the receiving unit 1 is used and a mode in which it is not used.

  In the mode to be used, the video processing unit 41, as in the first embodiment, the optimal parallax angle of each subject pixel indicated by the optimal parallax angle information, the display size, the distance to the viewer, and the viewer's pupil. Depending on the interval, the amount of pixel shift of each subject is adjusted to be the optimal parallax angle, but when the optimal parallax angle exceeds the maximum parallax angle notified from the maximum parallax angle notification unit 7, Suppresses the maximum parallax angle. In this embodiment, all the subjects that protrude beyond the maximum parallax angle are recognized at the position of the maximum parallax angle. As in the first embodiment, when there are a plurality of viewers, the parallax angle of each subject is calculated assuming that the viewer having the largest pupil interval is at the closest position. The same applies to the subsequent embodiments.

  In a form that is not used, the video processing unit 41 obtains time series information of the parallax angle of each subject from the pixel shift amount of each subject, the display size, the distance to the viewer, and the viewer's pupil spacing, The pixel shift amount of each subject is enlarged or corrected at an equal ratio so that the maximum value becomes the maximum parallax angle notified from the maximum parallax angle notifying unit 7. That is, for example, when the maximum value of the pixel shift amount of the given 3D video is 40 pixels and the maximum value of the pixel shift amount must be 20 pixels in order to be equal to or less than the notified maximum parallax angle, Assuming that the pixel shift amount at the moment of subject A is 20 pixels and the pixel shift amount of subject B at that moment is 10 pixels, the pixel shift amount is changed to 10 pixels and 5 pixels, respectively. In this embodiment, the most projecting subject is recognized at the position of the maximum parallax angle, and the context of the subject is stored. However, in order to determine the parallax angle after video adjustment at each time for each subject, first, it is necessary to obtain the maximum value of the pixel shift amount of each subject over the entire time of the content. In this embodiment, it is not necessary to include optimal parallax angle information in the received signal.

  It is not preferable to show a video with a strong parallax angle to children, and in this embodiment, the maximum value of the parallax angle of each subject viewed by all viewers is suppressed below the maximum value obtained by age or the like. Thus, it is possible to prevent a child from viewing an image with a strong parallax angle and to prevent adverse effects such as eye strain.

  In the present embodiment, the maximum parallax angle notification unit 7 holds the correspondence between each viewer's identifier and its age, and the maximum is based on the viewer's age of the identifier notified from the viewer specifying unit 8. The parallax angle was obtained. However, the maximum parallax angle notifying unit 7 sets the correspondence between each viewer identifier and the maximum parallax angle without regard to the age, and the maximum parallax angle notifying unit 7 sets the viewer specifying unit 8. The maximum parallax angle may be obtained for each person who is currently viewing the television receiver 50 based on the identifier notified from, and the smallest value among them may be notified to the video processing unit 41. For example, it is difficult for a person who has a significant difference in visual acuity between both eyes to view a stereoscopic image. Therefore, when such a viewer is watching, it is preferable that the amount of pixel shift is small or zero. Therefore, the maximum parallax angle notifying unit 7 is set with a predetermined maximum parallax angle based on the identifier of each viewer, the age of each viewer, and other physical factors. Accordingly, it is possible to adjust the 3D image.

  Subsequently, a third embodiment of the image adjusting apparatus according to the present invention will be described with reference to FIG. In addition, the same reference number is given to the same component as 1st and 2nd embodiment, and description is abbreviate | omitted. According to FIG. 3, the video adjustment apparatus further includes an attitude determination unit 9.

  The posture determination unit 9 determines the angle with respect to the horizontal direction of the direction connecting the eyes of the viewer and / or the angle of the viewer direction with respect to the normal direction of the display (based on the direction toward the display) to adjust the image. Notify the unit 42. The image adjustment unit 42 determines whether the angle with respect to the horizontal direction and / or the angle with respect to the normal direction is less than a predetermined angle. If the angle is less than the predetermined angle, each subject is the same as in the first embodiment. Is adjusted to the optimal parallax angle, but if it is not less than the predetermined angle, the optimal parallax angle is converted to a smaller value in accordance with the angle, and the pixel shift amount is adjusted with the converted optimal parallax angle. At this time, it is preferable to adjust so that the optimum parallax angle becomes smaller as the angle with respect to the horizontal direction and / or the angle with respect to the normal direction becomes larger.

  Note that the viewer orientation is the orientation of the viewer's face, and the angle with respect to the horizontal direction and the angle with respect to the normal direction are, for example, provided with reflectors at both ends of the 3D video viewing glasses, Judgment is made by projecting light rays and capturing reflected waves. In the case of the liquid crystal shutter method, it can also be determined by recognizing an image whether or not the synchronization signal reception window of the glasses is visible from the display surface.

  The posture determination unit 9 can be combined with the second embodiment of FIG. 2, and in this case, the maximum parallax angle is changed to a smaller value depending on the angle with respect to the horizontal direction and / or the angle with respect to the normal direction.

  As described above, in the present embodiment, by suppressing the parallax angle according to the posture of the viewer, it is possible to prevent adverse effects such as eye strain that occur when viewing 3D video without facing the display. .

  Finally, a fourth embodiment of the image adjustment apparatus according to the present invention will be described with reference to FIG. In addition, the same reference number is given to the same component as 1st-3rd embodiment, and description is abbreviate | omitted. According to FIG. 4, the video adjustment device further includes a synchronization determination unit 15.

  The synchronization determination unit 15 determines whether the right and left open / close periods of the liquid crystal shutter / glasses used by the viewer are synchronized with the display period of the right-eye video and the left-eye video in the television receiver 50. The result is notified to the video processing unit 43. When the liquid crystal shutter / glasses are in the synchronized state, the image processing unit 43 adjusts each subject to the optimum parallax angle as in the first embodiment. However, when the liquid crystal shutter / glasses are not in the synchronized state, the image processing unit 43 The pixel shift amount of the corresponding pixel of the video is set to zero or the optimal parallax angle is converted to a smaller value at a predetermined ratio, and the pixel shift amount is adjusted with the converted optimal parallax angle.

  The synchronization determination unit 15 determines whether or not the liquid crystal shutter / glasses are in a synchronized state by having the liquid crystal shutter / glasses notify the reception state of the synchronization signal by a wireless signal or the like. Further, the synchronization state can be determined based on whether the synchronization signal reception window of the liquid crystal shutter / glasses is visible from the display 10 side.

  The synchronization determination unit 15 can also be used in combination with the third embodiment of FIG. 3. In this case, each of the angle with respect to the horizontal direction and / or the angle with respect to the normal direction and the synchronization state of the liquid crystal shutter / glasses, respectively. Thus, the maximum parallax angle and the optimum parallax angle are controlled.

  As described above, in the present embodiment, it is possible to prevent inappropriate presentation of video to the viewer when the liquid crystal shutter / glasses are not synchronized.

  In all the embodiments described above, when the amount of pixel shift is a negative value and the distance between the pixels is larger than the minimum value of the pupil interval of the viewer, the video processing unit 4 It is preferable to adjust the distance so as to be equal to or less than the minimum value. Specifically, as shown in FIG. 5C, when the subject is at a position deeper than the display, when the distance between the reference numerals 31 and 32 is larger than the smallest pupil interval among the viewers, The pixel shift amount is adjusted so that the distance between the pixels 32 is equal to or smaller than the smallest pupil interval. Under a natural environment, the distance between the reference numerals 31 and 32 in FIG. 5C does not become larger than the pupil interval, and the above process can prevent adverse effects on the eyes.

  In the above-described embodiment, the correspondence between the pixels of the right-eye video and the left-eye video is determined based on the depth information. However, the relationship is recognized by a technique such as block matching instead of using the depth information. In this case, it is not necessary to include depth information in the received signal.

  Note that the video adjustment apparatus according to the present invention can be realized by a program that causes a computer to function as each unit shown in FIGS. These computer programs can be stored in a computer-readable storage medium or distributed via a network. Furthermore, the present invention can be realized by a combination of hardware and software. Further, the video adjusting device according to the present invention can be incorporated in a television receiver and becomes the television receiver according to the present invention.

DESCRIPTION OF SYMBOLS 1 Reception part 2 Correspondence relationship determination part 3 Image shift amount recognition part 4, 41, 42, 43 Image | video process part 5 Distance measurement part 6 Pupil space holding part 7 Maximum parallax angle notification part 8 Viewer specific part 9 Posture determination part 10 Display 15 synchronization determination unit 21 left eye 22 right eye 31 one point of subject of video for left eye 32 one point of subject of video for right eye 50 TV apparatus

Claims (10)

Receiving means for receiving a signal including a right-eye video and a left-eye video , optimal parallax angle information indicating an optimal parallax angle of a subject indicated by each pixel, and depth information about each pixel ;
Determining means for determining a correspondence relationship between each pixel of the right-eye video and the left-eye video based on the depth information ;
The size of the display that displays an image, based on the distance and the pupil distance from the display to a given position, the parallax angle of each object seen by the viewer who is in the given position in the pupil distance and the said optimum parallax angle A processing means for adjusting a pixel shift amount of a corresponding pixel of the right-eye video and the left-eye video;
A video adjustment device. The maximum parallax angle comprises a notification means for notifying said processing means,
The processing means limits the maximum value of the optimum parallax angle to the maximum parallax angle,
The image adjusting device according to claim 1. A means to identify viewers,
The notification unit notifies to the processing unit determines the maximum parallax angle based on the identified viewer,
The image adjusting device according to claim 2. The notification unit determines the maximum parallax angle based on the age of the viewer,
The image adjusting device according to claim 3 . A posture determining means for determining an angle with respect to a horizontal direction of a direction connecting the eyes of the viewer and / or an angle with respect to a normal direction of a display that displays an image of the orientation of the viewer;
The processing means changes the maximum parallax angle or the optimal parallax angle to a smaller value according to the angle with respect to the horizontal direction and / or the angle with respect to the normal direction.
Image adjustment device according to any one of claims 1 to 4. It includes synchronization determination means for determining whether the operation of the liquid crystal shutter / glasses used by the viewer is synchronized with the display period of the right-eye video and the left-eye video,
When the liquid crystal shutter / glasses are not in a synchronized state, the processing means adjusts the pixel shift amount of the corresponding pixel of the right-eye video and the left-eye video to zero, or reduces the maximum parallax angle or the optimal parallax angle to a smaller value. Change to
Image adjustment device according to any one of claims 1 to 5. If you have multiple viewers,
The given position is the position of the viewer closest to the display;
The pupil spacing is the widest pupil spacing;
Image adjustment device according to any one of claims 1 to 6. The processing means is such that the pixel of the right eye image is on the right side of the display surface of the display from the corresponding pixel of the left eye image, and the distance between the corresponding pixels is less than the minimum value of the viewer's pupil interval. If it is large, adjust the pixel shift amount so that the distance between the pixels is less than the minimum value of the pupil interval.
Image adjustment device according to any one of claims 1 to 7. Television receiver including a video controller according to any one of claims 1 to 8. Program for causing a computer to function as image adjusting apparatus according to any one of claims 1 to 8.

Images