JP2012156699A - Stereoscopic image processing apparatus and stereoscopic image display apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a stereoscopic image processing apparatus which displays and outputs a satisfactory stereoscopic image which is not uncomfortable at the ends of the screen by changing the range of the parallax amount of the stereoscopic image to be suitable for a user.SOLUTION: The stereoscopic image processing apparatus inputs a pair of inputted image data for the right eye and inputted image data for the left eye, and generates image data to be displayed by expanding respective image data for the right eye and inputted image data for the left eye so that only areas becoming a pair of images become display areas when deviating the display position of the inputted image data for the left eye to one of the right and left in a horizontal direction and deviating the inputted image data for the right eye to the other, respectively by portions of a parallax offset amount.

Description

  The present invention relates to a stereoscopic image processing apparatus in a stereoscopic image display apparatus that displays a pair of input images forming a stereoscopic image.

  In recent years, many stereoscopic image display techniques using binocular parallax have been proposed as image display techniques for a user to obtain a pseudo-depth feeling. This is a technology that induces a sense of depth in a pseudo manner by showing an image viewed with the left eye and an image viewed with the right eye to the left and right eyes of the user, respectively.

  In addition, as a technique for showing different images to the left and right eyes of the user, the left-eye image and the right-eye image are alternately switched in time and displayed on the display, and at the same time, the left and right images are synchronized with the timing at which the images are switched. Separate the left and right eyes by using a method that separates the left and right fields of view temporally using glasses that close the field of view, and a barrier or lens that limits the display angle of the image displayed on the display in front of the display. Various methods have been proposed, such as a method for showing a left-eye image and a right-eye image.

  In such a stereoscopic image display device, if the amount of popping out is too large due to the mismatch of focusing on the display surface while adjusting the convergence angle of the eye to the point where the object being watched by the user has popped out, fatigue of the eyes There is a problem of inducing. Also, the sense of depth suitable for the user varies depending on the distance between the user and the display surface of the display, the size of the display surface, and individual differences among users.

  With respect to these problems, the conventional stereoscopic image processing apparatus moves the video display position to the left and right on the screen by adjusting the display timing of the input stereoscopic image based on the parallax amount instruction signal. There is. (For example, refer to Patent Document 1).

JP 2000-78615 A (page 3-4, FIG. 3)

  However, by adjusting the amount of parallax by a method such as Patent Document 1, a black portion outside the screen (hereinafter also referred to as blanking) without pixel data to be displayed only on one side of the screen is displayed at the edge of the screen, There is a problem that the stereoscopic effect at the edge of the screen is lost. For example, if the left-eye image is moved to the left, blanking is displayed at the right screen end of the left-eye image, so there is no left-eye image corresponding to the right end of the right-eye image, and a pair of three-dimensional images An image cannot be made. Similarly, if the right-eye image is moved to the right, blanking is displayed at the left screen end of the right-eye image, so there is no right-eye image corresponding to the left end of the left-eye image, and a pair of three-dimensional images An image cannot be made. As a result, there is a problem that the user sees an uncomfortable image on both ends of the screen.

  The present invention has been made to solve the above-described problems, and even when the parallax amount is adjusted with respect to the input image for the left eye and the image for the right eye, the screen edge is not uncomfortable. An object is to display and output a simple stereoscopic image.

  The stereoscopic image processing apparatus according to the present invention receives a pair of left-eye input image data and right-eye input image data, and inputs the left-eye input image data based on parallax adjustment information indicating an adjustment amount of a parallax offset amount. The left eye display image data, the right eye display image data from the right eye display image data, and a predetermined output from the left eye display image data and the right eye display image data. A display output unit that outputs an image signal in a format, wherein the image generation unit sets the display position of the input image data for the left eye in one of the left and right horizontal directions and the right When the display position of the input image data for the eye is shifted in the other direction by the amount of parallax offset, the input image data for the left eye and the right eye are set so that only the area that becomes the pair of images becomes the display area. Is characterized in that the stretching force image data, respectively.

  According to the present invention, it is possible to generate a new pair of images in which the parallax amount in the pair of input image data for the left eye and the input image data for the right eye is changed based on the parallax offset amount. By creating and outputting a part that does not exist in the original video without displaying a pair of areas that appear at the edge of the image due to the parallax offset amount while obtaining a feeling of depth suitable for the user, a parallax amount range suitable for the user A stereoscopic image can be displayed and output.

1 is a block diagram illustrating a stereoscopic image processing apparatus according to Embodiment 1. FIG. It is a figure which shows the relationship between the parallax of the input image for left eyes and the input image for right eyes, and the feeling of depth which a user feels. It is a figure explaining parallax adjustment. It is a figure explaining the position of the object shown to the pixel and user which are shown on a screen. It is a figure explaining the common part of the right-and-left image at the time of parallax adjustment. It is a figure explaining a scaling method. 6 is a block diagram illustrating a stereoscopic image processing apparatus according to Embodiment 2. FIG.

Embodiment 1 FIG.
FIG. 1 is a diagram showing a configuration of a stereoscopic image processing apparatus according to Embodiment 1 of the present invention. In FIG. 1, a stereoscopic image processing apparatus 100 includes a parallax information detection unit 1, a parallax adjustment unit 2, an image generation unit 3, and a display output unit 4. Become.

  First, an outline of the components will be described. The parallax information detection unit 1 outputs the maximum amount T1max of the parallax information and the maximum amount H1max of the parallax information for each screen (frame) from the left-eye input image data Da1 and the right-eye input image data Db1. is there. The parallax adjustment unit 2 determines parallax adjustment information T2 that is a parallax offset amount to be set so that an input image falls within a parallax amount range suitable for the user. The parallax adjustment information T2 is determined and output from the maximum pull-in amount H1max, the maximum pop-out threshold value ST1 and the maximum pull-in threshold value SH1 determined by the user. The image generation unit 3 inputs the left-eye input image data Da1 and the right-eye input image data Db1, and generates the left-eye display image data Da2 and the right-eye display image data Db2 based on the parallax adjustment information T2. Is. The display output unit 4 outputs an image signal corresponding to the input format of the display device 200 based on the left-eye display image data Da2 and the right-eye display image data Db2.

  Next, the maximum pop-out amount T1max and the maximum pull-in amount H1max obtained by the parallax information detection unit 1 will be described. FIG. 2 shows the relationship between the parallax between the image for the left eye and the image for the right eye and the sense of depth felt by the user. The image for the left eye is only for the user's left eye, and the image for the right eye is the user's right eye. It is controlled to be visible only. In FIG. 2A, the display position on the display surface in the left-eye image regarding a certain object is P1l, and the display position on the display surface in the right-eye image is P1r. Similarly, in FIG. 2B, the display position on the display surface in the left-eye image regarding a certain object is P2l, and the display position on the display surface in the right-eye image is P2r. At this time, when P1l and P1r are seen as one object, the user appears to exist in the spatial position of F1, and when P2l and P2r appear as one object, they exist in the spatial position of F2. looks like.

  Here, when the horizontal coordinate of the image for the left eye of a certain object is X (Pl) and the horizontal coordinate of the image for the right eye is X (Pr), the parallax is obtained by the first equation. Here, since the number of pixels on one line in one frame is determined by the format of the input image, the horizontal coordinate is described as being expressed in units of the number of pixels with the zero coordinate as the left end of the frame.

  When the first equation is applied to P1l and P1r in FIG. 2A, d1 = X (P1l) −X (P1r) is a positive value, and when applied to P2l and P2r in FIG. The obtained d2 = X (P2l) -X (P2r) is a negative value.

  As shown in FIG. 2A, when the parallax is obtained with a positive value, the object appears to be present between the display surface and the user. Further, as shown in FIG. 2B, when the parallax is obtained with a negative value, the object appears to be present behind the display surface. Here, in an input image of one screen (hereinafter referred to as one frame), parallax having a positive maximum value is referred to as a maximum pop-out amount, and parallax having a negative maximum value is referred to as a maximum pull-in amount.

  The parallax information detection unit 1 calculates the maximum pop-out amount and the maximum pull-in amount for each frame described above, compares the left-eye input image with the right-eye input image, and compares the left-eye input image with the right-eye input image. Pixels displaying the same object in the ophthalmic input image are detected, and the parallax d of each object is calculated by calculating the difference between the horizontal coordinates of those pixels. For each frame, a maximum value when the parallax d is positive, that is, a maximum pop-out amount T1max, and a maximum absolute value when the parallax d is negative, that is, a maximum pull-in amount T2max are calculated. When calculating the parallax d, for the sake of simplicity, instead of pixel by pixel, the screen is divided into certain sections, and the parallax d is calculated for each section, and the maximum pop-out amount T1max and the maximum pull-in amount T2max in one screen are calculated. Also good. As a method for detecting pixels displaying the same object, for example, a technique such as block matching can be used.

  Next, the parallax adjustment unit 2 will be described. The parallax adjustment unit 2 calculates parallax adjustment information from the maximum pop-out threshold value ST1 and the maximum pull-in threshold value SH1 determined by the user, and the maximum pop-out amount T1max and the maximum pull-in amount H1max output from the parallax information detection unit 1. T2 is determined and output.

  In general, when the pop-out amount is large, eyes may become tired or stereoscopic viewing may be difficult. Therefore, the parallax is adjusted in the pull-in direction so as not to exceed the maximum pop-out threshold determined by the user. Further, even when the maximum pull-in amount is large, stereoscopic viewing may be difficult. Therefore, the parallax is adjusted in the direction of popping out so as not to exceed the maximum pull-in threshold determined by the user. The pop-up amount and the pull-in amount have different optimum values depending on the screen size, the number of pixels, the viewing distance of the user, and the like. Regarding the maximum pull-in amount, since the distance between both eyes is 5 cm for children, it is desirable that the maximum value (infinity) of the pull-in parallax on the display screen should not exceed 5 cm.

  The amount of pop-out and the amount of pull-in are preferably adjusted in the direction of pull-in as much as possible because the eyes are tired or less likely to become stereoscopic when the amount of pop-out is large. For example, when the maximum pop-out amount is large, the shift is made in the pull-in direction so that the pop-out amount is conservative. Further, when the maximum pull-in amount exceeds 5 cm, the shift is made in the pop-out direction so as to be 5 cm at the maximum. In this way, the parallax adjustment unit 2 operates so as to be within the parallax threshold range determined by the user. In this manner, the parallax adjustment unit 2 determines parallax adjustment information that falls within the parallax threshold range determined by the user.

  Next, the parallax offset adjustment method of the parallax adjustment unit 2 will be described. The parallax adjustment information T2 includes four cases of the maximum pop-out threshold value ST1 and the maximum pull-in threshold value SH1 determined by the user, and the maximum pop-out amount T1max and the maximum pull-in amount H1max output from the parallax information detection unit 1. It is assumed that the following formulas 2 to 5 are used. Here, regarding the determination of the maximum pop-out threshold value ST1 and the maximum pull-in threshold value SH1, for example, the user determines from a test image from the display device 200 or past viewing results, or the user selects from a plurality of candidates. It is determined from the selection. Further, a, b, c, and d are all coefficients of 0 or more and 1 or less, and these coefficients take into consideration that the distance corresponding to the parallax of the input image varies depending on the size of the display device 200. Is set.

  The case of the second formula will be described. When the maximum pop-out amount T1max is larger than the maximum pop-out threshold value ST1 and the maximum pull-in amount H1max is less than or equal to the maximum pull-in threshold value SH1, the coefficient a (0 ≦ 0) is set as the difference between the maximum pop-out amount T1max and the maximum pop-out threshold value ST1. A negative number obtained by multiplying a ≦ 1) is set as parallax adjustment information T2. That is, when the pop-out amount is large, the operation is performed so as to be pulled in (the parallax is in a negative direction). A <1 may be set to prevent the pull-in amount from changing greatly. Further, the coefficient a = 0 may be set to stop the operation.

  The case of the third formula will be described. When the maximum pop-out amount T1max is larger than the maximum pop-out threshold value ST1 and the maximum pull-in amount H1max is larger than the maximum pull-in threshold value SH1, the coefficient b (0 ≦ 0) is added to the difference between the maximum pop-out amount T1max and the maximum pop-out threshold value ST1. b ≦ 1) multiplied by a negative number, and the difference between the maximum pull-in amount H1max and the maximum pull-in threshold value SH1 multiplied by a coefficient a (0 ≦ c ≦ 1), and the parallax adjustment information T2 To do. When b = c = 1, the operation is performed so as to reduce the parallax amount having the larger difference from the maximum value determined by the user. In addition, it is possible to give priority to the adjustment that reduces the maximum pop-out amount over the maximum pull-in amount with b> c, or prioritize the adjustment that reduces the maximum pull-out amount over the maximum pop-out amount with b <c. Further, it is possible to prevent the pull-in amount and the pop-out amount from changing greatly by setting b <1 and c <1. Further, the pull-in operation may be stopped by setting the coefficient b = 0, or the pop-out amount may be stopped by setting the coefficient c = 0.

  The case of the fourth formula will be described. When the maximum pop-out amount T1max is equal to or smaller than the maximum pop-out threshold value ST1 and the maximum pull-in amount H1max is larger than the maximum pull-in threshold value SH1, a coefficient d (0 ≦ 0) is calculated as the difference between the maximum pull-in amount H1max and the maximum pull-in threshold value SH1. The product obtained by multiplying d ≦ 1) is set as parallax adjustment information T2. That is, when the pop-out amount is small (below the threshold value) but the maximum pull-in amount is large, the pull-in amount is reduced, that is, the pop-out amount is increased (the parallax is in the positive direction). d <1 may be set so as to prevent the jump amount from changing greatly. The operation may be stopped by setting the coefficient d = 0.

  The case of the fifth formula will be described. When the maximum pop-out amount T1max is equal to or smaller than the maximum pop-out threshold value ST1 and the maximum pull-in amount H1max is equal to or smaller than the maximum pull-in threshold value SH1, T2 = 0. That is, if the maximum pop-out amount and the maximum pull-in amount are within the range of the maximum pop-out threshold value ST1 and the maximum pull-in threshold value SH1 determined by the user, nothing is done and the input stereoscopic image is output as it is. And

  As described above, the parallax adjustment unit 2 determines the parallax adjustment information T2 from the maximum pop-out threshold value ST1 and the maximum pull-in threshold value SH1 determined by the user, the maximum pop-out amount T1max, and the maximum pull-in amount H1max. And output to the image generation unit 3.

  Next, the operation of the image generation unit 3 will be described. Based on the parallax adjustment information T2 output from the parallax adjustment unit 2, the image generation unit 3 generates a new left-eye image and right-eye image from the left-eye input image Da1 and the right-eye input image Db1. The left-eye display image Da2 and the right-eye display image Db2 are output. Here, the image generation unit 3 generates an image by pairing the left-eye image and the right-eye image based on the parallax adjustment information T2.

  Assume that the left-eye input image Da1 and the right-eye input image Db1 shown in FIG. The black circle objects B1l and B1r in the figure are the same objects that are stereoscopically viewed. It is assumed that the object B1l of the input image for the left eye and the object B1r of the input image for the right eye originally have a parallax d1. In FIG. 3B, it is assumed that the entire left-eye input image is translated horizontally to the left, and the entire right-eye input image is horizontally moved to the right. That is, the wavy line image is horizontally moved so as to become a solid line image. In FIG. 3B, the parallax between the image for the left eye and the image for the right eye of the object B1 is d1-s, which is small. In other words, it appears to the user that the object that is popping out has moved back in the direction of drawing.

  The above description will be described with reference to the pixel on the screen and the position of the object felt by the user. FIG. 4A is the same as FIG. 4A is assumed to be a pixel in the object B1l of the image for the left eye in FIG. 3, and a pixel P1r of the image for the right eye is a pixel in the object B1r of the image for the right eye. The pixels P1l and P1r of the image for the left eye have parallax d1, and the user feels that there is an object at the point F1 in the space. FIG. 4B is a diagram in which the left-eye image displayed on the display surface is moved to the left and the right-eye image is moved to the right as described with reference to FIG. That is, in FIG. 4B, the pixel P1l in the object B1l of the left-eye image moves to P1l-s, and the pixel P1r in the object B1r of the right-eye image moves to P1r-s. As shown in FIG. 4B, the parallax between the pixel P1l-s of the left-eye image and the pixel P1r-s of the right-eye image is d1-s, and the pixel P1l-s of the left-eye image and the right eye With the pixel P1r-s of the image for use, the user feels that there is an object at the point F1-s in the space. That is, it can be felt that the projecting object has been pulled in by -F.

  Thus, the parallax can be changed by horizontally moving the input image for the left eye and the input image for the right eye. This movement amount is set as a parallax offset amount. When the parallax offset amount is increased in the negative direction, the entire left eye image is horizontally moved to the left, and the entire right eye image is horizontally moved to the right. When the parallax offset amount is increased in the positive direction, the entire left eye image is horizontally moved to the right, and the entire right eye image is horizontally moved to the left. That is, when the parallax offset amount is increased in the negative direction, the entire screen is drawn, and when the parallax offset amount is increased in the positive direction, the entire screen is projected. That is, by adjusting the parallax offset amount, the pop-out amount and the pull-in amount, that is, the sense of depth can be moved forward or backward. In addition, the left and right images are paired with the parallax offset amount, and the left and right are simultaneously moved horizontally in opposite directions. In the image generation unit 3, the parallax adjustment information T2 output from the parallax adjustment unit 2 is input, and the parallax adjustment information T2 is adjusted as the parallax offset amount.

  As described above, when the entire left-eye image and the entire right-eye image are translated in the horizontal direction and the parallax adjustment is performed, the moved image is a portion that is not in the original image (the portion that has no image data to be displayed). Will be displayed. This situation will be described with reference to FIG. FIG. 5 is a diagram for explaining a common part of left and right images when parallax adjustment is performed. Here, FIG. 5A is the same diagram as FIG. For example, as shown in FIG. 5A, when the entire left-eye image is horizontally moved to the left, the right oblique line portion of the display area (within the dotted frame) when the left-eye image is displayed on the display device 200 Is a portion that is not in the original image. Similarly, when the entire right-eye image is horizontally moved to the right, the left hatched portion of the display area when the right-eye image is displayed on the display device 200 is a portion that is not in the original image. The left-eye image and the right-eye image must be the same except for the one that is viewed stereoscopically. It is desirable to make an image as follows.

  In FIG. 5A, the common part of the left and right images other than the shaded part is the central part indicated by the solid thick line in FIG. When this center image is shifted by the amount of parallax offset, it is a region that becomes a pair of images, and left and right portions are created from this center image. Since the part that is not in the original video is based on the parallax offset amount, that is, the parallax adjustment information T2, the scaling method (enlargement process) described below is used based on the parallax adjustment information T2 when creating the part that is not in the original video. Then, the enlargement rate is determined, and the pixel data of the corresponding region is reconstructed after being extended from the pixel data of the original input image according to the extension rate, thereby generating the left-eye display image and the right-eye display image.

  Next, a first scaling method will be described in which an image is stretched so as to be the original size from a central image obtained by cutting out the periphery. As shown in FIG. 6A, the enlargement rate is reduced from the horizontal size of the central image of the left and right common portion so that the central image of the left and right common portion determined by the parallax adjustment information T2 becomes the horizontal size of the original image. calculate. The horizontal portion is stretched at a certain stretch rate to stretch the central portion of the left and right images to produce the original image size. Since the scaling performed at this constant stretch rate is horizontally stretched at a constant rate, it becomes slightly horizontal and does not feel strange.

  Next, a second scaling method will be described in which an image is stretched so as to be the original size from the central image obtained by cutting the periphery. As shown in FIG. 6B, a method is used in which the roundness rate at the center is as it is (1 time) and the stretching rate is increased toward the periphery. The enlargement ratio is gradually increased so that the center image of the left and right common part determined by the parallax adjustment information T2 becomes the horizontal size of the original image and gradually increases from the area that secures the roundness of the center image of the right and left common part. The stretching rate to be calculated may be determined to be linear or non-linear. Further, the area for ensuring the roundness may be increased or decreased. It is also possible to increase the rate of elongation gradually from the center without providing a region for securing the perfect circle rate. An example of the stretching rate determined in this way is shown below FIG. The center part of the left and right images is left as it is, and the enlargement ratio is increased toward the periphery, and scaling is performed to produce the original image size. The feature of this method is that it is difficult to understand that it has been extended by a scaling method that takes advantage of the fact that people pay close attention to the central part and the peripheral part is not so concerned.

  Next, a third scaling method for extending an image so as to be the original size from the central image obtained by cutting the periphery will be described. As shown in FIG. 6C, the enlargement rate is reduced from the horizontal size of the central image of the left and right common portion so that the central image of the left and right common portion determined by the parallax adjustment information T2 becomes the horizontal size of the original image. calculate. This stretching ratio is applied so that the ratio is the same in the horizontal direction and the vertical direction, and scaling is performed to create the original image size by stretching in the horizontal direction and the vertical direction with reference to the center of the left and right images. An image in the vertical direction goes out of the image and is cut out. However, since the image is stretched at a constant ratio in the horizontal and vertical directions, the roundness is maintained and there is no sense of incongruity.

  Next, a fourth method for creating an image of the original size from the center image obtained by cutting the periphery will be described. As shown in FIG. 6D, without scaling without using a scaling method, the left-eye image and the right-eye image are moved horizontally, and the portion without the image is replaced with a wallpaper containing a logo or advertisement. Insert an image like this, or a black, gray, or color image. That is, leave the common part of the image for the left eye and the image for the right eye, and the image other than the common part of both the image for the left eye and the image for the right eye, such as an image such as a logo or advertising wallpaper, black or gray, Make a color image. This is the simplest method, and the same image is displayed in the binocular image, so there is no sense of incongruity.

  Although the above-described first to fourth methods have been described as methods for generating an image of the original size from the central image obtained by cutting the periphery, the present invention is not limited to the first to fourth methods, and other known scaling methods are also used. Or by inserting images.

  In this way, the image generation unit 3 changes the enlargement rate by the same amount from the left-eye image and the right-eye image in accordance with the parallax adjustment information T2 output from the parallax adjustment unit 2, respectively. A new left-eye display image Da2 and right-eye display image Db2 are output by scaling from the input image Da1 and the right-eye input image Db1. As a result, even if the parallax adjustment information T2 is changed, an image at the horizontal end of either of the left and right images is not lost or a different image is obtained, and a good stereoscopic image without a sense of incongruity can be obtained.

  Further, the parallax adjustment information T2 determined and output by the parallax adjustment unit 2 does not output the new parallax adjustment information T2 for each frame corresponding to the maximum pop-out amount T1max and the maximum pull-in amount H1max for each frame, but the maximum pop-out amount. The maximum value for T1max and the maximum pull-in amount H1max may be obtained from the maximum value obtained in units of a plurality of frames, the maximum pop-out threshold ST1, and the maximum pull-in threshold SH1. Alternatively, the maximum pop-out amount T1max and the maximum pull-in amount H1max may be obtained from the maximum pop-out threshold value ST1 and the maximum pull-in threshold value SH1 stored in the program or content unit of the input video. Absent. By generating the display image for the left eye and the display image for the right eye in the image generation unit 3 based on the parallax adjustment information T2 thus configured, it is possible to suppress the frequency with which the parallax adjustment and the enlargement rate fluctuate. There is an effect that it is possible to provide an easy-to-view video. Needless to say, the fourth method described above can also provide an image that can be easily viewed by the user.

  Further, the image generation unit 3 does not always change the stretching rate based on the parallax adjustment information T2, but stores a history of the maximum value of the stretching rate based on the parallax adjustment information T2, and the maximum value of the stretching rate is updated. If the scaling using the maximum value of the stretch rate is held until the image is displayed, the frequency at which the stretch rate fluctuates can be suppressed, and an image that is easy for the user to view can be provided. At this time, for example, the history of the maximum value of the stretch rate may be deleted for each input video program or content unit. It goes without saying that the above-described fourth method also provides an effect that it is possible to provide an image that is easy for the user to view by using a history that has been stored for the range to be clipped.

  Next, the operation of the display output unit 4 will be described. Display methods that enable stereoscopic display include a method for displaying left-eye images and right-eye images at spatially different coordinates, and left-eye images and right-eye images in temporally different frames. There is a method to display. The display output unit 4 is a display device that inputs a display image for the left eye and a display image for the right eye and outputs an image signal corresponding to the input of the display device 200.

  The display output unit 4 may convert the image signal format into a predetermined image signal format and output the image signal. For example, even when the stereoscopic image processing apparatus 100 is provided in a Blu-ray playback / recording apparatus or the like and connected to a TV having a display device, it goes without saying that the effects of the present invention are achieved.

In this manner, parallax information is detected from the left-eye input image and the right-eye input image, and the left-eye input image and the right-eye input image are changed based on the detected parallax information and the parallax adjustment information. Thus, the depth feeling of the entire screen can be increased or decreased, so that a stereoscopic image with the optimum depth feeling can be displayed within the parallax amount range suitable for the user. In addition, when generating a new pair of images in which the parallax range is changed based on the parallax adjustment information, the new pair of images are displayed so as to create a portion that is not included in the original video. A good stereoscopic image can be obtained without lacking or different images, and a stereoscopic image in a parallax amount range suitable for the user can be displayed and output.
Embodiment 2. FIG.

  In Embodiment 1, the parallax adjustment unit 2 determines the parallax adjustment information T2 from the maximum pop-out amount T1max and the maximum pull-in amount H1max obtained by the parallax information detection unit 1, and the maximum pop-out threshold value ST1 and the maximum pull-in threshold value SH1. However, the parallax adjustment information T2 may be determined based on the parallax adjustment amount S1 that the user wants to arbitrarily change without detecting the parallax information from the input stereoscopic image without providing the parallax information detection unit 1.

  FIG. 7 is a diagram showing a configuration of a stereoscopic image processing apparatus according to Embodiment 2 of the present invention. In FIG. 7, the stereoscopic image processing apparatus 101 includes a parallax adjustment unit 5, an image generation unit 3, and a display output unit 4, and becomes a stereoscopic image display device by being connected to the display device 200. Here, the same reference numerals as those in the first embodiment are the same as those described in the first embodiment, and thus the description thereof is omitted in this embodiment.

  The parallax adjustment unit 5 allows the user to adjust the degree of the pop-out amount. For example, it is assumed that the parallax adjustment amount S1 can be adjusted in the range of + A to -B on the parallax adjustment menu. When the sign is +, it means that the pop-out amount is increased. That is, the left eye image and the right eye image are horizontally moved in the pop-out direction. When the sign is-, the pop-out amount is reduced. That is, the left eye image and the right eye image are horizontally moved in the pull-in direction. If the pop-out amount is large, the eyes may become tired or the stereoscopic view may be difficult to enter. Therefore, in order to suppress the pop-out amount, the A side is set to A = 0, and the -B side is adjusted by user adjustment. You can do it mainly.

  A method for determining the parallax adjustment information T2 output from the parallax adjustment unit 5 will be described. The parallax adjustment unit 5 receives the parallax adjustment amount S1 determined by the user. The parallax adjustment information T2 is output in proportion to the parallax adjustment amount S1 or an arbitrary value. For example, it is assumed that the parallax adjustment amount S1 can be adjusted in the range of +1 to −2. When the parallax adjustment amount S1 = + 1, T2 = + e, when S1 = 0, T2 = 0, when S1 = −1, T2 = −f, and when S1 = −2, T2 = −g (g> f). Here, e, f, and g may be arbitrary numerical values.

  The operation of the image generation unit 3 will be described. Based on the parallax adjustment information T2 output from the parallax adjustment unit 5, the image generation unit 3 fixes the scaling rate to the assumed maximum value without changing the scaling rate of scaling every time, and responds to the parallax adjustment information T2. Thus, it is conceivable to simply shift the left-eye input image and the right-eye input image in the horizontal direction. That is, since the maximum value of the parallax adjustment information T2 is determined, an image having a larger number of pixels than the original image obtained by scaling the image with a fixed extension rate in the case of the maximum value of the parallax adjustment information T2 in advance is created. Based on the parallax adjustment information T2, the left-eye input image and the right-eye input image are shifted in the horizontal direction by the above-described method of parallax offset amount. As the scaling method, the first to fourth methods may be used. Since this method is previously scaled with the maximum value of the parallax adjustment information, there is an image portion that cannot be seen unless it is shifted. It is characteristic that there is not. As a result, even if the parallax adjustment information T2 changes, an image at the horizontal end of either the left or right image is not lost or a different image is obtained, and a good stereoscopic image is obtained.

In this manner, the parallax adjustment amount determined by the user is used to adjust the parallax offset amount for the left-eye input image and the right-eye input image, and the original pair of image edges is generated based on the parallax adjustment amount. It goes without saying that the intended purpose can be achieved even when a portion not included in the image is created.

DESCRIPTION OF SYMBOLS 100 Stereoscopic image processing apparatus 1 Parallax information detection part 2 Parallax adjustment part 3 Image generation part 4 Display output part 5 Parallax adjustment part

Claims (8)

A pair of left-eye input image data and right-eye input image data is input, and the left-eye display image data is converted from the left-eye input image data based on the parallax adjustment information indicating the adjustment amount of the parallax offset amount. An image generation unit that generates right-eye display image data from right-eye input image data;
A stereoscopic image processing apparatus comprising: a display output unit that outputs an image signal of a predetermined output format from the display image data for the left eye and the display image data for the right eye,
The image generation unit sets the display position of the left-eye input image data in one of the left and right horizontal directions, and the display position of the right-eye input image data in the other direction, respectively. A three-dimensional image processing apparatus, wherein the left-eye input image data and the right-eye input image data are each extended so that only a region that becomes a pair of images becomes a display region when shifted by a distance. A parallax information detection unit that detects parallax information including a maximum pop-out amount and a maximum pull-in amount from the left-eye input image data and the right-eye input image data;
The stereoscopic image according to claim 1, further comprising: a parallax adjustment unit that generates the parallax adjustment information from the set maximum pop-out threshold value, the set maximum pull-in threshold value, and the parallax information. Processing equipment. 3. The stereoscopic image processing apparatus according to claim 1, wherein the image generation unit uniformly extends the image at a predetermined horizontal expansion rate based on the parallax adjustment information. The stereoscopic image processing apparatus according to claim 3, wherein the image generation unit further extends the image at a predetermined vertical expansion rate based on the parallax adjustment information. 3. The stereoscopic image processing apparatus according to claim 1, wherein the image generation unit maintains a circularity rate of 1 in a predetermined central region in the display region and extends other than the central region. A pair of left-eye input image data and right-eye input image data is input, and the left-eye display image data is converted from the left-eye input image data based on the parallax adjustment information indicating the adjustment amount of the parallax offset amount. An image generation unit that generates right-eye display image data from right-eye input image data;
A stereoscopic image processing apparatus comprising: a display output unit that outputs an image signal of a predetermined output format from the display image data for the left eye and the display image data for the right eye,
The image generation unit sets the display position of the left-eye input image data in one of the left and right horizontal directions, and the display position of the right-eye input image data in the other direction, respectively. The left-eye display image data and the right-eye display image are added by adding the second left-eye display image data and the second right-eye display image data to a region that does not become a pair of images when shifted by a distance. A stereoscopic image processing apparatus characterized by generating data. The image generation unit stores the maximum value of the parallax offset amount, and generates the display image data for the left eye and the display image data for the right eye using the maximum value. The stereoscopic image processing apparatus according to claim 6. A stereoscopic image processing apparatus according to any one of claims 1 to 7, comprising:
A stereoscopic image display apparatus, further comprising a display device that displays the image signal from the display output unit.

Images