JP2010171628A - Image processing device, program, image processing method, recording method, and recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To solve unnaturalness of the left- and right-edge portions of a screen showing a three-dimensional image. <P>SOLUTION: An image processing device 10 for displaying a two-dimensional image three-dimensionally is provided which comprises: a creating unit 20 for creating left- and right-side images by moving the two-dimensional image in a display region leftward and rightward; a right-edge processing unit 22 for adding a right-edge image to be displayed in a predetermined region from the right edge of the display region to the right side of the left-side image; a left-edge processing unit 24 for adding a left-edge image to be displayed in a predetermined region from the left edge of the display region to the left side of the right-side image; and an output unit 30 for outputting the left-side image to which the right-edge image is added toward the left eye of the user and the right-side image to which the left-edge image is added toward the right eye thereof. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image processing apparatus, a program, an image processing method, a recording method, and a recording medium.

  Conventionally, stereoscopic (3D) image presentation technology is known. As one of the technologies for presenting stereoscopic images, a right-eye image when an object is viewed from the right eye and a left-eye image when the object is viewed from the left eye are generated, and the right-eye image is generated by the user. There is a technique (stereostereoscopic technique) that displays only to the right eye of the user and displays an image for the left eye only to the left eye of the user.

Japanese Patent Laid-Open No. 10-117362 JP 2002-262310 A JP-A-8-205201

  By the way, such a stereo stereoscopic vision technique may give a user discomfort. In the stereo stereoscopic technique, the image displayed on the surface is made to feel as if there is depth and pop-out due to parallax of both eyes. Therefore, compared with the case of viewing a normal three-dimensional object, the function of vision and brain is different, and this may cause unnatural feeling in the image, resulting in discomfort. In particular, the discrepancy between visual vergence and accommodation (difference between the intersection of binocular vergence and the actual in-focus position as an image) is a major factor.

  In addition, the stereo stereoscopic technique has a high cost for generating a parallax image for stereoscopic video. In the stereo stereoscopic technique, two images (right-eye image and left-eye image) having parallax with respect to one scene must be generated. Therefore, at the time of shooting, parallax images must be acquired by two or more cameras that are appropriately installed and controlled, which is expensive. Also, when an image is artificially synthesized by computer graphics or the like, the cost for generating a parallax image is high.

  Various methods for generating a parallax image based on a two-dimensional image have also been proposed. For example, a method has been proposed in which a plurality of images acquired with a time difference are used as a right eye image and a left eye image, respectively. In addition, for example, a method of generating a parallax image from a two-dimensional image by analyzing a two-dimensional image and allowing a user to add depth information has been proposed. However, both methods are complicated and involve manual work with human judgment, which is expensive.

  In addition, a method of presenting a stereoscopic image without giving parallax to the right-eye image and the left-eye image has been proposed (Patent Documents 1 to 3). However, none of the methods is clear about the specific processing for appropriately presenting a stereoscopic image. Furthermore, a stereoscopic video provided based on such a two-dimensional image may become unnatural at the right and left end portions of the screen.

  Therefore, an object of the present invention is to provide an image processing apparatus, a program, an image processing method, a recording method, and a recording medium that can solve the above-described problems. This object is achieved by a combination of features described in the independent claims. The dependent claims define further advantageous specific examples of the present invention.

  In order to solve the above problems, according to a first aspect of the present invention, there is provided an image processing apparatus for enabling a two-dimensional image to be displayed three-dimensionally, wherein the two-dimensional image is shifted left and right within a display area. A left side image and a right side image generating unit; a right end processing unit for adding a right end image displayed within a predetermined range from the right end of the display area to the right side of the left side image; and a left side of the right side image. A left end processing unit for adding a left end image displayed within a predetermined range from the left end of the display area; and outputting the left image to which the right end image has been added to a user's left eye, wherein the left end image And an output unit that outputs the added right image to the right eye of the user. Furthermore, a program and an image processing method for causing a computer to function as such an image processing apparatus are provided.

  Further, in the second aspect of the present invention, there is provided a recording method for recording an image for enabling a two-dimensional image to be displayed three-dimensionally, wherein the two-dimensional image is shifted left and right within a display area. Image data and right side image data are generated, a right end image displayed within a predetermined range from a right end of the display area is added to the right side of the left side image, and the display area is set to the left side of the right side image. The left end image displayed within a predetermined range from the left end of the image is added, and the image data of the left image to which the right end image is added is read by the playback device in the recording medium and output to the left eye of the user The image data of the right image with the left end image added to the left image data recording area that holds the image to be read is read by the playback device in the recording medium and is applied to the right eye of the user. To provide a recording method for recording the right image data recording area for holding image output. Furthermore, a recording medium recorded by such a recording method is provided.

  The above summary of the invention does not enumerate all the necessary features of the present invention, and sub-combinations of these feature groups can also be the invention.

  Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. In addition, not all the combinations of features described in the embodiments are essential for the solving means of the invention.

  FIG. 1 shows a configuration of an image processing apparatus 10 according to the present embodiment. The image processing apparatus 10 is an apparatus for enabling a given two-dimensional image to be displayed in a three-dimensional manner. More specifically, the image processing device 10 generates an image to be output to the user's right eye and an image to be output to the user's left eye based on the given two-dimensional image, and the display device To display. The given two-dimensional image may be a still image or a moving image including a plurality of still images that are temporally continuous.

  The image processing apparatus 10 includes a generation unit 20, a right end processing unit 22, a left end processing unit 24, and an output unit 30. For example, the generation unit 20 receives a two-dimensional image from a reproduction device that reproduces data from a recording medium or a reception device that receives transmitted data.

  The generation unit 20 generates a left image and a right image obtained by shifting the two-dimensional image left and right within the display area by a distance equal to or less than the inter-pupil distance. For example, the generation unit 20 generates a left image and a right image based on the same two-dimensional image.

  Here, the interpupillary distance is the distance between the human pupils (40 mm to 90 mm), and when the left image and the right image are displayed at positions separated by the distance, the human image of the left image viewed by the left eye is displayed. The distance is such that the display object and the display object of the right image viewed with the right eye can be merged and recognized as one image, and the merged image can be recognized at infinity. In this case, the eyes of the viewer's eyes are parallel. Therefore, it is desirable that the generation unit 20 generates a left image and a right image in which the two-dimensional image is shifted left and right by a distance greater than 0 and 90 mm or less in the display area.

  It should be noted that a human may be able to perform binocular fusion even with an object in a direction that is opened about 2 to 3 degrees to the left and right from the state where the eyes of both eyes are parallel. Therefore, the distance between the left image and the right image is 3 degrees or less (preferably 2 degrees) from the parallel state of the left eye to the left side, preferably 3 degrees or less (preferably from the parallel state of the right eye). (2 degrees) may be a distance shifted. The allowable amount that the distance between the left image and the right image may deviate from the interpupillary distance increases as the distance between the viewer and the display surface increases.

  The display area is an area of an image display portion in a display device that provides a stereoscopic image to the user. More specifically, for example, the display area is an area formed on one screen such as a display area of a television device or one window area displayed in a computer monitor. Further, for example, the display area may be an area formed by two screens such as a display surface of a head mounted display. As an example, the generation unit 20 generates a left image so that the distance between the left image and the right image on the display area is the interpupillary distance according to the pixel size of the given two-dimensional image and the size of the display area. The distance on the data between the right side image and the right side image may be changed.

  For example, the generation unit 20 generates the left image by shifting the original two-dimensional image leftward. Further, as an example, the generation unit 20 generates the right image by shifting the original two-dimensional image in the right direction. For example, the generation unit 20 may delete a portion of the left image generated by shifting the original two-dimensional image in the left direction and extending beyond the left boundary of the display area to the left. As an example, the generation unit 20 may delete a portion of the right image generated by shifting the original two-dimensional image in the right direction and protruding beyond the right boundary of the display area.

  Further, when the image processing apparatus 10 provides a stereoscopic image by a display device having one display area, the generation unit 20 selects one of the horizontal lines of the display area alternately in a predetermined direction in the vertical direction. An image displayed on the horizontal line (for example, even lines) is a left image. Further, in this case, the generation unit 20 sets the image displayed on the other horizontal line (for example, odd line) when the horizontal lines of the display area are alternately selected by a predetermined number in the vertical direction as the right image.

  Further, when the image processing apparatus 10 provides a stereoscopic image by a display device having one display area, the generation unit 20 selects one of the frames included in the moving image alternately by a predetermined number in time order. Let the image displayed in the frame (for example, even frame) be the left image. Further, in this case, the generation unit 20 sets the image displayed in the other frame (for example, odd frame) when the frames included in the moving image are alternately selected by a predetermined number in time order as the right image.

  When the image processing apparatus 10 provides a stereoscopic image to the user using a display device having a left-eye display surface and a right-eye display surface such as a head-mounted display, the generation unit 20 displays the left-eye display. The image displayed on the screen is the left image. In this case, the generation unit 20 sets the image displayed on the right-eye display surface as the right image.

  Further, as an example, the generation unit 20 may perform processing for generating a left image and a right image by computer software calculation. Alternatively, the generation unit 20 may perform image processing in real time on a video signal transmitted or played back in real time.

  The right end processing unit 22 adds a right end image displayed within a predetermined range from the right end of the display area to the right side of the left image. For example, the right end processing unit 22 adds the right end image to a blank portion on the right side of the left image obtained as a result of shifting the original two-dimensional image to the left. A specific example of the right end image added by the right end processing unit 22 will be described later in detail.

  The left end processing unit 24 adds a left end image displayed within a predetermined range from the left end of the display area to the left side of the right image. For example, the left end processing unit 24 adds the left end image to the left blank portion of the right image obtained as a result of shifting the original two-dimensional image in the right direction. A specific example of the left end image added by the left end processing unit 24 will be described later in detail.

  The output unit 30 has a display area where an area in which the left image and the right image are not displayed in an overlapping manner is located outside the effective visual field of the user. And the output part 30 outputs the left side image to which the right end image was added with respect to a user's left eye by this display area. Further, the output unit 30 outputs the right image to which the left end image is added to the right eye of the user using this display area.

  For example, the output unit 30 may be configured to display the left image and the right image in a display area formed on a single screen such as a stationary liquid crystal display. Instead of this, the output unit 30 may be configured to separately display the left image and the right image in each of display areas formed by two screens such as a head-mounted display.

  In the present embodiment, the output unit 30 includes a display unit 32 and stereoscopic glasses 34. The display unit 32 includes a plurality of pixels arranged in a two-dimensional matrix, and has a display area in which pixel lines for displaying an image are alternately arranged for the left eye and the right eye of the user. The stereoscopic glasses 34 give the image displayed by the pixel line for the right eye of the display unit 32 only to the right eye, and give the image displayed by the pixel line for the left eye of the display unit 32 only to the left eye. . When the output unit 30 includes such a display unit 32 and stereoscopic glasses 34, the generation unit 20 generates a left image from each pixel of the two-dimensional image corresponding to each pixel line for the left eye in the display area. The right image is generated by shifting each pixel of the two-dimensional image corresponding to each pixel line for the right eye in the display area to the right. Since such a generation unit 20 can generate the left image and the right image by shifting the pixel data in the horizontal direction in units of pixel lines, the circuit configuration can be simplified.

  As an example, the display unit 32 emits circularly polarized light in the first rotation direction from the pixel line for the left eye. Further, as an example, the display unit 32 emits circularly polarized light in the second rotation direction that is reverse to the circularly polarized light in the first rotation direction from the pixel line for the right eye. The display unit 32 displays the left image using the left eye pixel line, and displays the right image using the right eye pixel line.

  Further, as an example, the stereoscopic glasses 34 include a left-eye polarizing filter disposed on the left eye of the user that transmits circularly polarized light in the first rotational direction and blocks circularly polarized light in the second rotational direction, A right-eye polarizing filter disposed on the right eye of the user that transmits circularly polarized light in two rotational directions and blocks circularly polarized light in the first rotational direction. Thus, the stereoscopic glasses 34 give the left image displayed by the left eye pixel line of the display unit 32 only to the left eye, and the right image displayed by the right eye pixel line of the display unit 32 by the right eye. Can only be given to.

  The output unit 30 may have any configuration as long as the left image can be given only to the user's left eye and the right image can be given only to the user's right eye. For example, the output unit 30 may include a display device that alternately displays the left image and the right image in terms of time and glasses with shutters that have a shutter synchronized with the display device. In this case, the glasses with shutters open the left eye shutter and close the right eye shutter during the period when the left image is displayed, and open the right eye shutter and close the left eye during the period when the right image is displayed. Close the shutter. According to such an output unit 30, the left image can be given only to the user's left eye, and the right image can be given only to the user's right eye.

  The output unit 30 may be a head-mounted display having a left-eye display surface and a right-eye display surface. The output unit 30 is a device that displays the left image only on the user's left eye and the right image only on the user's right eye using color filters or spectral characteristic differences, deflection direction differences, and the like. May be.

  As described above, according to the image processing apparatus 10, a stereoscopic image is generated by shifting the two-dimensional image to the left and right. Thereby, according to the image processing apparatus 10, it is a very simple process and can provide a stereo image to a user at low cost.

  FIG. 2 shows an example of display by the display unit 32. For example, in the display unit 32, when one horizontal line in the display area is alternately selected in the vertical direction, one (for example, even line) is the left-eye pixel line, and the other (for example, odd line) is the right. This is an ophthalmic pixel line. In this case, the generation unit 20 generates a left-side image from each pixel of the two-dimensional image corresponding to the left-eye pixel line in the display area of the display unit 32, and at the same time, the right-eye pixel line in the display area. A right-side image is generated from each pixel of the two-dimensional image corresponding to and supplied to the display unit 32. Accordingly, the display unit 32 uses the stereoscopic glasses 34 to give the left image displayed by the left eye pixel line only to the left eye and the right image displayed by the right eye pixel line as the right eye. Can only be given to.

  FIG. 3 shows an example of a display point on the left image, a display point on the right image, and an image perceived by the user. When a human is looking at a two-dimensional image at a short distance, the image given to the left eye and the right eye are not the same but have parallax. From this parallax, a human recognizes that what he is looking at is a two-dimensional image. Further, when a human is looking at an object at infinity (for example, 10 m or more), the image given to the left eye and the image given to the right eye are the same with no parallax. When a human is looking at infinity, there is no parallax between the image given to the left eye and the image given to the right eye. I feel a feeling.

  The image processing apparatus 10 generates a left-side image and a right-side image without parallax (that is, the same as each other) shifted to the left and right by the same distance as the distance between the pupils of the user. Then, the image processing apparatus 10 provides the left image to the user's left eye and the right image to the user's right eye. As a result, the image processing apparatus 10 can bring the user's left eye and right eye line of sight into parallel states, i.e., the user's line of sight is not congested (the left eye and right eye line of sight do not intersect). . Thereby, the image processing apparatus 10 can make the user look at infinity. That is, for example, as shown in FIG. 3, the image processing apparatus 10 allows the user to perceive both point A (black circle point) and point B (triangular point) as points located at infinity. .

  As described above, the image processing apparatus 10 can provide the user with a stereoscopic image by giving the user an image with no parallax to the left eye and the right eye while viewing the image at infinity. For example, the image processing apparatus 10 can give a sense of presence as if looking out from a window, for example, in a landscape image or the like. Further, the image processing apparatus 10 can give a real feeling as seen with a magnifying glass to an image taken at a short distance such as macro photography.

  The reason why the image processing apparatus 10 can give the image a sense of reality such as a sense of reality and a real feeling as described above is estimated as follows. Since the image processing apparatus 10 does not converge the user's line of sight, the image position cannot be specified by parallax. However, even when there is no parallax, the human estimates the position of the image from the actual size and angle of view of the object derived from common sense of experience. Then, humans unconsciously and instantaneously perform such position estimation, and obtain an actual size sense together with a stereoscopic effect. Therefore, it is estimated that the image processing apparatus 10 can give the image a realistic feeling as described above without converging the user's line of sight.

  Further, when a human sees a moving image, a far object feels small movement, and a nearby object feels large movement. When a human sees a moving image, he / she feels a three-dimensional effect more strongly in the movement of such an object than in parallax. Therefore, the image processing apparatus 10 can make the user feel a stereoscopic effect more strongly when displaying a moving image.

  Further, the image processing apparatus 10 does not generate a phenomenon called a writing effect, in which a plane appears to stand, and a phenomenon called a miniature garden effect, which reduces the feeling of spreading in the horizontal direction of the screen by emphasizing the depth and popping feeling. . Therefore, according to the image processing apparatus 10, it is possible to provide a stereoscopic image having a natural stereoscopic effect and a realistic sensation.

  Further, since the image processing apparatus 10 does not congest the user's line of sight, there is no discrepancy between visual convergence and adjustment, and discomfort can be reduced. Further, since the image processing apparatus 10 perceives a stereoscopic image at a position farther than the screen, it is possible to give the user a feeling of looking through a frame (for example, a window frame or a magnifying glass frame). Therefore, according to the image processing apparatus 10, a phenomenon in which an image that appears to pop out before the screen is unnaturally cut by the screen frame does not occur, and a natural stereoscopic image can be provided to the user.

  FIG. 4 shows an example of a non-corresponding area where only the user's effective visual field in the display area and one of the left image and the right image in the display area are displayed. In the left side portion of the display area, there is an area (non-corresponding area) where the left screen is displayed but the right screen is not displayed when a left image and a right image are generated by shifting one two-dimensional image left and right. . Similarly, in the right side portion of the display area, there is a non-corresponding area where the right screen is displayed but the left screen is not displayed. Such a non-corresponding region cannot provide a stereoscopic image to the user.

  In the human visual area, there are an effective visual field and a peripheral visual field. The effective visual field is excellent in resolving power and color detection, and the line of sight moves instantaneously and is used for conscious recognition and gaze. That is, the effective visual field is a range in which the user is conscious of viewing when watching a television image or a picture. Peripheral vision is sensitive to light and dark, but contributes little to cognitive understanding (eg, determining who a person is or reading a character).

  Therefore, it is preferable that the image processing apparatus 10 displays the left image and the right image on a display region whose size is such that the non-corresponding region is located outside the effective visual field. Thereby, the image processing apparatus 10 can prevent the user from consciously recognizing an image of a non-corresponding portion that cannot provide a stereoscopic image.

For example, the image processing apparatus 10 preferably displays the left image and the right image in the display region of a value whose width in the left-right direction is represented by the following formula (1). In Expression (1), W represents the width of the display area in the left-right direction. D represents the distance from the user's viewpoint to the display surface. L represents the distance between the pupils of the user. θ represents the angle of the effective visual field of the user. Note that θ is generally about 20 °.
W ≧ (3 × L) + (2 × D × sin (θ / 2)) (1)

  That is, the width W in the left-right direction in the display area is a value obtained by multiplying the sine value of the half of the effective visual field angle by a value twice the distance from the viewpoint to the display surface (2 × D × sin). (Θ / 2)) and a value (3 × L) three times the interpupillary distance are preferably equal to or greater than the sum.

  As described above, the generation unit 20 generates the left image and the right image when the display area has the horizontal width represented by the expression (1). Thereby, the image processing apparatus 10 can provide a natural stereoscopic image.

  As an example, the generation unit 20 generates a left image and a right image that are shifted to the left and right on the condition that the screen of the display unit 32 has a width W represented by Expression (1), and displays a stereoscopic image to the user. provide. The distance from the user's viewpoint to the display surface recommended for a wide-size (aspect ratio: 16: 9) television is about three times the screen vertical size from the center of the screen. Therefore, as an example, the generation unit 20 provides a stereoscopic image to the user on the condition that the display unit 32 is a wide television of 20 inches or more.

  FIG. 5 shows an example of the line of sight when the user is paying attention to the right end of the display area. When a human sees the display area, he / she usually pays attention to the center portion and does not pay attention to the end portion. Therefore, if the horizontal width of the display area has the value shown in Expression (1), the image processing apparatus 10 does not usually give the user a sense of discomfort.

  However, if the object of interest is displayed at the left or right edge of the display area, or if the object of interest moves from the center to the left or right edge, the human will be at the right or left edge of the display area. Pay attention to. When the user pays attention to the left end or right end of the display area and no convergence occurs, as shown in FIG. 5, the line of sight of one eye is inside the display area and the line of sight of the other eye is outside the display area. . Such a sense of incongruity that occurs at the end affects the overall monitoring feeling.

  Here, human beings do not have a sense of incongruity when looking at the scenery outside from the window frame. Therefore, the image processing apparatus 10 can provide a natural stereoscopic image at the right end and the left end of the display area by displaying the frame so that the user is aware of the frame.

  FIG. 6 shows an example of a left image to which a single color right end image is added and an example of a right image to which a single color left end image is added. For example, the right end processing unit 22 adds a right end image of a single color displayed within a predetermined range from the right end of the display area to the right side of the left image. As an example, the right end processing unit 22 adds a right end image of a dark color such as black or a light color such as white displayed within a predetermined range from the right end of the display area to the right side of the left image. As an example, the right end processing unit 22 outputs the right end image of a dark color such as black or a light color such as white in a blank portion on the right side of the left image in the display area, which can be a result of shifting the original two-dimensional image leftward. Append.

  For example, the left end processing unit 24 adds a left end image of a dark color such as black or a light color such as white displayed within a predetermined range from the left end of the display area to the left side of the right image. As an example, the left edge processing unit 24 shifts the left edge image of a dark color such as black or a light color such as white into the left blank portion of the right image in the display area, which can be obtained as a result of shifting the original two-dimensional image to the right. Append.

  The image processing apparatus 10 can display such that a frame is conscious at the right end and the left end in the display area by adding such a right end image and a left end image. As a result, the image processing apparatus 10 can provide the user with a natural three-dimensional image that looks like the scenery outside from the window frame.

  In addition, as an example, the right end processing unit 22 further provides a dark frame image such as black or a light color such as white having a width equal to or greater than the distance between the pupils on each of the left and right sides of the left image to which the right end image is added. Append. Similarly, as an example, the left end processing unit 24 displays a dark frame image such as black or white having a width equal to or greater than the distance between the pupils on each of the right and left sides of the right image to which the left end image is added. Add more. Thereby, the image processing apparatus 10 can display a clear frame in the display screen.

  FIG. 7 shows an example of a left image to which a right end image obtained by copying a part of the right image is added and an example of a right image to which a left end image obtained by copying a part of the left image is added. As an example, the right end processing unit 22 adds, as a right end image, a portion displayed within a predetermined range from the right end of the display area in the right image on the right side of the left image. As an example, the right end processing unit 22 copies a portion displayed within a range from the right end of the display area in the right image to a position corresponding to the right end of the left image, and adds it as the right end image to the right side of the left image. .

  Further, as an example, the left end processing unit 24 adds, as a left end image, a portion displayed within a predetermined range from the left end of the display area in the left image on the left side of the right image. As an example, the left end processing unit 24 copies a portion displayed within a range from the left end of the display area in the left image to a position corresponding to the left end of the right image, and adds it as the left end image to the left side of the right image. .

  When convergence occurs when attention is paid to the right end or left end of the display area, there is a problem of visual field struggle that is different between what is seen between the right eye and the left eye. In this case, the greater the distance between the image given to the right eye and the image given to the left eye, the greater the unnatural feeling given to humans. However, the image processing apparatus 10 according to this example gives the same image to the right eye and the left eye at the right end or the left end of the display area. Therefore, the image processing apparatus 10 according to the present example can provide an image that does not feel unnatural even when congestion occurs in the right end portion or the left end portion of the display area. it can. It should be noted that, in the central portion of the display area, the condition for fusion of both eyes is maintained, so that it is less likely that congestion will occur compared to the end portion.

  Further, as an example, the right end processing unit 22 may add an image obtained by blurring a portion displayed within a predetermined range from the right end of the display area in the right image to the right side of the left image as the right end image. For example, the left end processing unit 24 may add an image obtained by blurring a portion displayed within a predetermined range from the left end of the display area in the left image to the left side of the right image as the left end image.

  When images with different focus levels are given to the right eye and the left eye, a human feels the given image three-dimensionally. Therefore, such an image processing apparatus 10 can reduce the visual field struggle and make the user feel a three-dimensional effect when congestion occurs in the right end portion or the left end portion of the display area.

  For example, the right end processing unit 22 may use the color of the right end image as the average color of the portion of the right image that is displayed within a predetermined range from the right end of the display area. Further, in addition to or instead of this, the right end processing unit 22 may set the luminance of the right end image as the average luminance of the portion of the right image that is displayed within a predetermined range from the right end of the display area. For example, the left end processing unit 24 may use the color of the left end image as an average color of a portion of the left image displayed within a predetermined range from the left end of the display area. Further, in addition to or instead of this, the left end processing unit 24 may set the luminance of the left end image as the average luminance of a portion of the left image displayed within a predetermined range from the left end of the display area. Such an image processing device 10 can reduce the visual field struggle because images with the same hue or luminance can be given to the left eye and the right eye when congestion occurs in the right end portion or the left end portion of the display area. Can do.

  FIG. 8 shows an example of the left image enlarged in the right direction and an example of the right image enlarged in the left direction. As an example, the right end processing unit 22 enlarges the left image to the right and generates an image including the left image and the right end image. In this case, the right end processing unit 22 generates an image including the left image and the right end image by enlarging the left image to the right at a larger enlargement ratio as it is closer to the left and right ends. Further, in this case, the right end processing unit 22 may not enlarge the left image from a predetermined position (for example, the center position) of the left image.

  For example, the left end processing unit 24 enlarges the right image to the left and generates an image including the right image and the left end image. In this case, the left end processing unit 24 generates an image including the right image and the left end image by enlarging the right image to the left at a larger enlargement ratio as it is closer to the left and right ends. Furthermore, in this case, the right end processing unit 22 does not have to enlarge the right image from a predetermined position (for example, the center position) of the right image. The image processing apparatus 10 according to this example can provide a natural image in which images are continuous at the end.

  Further, the right end processing unit 22 and the left end processing unit 24 may enlarge the left image and the right image vertically according to the enlargement ratio in the right direction and the left direction. In this case, the right end processing unit 22 and the left end processing unit 24 delete the portions outside the display area in the left image and the right image as a result of enlarging vertically.

  Further, as an example, the right end processing unit 22 is a portion that is displayed on the right side of the left image within a predetermined range from the right end of the display area in the left image (for example, a pixel column for one column or several columns from the right end). May be added as a right end image. Further, as an example, the left end processing unit 24 is a portion displayed within a predetermined range from the left end of the display area in the right image on the left side of the right image (for example, a pixel column for one column or several columns from the left end). May be added as a left end image. Such an image processing apparatus 10 can provide a natural image in which images are continuous at the end.

  FIG. 9 shows an example of the configuration of the display unit 32 that displays the left image and the right image. The display unit 32 may include a physical outer frame unit 40 that covers a non-corresponding region where the left image and the right image do not overlap each other in the left image and the right image displayed on the display region. The outer frame portion 40 is, for example, a tape or the like that is directly attached on the display surface of the display portion 32. As a result, the image processing apparatus 10 can provide a natural stereoscopic image by hiding the non-corresponding portion of the image that cannot provide the stereoscopic image.

  FIG. 10 shows an example of the left image from which the left end portion is deleted, and an example of the right image from which the right end portion is deleted. For example, the right end processing unit 22 deletes a predetermined range on the right side of the right image instead of adding the right end image to the right side of the left image. Further, as an example, the left end processing unit 24 deletes a predetermined range on the left side of the left image instead of adding the left end image to the left side of the right image.

  Such an image processing apparatus 10 can display an image without a non-corresponding portion that cannot provide a stereoscopic image. Here, the display unit 32 outputs a dark color (for example, a black image) or the like from a portion where the image in the display area is deleted. Therefore, such an image processing apparatus 10 can provide a natural stereoscopic image as in the case where the same outer frame as that of FIG. 9 is provided.

  FIG. 11 shows an example in which a left image and a right image are generated after enlarging a two-dimensional image. For example, the image processing apparatus 10 may perform the following processing.

  First, the generation unit 20 enlarges the two-dimensional image left and right by a predetermined distance. For example, the generation unit 20 expands in the left-right direction so that the horizontal width becomes a distance obtained by adding the horizontal width of the display area and the inter-pupil distance. In this case, the generation unit 20 may enlarge the vertical direction of the two-dimensional image with the same enlargement ratio as that of the horizontal direction.

  Subsequently, the generation unit 20 generates a left image and a right image obtained by shifting the enlarged two-dimensional image left and right by a predetermined distance within the display area. For example, the generation unit 20 shifts the left image to the left by a distance corresponding to ½ of the inter-pupil distance, and shifts the right image to the right by a distance corresponding to ½ the inter-pupil distance.

  Subsequently, the right end processing unit 22 deletes a predetermined distance range on the right side of the right image instead of adding the right end image to the right side of the left image. As an example, the right end processing unit 22 deletes the range corresponding to the interpupillary distance from the right end of the right image.

  The left end processing unit 24 deletes a predetermined distance range on the left side of the left image instead of adding the left end image to the left side of the right image. As an example, the left end processing unit 24 deletes a range corresponding to the interpupillary distance from the left end of the left image.

  Such an image processing apparatus 10 can display an image without a non-corresponding portion that cannot provide a stereoscopic image. Therefore, such an image processing apparatus 10 can provide a natural stereoscopic image. Note that when the two-dimensional image is enlarged in the vertical direction, the image processing apparatus 10 deletes a portion of the left image and the right image that exceed the upper and lower boundaries of the display range.

  FIG. 12 shows a configuration of the image processing apparatus 10 according to a first modification of the present embodiment. Since the image processing apparatus 10 according to this modification employs substantially the same configuration and function as the image processing apparatus 10 shown in FIG. 1, members having substantially the same function and configuration are denoted by the same reference numerals, and the following differences are noted. Description is omitted except for the points.

  The image processing apparatus 10 according to this modification further includes a characteristic measurement unit 44. The characteristic measurement unit 44 measures the characteristic of the portion displayed in a predetermined range from the right end of the display area in the right image generated by the generation unit 20. In addition, the characteristic measurement unit 44 measures the characteristic of a portion displayed in a predetermined range from the left end of the display area in the left image generated by the generation unit 20. For example, the characteristic measurement unit 44 measures the spatial frequency, the average color, the rate of change per time, and the like in the corresponding part.

  The right end processing unit 22 according to the present example generates a right end image based on the image of the right part image based on the image of the part according to the characteristics of the part displayed within the predetermined range from the right end of the display area. Select whether to generate the right-most image with the set display conditions. Further, the left end processing unit 24 according to the present example generates a left end image based on the image of the part according to the characteristics of the part displayed within a predetermined range from the left end of the display area in the left image, Alternatively, it is selected whether to generate a left end image with a preset display condition. Here, the image of the preset display condition is, for example, a preset color image, a preset brightness image, a preset pattern image, or the like. Such an image processing device 10 determines whether to display a user without discomfort when congestion occurs or to display a frame to provide a natural stereoscopic image to the user. Can be switched according to

  For example, when the spatial frequency of a portion displayed in a predetermined range from the right end of the display area in the right image is equal to or higher than a reference value, the right end processing unit 22 generates a right end image based on the image of the portion. When the spatial frequency of the part is less than the reference value, a right end image with a preset display condition is generated. For example, when the spatial frequency of a portion displayed in a predetermined range from the left end of the display area in the left image is equal to or higher than a reference value, the left end processing unit 24 calculates the left end image based on the image of the portion. When the spatial frequency of the part is less than the reference value, a left end image with a preset display condition is generated. Such an image processing apparatus 10 displays an object that does not cause discomfort even when congestion occurs when an object of interest with a high spatial frequency is displayed at the edge of the display area. When a high attention object is not displayed, a natural stereoscopic image can be provided by displaying a frame.

  Further, as an example, when the average color of a portion displayed within a predetermined range from the right end of the display area in the right image is outside the reference range, the right end processing unit 22 generates a right end image based on the image of the portion. When the average color of the part is within the reference range, a right end image with a preset display condition is generated. Further, as an example, when the average color of a portion displayed within a predetermined range from the left end of the display area in the left image is outside the reference range, the left end processing unit 24 calculates the left end image based on the image of the portion. When the average color of the part is within the reference range, a left end image with a preset display condition is generated. Such an image processing apparatus 10 displays an object that does not cause discomfort even when congestion occurs when an attention object having a different color from the other part is displayed at the edge of the display area. When an object of interest having a color different from that of the part is not displayed, a natural stereoscopic image can be provided by displaying a frame.

  Further, it is assumed that the image processing apparatus 10 is an apparatus for stereoscopically displaying a plurality of continuous two-dimensional images included in a moving image. In this case, for example, when the rate of change per unit time of the portion displayed in the predetermined range from the right end of the display area in the right image is equal to or higher than the reference value, the right end processing unit 22 is based on the image of the portion. The right end image is generated, and when the change rate per time of the portion is less than the reference value, the right end image of the preset display condition is generated. For example, when the rate of change per unit time of a portion displayed within a predetermined range from the left end of the display area in the left image is equal to or higher than a reference value, the left end processing unit 24 is based on the image of the portion. A left end image is generated, and when the rate of change per time of the portion is less than a reference value, a left end image with a preset display condition is generated. Such an image processing apparatus 10 displays an object that does not cause discomfort even when congestion occurs when an object of interest with a large time change is displayed at the edge of the display area. When a large object of interest is not displayed, a natural stereoscopic image can be provided by displaying a frame.

  Further, the right end processing unit 22 and the left end processing unit 24, for example, according to distance information used in focus control at the time of shooting a given two-dimensional image, a value separately input by a moving image generator, or the like. The generation processing contents of the right end image and the left end image may be switched. For example, when a moving image is given, the right end processing unit 22 and the left end processing unit 24 may switch the generation processing contents of the right end image and the left end image according to the contents of the scene.

  FIG. 13 shows a configuration of an image processing apparatus 10 according to a second modification of the present embodiment. Since the image processing apparatus 10 according to this modification employs substantially the same configuration and function as the image processing apparatus 10 shown in FIG. 1, members having substantially the same function and configuration are denoted by the same reference numerals, and the following differences are noted. Description is omitted except for the points.

  The image processing apparatus 10 according to this modification further includes a line-of-sight measurement unit 46. The line-of-sight measurement unit 46 measures the user's line-of-sight direction. As an example, the line-of-sight measurement unit 46 detects the user's eyeball part from the user's face image obtained by an imaging sensor or the like attached to the display unit 32 and measures the user's line-of-sight direction. The line-of-sight measurement unit 46 may measure the user's line-of-sight direction with a sensor or the like provided in the stereoscopic glasses 34.

  The right end processing unit 22 according to this example is based on an image of a portion displayed within a predetermined range from the right end of the display area when the line-of-sight direction is shifted to the right from the reference range including the center of the display area. A right end image is generated, and when the line-of-sight direction is not shifted to the right from the reference range, a right end image with a preset display condition is generated. In addition, the left end processing unit 24 according to this example applies an image of a portion displayed within a predetermined range from the left end of the display area when the line-of-sight direction is shifted to the left from the reference range including the center of the display area. Based on this, a left end image is generated, and when the line-of-sight direction is not shifted to the left from the reference range, a left end image with a preset display condition is generated. Such an image processing apparatus 10 performs display so as not to cause discomfort even when congestion occurs when the user's line-of-sight direction is directed to the end of the display area, and the user's line-of-sight direction is the display area. If it is directed to the center portion of the image, a frame can be displayed to provide a natural stereoscopic image.

  FIG. 14 shows a configuration of an image processing apparatus 10 according to a third modification of the present embodiment. Since the image processing apparatus 10 according to this modification employs substantially the same configuration and function as the image processing apparatus 10 shown in FIG. 1, members having substantially the same function and configuration are denoted by the same reference numerals, and the following differences are noted. Description is omitted except for the points.

  The image processing apparatus 10 according to this modification further includes a set color storage unit 48. The set color storage unit 48 stores colors to be set in the right end image and the left end image.

  For example, the set color storage unit 48 stores a dark color such as black or a light color such as white. In addition, the set color storage unit 48 may store a color that is the same as or close to the color of the frame of the display device as an example. Moreover, the setting color memory | storage part 48 memorize | stores a different color on either side as an example. In addition, the set color storage unit 48 stores, for example, a color designated by the user.

  The right end processing unit 22 and the left end processing unit 24 according to this example set the colors of the right end image and the left end image to the colors stored in the setting color storage unit 48. Such an image processing apparatus 10 can display a right end image and a left end image of a color suitable for making the user aware of the frame or a color that reduces the visual field conflict.

  FIG. 15 shows a configuration of a recording / reproducing system 50 according to the present embodiment. The recording / reproducing system 50 generates data for enabling stereoscopic display from the two-dimensional image and records the data on the recording medium 100. The recording / reproducing system 50 reproduces data from the recording medium 100 and displays a stereoscopic image.

  The recording / reproducing system 50 includes a generating unit 20, a recording device 62, a reproducing device 64, and an output unit 30. The generation unit 20 and the output unit 30 have the same functions and configurations as the generation unit 20 and the output unit 30 described with reference to FIGS. The recording / reproducing system 50 may be configured without the output unit 30.

  The recording device 62 records the left image and the right image generated by the generation unit 20 on the recording medium 100. The playback device 64 reads the left image and the right image stored in the recording medium 100 and gives them to the output unit 30.

  The recording medium 100 records an image that is read by the playback device 64 and displayed three-dimensionally. The recording medium 100 has a left image data recording area and a right image data storage area. The left image data recording area is a left image of the left image and the right image generated by shifting the two-dimensional image left and right within the display area, and is read by the playback device 64 to the left eye of the user. The image data of the left image output in this way is held. The right image data recording area is a right image of the left image and the right image generated by shifting the two-dimensional image left and right within the display area, and is read by the playback device 64 to the right eye of the user. The image data of the right image output in this way is held.

  According to such a recording / reproducing system 50, a natural stereoscopic image can be generated by a simple process and recorded on the recording medium 100. Furthermore, according to the recording / reproducing system 50, it is possible to reproduce data from the recording medium 100 and provide a stereoscopic image to the user.

  FIG. 16 shows an example of a hardware configuration of a computer 1900 according to the present embodiment. A computer 1900 according to this embodiment is connected to a CPU peripheral unit having a CPU 2000, a RAM 2020, a graphic controller 2075, and a display device 2080 that are connected to each other by a host controller 2082, and to the host controller 2082 by an input / output controller 2084. Input / output unit having communication interface 2030, hard disk drive 2040, and CD-ROM drive 2060, and legacy input / output unit having ROM 2010, flexible disk drive 2050, and input / output chip 2070 connected to input / output controller 2084 With.

  The host controller 2082 connects the RAM 2020 to the CPU 2000 and the graphic controller 2075 that access the RAM 2020 at a high transfer rate. The CPU 2000 operates based on programs stored in the ROM 2010 and the RAM 2020 and controls each unit. The graphic controller 2075 acquires image data generated by the CPU 2000 or the like on a frame buffer provided in the RAM 2020 and displays it on the display device 2080. Instead of this, the graphic controller 2075 may include a frame buffer for storing image data generated by the CPU 2000 or the like.

  The input / output controller 2084 connects the host controller 2082 to the communication interface 2030, the hard disk drive 2040, and the CD-ROM drive 2060, which are relatively high-speed input / output devices. The communication interface 2030 communicates with other devices via a network. The hard disk drive 2040 stores programs and data used by the CPU 2000 in the computer 1900. The CD-ROM drive 2060 reads a program or data from the CD-ROM 2095 and provides it to the hard disk drive 2040 via the RAM 2020.

  The input / output controller 2084 is connected to the ROM 2010, the flexible disk drive 2050, and the relatively low-speed input / output device of the input / output chip 2070. The ROM 2010 stores a boot program that the computer 1900 executes at startup and / or a program that depends on the hardware of the computer 1900. The flexible disk drive 2050 reads a program or data from the flexible disk 2090 and provides it to the hard disk drive 2040 via the RAM 2020. The input / output chip 2070 connects the flexible disk drive 2050 to the input / output controller 2084 and inputs / outputs various input / output devices via, for example, a parallel port, a serial port, a keyboard port, a mouse port, and the like. Connect to controller 2084.

  A program provided to the hard disk drive 2040 via the RAM 2020 is stored in a recording medium such as the flexible disk 2090, the CD-ROM 2095, or an IC card and provided by the user. The program is read from the recording medium, installed in the hard disk drive 2040 in the computer 1900 via the RAM 2020, and executed by the CPU 2000.

  The program installed in the computer 1900 and causing the computer 1900 to function as the image processing apparatus 10 includes a generation module, a right end processing module, a left end processing module, and an output module. These programs or modules work on the CPU 2000 or the like to cause the computer 1900 to function as the generation unit 20, the right end processing unit 22, the left end processing unit 24, and the output unit 30, respectively.

  The information processing described in these programs is read into the computer 1900, and the generating unit 20, the right end processing unit 22, the left end processing, which are specific means in which the software and the various hardware resources described above cooperate with each other. The unit 24 and the output unit 30 function. And the specific image processing apparatus 10 according to the intended use is constructed | assembled by implement | achieving the calculation or processing of the information according to the intended use of the computer 1900 in this embodiment by these concrete means.

  As an example, when communication is performed between the computer 1900 and an external device or the like, the CPU 2000 executes a communication program loaded on the RAM 2020 and executes a communication interface based on the processing content described in the communication program. A communication process is instructed to 2030. Under the control of the CPU 2000, the communication interface 2030 reads transmission data stored in a transmission buffer area or the like provided on a storage device such as the RAM 2020, the hard disk drive 2040, the flexible disk 2090, or the CD-ROM 2095, and sends it to the network. The reception data transmitted or received from the network is written into a reception buffer area or the like provided on the storage device. As described above, the communication interface 2030 may transfer transmission / reception data to / from the storage device by a DMA (direct memory access) method. Instead, the CPU 2000 transfers the storage device or the communication interface 2030 as a transfer source. The transmission / reception data may be transferred by reading the data from the data and writing the data to the communication interface 2030 or the storage device of the transfer destination.

  The CPU 2000 is all or necessary from among files or databases stored in an external storage device such as a hard disk drive 2040, a CD-ROM drive 2060 (CD-ROM 2095), and a flexible disk drive 2050 (flexible disk 2090). This portion is read into the RAM 2020 by DMA transfer or the like, and various processes are performed on the data on the RAM 2020. Then, CPU 2000 writes the processed data back to the external storage device by DMA transfer or the like. In such processing, since the RAM 2020 can be regarded as temporarily holding the contents of the external storage device, in the present embodiment, the RAM 2020 and the external storage device are collectively referred to as a memory, a storage unit, or a storage device. Various types of information such as various programs, data, tables, and databases in the present embodiment are stored on such a storage device and are subjected to information processing. Note that the CPU 2000 can also store a part of the RAM 2020 in the cache memory and perform reading and writing on the cache memory. Even in such a form, the cache memory bears a part of the function of the RAM 2020. Therefore, in the present embodiment, the cache memory is also included in the RAM 2020, the memory, and / or the storage device unless otherwise indicated. To do.

  In addition, the CPU 2000 performs various operations, such as various operations, information processing, condition determination, information search / replacement, etc., described in the present embodiment, specified for the data read from the RAM 2020 by the instruction sequence of the program. Is written back to the RAM 2020. For example, when performing the condition determination, the CPU 2000 determines whether the various variables shown in the present embodiment satisfy the conditions such as large, small, above, below, equal, etc., compared to other variables or constants. When the condition is satisfied (or not satisfied), the program branches to a different instruction sequence or calls a subroutine.

  Further, the CPU 2000 can search for information stored in a file or database in the storage device. For example, in the case where a plurality of entries in which the attribute value of the second attribute is associated with the attribute value of the first attribute are stored in the storage device, the CPU 2000 displays the plurality of entries stored in the storage device. The entry that matches the condition in which the attribute value of the first attribute is specified is retrieved, and the attribute value of the second attribute that is stored in the entry is read, thereby associating with the first attribute that satisfies the predetermined condition The attribute value of the specified second attribute can be obtained.

  The program or module shown above may be stored in an external recording medium. As the recording medium, in addition to the flexible disk 2090 and the CD-ROM 2095, an optical recording medium such as DVD or CD, a magneto-optical recording medium such as MO, a tape medium, a semiconductor memory such as an IC card, and the like can be used. Further, a storage device such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet may be used as a recording medium, and the program may be provided to the computer 1900 via the network.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

  The order of execution of each process such as operations, procedures, steps, and stages in the apparatus, system, program, and method shown in the claims, the description, and the drawings is particularly “before” or “prior to”. It should be noted that the output can be realized in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the description, and the drawings, even if it is described using “first”, “next”, etc. for convenience, it means that it is essential to carry out in this order. It is not a thing.

1 shows a configuration of an image processing apparatus 10 according to the present embodiment. An example of the display by the display part 32 is shown. An example of a display point on the left image, a display point on the right image, and an image perceived by the user is shown. An example of a non-corresponding area in which only one of the effective visual field of the user in the display area and the left image or the right image in the display area is displayed is shown. An example of the line of sight when the user is paying attention to the right end of the display area is shown. An example of the left side image to which the right end image of a single color was added, and an example of the right side image to which the left end image of a single color was added are shown. An example of a left image to which a right end image obtained by copying a part of the right image is added and an example of a right image to which a left end image obtained by copying a part of the left image is added are shown. An example of the left side image expanded in the right direction and an example of the right side image expanded in the left direction are shown. An example of the structure of the display part 32 which displays a left side image and a right side image is shown. An example of the left side image from which the left end portion is deleted and an example of the right side image from which the right end portion is deleted are shown. An example in which a left image and a right image are generated after enlarging a two-dimensional image is shown. The structure of the image processing apparatus 10 which concerns on the 1st modification of this embodiment is shown. The structure of the image processing apparatus 10 which concerns on the 2nd modification of this embodiment is shown. The structure of the image processing apparatus 10 which concerns on the 3rd modification of this embodiment is shown. 1 shows a configuration of a recording / reproducing system 50 according to the present embodiment. 2 shows an exemplary hardware configuration of a computer 1900 according to an embodiment of the present invention.

DESCRIPTION OF SYMBOLS 10 Image processing apparatus, 20 production | generation part, 22 right end process part, 24 left end process part, 30 output part, 32 display part, 34 stereoscopic glasses, 40 outer frame part, 44 characteristic measurement part, 46 gaze measurement part, 48 setting Color storage unit, 50 recording / playback system, 62 recording device, 64 playback device, 100 recording medium, 1900 computer, 2000 CPU, 2010 ROM, 2020 RAM, 2030 communication interface, 2040 hard disk drive, 2050 flexible disk drive, 2060 CD- ROM drive, 2070 input / output chip, 2075 graphic controller, 2080 display device, 2082 host controller, 2084 input / output controller, 2090 flexible disk, 2095 CD-ROM

Claims (26)

An image processing apparatus for enabling a two-dimensional image to be displayed three-dimensionally,
A generating unit that generates a left image and a right image obtained by shifting the two-dimensional image left and right within a display region;
A right end processing unit for adding a right end image displayed within a predetermined range from the right end of the display area to the right side of the left side image;
A left end processing unit for adding a left end image displayed within a predetermined range from the left end of the display area on the left side of the right image;
An output unit that outputs the left image to which the right end image is added to a user's left eye, and outputs the right image to which the left end image is added to the user's right eye;
An image processing apparatus comprising:   The image processing apparatus according to claim 1, wherein the generation unit generates a left image and a right image based on the same two-dimensional image. The output unit includes a display unit including a plurality of pixels arranged in a two-dimensional matrix and having a display area in which pixel lines for displaying an image are alternately arranged for the left eye and the right eye of the user. ,
The generation unit generates the left-side image from each pixel of the two-dimensional image corresponding to each pixel line for the left eye in the display region, and the two-dimensional corresponding to each pixel line for the right eye in the display region. The image processing apparatus according to claim 1, wherein each pixel of the image is shifted to the right side to generate the right side image.   The image processing apparatus according to claim 1, wherein the generation unit generates the left image and the right image obtained by shifting the two-dimensional image left and right within a display area by a distance equal to or less than a distance between pupils.   The generation unit generates the left image and the right image that are shifted by a distance such that a left eye line of sight is 3 degrees or less to the left side from a parallel state and a right eye line of sight is 3 degrees or less to the right side from a parallel state. 5. The image processing apparatus according to 4.   The image processing device according to claim 4, wherein the generation unit generates the left image and the right image obtained by shifting the two-dimensional image by a distance greater than 0 and 90 mm or less in the left-right direction within the display region. The right end processing unit adds, to the right side of the left image, a portion displayed within a predetermined range from the right end of the display area in the right image as the right end image,
The left end processing unit adds, as the left end image, a portion of the left image that is displayed within a predetermined range from the left end of the display area on the left side of the right image. Image processing device. The right end processing unit adds, as the right end image, an image obtained by blurring a portion displayed in a predetermined range from the right end of the display area in the right image on the right side of the left image.
The left end processing unit adds, as the left end image, an image obtained by blurring a portion of the left image displayed within a predetermined range from the left end of the display area on the left side of the right image. An image processing apparatus according to claim 1. The right end processing unit enlarges the left image to the right to generate an image including the left image and the right end image,
The image processing apparatus according to claim 1, wherein the left end processing unit generates an image including the right image and the left end image by expanding the right image to the left. The right end processing unit generates an image including the left image and the right end image by enlarging the left image to the right with a larger enlargement ratio as it approaches the left and right ends,
The image processing apparatus according to claim 9, wherein the left end processing unit generates the image including the right image and the left end image by expanding the right image to the left with a larger enlargement ratio as the left and right ends are closer. The right end processing unit adds, to the right side of the left image, an image that repeats a portion displayed in a predetermined range from the right end of the display area in the left image in the right direction as the right end image,
The left end processing unit adds, to the left side of the right image, an image that repeats a portion displayed in a predetermined range from the left end of the display area in the right image in the left direction as the left end image. The image processing apparatus according to claim 10. The right end processing unit generates or presets the right end image based on the image of the part according to the characteristics of the part displayed in a predetermined range from the right end of the display area in the right image. Select whether to generate the rightmost image of the displayed display condition,
The left end processing unit generates the left end image based on an image of the left side image based on an image of the part according to the characteristics of the part displayed within a predetermined range from the left end of the display area, or is preset. The image processing apparatus according to claim 1, wherein the image processing apparatus selects whether to generate the left end image of the displayed condition. The right end processing unit generates the right end image based on the image of the right portion when the spatial frequency of the portion displayed within a predetermined range from the right end of the display area in the right image is equal to or higher than a reference value. , When the spatial frequency of the part is less than the reference value, generate the right end image of a preset display condition,
The left end processing unit generates the left end image based on the image of the left part when the spatial frequency of the part displayed within a predetermined range from the left end of the display area in the left image is equal to or higher than a reference value. The image processing device according to claim 12, wherein when the spatial frequency of the portion is less than a reference value, the left end image having a preset display condition is generated. The right end processing unit generates the right end image based on the image of the portion when the average color of the portion displayed in a predetermined range from the right end of the display region in the right image is outside the reference range. When the average color of the part is within the reference range, the right end image of the preset display condition is generated,
The left end processing unit generates the left end image based on the image of the left part when the average color of the part displayed within a predetermined range from the left end of the display area is outside the reference range in the left image. The image processing apparatus according to claim 12, wherein the left end image having a preset display condition is generated when an average color of the portion is within a reference range. The image processing apparatus is for enabling a plurality of continuous two-dimensional images included in a moving image to be displayed in a three-dimensional manner.
When the change rate per time of a portion displayed in a predetermined range from the right end of the display area in the right image is greater than or equal to a reference value, the right end processing unit, based on the image of the portion, When the rate of change per time of the part is less than a reference value, the right end image of the preset display condition is generated,
When the rate of change per unit time of a portion displayed within a predetermined range from the left end of the display area in the left image is equal to or greater than a reference value, the left end processing unit is configured to generate the left end image based on the image of the portion. The image processing device according to any one of claims 9 to 14, wherein the left end image of a preset display condition is generated when a change rate per time of the portion is less than a reference value. It further includes a line-of-sight measurement unit that measures the user's line-of-sight direction,
The right end processing unit, based on an image of a portion displayed within a predetermined range from the right end of the display region when the line-of-sight direction is shifted to the right from a reference range including the center of the display region. When a right end image is generated and the line-of-sight direction is not shifted to the right from the reference range, the right end image of a preset display condition is generated,
The left end processing unit, based on an image of a portion displayed within a predetermined range from the left end of the display region when the line-of-sight direction is shifted to the left from a reference range including the center of the display region. The image processing device according to claim 1, wherein a left end image is generated, and the left end image having a preset display condition is generated when the line-of-sight direction is not shifted to the left from the reference range. A set color storage unit for storing colors to be set in the right end image and the left end image;
The image processing apparatus according to any one of claims 1 to 16, wherein the right end processing unit and the left end processing unit set colors of the right end image and the left end image to colors stored in the set color storage unit. The right end processing unit sets the color of the right end image as an average color of a portion displayed in a predetermined range from the right end of the display area in the right image,
The image according to any one of claims 1 to 16, wherein the left end processing unit sets the color of the left end image as an average color of a portion of the left image displayed within a predetermined range from the left end of the display area. Processing equipment. The right end processing unit sets the luminance of the right end image as an average luminance of a portion displayed in a predetermined range from the right end of the display area in the right image,
The image according to any one of claims 1 to 18, wherein the left end processing unit sets the luminance of the left end image as an average luminance of a portion of the left image displayed within a predetermined range from the left end of the display area. Processing equipment. The right end processing unit deletes a predetermined range on the right side of the right image instead of adding the right end image to the right side of the left image,
The image processing apparatus according to any one of claims 1 to 19, wherein the left end processing unit deletes a predetermined range on the left side of the left image instead of adding the left end image to the left side of the right image. The generating unit generates the left image and the right image obtained by enlarging the two-dimensional image left and right by a predetermined distance, and shifting the enlarged two-dimensional image left and right by a predetermined distance within the display region,
The right end processing unit deletes a predetermined distance range on the right side of the right image instead of adding the right end image to the right side of the left image,
The image processing according to any one of claims 1 to 20, wherein the left end processing unit deletes a predetermined distance range on the left side of the left image instead of adding the left end image to the left side of the right image. apparatus. The image processing device according to any one of claims 1 to 21, wherein the generation unit generates the left image and the right image when the display area has a horizontal width represented by the following expression (1).
W ≧ (3 × L) + (2 × D × sin (θ / 2)) (1)
In Expression (1), W represents the horizontal width of the display area, D represents the distance from the user's viewpoint to the display surface, L represents the distance between the pupils of the user, and θ represents the effective visual field of the user. Represents an angle. A program for causing a computer to function as an image processing device for enabling stereoscopic display of a two-dimensional image,
The computer,
A generating unit that generates a left image and a right image obtained by shifting the two-dimensional image left and right within a display region;
A right end processing unit for adding a right end image displayed within a predetermined range from the right end of the display area to the right side of the left side image;
A left end processing unit for adding a left end image displayed within a predetermined range from the left end of the display area on the left side of the right image;
An output unit that outputs the left image to which the right end image is added to a user's left eye, and outputs the right image to which the left end image is added to the user's right eye;
Program to make it work. An image processing method for enabling a two-dimensional image to be displayed three-dimensionally,
Generating a left side image and a right side image in which the two-dimensional image is shifted left and right in a display area;
To the right side of the left side image, a right end image displayed within a predetermined range from the right end of the display area is added,
To the left side of the right side image, a left end image displayed within a predetermined range from the left end of the display area is added,
An image processing method for outputting the left image with the right end image added to a user's left eye and outputting the right image with the left end image added to a user's right eye. A recording method for recording an image for enabling a two-dimensional image to be displayed stereoscopically,
Generating left-side image data and right-side image data in which the two-dimensional image is shifted left and right within a display area;
To the right side of the left side image, a right end image displayed within a predetermined range from the right end of the display area is added,
To the left side of the right side image, a left end image displayed within a predetermined range from the left end of the display area is added,
The image data of the left image to which the right end image is added is recorded in a left image data recording area that holds an image that is read by a playback device and output to the user's left eye on a recording medium,
A recording method in which image data of the right image to which a left end image is added is recorded in a right image data recording area that holds an image that is read by a playback device and output to the right eye of a user on a recording medium. A recording medium on which an image that is read and displayed three-dimensionally by a playback device is recorded,
Of the left-side image and right-side image generated by shifting the two-dimensional image left and right within the display area, the left-side image to which the right-end image displayed within a predetermined range from the right end of the display area is added on the right side. A left image data recording area that holds image data of the left image that is read by the playback device and output to the left eye of the user;
Of the left-side image and right-side image generated by shifting the two-dimensional image to the left and right within the display area, the left-side image displayed within a predetermined range from the left end of the display area is added to the left side. A right image data storage area for holding image data of the right image read by the playback device and output to the right eye of the user;
A recording medium comprising:

Images