JP2008167310A - Naked eye stereoscopic vision image processing method, device, and recording medium recording operation program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a naked eye stereoscopic vision image processing method, device, and recording medium recording an operation program which can adjust a depth of a stereoscopic image after imaging for a more natural depth. <P>SOLUTION: A naked eye stereoscopic vision image processing device supplying multiple parallax images supplied from an imaging device (camera) 3 to a stereo image display device (display) 5 which enables a stereoscopic vision has a regarding point assigning means assigning a regarding point to the multiple parallax images, and a regarding point position change means of a regarding point changing pointer PP etc. which changes a depth position of the regarding point assigned by the regarding point assigning means. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an autostereoscopic image processing method and apparatus that adjusts the sense of depth of a stereoscopic image and enables autostereoscopic viewing without a sense of incongruity, and a recording medium on which an arithmetic program is recorded.

  In recent years, various techniques for enabling stereoscopic viewing of images with the naked eye have been provided. Recently, there have been some proposals that try to provide natural autostereoscopic images instead of vague stereoscopic images.

  For example, in the technique described in Patent Document 1, as a problem, in the parallax division method, two two-dimensional images in which parallax is generated by slightly shifting the viewpoint are obtained by “intersection method” or “parallel method”. When attempting to recognize as a single stereoscopic image, a case where a stereoscopic video cannot be enjoyed due to individual differences among humans is assumed.

  The technique described in Patent Document 1 is intended to alleviate the problem when it is not possible to recognize such an extremely unnatural image, that is, an image obtained by alternately synthesizing two slightly shifted images. is there.

  For example, in the technique described in Example 4 of Patent Document 1, in the “intersection method” of the parallax division method, the intersection point of the line of sight is calculated, and the position of the intersection point is notified to the user on the display screen. It has a function.

In other words, the technique described in Example 4 of Patent Document 1 attempts to eliminate whether or not to enjoy a stereoscopic video image due to individual differences by notifying the intersection point of line of sight.
JP 2005-318421 A

  As described above, the conventional stereoscopic video display device only solves the problem in a specific method, for example, the “intersection method” of the parallax division method, and has a more natural depth feeling in autostereoscopic image display. No parallax image that can be viewed stereoscopically is available. In addition, since it is generally recognized that processing for parallax images obtained from a camera is usually set or processed before or during imaging, such as changing the optical axis of a camera, adjustment of parallax after imaging, etc. It was not assumed at all to perform the process.

  The present invention has been made in view of such a technical problem, and an object of the present invention is to control a depth position of a stereoscopic image after shooting and provide a stereoscopic image information with a more natural depth feeling. An object of the present invention is to provide a visual image processing method and apparatus and a recording medium on which an arithmetic program is recorded.

  In order to solve the above-described problem, the autostereoscopic image processing method according to claim 1 supplies the multi-parallax image supplied from the image supply unit to a stereoscopic image display device that enables stereoscopic viewing with the naked eye. The point is that the point of interest is given to an arbitrary depth position of a stereoscopic image obtained from the multi-parallax image.

  According to the autostereoscopic image processing method of claim 1, it is possible to control the sense of depth of a stereoscopic image that could not be changed after photographing, and to provide stereoscopic image information with a more natural sense of depth.

  The autostereoscopic image processing method according to claim 2 processes a multi-parallax image supplied from an image supply unit including a plurality of cameras installed so that optical axes thereof are parallel to each other, thereby A method for processing an autostereoscopic image when supplying to a stereoscopic image display device that enables stereoscopic viewing at a point of view, which adds a gazing point to an arbitrary depth position of a stereoscopic image obtained from the multi-parallax image. The gist of the present invention is to include a process and a gaze point position changing step for changing the depth position of the gaze point given in the gaze point giving step.

  According to the autostereoscopic image processing apparatus of the second aspect, it is possible to provide a more natural stereoscopic image information by controlling the depth feeling of the stereoscopic image that could not be changed after the imaging, after the imaging.

  The autostereoscopic image processing apparatus according to claim 3 is an autostereoscopic image processing apparatus for supplying a multi-parallax image supplied from an image supply unit to a stereoscopic image display apparatus that enables stereoscopic viewing with the naked eye. The gist of the invention is to include gaze point position changing means for changing the depth position of the gazing point set for the stereoscopic image obtained from the multi-parallax image to an arbitrary depth position.

  The autostereoscopic image processing apparatus according to claim 4 processes a multi-parallax image supplied from an image supply unit and supplies the autostereoscopic image to a stereoscopic image display apparatus that enables stereoscopic viewing with the naked eye. A processing apparatus, a gazing point giving unit that gives a gazing point to an arbitrary depth position of a stereoscopic image obtained from the multi-parallax image, and a gazing point that is given by the gazing point giving unit. The gist of the present invention is to provide viewpoint position changing means.

  The autostereoscopic image processing apparatus according to claim 5 is configured such that the image supply unit according to any one of claims 3 and 4 includes a plurality of imaging units installed so that respective optical axes are parallel to each other. The gist is that

  The autostereoscopic image processing apparatus according to claim 6, wherein the process of giving a gazing point to an arbitrary depth position according to claim 5 or the process of changing the depth position of the gazing point constitutes the image supply unit. The gist is to calculate the lateral movement amount of the position of the gazing point when the optical axis of each camera to be artificially tilted to the gazing point and reflect this movement amount in the multi-parallax image.

  The autostereoscopic image processing apparatus according to claim 7, wherein the gazing point position changing unit according to any of claims 3 to 6 is temporarily displayed on the screen of the stereoscopic image display apparatus in a normal state or during operation. The gist is to change the position of the gazing point to the depth position indicated by the gazing point changing pointer.

  The autostereoscopic image processing apparatus according to claim 8 is characterized in that the gazing point position changing means according to any one of claims 3 to 6 has a screen vertical direction on the screen of the stereoscopic image display apparatus in a normal state or during operation. The gist is to change the position of the point of gaze to the depth position indicated by moving the cursor for changing the point of gaze that is temporarily displayed.

  The autostereoscopic image processing apparatus according to claim 9, wherein the gazing point position changing unit according to any one of claims 3 to 6 is a gazing point changing cursor position displayed on the screen of the stereoscopic image display apparatus. The gist is to display the gazing point display line for changing the gazing point horizontally.

  The autostereoscopic image processing apparatus according to claim 10, wherein the gazing point position changing unit according to any of claims 3 to 6 is temporarily displayed on a screen of the stereoscopic image display apparatus in a normal state or during operation. The gist of the invention is to change the position of the gazing point to the depth position corresponding to the numerical value input in the numerical value input window for changing the gazing point.

  The autostereoscopic image processing apparatus according to claim 11 is a depth corresponding to a numerical value input by the gaze point position changing unit according to any of claims 3 to 6 to the numerical value input window for changing the gaze point. The gist is to display a gazing point display line for changing the gazing point horizontally at the position.

  The autostereoscopic image processing calculation program according to claim 12 is an autostereoscopic image processing calculation operation for supplying a multi-parallax image supplied from an image supply unit to a stereoscopic image display device that enables stereoscopic viewing with the naked eye. A program that includes a gazing point giving process for giving a gazing point to the multi-parallax image, and a gazing point position changing process for changing the depth position of the gazing point given in the gazing point giving process. The gist of this is to make the computer execute.

  The gist of a computer-readable recording medium according to a thirteenth aspect is that the autostereoscopic image processing arithmetic program according to the twelfth aspect is recorded.

  According to the autostereoscopic image processing method and apparatus of the present invention and the recording medium on which the arithmetic program is recorded, the depth feeling of the stereoscopic image that could not be changed after the photographing is controlled after the photographing so that a stereoscopic with a more natural depth sensation is achieved. Image information can be provided.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram showing the overall configuration of an autostereoscopic image processing system including a stereoscopic image processing apparatus according to the present invention.

  Referring to FIG. 1, a stereoscopic image processing apparatus 1 is provided between an imaging apparatus (camera) 3 and a stereoscopic image display apparatus (display) 5 as image supply means.

  In this embodiment, the imaging device 3 includes seven digital cameras fixed in a direction in which the optical axes are parallel to each other or seven CCDs in one housing (including the case where one CCD is divided into seven CCDs). ), And supplies uncompressed full HD high-definition images for seven cameras to the stereoscopic image processing apparatus 1 as multi-parallax images. In the present embodiment, the image pickup apparatus 3 including a plurality of cameras and the like will be described as an example. However, as an image supply unit, an image supply unit is supplied via broadcasting or a communication line, or supplied via a recording medium. Needless to say, what is provided and what supplies arbitrary images such as computer graphics (CG) are included as images.

  As will be described later, the stereoscopic image processing apparatus 1 performs image processing on the supplied multi-parallax image so as to enable autostereoscopic viewing, and outputs the processed image to the stereoscopic image display apparatus 5.

  The stereoscopic image display device 5 displays the processed image supplied from the stereoscopic image processing device 1 as an image capable of autostereoscopic viewing. The stereoscopic image display device 5 includes all displays capable of displaying a stereoscopic image that can be generated using a multi-parallax image as a source. For example, in a binocular display method, an anaglyph method, a shutter glass method, a deflection lens method, a lenticular A multi-lens display method includes a lenticular method, a micro lens array method (fly eye lens method), a parallax barrier method, and the like. Further, when the required number of parallaxes is insufficient, a stereoscopic view is possible by interpolating between the cameras and compensating for the required number of parallaxes.

  Next, the configuration of the stereoscopic image processing apparatus 1 will be described in detail.

  The disk storage device 11 is a large-capacity storage medium composed of a hard disk drive (HDD) or the like, and is a non-storage device from seven cameras (hereinafter also abbreviated as seven cameras) acquired from the imaging device 3. This is an apparatus for recording a compressed full HD high-definition image. In addition to a disk type such as DVD or MO (magneto-optical disk), a flash memory type using a semiconductor may be used to secure a higher access speed.

  The data compression / decompression device 13 performs, in real time, software or a dedicated chip to process, for example, multi-parallax images (in this embodiment, parallax images for seven cameras) recorded and accumulated in the disk storage device 11 into one file.

  The data compression / decompression device 13 is provided to compress and easily handle uncompressed full HD high-definition (full-spec high-definition) images for the current seven cameras. Specifically, since the data amount of seven full HD high-definition images without compression is 435.4 MB / second, the file size corresponding to the maximum transfer rate in the current personal computer (PC) is compressed. This makes it easy to secure the control area, shorten the access time to the data, and further record on the recording medium.

  The stereoscopic image editing device 15 is equipped with an auxiliary “stereoscopic image editing / synthesizing program” for the existing software as a base, and edits and synthesizes a stereoscopic image with the same feeling as an existing editing / synthesizing system. At this time, the stereoscopic image editing device 15 performs processing such as changing the stereoscopic effect (depth feeling) by changing the interval (parallax) of the cameras when generating a stereoscopic image by an algorithm described later.

  The data conversion device 17 performs image conversion to be displayed on the stereoscopic image display device in real time from multi-parallax image information.

  Next, with reference to FIG. 2 to FIG. 8, a gaze point changing process in the autostereoscopic image processing system in the present embodiment will be described.

  FIG. 2 shows the preconditions of the imaging conditions in the present embodiment. For convenience, the subject T, the camera, and the image content captured by each camera are shown as three sets (in this embodiment, originally seven cameras). 7 sets are needed to get a minute parallax image).

  In FIG. 2, as the subject T, the right subject TR on the right side and far from the camera side, the central subject TC at the center and intermediate distance, the left subject TL on the left side and closer, and the imaging device 3 as the subject T Three cameras C0, C1, C2 are shown. The three cameras C0, C1, C2 are arranged at equal intervals, and their optical axes are parallel.

  Furthermore, images I0, I1, and I2 captured by the cameras C0, C1, and C2 are shown as parallax images corresponding to the cameras C0, C1, and C2, respectively. For example, an image I1 obtained by imaging the subject T with the camera C1 includes a right subject image (TR) that is a captured image of the right subject TR from the right side and a central subject image (TC) that is an image captured of the central subject TC. ) And a left subject image (TL) that is a captured image of the left subject TL. Further, comparing the images I0, I1, and I2 shows that the images have parallax for each of the cameras C0, C1, and C2.

  Next, with reference to FIGS. 3 and 4, it will be described that a natural sense of depth can be obtained by a gaze point and a pseudo gaze point operation.

  FIGS. 3 and 4 (a) show the relationship between the images I0, I1 and I2 captured by the cameras C0, C1 and C2 and the gazing point (shown by dotted lines), and FIGS. 3 and 4 (b). 4 schematically shows a state in which the user U is looking at the right subject TR, the central subject TC, and the left subject TL via the display screen of the stereoscopic image display device 5 (display surface indicated by IL in the figure).

  Further, in FIG. 3 and FIG. 4B, “appropriate stereoscopic display area”, which is an area that the user U feels as a stereoscopic image with a natural sense of depth, is indicated by dotted lines. That is, the display screen IL is in the center of the front and rear of the “appropriate stereoscopic display area”, and is also a gaze point. Here, when the user U gazes, it is a gaze point because it is a point, but in reality, it is a surface in terms of sensation. Therefore, in FIG. 3 and FIG. The point of interest is shown in

  Referring to FIG. 3B, when the left subject TL has a gazing point (see FIG. 3A), the right subject TR is outside the “appropriate stereoscopic display area” for the user U. As a whole, it feels like a stereoscopic image with an unnatural depth.

  Therefore, as shown in FIG. 4B, the gaze point is brought to the central subject TC (see FIG. 4A). In this case, both the front side and the depth side are recognized as a stereoscopic image having a natural sense of depth.

  Next, the trimming area will be described with reference to FIGS.

  In FIG. 5, the optical axis of camera C is shifted 45 degrees, and three images (A1, A2, A3) are obtained. These three images (A1, A2, A3) are joined together to obtain one image. It shows a state of making a continuous image. FIG. 6 shows a case where the camera C is photographed while swinging from left to right. Even in this case, continuous images are obtained, and conversely, images (A4, A5) having the same effect as when simply panning are obtained.

  Next, referring to FIG. 7, in FIG. 7, the camera C <b> 1 and C <b> 2 are arranged so that their optical axes are parallel to each other, and the state of imaging is indicated by a dotted line, and the optical axes of the cameras C <b> 1 and C < A state of installation and imaging is shown by a two-dot chain line. In either case, a continuous image is obtained as in FIGS.

  In this experiment, a natural stereoscopic image is obtained due to the presence of a gazing point in the case of a two-dot chain line, while there is no gazing point in the case of a parallel optical axis indicated by a dotted line. It was found that an image with a sense of incongruity in the depth was obtained when the autostereoscopic viewing was performed. In such a case, it is possible to create an effect that gives a gazing point by trimming.

  Next, a pseudo gaze point operation will be described with reference to FIG. In this pseudo gazing point operation, as described with reference to FIGS. 5, 6, and 7, an gazing point is given to an arbitrary position with respect to an image photographed with a parallel optical axis, that is, an image without a gazing point. Therefore, it is possible to provide a stereoscopic image without a sense of incongruity, and by appropriately changing the gazing point given to an arbitrary position to an optimal position (gaze point operation), a stereoscopic image with a more natural depth feeling It is possible to provide.

  Conventionally, the control of the display depth position that could not be changed after shooting is performed by the stereoscopic image producer by performing a pseudo gaze point operation when displaying the stereoscopic image, so that the stereoscopic image displayed after shooting or after CG production is displayed. In the state where the depth information is maintained, the display depth position is moved back and forth so that an easily viewable stereoscopic image can be displayed and created.

  In FIG. 8, seven cameras C0, C1, C2, C3, C4, C5, and C6 are arranged at equal intervals (camera interval d). A distance between the imaging surface B of the central camera C0 and the gazing point A among the seven cameras is set as a gazing point distance D. In FIG. 3, the cameras C0, C1, C2, C3, C4, C5, and C6 are directed in the direction of the gazing point A, and the inclination angles thereof are θ0, θ1, θ2, θ3, θ4, and θ5 for the sake of explanation. , Θ6. In other words, the inclination of each optical axis with respect to the gazing point when the optical axes of the cameras C0, C1, C2, C3, C4, C5, and C6 are made parallel.

In an example arranged in this way, for an image obtained on an imaging device arranged in parallel at equal intervals (where atan = arctan),
atan (camera interval) ÷ (gazing distance) = (tilt angle)
(Image size (horizontal)) ÷ (angle of view) ÷ θ = (number of pixels to move (horizontal direction))
The arrangement X coordinate of each image is determined by the following formula, and each image is arranged and synthesized at the determined position. The composition method changes with each autostereoscopic display. As a result of adding “display depth position information” to the synthesized stereoscopic image and performing a pseudo gaze point operation, the “display depth position” of the stereoscopic image can be changed back and forth when displaying each display, resulting in an easily viewable stereoscopic image Can be generated while checking.

  Next, a method for changing the depth display position of a stereoscopic image will be described.

  First, in step S11, seven images taken from seven viewpoints are obtained by the seven cameras C of the imaging device 3 arranged so that the optical axes are parallel with an equal interval d. The seven images are temporarily stored in seven folders (set) provided for each of the seven cameras C of the imaging device 3 in the HDD (not shown) of the disk storage device 11. The stored image is compressed and decompressed by the data compression / decompression device 13 </ b> A in order to improve storability and handling, and is output to the stereoscopic image editing device 15.

  Next, in step S13, the stereoscopic image editing apparatus 15 inputs and executes camera information used at the time of shooting or CG production to the image movement amount calculation program, and calculates the lateral movement amount of each image.

Each image is read from the disk storage device 11 to the stereoscopic image editing device 15 via the data compression / decompression device 13A, and the calculation unit performs the calculation. As camera information to be input,
Camera interval (distance) unit: mm
Mm of lens; f
Image sensor width (CCD, CMOS, film, etc.) Unit: mm
Size of captured image (horizontal) Unit: Number of pixels Number of cameras used for photographing (number of viewpoints) Unit: Gaze point distance to be given in a simulated manner Unit: mm
There is. Further, as an operation performed by the CPU, this camera information is input and an equation in step S23 described later is calculated. After the calculation, the amount of movement of the image obtained from each camera is known, and accordingly, the display position of each image is moved in the horizontal direction.

  Next, in step S15, each image is moved in accordance with the calculated image movement amount, and a multi-viewpoint image is synthesized by a synthesis method suitable for each stereoscopic image display device. The image read into this PC is temporarily recorded in the memory, and the CPU synthesizes the image.

  Further, in step S17, the images are displayed on each stereoscopic image display device after being synthesized. The result calculated by the CPU (the result of synthesis by a synthesis method suitable for each stereoscopic image display device) is transferred to each display device through the GPU and displayed on each stereoscopic image display device.

  In step S19, if it is difficult to see at the time of stereoscopic image display, the gaze distance is arbitrarily changed, and the display depth position is changed. As in step S15, the image read into the PC is temporarily recorded in the memory, and the CPU again combines the images.

  In step S21, a natural stereoscopic image is displayed on each stereoscopic image display device. As in step S17, the result calculated by the CPU (the result synthesized by the synthesis method adapted to each stereoscopic image display device) is transferred to each display device through the GPU and displayed on each stereoscopic image display device.

  Note that the above work is repeated for each frame (ordinary video in Japan, 29.97 fps for televisions, etc.) and the above work is repeated to support moving images.

  Next, an image lateral movement calculation program will be described.

  First, in step S23, the following input is performed.

・ Enter the width of each image to be used for 3D image composition (for printing, mm, etc., for display on a monitor etc., change the unit depending on the output destination such as the number of pixels)
・ Enter the image sensor size w of the camera used during shooting or CG production (length of the vertical or diagonal line)
・ Enter the camera lens number f used during shooting or CG production ・ Enter the camera distance d used during shooting or CG production ・ Enter the number of cameras used during shooting or CG production (n = 7) -Entering a pseudo gaze distance Subsequently, in step S25, the angle of view (θ) of the camera used at the time of photographing is calculated.

{Atan ((w / 2) ÷ f)} × 2 = θ
In step S27, the angle θ of the optical axis of the camera is calculated in order to provide a pseudo gaze point from cameras arranged in parallel or at equal intervals.

{(D × (n−1)) / 2} + d × ((mth camera from the left) −1) = L
{Atan (L)} ÷ D = θ
However,
d; camera interval n; number of cameras D; gaze distance θ; camera tilt angle L; distance from the origin to camera m In step S29, the lateral movement amount of each captured image is calculated for each image.

{(Angle of view) ÷ θ} / (horizontal size of image) = (horizontal movement of image)
Thus, the lateral movement amount is calculated for the number of cameras used at the time of shooting.

  Next, the gaze point changing operation will be described with reference to FIGS.

  First, referring to FIG. 9, the display screen 5 a of the stereoscopic image display device 5 includes a right subject stereoscopic image I (TR), a center subject image I (TC), and a left subject image I (TL) that can be viewed with the naked eye. Is displayed. Further, (+) is a gazing point changing pointer PP.

  Here, the user U can view the stereoscopic image of the subject stereoscopic image I (right subject stereoscopic image I (TR), central subject image I (TC), left subject image I (TL) on the display screen 5a of the stereoscopic image display device 5. Suppose that the user sees the entire screen including the image and feels unnaturalness in the stereoscopic view.

  Therefore, the user U switches the display screen 5a to the gazing point change mode by right-clicking the mouse or the like, and displays the gazing point changing pointer PP on the display screen 5a. Next, the gazing point changing pointer PP is moved using the mouse, and the gazing point changing pointer PP is arranged at a position where there is no sense of incongruity and natural stereoscopic viewing is possible.

  In FIG. 9, the gazing point changing pointer PP is arranged on the central subject image I (TC), and thereby the gazing point position is moved to the central subject image I (TC) position. Since the gazing point movement process is performed in real time, the user U can change the gazing point while confirming the stereoscopic effect on the display screen 5a.

  At this time, the position of the gazing point changing pointer PP need not be on the subject image I (T), and is set between the right subject stereoscopic image I (TR) and the central subject image I (TC), for example. It doesn't matter. In this case, there may be no subject subject. In this case, the subject is positioned at a ratio corresponding to a position such as an intermediate distance between the right subject stereoscopic image I (TR) and the central subject image I (TC). Set it.

  Next, another example of changing the point of gaze will be described with reference to FIG.

  In the example shown in FIG. 10, the gazing point is changed using the gazing point changing cursor PC instead of the gazing point changing pointer PP shown in FIG.

  As in the example shown in FIG. 9, the user operation causes the gazing point changing cursor PC to be displayed on the display screen 5b, and the gazing point changing cursor PC is moved up and down with the mouse. As a result, the stereoscopic effect is changed, and the user U moves the gazing point changing cursor PC to a position where the stereoscopic vision of the subject image I (T) feels natural. Thereby, the gazing point position is moved to, for example, the center subject image I (TC) position.

  Since the gazing point movement process is performed in real time, the user U can change the gazing point while confirming the stereoscopic effect on the display screen 5b.

  Further, the gazing point changing gazing point display line PL that moves in conjunction with the vertical movement of the gazing point changing cursor PC may be displayed. By displaying this gazing point changing gazing point display line PL, the user U can visually know the position of the gazing point, and the gazing point can be changed more easily.

  It should be noted that the display position of the gazing point changing gazing point display line PL is not necessarily at the same position as the gazing point changing cursor PC in the vertical direction of the screen. This is natural according to the image content displayed on the display screen 5b, and is also effective for securing the maximum effective cursor length of the gazing point changing cursor PC.

  Next, another example of changing the point of gaze will be described with reference to FIG.

  In the example shown in FIG. 11, the gazing point is changed using the gazing point changing numerical input window PW instead of the gazing point changing pointer PP shown in FIG.

  As in the example shown in FIG. 9, the user operation causes the gaze point changing numerical value input window PW to be displayed on the display screen 5 c, and an arbitrary numerical value is manually input or a numerical value by pull-down in the gaze point changing numerical value input window PW. This is done by selecting the display. As a result, the effect of stereoscopic vision is changed, so that the user U operates and inputs the gaze point changing numerical value input window PW until the stereoscopic image of the subject image I (T) has a natural value. Thereby, the gazing point position is moved to, for example, the center subject image I (TC) position.

  Since the gazing point movement process is performed in real time, the user U can change the gazing point while confirming the stereoscopic effect on the display screen 5c.

  In addition, a gazing point changing gazing point display line PL that moves in conjunction with a numerical value input in the gazing point changing numerical value input window PW may be displayed. By displaying this gazing point changing gazing point display line PL, the user U can visually know the position of the gazing point, and the gazing point can be changed more easily.

  As described above, according to the present embodiment, when viewing a video based on an autostereoscopic image, the autostereoscopic image is visually displayed so that the user himself / herself becomes a more natural 3D image. It is possible to change while confirming.

  The autostereoscopic image processing calculation according to the embodiment of the present invention may be programmed and stored in a computer-readable recording medium. When performing autostereoscopic image processing, the recording medium is read into the stereo image processing apparatus 1 configured by a computer system, and the program is stored in a storage unit such as a memory in the stereo image processing apparatus 1 to By executing the stereoscopic image processing calculation program on the calculation device, the autostereoscopic image processing calculation system and method of the present invention can be realized. Here, the recording medium includes, for example, a computer-readable recording medium capable of recording a program such as a semiconductor memory, a magnetic disk, an optical disk, a magneto-optical disk, and a magnetic tape.

It is a block diagram which shows the structure of the whole system containing the autostereoscopic image processing apparatus of this invention. It is a figure which shows the content of the image imaged with the to-be-photographed object, the camera, and each camera. It is a figure explaining the change process of a gaze point. It is a figure explaining the change process of a gaze point. It is a figure explaining the change process of a gaze point. It is a figure explaining the change process of a gaze point. It is a figure explaining the change process of a gaze point. It is a figure explaining the change process of a gaze point. It is a figure explaining the change method of a gaze point. It is a figure explaining the change method of a gaze point. It is a figure explaining the change method of a gaze point.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Three-dimensional image processing apparatus 3 ... Imaging device (camera)
5 ... Stereoscopic image display device (display)
DESCRIPTION OF SYMBOLS 11 ... Disk storage apparatus 13 ... Data compression / decompression apparatus 15 ... Stereoscopic image editing apparatus 17 ... Data conversion apparatus A ... Gaze point B ... Imaging surface C ... Camera D ... Gaze point distance d ... Camera interval I ... Display image PP ... Gaze point Change pointer PC ... gazing point changing cursor PL ... gazing point changing gazing point display line PW ... gazing point changing numerical value input window T ... subject TR ... right subject TC ... center subject TL ... left subject (T) ... subject image (TR) ... right subject image (TC) ... center subject image (TL) ... left subject image

Claims (13)

An autostereoscopic image processing method for supplying a multi-parallax image supplied from an image supply means to a stereoscopic image display device that enables stereoscopic viewing with the naked eye,
An autostereoscopic image processing method, characterized in that a gazing point is given to an arbitrary depth position of a stereoscopic image obtained from the multi-parallax image. Process multi-parallax images supplied from image supply means composed of a plurality of cameras installed so that their optical axes are parallel to each other and supply them to a stereoscopic image display device that enables stereoscopic viewing with the naked eye A method for processing an autostereoscopic image when
A gazing point providing step of providing a gazing point at an arbitrary depth position of a stereoscopic image obtained from the multi-parallax image;
An autostereoscopic image processing method comprising: a gazing point position changing step of changing a depth position of a gazing point given in the gazing point giving step. An autostereoscopic image processing apparatus for supplying a multi-parallax image supplied from an image supply means to a stereoscopic image display apparatus that enables stereoscopic viewing with the naked eye,
An autostereoscopic image processing apparatus comprising gaze point position changing means for changing a gaze point depth position set for a stereoscopic image obtained from the multi-parallax image to an arbitrary depth position. An autostereoscopic image processing apparatus for processing a multi-parallax image supplied from an image supply means and supplying the stereoscopic image display apparatus that enables stereoscopic viewing with the naked eye,
Gazing point giving means for giving a gazing point to an arbitrary depth position of a stereoscopic image obtained from the multi-parallax image;
An autostereoscopic image processing apparatus comprising: a gazing point position changing unit that changes a depth position of the gazing point given by the gazing point giving unit. 5. The autostereoscopic image processing apparatus according to claim 3, wherein the image supply unit includes a plurality of imaging units installed so that optical axes thereof are parallel to each other. 6. The process of giving a gazing point to the arbitrary depth position or the process of changing the depth position of the gazing point,
Calculating a lateral movement amount of the gazing point position when the optical axis of each camera constituting the image supply unit is artificially tilted to the gazing point, and reflecting the movement amount in the multi-parallax image. The autostereoscopic image processing apparatus according to claim 5, wherein:   The gazing point position changing means changes the gazing point position to a depth position indicated by a gazing point changing pointer that is temporarily displayed on a screen of a stereoscopic image display device in a normal state or during operation. The autostereoscopic image processing apparatus according to claim 3.   The gazing point position changing means moves the gazing point position to the depth position indicated by moving the gazing point changing cursor displayed on the screen of the stereoscopic image display device in the vertical direction in a normal state or temporarily during operation. The autostereoscopic image processing device according to claim 3, wherein the autostereoscopic image processing device is changed.   7. The gazing point changing gazing point display line is horizontally displayed from a gazing point changing cursor position displayed on the screen of the stereoscopic image display device. The autostereoscopic image processing apparatus according to any one of the above.   The gazing point position changing means changes the gazing point position to a depth position corresponding to a numerical value input in a numerical value input window for changing the gazing point temporarily displayed on the screen of the stereoscopic image display device during normal operation or operation. The autostereoscopic image processing apparatus according to claim 3, wherein the autostereoscopic image processing apparatus is a naked eye stereoscopic image processing apparatus.   The gazing point position changing means displays a gazing point changing gazing point display line horizontally at a depth position corresponding to a numerical value input in the gazing point changing numerical value input window. The autostereoscopic image processing apparatus according to any one of the above. An autostereoscopic image processing calculation program for supplying a multi-parallax image supplied from an image supply means to a stereoscopic image display device that enables stereoscopic viewing with the naked eye,
A gazing point giving process for giving a gazing point to the multi-parallax image;
A gazing point position changing process for changing the depth position of the gazing point given in the gazing point giving process,
An autostereoscopic image processing calculation program for causing a computer to execute these processes.   A computer-readable recording medium on which the autostereoscopic image processing calculation program according to claim 12 is recorded.

Images