JP4259913B2 - Stereoscopic image processing apparatus, stereoscopic image processing program, and recording medium recording the program - Google Patents

Stereoscopic image processing apparatus, stereoscopic image processing program, and recording medium recording the program Download PDF

Info

Publication number
JP4259913B2
JP4259913B2 JP2003130711A JP2003130711A JP4259913B2 JP 4259913 B2 JP4259913 B2 JP 4259913B2 JP 2003130711 A JP2003130711 A JP 2003130711A JP 2003130711 A JP2003130711 A JP 2003130711A JP 4259913 B2 JP4259913 B2 JP 4259913B2
Authority
JP
Japan
Prior art keywords
parallax
stereoscopic image
amount
stereoscopic
range
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2003130711A
Other languages
Japanese (ja)
Other versions
JP2004349736A (en
Inventor
竜二 北浦
正宏 塩井
博明 矢部
敏男 野村
Original Assignee
シャープ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by シャープ株式会社 filed Critical シャープ株式会社
Priority to JP2003130711A priority Critical patent/JP4259913B2/en
Priority claimed from PCT/JP2004/005484 external-priority patent/WO2004093467A1/en
Priority claimed from CN200480010332A external-priority patent/CN100596209C/en
Publication of JP2004349736A publication Critical patent/JP2004349736A/en
Application granted granted Critical
Publication of JP4259913B2 publication Critical patent/JP4259913B2/en
Application status is Expired - Fee Related legal-status Critical
Anticipated expiration legal-status Critical

Links

Images

Description

[0001]
BACKGROUND OF THE INVENTION
When the stereoscopic image is enlarged or reduced, the amount of parallax changes, so that when the enlarged stereoscopic image becomes difficult to stereoscopically view or has a stereoscopic effect, the user is warned to that effect, The present invention relates to a stereoscopic image processing apparatus, a stereoscopic image processing program, and a recording medium on which the program is recorded.
[0002]
[Prior art]
Conventionally, various studies have been made on a three-dimensional display that enables stereoscopic display by displaying different images for the left eye and the right eye. In the old days, there is a method of adjusting the position of the lens of a camera, arranging a photograph corresponding to what is viewed from the left eye of a human and a photograph corresponding to viewing from the right eye, and viewing it through a binocular adapter. Recently, by combining a video camera and a liquid crystal shutter during recording, the right-eye image and the left-eye image are alternately recorded for each frame, and during playback, glasses using two liquid crystal shutters instead of the left and right binocular lenses are used. For example, there is a technique that enables stereoscopic display by alternately turning on / off the liquid crystal shutter.
[0003]
In such a method that enables stereoscopic viewing by observing different images between the left and right eyes, the distance between the corresponding points of the left and right images (hereinafter referred to as parallax) is comfortably three-dimensional. Although it can be seen, if the parallax increases, the images of both eyes will not be fused and stereoscopic viewing will not be possible. The magnitude of the parallax at this time has been reported, for example, according to “Guidelines for 3D Video” published by the Mechanical Systems Promotion Association in 2002.
[0004]
When displaying stereoscopic images that are difficult to view stereoscopically because the binocular images are not fused due to the large parallax, the parallax is adjusted by shifting the display position of the left and right images on the stereoscopic display, and the stereoscopic image is displayed in an easy-to-view manner. The method is disclosed in the following Patent Document 1 and Patent Document 2.
[0005]
[Patent Document 1]
JP 2000-78615 A [Patent Document 2]
JP-A-10-221775 [0006]
[Problems to be solved by the invention]
However, when the stereoscopic image according to the conventional technique is enlarged or reduced, there is a problem that the pop-out amount or the pull-in amount of the stereoscopic image changes, and a desired stereoscopic effect cannot be obtained.
[0007]
In the following, first, the principle of a stereoscopic display that performs stereoscopic viewing by displaying different images on the left and right eyes will be briefly described with reference to FIGS. 11 and 12. Each of these drawings is a schematic view of the stereoscopic display 1 as viewed from above when the user observing the binocular distance d is observed.
[0008]
In general, the distance between both eyes of the user is d [m], the distance between the user and the stereoscopic display 1 is D [m], the width of the display is W [m], the resolution of the display is P [dot], If the distance between corresponding points is l [dot],
The pop-up amount z [m] when the stereoscopic image pops out is
z = (l × W / P) × D / (d + (l × W / P)) (1)
The pull-in amount z [m] when the stereoscopic image is retracted is
z = (l × W / P) × D / (d− (l × W / P)) (2)
The parallax θ at this time is
θ = tan −1 (l / 2D) × 2 Equation (3)
It is expressed.
[0009]
When a stereoscopic image is enlarged or reduced on such a stereoscopic display, the amount of shift between the left and right images changes, and the stereoscopic effect changes. FIG. 11A illustrates a stereoscopic image before enlargement processing, and FIG. 11B illustrates a stereoscopic image after enlargement processing. When a stereoscopic image that pops out before the stereoscopic display as shown in FIG. 11A is enlarged, the pop-out amount increases as shown in FIG. Here, l ′ represents the left and right corresponding points after enlargement, and z ′ represents the pop-out amount after enlargement.
[0010]
As shown in FIG. 12A, when a stereoscopic image that is retracted deeper than the stereoscopic display is enlarged and displayed, the amount of pull-in increases, and depending on the enlargement ratio, both eyes are focused as shown in FIG. The stereoscopic view is not possible. On the contrary, when the stereoscopic image is reduced, the shift between the left and right images becomes small, so that the pop-out amount or the pull-in amount becomes small and the stereoscopic effect becomes weak.
[0011]
In this way, when a stereoscopic image is enlarged or reduced, the parallax increases when the image is enlarged, so that the pop-out becomes large.On the other hand, when the image is reduced, the pop-out becomes small because the parallax becomes small. If enlargement / reduction is performed by the same method as that of the two-dimensional image, there is a problem that a desired stereoscopic view cannot be achieved and confusion occurs, or an unreasonable stereoscopic view is caused and an eye strain is applied.
[0012]
It is an object of the present invention to warn a user when a stereoscopic image is enlarged or reduced, so that the amount of parallax changes. An object is to provide an image processing apparatus, a stereoscopic image processing program, and a recording medium on which the program is recorded.
[0013]
[Means for Solving the Problems]
The present invention relates to a parallax range acquisition unit that acquires a parallax range suitable for stereoscopic vision , a parallax amount acquisition unit that acquires a parallax amount of a stereoscopic image, and whether or not the parallax amount of the stereoscopic image is within the parallax range. Determining means for determining the parallax, parallax adjustment means for adjusting the parallax amount of the stereoscopic image, and designation means for designating a point of interest for adjusting the parallax amount ,
When the determination unit determines that the parallax amount of the stereoscopic image is not within the parallax range, the parallax adjustment unit preferentially sets the parallax amount acquisition range around the attention point designated by the designation unit. A stereoscopic image processing apparatus that performs reduction and adjusts a parallax amount by shifting the stereoscopic image.
[0014]
The stereoscopic image processing apparatus further includes an enlargement factor designating unit for enlarging or reducing the stereoscopic image and displaying the stereoscopic image enlarged or reduced according to the designated enlargement factor. amount of parallax you characterized by determining whether it is within the parallax range.
[0015]
Here, the determination unit may make a determination process about a partial area of the three-dimensional image.
[0016]
The front Symbol parallax range acquisition means uses the crosstalk capacity of the left and right images of a stereoscopic display for displaying the stereoscopic image, characterized in that to reduce the disparity range as crosstalk increases. Further, the parallax amount acquisition device is characterized by using the amount of maximum protrusion and maximum pull-in amount suitable for stereoscopic viewing is added in advance the stereoscopic image.
[0017]
In addition, the present invention is a stereoscopic image processing program that causes a computer to function as each of the above means.
[0018]
The present invention is also a computer-readable recording medium on which the program is recorded.
[0019]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[0020]
<First Embodiment>
In the first embodiment of the present invention, a personal computer (hereinafter abbreviated as a personal computer) performs a stereoscopic display process using a stereoscopic image display GUI application software to display a stereoscopic display on a stereoscopic display. That is, a CPU provided in a personal computer processes a moving image or a still image according to stereoscopic display application software recorded on a recording medium such as a CD-ROM or a hard disk, and displays the stereoscopic display on a stereoscopic display. Further, when the user gives an instruction regarding the three-dimensional processing using the mouse or the keyboard, the CPU performs processing based on the instruction.
[0021]
FIG. 1 is a diagram for explaining a display image on a stereoscopic display according to the first embodiment, and a processing display image 2 by a stereoscopic image display application is displayed on the display 1. The processing display image 2 of the stereoscopic image display application includes a stereoscopic image display area 3, an enlargement rate change bar 4, and a warning display area 5.
[0022]
As can be seen from FIGS. 11 and 12 used in the description of the prior art, when a stereoscopic image is displayed in an enlarged manner, both the pop-out amount that appears to pop out from the three-dimensional display and the pull-in amount that appears to be retracted deeper than the three-dimensional display are displayed. When it is enlarged and becomes larger than a certain threshold value, stereoscopic viewing becomes impossible. At this time, if the maximum pop-out amount and the maximum pull-in amount of the stereoscopic image to be displayed in advance are known, how much the pop-out amount and the pull-in amount of the three-dimensional image are determined according to the enlargement ratio according to the expressions (1) and (2). You will be asked if it will change. In the present embodiment, for example, a warning is given to the user when the projection of the stereoscopic image becomes strong and the user is burdened if the stereoscopic image is viewed for a long time.
[0023]
Next, the processing flow of the first embodiment will be described with reference to the flowchart of FIG.
[0024]
In step S1, display information is acquired. Here, the display information is a display width W [m], a display resolution P [dot], and a distance D [m] between the user and the display. The distance between the user and the display may be accurately obtained by using a position sensor or the like. For example, if the display size is 15 inches, the distance from the user is about 1 m. It is convenient to store the approximate distance in a database or the like in advance to determine how far away the user is depending on the distance.
[0025]
Also, in a stereoscopic display that displays different images on the left and right eyes to produce a stereoscopic effect, for example, when using separate display devices for the left and right eyes, such as an HMD, the left and right images are not mixed. In a barrier-type or lenticular-type three-dimensional display, an image viewed from the left eye of the user may be slightly overlapped with an image for the right eye. This is called crosstalk. In general, the better the stereoscopic display is, the less crosstalk there is, and the greater the crosstalk, the narrower the range for comfortable stereoscopic viewing. For this reason, crosstalk information may be included as display information, and when the crosstalk is large as described below, the range of parallax that can be comfortably stereoscopically viewed on a stereoscopic display may be reduced.
[0026]
Therefore, in step S2, a parallax range that can be stereoscopically viewed is acquired.
The CPU of the personal computer uses Equation (1), Equation (2), and Equation (3) to calculate the amount of parallax θ within the range that can be comfortably stereoscopically viewed at this time, based on the deviation of the left and right images. The pop-out amount th_f [dot] and the pull-in amount th_b [dot] within the range where stereoscopic viewing is possible are determined. Here, th_f and th_b are expressed as the distance (parallax) between corresponding points on the left and right on the stereoscopic display surface. As apparent from FIGS. 11 and 12, in the image popping out from the screen, the left eye image is on the right side of the right eye image, and in the image retracted from the screen, the left eye image is on the left side of the right eye image. The degree of deviation of the right eye image is obtained with reference to the left eye image, and the parallax value is positive when popping out (left eye image is on the right side), and the parallax value is negative when retracting (left eye image is on the left side).
[0027]
It can be said that the range of the parallax value from th_f to th_b is the maximum parallax range of stereoscopic display that allows comfortable stereoscopic viewing. Further, th_f and th_b are threshold values indicating the maximum parallax range, respectively.
[0028]
The parallax amount θ that can be stereoscopically viewed comfortably has been empirically determined by various studies, and is known to correlate with the size of the stereoscopic display and crosstalk. For example, when the range of θ that can be stereoscopically viewed comfortably when using a 15-inch stereoscopic display is 35 minutes for protrusion and 35 minutes for withdrawal, and the distance between both eyes of the user is 60 mm, the threshold value indicating the maximum parallax range for stereoscopic display is about th_f = 25, th_b = −25 [dot]. Accordingly, the parallax range in which stereoscopic viewing is possible is −25 ≦ θ ≦ 25. As a matter of course, this numerical value changes depending on the information of the display acquired in S1, and since it is a value obtained empirically only, the expressions (1), (2), and (3) are used. Instead, it is naturally conceivable that the value obtained by experimenting the display performance of the three-dimensional display is stored in advance in a database or the like and used by the CPU.
[0029]
In step S3, the maximum pop-out amount f [dot] and the maximum pull-in amount b [dot] of the stereoscopic image as a display source, that is, the maximum parallax amount of the stereoscopic image is acquired from the tag information of the stereoscopic image. Here, the tag information is additional information separately attached to the stereoscopic image, such as a shooting condition at the time of shooting. In the present embodiment, information on the maximum pop-out amount and the maximum pull-in amount of the stereoscopic image is added as tag information in advance. However, there is a method of automatically obtaining information on f and b by stereo matching, and tag information It is not limited to acquisition from. Here, f and b are expressed as the amount of parallax on the stereoscopic display surface. These values indicate the parallax range (parallax range) of the stereoscopic image.
[0030]
In step S <b> 4, the user inputs a ratio E [%] of enlargement or reduction of the stereoscopic image through the enlargement ratio change bar 4. The input of the enlargement ratio may be changed by pressing a specific keyboard, or may be changed by a mouse scroll bar, and is not limited to the enlargement ratio change bar. Further, the present invention can deal with not only enlargement processing but also reduction processing, and in step S5, the enlargement or reduction ratio can be acquired.
[0031]
In step S5, it is determined whether or not the parallax amount of the stereoscopic image is within a parallax range in which stereoscopic viewing is possible. The enlargement ratio E [%] obtained in step S4 is multiplied by the maximum pop-out amount f and the maximum pull-in amount b obtained in step S3, respectively, and the maximum pop-out amount f ′ = Ef [ dot] and the maximum pull-in amount b ′ = Eb [dot] of the stereoscopic image after enlargement are compared with th_f and th_b obtained in step S3, and within the parallax range in which stereoscopic vision is possible in step S5. It is determined whether or not. If the parallax amount of the stereoscopic image is within the parallax range, the process is terminated, and if the parallax amount of the stereoscopic image is outside the parallax range, the process proceeds to step S6.
[0032]
In step S6, the CPU of the personal computer determines that the amount of parallax of the stereoscopic image has deviated from the parallax range in which stereoscopic viewing is possible, “jumping is too strong”, “retraction is too strong”, “jumping is weak. Messages such as “Too much” and “Retraction is too weak” are determined and displayed in the warning display area 5. At this time, the message may be notified by voice, or the color of the stereoscopic image display area 3 may be changed. The warning to the user is not limited to the display of the message in the warning display area 5.
[0033]
In this embodiment, the parallax amount [dot], which is a shift between corresponding points of the left and right images, is used for the determination of the pop-out amount of the three-dimensional image. However, as shown in FIGS. It is obvious that the determination may be made using the amount z [m] that appears to jump out of the screen.
[0034]
<Second Embodiment>
A second embodiment of the present invention will be described.
The processing display image 6 of the stereoscopic display 1 in the second embodiment includes a stereoscopic image display area 3, an enlargement ratio change bar 4, and a warning display area 5, as shown in FIG.
[0035]
The processing flow of the second embodiment will be described with reference to the flowchart of FIG. Steps S1 to S5 are the same as those in the first embodiment.
[0036]
In step S16, as shown in FIG. 5, the pop-out correction (parallax amount adjustment) is performed. 5A shows the parallax range of the stereoscopic image before the enlargement process, FIG. 5B shows the parallax range of the stereoscopic image after the enlargement process, and FIG. 5C shows the parallax range of the stereoscopic image after the correction process. ing. In FIG. 5, the horizontal axis indicates the magnitude of the shift (dot) between the stereo corresponding points of the left and right images, and the hatched range indicates the range of parallax that can be comfortably stereoscopically viewed. The symbol indicates that the maximum pop-out amount of the stereoscopic image before enlarging processing is f, the pull-in amount is b, the maximum pop-out amount of the enlarged image is f ′, the pull-in amount is b ′, and the stereoscopic display can be comfortably viewed stereoscopically. The maximum pop-out amount is th_f and the pull-in amount is th_b. Even if the maximum pop-out amount f ′ of the enlarged image is larger than th_f, if f′−b ′ is smaller than th_f−th_b, the entire right image is shifted by f−th_f ′ as shown in FIG. Thus, the stereoscopic effect is corrected by displaying the entire stereoscopic image so as to be retracted from the stereoscopic display. In FIG. 6, a portion 6 surrounded by a broken line represents the original image, and a portion 7 surrounded by a solid line represents the image after the shifting process. However, when f′−b ′ is larger than th_f−th_b, the pop-out cannot be corrected by simply shifting the entire right image.
[0037]
Similarly, when the maximum pull-in amount b ′ of the enlarged image is smaller than th_b and f′−b ′ is smaller than th_f−th_b, the entire right image is shifted by b′−th_b. By displaying the entire stereoscopic image so as to jump out of the stereoscopic display, comfortable stereoscopic viewing becomes possible. When the shift amount is positive, the entire right image is shifted to the right, and when the shift amount is negative, the entire right image is shifted to the left.
[0038]
In this embodiment, the pop-up correction of the entire stereoscopic image is performed by shifting the right image, but it is not limited to shifting the right image, but the method of fixing the right image and shifting the left image, or both simultaneously shifting May be.
[0039]
Furthermore, when f′−b ′ is larger than th_f−th_b, the warning area displays “too strong to correct” or displays only one of the left and right images in the stereoscopic image display area. However, the warning display area 5 is not indispensable and it is not necessary to warn.
[0040]
In addition to correcting the stereoscopic effect at the time of enlargement processing, it is also possible to emphasize and display the stereoscopic effect by popping out or retracting a stereoscopic image that has been reduced in depth due to the reduction process. It is. For example, in step S16, as a process when the enlargement ratio in step S4 is smaller than 1, the stereoscopic image after the reduction process is shifted by ff ′ so as to protrude to the front from the display, thereby reducing the image after the reduction process. By making the maximum pop-up position the same as before processing, it is possible to make a three-dimensional image with a large pop-out feeling pop out greatly before the screen even after reduction. Conversely, the maximum pull-in position may be fixed and the pull-in amount may be the same without fixing the maximum pop-out position.
[0041]
<Third Embodiment>
A third embodiment of the present invention will be described.
The third embodiment is an improvement of the pop-out correction process (parallax amount adjustment process) in step S16 in the second embodiment.
[0042]
In the present embodiment, even when a comfortable stereoscopic view is impossible even if the entire stereoscopic image is shifted, the stereoscopic effect is adjusted by giving priority to the central portion of the stereoscopic image so that the stereoscopic view can be easily performed. Can be displayed. This utilizes the characteristic that human vision can clearly see objects in the center rather than the periphery of the visual field.
[0043]
In the third embodiment, steps S1 to S5 in the flowchart shown in FIG. 4 are the same as those in the second embodiment, but the parallax adjustment in step S17 is performed instead of the parallax adjustment in step S16. I do. That is, the processing from step S21 to step S26 in FIG. 7 is performed. The flow of processing at this time will be described below with reference to the flowchart of FIG.
[0044]
In step S21, the entire image is designated as the initial value of the parallax amount acquisition area of the stereoscopic image to be processed.
In step S22, in the parallax amount acquisition area, the protrusion amount and the pull-in amount for each pixel are compared, and the maximum pop-out amount f ′ and the maximum pull-in amount b ′ in the parallax amount acquisition area are acquired. In the present embodiment, information on the amount of popping out and the amount of pulling in is preliminarily added as tag information for each pixel of the image, but there is also a method for automatically obtaining each pixel by stereo matching. It is not limited to acquisition from. In addition, it is not necessary to obtain the pop-out amount and the pull-in amount for all the pixels, and a method for acquiring some characteristic pixels in the parallax amount acquisition area may be used.
[0045]
In step S23, it is determined whether or not stereoscopic viewing is possible by adjusting the amount of parallax for shifting the entire stereoscopic image. As shown in FIG. 6, by shifting by f−th_f ′, the entire stereoscopic image is displayed so as to be retracted from the stereoscopic display, thereby enabling comfortable stereoscopic viewing. However, when f′−b ′ is larger than th_f−th_b, the pop-out cannot be corrected by simply shifting the entire left and right images.
[0046]
Therefore, when f′−b ′ is larger than th_f−th_b, the CPU of the personal computer determines that stereoscopic viewing is not possible by adjusting the parallax amount, and reduces the parallax amount acquisition area in step S24. Then, the processing from step S22 is repeated again. In the present embodiment, as shown in FIG. 9, the entire stereoscopic image is set as an initial value in a range L1 (horizontal w1, vertical h2), and when correction processing cannot be performed in L1, L2 (horizontal w2, vertical h2). Is a range for performing the correction process, and when the correction process cannot be performed in L2, L3 (horizontal w3, vertical h3)... Is repeated. Here, wn = 0.9 × wn−1 and hn = 0.9 × hn−1 are set, but the present invention is not limited to this recurrence formula.
[0047]
Thus, if the CPU of the personal computer determines in step 23 that stereoscopic viewing is possible by adjusting the parallax amount, in step S25, the parallax amount is adjusted by shifting the stereoscopic image.
[0048]
As the point to adjust the stereoscopic effect, specify the object with the largest pop-out or the most focused object as the point of interest in advance, not the center of the screen, and adjust the stereoscopic effect with priority on the area around the point of interest. By doing so, it is possible to display so as to facilitate stereoscopic viewing.
[0049]
<Fourth embodiment>
Any of the embodiments described so far is not limited to applications on a personal computer, and can be implemented on a TV, a PDA, a mobile phone, or the like. This will be described below as a fourth embodiment of the present invention.
[0050]
As shown in FIG. 10, the fourth embodiment includes a stereoscopic image data supply unit 10, a data processing temporary storage unit 11, a stereoscopic image display unit 12, an enlargement ratio designation unit 13, a parallax adjustment unit 14, and a warning determination unit. 15 and a warning display unit 16.
[0051]
First, the color data and the parallax data for each pixel of the stereoscopic image data from the stereoscopic image data supply unit 10, the size and resolution of the display device, and the size of the crosstalk from the stereoscopic image display unit 12 are stored in the data processing storage unit. 11. Here, as the stereoscopic image data supply unit 10, data transmission by a magnetic disk, a semiconductor memory, a wired and a wireless network, or the like can be considered. As a temporary storage unit for data processing, a semiconductor memory or a magnetic disk mounted on a PDA, a mobile phone or the like can be considered.
[0052]
Next, the enlargement ratio designating unit 13 designates the enlargement ratio when displaying a stereoscopic image. As the enlargement ratio designating unit 13, a button for performing enlargement or reduction, a dial, or the like can be considered.
[0053]
The parallax adjustment unit 14 performs the same processing as steps S <b> 1 to S <b> 5 in the first embodiment on the stereoscopic image data stored in the data processing storage unit 11. That is, the display information stored in the data processing storage unit 11 is acquired, the stereoscopic view parallax range of the stereoscopic image data is acquired, and this is compared with the parallax amount of the stereoscopic image, so that the parallax amount of the stereoscopic image is obtained. Is within the parallax range in which stereoscopic viewing is possible.
[0054]
If it is out of the parallax range in which stereoscopic viewing is possible, the warning processing unit 15 warns the stereoscopic image display unit 12. The wording for warning display is stored in the data processing storage unit 11, and the warning processing unit 15 determines based on how much the parallax amount of the stereoscopic image deviates from the parallax range in which stereoscopic viewing is possible. In this way, the warning wording is temporarily stored in the data processing storage unit 11 and overlaid on the stereoscopic image display unit 12 for warning. For the warning, a warning dedicated display unit different from the stereoscopic image display unit 12 may be used, or a warning sound or the like may be given using a speaker or headphones.
[0055]
In addition, the parallax adjustment unit 14 also performs the processing of Step S16 in the second embodiment and Steps S21 to S26 in the third embodiment on the stereoscopic image stored in the data processing storage unit 11, The adjustment processed image is temporarily stored in the data processing storage unit 11 and then displayed on the stereoscopic image display unit 12.
[0056]
【The invention's effect】
According to the present invention, since it is determined whether or not the amount of parallax of a stereoscopic image is within a parallax range in which stereoscopic viewing is possible, it is possible to take a countermeasure when stereoscopic viewing is not possible. For example, a warning can be given to the user, or the amount of parallax of a stereoscopic image can be adjusted. Also, when enlarging / reducing a stereoscopic image, it is determined whether the parallax amount of the stereoscopic image is within a parallax range in which stereoscopic viewing is possible.
[0057]
Also, when stereoscopic viewing becomes difficult, consider the parallax amount of the entire or partial range of the stereoscopic image (for example, the maximum pop-out amount and the maximum pull-in amount) and the parallax range that allows comfortable stereoscopic viewing on the stereoscopic display. In addition, the parallax can be adjusted so that stereoscopic viewing can be performed as comfortably as possible.
[Brief description of the drawings]
FIG. 1 is an explanatory diagram showing a stereoscopic image GUI screen according to a first embodiment;
FIG. 2 is a flowchart illustrating a process according to the first embodiment.
FIG. 3 is an explanatory diagram showing a stereoscopic image GUI screen according to the second embodiment;
FIG. 4 is a flowchart illustrating a process according to the second embodiment.
FIG. 5 is an explanatory diagram illustrating a parallax amount of a stereoscopic image in a correction process.
FIG. 6 is an explanatory diagram illustrating correction of stereoscopic effect by changing the shift amount of the left and right images.
FIG. 7 is a flowchart illustrating a process according to the third embodiment.
FIG. 8 is a flowchart illustrating processing of step 17 according to the third embodiment.
FIG. 9 is an explanatory diagram illustrating a method of changing a parallax amount acquisition area.
FIG. 10 is a block diagram illustrating a three-dimensional processing apparatus according to a fourth embodiment.
FIG. 11 is a diagram illustrating pop-out of a stereoscopic image.
FIG. 12 is a diagram for explaining the confinement of a stereoscopic image.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 3D display 2, 6 Process display image of 3D image display application 3D image display area 4 Magnification rate change bar 5 Warning display area 10 3D image data supply unit 11 Data processing storage unit 12 3D image display unit 13 Magnification rate designation unit 14 Parallax adjusting unit 15 Warning processing unit

Claims (9)

  1. Parallax range acquisition means for acquiring a parallax range suitable for stereoscopic vision;
    Parallax amount acquisition means for acquiring the parallax amount of the stereoscopic image;
    Determination means for determining whether or not a parallax amount of the stereoscopic image is within the parallax range;
    Parallax adjusting means for adjusting the parallax amount of the stereoscopic image;
    A designation means for designating a point of interest for adjusting the amount of parallax;
    With
    The parallax range acquisition means uses the crosstalk capability of the left and right images of the stereoscopic display for displaying the stereoscopic image, and decreases the parallax range as the crosstalk increases.
    When the determination unit determines that the parallax amount of the stereoscopic image is not within the parallax range, the parallax adjustment unit preferentially sets the parallax amount acquisition range around the attention point designated by the designation unit. A stereoscopic image processing apparatus that performs reduction and adjusts a parallax amount by shifting the stereoscopic image.
  2. Further comprising an enlargement ratio designating means for displaying the stereoscopic image in an enlarged or reduced manner,
    2. The stereoscopic image processing according to claim 1, wherein the determination unit determines whether or not a parallax amount of the stereoscopic image enlarged or reduced according to the designated enlargement ratio is within the parallax range. apparatus.
  3.   The stereoscopic image processing apparatus according to claim 1, wherein the determination unit performs a determination process on a partial region of the stereoscopic image.
  4. The stereoscopic image processing apparatus according to any one of claims 1 to 3 , wherein the parallax amount acquisition unit uses a maximum pop-out amount and a maximum pull-in amount suitable for stereoscopic vision, which are added to the stereoscopic image in advance.
  5. Computer
    Parallax range acquisition means for acquiring a stereoscopically viewable parallax range;
    Parallax amount acquisition means for acquiring the parallax amount of the stereoscopic image;
    Determination means for determining whether or not a parallax amount of the stereoscopic image is within the parallax range;
    Parallax adjusting means for adjusting the parallax amount of the stereoscopic image;
    Function as a designation means to designate the point of interest for adjusting the amount of parallax,
    The parallax range acquisition means uses the crosstalk capability of the left and right images of the stereoscopic display for displaying the stereoscopic image, and decreases the parallax range as the crosstalk increases.
    When the determination unit determines that the parallax amount of the stereoscopic image is not within the parallax range, the parallax adjustment unit has a parallax amount acquisition range given priority to the periphery of the point of interest specified by the specification unit. A stereoscopic image processing program that reduces and adjusts the amount of parallax by shifting the stereoscopic image.
  6. Computer
    Further functioning as an enlargement ratio designating means for displaying the stereoscopic image enlarged or reduced,
    6. The stereoscopic image processing according to claim 5, wherein the determination unit determines whether or not a parallax amount of the stereoscopic image enlarged or reduced according to the designated enlargement ratio is within the parallax range. program.
  7. Said determination means three-dimensional image processing program according to claim 5 or 6, characterized in that a determination process about a partial area of the three-dimensional image.
  8. The three-dimensional image processing program according to any one of claims 5 to 7 , wherein the parallax amount acquisition unit uses a maximum pop-out amount and a maximum pull-in amount that are preliminarily added to the stereoscopic image and suitable for stereoscopic vision.
  9. A computer-readable recording medium storing a program according to claim 5 to 8.
JP2003130711A 2003-05-08 2003-05-08 Stereoscopic image processing apparatus, stereoscopic image processing program, and recording medium recording the program Expired - Fee Related JP4259913B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2003130711A JP4259913B2 (en) 2003-05-08 2003-05-08 Stereoscopic image processing apparatus, stereoscopic image processing program, and recording medium recording the program

Applications Claiming Priority (8)

Application Number Priority Date Filing Date Title
JP2003130711A JP4259913B2 (en) 2003-05-08 2003-05-08 Stereoscopic image processing apparatus, stereoscopic image processing program, and recording medium recording the program
PCT/JP2004/005484 WO2004093467A1 (en) 2003-04-17 2004-04-16 3-dimensional image creation device, 3-dimensional image reproduction device, 3-dimensional image processing device, 3-dimensional image processing program, and recording medium containing the program
US10/550,710 US7636088B2 (en) 2003-04-17 2004-04-16 3-Dimensional image creation device, 3-dimensional image reproduction device, 3-dimensional image processing device, 3-dimensional image processing program, and recording medium containing the program
EP04728007A EP1617684A4 (en) 2003-04-17 2004-04-16 3-dimensional image creation device, 3-dimensional image reproduction device, 3-dimensional image processing device, 3-dimensional image processing program, and recording medium containing the program
CN 201010114092 CN101841728B (en) 2003-04-17 2004-04-16 Three-dimensional image processing apparatus
KR1020057018993A KR100768837B1 (en) 2003-04-17 2004-04-16 3-dimensional image creating apparatus, 3-dimensional image reproducing apparatus, 3-dimensional image processing apparatus, and recording medium recorded with 3-dimensional image processing program
CN200480010332A CN100596209C (en) 2003-04-17 2004-04-16 3-dimensional image creation device
US12/604,242 US7889196B2 (en) 2003-04-17 2009-10-22 3-dimensional image creating apparatus, 3-dimensional image reproducing apparatus, 3-dimensional image processing apparatus, 3-dimensional image processing program and recording medium recorded with the program

Publications (2)

Publication Number Publication Date
JP2004349736A JP2004349736A (en) 2004-12-09
JP4259913B2 true JP4259913B2 (en) 2009-04-30

Family

ID=33524469

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2003130711A Expired - Fee Related JP4259913B2 (en) 2003-05-08 2003-05-08 Stereoscopic image processing apparatus, stereoscopic image processing program, and recording medium recording the program

Country Status (1)

Country Link
JP (1) JP4259913B2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012060243A (en) * 2010-09-06 2012-03-22 Fujifilm Corp Stereoscopic image display control device, and operation control method of the same and operation control program of the same

Families Citing this family (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100988894B1 (en) * 2005-11-17 2010-10-20 노키아 코포레이션 Method and devices for generating, transferring and processing three-dimensional image data
EP2914000A1 (en) * 2007-06-19 2015-09-02 Electronics and Telecommunications Research Institute Metadata structure for storing and playing stereoscopic data, and method for storing stereoscopic content file using this metadata
JP2010102137A (en) * 2008-10-24 2010-05-06 Fujifilm Corp Three-dimensional photographing device, method and program
JP5355208B2 (en) * 2009-05-01 2013-11-27 富士フイルム株式会社 Three-dimensional display device and digital zoom correction method
JP2010278878A (en) * 2009-05-29 2010-12-09 Fujifilm Corp Stereoscopic image device and display image switching method thereof
KR20110005205A (en) * 2009-07-09 2011-01-17 삼성전자주식회사 Signal processing method and apparatus using display size
JP5249149B2 (en) * 2009-07-17 2013-07-31 富士フイルム株式会社 Stereoscopic image recording apparatus and method, stereoscopic image output apparatus and method, and stereoscopic image recording and output system
JP5444955B2 (en) * 2009-08-31 2014-03-19 ソニー株式会社 Stereoscopic image display system, parallax conversion device, parallax conversion method, and program
AU2010288010A1 (en) * 2009-08-31 2011-03-03 Panasonic Corporation Stereoscopic vision control device, integrated circuit, stereoscopic vision control method
JP5444452B2 (en) 2010-03-05 2014-03-19 パナソニック株式会社 Stereo imaging device and stereo imaging method
WO2011108277A1 (en) 2010-03-05 2011-09-09 パナソニック株式会社 3d imaging device and 3d imaging method
JP5491617B2 (en) 2010-03-05 2014-05-14 パナソニック株式会社 Stereo imaging device and stereo imaging method
JP2011211450A (en) * 2010-03-30 2011-10-20 Victor Co Of Japan Ltd Three-dimensional video display device, three-dimensional video photographing device, and three-dimensional video display method
JP5186715B2 (en) 2010-06-14 2013-04-24 任天堂株式会社 Display control program, display control device, display control method, and display control system
WO2012005962A1 (en) 2010-06-28 2012-01-12 Thomson Licensing Method and apparatus for customizing 3-dimensional effects of stereo content
JP5292364B2 (en) * 2010-07-07 2013-09-18 株式会社ソニー・コンピュータエンタテインメント Image processing apparatus and image processing method
JP5675197B2 (en) * 2010-07-26 2015-02-25 オリンパスイメージング株式会社 Display device
JP5368399B2 (en) * 2010-09-17 2013-12-18 富士フイルム株式会社 Electronic album generating apparatus, stereoscopic image pasting apparatus, operation control method thereof, and program thereof
JP5612548B2 (en) * 2010-09-28 2014-10-22 富士フイルム株式会社 Stereoscopic image pasting system, operation control method thereof, and control program thereof
JP5723721B2 (en) 2010-09-28 2015-05-27 富士フイルム株式会社 Stereoscopic image editing apparatus and stereoscopic image editing method
JP2012090094A (en) * 2010-10-20 2012-05-10 Sony Corp Image processing device, image processing method, and program
WO2012060170A1 (en) * 2010-11-02 2012-05-10 シャープ株式会社 3d image display device
JP5002047B2 (en) * 2010-11-05 2012-08-15 シャープ株式会社 Stereoscopic image data playback device
JP2012103980A (en) * 2010-11-11 2012-05-31 Sony Corp Image processing device, image processing method, and program
JP5640680B2 (en) * 2010-11-11 2014-12-17 ソニー株式会社 Information processing apparatus, stereoscopic display method, and program
KR101727899B1 (en) * 2010-11-26 2017-04-18 엘지전자 주식회사 Mobile terminal and operation control method thereof
JP4951131B1 (en) 2011-02-21 2012-06-13 株式会社東芝 Image display device, image processing device, and image processing method
WO2012120880A1 (en) * 2011-03-10 2012-09-13 パナソニック株式会社 3d image output device and 3d image output method
JP2012205148A (en) * 2011-03-25 2012-10-22 Kyocera Corp Electronic apparatus
JP5765418B2 (en) * 2011-05-06 2015-08-19 富士通株式会社 Stereoscopic image generation apparatus, stereoscopic image generation method, and stereoscopic image generation program
CN103597822A (en) * 2011-06-06 2014-02-19 富士胶片株式会社 Image processing device, compound-eye imaging device, image processing method, and program
JP5972533B2 (en) * 2011-06-15 2016-08-17 東芝メディカルシステムズ株式会社 Image processing system and method
JP6113411B2 (en) * 2011-09-13 2017-04-12 シャープ株式会社 Image processing device
JP5281720B1 (en) 2011-09-20 2013-09-04 パナソニック株式会社 3D image processing apparatus and 3D image processing method
JP5181084B1 (en) 2012-01-27 2013-04-10 パナソニック株式会社 Stereoscopic image display control apparatus and stereoscopic image display control method
WO2013125122A1 (en) 2012-02-23 2013-08-29 富士フイルム株式会社 Stereoscopic display control device, imaging device provided with same, and stereoscopic display control method
JP5993937B2 (en) * 2012-03-30 2016-09-14 富士フイルム株式会社 Image processing apparatus, imaging apparatus, image processing method, and program
WO2013173548A2 (en) * 2012-05-17 2013-11-21 Thomson Licensing Adapting large format stereoscopic content to other platforms
JP2018144452A (en) 2017-03-09 2018-09-20 カシオ計算機株式会社 System for producing stereoscopic image, and program for producing stereoscopic image

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012060243A (en) * 2010-09-06 2012-03-22 Fujifilm Corp Stereoscopic image display control device, and operation control method of the same and operation control program of the same

Also Published As

Publication number Publication date
JP2004349736A (en) 2004-12-09

Similar Documents

Publication Publication Date Title
US7557824B2 (en) Method and apparatus for generating a stereoscopic image
US8488869B2 (en) Image processing method and apparatus
US8019146B2 (en) Method for adjusting disparity in three-dimensional image and three-dimensional imaging device thereof
US7190825B2 (en) Portable communication device for stereoscopic image display and transmission
JP4693900B2 (en) Image processing device
JP5429896B2 (en) System and method for measuring potential eye strain from stereoscopic video
EP0751689B1 (en) Stereoscopic image generating apparatus and display therefor
CN102075694B (en) Stereoscopic editing for video production, post-production and display adaptation
JP2010045584A (en) Solid image correcting apparatus, solid image correcting method, solid image display, solid image reproducing apparatus, solid image presenting system, program, and recording medium
WO2011036827A1 (en) 3d image display device and 3d image display method
JP2013005259A (en) Image processing apparatus, image processing method, and program
US20150304635A1 (en) Stereoscopic depth mapping
KR100739730B1 (en) Apparatus and method for processing 3D dimensional picture
US8441524B2 (en) Three-dimensional display device and digital zoom correction method
JP5963422B2 (en) Imaging apparatus, display apparatus, computer program, and stereoscopic image display system
AU2010270951B2 (en) Insertion of 3D objects in a stereoscopic image at relative depth
JP2011210027A (en) Image processing apparatus and method, and program
US20060158730A1 (en) Stereoscopic image generating method and apparatus
US8724886B2 (en) Method and apparatus for processing three-dimensional images
JP5572094B2 (en) One-source multi-use (OSMU) type stereo camera and method for producing stereo image content thereof
JP5491786B2 (en) Image reproducing apparatus and method
JP3653790B2 (en) Stereoelectronic zoom apparatus and stereoscopic image quality control unit
US7633528B2 (en) Multi-viewpoint image generation apparatus, multi-viewpoint image generation method, and multi-viewpoint image generation program
KR20080076628A (en) Image display device for improving three-dimensional effect of stereo-scopic image and method thereof
Vázquez et al. Stereoscopic imaging: filling disoccluded areas in depth image-based rendering

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20050810

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20080715

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20080911

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20081028

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20081120

A911 Transfer of reconsideration by examiner before appeal (zenchi)

Free format text: JAPANESE INTERMEDIATE CODE: A911

Effective date: 20090108

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20090203

A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20090203

R150 Certificate of patent or registration of utility model

Free format text: JAPANESE INTERMEDIATE CODE: R150

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120220

Year of fee payment: 3

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120220

Year of fee payment: 3

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130220

Year of fee payment: 4

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130220

Year of fee payment: 4

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20140220

Year of fee payment: 5

LAPS Cancellation because of no payment of annual fees