JP2004193795A - Stereoscopic image edit apparatus and stereoscopic image edit program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To attain appreciation of many stereoscopic images at once by a naked eye parallel method or a naked eye crossing method. <P>SOLUTION: A thumbnail list display section 440 in a stereoscopic image edit section 4 displays a plurality of stereoscopic images in a designated folder on one screen as a list by arranging the images by means of thumbnail images in a lateral direction according to a stereoscopic vision form by the naked eye parallel method or the naked eye crossing method. The display section 440 uses scroll bars to display images protruded in a longitudinal direction or a lateral direction within the screen. Further, a mouse or the like is used to adjust an interval of the images in the lateral direction. <P>COPYRIGHT: (C)2004,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention provides a stereoscopic image editing apparatus that generates a stereoscopic image by displaying two or more planar images shifted left and right on an editing screen, enables the stereoscopic image to be edited, and a stereoscopic image editing device. About the program.
[0002]
[Prior art]
In commercial transactions using the Internet, so-called E-commerce, it is very effective to stereoscopically view a product on a screen because the product cannot be actually picked up. However, in order to provide various contents as a stereoscopic image on the screen of a personal computer, a device that can quickly and easily edit a planar image acquired by a digital camera or the like is required.
[0003]
Therefore, conventionally, a shooting adapter for easily obtaining a right and left plane image necessary for generating a stereoscopic image with a digital camera or the like, and an editing screen for determining whether the obtained image is a right image or a left image. There has been proposed a stereoscopic image editing apparatus having a function that can be easily identified above (for example, see Patent Document 1).
[0004]
In addition, two plane images to which depth values (also referred to as “amount of deviation” and “height”) corresponding to binocular parallax and parameters such as a sense of transparency are added from one plane image are created. A stereoscopic image editing apparatus that generates a stereoscopic image from two planar images has also been proposed (for example, see Patent Document 2).
[0005]
[Patent Document 1]
JP 2002-12546 A
[Patent Document 2]
JP 2002-123842 A
[Problems to be solved by the invention]
However, the stereoscopic image editing apparatus shown in the above prior art is not sufficient as an editing function, and a stereoscopic image can be easily created by reading a planar image captured by a digital camera or the like, and the editing work can be easily performed. In order to be able to do it quickly, further improvements were required.
[0008]
SUMMARY OF THE INVENTION In view of the above, an object of the present invention is to provide a stereoscopic image editing apparatus that can easily generate a stereoscopic image from a planar image and can easily and quickly edit the stereoscopic image.
[0009]
[Means for Solving the Problems]
The stereoscopic image editing apparatus according to the present invention has the following configuration.
[0010]
(1) In a stereoscopic image editing apparatus in which two or more plane images shifted left and right are displayed on an editing screen to generate a stereoscopic image, and the stereoscopic image can be edited on the editing screen,
When one or more stereoscopic image files are specified, a thumbnail image creating unit that converts a plurality of left and right planar images constituting each stereoscopic image into thumbnail images of a predetermined size, Alternatively, there is provided a stereoscopic image list display processing unit for arranging the stereoscopic images in the horizontal direction for each stereoscopic image according to one of the stereoscopic formats of the naked-eye parallel method and displaying the list on the display unit.
[0011]
The stereoscopic image according to the present invention is typically formed by displacing left and right LR images (hereinafter, L images) of a left image (hereinafter, L images) and left and right images (hereinafter, R images). Normally, the LR image is displayed as a stereoscopic image on the editing screen, but the editing screen does not have a function of allowing multiple sets of stereoscopic images to be viewed at the same time. Therefore, in the stereoscopic image editing apparatus according to the present invention, when a plurality of stereoscopic image files are designated, the LR images constituting each stereoscopic image are converted into thumbnail images, which are arranged in the horizontal direction and displayed on the display unit. A processing unit for displaying a list is provided. If all of the stereoscopic image files cannot be displayed at once, vertical scrolling and horizontal scrolling can be performed on the screen.
[0012]
In the present invention, when a large number of stereoscopic images are designated in this way, a plurality of left and right thumbnail images are displayed for each stereoscopic image on one display screen, and these thumbnail images are displayed by the naked eye intersection method. Alternatively, since the images are arranged in the horizontal direction according to any of the stereoscopic formats of the naked-eye parallel method, the user can view a plurality of stereoscopic images by the naked-eye crossing method or the naked-eye parallel method by viewing this screen. .
[0013]
In addition, according to the ability of the user, the interval between the left and right thumbnail images displayed according to one of the above-mentioned naked eye crossing method and naked eye parallel method can be adjusted, so that stereoscopic viewing becomes easier.
[0014]
(2) In a stereoscopic image editing program which generates two-dimensional images by displaying two plane images shifted left and right on an editing screen, and makes the three-dimensional images editable on the editing screen,
When a depth value of the two plane images is equal to or more than a predetermined value, a computer is provided with a trimming function for trimming left and right end portions of each image so as not to be displayed.
[0015]
Normally, when two left and right plane images (L image and R image) are displayed as a stereoscopic image on the editing screen, if the heights (depth values) of the left and right images become larger than a certain level, the LR images do not overlap. The left and right ends are not three-dimensional. In particular, when there is a background image, an unnatural stereoscopic image is obtained because the left and right ends of the left and right eyes receive a background image unrelated to the image. Therefore, in the present invention, when the height (depth value) of two LR images is equal to or more than a certain value, trimming is performed so that the left and right end portions of each image are not displayed. For the trimmed portion, when there is a background image, the background image is displayed. By performing such processing, normal stereoscopic viewing can be performed.
[0016]
(3) In a stereoscopic image editing program that generates two-dimensional images by displaying two plane images shifted to the left and right on an editing screen and enables the three-dimensional images to be edited on the editing screen,
A function of comparing the two left and right plane images to detect a different region of the image, and a depth value corresponding to the binocular disparity after the left and right replacement of the region becomes the same as the depth value of the replaced image. The function of automatically adjusting the depth value of the replaced image as described above is realized by a computer.
[0017]
When a planar image for generating a stereoscopic image is acquired by one digital camera, if there is a moving subject in the imaging range, the position of the subject differs between the L image and the R image due to the imaging time difference. come. Also, even if two digital cameras capture the same subject synchronously at the same time, if a long-range subject and a short-range subject coexist in the imaging range, depending on the distance between the digital cameras, In some cases, the position of a subject at a short distance may differ greatly.
[0018]
In such a case, it is very difficult to see a subject at a different position between the LR images during stereoscopic viewing. Therefore, usually, the time, place, subject, equipment, and the like at the time of shooting are set so that this does not occur. Had to be finely adjusted.
[0019]
Therefore, in the present invention, two LR images are compared, and different regions of the images are automatically extracted. Further, the extracted area is left and right replaced in the LR image, and the depth value of the replaced image is changed so that the height (depth value) corresponding to the binocular disparity becomes the same as the depth value of the replaced image. Adjust automatically. The left and right replacement of the detected area may be automatic or manual.
[0020]
In the present invention, by configuring as described above, even if there is a subject at a different position in the LR image, the portion is switched right and left and the depth value is automatically adjusted, so that a natural image can be obtained by stereoscopic viewing. can do. In addition, there is an advantage that it is not necessary to consider a photographing time, a photographing place, photographing equipment, and the like as in the related art.
[0021]
BEST MODE FOR CARRYING OUT THE INVENTION
FIG. 1 is a functional block diagram of a stereoscopic image editing apparatus according to the present invention. This stereoscopic image editing apparatus is usually composed of a personal computer. Therefore, functions necessary for performing the editing process are provided by the stereoscopic image editing program.
[0022]
In FIG. 1, digital cameras 1 and 2 capture an L image (left plane image) and an R image (right plane image), respectively. In this figure, two digital cameras 1 and 2 are shown to capture an L image and an R image, respectively. However, one digital camera is used to capture an L image and an R image at different times. You may make it. Further, the L image and the R image may be simultaneously captured by one multi-lens camera.
[0023]
The L image and the R image are input to the image input unit 3 and passed to the stereoscopic image editing unit 4 directly or indirectly via a file storage unit. Specifically, it is input to the stereoscopic view format setting section 42 in the stereoscopic image editing section 4. The stereoscopic view format setting section 42 is a section for setting the stereoscopic view format of the LR image from the image input section 3. Stereoscopic formats include a naked-eye parallel method, a naked-eye crossing method, a red-blue two-color glasses three-dimensional method, a liquid crystal glasses three-dimensional method, and the like, and image processing is performed according to these formats. Note that the file input processing unit 40 in the stereoscopic image editing unit 4 controls the image input unit 3.
[0024]
The file storage processing unit 41 stores a stereoscopic image file stored in the image memory 5 in the image file unit 6 and reads a stereoscopic image file stored in the image file unit 6 into the image memory 5. Perform processing.
[0025]
The LR image automatic creation unit 43 of the stereoscopic image editing unit 4 automatically creates an LR image for an image having a clear contour such as a character image and stores the LR image in the image memory 5 as a stereoscopic image. The character information from the character input unit 8 is input to the LR image automatic creation unit 43. In addition, a character input from the keyboard 7 is input to the character input unit 8. It is also possible to input an image from the image input unit 3 to the LR image automatic creation unit 43 by setting. The method of automatically creating an LR image in the LR image movement creating unit 43 is disclosed in, for example, JP-A-2002-123842. As an example of a method of automatically creating an LR image, another image is created for a character input from the character input unit 8, and these two character images are defined as an L image and an R image. The parameter of the height (shift amount) is automatically set according to values such as hue, saturation, and lightness.
The image editing processing unit 44 includes a thumbnail list display unit 440, a left and right image end processing unit 441, and a left and right image exchange processing unit 442. When a folder in which a stereoscopic image file is stored is designated on the screen, the thumbnail list display unit 440 converts the LR images constituting each stereoscopic image in the folder into a thumbnail image of a predetermined size. The conversion is performed, and a process of displaying the list on the display unit side by side in a horizontal direction for each stereoscopic image according to the stereoscopic format of either the naked-eye crossing method or the naked-eye parallel method is performed.
[0026]
Further, the left and right image edge processing unit 441 trims the left and right edge portions of each image so that the LR image displayed on the editing screen is not displayed when the height (depth value) of the LR image is equal to or more than a certain value. I do. Further, the left and right image exchange processing unit 442 compares the LR images to detect a different area of the image, and after replacing the area, the “height” (depth value) of the image after the “height” (depth value) is replaced. (Depth value) is automatically adjusted to be the same as the “height” (depth value) of the replaced image.
[0027]
The image memory 5 stores a stereoscopic image composed of LR images stored in the JPEG format and parameters in pairs. When a plurality of stereoscopic images are displayed on the editing window, image data corresponding to each stereoscopic image is stored in the image memory. Specifically, every time an LR image is input from the image input unit 3, the LR image passes through the stereoscopic format setting unit 42, and is sequentially stored as a stereoscopic image together with parameters. Each time character data is input from the character input unit 8, the data passes through the LR image automatic creation unit 43 and is stored as a stereoscopic image together with parameters. The image data on the image memory 5 is developed on the graphic memory 10 according to the parameter information and displayed on the monitor screen. The parameters stored as a pair with each stereoscopic image include values such as a height (depth value), transparency, a pasting position, and a time axis change degree of each parameter.
[0028]
Hereinafter, each function will be described.
[0029]
(A) Regarding the Function of the Thumbnail List Display Unit 440 Since a large number of stereoscopic images cannot be viewed at a time on the editing window, in the present embodiment, a folder in which a plurality of stereoscopic images are stored is specified. Accordingly, the stereoscopic images stored in the folder are displayed as a list as LR thumbnail images. The format of the stereoscopic image is either the naked-eye parallel method or the naked-eye crossing method. Further, the size of the thumbnail image can be arbitrarily changed. Further, the interval between the L image and the R image can be arbitrarily adjusted.
[0030]
This allows the user to view a large number of stereoscopic images in a list by either the naked-eye crossing method or the naked-eye parallel method. It should be noted that the scroll function in the vertical direction and the horizontal direction makes it possible to easily view even a stereoscopic image that extends off the screen.
[0031]
FIG. 2A is a diagram showing an operation method for displaying a thumbnail list. The attribute of the file is designated in the file designation unit 20. For example, the attribute of the image (.ios in the figure) obtained by integrating the LR image as the stereoscopic image and the attribute of the planar image before editing such as JPEG are designated. Subsequently, a folder 21 and a size 22 of the thumbnail image are designated, and a naked-eye parallel method 23 or a naked-eye intersection method 24 is designated as a stereoscopic format.
[0032]
By performing the above operation, when the naked-eye parallel method 23 is designated, the display is as shown in FIG. 2B, and when the naked-eye intersection method 24 is designated, the display is as shown in FIG. 2C. In the display states of FIGS. 2B and 2C, the left and right image intervals can be changed with the mouse. By adjusting the image interval, it is possible to arrange the images at an optimal interval suitable for the stereoscopic ability of the viewer. Note that the vertical scroll bar 25 can easily display an image protruding in the vertical direction on the screen.
[0033]
In FIG. 2, two planar images are shown, but a thumbnail list can be displayed for more planar images in the same manner. FIG. 3 shows an example of this display. In this case, by using the horizontal scroll bar 26 in addition to the vertical scroll bar 25, it is possible to easily display not only the image in the vertical direction but also the image protruding in the horizontal direction on the screen. Further, the interval between the images can be easily changed with a mouse, as in the case shown in FIG.
[0034]
FIG. 4 is a flowchart showing a schematic operation of the thumbnail list display unit 440.
[0035]
When the file type, the folder, the size of the thumbnail image, and the display format (autostereoscopic method or autostereoscopic method) are specified (ST1), the image is determined according to whether the stereoscopic format is autostereoscopic method or autostereoscopic method (ST2). Determine the order of setting in the horizontal direction. That is, when the naked-eye parallel method is designated as shown in FIG. 2B, the L image and the R image are displayed in the order of the L image and the R image from the left side, and as shown in FIG. Is set so that the R image and the L image are displayed in this order from the left (ST3, ST4). Subsequently, a thumbnail list is displayed for all the images in the designated folder corresponding to the designated file type (ST5). At this time, an image that extends off the screen can be displayed on the screen using the vertical scroll bar 25, and the image interval can be changed using a mouse. The reason for changing the image interval is to allow the user to easily stereoscopically view an image displayed by the naked-eye parallel method or the naked-eye crossing method.
[0036]
Note that when three or more LR images are configured, each image is displayed in the horizontal direction as shown in FIG. 3, but when the naked-eye parallel method is specified, in ST3, from left to right in the above ST3. It is set so that images taken in order are displayed sequentially from the left end to the right. Further, when the naked-eye crossing method is designated, in the above ST4, it is set so that the images taken in order from the left to the right are sequentially displayed from the right end to the left.
[0037]
The default values such as the image interval when the thumbnail list is displayed in ST5 are set to appropriate values in the thumbnail list display section 440.
[0038]
In the thumbnail list display section 440 of the present embodiment, by listing a large number of thumbnail images on the screen as described above, stereoscopic images can be viewed in a list by the naked eye parallel method or the naked eye intersection method. is there. Note that the thumbnail images displayed in a list can be printed in a predetermined layout.
[0039]
(B) Regarding the function of the left and right image edge processing unit 441 In the editing window, the depth of the image in the stereoscopic space is set by changing the height of the LR image. In order to increase the depth, it is necessary to increase the height of the LR image. However, if the height is increased to a certain degree or more, stereoscopic viewing cannot be performed at the left and right end portions where the LR images are no longer overlapped. In particular, when the image is a pasted image with respect to the background image, the left and right end portions are unnatural stereoscopically viewed because the background image enters the eyes.
[0040]
In the present embodiment, in order to solve the above-described inconvenience, when the height (depth value) of the LR image is equal to or more than a certain value, processing is performed so that the left and right end portions of the image are not displayed after being trimmed.
[0041]
FIG. 5 is a diagram for explaining the function of the left and right image edge processing unit 441.
[0042]
In the embodiment shown in the figure, a P1 image, which is a stereoscopic image, and an image P2 of a stereoscopic image pasted thereon are displayed on the editing window W1. The images P1 and P2 are layer-managed, and the images are displayed as thumbnails on the layer window W2. A setting button B is arranged on the right side of the thumbnail image. When a thumbnail image is selected and operated, a layer setting dialog W5 for changing parameters is displayed.
[0043]
FIG. 5B shows the layer setting dialog. This dialog can adjust the "darkness" and "height" of the image selected on the layer window W2. In addition, a check box for “display outside area darkened” is provided. The function of "display outside the area darkly" is that, when a specific image is selected on the layer window W2, all the images other than the image on the layer window W1 are displayed dark, and the parameter setting for the selected specific image is performed. Try to make it easier.
[0044]
In the state shown in FIG. 5A, since the height of the image P2 does not exceed a certain value, the trimming process on the left and right end portions of the image is not performed. However, in FIG. 5B, when the bar for “height” adjustment is moved to the left to make the value equal to or greater than a certain value, the left and right end portions are stereoscopically displayed as shown in FIG. 5C. Because it cannot be trimmed, the background image is displayed.
FIG. 6 is a flowchart showing the function of the left and right image edge processing unit 441.
[0045]
First, a stereoscopic image is displayed on the editing window W1. As shown in FIG. 5A, it is assumed that two stereoscopic images P1 and P2 are currently displayed on the editing window W1. At this stage, when one of the images is selected and the “height” of the image is changed (ST11), the condition is determined on the condition that the value of the “height” is equal to or more than a certain value (ST12). The left and right edges of the image are trimmed (ST13).
[0046]
When the “height” is adjusted on the layer setting dialog W5 shown in FIG. 5B, the adjusted value is reflected in real time on the image on the edit window W1.
[0047]
By the above-described processing, even when the height of the image is increased by setting the “height” to a certain value or more, it is possible to eliminate the unnaturalness at the left and right end portions of the image, which is likely to be caused by the depth. A natural stereoscopic image can be guaranteed without being affected by the value of “sa”.
[0048]
【The invention's effect】
According to the stereoscopic image editing apparatus and program of the present invention, the editing efficiency is extremely improved. Specifically, the following effects are obtained.
[0049]
(1) A large number of stereoscopic images can be easily stereoscopically viewed on a screen by the naked-eye crossing method or the naked-eye parallel method. In addition, by enabling adjustment of the interval between the left and right thumbnail images displayed in accordance with either the above-mentioned autostereoscopic method or the autostereoscopic method, an image interval according to the stereoscopic ability of the user can be set. There is.
[0050]
(2) When the height (depth value) of two LR images is equal to or more than a certain value, the left and right end portions of the images are automatically trimmed, so that the “height” is set to be large. Also, normal stereoscopic viewing can be performed at the left and right end portions.
[Brief description of the drawings]
FIG. 1 is a functional block diagram of a stereoscopic image editing apparatus according to an embodiment of the present invention.
FIG. 2 is a diagram for explaining a function of a thumbnail list display unit 440.
FIG. 3 is a diagram for explaining a function of a thumbnail list display unit 440;
FIG. 4 shows a schematic flowchart of a program for realizing the function of a thumbnail list display unit 440.
FIG. 5 is a diagram for explaining a function of a left and right image edge processing unit 441;
FIG. 6 shows a schematic flowchart of a program for realizing the function of the left and right image edge processing unit 441.

Claims (4)

In a stereoscopic image editing apparatus that generates two-dimensional images by displaying two or more two-dimensional images shifted to the left and right on an edit screen and enables the three-dimensional images to be edited on the edit screen,
When one or more stereoscopic image files are specified, a thumbnail image creating unit that converts a plurality of left and right planar images constituting each stereoscopic image into thumbnail images of a predetermined size, A stereoscopic image editing apparatus, further comprising a stereoscopic image list display processing unit for arranging the stereoscopic images in the horizontal direction in accordance with one of the stereoscopic formats of the naked eye parallel method and displaying the list on a display unit. The stereoscopic image editing apparatus according to claim 1, wherein the stereoscopic image list display processing unit is capable of adjusting an interval between the thumbnail images arranged in a horizontal direction. In a stereoscopic image editing program that generates two-dimensional images by displaying two or more two-dimensional images shifted to the left and right on an editing screen and enables the three-dimensional images to be edited on the editing screen,
When one or more stereoscopic image files are designated, a thumbnail image creating function for converting a plurality of left and right planar images constituting each stereoscopic image into a thumbnail image of a predetermined size, A stereoscopic image editing program, which causes a computer to realize a stereoscopic image list display processing function of horizontally arranging each stereoscopic image according to a stereoscopic format of the naked eye parallel method and displaying the list on a display unit. . The stereoscopic image editing program according to claim 3, wherein the stereoscopic image list display processing function enables adjustment of an interval between the thumbnail images arranged in a horizontal direction.

Images