JP4184061B2 - Stereoscopic image editing apparatus and stereoscopic image editing program - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention generates a stereoscopic image by displaying two or more planar images on the editing screen while shifting them to the left and right, and a stereoscopic image editing apparatus capable of editing this stereoscopic image, and stereoscopic image editing Regarding the program.
[0002]
[Prior art]
In commercial transactions using the Internet, so-called e-commerce, it is very effective to stereoscopically display a product on the screen because the product cannot actually be picked up. However, in order to provide various contents as stereoscopic images on a personal computer screen, an apparatus capable of quickly and easily editing a planar image acquired by a digital camera or the like is required.
[0003]
Therefore, conventionally, a shooting adapter for easily obtaining a left-right plane image necessary for generating a stereoscopic image with a digital camera or the like, and an editing screen for determining whether the obtained image is a right image or a left image. A stereoscopic image editing apparatus having a function that can be easily identified has been proposed (for example, see Patent Document 1).
[0004]
Also, two planar images to which parameters such as a depth value corresponding to binocular parallax (also referred to as “deviation amount” and “height”) and transparency are added from one planar image are created. A stereoscopic image editing apparatus that generates a stereoscopic image from two planar images has also been proposed (see, for example, Patent Document 2).
[0005]
[Patent Document 1]
JP-A-2002-12546 gazette
[Patent Document 2]
Japanese Patent Laid-Open No. 2002-123842
[Problems to be solved by the invention]
However, the stereoscopic image editing apparatus shown in the above prior art is not sufficient as an editing function, and can easily create a stereoscopic image by reading a planar image captured by a digital camera or the like, or its editing work Further improvements were required to make it faster.
[0008]
In view of the above, an object of the present invention is to provide a stereoscopic image editing apparatus that can easily generate a stereoscopic image from a planar image and edit the image easily and quickly.
[0009]
[Means for Solving the Problems]
The stereoscopic image editing apparatus according to the present invention has the following configuration.
[0010]
(1) In a stereoscopic image editing apparatus in which two or more plane images shifted left and right are displayed on an editing screen to generate a stereoscopic image, and the stereoscopic image can be edited on the editing screen.
When one or more stereoscopic image files are designated, a thumbnail image creating unit that converts a plurality of left and right planar images constituting each stereoscopic image into thumbnail images of a predetermined size, and this with a naked-eye intersection method Alternatively, a stereoscopic image list display processing unit that displays the stereoscopic image in a list in a horizontal direction for each stereoscopic image in accordance with any stereoscopic format of the naked eye parallel method is provided.
[0011]
The stereoscopic image according to the present invention is typically formed by arranging LR images of a left image (hereinafter referred to as an L image) and a right image (hereinafter referred to as an R image) while being shifted to the left and right. Normally, the LR image is displayed as a stereoscopic image on the editing screen, but this editing screen does not have a function that allows a large number of stereoscopic images to be simultaneously viewed. Therefore, in the stereoscopic image editing apparatus according to the present invention, when a plurality of stereoscopic image files are designated, the LR images constituting each stereoscopic image are converted into thumbnail images, which are arranged in the horizontal direction on the display unit. A processing unit for displaying a list is provided. When all stereoscopic image files cannot be displayed at once, vertical scrolling and horizontal scrolling are possible on the screen.
[0012]
In the present invention, when a large number of stereoscopic images are designated in this way, a plurality of left and right thumbnail images are displayed for each stereoscopic image on one display screen, and these thumbnail images are displayed with the naked eye intersection method. Alternatively, since the images are arranged in the horizontal direction according to any of the stereoscopic viewing methods of the naked-eye parallel method, the user can view a plurality of stereoscopic images by viewing the screen by the naked-eye crossing method or the naked-eye parallel method. .
[0013]
Also, stereoscopic viewing can be facilitated by making it possible to adjust the interval between the left and right thumbnail images displayed in accordance with either the autostereoscopic method or autostereoscopic method according to the user's ability.
[0014]
(2) In a stereoscopic image editing program in which two planar images shifted left and right are displayed on an editing screen to generate a stereoscopic image, and the stereoscopic image can be edited on the editing screen.
When a depth value of the two planar images is equal to or greater than a certain value, a computer is caused to perform a trimming function for trimming so that the left and right end portions of each image are not displayed.
[0015]
Normally, when two left and right planar images (L image and R image) are displayed as a stereoscopic image on the editing screen, if the height (depth value) of the left and right images becomes larger than a certain level, the LR images will not overlap. The left and right ends are not solid. In particular, when there is a background image, the left and right end portions of the background image are unnatural stereoscopic images because a background image that is not related to the image enters the left or right eye. Therefore, in the present invention, when the height (depth value) of two LR images is equal to or greater than a certain value, trimming is performed so that the left and right end portions of each image are not displayed. For the trimmed portion, when there is a background image, the background image is displayed. By processing in this way, normal stereoscopic viewing can be performed.
[0016]
(3) In a stereoscopic image editing program that generates two-dimensional images by displaying two plane images shifted left and right on the editing screen, and enabling editing of the stereoscopic images on the editing screen.
A function of comparing the two left and right planar images to detect a different area of the image, and after the area is replaced left and right, the depth value corresponding to binocular parallax is the same as the depth value of the image after replacement As described above, the computer is realized with a function of automatically adjusting the depth value of the replaced image.
[0017]
When a plane image for generating a stereoscopic image is acquired with one digital camera, if there is a moving subject in the imaging range, the position of the subject differs between the L image and the R image due to the imaging time difference. come. In addition, even if two digital cameras capture the same subject in synchronization with the same time, if a subject at a long distance and a subject at a short distance are mixed in the imaging range, depending on the distance between each digital camera, In some cases, the position of a subject at a short distance may vary greatly.
[0018]
In such a case, it is very difficult to see a subject having a different position between LR images during stereoscopic viewing. Usually, in order to prevent such a situation, time, place, subject to be photographed, equipment, etc. There was a need to make minor adjustments.
[0019]
Therefore, in the present invention, two LR images are compared, and different regions of the images are automatically extracted. In addition, the extracted region is replaced with the left and right in the LR image, and the depth value of the replaced image is set so that the height (depth value) corresponding to binocular parallax is the same as the depth value of the image after replacement. Adjust automatically. The left and right replacement of the detected area may be automatic or manual.
[0020]
In the present invention, even if there is a subject having a different position in the LR image, the depth value is automatically adjusted by changing the left and right portions of the LR image. can do. In addition, there is an advantage that it is not necessary to consider the photographing time, the photographing place, the photographing equipment and the like as in the past.
[0021]
DETAILED DESCRIPTION OF THE INVENTION
FIG. 1 is a functional block diagram of a stereoscopic image editing apparatus according to the present invention. This stereoscopic image editing apparatus is usually composed of a personal computer. Therefore, the functions necessary for performing the editing process are provided by the stereoscopic image editing program.
[0022]
In FIG. 1, digital cameras 1 and 2 capture an L image (left plane image) and an R image (right plane image), respectively. In this figure, two digital cameras 1 and 2 are shown to capture an L image and an R image, respectively, but an L image and an R image are captured at different times using one digital camera. You may make it do. Moreover, you may make it image L image and R image simultaneously with one multi-camera.
[0023]
The L image and the R image are input to the image input unit 3 and passed to the stereoscopic image editing unit 4 directly or indirectly through the file storage unit. Specifically, it is input to the stereoscopic format setting unit 42 in the stereoscopic image editing unit 4. The stereoscopic format setting unit 42 is a part for setting the stereoscopic format of the LR image from the image input unit 3. Stereoscopic formats include a naked-eye parallel method, a naked-eye intersection method, a red-blue two-color glasses stereoscopic method, a liquid crystal glasses stereoscopic method, and the like, and image processing according to these formats is performed. The file input processing unit 40 in the stereoscopic image editing unit 4 controls the image input unit 3.
[0024]
The file storage processing unit 41 stores the stereoscopic image file stored in the image memory 5 in the image file unit 6 or reads the stereoscopic image file stored in the image file unit 6 into the image memory 5. Process.
[0025]
The LR image automatic creation unit 43 of the stereoscopic image editing unit 4 automatically creates an LR image for an image with a clear outline such as a character image, and stores this in the image memory 5 as a stereoscopic image. Character information from the character input unit 8 is input to the LR image automatic creation unit 43. A character input from the keyboard 7 is input to the character input unit 8. It is possible to input the image from the image input unit 3 to the LR image automatic creation unit 43 by setting. Note that a method of automatically creating an LR image in the LR image movement creating unit 43 is disclosed in, for example, Japanese Patent Application Laid-Open No. 2002-123842. As an example of a method for automatically creating an LR image, another image is created for a character input from the character input unit 8, and these two character images are set as an L image and an R image. The height (deviation amount) parameter is automatically set according to values such as hue, saturation, and brightness.
The image editing processing unit 44 includes a thumbnail list display unit 440, a left and right image edge processing unit 441, and a left and right image replacement processing unit 442. When a folder in which a stereoscopic image file is stored is designated on the screen, the thumbnail list display unit 440 converts the LR images constituting each stereoscopic image in the folder into thumbnail images having a predetermined size. Conversion is performed, and a process of displaying a list on the display unit in a horizontal direction for each stereoscopic image according to a stereoscopic format of either the naked eye intersection method or the naked eye parallel method is performed.
[0026]
Further, the left and right image edge processing unit 441 performs processing for trimming the left and right edge portions of each image so as not to be displayed when the height (depth value) of the LR image displayed on the editing screen is equal to or greater than a certain value. I do. Further, the left and right image replacement processing unit 442 compares the LR images to detect different regions of the image, replaces the left and right regions, and then replaces the “height” (depth value) with the “height” of the image. "Height" (depth value) of the replaced image is automatically adjusted so as to be the same as "" (depth value).
[0027]
In the image memory 5, a stereoscopic image composed of LR images stored in the JPEG format and parameters are stored in pairs. When a plurality of stereoscopic images are displayed on the editing window, image data corresponding to each stereoscopic image is stored in the image memory. Specifically, every time an LR image is input from the image input unit 3, the LR image passes through the stereoscopic format setting unit 42 and is sequentially stored as a stereoscopic image together with parameters. Each time character data is input from the character input unit 8, the character data is stored together with the parameters as a stereoscopic image after passing through the LR image automatic creation unit 43. The image data on the image memory 5 is developed on the graphic memory 10 according to the parameter information and displayed on the monitor screen. Note that the parameters stored in pairs with each stereoscopic image include values such as height (depth value), transparency, pasting position, and time axis change degree of each parameter.
[0028]
Each function will be described below.
[0029]
(A) Function of Thumbnail List Display Unit 440 Since a large number of stereoscopic images cannot be viewed at once on the editing window, in this embodiment, a folder in which a plurality of stereoscopic images are stored is designated. As a result, the stereoscopic images stored in the folder are displayed as a list of LR thumbnail images. The format of the stereoscopic image is either the naked eye parallel method or the naked eye intersection method. Further, the size of the thumbnail image can be arbitrarily changed. Further, the interval between the L image and the R image can be arbitrarily adjusted.
[0030]
Thus, the user can view a large number of stereoscopic images in a list by either the naked eye intersection method or the naked eye parallel method. Note that a stereoscopic image that protrudes from the screen can be easily viewed by the scroll function in the vertical direction and the horizontal direction.
[0031]
FIG. 2A is a diagram illustrating an operation method when displaying a thumbnail list. The file specification unit 20 specifies file attributes. For example, an attribute of an image obtained by integrating the LR image as a stereoscopic image (.ios in the figure) and an attribute of a planar image before editing such as JPEG are designated. Subsequently, the folder 21 and the thumbnail image size 22 are specified, and the autostereoscopic method 23 or autostereoscopic intersection method 24 is specified as the stereoscopic format.
[0032]
When the above operation is performed, the screen is displayed as shown in FIG. 2B when the autostereoscopic method 23 is designated, and is displayed as shown in FIG. 2C when the autostereoscopic method 24 is designated. In the display states of FIGS. 2B and 2C, the left and right image intervals can be changed with the mouse. By adjusting the image interval, it is possible to arrange the images at an optimal interval suitable for the viewer's stereoscopic vision ability. The vertical scroll bar 25 can easily display an image protruding in the vertical direction on the screen.
[0033]
Although FIG. 2 shows two planar images, thumbnail list display can be similarly performed for more planar images. FIG. 3 shows an example of this display. In this case, by using the horizontal scroll bar 26 in addition to the vertical scroll bar 25, it is possible to easily display an image that protrudes not only in the vertical direction but also in the horizontal direction on the screen. Further, the interval between the images can be easily changed with a mouse, as in the case shown in FIG.
[0034]
FIG. 4 is a flowchart showing a schematic operation of the thumbnail list display unit 440.
[0035]
When the file type, folder, thumbnail image size, and display format (naked-eye parallel method or naked-eye intersection method) are specified (ST1), the image is displayed depending on whether the stereoscopic format is the naked-eye parallel method or the naked-eye intersection method (ST2). Determine the setting order in the horizontal direction. That is, when the autostereoscopic method is designated as shown in FIG. 2 (B), the L image and the R image are displayed in the order of the L image and the R image from the left side, and as shown in FIG. Is designated so that the R image and the L image are displayed in this order from the left (ST3, ST4). Subsequently, thumbnail lists are displayed for all images in the designated folder corresponding to the designated file type (ST5). At this time, an image protruding from the screen can be displayed on the screen by the vertical scroll bar 25, and the image interval can be changed by the mouse. The reason for changing the image interval is to allow the user to easily view the image displayed by the naked-eye parallel method or the naked-eye intersection method.
[0036]
When there are three or more LR images, each image is displayed in the horizontal direction as shown in FIG. 3, but when the autostereoscopic method is designated, in ST3, from left to right. It sets so that the image imaged in order may be similarly displayed in order from the left end to the right direction. When the naked-eye intersection method is designated, in ST4, settings are made so that images taken in order from the left to the right are displayed in order from the right end to the left.
[0037]
Note that the default values such as the image interval when performing thumbnail list display in ST5 are set to appropriate values in the thumbnail list display section 440.
[0038]
In the thumbnail list display unit 440 of the present embodiment, a large number of thumbnail images are displayed as a list on the screen as described above, so that stereoscopic images can be viewed in a list by the naked-eye parallel method or the naked-eye intersection method. is there. Note that thumbnail images displayed in a list can be printed in a predetermined layout.
[0039]
(B) Functions of the left and right image edge processing unit 441 On the editing window, the depth of the image in the stereoscopic view space is set by changing the height of the LR image. In order to increase the depth, it is necessary to increase the height of the LR image. However, if the height is increased to some extent, stereoscopic viewing cannot be performed at the left and right end portions where the LR images no longer overlap. In particular, when the image is a pasted image with respect to the background image, since the background image enters the eyes at the left and right end portions, it becomes unnatural stereoscopic viewing.
[0040]
In the present embodiment, in order to eliminate the above inconvenience, when the height (depth value) of the LR image is a certain value or more, the left and right end portions of the image are trimmed so as not to be displayed.
[0041]
FIG. 5 is a diagram for explaining the function of the left and right image edge processing unit 441.
[0042]
In the embodiment shown in the figure, a P1 image that is a stereoscopic image and an image P2 of a stereoscopic image that is pasted thereon are displayed on the editing window W1. Each of the images P1 and P2 is managed as a layer, and each image is displayed as a thumbnail on the layer window W2. Also, a setting button B is arranged on the right side of the thumbnail image. When a thumbnail image is selected and this button B is operated, a layer setting dialog W5 for changing parameters is displayed.
[0043]
FIG. 5B shows the layer setting dialog. This dialog can adjust the “darkness” and “height” of the image selected on the layer window W2. In addition, a check box “display dark outside area” is provided. This “display outside area darkly” function displays all images other than the image on W1 darkly when a specific image is selected on the layer window W2, and parameter setting for the selected specific image is performed. To make it easier.
[0044]
In the state shown in FIG. 5A, since the height of the image P2 is not equal to or higher than a certain value, the trimming process is not performed on the left and right end portions of the image. However, in FIG. 5B, when the “height” adjustment bar is moved to the left and the value is set to a certain value or more, as shown in FIG. So that the background image is displayed after trimming.
FIG. 6 is a flowchart showing the functions of the left and right image edge processing unit 441.
[0045]
First, a stereoscopic image is displayed on the editing window W1. As shown in FIG. 5A, it is assumed that two stereoscopic images P1 and P2 are currently displayed on the editing window W1. At this stage, when any image is selected and the “height” for the image is changed (ST11), the value of the “height” is equal to or greater than a certain value (ST12). The left and right edges of the image are trimmed (ST13).
[0046]
When the “height” is adjusted on the layer setting dialog W5 shown in FIG. 5B, the adjusted value is reflected in the image on the editing window W1 in real time.
[0047]
Through the above processing, even when the height is set to a certain value or more and the depth of the image is increased, the unnaturalness at the left and right edges of the image that is likely to occur can be eliminated. A natural stereoscopic image can be guaranteed without being affected by the value of “sa”.
[0048]
【The invention's effect】
In the stereoscopic image editing apparatus and program of the present invention, the editing efficiency is very good. Specifically, the following effects are obtained.
[0049]
(1) A large number of stereoscopic images can be easily stereoscopically viewed on the screen by the naked-eye intersection method or the naked-eye parallel method. In addition, by making it possible to adjust the interval between the left and right thumbnail images displayed according to the stereoscopic format of either the autostereoscopic method or the autostereoscopic method, it is possible to set an image interval according to the stereoscopic capability of the user There is.
[0050]
(2) When the height (depth value) of two LR images is greater than or equal to a certain value, the left and right end portions of the images are automatically trimmed, and thus the “height” is set to be large. In addition, normal stereoscopic viewing can be performed at the left and right end portions.
[Brief description of the drawings]
FIG. 1 is a functional block diagram of a stereoscopic image editing apparatus according to an embodiment of the present invention.
FIG. 2 is a diagram for describing functions of a thumbnail list display unit 440;
FIG. 3 is a diagram for explaining a function of a thumbnail list display unit 440;
FIG. 4 shows a schematic flowchart of a program for realizing the function of the thumbnail list display section 440;
FIG. 5 is a diagram for explaining a function of a left and right image edge processing unit 441;
FIG. 6 is a schematic flowchart of a program for realizing the functions of the left and right image edge processing unit 441;

Claims (4)

In a stereoscopic image editing apparatus in which two or more plane images shifted left and right are displayed on an editing screen to generate a stereoscopic image, and the stereoscopic image can be edited on the editing screen.
When one or more stereoscopic image files are designated, a thumbnail image creating unit that converts a plurality of left and right planar images constituting each stereoscopic image into thumbnail images of a predetermined size, and this with the naked-eye intersection method A stereoscopic image editing apparatus comprising a stereoscopic image list display processing unit configured to display a list on the display unit in a horizontal direction for each stereoscopic image in accordance with any stereoscopic format of the naked eye parallel method. The stereoscopic image editing apparatus according to claim 1, wherein the stereoscopic image list display processing unit enables adjustment of an interval between the thumbnail images arranged in a horizontal direction. In a stereoscopic image editing program in which two or more plane images shifted left and right are displayed on an editing screen to generate a stereoscopic image, and the stereoscopic image can be edited on the editing screen.
When one or more stereoscopic image files are designated, a thumbnail image creation function for converting a plurality of left and right planar images constituting each stereoscopic image into thumbnail images of a predetermined size, and this with the naked-eye intersection method Or a stereoscopic image editing program for causing a computer to realize a stereoscopic image list display processing function for displaying a list on a display unit in a horizontal direction for each stereoscopic image in accordance with a stereoscopic format of either the naked eye parallel method . The stereoscopic image editing program according to claim 3, wherein the stereoscopic image list display processing function enables adjustment of an interval between the thumbnail images arranged in a horizontal direction.

Images