WO2008013352A1

WO2008013352A1 - 3d image editing apparatus and method thereof

Info

Publication number: WO2008013352A1
Application number: PCT/KR2007/000715
Authority: WO
Inventors: Won Kyoung Lee; Kyoung Hoon Bae; Dong Sik Yi
Original assignee: Bluvis Inc.
Priority date: 2006-07-28
Filing date: 2007-02-09
Publication date: 2008-01-31
Also published as: KR100713220B1

Abstract

Disclosed is a 3D image editing apparatus and method which is capable of synchronizing and multiplexing an image and easily editing a 3D image without any hardware means, in which left and right images and audio information are photographed, the left and right images are syn¬ chronized by only software based on the audio information, the synchronized left and right images are converted into a 3D image format by software, and the left and right images and audio information are edited and converted to have desired depth of a cubic effect, desired resolution and desired 3D image format through a dedicated editing program. Accordingly, costs required to create a moving picture of a real picture 3D image format is reduced and an editing function is improved so that a variety of users can create moving pictures of various 3D image formats without difficulty.

Description

Description 3D IMAGE EDITING APPARATUS AND METHOD THEREOF

Technical Field

[1] The present invention relates to a technique of generating a 3D image, and more particularly, to a 3D image editing apparatus and method which is capable of synchronizing and multiplexing an image and easily editing a 3D image without any hardware means. Background Art

[2] Studies on means of providing a variety of images for a human body to acquire enormous information through the sense of sight have been constantly made. Also, studies of providing a 3D image superior to a 2D image more conveniently as well as studies on smaller, lighter, splendid and precise displays have been constantly made.

[3] In particular, computers and image processing means have so rapidly advanced as to satisfy necessity and possibility of the 3D image and utilize the 3D image in a variety of fields. Particularly, the 3D image comes into the spotlight for a variety of learning, medical care, military and so on, and cubic storage of information on relics, cultural heritages, animals and plants and so on beyond a short picture in an amusement part and restrictive showing for a special movie. However, due to obscurity of standards for the 3D image and difficulty of creation of 3D contents, the 3D image have been not yet popularized.

[4] In general, the 3D image shows a cubic effect due to a difference between left and right images of an object projected into eyes and is perceivable through combination of the left and right images in the brain. In case of creation of real picture 3D contents, a 3D image is created through a pre-process of synchronizing two left and right image signals received from a 3D camera and converting the synchronized image signals into a 3D image format and an editing process of converting the 3D image format into 3D contents. The 3D image is also called a stereo image.

[5] The pre-process of the 3D contents creation is mostly performed using a hardware synchronization controller, which is called a frame synchronizer, and a hardware multiplexer. The frame synchronizer synchronizes images photographed in left and right sides precisely in order to avoid awkwardness which may occur when the 3D image is formed using deviated frames. In addition, the hardware multiplexer converts the synchronized left and right images into a 3D image format adapted to a 3D display on which the 3D image is displayed, and stores a result of the conversion.

[6] Fig. 1 is a view showing a configuration of a photographing apparatus for basic left and right image photography. As shown in the figure, the photographing apparatus includes a left camera 10a, a right camera 10b, a frame synchronizer 20 for synchronizing images photographed by the cameras 10a and 10b, and a multiplexer (hereinafter abbreviated as 'MUX') 30 for converting the synchronized left and right images provided by the frame synchronizer 20 into a proper 3D image. Although the frame synchronizer 20 is not indispensable for cameras provided with a means (Gen-lock) for frame synchronization in simultaneous photographing or dedicated cameras for 3D image photographing, the frame synchronizer 20 is indispensable for general cameras. In addition, the MUX 30 converts the photographed images into the 3D image format, in real time, to be displayed on a 3D image display. The frame synchronizer 20 and the MUX 30 use a hardware device.

[7] Fig. 2 shows images of an object shown in Fig. 1, which is photographed by the photographing apparatus shown in Fig. 1. Fig. 2a shows an image obtained through the left camera 10a and an image obtained through the right camera 10b, and Fig. 2c shows an output image obtained when the images of the left and right cameras 10a and 10b are converted into a 3D image of a side by side format in the MUX 30.

[8] A 3D image generally used has a top by bottom format, an interlace format, a round format, a frame- sequential format or the like, in addition to the side by side format, depending on the kind of 3D image display on which the 3D image is displayed.

[9] Fig. 3 shows an example of an edition screen 50 of software for editing the left and right images obtained through the photographing apparatus shown in Fig. 1 to be the 3D image. As shown in the figure, since there is no dedicated software developed for 3D image creation, edition for the images is manually performed for each frame using general moving picture edition software. The shown edition screen 50 shows an example of use of "After Effect" which is representative moving picture edition software. As shown in the edition screen 50, in order to create a 3D image of a horizontal interlace format, a mask 51 applied to a left image 52 and a right image 53 is set and a degree of positional movement of the images is specified for each of the left and right images to adjust a depth effect. Next, the images are processed using the mask, and a mixing process to mix the processed images to create a horizontally interlaced 3D image 54 is set.

[10] However, since the series of processes have to be manually performed, it takes a long time to create the 3D image and the manual work has to repeat if the process of adjusting the depth effect for a certain interval is needed. For example, even in case of a 3D image of the same contents, since a 3D image to be displayed on a large screen has to be different in depth effect from a 3D image displayed on a small screen, contents to be provided to various 3D image displays have to be differently edited and created although the same left and right moving picture source is used. Accordingly, increase of time and costs of 3D image creation by the manual work is unavoidable. Particularly, since the frame synchronizer and the multiplexer are expensive and bulky, it is difficult to popularize 3D contents, which results in delay of spread of 3D displays.

Disclosure of Invention

Technical Problem

[11] It is therefore an object of the present invention to provide a 3D image editing apparatus and method which is capable of creating a 3D image inexpensively and simply by photographing left and right images with a specified audio signal and synchronizing the left and right images based on the audio signal by only a software module without a separate hardware synchronizer.

[12] It is another object of the present invention to provide a 3D image editing apparatus and method which is capable of providing a moving picture of a proper 3D image format for edition and reproduction without using an expensive multiplexer by multiplexing frame-synchronized left and right images into a 3D image format, which is applicable to a dedicated editor and a 3D image display, by a software manner before editing the frame- synchronized left and right images.

[13] It is still another object of the present invention to provide a 3D image editing apparatus and method which is capable of generating a moving picture of a desired 3D image format by a simple operation through a user interface by providing a dedicated editing means to adjust an cubic effect of a 3D image in the unit of frame and interval while displaying synchronized left and right images in the unit of frame.

[14] It is still another object of the present invention to provide a 3D image editing apparatus and method which is capable of easily creating proper 3D contents for 3D displays having different sizes by editing a synchronized 3D image through display for each frame and ease adjustment of an cubic effect and automatically or manually converting resolution according to a characteristic of desired target 3D display.

[15] It is still another object of the present invention to provide a 3D image editing apparatus and method which is capable of automatically forming a proper cubic effect and converting resolution with only designation of object 3D display, according to various sizes and resolutions of 3D displays, ranging from portable 3D displays to theater 3D displays, by specifying a particular 3D display to which left and right images having different 3D image formats are applied.

[16] It is still another object of the present invention to provide a 3D image editing apparatus and method which is capable of easily adjusting a cubic effect in a wide range and forming a cubic effect with various resolutions by adjusting the cubic effect for each scene in a minute unit and effectively compensating for holes occurring due to the adjustment of the cubic effect. Technical Solution

[17] To achieve the above objects, according to an aspect, the present invention provides a 3D image editing apparatus comprising: a photographing part that photographs left and right image information and audio information simultaneously; a synchronizing part that receives the left and right image information and audio information from the photographing part and synchronizes the left and right image information and audio information based on a root-mean- square (RMS) value of the audio information for each of left and right images; and a multiplexing part that converts the synchronized left and right images into a 3D image format by software.

[18] According to another aspect, the present invention provides a 3D image editing apparatus comprising: a 3D image pre-processing part that acquires left and right images and audio signals, synchronizes the left and right images and audio signals based on a synchronization signal included in the audio signals, and converts the synchronized left and right images and audio signals into a preset 3D image format; and a 3D image editing part that provides a function of displaying the left and right images of the 3D image format provided by the 3D image pre-processing part and a degree of cubic effect in the unit of a frame and adjusting the cubic effect for each desired interval and combines the left and right images and audio signals in a particular 3D image format.

[19] According to still another aspect, the present invention provides a 3D image editing method comprising the steps of: providing physical audio information of a preset size and photographing left and right image information and audio information simultaneously; receiving the left and right image information and audio information, detecting the physical audio information of the preset size from the audio information for the images, and synchronizing left and right images based on the detected physical audio information; and converting the synchronized left and right images into a 3D image format.

[20] According to still another aspect, the present invention provides a 3D image editing method comprising: a first step of photographing left and right images and audio information including a synchronization audio signal of a preset size; a second step of acquiring the photographed left and right images and audio information, synchronizing the left and right images and audio information based on the synchronization audio signal included in the audio information, and converting the synchronized left and right images into a preset 3D image format; a third step of reading the 3D image format, separating the left and right images from each other, and editing the separated left and right images according to control information by executing an editing program to variably adjust a depth effect; and a fourth step of converting the left and right images having the adjusted depth effect and the audio information into a 3D image format with resolution set after the editing.

Advantageous Effects

[21] According to the present invention, the 3D image editing apparatus and method has an advantage of reduction of costs and high use accessibility since left and right images can be synchronized only a software module without a separate hardware synchronizer by photographing the left and right images with a specified audio signal and synchronizing the left and right images based on the audio signal.

[22] In addition, the 3D image editing apparatus and method has an advantage in that contents of a 3D image format for edition and reproduction can be created without using an expensive multiplexer by multiplexing frame- synchronized left and right images into a 3D image format, which is applicable to a dedicated editor and a 3D image display, by a software manner before editing the frame-synchronized left and right images.

[23] In addition, the 3D image editing apparatus and method has an advantage in that a moving picture of a desired 3D image format can be generated by a simple operation through a user interface by providing a dedicated editing means to adjust an cubic effect of a 3D image in the unit of frame and interval while displaying synchronized left and right images in the unit of frame.

[24] In addition, the 3D image editing apparatus and method has an advantage in that proper 3D contents for 3D displays having different sizes can be easily created by editing a synchronized 3D image through display for each frame and ease adjustment of an cubic effect and automatically or manually converting resolution according to a characteristic of desired target 3D display.

[25] In addition, the 3D image editing apparatus and method has an advantage of automatically forming a proper cubic effect and converting resolution with only designation of object 3D display, according to various sizes and resolutions of 3D displays, ranging from portable 3D displays to theater 3D displays, by specifying a particular 3D display to which left and right images having different 3D image formats are applied.

[26] Furthermore, the 3D image editing apparatus and method has an advantage of easily adjusting a cubic effect in a wide range and forming a cubic effect with various resolutions by adjusting the cubic effect for each scene in a minute unit and effectively compensating for holes occurring due to the adjustment of the cubic effect. Brief Description of the Drawings

[27] Fig. 1 is a block diagram showing a configuration for left and right image acquisition. [28] Fig. 2 shows an example of a 3D image obtained by the acquisition of the left and right image acquisition of Fig. 1.

[29] Fig. 3 shows an example of a 3D image frame edition system using the left and right images.

[30] Fig. 4 is a conceptual view for explaining the operation concept of an embodiment of the present invention.

[31] Fig. 5 shows an edition screen of an embodiment of the present invention.

[32] Fig. 6 is a conceptual view showing a 3D image creating process according to an embodiment of the present invention.

[33] Fig. 7 is a graphical view showing comparison of a cubic effect adjusting method of an embodiment of the present invention with an existing cubic effect adjusting method.

[34] Fig. 8 shows an example of 3D image formats provided in an embodiment of the present invention.

[35] Fig. 9 is a flow chart illustrating an operation of an embodiment of the present invention. Mode for the Invention

[36] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

[37] Fig. 4 is a conceptual view for explaining the operation concept of an embodiment of the present invention through which a general operation of the present invention will be described. Fig. 4a shows a conceptual flow diagram and Fig. 4b shows exemplary information arranged in the conceptual flow diagram.

[38] Considering the general flow of the conceptual flow diagram to obtain contents of a real picture 3D image format, first, left and right moving pictures (including an image and an audio signal) are acquired using a photographing means and are provided to an application program executing on a computer directly (through direct connection) or indirectly (transmission of only data) (Sl). In this case, images of the same object at different points of time are presented as shown in Fig. 4b. The application program performs subsequent functional blocks (S2 to S6) shown in Fig. 4a and may be a single software, or a program module (DLL, OCX, Active X or the like) and an integrated software that manages the program module, substantially including all forms that can be executed by software, not by hardware. Although it is illustrated in this embodiment that the application program is executed on a personal computer, the application program may be executed on any environments as long as the application program can be substantially executed, including a dedicated apparatus, a remote server, a virtual computing environment, etc. However, it is advantageous in the viewpoint of general- purpose to use a general program executed on the personal computer under a general operating system.

[39] Considering the functional blocks (S2 to S6) operating by software, first, audio signals are respectively extracted from the left and right moving pictures (S2). Next, the audio signals are filtered to remove noise (S3). At this time, exemplary waveforms of the left and right audio signals are shown to be deviated from each other as shown in Fig.4b. This is because photographing timings are different if the photographing means has no special device (for example, Gen-Lock). If the deviated left and right audio signals are converted into a 3D image format, quality of a 3D image is deteriorated.

[40] Accordingly, audio signals having a certain amplitude is detected from left and right audio signals having no noise that are extracted through the S2 and S3 steps (S4), and then, the left moving picture is synchronized with the right moving picture based on the detected audio signals (S5). The audio signals having a certain amplitude is detected using a root-mean-square (RMS). Target audio signals to be detected are physically generated and inserted for synchronization when the left and right moving pictures are photographed. For example, when the left and right moving pictures begin to be photographed, a starting signal having a certain amplitude is generated to notice the start of the photographing and to be used for synchronization. Of course, although audio characteristics may be diverse, such as inserting the audio signals for each scene or using signals of a particular pattern, it is preferable to use sporadic audio signals having a particular amplitude for easiness of detection and synchronization.

[41] The above synchronization process is performed by software without using a hardware equipment such as the frame synchronizer, and accordingly, the left and right moving pictures can be inexpensively and simply synchronized.

[42] In addition, the synchronized left and right moving pictures are stored in the form of a 3D image format in order to apply the synchronized left and right moving pictures to a dedicated edition program to be described later or directly provide these moving pictures to different kinds of programs or 3D image displays. Since different kinds of 3D image formats are mixed depending on the type of 3D display, it is preferable to select and store one of various supported 3D image formats. However, if the 3D image format aims at application of the dedicated edition program to be described later, a sequential frame method (shown in Fig. 4b), which is the simplest 3D image format, a side-by-side method or a top-by-bottom method may be used.

[43] The process of converting the synchronized left and right images into the 3D image format is also performed by software effectively replacing an expensive hardware multiplexer. An existing hardware multiplexer is equipment requisite for applying a result of image photographing to a 3D display and monitoring contents and states of a photographed 3D image. Such a hardware multiplexer is very expensive and bulky, which makes it difficult to popularize 3D image contents. However, the above step (S6) of performing the mixing operation by software allows the synchronized left and right moving pictures to be converted into the single 3D image format without such expensive hardware equipment.

[44] In addition, when the 3D image format is applied to the dedicated edition program to be described later, since the edition program can freely adjust an depth effect of the 3D image and a result having the depth effect adjusted can be confirmed through a 3D display, the multiplexing step (S6) may be omitted and the dedicated edition program can directly use the synchronized left and right moving pictures as the case may be.

[45] Fig. 5 shows an example of a configuration of a screen of a dedicated 3D edition program to read the 3D image format obtained through the above process, set a desired frame interval to have a depth effect of a desired level, and convert the set frame interval into a 3D image format with resolution adapted to a target 3D image display.

[46] As shown in Fig. 5, a screen 100 includes a left image display region 101 for displaying a left image, a right image display region 102 for displaying a right image, a depth effect adjustment window 110 for adjusting a depth effect of the left and right images, a frame edition window 130 for arranging a plurality of frames so that a desired one of the plurality of frames can be easily selected and a desired frame interval is easily set, and an audio edition window 140 for indicating left and right audio signals corresponding to the plurality of frames. The screen 100 further includes a frame advancing scroll bar 150 for setting an edition position to be a desired edition point, a state output window 160 for indicating a current state, and a menu bar 120 for showing various menus.

[47] The information shown in the screen 100 is not necessarily displayed on a single screen, but some of the information may be displayed only when a particular menu is selected and the screen may be modified in various ways.

[48] Although not shown, the screen 100 may further include a 3D display region for confirming contents of the 3D image at the same time of editing the frames through the 3D image display, or may be configured to include a menu for providing a 3D image for a current frame in an overall screen so that an cubic effect of the current frame (or frame interval) can be rapidly confirmed.

[49] User interfaces composed of elements of the screen 100 can be adjusted by various input means including a keyboard, a mouse, a tablet, a touch pad, voice and so on, details of which will be omitted since they are well known in the art.

[50] Considering functions provided through the user interfaces of the screen 100, first, the 3D image edition program shown as the screen 100 reads the 3D image format generated by the process shown in Fig. 4 or other processes, divides the read 3D image format into left and right images, and provides the left and right images in the unit of frame to a user. In addition, a depth effect can be adjusted (and confirmed if necessary) in the unit of frame, and can be collectively adjusted through interval setting. In addition, the 3D image edition program further includes a function of again converting the left and right images and audio signals into a 3D image format with desired resolution.

[51] That is, when the user executes the 3D image edition program and selects a desired

3D image format, visual information on the left and right moving pictures is provided to the user in the unit of frame. At this time, the user can select a cubic effect as a whole or he/she can partially and differently adjust the cubic effect in the unit of interval or frame. In addition, by converting the selected 3D image format into a 3D image format with desired resolution, contents adapted to a desired 3D image display can be easily generated.

[52] The 3D image edition program can be integrated with or separated from the synchronization and multiplexing programs shown in Fig. 4. If the 3D image edition program and the synchronization and multiplexing programs are separately configured as modules, these moduled programs can be selectively called and managed by an integrated management program.

[53] Fig. 6 is a conceptual view showing an operation of the 3D image edition program shown in Fig. 5. As shown in Fig. 6, a moving picture having a 3D image format is received, analyzed and divided into left and right moving pictures, or independent left and right moving pictures with no 3D image format are directly received (SlO). That is, it may be configured that the left and right moving pictures are synchronized based on audio signals without performing a separate multiplexing process and then the synchronized left and right moving pictures are received, or it may be configured that the 3D image format is received after performing the multiplexing process and is divided into (synchronized) left and right moving pictures.

[54] Then, the cubic effect of the obtained left and right moving pictures is adjusted

(Sl 1). Particularly, since the 3D image edition program is a computer-based application having high arithmetic capability so that the cubic effect can be obtained by two-dimensional curve adjustment, not by one-dimensional multiple adjustment, a natural and effective cubic effect can be adjusted. Fig. 7 shows a conversion graph applied to provide the cubic effect. Fig. 7a shows an example of an existing cubic effect adjustment method in which a depth effect is adjusted by adjusting a photographing apparatus or through simple calculation, and Fig. 7b shows an example of a depth effect adjustment method provided by the 3D image edition program of this invention.

[55] The 3D image edition program can also provide a function of effectively presenting an actual cubic effect according to adjustment of the depth effect and a function of compensating for generation of holes in a more convenient manner. The hole may be generated because data are insufficient when the left and right images are converted into the 3D image format as a setting value of depth of the cubic effect increases. The hole means that, for example when a cubic effect is adjusted by horizontally shifting images, a portion of image in the opposite side to a horizontal shift direction of images is empty due to excessive horizontal shift. This problem may be overcome by inserting null data into the empty portion, however, using the dedicated 3D image edition program which is capable of utilizing high speed operable computer resources, it is preferable to set resolution of left and right moving pictures, which are initially provided as a source, to be higher than target resolution, or, if the source resolution is less than the target resolution, it is preferable to adjust depth of a cubic effect after adjusting the source resolution to be higher than the target resolution. In this case, the resolution is properly re-adjusted in generating a final 3D image format for a target 3D image display.

[56] The adjustment of the cubic effect may be either manually set through adjustment of the user interface or automatically set according to a preset criterion. For example, when the kind of a 3D image display to be applied is specified, depth of the cubic effect is properly set accordingly to be automatically applied to all frames or selected interval frames.

[57] In this manner, after the depth effect of the 3D image is applied to desired frames, a basic moving picture editing operation, such as cutting and attaching the left and right images and the left and right audios, making a special effect, etc., is performed (S 12). Since the moving picture editing function provided in the edition program is similar to a general moving picture edition function, details of which will be described. The moving picture editing operation (S 12) and the cubic effect adjusting operation (Sl 1) may be reversed in order or alternately repeated.

[58] When desired contents are created by performing the cubic effect adjusting operation (Sl 1) and the moving picture editing operation (S 12), the created contents have to be stored with a 3D image format adapted to the target 3D image display. To this end, the left and right images or the 3D images having the adjusted cubic effect are adjusted to have proper resolution (S 13), the images and audios are converted (S 14) into a proper 3D image format and stored, and then, the stored 3D image format is provided to the 3D image display or the edition program provides the 3D image format to the 3D image display directly (S15).

[59] In this embodiment, it is configured to support resolutions having sizes of QVGA

(320x240) [a PDA, a mobile communication terminal, etc.], VGA (640x480) [a PDA, a mobile communication terminal, a PMP, a DMA receiver, etc.], SVGA(800x600) [a TV, a monitor, etc.], XGA (1024x768) [a monitor, a TV, a projector, etc.], SXGA (1280x1024) [a monitor, a TV, a projector, etc.], FuIl-HD (1920x1080) [a large monitor, a large TV, a HD projector, etc.], and other resolutions (resolution of a mobile communication terminal, general HD (1366x768) resolution, user-specified resolution, etc.). In addition, the 3D image format includes at least formats of interlace (Fig. 8a), frame sequential (Fig. 8b), top by bottom (Fig. 8c), side by side (Fig. 8d), round (Fig. 8e), etc., as 3D image formats for 3D image displays of a shutter glass type, a polarization type, a barrier type, a lenticular type, etc.

[60] When the left and right moving picture source including particular audio synchronization information is prepared, subsequent 'synchronization', 'multiplexing', 'cubic effect editing', 'image editing', 'resolution converting', '3D image format converting' operations can be performed by software, thereby making it very ease to create real picture 3D image contents, which results in significant reduction of hardware burden and costs.

[61] Now, the above-described operations by software will be described with reference to Fig. 9 showing a flow chart illustrating an overall operation of the 3D image editing apparatus according to the embodiment of the present invention.

[62] First, a target 3D image display is determined, and then, a source moving picture is inputted to generate a 3D image format having proper resolution. This source moving picture may be inputted in the form of a file in real time through hardware connection, or in the form of a stream via a network.

[63] When the source moving picture is inputted, the kind of the source moving picture is classified automatically or as set when a user specifies a source to determine whether or not the inputted source moving picture has the 3D image format.

[64] If it is determined that the inputted source 3D moving picture has left and right moving picture information other than the 3D image format (including audio synchronization information of a particular size), frame synchronization performed based on synchronization included in left and right audio signals, and then, a process of generating the 3D image format is performed using a multiplexing function, or an editing function of editing the synchronized left and right moving pictures is performed without using the multiplexing function.

[65] If it is determined that the inputted source 3D moving picture has the 3D image format, the 3D image format is analyzed, the left and right moving pictures are separated from each other, and then, an editing function of editing the left and right moving picture information is performed.

[66] When performing the edition function, an edition interval is set to adjust a cubic effect or an editing operation is performed foe each frame. The edition interval is a particular interval specified by a user, an entire interval or a single frame, and the cubic effect adjustment is achieved by adjusting binocular parallax separately or simultaneously. At this time, the cubic effect adjustment may be made using a two- dimensional curve conversion method, and resolution may be adjusted for hole compensation. In addition, a particular frame may be inserted or deleted, making a special effect through the editing function for each frame in a manner similar to a general moving picture edition.

[67] In addition, an overall cubic effect may be automatically adjusted based on information on the kind of the target 3D image display (the kind of a cubic effect providing method, or resolution), and then, a user may manually adjust a cubic effect for only a particular interval. This is because a degree of depth of the cubic effect for the same cubic effect is varied depending on resolution. Through this function, it becomes easy to generate the same contents for different kinds of 3D image displays.

[68] If the user wishes to confirm the 3D image during the cubic effect adjustment for each interval or the frame edition using the editing function, the 3D image according to the 3D image format is displayed on a separate window, a converted overall screen, some of an edition screen, or an output part for an external 3D image display. This is optional but very useful if a display means performing the edition function is a 3D image display. In addition, if a 3D image display is additionally connected, contents of the 3D image can be confirmed at the same time of editing the 3D image and it is ease to perform the editing operation.

[69] The 3D image can be confirmed for each frame, each interval and an entire image.

After completing such confirmation or without such confirmation, the edited left and right moving images are converted into the 3D format for the target 3D image display.

[70] For the 3D format conversion, first, resolution is converted to be adapted to the target 3D image display, the left and right images with the resolution converted are combined according to the 3D image format, and then a final 3D image format is generated and stored using a codec selected to store 3D image information and left and right audio information.

[71] Although some of the above-described operations and processes may be omitted or different processes may be added as necessary, at least one of the synchronization process based on the audio information and the cubic effect adjustment and 3D image format converting process using a simple setting is necessarily included.

Claims

[1] A 3D image editing apparatus comprising: a photographing part that photographs left and right image information and audio information simultaneously; a synchronizing part that receives the left and right image information and audio information from the photographing part and synchronizes the left and right image information and audio information based on a root-mean-square (RMS) value of the audio information for each of left and right images; and a multiplexing part that converts the synchronized left and right images into a 3D image format by software.

[2] The 3D image editing apparatus according to claim 1, wherein the synchronizing part and the multiplexing part are software programs executed on a computer having a means for acquiring the left and right images provided by the photographing part.

[3] The 3D image editing apparatus according to claim 1, wherein the synchronizing part detects physical audio information at a particular point of time, which is included in the audio information for the left and right images, and adjusts a frame synchronization point of the left and right images to make the audio information synchronizing with each other.

[4] The 3D image editing apparatus according to claim 1, wherein the audio information for the left and right images, which is synchronized by the synchronizing part, is single audio sound information provided to the photographing part at the time of starting a unit photograph.

[5] The 3D image editing apparatus according to claim 1, wherein the multiplexing part converts the synchronized left and right images into a 3D image format of one of a side-by-side type and a top-by-bottom type.

[6] A 3D image editing apparatus comprising: a 3D image pre-processing part that acquires left and right images and audio signals, synchronizes the left and right images and audio signals based on a synchronization signal included in the audio signals, and converts the synchronized left and right images and audio signals into a preset 3D image format; and a 3D image editing part that provides a function of displaying the left and right images of the 3D image format provided by the 3D image pre-processing part and a degree of cubic effect in the unit of a frame and adjusting the cubic effect for each desired interval and combines the left and right images and audio signals in a particular 3D image format.

[7] The 3D image editing apparatus according to claim 6, wherein the 3D image pre- processing part and the 3D image editing part are computer software that can acquire the left and right images and audio signals.

[8] The 3D image editing apparatus according to claim 6, wherein the 3D image preprocessing part includes a synchronizing part that receives the left and right images and audio signals, detects a synchronization signal of a particular audio signal level inserted when the left and right images are generated, using a root- mean-square (RMS) method, and synchronizes the left and right images based on the detected synchronization signal.

[9] The 3D image editing apparatus according to claim 6, wherein the 3D image preprocessing part includes a multiplexing part that converts the synchronized left and right images into a 3D image format which can be read by the 3D image editing part.

[10] The 3D image editing apparatus according to claim 6, wherein the 3D image editing part includes: a left and right image display part that confirms the 3D image format and displays the left and right images separately; a depth effect adjusting part that adjusts depth of a cubic effect by adjusting binocular parallax as specified by a user; and a frame display part that displays a plurality of frames to allow the user to set a desired interval.

[11] The 3D image editing apparatus according to claim 6, wherein the 3D image editing part displays the left and right images and the degree of cubic effect in the unit of a frame and simultaneously displays a 3D image with the cubic effect.

[12] The 3D image editing apparatus according to claim 6, wherein the 3D image editing part represents variations of the cubic effect to a degree of adjustment of cubic effect in the form of a two-dimensional curve.

[13] The 3D image editing apparatus according to claim 6, wherein the 3D image editing part automatically selects a cubic effect or resolution depending on the kind of a target 3D image display.

[14] The 3D image editing apparatus according to claim 13, wherein the kind of a target 3D image display is at least one selected from sizes of QVGA, VGA, SVGA, XGA, SXGA and HD depending on resolution.

[15] The 3D image editing apparatus according to claim 6, wherein the 3D image editing part includes a format converting part that receives or converts a 3D image format supporting at least one of a shutter glass type, a polarization type, a barrier type and a lenticular type.

[16] The 3D image editing apparatus according to claim 6, wherein the 3D image editing part includes a depth effect adjusting part having a hole compensating function of converting the left and right images having more than target resolution into left and right images having the target resolution after adjusting binocular parallax as specified by a user.

[17] The 3D image editing apparatus according to claim 6, wherein the 3D image editing part provides a user interface that provides at least the left image, the right image, a depth effect adjusting means and a frame interval selecting means as one screen.

[18] A 3D image editing method comprising the steps of: providing physical audio information of a preset size and photographing left and right image information and audio information simultaneously; receiving the left and right image information and audio information, detecting the physical audio information of the preset size from the audio information for the images, and synchronizing left and right images based on the detected physical audio information; and converting the synchronized left and right images into a 3D image format.

[19] The 3D image editing method according to claim 18, wherein the step of converting the synchronized left and right images into the 3D image format includes storing the images of the 3D image format and the left and right audio information as a single moving picture through a particular coded.

[20] The 3D image editing method according to claim 18, wherein, in the step of photographing the left and right image information and audio information simultaneously, the physical audio information of the preset size is provided at a point of time of starting the photographing.

[21] The 3D image editing method according to claim 18, wherein the step of synchronizing the left and right images includes obtaining a root-mean- square (RMS) value of the left and right audio information and determining the physical audio information of the preset size based on the obtained root-mean- square value.

[22] The 3D image editing method according to claim 18, wherein the step of synchronizing the left and right images and the step of converting the synchronized left and right images into the 3D image format are performed by software executed on a computer.

[23] The 3D image editing method according to claim 18, wherein the step of converting the synchronized left and right images into the 3D image format includes converting the synchronized left and right images into a 3D image format of one of a side-by-side type and a top-by-bottom type.

[24] A 3D image editing method comprising: a first step of photographing left and right images and audio information including a synchronization audio signal of a preset size; a second step of acquiring the photographed left and right images and audio information, synchronizing the left and right images and audio information based on the synchronization audio signal included in the audio information, and converting the synchronized left and right images into a preset 3D image format; a third step of reading the 3D image format, separating the left and right images from each other, and editing the separated left and right images according to control information by executing an editing program to variably adjust a depth effect; and a fourth step of converting the left and right images having the adjusted depth effect and the audio information into a 3D image format with resolution set after the editing.

[25] The 3D image editing method according to claim 24, wherein the second to fourth steps are performed by individual or integrated software.

[26] The 3D image editing method according to claim 24, wherein, in the second step, the step of synchronizing the left and right images and audio information based on the synchronization audio signal included in the audio information includes obtaining a root-mean-square (RMS) value of the left and right audio information, determining the synchronization audio signal of the preset size based on the obtained root-mean-square value, and synchronizing the left and right images and audio information based on the determined synchronization audio signal.

[27] The 3D image editing method according to claim 24, wherein, in the second step, the preset 3D image format is a 3D image format of one of a side-by-side type and a top-by-bottom type.

[28] The 3D image editing method according to claim 24, wherein, in the third step, the editing program generates and applies control information to adjust depth of a cubic effect by automatically selecting a cubic effect and resolution depending on the kind of a target 3D image display.

[29] The 3D image editing method according to claim 24, wherein, in the third step, the editing program provides a means to allow a user to specify a frame interval and applies a depth effect variably adjusted by the user for the specified frame interval.

[30] The 3D image editing method according to claim 24, wherein, in the third step, the editing program reads the 3D image format, converts the left and right images to have more than predetermined resolution, and then variably adjusts a depth effect according to a setting.

[31] The 3D image editing method according to claim 24, wherein, in the third step, the editing program displays the left and right images and images having the 3D image format with the adjusted depth effect simultaneously.

[32] The 3D image editing method according to claim 24, wherein the resolution set in the fourth step is at least one selected from sizes of QVGA, VGA, SVGA, XGA, SXGA and HD.

[33] The 3D image editing method according to claim 24, wherein the 3D image format set in the fourth step is one of 3D image formats supporting at least one of a shutter glass type, a polarization type, a barrier type and a lenticular type.