CN102918858A

CN102918858A - 3-D panoramic image creating apparatus, 3-D panoramic image creating method, 3-D panoramic image creating program, 3-D panoramic image replay apparatus, 3-D panoramic image replay method, 3-D panoramic image replay program, and recording medium

Info

Publication number: CN102918858A
Application number: CN2011800267197A
Authority: CN
Inventors: 若林觉
Original assignee: Fujifilm Corp
Current assignee: Fujifilm Corp
Priority date: 2010-12-24
Filing date: 2011-11-08
Publication date: 2013-02-06
Anticipated expiration: 2031-11-08
Also published as: CN102918858B; WO2012086326A1; JPWO2012086326A1; US20130076856A1; US8687041B2; JP5214826B2

Abstract

In a 3-D panoramic image creating method of one embodiment of the present invention, a plurality of 3-D images, comprising left-side images and right-side images captured continuously while moving a 3-D image-pickup apparatus in one direction, are obtained, a 3-D panoramic image is created by compositing the left-side images and compositing the right-side images, corresponding points between the 3-D images are detected, the amount an image is to be deviated to make the parallax between the corresponding points become a prescribed value is calculated, and corresponding-point information and the amount an image is to be deviated are recorded in association with the 3-D panoramic image.

Description

Stereoscopic panoramic image creates equipment, stereoscopic panoramic image creation method and stereoscopic panoramic image creation procedure, stereoscopic panoramic image reproducer, stereoscopic panoramic image reproducting method and stereoscopic panoramic image playback program, and recording medium

Technical field

The present invention relates to stereoscopic panoramic image and create equipment, method and program, stereoscopic panoramic image reproducer, method and program, and recording medium, and relate more specifically to create based on a plurality of stereo-pictures of taking by the moving three-dimensional imaging device stereoscopic panoramic image establishment equipment, method and the program of stereoscopic panoramic image, by stereoscopic panoramic image reproducer, method and the program of rolling or stereoscopic panoramic image is reproduced in broadcast frame by frame, and recording medium.

Background technology

Usually, in known panorama mosaic method, with being fixed to tripod etc. so that the video camera of its rotation is carried out continuous shooting, and will be linked together with synthetic panoramic picture (patent documentation 1) from taking continuously the image cut Slit Image into strips that obtains by this.

Patent documentation 2 has been described the parallax adjustment of the image that is used for three-dimensional reading, but the position relationship that is used between the disparity barrier of the browser of disparity barrier type and the pixel that is used for the three-dimensional image of reading has been adjusted in this adjusting.

In the patent documentation 3 described 3 D image display devices, when having inputted when being used for regulating the information of stereo-picture parallax amount, based on the information of this input image that zooms in or out, change thus the parallax amount of stereo-picture.

In patent documentation 4 described stereo image correction equipment, detect at the left eye that consists of stereo-picture with image and right eye with the parallax amount between the image, and regulate this parallax amount with ejection amount and the amount of retreating of control stereo-picture.

{ reference listing }

{ patent documentation }

PTL 1: Japanese Patent Application Publication No.11-164325

PTL 2: Japanese Patent Application Publication No.2003-169351

PTL 3: Japanese Patent Application Publication No.2005-73013

PTL 4: Japanese Patent Application Publication No.2010-45584

Summary of the invention

{ technical problem }

The summary of patent documentation 1 has been described: will be linked together from the Slit Image (slit image) that continuously shot images cuts into shape of slit, be used for the panoramic picture that left eye reading and right eye are read to create.Yet the specification of patent documentation 1 does not have to describe the establishment about the panoramic picture that is used for left eye reading and right eye reading at all.

In addition, though the parallax adjustment before in the not mentioned stereoscopic panoramic image (3D panoramic picture), the parallax amount regulation technology described in the patent documentation 2 to 4 can be applicable to the 3D panoramic picture.

Simultaneously, compare with the aspect ratio (4:3,16:9) of the screen of normal 3D display, the 3D panoramic picture is larger.For whole 3D panoramic picture is presented on the 3D display, the upper and lower of 3D indicator screen is covered in order to show.On the other hand, in order effectively to use the whole screen of 3D display, the 3D panoramic picture is exaggerated so that 3D panoramic picture width longitudinally is consistent with 3D display width longitudinally.Then, by roll reproducing the 3D panoramic picture of this amplification, perhaps the 3D panoramic picture being divided into a plurality of frames with aspect ratio with 3D display and reproducing these frames that obtained by cutting apart by playing frame by frame afterwards.

Usually, there is not such 3D panoramic picture reproducer: when by rolling or frame by frame during play reproduction 3D panoramic picture, this 3D panoramic picture reproducer automatically regulates parallax so that this image has the best parallax for each scrolling position or each frame.Especially, when by rolling or frame by frame during play reproduction 3D panoramic picture, such situation can appear, so that there is not the crosspoint part (part that between left image and right image, does not have parallax) of appreciable impact 3D rendering reading effect in the 3D rendering that is to show on the 3D display, disadvantageously make thus three-dimensional reading difficult.

Made in view of such circumstances the present invention, and purpose of the present invention is for providing stereoscopic panoramic image to create equipment, method and program, stereoscopic panoramic image reproducer, method and program, and recording medium, they can be by rolling or automatically regulating parallax for each scrolling position or each frame during the play reproduction stereoscopic panoramic image frame by frame.

{ scheme of dealing with problems }

To achieve these goals, a kind of stereoscopic panoramic image establishment equipment according to a first aspect of the invention comprises: stereo-picture obtains device, it obtains a plurality of stereo-pictures that formed by left image and right image taken by stereoscopic imaging apparatus, and these stereo-pictures are that stereoscopic imaging apparatus is taken when shaking along constant direction continuously; The stereoscopic panoramic image creation apparatus, it is by being synthesized together left image from a plurality of stereo-pictures that obtained the device acquisition by stereo-picture and right image being synthesized together to create the stereoscopic panoramic image that is formed by left and right panoramic picture; The corresponding points checkout gear, it detects a plurality of corresponding points that are used for parallax adjustment, and these corresponding points have in the feature of mating between the left image of a plurality of stereo-pictures that obtained the device acquisition by stereo-picture and the right image or have the feature of mating between the left and right panoramic picture of the stereoscopic panoramic image that is creating; The image shift device for calculating, it is configured to calculate a plurality of image shift amounts that all are set to predetermined parallax amount for the parallax of a plurality of corresponding points that will detect; And tape deck, it records the stereoscopic panoramic image that creates in recording medium, and the positional information that is used for a plurality of corresponding points of parallax adjustment on the stereoscopic panoramic image is recorded in recording medium as the supplementary of stereoscopic panoramic image with a plurality of image shift amounts that calculate with being associated with each other.

According to the present invention of above-mentioned first aspect, detect a plurality of corresponding points that are used for parallax adjustment for stereoscopic panoramic image.And, be used for positional information that parallax with each corresponding points is arranged on each corresponding points of image shift amount on stereoscopic panoramic image of predetermined parallax amount and be recorded on the recording medium supplementary as stereoscopic panoramic image.Like this, when by rolling or frame by frame during the play reproduction stereoscopic panoramic image, supplementary can be used for automatically metering needle to the parallax of each scrolling position or each frame.

In stereoscopic panoramic image establishment equipment according to a second aspect of the invention, in above-mentioned first aspect, the corresponding points checkout gear is configured to for each every group of left image and one group of corresponding points of right image detection that obtained by stereo-picture in the stereo-picture that device obtains, and the image shift device for calculating is configured to the computed image side-play amount, and wherein the parallax that is used between the corresponding points that detect of each image shift amount is set to predetermined parallax amount.Accordingly, calculate and recorded the as many image shift amount of quantity with the synthetic stereo-picture that is used for stereoscopic panoramic image.In addition, can be before creating stereoscopic panoramic image the computed image side-play amount.

In stereoscopic panoramic image establishment equipment according to a third aspect of the invention we, in above-mentioned second aspect, the corresponding points checkout gear be configured near detect in the part at stereo-picture center in a plurality of stereo-pictures each every group of left image and one group of corresponding points of right image.

In stereoscopic panoramic image establishment equipment according to a forth aspect of the invention, in the above-mentioned third aspect, when the corresponding points checkout gear does not detect required corresponding points in the close part at stereo-picture center, the image shift amount that the image shift device for calculating is configured to set in advance is provided as calculated value, and perhaps the image shift device for calculating is configured to come the computed image side-play amount by carry out interpolation between the adjacent image side-play amount.Like this, even not detecting the characteristic corresponding points of tool near in the part at stereo-picture center, also can access the image shift amount.

In stereoscopic panoramic image establishment equipment according to a fifth aspect of the invention, in the either side aspect above-mentioned first to fourth, the stereoscopic panoramic image creation apparatus is configured to by a plurality of Slit Image amalgamations are created stereoscopic panoramic image together, wherein each Slit Image is bar shaped, and these Slit Image are in leaning in the paracentral part in a plurality of stereo-pictures that obtained by stereo-picture acquisition device.

Stereoscopic panoramic image according to a sixth aspect of the invention creates equipment and also comprise article detection device on the basis of above-mentioned first aspect, its detection is included in by stereo-picture and obtains a plurality of stereo-pictures that device obtains or be included in required object in the stereoscopic panoramic image that creates, and wherein the corresponding points checkout gear is configured to detect the corresponding points for each object that is detected by article detection device.For example, except people's face, article detection device also detects the culture such as building or wall etc. as main object.Like this, when by rolling or frame by frame during the play reproduction stereoscopic panoramic image, can automatically carrying out parallax adjustment for each object that in stereoscopic panoramic image, detects.

Stereoscopic panoramic image according to a seventh aspect of the invention creates equipment and also comprise the interpolation calculation element on the basis of the either side aspect above-mentioned first to the 6th, this interpolation calculation element is based on a plurality of image shift amounts that calculated by the image shift device for calculating, calculate continuous pixel-shift amount by interpolated pixel side-play amount between corresponding points, and wherein tape deck is configured to a plurality of image shift amounts that will be calculated by the image shift device for calculating and is recorded in the recording medium by the image shift amount that the interpolation calculation element calculates.Accordingly, when reproducing stereoscopic panoramic image by roll mode, the image shift amount of calculating through interpolation can be used for carrying out continuously parallax adjustment.

In stereoscopic panoramic image establishment equipment according to an eighth aspect of the invention, in the either side aspect above-mentioned first to the 6th, predetermined parallax amount is zero.

A kind of stereoscopic panoramic image reproducer according to a ninth aspect of the invention, it comprises: reading device, its from according to above-mentioned first to the eight aspect the recording medium of either side read the supplementary of stereoscopic panoramic image and stereoscopic panoramic image; Transcriber, it amplifies the stereoscopic panoramic image that reads with predetermined multiplying power, and input reproduces or to reproduce the stereoscopic panoramic image of amplification for the mode of playing frame by frame by each frame of dividing in a plurality of frames that stereoscopic panoramic image obtains in the mode of rolling at three-dimensional display automatically or according to manual command; And parallax adjustment device, it selects an image shift amount from a plurality of image shift amounts that record as the supplementary of stereoscopic panoramic image, this image shift amount is corresponding to the stereo-picture in the screen of three-dimensional display, and the parallax adjustment device carries out the parallax adjustment of stereo-picture based on the image shift amount of selecting when stereoscopic panoramic image is reproduced by the mode of rolling or play frame by frame by transcriber.

According to above-mentioned the 9th aspect, read and be recorded in according to the stereoscopic panoramic image on above-mentioned first the recording medium of either side to the eight aspect and the supplementary (for example a plurality of image shift amounts) of stereoscopic panoramic image.Afterwards, when amplifying the stereoscopic panoramic image that reads with predetermined multiplying power and reproducing by rolling at three-dimensional display automatically or according to the manual command input or with for when cutting apart each frame in a plurality of frames that stereoscopic panoramic image obtains and reproduce the stereoscopic panoramic image of amplification in the mode of playing frame by frame, supplementary can be used for automatically carrying out parallax adjustment for each scrolling position or each frame.Like this, can regulate the crosspoint part (part that between left and right image, does not have parallax) of appreciable impact stereo-picture reading effect, so that three-dimensional reading becomes easy.Preferably make the stereoscopic panoramic image width in the vertical multiplying power consistent with three-dimensional display width in the vertical although it should be noted that predetermined multiplying power, can be more greater or lesser than this multiplying power.In addition, can suitably regulate predetermined multiplying power.

A kind of stereoscopic panoramic image reproducer according to tenth aspect present invention comprises: stereoscopic panoramic image obtains device, the stereoscopic panoramic image that its acquisition is formed by left and right panoramic picture; The corresponding points checkout gear, it detected a plurality of corresponding points that are used for parallax adjustment in the stereoscopic panoramic image before reproducing the stereoscopic panoramic image that obtains, and these corresponding points have the feature of mating between left and right panoramic picture; The image shift device for calculating, it calculates the image shift amount that all is set to predetermined parallax amount for the parallax of a plurality of corresponding points that will detect; Storage device, it stores the positional information that is used for a plurality of corresponding points of parallax adjustment on the stereoscopic panoramic image with a plurality of image shift amounts that calculate with being associated with each other; Transcriber, it amplifies the stereoscopic panoramic image that obtains with predetermined multiplying power, and automatically or according to the manual command input reproduces in the mode of rolling at three-dimensional display or to reproduce the stereoscopic panoramic image of amplification for the mode of playing frame by frame by each frame of cutting apart in a plurality of frames that stereoscopic panoramic image obtains; And parallax adjustment device, it selects an image shift amount from be stored in a plurality of image shift amounts the described storage device corresponding to stereoscopic panoramic image, this image shift amount is corresponding to the stereo-picture in the screen of three-dimensional display, and the parallax adjustment device carries out the parallax adjustment of stereo-picture based on the image shift amount of selecting when stereoscopic panoramic image is reproduced by the mode of rolling or play frame by frame by transcriber.

Above-mentioned the tenth aspect relates to a kind of stereoscopic panoramic image reproducer in the time can not obtaining the supplementary (for example supplementary of a plurality of image shift amounts) of stereoscopic panoramic image from recording medium.Before reproducing stereoscopic panoramic image, the stereoscopic panoramic image reproducer detects a plurality of corresponding points that are used for parallax adjustment, and these corresponding points have the feature of mating between left and right panoramic picture; Calculate the image shift amount that is used for the parallax of these corresponding points all is arranged on predetermined parallax amount; The positional information that is used for a plurality of corresponding points of parallax adjustment on the stereoscopic panoramic image is stored with a plurality of image shift amounts that calculate with being associated with each other; Then a plurality of image shift amounts of using storage are with by rolling or carrying out parallax adjustment during by play reproduction stereoscopic panoramic image frame by frame.The mode that it should be noted that to be similar to above-mentioned the 9th aspect is carried out by rolling or parallax adjustment during by play reproduction stereoscopic panoramic image frame by frame.

In stereoscopic panoramic image reproducer according to an eleventh aspect of the invention, in aspect the above-mentioned the tenth, the corresponding points checkout gear is configured to detect for by cutting apart each the one group of corresponding points in a plurality of Slit Image that all are bar shaped that panoramic picture obtains.

In stereoscopic panoramic image reproducer according to a twelfth aspect of the invention, in above-mentioned the tenth one side, when the corresponding points checkout gear does not detect required corresponding points in the close part at stereo-picture center, the image shift amount that the image shift device for calculating is configured to set in advance is provided as calculated value, and perhaps the image shift device for calculating is configured to come the computed image side-play amount by carry out interpolation between the adjacent image side-play amount.

Stereoscopic panoramic image reproducer according to a thirteenth aspect of the invention also comprises article detection device on the basis aspect the above-mentioned the tenth, article detection device detects the required object in the stereoscopic panoramic image that is included in acquisition, and wherein the corresponding points checkout gear is configured to detect the corresponding points for each object that is detected by article detection device.Like this, when the frame by frame play reproduction stereoscopic panoramic image by rolling or cut apart, can carry out parallax adjustment for each object in the stereoscopic panoramic image.

Stereoscopic panoramic image reproducer according to a fourteenth aspect of the invention also comprises the interpolation calculation element on the basis of the either side of above-mentioned the tenth to the tenth three aspects:, it is based on a plurality of image shift amounts that calculated by the image shift device for calculating, calculate continuous pixel-shift amount by interpolated pixel side-play amount between corresponding points, and wherein storage device configuration becomes a plurality of image shift amounts that storage calculates by the image shift device for calculating and the image shift amount that is calculated by the interpolation calculation element.

In stereoscopic panoramic image reproducer according to a fifteenth aspect of the invention, in the either side aspect the above-mentioned the tenth to the 14, predetermined parallax amount is zero.

In stereoscopic panoramic image reproducer according to a sixteenth aspect of the invention, in the either side aspect the above-mentioned the 9th to the 15, the parallax adjustment device be configured to select three-dimensional display screen center the place or the image shift amount in the part of the most close screen center, and carry out the parallax adjustment of stereo-picture based on the image shift amount of selecting.Accordingly, can be set to predetermined parallax amount so that the solid reading of object becomes easy at the screen center place of three-dimensional display or in the parallax amount near the object in the part of screen center.It should be noted that as in aspect the above-mentioned the 15, when predetermined parallax amount is zero, the destination object plane earth show and the most easily reading arrive.Yet the present invention is not limited to this.For example, predetermined parallax amount can be arranged on suitable value, and can regulate parallax amount so that destination object looks slightly forward ejects.

Stereoscopic panoramic image reproducer according to a seventeenth aspect of the invention is configured on the basis of the either side aspect the above-mentioned the 9th to the 16 when transcriber reproduces stereoscopic panoramic image according to the manual command input by roll mode, before stopping to roll, select an image shift amount corresponding with the stereo-picture in the screen that is presented at three-dimensional display according to manual command input when beginning to roll, and when stopping when rolling, select to be presented at when stopping to roll the corresponding image shift amount of stereo-picture in the screen of three-dimensional display, and carry out the parallax adjustment of stereo-picture based on the image shift amount of selection.So, the parallax adjustment during the rolling is fixed, and can reduce thus the kopiopia that causes because of the parallax fluctuation and can carry out the parallax adjustment corresponding with the stereo-picture that stops when stopping to roll.

In stereoscopic panoramic image reproducer according to an eighteenth aspect of the invention, in the either side aspect the above-mentioned the 9th to the 16, transcriber is configured to only make one in left image and the right image to be presented on the three-dimensional display during the rolling that input is reproduced with roll mode according to manual command, and when rolling stereo-picture is presented on the three-dimensional display, and when stopping to roll, the parallax adjustment device is configured to select an image shift amount corresponding with the stereo-picture in the screen that is presented at three-dimensional display when stopping to roll, and carries out the parallax adjustment of stereo-picture based on the image shift amount of selecting.So, owing to display plane image during rolling, therefore can reduce kopiopia, and when stopping to roll, can carry out the parallax adjustment corresponding with the stereo-picture that stops.

In stereoscopic panoramic image reproducer according to a nineteenth aspect of the invention, in the either side of above-mentioned the 9th to the tenth eight aspect, transcriber is configured to make whole stereoscopic panoramic image to be presented on the three-dimensional display, then amplifies stereoscopic panoramic image and the mode playback stereoscopic panoramic image by rolling or playing frame by frame with predetermined multiplying power.Like this, after checking whole stereoscopic panoramic image, can with the mode of playing frame by frame of rolling or carried out cutting apart read amplify and convergent-divergent after stereoscopic panoramic image.

A kind of stereoscopic panoramic image creation method according to a twentieth aspect of the invention comprises: stereo-picture obtains step, be used for to obtain a plurality of stereo-pictures that the left image taken by stereoscopic imaging apparatus and right image form, these stereo-pictures are stereoscopic imaging apparatus continuously shootings when shaking along constant direction; The stereoscopic panoramic image foundation step is used for by from a plurality of stereo-pictures that obtain left image being synthesized together and right image being synthesized together to create the stereoscopic panoramic image that is formed by left and right panoramic picture; The corresponding points detecting step, for detection of a plurality of corresponding points that are used for parallax adjustment, these corresponding points have the feature of mating between the left and right panoramic picture of the feature of mating between the left image of a plurality of stereo-pictures that obtain and the right image or the stereoscopic panoramic image that creating; Image shift amount calculation procedure is used for calculating a plurality of image shift amounts that all are set to predetermined parallax amount for the parallax of a plurality of corresponding points that will detect; And recording step, the stereoscopic panoramic image that is used for creating is recorded in recording medium and the positional information that is used for a plurality of corresponding points of parallax adjustment on the stereoscopic panoramic image is recorded in recording medium as the supplementary of stereoscopic panoramic image with a plurality of image shift amounts that calculate with being associated with each other.4

In stereoscopic panoramic image creation method according to a twenty-first aspect of the invention, in aspect the above-mentioned the 20, the corresponding points detecting step is configured to for each every group of left image and the one group of corresponding points of right image detection in the stereo-picture that obtains, and image shift amount calculation procedure be configured to from for described a plurality of stereo-pictures each and specify one group of corresponding points in the corresponding points that detect, and calculate the image shift amount that the parallax between the corresponding points is set to be scheduled to parallax amount that all is used for.

In stereoscopic panoramic image creation method according to a twenty-second aspect of the invention, the above-mentioned the 20 on the one hand in, the corresponding points detecting step be configured near detect in the part at stereo-picture center in described a plurality of stereo-pictures each every group of left image and one group of corresponding points of right image.

In stereoscopic panoramic image creation method according to a twenty-third aspect of the invention, in aspect the above-mentioned the 22, when the corresponding points checkout gear does not detect required corresponding points in the close part at stereo-picture center, the image shift amount that image shift amount calculation procedure is configured to set in advance is provided as calculated value, and perhaps image shift amount calculation procedure is configured to come the computed image side-play amount by carry out interpolation between the adjacent image side-play amount.

In stereoscopic panoramic image creation method according to a twenty-fourth aspect of the invention, in the either side of above-mentioned the 20 to the 20 three aspects:, the stereoscopic panoramic image foundation step is configured to by a plurality of Slit Image amalgamations are created stereoscopic panoramic image together, wherein each Slit Image is bar shaped, these Slit Image be in a plurality of stereo-pictures of acquisition by in the paracentral part.

Also comprise the object detection step of the required object in the stereoscopic panoramic image that detects a plurality of stereo-pictures be included in acquisition or establishment on the basis of stereoscopic panoramic image creation method aspect the above-mentioned the 20 according to the twenty-fifth aspect of the invention, wherein the corresponding points detecting step is configured to detect the corresponding points for each object that is detected by article detection device.

Stereoscopic panoramic image creation method is according to the twenty-sixth aspect also comprising the interpolation calculation procedure of calculating continuous pixel-shift amount in image shift amount calculation procedure based on a plurality of image shift amounts that calculate, by interpolated pixel side-play amount between corresponding points on the basis of the either side aspect the above-mentioned the 20 to the 25, wherein recording step is configured to a plurality of image shift amounts that will calculate and the image shift amount that calculates is recorded in the recording medium in the interpolation calculation procedure in image shift amount calculation procedure.

In stereoscopic panoramic image creation method according to a twenty-seventh aspect of the invention, in the either side aspect the above-mentioned the 20 to the 25, predetermined parallax amount is zero.

A kind of stereoscopic panoramic image reproducting method according to a twenty-eighth aspect of the invention comprises: read step is used for reading from the recording medium according to the either side of above-mentioned the 20 to the 27 aspect the supplementary of stereoscopic panoramic image and stereoscopic panoramic image; Reproduce step, be used for amplifying the stereoscopic panoramic image that reads with predetermined multiplying power, and automatically or according to the manual command input reproduce in the mode of rolling at three-dimensional display or to reproduce the stereoscopic panoramic image of amplification for the mode of playing frame by frame by each frame of cutting apart in a plurality of frames that stereoscopic panoramic image obtains; And parallax adjustment step, be used for selecting an image shift amount from a plurality of image shift amounts that record as the supplementary of stereoscopic panoramic image, this image shift amount is corresponding to the stereo-picture in the screen of three-dimensional display, and carries out the parallax adjustment of stereo-picture when reproducing stereoscopic panoramic image by the mode of rolling or play frame by frame in described reproduction step based on the image shift amount of selecting.

A kind of stereoscopic panoramic image reproducting method according to the twenty-ninth aspect comprises: stereo-picture obtains step, obtains the stereoscopic panoramic image that is formed by left and right panoramic picture; The corresponding points detecting step is used for detecting a plurality of corresponding points that are used for parallax adjustment in the stereoscopic panoramic image before reproducing the stereoscopic panoramic image that obtains, and these corresponding points have the feature of mating between left and right panoramic picture; Image shift amount calculation procedure is used for calculating the image shift amount that all is arranged on predetermined parallax amount for the parallax of a plurality of corresponding points that will detect; Storing step is used for the positional information that is used for a plurality of corresponding points of parallax adjustment on the stereoscopic panoramic image is stored with a plurality of image shift amounts that calculate with being associated with each other; Reproduce step, be used for amplifying the stereoscopic panoramic image that obtains with predetermined enlargement ratio, and automatically or according to the manual command input reproduce in the mode of rolling at three-dimensional display or to reproduce the stereoscopic panoramic image of amplification for the mode of playing frame by frame by each frame of dividing in a plurality of frames that stereoscopic panoramic image obtains; And parallax adjustment step, be used for from a plurality of image shift amounts that are stored in storage device corresponding to stereoscopic panoramic image, selecting an image shift amount, this image shift amount is corresponding to the stereo-picture in the screen of three-dimensional display, and carries out the parallax adjustment of stereo-picture when reproducing stereoscopic panoramic image by the mode of rolling or play frame by frame in reproducing step based on the image shift amount of selecting.

In stereoscopic panoramic image reproducting method according to a thirtieth aspect of the invention, in aspect the above-mentioned the 29, the corresponding points detecting step is configured to detect for by cutting apart each the one group of corresponding points in a plurality of Slit Image that all are bar shaped that panoramic picture obtains.

In stereoscopic panoramic image reproducting method according to a thirty-first aspect of the invention, in aspect the above-mentioned the 30, when in the corresponding points detecting step, in the close part at stereo-picture center, not detecting required corresponding points, the image shift amount that image shift amount calculation procedure is configured to set in advance is provided as calculated value, and perhaps image shift amount calculation procedure is configured to come the computed image side-play amount by carrying out interpolation between the adjacent image side-play amount.

Also comprise the object detection step that detects the required object in the stereoscopic panoramic image that is included in acquisition on the basis of stereoscopic panoramic image reproducting method aspect the above-mentioned the 29 according to a thirty-second aspect of the invention, wherein the corresponding points detecting step is configured to detect the corresponding points for detected each object in the object detection step.

Stereoscopic panoramic image reproducting method according to the 30 three aspects: of the present invention is also comprising the interpolation calculation procedure of calculating continuous pixel-shift amount in image shift amount calculation procedure based on a plurality of image shift amounts that calculate, by interpolated pixel side-play amount between corresponding points on the basis of the either side aspect the above-mentioned the 29 to the 32, wherein storing step is configured to be stored in a plurality of image shift amounts that calculate in the image shift amount calculation procedure and the image shift amount that calculates in the interpolation calculation procedure.

In according to the stereoscopic panoramic image reproducting method aspect the of the present invention the 34, in the either side of above-mentioned the 29 to the 30 three aspects:, predetermined parallax amount is zero.

In according to the stereoscopic panoramic image reproducting method aspect the of the present invention the 35, in the either side aspect the above-mentioned the 28 to the 34, the parallax adjustment arrangements of steps become to be selected to be in the screen center place of three-dimensional display or is in image shift amount in the part of the most close screen center, and carries out the parallax adjustment of stereo-picture based on the image shift amount of selecting.

In according to the stereoscopic panoramic image reproducting method aspect the of the present invention the 36, in the either side aspect the above-mentioned the 28 to the 35, when the reproduction step is reproduced stereoscopic panoramic image according to the manual command input by roll mode, the parallax adjustment arrangements of steps became before stopping to roll to select an image shift amount corresponding with the stereo-picture in the screen that is presented at three-dimensional display according to manual command input when beginning to roll, and when stopping when rolling, select to be presented at when stopping to roll the corresponding image shift amount of stereo-picture in the screen of three-dimensional display, and in the parallax adjustment step, carry out the parallax adjustment of stereo-picture based on the image shift amount of selection.

In according to the stereoscopic panoramic image reproducting method aspect the of the present invention the 37, in the either side aspect the above-mentioned the 28 to the 35, reproducing arrangements of steps becomes during the rolling that input is reproduced with roll mode according to manual command only to make one in left image and the right image to be presented on the three-dimensional display, and when rolling stereo-picture is presented on the three-dimensional display, and the parallax adjustment arrangements of steps becomes to select an image shift amount corresponding with the stereo-picture in the screen that is presented at three-dimensional display when stopping to roll when stopping to roll, and carries out the parallax adjustment of stereo-picture based on the image shift amount of selecting.

In the stereoscopic panoramic image reproducting method according to the 30 eight aspect of the present invention, in the either side aspect the above-mentioned the 28 to the 37, reproduce step whole stereoscopic panoramic image is presented on the three-dimensional display, then amplify stereoscopic panoramic image and the mode playback stereoscopic panoramic image by rolling or playing frame by frame with predetermined multiplying power.

Be configured to create equipment by computer realization according to above-mentioned first the stereoscopic panoramic image of either side to the eight aspect according to a kind of stereoscopic panoramic image playback program of the 39 aspect of the present invention.

A kind of stereoscopic panoramic image creation procedure according to the 40 aspect of the present invention is configured to by the stereoscopic panoramic image reproducer of computer realization according to the either side in above-mentioned the 9th to the 19 aspect.

{ beneficial effect of the present invention }

In the present invention, detection is for a plurality of corresponding points that are used for parallax adjustment of stereoscopic panoramic image, and is used for the image shift amount that parallax with each corresponding points on this stereoscopic panoramic image is arranged on predetermined parallax amount and calculated and record with the positional information of each corresponding points.Therefore, when by rolling or frame by frame during the play reproduction stereoscopic panoramic image, the image shift amount of record can be used for automatically metering needle to the parallax of each scrolling position or each frame.Like this, can reproduce the stereoscopic panoramic image that easily three-dimensional reading is arrived by the mode of rolling or play frame by frame.

Description of drawings

Figure 1A is the front perspective view of stereoscopic imaging apparatus according to an embodiment of the invention.

Figure 1B is the back perspective view of stereoscopic imaging apparatus according to an embodiment of the invention.

Fig. 2 is the block diagram of internal structure that shows the stereoscopic imaging apparatus of Fig. 1.

Fig. 3 is the diagram of taking the method for the 3D rendering that is used for the 3D panorama mosaic.

Fig. 4 A is for the diagram of describing 3D panorama mosaic and other content.

Fig. 4 B is for the diagram of describing 3D panorama mosaic and other content.

Fig. 4 C is for the diagram of describing 3D panorama mosaic and other content.

Fig. 4 D is for the diagram of describing 3D panorama mosaic and other content.

Fig. 4 E is for the diagram of describing 3D panorama mosaic and other content.

Fig. 5 is the form of explanation supplementary example, has recorded the CP amount (Δ x) that the coordinate (x, y) with the crosspoint CP of each 3D rendering is associated thereon.

Fig. 6 is that explanation is for the flow chart of the operating procedure of the acquisition of the 3D rendering that creates 3D panoramic picture and 3D panorama mosaic.

Fig. 7 is the flow chart that the first embodiment of the method for reproducing the 3D panoramic picture is described.

Fig. 8 A is when by rolling and the image viewing during play reproduction 3D panoramic picture frame by frame.

Fig. 8 B is when by rolling and the image viewing during play reproduction 3D panoramic picture frame by frame.

Fig. 9 is the flow chart that the second embodiment of the method for reproducing the 3D panoramic picture is described.

Figure 10 is the flow chart that the 3rd embodiment of the method for reproducing the 3D panoramic picture is described.

Figure 11 is the diagram of display screen that shows the LCD monitor of whole 3D panoramic picture.

Figure 12 is the flow chart that the 4th embodiment of the method for reproducing the 3D panoramic picture is described.

Figure 13 A is the diagram of taking the other method of the 3D rendering that is used for the 3D panorama mosaic.

Figure 13 B is the diagram of taking the another method of the 3D rendering that is used for the 3D panorama mosaic.

Figure 14 is the diagram of the visual angle coupling when being described in the 3D rendering that take to be used for the 3D panorama mosaic.

Embodiment

The below describes with reference to the accompanying drawings according to stereoscopic panoramic image of the present invention and creates equipment, method and program, stereoscopic panoramic image reproducer, method and program, and recording medium.

[outward appearance of stereoscopic imaging apparatus]

Figure 1A and Figure 1B are the outside diagrams of stereoscopic imaging apparatus according to an embodiment of the invention.Figure 1A is the perspective view of the stereoscopic imaging apparatus 1 when watching from the top along diagonal, and Figure 1B is the perspective view of the stereoscopic imaging apparatus 1 when watching from the rear surface.

Shown in Figure 1A, stereoscopic imaging apparatus 1 is provided with left image-generating unit L and right image-generating unit R.For distinguishing, hereinafter these image-generating units are called the first image-generating unit L and the second image-generating unit R.

The first image-generating unit L and the second image-generating unit R are arranged side by side, in order to can obtain the picture signal for the solid reading.At these image-generating units L and R place, create respectively left picture signal and right picture signal.When the mains switch 10A on the upper surface of the stereoscopic imaging apparatus 1 of Figure 1A and Figure 1B is operated, screening-mode driver plate 10B (for example is arranged under the certain pattern, three-dimensional pattern), operate afterwards shutter release button 10C, all created the view data that is used for three-dimensional reading at image-generating unit L and R.

Be included in shutter release button 10C in the stereoscopic imaging apparatus 1 of this embodiment have half by with entirely by two kinds of operator schemes.In this stereoscopic imaging apparatus 1, when partly tripping button 10C, carry out exposure and regulate and focus adjustment, and ought entirely carry out shooting on time.In addition, when field brightness is too dark, send the top that window WD is arranged on image-generating unit L to the flash of light that object flashes.

Further, as shown in Figure 1B, stereoscopic imaging apparatus 1 is provided with the LCD monitor DISP that can carry out three-dimensional display at the back.On this LCD monitor DISP, be imaged the same target that unit L and R capture and be shown as stereo-picture.The example that it should be noted that adaptable LCD monitor DISP comprises the LCD monitor of using biconvex lens or disparity barrier and the LCD monitor that allows to read respectively right image and left image by wearing special eyeglasses (for example polarising glass or liquid crystal shutter glasses).Further, arrange and arranged operators such as ZSW 10D, menu/OK button 10E and cross key 10F.Hereinafter, the console switch that comprises mains switch 10A, screening-mode driver plate 10B, shutter release button 10C, ZSW 10D, menu/OK button 10E and cross key 10F can be referred to as operating unit 10.

[internal structure of stereoscopic imaging apparatus]

Fig. 2 is the block diagram of internal structure of the stereoscopic imaging apparatus 1 of explanation Figure 1A and Figure 1B.With reference to Fig. 2, the internal structure of stereoscopic imaging apparatus 1 is described.

Control in a concentrated manner the operation of this stereoscopic imaging apparatus 1 by host CPU (CPU) 100.

The ROM(read-only memory) 101 is connected to host CPU 100 via bus B us.In ROM101, storage is used for the required program of this stereoscopic imaging apparatus of operation 1.Based on the process of these programs, host CPU 100 is according to the operation of controlling in a concentrated manner this stereoscopic imaging apparatus 1 from the instruction of operating unit 10.

The pattern driver plate 10B of operating unit 10 is that these patterns are: the automatic shooting pattern for the choice device of selecting any pattern from following pattern; Manual screening-mode; Personage, landscape, night scene or other scene location; Be used for taking the mobile picture mode of mobile picture; And according to solid of the present invention (3D) panoramic picture screening-mode and 3D panoramic picture reproduction mode.In addition, unshowned reproduction button is be used to the button that switches to reproduction mode in the operating unit 10, and under reproduction mode, the still picture of taking or recording or mobile Image Display are on LCD monitor DISP.Menu/OK button 10E is not only as menu button but also as the operation keys of OK button, wherein menu button is used for sending menu is presented at instruction on the screen of LCD monitor DISP, and the OK button is used for sending the instruction that selected project etc. is determined and carried out.Cross key 10F inputs the operating unit of instruction for any one direction upper and lower along comprising, left and right this four direction, and is used as from the menu screen option or sends from the various buttons (cursor movement operating means) that the instruction of any one project the project is set of each menu setecting.In addition, the up/down key on the cross key 10F is used as ZSW and is used as when reproduction mode and reproduces scaling switch when screening-mode, and the left/right key is used as frame by frame broadcast (forwards/reverse is presented) button when reproduction mode.

At first, when the mains switch 10A in the operating unit shown in Figure 1 10 is operated, host CPU 100 is controlled power control units 1001 so that be supplied to each unit of Fig. 2 via power control unit 1001 from the electric power of battery Bt, makes thus this stereoscopic imaging apparatus 1 change mode of operation into.By this way, host CPU 100 beginning photographing process.It should be noted that, AF(automatic focus) detecting unit 120, AE/AWB(automatic exposure/Automatic white balance) detecting unit 130, image input control device 114A, digital signal processing unit 116A and 3D rendering creating unit 117 all be considered to by such as the DSP(digital signal processor) etc. processor consist of and host CPU 100 various processing of execution that are considered to cooperate with these DSP.

With reference to Fig. 2 the first image-generating unit L is described herein, and the second image-generating unit R(is described above with reference to Fig. 1) internal structure.It should be noted that by each element for the first image-generating unit L provides word " first " and provides word " second " to be described for each element of the second image-generating unit R.

The first image-generating unit L is provided with: the first photographing optical system 110A that comprises the first amasthenic lens FLA; The first amasthenic lens driver element (hereinafter being called a F lens driving unit) 104A, it is used for moving this first amasthenic lens FLA along optical axis direction; And the first image-forming component 111A, it is used for receiving by form the object light that object images obtains and the picture signal that creates this object of expression at the first photographing optical system 110A.The first aperture driver element 105A that this first photographing optical system 110A also is provided with the first aperture IA and is used for changing the opening diameter of this first aperture IA.

In addition, the first photographing optical system 110A comprises zoom lens ZLA.Z lens driving unit 103A is provided, has been used for control this zoom lens ZLA so that this zoom lens is arranged to have predetermined focal distance.It should be noted that in Fig. 2, schematically show the fact that whole photographing optical system is zoom lens with a camera lens ZL.

On the other hand, as the first image-generating unit L, the second image-generating unit R is provided with: the photographing optical system that comprises the second amasthenic lens FLB; The second amasthenic lens driver element (hereinafter being called the 2nd F lens driving unit) 104B, it is used for moving this second amasthenic lens FLB along optical axis direction; And the second image-forming component 111B, it is used for receiving by form the object light that object images obtains and the picture signal that creates this object of expression in the second photographing optical system.

In these the first image-generating unit L and the second image-generating unit R, created the picture signal that is used for three-dimensional reading.That is to say, created left picture signal at the first image-generating unit L, and created right picture signal at the second image-generating unit R.

The first image-generating unit L and the second image-generating unit R have identical structure, difference only is to create left picture signal or right picture signal, and the picture signal of two image-generating units is converted to digital signal respectively and is directed to afterwards bus B us back in an A/D converting unit 113A and the 2nd A/D converting unit 113B signal processing also is identical.Therefore, the below describes this structure along the flow direction about the picture signal of the first image-generating unit L.

At first, the operation of description when the object of being caught by the first image-generating unit L directly is presented at the upper conduct real-time reading image of LCD monitor DISP (direct picture).

After mains switch 10A in the operating unit 10 operated, host CPU 100 control power control units 1001 made this stereoscopic imaging apparatus 1 change mode of operation into so that be supplied to each unit from the electric power of battery Bt thus.

Host CPU 100 is at first controlled F lens driving unit 104A and aperture driver element 105A to begin exposure and focus adjustment.In addition, host CPU 100 indication timing generator (TG) 106A are so that image-forming component 111A arranges the time for exposure by electronic shutter, and make picture signal export analogy signal processing unit 112A to from image-forming component 111A every the scheduled time (for example, 1/60 second).

At analogy signal processing unit 112A, when the supply that receives timing signal from TG 106A and when the scheduled time receives the supply of picture signal from image-forming component 111A, carry out the processing such as noise reduction.Afterwards, the analog picture signal through noise reduction process is supplied to A/D converting unit 113A in the next stage.In addition, at this A/D converting unit 113A, and from the timing signal of TG106A synchronously, carry out the processing that analog signal conversion is become digital signal in the scheduled time.By this way, guided to bus B us in the scheduled time by image input control device 114A by changing the data image signal that obtains and export from A/D converting unit 113A.This picture signal via bus B us guiding is stored in the SDRAM(synchronous DRAM) in 115.Since every the scheduled time from image-forming component 111A output image signal, therefore rewrite the content of this SDRAM 115 every the scheduled time.

Being stored in the DSP that the picture signal among this SDRAM 115 is configured AF detecting unit 120, AE/AWB detecting unit 130 and digital signal processing unit 116A every the scheduled time reads.

At AF detecting unit 120, for at host CPU 100 control F lens driving unit 104A so that amasthenic lens FLA each scheduled time during moving, the high fdrequency component of picture signal is extracted and is accumulated AF assessed value with computational chart diagram image contrast in the focusing area.Host CPU 100 obtains the AF assessed value calculated by AF detecting unit 120, and the first amasthenic lens FLA moves to lens location (focal position) by F lens driving unit 104A, and is maximum in this AF of lens location place assessed value.For this reason, though the first image-generating unit L towards any direction, also adjusting focal length immediately, and the object that focuses on roughly always is presented on the LCD monitor DISP.

In addition, at AE/AWB detecting unit 130, carry out the detection of object brightness and calculating to the gain of the white balance amplifier among the digital signal processing unit 116A will be set every the scheduled time.In response to the brightness testing result of this AE/AWB detecting unit 130, host CPU 100 control aperture driver element 105A are to change the opening diameter of aperture IA.In addition, after the testing result that receives from AE/AWB detecting unit 130, the gain of digital signal processing unit 116A dialogue balance amplifier arranges.

At this digital signal processing unit 116A, carry out processing so that picture signal becomes and be suitable for demonstration.Then, the signal by digital signal processing unit 116A is processed and is converted the picture signal that is more suitable for showing to and be supplied to 3D rendering creating unit 117, and in this 3D rendering creating unit 117, creates to be used for the right picture signal that shows.The right picture signal that creates is stored in the VRAM(video RAM) in 118.

The second image-generating unit R is also with identical sequential execution same operation up to the present.Therefore, in VRAM 118, stored picture signal right and left two types.

Host CPU 100 is sent to indicative control unit 119 so that image is presented on the LCD monitor DISP with the right picture signal among the VRAM 118 and left picture signal.When the image based on right picture signal and left picture signal was presented at the LCD monitor DISP of Figure 1B when upper, the image on the LCD monitor DISP appears to three-dimensional concerning human eye.Since every the scheduled time from the first image-forming component 111A and the second image-forming component 111B output image signal continuously, therefore again write picture signal among the VRAM 118 every the scheduled time, and the stereo-picture on scheduled time switchable liquid crystal monitor DISP makes stereo-picture be shown as mobile picture thus.

Herein, when partly pressing when the object on the reference LCD monitor DISP and with the shutter release button 10C in the operating unit 10, received by AE/AWB detecting unit 130 and just to press the AE value that detects before the shutter release button 10C fully, and the first aperture IA and the second aperture IB are arranged to have certain diaphragm diameter by the first aperture driver element 105A and the second aperture driver element 105B respectively.In addition, press operation in response to above-mentioned half, host CPU 100 makes AF detecting unit 120 calculate the AF assessed value, and the first amasthenic lens FLA and the second amasthenic lens FLB are mobile in predetermined search ranges by a F lens driving unit 104A and the 2nd F lens driving unit 104B simultaneously.

Based on the AF assessed value of being calculated by AF detecting unit 120, the lens location of the first amasthenic lens FLA when host CPU 100 detects the AF assessed values and becomes maximum and the lens location of the second amasthenic lens FLB, and the first amasthenic lens FLA and the second amasthenic lens FLB moved to respectively the first lens location and the second lens location.

Then, when shutter release button 10C was pressed fully, host CPU 100 made the first image-forming component 111A and the second image-forming component 111B expose to carry out the shooting of still picture with predetermined shutter speed by a TG106A and the 2nd TG 106B.Host CPU 100 makes picture signal export the first analogy signal processing unit 112A and the second analogy signal processing unit 112B to from the first image-forming component 111A and the second image-forming component 111B in the close moment of electronic shutter, makes thus the first analogy signal processing unit 112A and the second analogy signal processing unit 112B carry out noise reduction process.At an A/D converting unit 113A and the 2nd A/D converting unit 113B, analog picture signal is converted into data image signal.

Herein, according to the instruction of host CPU 100, the first and second image input control device 114A make the data image signal that obtains by the conversion at an A/D converting unit 113A and the 2nd A/D converting unit 113B once be stored among the SDRAM 115 via bus B us.Then, digital signal processing unit 116A and 116B read the picture signal among the SDRAM 115, carries out image processing, and afterwards result is sent to 3D rendering creating unit 117, wherein image is processed and is comprised white balance correction, Gamma correction, to with veneer CCD(charge coupled device) on colour filter arrange that the R(be associated is red), G(is green), B(is blue) and the color signal of other color in spatial deviation carry out interpolation so that the synchronous processing that the position of each color signal matches each other, contour correction, and brightness/color difference signal (YC signal) produces.

Subsequently, host CPU 100 is by using bus B us that the right picture signal in the 3D rendering creating unit 117 and left picture signal are provided to compression/decompression unit 150.Host CPU 100 compresses 150 pairs of view data of this compression/decompression unit, then by use bus B us packed data is sent to the medium control unit, and with compression with take relevant header information and be supplied to medium control unit 160, so that medium control unit 160 (for example creates image file with predetermined format, the image file of form) and image file is recorded on the storage card 161 as the 3D still picture, many pictures of MP().

When the pattern driver plate 10B that utilizes operating unit 10 selected 3D panoramic picture screening-mode, host CPU 100 was carried out the processing of taking the required a plurality of stereo-pictures of 3D panorama mosaic.A plurality of 3D renderings (a plurality of left images and a plurality of right image) of taking when in addition, 3D rendering creating unit 117 is used as according to 3D panoramic picture screening-mode create the graphics processing unit of 3D panoramic picture.It should be noted that and hereinafter further describe the details of operation of stereoscopic imaging apparatus 1 when 3D panoramic picture screening-mode.

Corresponding points detecting unit 170 detects the corresponding points of characteristic matching between each 3D rendering (left image and right image), and detects the corresponding points of characteristic matching between the previous image taken continuously when 3D panoramic picture screening-mode and the successive image.The corresponding points of front detect and be used for the computed image side-play amount in order to use when the parallax adjustment of 3D panoramic picture, and the corresponding points of back detect for calculate light stream (translational component) when creating the 3D panoramic picture.The example that it should be noted that the corresponding points detection method comprises: by use Harris scheme extract minutiae and by using KLT(Kanade Lucas Tomasi) method of the tracking characteristics point such as method.

Face-detecting unit 172 detects people's face from direct picture (through-the-lens image), and will be about the information output of this facial position and size to host CPU 100.That is, face-detecting unit 172 comprises image checking circuit and face-image template.In the position of images match circuit moving object region on the screen of direct picture the image in the target area and face-image template are checked to find out therebetween correlation each other.Afterwards, when the correlation score surpassed predetermined threshold value, face-detecting unit 172 was identified as facial zone with the target area.In addition, face-detecting unit 172 can be from detecting facial from the image of taking in a similar manner.

It should be noted that any type of face detection method that can be used as in other known method, for example the type of face detection method by rim detection or shape pattern detection and detect or the type of face detection method of Face Detection by form and aspect.

When the information of the position that obtains to show facial zone from face-detecting unit 172 and size, host CPU 100 can and be presented on the LCD monitor DISP synthetic result with the facial detection block of the synthetic facial zone that centers on the people who obtains of direct picture.In addition, the position of the facial zone that detects as mentioned above and size are as AF zone or the AE zone of the face that focuses on the people, so that the brightness of people's face is suitable.The position of the facial zone that detects in each 3D rendering in addition, can be used as will be by the corresponding points of corresponding points detecting unit 170 detections.

It should be noted that Fig. 2 illustrates photoflash lamp control unit 180, sends photoflash lamp 181 that window WD flashes and for detection of the timing unit W of current time from the flash of light of Figure 1A after receiving from the instruction of photoflash lamp control unit 180.

＜obtain for the 3D rendering that creates 3D panoramic picture and 3D panorama mosaic

In order to take the 3D rendering for the 3D panorama mosaic, with the pattern driver plate 10B selection 3D panoramic picture screening-mode of operating unit 10.

Afterwards, as shown in Figure 3, make stereoscopic imaging apparatus 1 shake and it is carried out along constant direction and continue to take (taking continuously).

In Fig. 3, CP represents convergent point (hereinafter being called the crosspoint), intersect at the optical axis of the left image-generating unit L in this convergent point place and right image-generating unit R, and θ is the angle (convergent angle) that the optical axis by left image-generating unit L and right image-generating unit R forms.In this stereoscopic imaging apparatus 1, crosspoint CP and convergent angle θ fix, and for example, the distance from stereoscopic imaging apparatus 1 to crosspoint CP is approximately 2m.Yet, relatively be shifted by making left image and right image along continuous straight runs, in fact can be adjusted to the distance of crosspoint CP.

Simultaneously, the object on the CP of crosspoint does not have parallax.Therefore, by left image and right image relatively are shifted so that between left image and right image the side-play amount of the specific corresponding points (object) of characteristic matching be zero, parallax that can object is set to zero (crosspoint CP can be complementary with the distance of object).

When 3D panoramic picture screening-mode was set, host CPU 100 was carried out control so that fix for focal position, conditions of exposure and the white balance gains of the first 3D rendering, until the shooting of the 3D rendering of predetermined quantity finishes.

When the shooting of the 3D rendering of the required predetermined quantity of 3D panorama mosaic finished, the shooting that host CPU 100 is identified for the 3D rendering of 3D panorama mosaic finished, and be converted to such as 3D panorama mosaic etc. to pre-treatment.

Fig. 4 A to Fig. 4 E is the diagram that the synthetic processing sequence of 3D panoramic picture is shown.

In Fig. 4 A, 1 to 6 is illustrated in the time-series image of taking during the shaking of stereoscopic imaging apparatus 1, and the image of upside is left image, and the image of downside is right image.

A plurality of 3D renderings of taking when 3D rendering creating unit 117 is used as from 3D panoramic picture screening-mode create the graphics processing unit of 3D panoramic pictures.In panorama mosaic is processed, calculate light stream according to the corresponding points between the time-series image that is detected by corresponding points detecting unit 170.In the example shown in Fig. 4 A, 1-2, the 2-3 between the calculating adjacent image, 3-4 ... light stream (translation vector), (x, y)=(19,2), (21 ,-1), (20,0) ...

Subsequently, shown in Fig. 4 B, based on (x, the y) that calculate=(19,2), (21 ,-1), (20,0) ... light stream (translation vector), each 3D rendering is trimmed to bar shaped.Afterwards, sequentially synthetic bar shaped Slit Image of being pruned out.Namely, clipping distance has the bar shaped Slit Image of fixed width w by the horizontal component x that makes translation vector from picture centre displacement 1/2 position that obtains, and the bar shaped Slit Image displacement translation vector with these cuttings on vertical direction and horizontal direction comes these images are synthesized, shown in Fig. 4 C.Like this, the 3D panorama mosaic has been finished.

Next, the image in the zone of the overlaid pixel with the left image that carries out panorama mosaic and right image is all pruned.In the example shown in Fig. 4 D, cut out image in the maximum rectangular area from the left image that carries out panorama mosaic and the right image each.

The left image that these cut out and right image are stored in the storage card 161 as 3D panoramic picture (Fig. 4 E).For example, (the MP file: the file with the form that is coupled in a plurality of images together), and this MP file is recorded in the storage card 161 via medium control unit 160 to generate many picture files from two left sides and right panoramic picture.It should be noted that these two left sides and right panoramic picture are not limited to be stored in the MP file, but can be stored in the independent image file, as long as they are related each other.

In addition, in the corresponding points that detected for each 3D rendering by corresponding points detecting unit 170, host CPU 100 (is for example specified near the corresponding points in the center of 3D rendering, corresponding points on characteristic point in the bar shaped Slit Image of left image and the corresponding right image), and the side-play amount (pixel quantity) of calculating these corresponding points as image shift amount (hereinafter being called the CP amount).

That is to say, host CPU 100 makes the coordinate (x of the crosspoint CP on the aforesaid CP amount that calculates for each 3D rendering and the 3D panoramic picture (left image), y) be associated, and information recording/that will be relevant with these in the head zone of MP file etc. as the supplementary of 3D panoramic picture.

Fig. 5 is the form that the example of supplementary is shown, and has recorded the CP amount (Δ x) that the coordinate (x, y) with the crosspoint CP of each 3D rendering is associated on it.

Fig. 6 is the flow chart of operation sequence that the acquisition of aforesaid 3D rendering for creating 3D panoramic picture and 3D panorama mosaic is shown.

In Fig. 6, utilize the pattern driver plate 10B of operating unit 10 to select 3D panoramic picture screening-mode, then the hand-held three-dimensional imaging device 1, and begins to take (step S10) along with shaking in a certain direction this equipment.

Host CPU 100 judges whether to take and the required as many image of panorama mosaic (step S12).If the shooting of the image of requirement finishes (in the situation of " Yes "), host CPU 100 finishes the shooting under the 3D panoramic picture screening-mode.If the shooting of the image of requirement does not finish (in the situation of " No "), host CPU 100 makes program be converted to step S14.

At step S14, detect corresponding points from the 3D rendering of taking.That is to say, extract a characteristic point near the part the center of the left image of 3D rendering, and detect corresponding points corresponding with this characteristic point on the right image.Subsequently, the CP that calculates as the side-play amount between the corresponding points that detect measures (step S16).

Store the CP amount (step S18) that calculates for the 3D rendering of each acquisition.It should be noted that CP amount be stored as with 3D panoramic picture (left image) on the coordinate (x, y) of crosspoint CP be associated, as shown in Figure 5.

In addition, as described in reference to figure 4A to Fig. 4 E, based on the 3D rendering cutting bar shaped Slit Image of light stream (translation vector) from taking previous and follow-up 3D rendering, on vertical direction and horizontal direction, these bar shaped Slit Image displacements are reached translation vector and come these images are synthesized (panorama mosaic), then make this program be converted to step S12(step S20).

, create the 3D panoramic picture and calculate its supplementary (for example CP amount), and the 3D panoramic picture is stored in the storage card 161 with supplementary by repeating in the above described manner above-mentioned steps S12 to step S20 for the required image of panorama mosaic.

It should be noted that in Fig. 6, carry out the calculating of CP amount and storage and panoramic picture for each 3D rendering of taking during the shaking of stereoscopic imaging apparatus 1 synthetic.Yet the present invention is not limited to this.For example, can take and the required as many 3D rendering of panorama mosaic, these 3D renderings can be stored among the SDRAM 115 temporarily, then can carry out the calculating, panorama mosaic etc. of CP amount for each 3D rendering.

The reproduction of＜3D panoramic picture 〉

[the first embodiment]

Next, the reproduction that is stored in the above described manner the 3D panoramic picture in the storage card 161 is described.

Fig. 7 is the flow chart that the first embodiment of the method for reproducing the 3D panoramic picture is shown.

In Fig. 7, with the pattern driver plate 10B selection 3D panoramic picture reproduction mode of operating unit 10, and the reproduction (step S30) of beginning 3D panoramic picture.It should be noted that when beginning to reproduce the 3D panoramic picture, read predetermined 3D panoramic picture from storage card 161, and it is stored among the SDRAM 115 temporarily.In addition, in the first embodiment, each the CP amount in a plurality of 3D renderings supposed is stored the supplementary as shown in Figure 5 3D panoramic picture.

At first, be used for the 3D rendering that shows from the left end cutting of the 3D panoramic picture that reads, wherein the aspect ratio that has of this 3D rendering equals LCD monitor DISP(Fig. 2) the aspect ratio of screen, and select the CP amount (step S32) of the core (in the center of the display screen of LCD monitor DISP) of the 3D rendering that cuts out.In this CP amount is selected, find out the position (x coordinate) of 3D panoramic picture (on the left image) of the core (part of 3D panoramic picture) of the 3D rendering on LCD monitor DISP to be shown, and select (with reference to figure 5) CP amount corresponding with crosspoint CP, wherein the x coordinate of crosspoint CP is near described x coordinate.

Subsequently, based on selected CP amount, measure to carry out parallax adjustment by making relatively left this CP of image shift of right image, and be presented at LCD monitor DISP upper (step S34) through a left side and the right image (3D rendering) of parallax adjustment.

Afterwards, judge whether to occur for the instruction of rolling 3D panoramic picture or be used for playing frame by frame instruction (step S36) by each frame of cutting apart a plurality of frames that the 3D panoramic picture obtains.If there is rolling instruction or play instruction frame by frame, then make program be converted to step S32.On the other hand, if not only the rolling instruction do not occur but also frame by frame play instruction do not occur at predetermined amount of time (that is, when the 3D panoramic picture shows to its right-hand member end), the reproduction of the 3D panoramic picture that then reads finishes.It should be noted that by generating continuously the rolling instruction or generate continuously at certain intervals frame by frame play instruction when the play reproduction frame by frame when roll reproducing, can automatically carry out rolls reproduces or play reproduction frame by frame.

When selecting the CP amount corresponding with next scrolling position or frame position based on step S32, measure to carry out parallax adjustment to above-mentioned similar mode based on the CP that selects.

Fig. 8 A and Fig. 8 B are by rolling and image views during by play reproduction 3D panoramic picture frame by frame.In Fig. 8 A and Fig. 8 B, bold box represents the demonstration image on LCD monitor DISP to be shown.

Shown in Fig. 8 A, when reproducing the 3D panoramic picture by rolling, select the CP amount at close screen center for each scrolling position of 3D panoramic picture, carry out thus parallax adjustment.Shown in Fig. 8 B, by play reproduction 3D panoramic picture frame by frame the time, select CP amount near screen center for pending each frame of playing frame by frame, carry out thus parallax adjustment.

Because by rolling or measuring to carry out parallax adjustment based on the CP near the screen center during by play reproduction 3D panoramic picture frame by frame, therefore can be set to zero near the parallax of the image of screen center.Like this, obviously affect the crosspoint part (part that does not have parallax between the left and right image) of 3D rendering reading effect always near the screen center, thus by roll or during by play reproduction frame by frame so that three-dimensional reading becomes easy.

It should be noted that in above-mentioned the first embodiment by rolling or playing frame by frame and automatically reproduce the 3D panoramic picture.Yet the present invention is not limited to this.For example, the manual operation of cross key 10F that can be by operating unit 10 is carried out by rolling or reproduction by playing frame by frame.According to this point, by rolling or during by play reproduction 3D panoramic picture frame by frame, the 3D panoramic picture can stop at any scrolling position or frame position place.

In addition, when carrying out the rolling reproduction by manual operation, carry out parallax adjustment based on proper CP amount before image is presented beginning during the rolling.So, when image is presented when stopping, can measure to carry out parallax adjustment based on the CP near the screen center that stops.Accordingly, fixedly the parallax adjustment during the rolling reduces the kopiopia that causes because of the parallax fluctuation thus.

In addition, between left image and the right image only an image (plane (2D) panoramic picture) during rolling, be presented on the LCD monitor DISP, and present when stopping when image, can measure to carry out parallax adjustment based on the CP near the screen center that stops.

[the second embodiment]

Fig. 9 is the flow chart that the second embodiment of the method for reproducing the 3D panoramic picture is shown.

The second embodiment relates to a kind of reproducting method when the CP amount is not stored as the supplementary of 3D panoramic picture.It should be noted that and have identical number of steps with those common parts of the first embodiment shown in Figure 7 and no longer be described in detail at this.

In Fig. 9, utilize the pattern driver plate 10B of operating unit 10 to select 3D panoramic picture reproduction mode, and the reproduction (step S40) of beginning 3D panoramic picture.It should be noted that when beginning to reproduce the 3D panoramic picture, read predetermined 3D panoramic picture from storage card 161, and it is stored among the SDRAM 115 temporarily, but do not store the CP amount.

In a second embodiment, before reproducing the 3D panoramic picture, carry out the calculating of CP amount etc.

That is, extract a plurality of characteristic points from the 3D panoramic picture (left image) that is read by storage card 161, and detect corresponding points corresponding with these characteristic points on the right image (step S42).It should be noted that and extract in the following manner a plurality of characteristic points: the 3D panoramic picture is divided into a plurality of zones (width of the bar shaped Slit Image of these regional width when creating the 3D panoramic picture is roughly the same) and for by cutting apart the characteristic point of each extracted region that obtains.

Subsequently, calculate the CP amount (step S44) as the side-play amount between the corresponding points that step S42 detects, and this CP amount that calculates is associated with the position coordinates of a plurality of characteristic points and is stored in (step S46) among the SDRAM 115.

Afterwards, in the mode similar to the first embodiment shown in Figure 7 by measuring rollably with CP or playing frame by frame ground and reproduce the 3D panoramic picture.

It should be noted that and reproducing after the 3D panoramic picture finishes, the CP amount among the SDRAM115 of temporarily being stored in can be used as supplementary and is recorded on the MP file, and wherein the 3D panoramic picture is stored in the MP file.

According to the second embodiment, even in the situation that the CP amount is not stored as the supplementary of 3D panoramic picture, inputted the 3D panoramic picture, also can be by rolling or playing frame by frame the 3D panoramic picture that has carried out parallax adjustment by playing to reproduce for each scrolling position or each frame by frame.

[the 3rd embodiment]

Figure 10 is the flow chart that the 3rd embodiment of the method for reproducing the 3D panoramic picture is shown.

The 3rd embodiment obtains by the first embodiment shown in Figure 7 is made amendment, and is to have increased the processing that is centered on by the single-point line with the difference of the first embodiment.

The 3rd embodiment and the second embodiment difference are that whole 3D panoramic picture is displayed first on LCD monitor DISP.

In Figure 10, when the pattern driver plate 10B that utilizes operating unit 10 selects 3D panoramic picture reproduction mode and begins to reproduce the 3D panoramic picture (step S10), select the CP amount (step S50) of the central part office of the 3D panoramic picture that reads from storage card 161.

Subsequently, based on the CP amount of selecting, measure to carry out parallax adjustment by making the relatively left image of right image this CP that only is shifted, and be presented at LCD monitor DISP upper (step S52) with whole through the 3D of parallax adjustment panoramic picture.

Figure 11 is the diagram of display screen that shows the LCD monitor DISP of whole 3D panoramic picture.

Next, judge whether to occur reproducing by roll or pass through to play frame by frame etc. the convergent-divergent instruction (step S54) of 3D panoramic picture.When the convergent-divergent instruction not occurring, make this process be converted to step S52, then show whole 3D panoramic picture.If the convergent-divergent instruction occurred, make so this process be converted to step S32.The convergent-divergent instruction can automatically generate in the past the scheduled time after showing whole 3D panoramic picture, perhaps can utilize the instruction of operating unit 10 inputs to generate based on the user.

If the convergent-divergent instruction generates and this process is converted to step S32, then the 3D panoramic picture is carried out convergent-divergent, and begin by rolling or passing through frame by frame play reproduction 3D panoramic picture (with reference to Fig. 8 A and Fig. 8 B) from the left end through the 3D of convergent-divergent panoramic picture.It should be noted that, when by rolling or during by play reproduction 3D panoramic picture frame by frame, as described at the first embodiment shown in Figure 7, play frame by frame for each scrolling position or each and to select the CP amount, and measure to carry out parallax adjustment by the CP with selection.

According to the 3rd embodiment, after the whole 3D panoramic picture of identification, then can rollably or divide and play frame by frame the ground reading through the 3D of convergent-divergent panoramic picture.

It should be noted that the second embodiment shown in Figure 9 can be retrofit into so that equally with above-mentioned the 3rd embodiment at first whole 3D panoramic picture is presented on the LCD monitor DISP.In this case, during being presented at time period on the LCD monitor DISP, can carry out whole 3D panoramic picture the calculating etc. of CP amount.In addition, when whole 3D panoramic picture is presented on the LCD monitor DISP, can utilize default CP amount (comprising CP amount=0) to carry out parallax adjustment.

In addition, by rolling or convergent-divergent multiplying power during frame by frame play reproduction 3D panoramic picture by being partitioned into is preferably the multiplying power that makes 3D panoramic picture width in the vertical consistent with LCD monitor DISP width in the vertical.Yet scope of the present invention is not limited to this multiplying power.For example, can suitably regulate multiplying power by manual zoom operations.

Other embodiment that＜CP amount is calculated 〉

In the embodiment shown in fig. 6, calculate the CP amount for each 3D rendering that is used for panorama mosaic from the corresponding points at the center of close this 3D rendering.In another embodiment that the CP of 3D panoramic picture amount is calculated, in the 3D panoramic picture, detect a plurality of main objects, calculate the side-play amount between the left and right panoramic picture of each object and it is measured as CP.

Checkout gear as detecting main object can use face-detecting unit shown in Figure 2 172.Accordingly, calculate CP amount according to each face-image that is included in the 3D panoramic picture, and the CP amount is stored as with the position of each face-image on the 3D panoramic picture (left image) is associated.

In addition, except people's face, cultures such as building and wall and also can consider as the main object in the 3D panoramic picture such as the natural object of trees and forest etc.Can detect these cultures and such as the natural object of wooden and forest by known object recognition technique (for example, the dictionary data with each object is complementary).

Therefore, by article detection device (comprising face-detecting unit 172) is provided to stereoscopic imaging apparatus 1, can be for each the calculating CP amount in the main object (objects such as face, culture and natural object) and with its storage.

[the 4th embodiment]

Figure 12 is the flow chart that the 4th embodiment of the method for reproducing the 3D panoramic picture is shown.It should be noted that and have identical number of steps with those common parts of the first embodiment shown in Figure 7 and no longer be described in detail in this article.

In Figure 12, utilize the pattern driver plate 10B of operating unit 10 to select 3D panoramic picture reproduction mode, and the reproduction (step S30') of beginning 3D panoramic picture.It should be noted that when beginning to reproduce the 3D panoramic picture, read predetermined 3D panoramic picture from storage card 161, and it is stored among the SDRAM 115 temporarily.In addition, in the 4th embodiment, suppose for each object in the 3D panoramic picture CP amount is stored as the supplementary of 3D panoramic picture.

When beginning to reproduce the 3D panoramic picture, select to be presented at LCD monitor DISP(Fig. 2) on 3D rendering (part of 3D panoramic picture) in the CP corresponding with the object at the center of close display unit measure (step S60).

Then, in the mode similar to the first embodiment shown in Figure 7 by rolling or utilizing the CP amount to carry out the 3D panoramic picture of parallax adjustment by play reproduction frame by frame.

According to the 4th embodiment, when by rolling or during by play reproduction 3D panoramic picture frame by frame, carry out parallax adjustment so that the object at the center of close display unit overlap with the crosspoint.For this reason, by rolling or the object (main object) in the three-dimensional 3D of the reading panoramic picture easily during by play reproduction frame by frame.

It should be noted that in the 4th embodiment and to select the CP corresponding with the object at the center of the display unit of close LCD monitor DISP to measure.Yet the present invention is not limited to this.For example, can (for example pre-determine priority level for every type object, according to face → building → other order), and when a plurality of dissimilar objects appear on the display screen, can select the CP amount corresponding with the object with TP top priority.In this case, also need to be stored as with the CP amount about the information of object type and be associated.

＜be used for other embodiment of acquisition of the 3D rendering of 3D panoramic picture and 3D panorama mosaic 〉

Shown in Fig. 3 and Fig. 4 A to Fig. 4 E, in order to take the 3D rendering for the 3D panorama mosaic, shake stereoscopic imaging apparatus 1 and make it carry out lasting shooting the (taking continuously) along constant direction.Yet the present invention is not limited to this.For example, can shown in Figure 13 A and Figure 13 B, carry out shooting.

That is, shown in Figure 13 A and Figure 13 B, take the first 3D rendering (Figure 13 A) by stereoscopic imaging apparatus 1.When being provided with 3D panoramic picture screening-mode, host CPU 100 is carried out control so that fix for focal position, conditions of exposure and the white balance gains of the first 3D rendering, until the follow-up shooting of the 3D rendering of predetermined quantity finishes.

When the shooting of the first 3D rendering finished, photographer shook (pan) stereoscopic imaging apparatus 1 and takes direction to change, thereby takes the second 3D rendering (Figure 13 B).

Herein, as shown in figure 14, the shooting direction of photographer by regulating stereoscopic imaging apparatus 1 is so that the first 3D rendering and the second 3D rendering overlapping shooting the partly each other.When 3D panoramic picture screening-mode, it is upper to help to determine the next time shooting direction of shooting that host CPU 100 preferably makes the part of the 3D rendering of previous shooting be presented at LCD monitor DISP.That is, the photographer's part that can before take and be presented at the 3D rendering on the LCD monitor DISP by reading and direct picture determine to take direction.

When the shooting of the pre-if 3D rendering of default setting quantity finished, the shooting that host CPU 100 is identified for the 3D rendering of 3D panorama mosaic finished, and makes this process be transformed into the subsequent treatment of 3D panorama mosaic.It should be noted that any known technology can be used as from the panorama mosaic method of the synthetic 3D panoramic picture of a plurality of 3D renderings that obtains as mentioned above.

[other]

In the embodiment shown in fig. 6, for the characteristic point of each extraction in the 3D rendering of continuous acquisition near the center of left image, and detect corresponding points corresponding with this characteristic point on the right image.Calculate the CP amount by the side-play amount between these corresponding points that detect.Yet, depending on photographed scene, can not extract in some cases near the characteristic point that is suitable for detecting corresponding points in the zone of left picture centre.In this case, will preset CP amount (comprising CP amount=0), regard CP amount for this 3D rendering as by between adjacent C P amount, carrying out CP amount that interpolation obtains etc.

In addition, when reproducing the 3D panoramic picture by rolling, in order to allow to carry out parallax adjustment for each scrolling position, can obtain the CP amount corresponding with each scrolling position by interpolation (linear interpolation) based on a plurality of CP amounts that calculate, and can record these CP amounts.

In addition, when calculating the CP amount for each object in the 3D panoramic picture, can measure by the CP that interpolation calculates between the object equally, and can record these CP amounts.

Further, in the present embodiment, can obtain side-play amount in the specific corresponding points (object) of characteristic matching between left image and the right image and be the CP amount (image shift amount) in zero the situation.Yet the side-play amount that the present invention is not limited to corresponding points is set to zero situation.For example, can obtain the image shift amount, to realize predetermined parallax amount (parallax amount that destination object is ejected slightly forward).Further, can this predetermined parallax amount suitably be set by the user.

Obtain the CP amount for each rolling amount by aforesaid interpolation, when reproducing the 3D panoramic picture by rolling, calculate the CP amount that obtains by interpolation and can be used for carrying out continuously parallax adjustment.

In addition, although this stereoscopic imaging apparatus 1 is presented on the LCD monitor DISP on the rear surface 3D panoramic picture, equipment 1 can comprise be used to making the 3D panoramic picture be presented at output interface on the outside 3D display.

In addition, can be by such as not creating equipment and 3D panoramic picture reproducer with the personal computer of shoot function configuration 3D panoramic picture.In this case, a plurality of 3D renderings that are used for the 3D panorama mosaic of being taken by general stereoscopic imaging apparatus are counted as input picture.

Further, by installing on computers via the recording medium that stores these programs according to panoramic picture creation procedure of the present invention and panoramic picture playback program, can make computer play the effect that the 3D panoramic picture creates equipment or 3D panoramic picture reproducer.

In addition, the present invention is not limited to above-described embodiment, and can carry out various modification in the scope that does not deviate from spirit of the present invention, for example by suitably making up these embodiment.

{ reference numerals list }

1 ... stereoscopic imaging apparatus; 10 ... operating unit; 100 ... host CPU; 101 ... ROM; 102 ... flash ROM; 110A ... the first imaging optical system; 110B ... the second imaging optical system; 111A ... the first image-forming component; 111B ... the second image-forming component; 115 ... SDRAM; 117 ... the 3D rendering creating unit; 119 ... indicative control unit; 160 ... the medium control unit; 161 ... storage card; 170 ... the corresponding points detecting unit; 172 ... face-detecting unit; L ... the first image-generating unit; R ... the second image-generating unit; And DISP ... the monitoring lcd device

Claims

1. a stereoscopic panoramic image creates equipment, comprising:

Stereo-picture obtains device, and it is configured to obtain a plurality of stereo-pictures of being formed by the left image of taking by stereoscopic imaging apparatus and right image, and these stereo-pictures are the continuously shootings when shaking along constant direction of described stereoscopic imaging apparatus;

The stereoscopic panoramic image creation apparatus, it is configured to by from the described a plurality of stereo-pictures that obtained the device acquisition by described stereo-picture described left image being synthesized together and described right image being synthesized together to create the stereoscopic panoramic image that is formed by left panoramic picture and right panoramic picture;

The corresponding points checkout gear, it is configured to detect a plurality of corresponding points for parallax adjustment, and described a plurality of corresponding points have the feature of mating between the left panoramic picture of the feature of mating between the left image that is obtained described a plurality of stereo-pictures that device obtains by described stereo-picture and the right image or the stereoscopic panoramic image that creating and right panoramic picture;

The image shift device for calculating, it is configured to calculate a plurality of image shift amounts that all are set to predetermined parallax amount for the parallax with detected a plurality of corresponding points; And

Tape deck, it is configured to record the stereoscopic panoramic image that creates in recording medium, the positional information that described tape deck is configured to be used for described a plurality of corresponding points of parallax adjustment on the described stereoscopic panoramic image is recorded in described recording medium as the supplementary of described stereoscopic panoramic image with a plurality of image shift amounts that calculate with being associated with each other.

2. stereoscopic panoramic image according to claim 1 creates equipment, wherein

Each of each stereo-picture in described a plurality of stereo-pictures that device obtains is organized left image to described corresponding points checkout gear and right image detects one group of corresponding points for being obtained by described stereo-picture, and

Described image shift device for calculating calculates described a plurality of image shift amount, and the parallax that each the image shift amount in these image shift amounts is used between the detected corresponding points is set to described predetermined parallax amount.

3. stereoscopic panoramic image according to claim 2 creates equipment, wherein

Described corresponding points checkout gear is being organized described one group of corresponding points of left image and right image near each that detects for each stereo-picture in the described stereo-picture in the part at described stereo-picture center.

4. stereoscopic panoramic image according to claim 3 creates equipment, wherein

When described corresponding points checkout gear does not detect required corresponding points in the close part at described stereo-picture center, the image shift amount that described image shift device for calculating sets in advance is set to calculated value, and perhaps described image shift device for calculating calculates described image shift amount by carry out interpolation between the adjacent image side-play amount.

According to claim 1 in 4 each described stereoscopic panoramic image create equipment, wherein

Described stereoscopic panoramic image creation apparatus is by create described stereoscopic panoramic image with a plurality of Slit Image amalgamations together, wherein each Slit Image is bar shaped, and described a plurality of Slit Image are arranged in by described stereo-picture and obtain described a plurality of stereo-pictures of device acquisition by paracentral part.

6. stereoscopic panoramic image according to claim 1 creates equipment, also comprises:

Article detection device, it is configured to detect be included in by described stereo-picture and obtains described a plurality of stereo-pictures that device obtains or be included in required object in the stereoscopic panoramic image that creates, wherein

Described corresponding points checkout gear detects the corresponding points for each object that is detected by described article detection device.

According to claim 1 in 6 each described stereoscopic panoramic image create equipment, also comprise

The interpolation calculation element, it is configured to based on the described a plurality of image shift amounts that calculated by described image shift device for calculating, calculates continuous pixel-shift amount by interpolated pixel side-play amount between described corresponding points, wherein

Described a plurality of image shift amounts that described tape deck will be calculated by described image shift device for calculating and be recorded in the described recording medium by the described image shift amount that described interpolation calculation element calculates.

According to claim 1 in 6 each described stereoscopic panoramic image create equipment, wherein

Described predetermined parallax amount is zero.

9. stereoscopic panoramic image reproducer comprises:

Reading device, its be configured to from according to claim 1 to 8 each described recording medium read the supplementary of stereoscopic panoramic image and described stereoscopic panoramic image;

Transcriber, it is configured to amplify the stereoscopic panoramic image that is read with predetermined multiplying power, and described transcriber is configured to automatically or input reproduces or to reproduce the stereoscopic panoramic image through amplifying for the mode of playing frame by frame by each frame of cutting apart in a plurality of frames that described stereoscopic panoramic image obtains in the mode of rolling at three-dimensional display according to manual command; And

The parallax adjustment device, it is configured to select an image shift amount from a plurality of image shift amounts that record as the supplementary of described stereoscopic panoramic image, this image shift amount is corresponding to the stereo-picture in the screen of described three-dimensional display, and described parallax adjustment device is configured to carry out based on selected image shift amount the parallax adjustment of described stereo-picture when described stereoscopic panoramic image is reproduced by the mode of rolling or play frame by frame by described transcriber.

10. stereoscopic panoramic image reproducer comprises:

Stereoscopic panoramic image obtains device, and it is configured to obtain the stereoscopic panoramic image that formed by left panoramic picture and right panoramic picture;

The corresponding points checkout gear, it is configured to detect a plurality of corresponding points that are used for parallax adjustment in the described stereoscopic panoramic image before reproducing the stereoscopic panoramic image that obtains, and described a plurality of corresponding points have the feature of mating between described left panoramic picture and described right panoramic picture;

The image shift device for calculating, it is configured to calculate a plurality of image shift amounts that all are set to predetermined parallax amount for the parallax with detected a plurality of corresponding points;

Storage device, it is configured to the positional information that is used for described a plurality of corresponding points of parallax adjustment on the described stereoscopic panoramic image is stored with a plurality of image shift amounts that calculate with being associated with each other;

Transcriber, it is configured to amplify the stereoscopic panoramic image that is obtained with predetermined multiplying power, and described transcriber is configured to automatically or input reproduces or to reproduce the stereoscopic panoramic image that is amplified for the mode of playing frame by frame by each frame of cutting apart in a plurality of frames that described stereoscopic panoramic image obtains in the mode of rolling at three-dimensional display according to manual command; And

The parallax adjustment device, it is configured to select in a plurality of image shift amounts the storage device shown in be stored in corresponding to described stereoscopic panoramic image an image shift amount, this image shift amount is corresponding to the stereo-picture in the screen of described three-dimensional display, and described parallax adjustment device is configured to carry out based on selected image shift amount the parallax adjustment of described stereo-picture when described stereoscopic panoramic image is reproduced by the mode of rolling or play frame by frame by described transcriber.

11. stereoscopic panoramic image reproducer according to claim 10, wherein

Described corresponding points checkout gear detects for by cutting apart one group of corresponding points of each Slit Image in a plurality of Slit Image that all are bar shaped that described panoramic picture obtains.

12. stereoscopic panoramic image reproducer according to claim 11, wherein

13. stereoscopic panoramic image reproducer according to claim 10 also comprises

Article detection device, it is configured to detect the required object that is included in the stereoscopic panoramic image that obtains, wherein

14. each described stereoscopic panoramic image reproducer in 13 also comprises according to claim 10

A plurality of image shift amounts that described memory device stores is calculated by described image shift device for calculating and the image shift amount that is calculated by described interpolation calculation element.

15. each described stereoscopic panoramic image reproducer in 14 according to claim 10, wherein

Described predetermined parallax amount is zero.

16. each described stereoscopic panoramic image reproducer in 15 according to claim 9, wherein

The screen center of the described three-dimensional display of described parallax adjustment Array selection be the place or the image shift amount in the part of the most close described screen center, and carry out the parallax adjustment of described stereo-picture based on selected image shift amount.

17. each described stereoscopic panoramic image reproducer in 16 according to claim 9, wherein

When described transcriber reproduces described stereoscopic panoramic image according to manual command input by roll mode, described parallax adjustment device was selected an image shift amount corresponding with the stereo-picture in the screen that is presented at described three-dimensional display according to manual command input when beginning to roll before stopping to roll, and when stopping when rolling, described parallax adjustment Array selection is presented at the corresponding image shift amount of stereo-picture in the described screen of described three-dimensional display when stopping to roll, and carries out the parallax adjustment of described stereo-picture based on selected image shift amount.

18. each described stereoscopic panoramic image reproducer in 16 according to claim 9, wherein

Described transcriber only makes an image in described left image and the described right image be presented on the described three-dimensional display during the rolling that input is reproduced with roll mode according to manual command, and when rolling described stereo-picture is presented on the described three-dimensional display, and

When stopping to roll, the image shift amount that described parallax adjustment Array selection is corresponding with the described stereo-picture in the screen that is presented at described three-dimensional display when stopping to roll, and carry out the parallax adjustment of described stereo-picture based on selected image shift amount.

19. each described stereoscopic panoramic image reproducer in 18 according to claim 9, wherein

Described transcriber is presented on the described three-dimensional display whole stereoscopic panoramic image, then amplifies described stereoscopic panoramic image and the described stereoscopic panoramic image of mode playback by rolling or playing frame by frame with predetermined multiplying power.

20. a stereoscopic panoramic image creation method comprises:

Stereo-picture obtains step, is used for obtaining a plurality of stereo-pictures of being formed by the left image of taking by stereoscopic imaging apparatus and right image, and these stereo-pictures are the continuously shootings when shaking along constant direction of described stereoscopic imaging apparatus;

The stereoscopic panoramic image foundation step is used for by from a plurality of stereo-pictures that obtain described left image being synthesized together and described right image being synthesized together to create the stereoscopic panoramic image that is formed by left panoramic picture and right panoramic picture;

The corresponding points detecting step, for detection of a plurality of corresponding points that are used for parallax adjustment, described a plurality of corresponding points have the feature of mating between the left panoramic picture of the feature of mating between the left image of a plurality of stereo-pictures that obtain and the right image or the stereoscopic panoramic image that creating and right panoramic picture;

Image shift amount calculation procedure is used for calculating a plurality of image shift amounts that are used for the parallax of detected a plurality of corresponding points all is arranged on predetermined parallax amount; And

Recording step, be used for the stereoscopic panoramic image that creates is recorded in recording medium, and the positional information that is used for described a plurality of corresponding points of parallax adjustment on the described stereoscopic panoramic image is recorded in described recording medium as the supplementary of described stereoscopic panoramic image with a plurality of image shift amounts that calculate with being associated with each other.

21. stereoscopic panoramic image creation method according to claim 20, wherein

In described corresponding points detecting step, organize left image and right image detects one group of corresponding points for each of each stereo-picture in the stereo-picture that obtains, and

In described image shift amount calculation procedure, from the corresponding points that detect for each stereo-picture the described stereo-picture, specify one group of corresponding points, and calculate the described a plurality of image shift amounts that all are set to described predetermined parallax amount for the parallax between the described corresponding points.

22. stereoscopic panoramic image creation method according to claim 21, wherein

In described corresponding points detecting step, organizing one group of corresponding points of left image and right image near each that detects for each stereo-picture in the described stereo-picture in the part at described stereo-picture center.

23. stereoscopic panoramic image creation method according to claim 22, wherein

When in described corresponding points detecting step, in the close part at described stereo-picture center, not detecting required corresponding points, the image shift amount that sets in advance is set up as calculated value, perhaps calculates described image shift amount by carry out interpolation between the adjacent image side-play amount in described image shift amount calculation procedure.

24. each described stereoscopic panoramic image creation method in 23 according to claim 20, wherein

In described stereoscopic panoramic image foundation step, by a plurality of Slit Image amalgamations are created described stereoscopic panoramic image together, wherein each Slit Image all is bar shaped, and described a plurality of Slit Image are arranged in a plurality of stereo-pictures that obtain and lean on paracentral part.

25. stereoscopic panoramic image creation method according to claim 20 also comprises

The object detection step is for detection of the required object that is included in a plurality of stereo-pictures that obtain or the stereoscopic panoramic image that creates, wherein

In described corresponding points detecting step, detect the corresponding points for each object that is detected by described article detection device.

26. each described stereoscopic panoramic image creation method in 25 also comprises according to claim 20

The interpolation calculation procedure is used for based on the described a plurality of image shift amounts that calculate in described image shift amount calculation procedure, calculates continuous pixel-shift amount by interpolated pixel side-play amount between described corresponding points, wherein

In described recording step, a plurality of image shift amounts that calculate in described image shift amount calculation procedure and a plurality of image shift amounts that calculate in described interpolation calculation procedure are recorded in the described recording medium.

27. each described stereoscopic panoramic image creation method in 25 according to claim 20, wherein

Described predetermined parallax amount is zero.

28. a stereoscopic panoramic image reproducting method comprises:

Read step is used for from read according to claim 20 the supplementary of stereoscopic panoramic image and described stereoscopic panoramic image to 27 each described recording mediums;

Reproduce step, be used for amplifying the stereoscopic panoramic image that is read with predetermined multiplying power, and input reproduces or to reproduce the stereoscopic panoramic image that is amplified for the mode of playing frame by frame by each frame of cutting apart in a plurality of frames that described stereoscopic panoramic image obtains in the mode of rolling at three-dimensional display automatically or according to manual command; And

The parallax adjustment step, be used for selecting an image shift amount from a plurality of image shift amounts that record as the supplementary of described stereoscopic panoramic image, this image shift amount is corresponding to the stereo-picture in the screen of described three-dimensional display, and carries out the parallax adjustment of described stereo-picture when reproducing described stereoscopic panoramic image by the mode of rolling or play frame by frame in described reproduction step based on selected image shift amount.

29. a stereoscopic panoramic image reproducting method comprises:

Stereoscopic panoramic image obtains step, is used for the stereoscopic panoramic image that acquisition is formed by left panoramic picture and right panoramic picture;

The corresponding points detecting step is used for detecting a plurality of corresponding points that are used for parallax adjustment in the described stereoscopic panoramic image before reproducing the stereoscopic panoramic image that obtains, and described corresponding points have the feature of mating between described left panoramic picture and described right panoramic picture;

Image shift amount calculation procedure is used for calculating a plurality of image shift amounts that are used for the parallax of detected a plurality of corresponding points all is set to predetermined parallax amount;

Storing step: the positional information that is used for described a plurality of corresponding points of parallax adjustment on the described stereoscopic panoramic image is stored with a plurality of image shift amounts that calculate with being associated with each other;

Reproduce step, be used for amplifying the stereoscopic panoramic image that is obtained with predetermined multiplying power, and input reproduces or to reproduce the stereoscopic panoramic image that is amplified for the mode of playing frame by frame by each frame of cutting apart in a plurality of frames that described stereoscopic panoramic image obtains in the mode of rolling at three-dimensional display automatically or according to manual command; And

The parallax adjustment step, be used for from a plurality of image shift amounts that are stored in described storage device corresponding to described stereoscopic panoramic image, selecting an image shift amount, this image shift amount is corresponding to the stereo-picture in the screen of described three-dimensional display, and carries out the parallax adjustment of described stereo-picture when reproducing described stereoscopic panoramic image by the mode of rolling or play frame by frame in described reproduction step based on selected image shift amount.

30. stereoscopic panoramic image reproducting method according to claim 29, wherein

In described corresponding points detecting step, detect for by cutting apart one group of corresponding points of each Slit Image in a plurality of Slit Image that all are bar shaped that described panoramic picture obtains.

31. stereoscopic panoramic image reproducting method according to claim 30, wherein

32. stereoscopic panoramic image reproducting method according to claim 29 also comprises:

The object detection step is for detection of the required object that is included in the stereoscopic panoramic image that obtains, wherein

In described corresponding points detecting step, detect the corresponding points for detected each object in the described object detection step.

33. each described stereoscopic panoramic image reproducting method in 32 according to claim 29 also comprises:

In described storing step, be stored in a plurality of image shift amounts that calculate in the described image shift amount calculation procedure and a plurality of image shift amounts that in described interpolation calculation procedure, calculate.

34. each described stereoscopic panoramic image reproducting method in 33 according to claim 29, wherein

Described predetermined parallax amount is zero.

35. each described stereoscopic panoramic image reproducting method in 34 according to claim 28, wherein

In described parallax adjustment step, select to be in the screen center place of described three-dimensional display or be in image shift amount in the part of the most close described screen center, and carry out the parallax adjustment of described stereo-picture based on selected image shift amount.

36. each described stereoscopic panoramic image reproducting method in 35 according to claim 28, wherein

When in described reproduction step, reproducing described stereoscopic panoramic image according to manual command input by roll mode, before stopping to roll, select an image shift amount corresponding with the stereo-picture in the screen that is presented at described three-dimensional display according to manual command input when beginning to roll, and when stopping when rolling, select to be presented at when stopping to roll the corresponding image shift amount of stereo-picture in the described screen of described three-dimensional display, and in described parallax adjustment step, carry out the parallax adjustment of described stereo-picture based on selected image shift amount.

37. each described stereoscopic panoramic image reproducting method in 35 according to claim 28, wherein

Described reproduction step only makes an image in described left image and the described right image be presented on the described three-dimensional display during the rolling that input is reproduced with roll mode according to manual command, and when rolling described stereo-picture is presented on the described three-dimensional display, and

In described parallax adjustment step, when stopping to roll, select an image shift amount corresponding with the stereo-picture in the screen that when stopping to roll, is presented at described three-dimensional display, and carry out the parallax adjustment of described stereo-picture based on selected image shift amount.

38. each described stereoscopic panoramic image reproducting method in 37 according to claim 28, wherein

Described reproduction step is presented on the described three-dimensional display whole stereoscopic panoramic image, then amplifies described stereoscopic panoramic image and the described stereoscopic panoramic image of mode playback by rolling or playing frame by frame with predetermined multiplying power.

39. stereoscopic panoramic image creation procedure that makes the computer realization following functions:

Stereo-picture obtains function, is used for obtaining a plurality of stereo-pictures of being formed by the left image that utilizes stereoscopic imaging apparatus to take and right image, and these stereo-pictures are that described stereoscopic imaging apparatus is taken when shaking along constant direction continuously;

Stereoscopic panoramic image creates function, is used for by from the described a plurality of stereo-pictures that obtained gain-of-function by described stereo-picture described left image being synthesized together and described right image being synthesized together to create the stereoscopic panoramic image that is formed by left panoramic picture and right panoramic picture;

The corresponding points measuring ability, for detection of a plurality of corresponding points that are used for parallax adjustment, described corresponding points have the feature of mating between the left panoramic picture of the feature of mating between the left image of the described a plurality of stereo-pictures that obtained gain-of-function by described stereo-picture and the right image or the stereoscopic panoramic image that creating and right panoramic picture;

Image shift amount computing function is used for calculating a plurality of image shift amounts that are used for the parallax of detected a plurality of corresponding points all is set to predetermined parallax amount; And

Writing function, be used for recording the stereoscopic panoramic image that creates at recording medium, and the positional information that is used for described a plurality of corresponding points of parallax adjustment on the described stereoscopic panoramic image is recorded in described recording medium as the supplementary of described stereoscopic panoramic image with a plurality of image shift amounts that calculate with being associated with each other.

40. stereoscopic panoramic image playback program that makes the computer realization following functions:

Stereoscopic panoramic image obtains function, is used for the stereoscopic panoramic image that acquisition is formed by left panoramic picture and right panoramic picture;

The corresponding points measuring ability, be used for detecting a plurality of corresponding points that described stereoscopic panoramic image is used for parallax adjustment before reproducing the stereoscopic panoramic image that obtains, described a plurality of corresponding points have the feature of mating between described left panoramic picture and described right panoramic picture;

Image shift amount computing function is used for calculating a plurality of image shift amounts that are used for the parallax of detected a plurality of corresponding points all is set to predetermined parallax amount;

Memory function is used for the positional information that is used for described a plurality of corresponding points of parallax adjustment on the described stereoscopic panoramic image is stored with a plurality of image shift amounts that calculate with being associated with each other;

Representational role, be used for amplifying the stereoscopic panoramic image that is obtained with predetermined multiplying power, and input reproduces or to reproduce the stereoscopic panoramic image that is amplified for the mode of playing frame by frame by each frame of cutting apart in a plurality of frames that described stereoscopic panoramic image obtains in the mode of rolling at three-dimensional display automatically or according to manual command; And

The parallax adjustment function, be used for from a plurality of image shift amounts that described memory function is stored, selecting an image shift amount corresponding to described stereoscopic panoramic image, this image shift amount is corresponding to the stereo-picture in the screen of described three-dimensional display, and carries out the parallax adjustment of described stereo-picture when reproducing described stereoscopic panoramic image by described representational role in the mode of rolling or play frame by frame based on selected image shift amount.

41. a computer readable recording medium storing program for performing, when reading by processor and carrying out instruction, described computer readable recording medium storing program for performing is realized described processor:

Stereo-picture obtains step, is used for a plurality of stereo-pictures that acquisition is formed by the left image of taking by stereoscopic imaging apparatus and right image, and these stereo-pictures are that described stereoscopic imaging apparatus is taken when shaking along constant direction continuously;

The stereoscopic panoramic image foundation step is used for by from the described a plurality of stereo-pictures that obtain in described stereo-picture acquisition step described left image being synthesized together and described right image being synthesized together to create the stereoscopic panoramic image that is formed by left panoramic picture and right panoramic picture;

The corresponding points detecting step, for detection of a plurality of corresponding points that are used for parallax adjustment, described a plurality of corresponding points have at described stereo-picture and obtain the feature of mating between the left panoramic picture of the feature of mating between the left image of described a plurality of stereo-pictures of obtaining in the step and the right image or the stereoscopic panoramic image that is creating and the right panoramic picture;

Image shift amount calculation procedure is used for calculating a plurality of image shift amounts that are used for the parallax of detected a plurality of corresponding points all is set to predetermined parallax amount; And

Recording step, be used for recording the stereoscopic panoramic image that creates at recording medium, and the positional information that is used for described a plurality of corresponding points of parallax adjustment on the described stereoscopic panoramic image is recorded in described recording medium as the supplementary of described stereoscopic panoramic image with a plurality of image shift amounts that calculate with being associated with each other.

42. a computer readable recording medium storing program for performing, when being read by processor and carrying out instruction, described computer readable recording medium storing program for performing is realized described processor:

The corresponding points detecting step, be used for detecting a plurality of corresponding points that described stereoscopic panoramic image is used for parallax adjustment before reproducing the stereoscopic panoramic image that obtains, described a plurality of corresponding points have the feature of mating between described left panoramic picture and described right panoramic picture;

Storing step is used for the positional information that is used for described a plurality of corresponding points of parallax adjustment on the described stereoscopic panoramic image is stored with a plurality of image shift amounts that calculate with being associated with each other;

The parallax adjustment step, be used for from a plurality of image shift amounts that described storing step is stored, selecting an image shift amount corresponding to described stereoscopic panoramic image, this image shift amount is corresponding to the stereo-picture in the screen of described three-dimensional display, and carries out the parallax adjustment of described stereo-picture when reproducing described stereoscopic panoramic image by the mode of rolling or play frame by frame in described reproduction step based on selected image shift amount.