The application is the application for a patent for invention (applying date of Application No. 201210152747.X:On May 16th, 2012, hair
Bright title:Image panel synthesized display apparatus, image composition display method and photographic equipment) divisional application.
The content of the invention
The present invention be exactly in light of this situation and complete, and it is an object of the present invention to provide a kind of image panel synthesized display apparatus, image
Display methods and photographic equipment are synthesized, photographic equipment is being held, is moving while under the scene shot, do not record merely
The appearance of cameraman, additionally it is possible to easily show cameraman and be moved through the appearance come and proceed by shooting from separate position
Appearance.
In order to achieve the above object, the image panel synthesized display apparatus of the 1st aspect, which is characterized in that have:It can synthesize and sentence
Determine portion, can progress synthesize judgement, and can in it synthesize judgement, can judgement will repeatedly carry out the movement with cameraman successively
The 1st image down of the image of shooting as before in multiple images obtained from the photography of side in the opposite direction, to close
Into on the 2nd image as the image shot afterwards;And image combining unit, into being about to contract to the 1st image
Downscaled images obtained from small overlap onto in a part for the 2nd image to generate the generation of the composograph of composograph.
In order to achieve the above object, can the image panel synthesized display apparatus of the 2nd aspect be characterized in that, described to synthesize judgement
The composograph can be set to the 1st image, the figure that will be shot after the 2nd image by portion and described image combining unit
As being set to the 2nd image, generated to repeat judgement and the composograph of can synthesizing.
In order to achieve the above object, in the image panel synthesized display apparatus of the 3rd invention, which is characterized in that described to synthesize
Determination unit compares the peripheral portion of the downscaled images and the background portion in addition to the part of the 2nd image
Compared with, by judge the peripheral portions of the downscaled images and the 2nd image background portion whether with continuity come can judge
Synthesis.
In order to achieve the above object, the image panel synthesized display apparatus of the 4th aspect, which is characterized in that described image combining unit
Make at the boundary portion that the peripheral portion of the downscaled images synthesizes with the background portion of the 2nd image in image across the border
The boundary line of the shade in direction is continuously connected, to synthesize the downscaled images and the 2nd image.
In order to achieve the above object, the image panel synthesized display apparatus of the 5th aspect, which is characterized in that the institute of the 2nd image
It is to have beaten in the part of the face of cameraman to state a part.
In order to achieve the above object, the image panel synthesized display apparatus of the 6th aspect, which is characterized in that the institute of the 2nd image
State the central portion that a part is the 2nd image.
In order to achieve the above object, the image panel synthesized display apparatus of the 7th aspect, which is characterized in that image synthesis display
Device has the picture pick-up device for the photography for repeatedly carrying out the direction opposite with the moving direction of cameraman successively.
In order to achieve the above object, the image panel synthesized display apparatus of the 8th aspect, which is characterized in that described image synthesis is aobvious
Showing device has:Face detection portion is detected the facial positions in the photographic picture acquired by above-mentioned picture pick-up device;With
And warning portion, the testing result according to above-mentioned face detection portion are alerted, and above-mentioned photographic equipment is put suitable position
It puts.
In order to achieve the above object, the 9th aspect image panel synthesized display apparatus, which is characterized in that above-mentioned warning portion according to
The interval of the photography carried out when carrying out above-mentioned mobile determines the suitable position of above-mentioned photographic equipment.
In order to achieve the above object, the 10th aspect image panel synthesized display apparatus, which is characterized in that above-mentioned warning portion according to
Above-mentioned downscaled images determine the suitable position of above-mentioned photographic equipment.
In order to achieve the above object, the image panel synthesized display apparatus of the 11st aspect, which is characterized in that image synthesis display
Device has the acceleration transducer being detected to the vibration for being applied to the photographic equipment, and according to the acceleration sensing
The testing result of device determines the interval of the photography carried out when carrying out above-mentioned mobile.
In order to achieve the above object, the image panel synthesized display apparatus of the 12nd aspect, which is characterized in that using advance by photographing
The facial width of person, the distance obtained from the photographic equipment to the field angle of the distance of the face and the photographic equipment
Until image for synthesizing.
In order to achieve the above object, the image panel synthesized display apparatus of the 13rd aspect, which is characterized in that in the face for setting cameraman
Portion's width is Wf, from the photographic equipment to the distance of above-mentioned face be D1, the half angle of the field angle of the photographic equipment
For Θ when, using advance the D3 according to obtained from the D2 that is obtained in following formula when image for synthesizing,
(D3=D2-D1)
W1=2D1tan Θ (formula 1)
R=Wf/ (2D1tan Θ) (formula 2)
W1=2D2tan Θ (formula 3)
W1/W2=D1/D2 (formula 4).
In order to achieve the above object, the image composition display method of the 14th aspect, which is characterized in that can judge will successively
Being shot as before in multiple images obtained from repeatedly carrying out the photography in the direction opposite with the moving direction of cameraman
1st image down of image is synthesized on the 2nd image as the image shot afterwards, and the 1st image will be reduced
The downscaled images obtained afterwards overlap onto in a part for the 2nd image to generate composograph.
In order to achieve the above object, the photographic equipment of the 15th aspect, which is characterized in that have:Image pickup part, so as into
It is about to the downscaled images overlapping that the 1st photographs reduces to be synthesized in a part for the 2nd photographs to generate composite diagram
The mode of the composograph generation of picture, repeatedly carries out the photography in the direction opposite with the moving direction of cameraman successively;It can close
Can, into determination unit, can progress synthesize judgement, in it synthesize judgement, judge to carry out what above-mentioned multiple shooting obtained
In multiple images, above-mentioned 1st image as the image shot before is closed with above-mentioned 2nd image as the image shot afterwards
Into.
In order to achieve the above object, the photographic equipment of the 16th aspect, which is characterized in that can this synthesize judgement and be not limited to base
Judge in the synthesis of image, can also be judged according to the variation of photographs whether can also be moved according to cameraman
Predetermined amount is judged.
In order to achieve the above object, the multiple moving direction for carrying out cameraman of the 17th aspect and with the moving direction phase
The camera of the photography in anti-direction, which is characterized in that the camera has:Image pickup part carries out multiple institute successively
State photography;Face detection portion is detected the facial positions of the cameraman in the photographic picture acquired by the image pickup part;With
And warning portion, the testing result according to the face detection portion judge the back of the body whether in photographic picture with cameraman top
Scape, and alerted.
In order to achieve the above object, the multiple moving direction for carrying out cameraman of the 18th aspect and with the moving direction phase
The method for imaging of the photography in anti-direction, which is characterized in that the method for imaging includes:Multiple photography is carried out successively;To photography
The facial positions of cameraman in the photographic picture of acquirement are detected;And it is in photographic picture according to testing result judgement
The no background with cameraman top, and alerted.
In accordance with the invention it is possible to provide in a kind of overleaf photography to be easily moved through the sample come with alternatively performance
Image panel synthesized display apparatus, image composition display method and the camera of son etc..
Specific embodiment
Hereinafter, preferred embodiment is illustrated using the camera for applying the present invention according to attached drawing.The present invention's
Camera has the image pickup part that can shoot camera rear to obtain the image of cameraman, according to the operation of release button etc.
The image data for starting above-mentioned photography obtains, and by the image data blotter into recording medium.At the face of cameraman
In the central portion of the photographs of the blotter, can determine that could be synthesized with the background portion of front and rear image.It is above-mentioned
The synthesis of the background portion can be utilized to obtain by cameraman just like image as cameraman is mobile in background image.
Fig. 1 is the block diagram of the structure for the photographic equipment for showing the 1st embodiment of the present invention, and photographic equipment 10 is shooting quilt
It takes the photograph body and obtains the digital camera of image.Photographic equipment 10 also has in addition to front image pickup part 2 and carries out photographies on the back
Back side image pickup part 5, the record portion 4 of photographs and the display unit 8 that is shown to photographs etc..In addition, in order to being clapped
The condition when image data taken the photograph classifies or determines to photograph, possesses what the acceleration for being applied to camera was detected
Acceleration transducer, and possess clock 7 for date of acquisition, the information at moment.In addition, the image obtained by image pickup part 2,5
Signal can carry out image procossing by the signal processing part in the control unit 1 of execution processing sequence, and shown, recorded.Make
For the signal processing, there are face detection portion 1a, diminution portion 1c, blotter portion 1d, combining unit 1e, determination unit can be synthesized (close
Into determination unit) 1f etc..In addition, warning portion 1b is formed in control unit, carrying out warning in 8 grade of display unit as needed shows
Deng alerting cameraman.
It is assumed that image pickup part 2 and back side image pickup part 5 are made of phtographic lens and photographing element, shot object image is converted into telecommunications
Number, and handled by signal processing part and become image data.It is assumed that image pickup part 2 is configured before the main body of photographic equipment 10
Face configures back side image pickup part 5 at the opposite to that back side.Certainly, in order to which an image pickup part can selectively shoot front
Or rear, it is possible to have the mechanical structure in the horizontal direction or perpendicularly thereto rotated centered on axis etc., not to front,
The specific image pickup part allocation position such as back side is defined.That is, two image pickup parts can not also be prepared, and an image pickup part is set
Be set to can rotate so that image pickup part selectively towards photographic equipment 10 main body front or behind.At this point, in image pickup part
Towards during front mainly can shooting subject, towards the face that cameraman can be mainly shot during rear.In addition, the back side is taken the photograph
As the phtographic lens in portion 5 can only shoot the part of the personage in photography when field angle is relatively narrow, therefore in order to shoot
Background portion enter more image, preferably make for field angle it is wider.In addition it is also possible to utilize ultra-wide angle mirror as fish eye lens
Head, and it is applied to the camera that can shoot front and rear two side.At this point, if the image for only cutting out the direction of cameraman carries out profit
With can then obtain same effect.Deformation of the straight line of background etc. can be modified with image procossing.It if can be simultaneously
The front and rear structure of shooting, the then photography at some in front of progress, only utilizes picture using the image at rear etc. if necessary
Switching applies image and changes.At this point, as in the present invention, by such from coming at a distance using cameraman as needed
Performance, can further show changeful image.Especially, incited somebody to action using dynamic image presentation to apply the method for variation
Video carries out highly effective during works.
In addition, in having the camera there are two image pickup part, the present invention is not to utilize the camera for observing object side, and
It is using shooting the camera of cameraman side, but the camera observes the display one for being arranged at the back side due to cameraman on one side
While being shot, therefore two image pickup parts are distinguished.In addition, if the appearance that shooting cameraman holds with a hand, then should
Side is determined as cameraman side.Furthermore, it is possible to verify the face in picture center to judge cameraman side camera, shifting can also be detected
Acceleration when dynamic, cameraman side is determine whether according to the direction, can also be detected background variation and be determine whether cameraman
Side.I.e., it is also contemplated that less change in face-image, surrounding image (background image) continuously separate situation
Under, be determined as be cameraman side image using the present invention or cameraman side image pickup part method, no matter using which in these
A technology, the present invention are set up.
Control unit 1 with signal processing part carries out the whole control of photographic equipment 10 according to the program stored, and
By to Imagery Data Recording obtained from being handled from the picture signal that image pickup part 2,5 exports into the record portions such as storage card 4.
Face detection portion 1a inputs the photographs from image pickup part 2,5, judges to whether there is the face of personage in the photographs,
In the case of there are character face, the size of its position and face is detected.
Operation portion 6 is disposed on the operating members such as release button 6a on photographic equipment 10, zoom button.User can use
Cross key or touch panel etc. carry out various pattern settings.
As shown in Fig. 2 (a), release button 6a is configured at the body upper surface of photographic equipment 10, when operating release button
During 6a, photographic equipment 10 starts to photograph, and in the case of dynamic image or burst mode, when operating release button again, stops
Only photograph.
As shown in Fig. 2 (b), display unit 8 includes and is configured at the LCD monitor at the back side of photographic equipment 10 etc., organic EL etc.
Display device carries out the reproduction display of the image from image pickup part and the image being recorded in record portion 4 or showing for alert message
Show.
Image processing part 7 adjusts brightness, gray scale or color of picture signal obtained by image pickup part 2,5 etc., is compressed into appearance
Easily record, is processed into predetermined form and is recorded in record portion 4.
In this image procossing, also comprising Altered Graphs as size (size adjusting) processing, reduce processing exists
It is important in the present invention, therefore diminution portion 1c is especially described in figure here.
In addition, picture signal can before actually being recorded blotter in blotter portion 1d, in order to
It as multiple images and recorded, shown, image combining unit 1e and synthesis determination unit 1f also serve as a ring of signal processing, interior
It puts in the control unit 1 with signal processing part.
Face detection portion 1a is according to the characteristics of image obtained according to the face organ of personage, personage that detection image is included
Face-image, consider that the testing result etc. is synthesized and alerted.In addition, synthesis determination unit 1f is determining whether to be smoothed out
Also according to being alerted in the case of synthesis.
The composograph generated by the image combining unit 7 is shown on display unit 8, but is reading simultaneously profit from record portion 4
In the case of being shown with the image after shooting carrying out synthesis, invention of the present invention as display device can be also utilized.
Then, the action in present embodiment is illustrated, but uses Fig. 3 first to the feature as the present invention
Method when shooting back side composograph illustrates.When using the photographic equipment 10, photographic equipment is put as shown in Figure 3
10, while cameraman confirms photography situation with the display unit at the camera back side, 11 one side walking of cameraman is while clapped
When taking the photograph, cameraman can in front of shooting it can be seen that subject while, also record the face and background of itself.
When so periodically shooting or being shot with dynamic image, the obtained figure of fore direction photographing of positive the ministry of photography 2
As changing with movement, but cameraman 1 and the position relationship of photographic equipment 10 are determined by the state for putting camera, thus
The image obtained by back side image pickup part 5 does not change substantially.
That is, if photographic equipment as shown in Figure 3, is kept in cameraman while when walking periodically carries out taking the photograph for the back side
Shadow then obtains the image shown in Fig. 4 (a) to (e).Since the position put and the distance of face will not vary widely, because
The image of this cameraman is by with roughly the same size shooting, and in contrast, background is then become in a manner of gradually past towards the rear
Change.
By as shown in Figure 5 synthesizing this image, the image of cameraman can be become such as to take the photograph than actual
The image of the such performance of shadow image farther place shooting.That is, image, the i.e. back of the body of Fig. 5 (a) shot before the image of Fig. 5 (b)
Scape part is as shown in the figure, be a part for the image of (b), therefore determine minification so as in the comparable portion of the image of Fig. 5 (b)
Divide the image of embedded Fig. 5 (a), be embedded in after the image down by Fig. 5 (a), so as to the table as shown in Fig. 5 (c)
It is now an image non-jointed with background.The personage portion of the image with its above image portion (with reference to Fig. 5 (d)) despite
Cameraman itself shooting image, but it seem that just like be from away from cameraman position the image remotely shot that
Sample.This is equal with the such performance of personage from the position for the photography for carrying out Fig. 5 (b) position of the shooting in Fig. 5 (a).
In order to carry out this synthesis, the preferably image of Fig. 5 (a) becomes covering the head in the personage portion of the image of Fig. 5 (b)
The image in portion.If not in this way, if the combining units of head from the image of Fig. 5 (c) of Fig. 5 (b) images exceed and become unnatural.
Therefore, in the present invention, in order to prevent this synthesis when it is unnatural, to the interval photography of the image of (a) He (b)
Suitable control is carried out.
As a result, by the way that with this complex functionality, which can not only be to forward image application variation, Er Qieneng
Enough images to rear apply variation to carry out image reproducing, therefore for example after dynamic image photography, before can suitably switching
Image afterwards can allow appreciator to appreciate with not irksome image appearance.It can be with personage moves closer in landscape side
Formula is reproduced with lantern slide or dynamic image.It can apply variation to image by using this form of expression and come pleasant
It is appreciated.
For example, after the image of Fig. 5 (d) is shown, when showing the image of Fig. 5 (a), cameraman can be carried out from a distance
Close to such performance that comes.That is, as long as stop reducing the synthesis of the image after synthesizing.
Herein, two have only been synthesized, but if by the image down of (d), has been synthesized in Fig. 4 (c), then can have been taken the photograph
Shadow person is in the such performance in farther place.If these synthesis are overlapped, stop successively since the image utmostly reduced
It is synthesized, then cameraman is constantly close.Also, dynamic image can be carried out if more meticulously the synthesis is carried out certainly
Performance.
It is unnatural when then, in order to handle synthesis display, in photography considerable aspect being answered to illustrate.
Fig. 6 is the position relationship for the face 11 for showing as photographic equipment 10 viewed from above and cameraman.It can be seen that
Such as the half angle of the field angle of photographic equipment 10 is Θ, it is facial when the distance of photographic equipment 10 to face 11 is D1
In the case that width is Wf, the width W1 of picture is showed as formula 1, thus face wherein shared ratio R as formula 2
Performance.
W1=2D1tan Θ (formula 1)
R=Wf/ (2D1tan Θ) (formula 2)
For example, Θ is 45 °, when D1 as the width of 45cm, face is 15cm the position of the hand when setting from putting equipment,
The result of formula 2 is 1/6.But, it is however generally that, the longitudinal direction of picture is shorter than transverse direction shown herein, the longitudinal direction height of opposite faces
It is longer than width, therefore face is accounted for longitudinal nearly 1/3 in picture.Therefore, in the case of this condition, Fig. 5 (a) is preferably used
1/3 or so of Fig. 5 (b) is synthesized.
It is however important that this condition also according to the focal length of phtographic lens of half angle Θ etc. for determining field angle and
Variation.That is, in the case where focal length is shorter, which becomes larger, and thus face proportion R becomes smaller, therefore the part of background increases,
So as to easily be attached the synthesis for connecting background as shown in Figure 5.
In addition, as previously mentioned, the field angle of the photographic equipment 10 half angle in the case of Θ, present dynasty Fig. 7's
During the direction movement of arrow 12, then when most starting to be photographed at the P1 of position, if it is considered that the scope of 21 plane, then W1
It is taken, this is represented with foregoing formula 1.
When camera advance D3 comes the position of P2, if field angle is identical, on the scope of shooting, according to flat
The distance D2 in face 21, shoots by the scope of the W2 shown in formula 3.W1 is included in W2, and according to formula 1, formula 2, ratio W1/W2 is such as
Shown in formula 4.
W2=2D2tan Θ (formula 3)
W1/W2=D1/D2 (formula 4)
That is, in the case of the condition as illustrated by Fig. 6, D1/D2 is preferably 1/3, is set as described above in D1
For 45cm when, D2 be 45cm × 3=135cm.
Therefore, if shot away from more than D2, when Fig. 5 (a) being overlapped onto Fig. 5 (b) being synthesized, minification
It is excessive, so as to which the face of Fig. 5 (b) cannot be covered.As a result, it is necessary to pay attention to position and the size of face in the synthesis of this image.
When setting D2 as 135cm, 2 steps of adult's stride are equivalent to, therefore can also be according to the defeated of acceleration transducer 3
Go out, the vibration for being applied to camera is detected as pedometer, try to shoot once such timing progress continuous shooting with every 2 step.
Certainly, if Θ is larger, according to formula 2, face ratio shared in picture becomes smaller, thus can also with thicker timing into
Row continuous shooting.For example, when focal length is half, field angle is double, R 1/6, the W1/W2 of formula 4 is that 1/6, D2 is 45cm × 6=
270cm。
Such as in the case where the system of the field angle of image pickup part at the back side can be changed, such switching can be carried out,
As invention also comprising this switching, but simplified herein, using Θ as 45 ° of situation continued explanation.
The photographic equipment of image synthesis processing as the photographies on the back portion for using as described above is carried out Fig. 5
The flow performed when overleaf photographing is illustrated as Fig. 8.Herein, especially " back side synthesis will be referred to as with the photography of this synthesis
Photography " illustrates.In fact, being also carried out at the same time positive photography, sometime taken the photograph in reproduction display using positive
Shadow result, sometime in reproduction display using the photography at the back side as a result, enrich the variation of image, but carry out herein
Simplify, be narrowed to using the photography in photographies on the back portion to illustrate.User as carrying out Fig. 3 when photographing, using taking the photograph
Shadow equipment pattern setting, select " back side process cinematography pattern " and using discharge SW (6a of Fig. 2) by inferior beginning
Shooting operation.The such synthesis of Fig. 5 (c) is carried out using multiple back side images, therefore in order to manage the plurality of image, S101's
Variable N is initialized (0) in step.In shooting operation terminating by inferior end due to release SW (6a of Fig. 2)
When, S102 is branched off into Y and enters S109, but first, as the explanation in photography, carried out as the S103 that S102 is branched off into N.
In S103, the subroutine for the back side synthesis candidate image generation that will be explained below is performed.Herein, it is continuous to obtain
Image, the synthesis determination unit of the 1f of Fig. 1 judge image (the synthesis candidate's figure for being suitable for synthesis display in acquired image
Picture), and as in Im blotters to blotter portion (1d of Fig. 1).
Due to individually not knowing that the synthesis candidate image at the thus obtained back side is appropriate for synthesize, first
Determine whether to obtain as basic initial one in S104.It, cannot be into if initial one cannot be obtained
The comparison of row and next image, therefore N is branched off into, wait to stay in that candidate image is obtained in S103.
After initial candidate image is obtained, S104 is branched off into Y, is receipts by the image down of Fig. 5 (a) in S105
The dotted line part (the diminution portion 1c for utilizing Fig. 1) of Fig. 5 (b) is held back, and compared with the background portion of next image.Herein, it is false
If reduced scale is set to 1/3.
The ratio is using the conditional decision that illustrates in the S114 of Fig. 9, determined by field angle, in continuous shooting by connecing under
Carry out the operational capability for the image or camera to be shot and the balance of power consumption etc. determines.It is frequently obtaining image or is frequently carrying out
During synthesis, waste and unreasonable is generated in recording capacity and power consumption, therefore is here depicted as being carried out with less photography as far as possible
Connected example.If using the numerical value illustrated in fig. 6 and 7, the image for being reduced into 1/3 is overlapped to generate composograph
It is reasonably to design.This is designed as 2 steps of every advance and shoots the step of one, but if can further realize the processing of high speed
Circuit and energy-saving design can also then increase synthesis number.If increasing shooting number and increasing synthesis number, can approach
The such performance of dynamic image.In the case where field angle is wide, it can carry out reducing the synthesis of shooting number.
As Fig. 5 (b), by before image down as a result, comparison according to the image on the crown of cameraman
Degree or edge whether unanimously come determine whether by by face cover to next image face part in the form of according to will
The mode that background is connected is synthesized (using determination unit 1f is synthesized).Herein, in order to simply illustrate only the corner of ceiling
Line and window portion profile, but actually on ceiling or wall there are decorative pattern, shade, plate (wooden partition) seam
Or the picture pattern of dirt etc., these similitude and continuity etc. can be utilized.
Specifically, for the such synthesis of facial parts that the picture become with Fig. 4 (a) covers Fig. 4 (b), process decision chart 4
(b) the face in image, judge the image in addition to face face top, left and right portion background portion pattern,
Reduce Fig. 4 (a) image, the pattern of the peripheral portion to ensure the diminution picture it is successional in the form of, according to cover Fig. 4 (b)
Face mode synthesized.
In the case of method for imaging as Fig. 3, face is substantially certain with the distance of camera, so if field angle
Do not change, then what kind of position that facial size is occupied in picture is fixed, so if the size of face is, for example, picture
1/3, the 1/3 of upper-lower height of left and right width in face, then be set to background (root by the left side 1/3, the right 1/3, top 1/3 of picture
Other values are can be changed to according to field angle), the downscaled images of synthesis with the part are connected naturally and are coincide." nature " assumes that
Substantially ensure straight-line pattern linearity or shade boundary line is continuous and the state that is not connected with having weak point.
The synthesis determination unit is the function that the program of control unit 1 performs, but can also be designed using hardware.Using face as
Benchmark usually has taken a part for ceiling or landscape on the top (on the crown) of face, therefore is holding camera substantially
When being moved along its optical axis direction, background parts variation.Camera coverage is as shown in Figure 7 compared with its change in location and shifting
It moves and changes, therefore the synthesis of multiple images can be carried out using processing such as diminutions.But face part or face
There are body, these parts for lower section to change, therefore when reducing, understands to carry out well from Fig. 5 (c) continuous
Synthesis.Thus with the present invention the considerations of in the case of method synthesis multiple images, for the lower part of face, with shooting before
Image the such synthesis of the image that shoots afterwards of downscaled images covering it is difficult and effectively cannot flexibly use, therefore face
Image is preferably tried one's best downwards from center.But when in very lower section, lack chin etc. and become unnatural, therefore with face
Portion continues to explain premised on being generally in mid-face.
Therefore, in S105, to the background (or periphery) of the image of the part of no personage part (herein on picture
Half part) it is compared, judge whether the part is consistent in S106.Specifically, by picture face left and right and on
Side is partly set to background, and the peripheral portion for judging to synthesize the situation of walking (personage forward) downscaled images used and shot is (outer
Side) whether can conjointly be synthesized naturally with the inside of the background image portion." nature " refers to assume following state:Substantially
Ensure the side across the border of the boundary portion of linearity or the image synthesis of background or the straight-line pattern in the subject of periphery
To shade boundary line it is continuous and be not connected with there is no weak point.It synthesizes determination unit (1f of Fig. 1) and carries out this judgement.Consistent
In the case of, using these images compared in S105 as can be used as synthesis image, and it is incremented by variable N
(S107), candidate image Im is set to record image Im (N).
The synthesis determination unit 1f of Fig. 1 repeats this spectral discrimination, by by the peripheral portion of downscaled images and following
To the background portion of image be compared, judgement has obtained moving while image that is shooting and being synthesized, directly
Terminate (S102 → Y) to shooting operation.
That is, it is a feature of the present invention that in the photographic equipment for repeatedly carrying out the photography of opposite direction of moving direction, the back of the body
Can face image pickup part be repeatedly photographed successively, and carry out judging the image down shot before is synthesized to what is shot afterwards
Judgement can be synthesized in image.
Certainly, by the downscaled images compared with the predetermined portions of next image, and determine whether what can be synthesized
Method is in addition to photographic equipment, such as can also be applied to display device.Herein, the background portion to picture and downscaled images
Continuity (synthesis determination unit 1f according to distribution of the direction at edge, contrast changing unit and color etc. image seam
Whether place is carried out continuously judgement) it compares, but in hand-held photography, cameraman not necessarily advances and will photograph straight
Machine puts same position, therefore the image section being compared in S105 need not be strictly at center, and can be upper
20% or so of lower left and right deviation picture.Certainly, if field angle becomes wide, the surplus of the value becomes larger.
In S109, the image of blotter is transferred to record portion 4 and carries out offical record.At this point, in order to manage each image
Context, the date also shot with each image associated record, moment and indicate whether correctly to put and move photograph
Acceleration information of camera etc. (S110).
For example, if acceleration transducer is three axis, if the upper and lower of camera is correctly put, acceleration of gravity is only
Related to the vertical direction, in the case of walking, acceleration is periodically related etc. to optical axis direction and changes, therefore energy
Enough photographies that back side synthesis is carried out according to this information, and record the image for whether being suitable for synthesis.It is of course also possible to
Each image corresponding record variable N.Multiple images can be correctly synthesized using this information, and people is changed with the such synthesis of Fig. 5
The distance perspective of object.
In addition, image as Fig. 5 (d) is further reduced and is synthesized in next image.That is, if by figure small N
As reducing and being synthesized on the big images of N, then despite hand-held photography, can also obtain as shooting cameraman from distant place
Image, the distance can be changed according to synthesis number.
Then, the subroutine of the S103 of Fig. 8 is illustrated using the flow chart of Fig. 9.
Whether this is as previously mentioned, be to be adapted for use as closing with the result that back side image pickup part 5 repeats to shoot for one side judgement
Into image, while carrying out candidate image to image and carrying out the program of blotter.
In S111, start sequence photography, in S112, judge whether be not present in the image obtained in S111 by face
Portion's organ and the peculiar shade generated, to carry out face detection.
At picture center or picture lower part not facial positions, as illustrating as before in the S105 of Fig. 8, no
The image using overlapping that can carry out the feature as the present invention well synthesizes, therefore sentencing for the purport is carried out in S113
It is fixed.It is important that clearly have taken the background on cameraman top.When condition is not satisfied, control unit 1 determines the situation, and
Via warning portion 1b, using showing that image or sound are alerted (S121).Specifically, can show " please be well placed photograph
Machine is so that the face of cameraman is in picture center " as word or obtained image is shown together with frame, indicate
Face is made to enter in frame.
As a result, when face is in picture center, in order to ensure in the space of the top of cameraman intake background, judgement face
Portion's size whether be picture longitudinal size less than 1/3 (S114).
Certainly, which can be adjusted according to the length of the hand of cameraman and facial size etc..Also, in continuous shooting
When be instantly available the image next shot in the case of, can also increase face size.Why in this way, be because by it
Preceding image down and the part for overlapping onto the face in the picture, therefore what smaller image was synthesized is being changed to background
In the case of easily background is connected.But when fairly frequently obtaining image or being synthesized, on recording capacity and power consumption
Waste and unreasonable is generated, therefore is here depicted as carrying out connected example with less photography as far as possible.If using in Fig. 6,7
The numerical value of middle explanation can then shoot the step of one with 2 steps of often advancing and reasonably photograph and synthesize.Certainly, if energy
Enough process circuits and energy-saving design for further realizing high speed, then can also increase synthesis number.
If increasing shooting number and increasing synthesis number, the performance close to as dynamic image.
Furthermore it is possible to field angle according to back side image pickup part etc. changes.The shooting model of background when field angle is wider
It is wide to enclose change, therefore synthesis number can be further reduced.It is at this point, close to show personage with magic lantern sheet form.
As a result, when condition is not satisfied, control unit 1 determines the situation, and is utilized via warning portion 1b and show image
Or sound is alerted (S122).Specifically, can show " please be well placed camera so that the face size of cameraman is fitted
When " as word or obtained image shown together with the frame of 1/3 size of picture, and indicate to make facial entrance
In frame.
Even if in the case where providing these warnings and being also unsatisfactory for such as 1 minute conditions above, synthesize and judge in S123
Portion 1f determines the situation, and being branched off into S124 makes warning portion 1b provide the warning that can not be synthesized.
The image for the condition for meeting S113, S114 is set to candidate image as a result, but according to whether is initial figure
As to carry out branch to S115, classification during blotter is carried out.In addition initial image is handled as benchmark, therefore to it,
Im (0) is set in S117.In addition, carrying out choice selection in the flow of Fig. 8, selected image is only recorded in S109,
Therefore blotter is Im in S116.
In S118, as previously mentioned, being also written with photography time information, the posture for representing camera and direct of travel etc.
Acceleration information etc..If the image with this information, then the photography of this multiple images, PC can also be carried out with camera
Or the display devices such as TV are according to multiple images obtained from being sent from camera, the image as being illustrated in Figure 5
Processing, and variation is applied to display.Certainly, the display unit of camera can also carry out this synthesis display when the image is reproduced.
That is, the display device of PC, TV or mobile phone etc. including the display unit comprising camera can also utilize movement
The photographs in multiple timed shooting of the opposite direction in direction carries out the judgement of the feature as the present invention, that is, judges energy
The no image down that will be shot before, and be synthesized on the image shot afterwards.It can utilize this that can synthesize judgement, determine energy
It is no that variation is applied to simple sequence photography image to reproduce.
Illustrate the example of this display control with the flow chart of Figure 10.
It is the step of selection will carry out the image of reproduction display in S131.The step can be selected from thumbnail image manually
Specific image is selected, it can also be subsidiary to select when being reproduced to other images (such as the image shot by positive image pickup part 2)
Select corresponding back side image.
It can be according to additional auxiliary information (moment, acceleration information and the change in the S110 of Fig. 8 for being attached to each image
Amount N etc.) judge what is judged in S132 and S133, before closely image, afterwards with the presence or absence of image and whether it is shifting
Dynamic photography.
In the case of there are this image, in S134 by previous image it is (corresponding with (a) of Fig. 4, Fig. 5) reduce,
And by the pattern overlapping of its upper part peripheral portion to the latter image (corresponding with (b) of Fig. 4, Fig. 5) and consistent degree is adjusted, if
Continuously, then can be synthesized in the state of overlapping.Thus, it is possible to obtain the image of Fig. 5 (c).Wherein, if deleted
Inconsistent part below picture, then image as can obtaining Fig. 5 (d), despite hand-held photography, can also obtain such as from
The image of such performance is shot at a distance.If stopping the synthesis, can obtain moving closer to such consecutive image.
As previously mentioned, herein, drawdown ratio official holiday is set to 1/3 by the diminution of S134 surely.
The ratio is the conditional decision by illustrating in the S114 of Fig. 9, by field angle, in continuous shooting by next to clap
The balance of the operational capability and power consumption of the image taken the photograph or the camera etc. determines.It is frequently obtaining image or is frequently being synthesized
When, waste and unreasonable is generated in recording capacity and power consumption, therefore is here depicted as with less photography being connected as far as possible
Example.If using the numerical value illustrated in fig. 6 and 7, it is to close that the image for being reduced into 1/3, which is overlapped to generate composograph,
The design of reason.This is designed as 2 steps of every advance and shoots the step of one, but if can further realize the process circuit of high speed
And energy-saving design, then it can also increase synthesis number.If increasing shooting number and increasing synthesis number, dynamic can be approached
The such performance of image.In the case where field angle is wide, it can carry out reducing the synthesis of shooting number.
In addition, in the present embodiment, fore direction photographing portion 2 and rear the ministry of photography 5 are integrally provided to photographic equipment 10, but
This is not limited to, camera of 2 tools there are one the ministry of photography can also be prepared, makes 2 camera cooperations.At this point, it is configured to
The ministry of photography of 1st camera is used as fore direction photographing portion 2, the ministry of photography of the 2nd camera is used as rear the ministry of photography 5, a photograph
The control unit (control unit 1) of camera controls the ministry of photography of another camera.Control communication at this time can be wired
Can also be wireless.
The composograph of feature as the present invention can substantially utilize downscaled images and synthesize the downscaled images
The partly overlapping image of the two images of synthesis candidate image simultaneously is connected to obtain.As for the portion of the overlapping of the image
Point, judge the part that a part for the two images can conformably be overlapped with the similarity of image, and it is high using consistent degree
Part is connected.Alternatively, obtain continuous composograph using the part of overlapping as seam is pasted.
Even if in addition, at this point, also exist not exclusively be continuously connected, if the image that can be appreciated then can also feelings
Condition.Especially in the case where being showed with dynamic image, picture is switched fast, therefore will not notice that seam sometimes.Sometimes
Brightness and color change due to variation of light exposure etc., but in such a case, it is possible to correction of color and brightness judge
Consistent degree, if binaryzation and consistent degree are carried out to pattern for more than predetermined grade, can also be judged as it is unanimous on the whole or
It is judged as that composite result is generally continuous.
As the method for finding and synthesizing seam, can reduce to carry out the image for reducing synthesis successively, at it every time
During diminution, the synthesis candidate portion that judges picture end with synthesize candidate image a part (part as with it is upper in picture
State the peripheral portion of downscaled images shape is consistent or the part of corresponding shape) consistent degree, obtaining consistent degree highest
Downscaled images when synthesized.Also, even if not reduced successively, can also be changed according to the timeliness of image with user's
The minification of the process decision charts picture such as speed judges the peripheral portion of synthesis downscaled images and the picture background portion of synthesis candidate image
The consistent degree part high with continuation degree when synthesizing simultaneously is synthesized.The shade and color of continuation degree linearity, picture entirety
Naturality and flatness of tune etc. are judged.
Sequence photography interval it is shorter and can be used in synthesis picture number it is more in the case of, can reduce scheme
As peripheral portion carry out filling the peripheral portion of synthesis candidate image successively and such synthesize.At this point, even if one is not judged strictly
Cause degree etc., can also with certain ratio by image down be synthesis use, with the end of the picture connect without diminution
The form for synthesizing the end of candidate image is synthesized.
In addition, in embodiment, the face of people is shown in picture center, but it is displayed as moved in center
Can be the vehicles of the face of pet, the vehicles or model if the object of movement, can be any object
Shell etc..
In addition, the personage of the image shot by back side image pickup part is shown as " cameraman ", but for example can also be used to
Loaded onto on the handle of the bicycle of child the camera and to cyclery into appearance carry out synthesizing such purposes.This
When, cameraman is the parent of child, and child is subject, but for the purpose of simplifying the description, the people that will also be shot by back side image pickup part
Object shows as cameraman.
As described above, according to the embodiment of the present invention, according to image data, judge with camera positions
The mobile and variation of background image that changes, and according to the judgement, it is changed the image procossing of the size of consecutive image.Cause
This, can obtain the effect as shooting cameraman from distant place or can stop the synthesis of the composograph successively, easily
Ground performance is moved through the appearance come.For example, can also according to the position relationships of itself and the scenic spots and historical sites, movement appearance etc. come table
Emotion durings scenic spots and historical sites in existing maiden visit somewhere etc. etc..
In addition, in the embodiments of the present invention, the example that reproduction is photographed and appreciated with photographic equipment 10 is shown
Son, but it is without being limited thereto, on reproduction, additionally it is possible to be appreciated with personal computer or TV etc..With personal computer or
In the case that TV etc. is appreciated, as long as the image data for the dynamic image that storage is shot by photographic equipment 10 is appreciated i.e.
It can.
In addition, in the embodiments of the present invention, photographic equipment 10 is shot and is reproduced with continuous shooting, but certainly
It can be applied in dynamic image photography each as video camera, make it have the reproduction display work(as dynamic image
Energy.
The present invention can behave as following photographic equipments.
Also, in the embodiments of the present invention, as the equipment for photography, said using digital camera
It is bright, but as camera, can be digital single-lens reflex camera and Portable digital camera or video camera, film are taken the photograph
The camera of dynamic image as shadow machine, and it is of course possible to being to be built in mobile phone, portable information terminal PDA
(Personal Digital Assistants:Personal digital assistant) etc. in camera.
The present invention is not defined to the respective embodiments described above directly, can be in the range of its purport is not departed from implementation phase
Structural element is deformed and is embodied.Furthermore it is possible to pass through the suitable of multiple structural elements disclosed in the respective embodiments described above
When combination forms various inventions.For example, several structural elements in the entire infrastructure element shown in embodiment can be deleted.And
And can appropriately combined different embodiments structural element.