The application is the application for a patent for invention of original bill Application No. No.200910161468.8(The applying date:2009 07 month
31 days, denomination of invention:Image-reproducing means and imaging reconstruction method)Divisional application.
Specific embodiment
Below, explanation uses the preferred implementation of the photographing unit applying the present invention with reference to the accompanying drawings.The 1st of the present invention is real
The photographing unit 10 applying mode is digital camera, shooting still image in the recording medium recording image data.And, reproduce
When, the part that can extract brightness flop in still image, as candidate portion, is generated luminous point centered on this candidate portion and amplifies
Image, is synthesized with captured original still image, and the composite diagram of reproduction display movement in the way of luminous point flowing
Picture.Thus, get used to conventional photo photography camera user can with all the time using simple operationss carry out
Shoot, and, can obtain being also suitable for the image in the content being connected when being appreciated with external equipments such as television sets.
Before the structure of the photographing unit 10 of explanation present embodiment, it is mounted with the figure of the present invention using Fig. 2 and Fig. 3 explanation
Consideration method as the image reproducing in the photographing unit 10 of transcriber.
In the photographic attachment such as nearest digital camera, can show in the built-in liquid crystal of photographing unit or organic EL etc.
Simply show before photography on the exterior display device such as portion or the television set via output section connection and personal computer and take the photograph
The image of movie queen.
And, it is also possible to simply carry out dynamic image photography etc. in the photographic attachment such as nearest digital camera.But
It is that common people are difficult to shoot the works of the degree that other people can be allowed to watch according to the mode of dynamic image.On the other hand, static
Image has the effect of the moment works making shooting, so, complete the labor it is not necessary to outside shooting in the moment shooting
Dynamic.
But, as shown in figure 3, in the case of using reproduction display images such as big frame TV machines, completely not any
The image of change is dull and makes one tired, it is preferred, therefore, that image has some changes.For example, the presence shown in Fig. 2 is huge
In the case of landscape of grandness of big luminance difference etc., can attempt changing glittering of the sunlight shining on cloud 30, make
Luminous component passes through in time and moves.That is, when so that spot portion 32a, 32b glittered, 32c are mobile along the edge 31 of cloud 30
Mode when carrying out reproduction display, can ferment the atmosphere of grand landscape.Angle due to the motion of cloud and the sun etc. is constantly
Quarter is engraved in change, so, even if repeated multiple times add suddenly in the change lighting in a flash, also not particularly unnatural sense.
In the present embodiment, according to Fig. 4(a)Shown still image, the brightness flop of edge 31 grade of detection cloud 30
Brightness flop portion, luminous point processing and amplifying is carried out to the candidate portion selected from this brightness flop portion, according to Fig. 2(a)→(b)→
(c)Order so that luminous point is flashed successively, thus, reproduce the glittering in the image of movement of light.
So although being still image and the image not having especially big change, but, it is continuously displayed at television set 20 etc.
Picture on when(With reference to Fig. 3), synthesizing display makes the brightness around the candidate portion in brightness flop portion brighten(Luminous point), and this light
The image of point movement, thereby, it is possible to directly be mirrored the reproduction of landscape outside window.
According to this consideration method, in the image-reproducing means of present embodiment, quiet for complete in the photography moment
State image, as shown in Fig. 2 factitious mode will not be carried out image and synthesize and show with the change of optical scintillation.Alternatively, it is also possible to
With photography simultaneously, advance with the sound such as collection line record chirping of birds, repeatedly reproduce in reproduction display.
Then, the structure of the above-mentioned photographing unit being capable of reproduction display image is described.Fig. 1 is the photograph illustrating the 1st embodiment
The block diagram of the electrical structure of camera 10.Photographing unit 10 has:Control unit 1, photography portion 2, flash lamp 2a, record portion 3, compression preserve
Portion 3b, candidate extraction portion 4, mobile control division 5a, peripheral light amount increase portion 5b, collection line 6, synthesis control unit 7, output section 8, liquid
Brilliant display part 8a and operating portion 9.
Control unit 1 is by CPU(Central Processing Unit)Deng constituting, it is connected with each portion of this photographing unit 10, root
Carry out overall control according to program.Photography portion 2 comprises to obtain the optical system of shot object image for making subject be imaged, to subject
As carrying out the imaging apparatuss of opto-electronic conversion, to image processing part that the picture signal exporting from imaging apparatuss is processed etc., and
Output image data.In addition, this photography portion 2 can export still image, dynamic image(Also comprise continuous shooting)View data.
Collection line 6 is passed through mike etc. and is converted sound into the signal of telecommunication, and exports acoustical signal.Record portion 3 is according to being derived from
The control signal of control unit 1, records the view data of the still image exporting from photography portion 2, dynamic image.And, with image
The record of data together, also carries out the record of the voice data from collection line 6 output.And, remembered according to control signal output
The view data of record and voice data.
Candidate extraction portion 4, is extracted by right with high light imparting from record in the view data of the still image record portion 3
Than degree part as candidate portion.In the present embodiment, there is striking contrast degree, light with dazzling the eyes for direct sunlight etc.
The landscape of part give the glittering of light, thus, reproduce the image after change additional to still image.For this landscape figure
Picture, candidate extraction portion 4 selects the part of the change with light.
For example in the example in figure 2, candidate extraction portion 4 extracts candidate portion from the edge 31 of cloud 30.That is, the edge of cloud 30
31 is the line segment at the edge along cloud, and the part in this edge 31 of candidate extraction portion 4 extraction is as candidate portion.In addition, image
Be not limited to landscape image or the character image being shined upon, should in the case of, candidate extraction portion 4 is extracted and is shone
Cheek part, as described later, can reproduce sparkling scene.
Peripheral light amount increase portion 5b is improved the image of the surrounding brightness in candidate portion being extracted by candidate extraction portion 4
Reason.That is, peripheral light amount increase portion 5b generates the surrounding in candidate portion and glitters and become suddenly bright image as synthesis image.Make
Become bright composograph for unexpected, showed by the area of expansion luminous component and glitter.With regard to this area expansion, Neng Goujin
It is about to candidate portion to expand for circle or expand for the various area expansion such as star-like, cross.And, peripheral light amount increase portion 5b exists
Suddenly, after being become bright image procossing, it is again restored to original light quantity.
Mobile control division 5a makes to have carried out the synthesis image warp in time after light quantity increases by peripheral light amount increase portion 5b
Cross and move.That is, as Fig. 2(a)→(b)→(c)Shown, mobile control division 5a make to carry out light quantity increase partly move so that
Seem just like flared section 32a, 32b, 32c are mobile the same.
Synthesis control unit 7 is directed to original still image in record portion 3 for the record, is increased by peripheral light amount increase portion 5b
Big peripheral light amount, by mobile control division 5a, by original still image and process in time, the synthesis of movement is carried out with image
Synthesis, generates Fig. 2(a)~(c)Shown image.That is, by peripheral light amount increase portion 5b and mobile control division 5a, sequentially generate
Light quantity increase portion is passed through and the synthesis image of movement in time, so, multiple conjunctions that these are sequentially generated by synthesis control unit 7
One-tenth is synthesized with original still image with image.
Compression storage unit 3b is compressed preserving to by the view data that record portion 3 records, and, in synthesis control unit
In 7, the view data of synthesis is compressed, and is saved.
Output section 8 records in record portion 3 to the output of the exterior display devices such as television set or to liquid crystal display part 8a output
Still image, dynamic image.And, the image of synthesis also exports exterior display device or liquid crystal in synthesis control unit 7
Display part 8a.As exterior display device, e.g. slim TV machines 20 etc., for exterior display device, except wired connection
In addition it is also possible to be exported with infrared ray or electric wave, or specific server can also be sent to by WLAN etc..
Liquid crystal display part 8a is arranged on photographing unit 10, the record image of reproduction display record portion 3, clear in real time before photography
Look at display shot object image.And, the composograph that synthesis control unit 7 is generated carries out reproduction display.And, before photography
From the view data in photography portion 2, carry out synthesis process, the image of display spot portion movement by synthesizing control unit 7.Display is taken the photograph
Carry out before shadow synthesizing image when processing, thereby, it is possible to enjoy the enjoyment of photography.
Operating portion 9 comprises the functional units such as release button, menu button, when user operates to operating portion 9, controls
Portion 1 is according to operation to each portion output control signal.Flash lamp 2a is artificial lighting's device that subject is irradiated with illumination light.
Then, the process of the image synthesis of present embodiment is described using Fig. 4.Fig. 4(a)Illustrate the one of captured landscape
Example.In the landscape of this illustration, the edge 31 of cloud 30 is lighted brightly due to sunlight.When along the horizontal line along X-direction
When 35a takes the distribution of brightness, this Fig. 4(a)The Luminance Distribution of shown image such as Fig. 4(b)Shown.As illustrated, the end of cloud 30
The reflection of the sunlight in portion 31 is strong partly especially bright, and the part adjacent with this end 31 be not so bright.
In the present embodiment, select candidate portion from the end 31 of this cloud 30, the surrounding's change entering to exercise this candidate portion is bright
Bright emphasizes process.That is, as Fig. 4(b)Partly middle selection candidate portion that is shown, becoming clear from ratio regulation brightness B, for comprising this time
Select scope 33a in portion(Part by dotted line), such as Fig. 4(b)In arrow shown in so as to the end 31 of cloud 30 than surrounding
Brightness brighter.After carrying out this process, such as Fig. 4(c)Shown, become glitter brightly, the there is luminous point 32a figure in local
Picture.
And, as Fig. 4(d)Shown, take Luminance Distribution along the horizontal line 35b along X-axis, from the portion becoming clear than regulation brightness B
Candidate portion is selected, for scope 33b comprising this candidate portion in point(Part by dotted line), such as Fig. 4(e)In arrow institute
Show so as to brighter than the brightness of the end 31 of the cloud 30 of surrounding.After carrying out this process, such as Fig. 4(f)Shown, become local
Image that glitter brightly, that there is luminous point 32b.
In addition, when making around candidate portion A become bright, such as Fig. 4(b)、(e)Shown, carry out figure for scope 33a, 33b
Become certain brightness as processing, in other words, for the brightness peak of original image, generate more bright part, increase
Plus its area.
So, even identical image, such as Fig. 4(a)With(d)Shown, by changing the judgement position of Luminance Distribution(Horizontal line
The switching of 35a, 35b), the thus part change of regulation more than brightness B.Therefore, the position in candidate portion, thus, light are changed successively
The change in location of point 32a, 32b, can carry out the image appearance with sense of glittering.
In addition, in Fig. 4(c)、(f)In, processed in the range of the circle of candidate portion periphery with luminous point 32a, 32b,
But not limited to this, such as shown in Figure 5 it is also possible to be star-like or other shapes.By changing the shape emphasizing part, can
To give, from round different atmosphere, sense of glittering.With regard to this change of shape emphasizing part, in peripheral light amount increase portion 5b
Storage is emphasized the data of pattern of part and is switched successively, or can also be switched according to the selection of user.
Using the flow chart shown in Fig. 6, illustrate this luminous point that light is emphasized to be highlighted for executing
Action.Control unit 1 view data in record portion 3 according to record, with candidate extraction portion 4, peripheral light amount increase portion 5b, shifting
Dynamic control unit 5a etc. cooperates and to execute this flow process.
After entrance luminous point emphasizes flow process, first, 0 is set to variable Y(S101).Then, Δ Y is added to this variable Y
(S102), judge whether this variable Y is equal to the boundary value Y1 of Y(S103).Do not arrive for variable Y in the result of determination of step S103
In the case of reaching boundary value Y1, then, 0 is set to variable X(S104), Δ X is added to this variable X(S105), judge this variable X
Whether it is equal to the boundary value X1 of X(S106).
These steps S101~S103 is the steps of:Setting Fig. 4(a)When shown X, Y-axis, along Y-axis until Y-axis
Boundary value Y1 till, with Δ Y interval successively change brightness judge region.And, step S104~S106 is the steps of:
While changing X-coordinate, the brightness determinating area in change picture, till reaching the boundary value X1 of X-axis.Here, by
When carrying out brightness judgement according to continuous pixel, the pixel of determine object is meticulous and excessive, and therefore, Δ Y and Δ X are set as energy
Enough pixel separation that picture is divided into 50 parts about degree.
In the case that the result of determination of step S106 does not reach boundary value X1 for variable X, it is determined that coordinate(X,
Y)Whether the brightness at place becomes clear than regulation brightness B1(S107).It is situation about becoming clear unlike regulation brightness B1 in this result of determination
Under, return to step S105, Δ X is added to X-coordinate, judges whether brightness becomes clear than B1 at next coordinate.
It is coordinate in the result of determination of step S107(X, Y)In the case that brightness ratio B1 at place becomes clear, judge surrounding A portion
Brightness(S111).Here, surrounding A portion is equivalent to Fig. 4(c)、(f)Circles mark, the region of the star-like labelling of Fig. 5.Then, sentence
Whether the whole pixels in the region in A portion around fixed are more than brightness B1(S112).Complete in A portion around this result of determination is
In the case that the brightness of portion's pixel is more than B1, return to step S105.
On the other hand, the result of determination in step S112 is to be not all of pixel in the case of more than brightness B1, as
Candidate portion, extracts and records this coordinate(X, Y)(S113).Carry out these by candidate extraction portion 4 and extract operation.Here, exist
Brightness is because for return to step S105 in the case of more than B1, in the case that the whole pixels within A portion become clear around, that is,
Make by circles mark, star-like labelling partly become clear also inconspicuous, thus from candidate portion exclude.On the other hand, only one
In the case of partly dark, by making circles mark, the part of star-like labelling become bright, can show substantially and glitter.
With Y in step S112("Yes")Depart from circulation or record coordinate in S113(X, Y)Afterwards, return to step S105,
Judge laterally execution brightness being spaced with Δ X, till X-coordinate reaches boundary value X1.By executing these a series of places
Reason, terminates to judge, record brightness is more than B1 but part darker than B1 about along in a line of X-axis(Candidate portion)Whole seats
Mark(X, Y).
In step s 106, when X-coordinate reaches boundary value X1, enter step S102, the Y after Δ Y is added to variable Y
At coordinate, change X-coordinate, while detection becomes clear and part darker than B1 about than regulation brightness B1(Candidate portion), note
Record this coordinate(X, Y).
When above-mentioned brightness judges along Y direction at the end of the arrival other end of one end, in the judgement of step S103,
Variable Y becomes boundary value Y1.By executing these a series of process, the judgement of whole picture terminates, record brightness be B1 with
Go up but part darker than B1 about(Candidate portion)Whole coordinates(X, Y).
After variable Y becomes boundary value Y1, it is determined that whether candidate's number is less than 5(S115).In this step, judge
In step S113, whether the quantity in the candidate portion of record is less than stated number(Here it is " 5 ").In addition, this stated number is not limited to 5,
As long as in the suitable quantity carrying out the degree telling on when luminous point is highlighted.
In the case that the result of determination of step S115 is less than 5 for candidate's number, amplify determinating area(S116).That is, work as time
When selecting the quantity in portion few, the DeGrain being highlighted, so, expand the scope in A portion around carrying out in step S111.
This is because, by the scope in A portion around expanding, it is judged to that the probability of all more than B1 improves in step S112, waits
The quantity selecting portion increases.In addition, in the case that the quantity in candidate portion is excessive, on the contrary, be highlighted is partly excessive, may
Become irksome image.Therefore, in the case of being somebody's turn to do, according to certain rule, the quantity in candidate portion can be entered and in the ranks dredge(?
Draw く), or the scope of constriction region A.
In the case that the result of determination of step S115 is no less than 5, is more than 5 for the quantity in candidate portion, then, at this
In the range of candidate portion and about A portion, carry out the image procossing for producing sparkle effect.First, in order to according to situation Lai
Switching sparkle effect, whether there is face in process decision chart picture(S121).
In the case of being to comprise face in image in the result of determination of step S121, if the stipulated time is t10(S122), separately
On the one hand, in the case of not comprising face in the picture, if the stipulated time is t20(S123).This stipulated time is to change candidate
Time to change brightness again after the brightness in portion.
In the present embodiment, as Fig. 7(a)Shown, when changing the brightness of facial parts and so that it is glittered, as early as possible(t10)
Carry out the switching of brightness so that it is inconspicuous.On the other hand, as Fig. 7(b)Shown, beyond face partly in, slowly(t20)
Change.In addition, in the present embodiment, judging the coordinate in candidate portion(X, Y)Whether the point at place is face-image, however, it is possible to
To reflect the contrast of image.
After carrying out the setting of stipulated time, then, the coordinate to be recorded(X, Y)Centered on, generate and show to its week
Enclose A portion brightness increased after image(S124).After increasing brightness, when the rule through setting in step S122, S123
When fixing time, the part that change becomes clear is made to return to original brightness(S125).It is determined whether terminate luminous point being highlighted
(S126).Operating portion 9 is provided with for starting or terminating the functional unit that luminous point is highlighted, in step S126, judges
The mode of operation of this functional unit.Alternatively, it is also possible to be terminated by operating release button to execute, in the case of being somebody's turn to do, shooting terminates
The luminous point in moment emphasizes image.
In the case of being to terminate in the result of determination of step S126, return the flow process that photographing unit described later controls.Another
Aspect, in the case of being not over, selects the coordinate in other candidate portions of record in step S113(X, Y)(S127).Choosing
After selecting the coordinate in other candidate portions, return to step S121, execute above-mentioned action.
So, in the flow process that luminous point is highlighted, in step S101~S113, detection than regulation brightness B1 become clear and
The brightness in A portion does not all have the candidate portion that B1 becomes clear about(Coordinate(X, Y)), it is recorded.Then, remember for this institute
The candidate portion of record, the A portion around this that comprises increases brightness successively interior, returns to original brightness after the stipulated time.By anti-
Carry out this action again, as shown in Figure 2 and Figure 7, can carry out with still image as keynote, play the figure of dynamic image effect simultaneously
As performance.
In addition, the A portion of surrounding comprising candidate portion makes candidate portion become bright interior, being set as A portion around this in advance will not
When making us being fed up with and showing it can be seen that size, set the sizable circle with the 1/30 about of whole picture
Portion is worth by default.But, by the selection operation of user, this shape can also be comparable to an equal amount of star-like or rhombus
Etc. other shapes, in addition, size is also not necessarily limited to 1/30, can suitably be changed.Alternatively, it is also possible to the spy according to image section
Levy to change size and color etc..Determine carry out candidate portion that luminous point emphasizes and about after, entered by synthesizing control unit 7
Row controls, but it is also possible to carry out the decision of the stipulated time in step S121~S123 by control unit 1.
Then, illustrate using Fig. 9 to execute the concrete structure of the synthesis control unit 7 of image synthesis.Synthesis control unit 7 is by gain
Assigning unit 7a, multiplier 7b, 7c and adder 7d are constituted.
That is, multiplier 7b is connected with the output of record portion 3 and the output of gain assigning unit 7a, and connects into adder 7d
Export these multiplication results.Multiplier 7c is connected with the output of gain assigning unit 7a and the output of light quantity increase portion 5b, and connects
Become and export multiplication result to adder 7d.Gain assigning unit 7a is connected with the output of light quantity increase portion 5b, and has inputted and be derived from
The synthesis timing signal of control unit 1.Output according to light quantity increase portion 5b and generate gain, and connect into multiplier 7b, 7c
Export this gain.Adder 7d connects into input each output from multiplier 7b, 7c, and connects into and export to output section 8
These addition results.
The static image data reading from record portion 3 is output to multiplier 7b and candidate extraction portion 4.By candidate extraction portion
The coordinate information in the candidate portion that 4 extract is output to peripheral light amount increase portion 5b and mobile control division 5a.Peripheral light amount increases
Portion 5b inputs the positional information in candidate portion from candidate extraction portion 4, and inputs mobile message from mobile control division 5a, and generation increases
The image of peripheral light amount, is output to gain assigning unit 7a and multiplier 7c.
Then, the action of the synthesis control unit 7 of such composition is described.First, candidate extraction portion 4 inputs figure from record portion 3
As data, extract and there is the candidate portion that light quantity increases effect.According to each pixel, to being extracted based on this in adder 7d
Candidate portion and the image after increasing peripheral light amount are added with original still image.Now, for original static state
The suitable pixel of light quantity augmenting portion in image, is multiplied in multiplier 7b using gain 0, and the light quantity of synthesis increases figure
As, after being multiplied in multiplier 7c with gain 1, being added.
Control this image to synthesize by synthesizing timing signal, after starting, terminate after the stipulated time, now, if light
The gain that amount increases image is 0, and the gain of still image 38 originally is 1.Therefore, according to synthesis timing signal, gain gives
Portion 7a makes gain change between zero and one.As the change of this gain, such as Fig. 8(a)、(b)Shown, in a period of from T1 to T2
Increase synthesis gain 37, emphasize luminous point, return to 0 in a period of from T2 to T3, make display image return to original image.
The change of this gain has various modifications example, for example, can select as Fig. 8(a)As shown in gradually become bright figure
Case or such as Fig. 8(b)The bright pattern of shown unexpected change.In the case of being somebody's turn to do, can be set to:If face-image, then automatically select
Fig. 8(b)Shown pattern, if other images, then automatically selects Fig. 8(a)Pattern.The figure of change in gain depicted herein
Case is the sequential chart of the change of light in the candidate portion at a position, and the coordinate in the candidate portion from display transfers to next candidate
The time during coordinate in portion switches over according to described stipulated time t10, t20.
This change timing can be selected or switch at random.Alternatively, it is also possible to be cut according to image
Change.For example, make high partly fast of contrast, make low partly slow of contrast.Show corresponding with the atmosphere of image can be carried out.
Here, that spends as a comparison obtains method, in Fig. 4(b)、(e)Shown in figure, using brightness from regulation brightness B1
Height to peak value etc. is judged, or can also be judged according to the slope in this peak value portion etc..And, in step S121
(Fig. 6)In it is also possible to consider contrast changing the stipulated time.In the case of contrast height, if expanding luminous point further
Area, then more effectively.Furthermore, it is also possible to according to the tone of image, such as with blue or with white or Lycoperdon polymorphum Vitt feelings
Under condition, it is judged to above picture have cloud, when luminous point expands, change size and timing etc..
Then, the photographing unit control of this photographing unit that can carry out reproduction display, using the flow chart shown in Figure 10, is described
The action of system.
After entering the flow process that photographing unit controls, it is first determined whether being photograph mode(S201).This photographing unit 10 can set
Determine photograph mode and this two patterns of reproduction mode.In the case of being to be photograph mode in the result of determination of step S201, transfer
Prepare to photography.In addition, in the present embodiment, the displaying live view when photography prepares can carry out strong based on luminous point when showing
The display adjusted.
After transferring to photography preparation, it is taken into image first(S202).In this step, picture number is taken into by photography portion 2
According to displaying live view being carried out on liquid crystal display part 8a according to this view data and shows.And, come using the view data being taken into
Detect whether there are facial parts, and detection is located at where picture in case of presence.Can also be in photography
When record the information relevant with face detecting here in the lump.If being recorded, carrying out luminous point when reproducing and emphasizing to show
When showing, can not need to judge the position of face.
It is determined whether carry out luminous point being highlighted(S203).In this step, determine whether to operate operating portion 9
Interior luminous point emphasizes functional unit.It is not carry out in the case that luminous point emphasizes in this result of determination, according to the image being taken into
Data carries out common displaying live view and shows(S204).On the other hand, strong for having carried out luminous point in the result of determination of step S203
In the case of adjusting the operation of display, carry out luminous point and be highlighted(S205).
This luminous point is highlighted the flow process using Fig. 6 explanation for the execution.By executing the flow process that luminous point is highlighted, such as Fig. 7
Shown, display has the image glittering, and enjoys the enjoyment of photography.Further, it is possible to one side direct viewing is while confirm before photography
Whether it is to there is the image that luminous point is highlighted effect.
Carry out image to show or after luminous point is highlighted, then determine whether to have carried out release operation(S206).In this step
In rapid, determine whether to operate the release button in operating portion 9.
In the case of being not discharged in the result of determination of step S206, return to step S201, carry out described action.
On the other hand, in the case of being to be discharged in result of determination, start to photograph and record(S207).Here, photography is to pass through
Still image photography or dynamic image photography that photography portion 2 is carried out.It is also possible to be judged in the case of operating release button
It is dynamic image photography, in addition, in the photography of dynamic image or still image it is also possible to record sound by collecting line 6.
When reproducing image, sound can be reproduced in the lump.During photography/record end, terminate this flow process, again return to step S201.
In the case of being not to be photograph mode in the result of determination of step S201, determine whether reproduction mode(S211).
In the case of being not to be reproduction mode in this result of determination, return to step S201.On the other hand, in result of determination for being to reproduce mould
In the case of formula, carry out image selection(S212).In this step, for example carry out thumbnail to show, the image that user is selected
As reproduction candidate.
Then, same with step S203, determine whether that carrying out luminous point is highlighted(S213).It is not to be in this result of determination
In the case that luminous point is highlighted, carry out the usual reproduction of the image of selection in step S212.In the case of being somebody's turn to do, selecting image
In the case of being dynamic image, directly captured consecutive image is reproduced as dynamic image, be quiet selecting image
In the case of state image, directly carry out the reproduction display of still image.
And, it is to have selected in the case that luminous point is highlighted in the result of determination of step S213, execution is illustrated using Fig. 6
The flow process that is highlighted of luminous point(S215).Thus, as described above, be that regulation is above for brightness and periphery be not specified by with
The candidate portion of the part of upper brightness, the synthesis carrying out image successively is processed so that it becomes bright, thereby, it is possible to reproduction display light
The image of the dynamic image style moving of glittering.It is the situation not selecting luminous point to emphasize in the result of determination of step S213
Under, carry out common reproduction display(S214).Carry out luminous point to be highlighted or terminate after generally showing, open from step S201 again
Begin to execute.
As described above, in the 1st embodiment of the present invention, extract as the edge of cloud that being illuminated by sunlight
Sample, substantially become bright part compared with surrounding as candidate portion, make this candidate portion being extracted become the bright of regulation of becoming clear
After more than degree, it is again restored to original brightness.For multiple candidate portions, implement the image procossing of this brightness change successively, by
This, glittering of light is moved successively.Therefore, different from simple still image, become the reproduction of dynamic image style, become rich
The image of change.Due to image change, therefore just like it can be seen that landscape outside window becomes broad.
Then, the 2nd embodiment of the present invention is described using Figure 11~Figure 13.In the 1st embodiment, randomly choose and wait
Select portion, in other words, not necessarily along continuous line options candidate portion.On the other hand, in the 2nd embodiment, determine whether band
The continuous light of shape, selects the candidate portion of continued presence, thus, carries out the luminous point to the part additional spot that banding becomes clear
It is highlighted.
In the structure of second embodiment of the present invention, except the luminous point shown in Fig. 6 in the 1st embodiment is highlighted
Flow chart be replaced into beyond the flow chart shown in Figure 13, identical with the 1st embodiment, so, carried out centered on difference
Explanation.
First, the selection in the candidate portion of the 2nd embodiment is described using Figure 11 and Figure 12.In Figure 11(a)Shown cloud 30
The glittering in impressive image of edge 31, after playing the sparkle effect of part highlighting this edge 31, further plus
Strong impression.
As Figure 11(a)Shown take X-axis Y-axis, along the horizontal line 36a~36c along Y-axis take Luminance Distribution when, Luminance Distribution is such as
Figure 11(b)~(d)Shown.In a same manner as in the first embodiment, take out the part that specific luminance B becomes clear, this portion is described on XY coordinate axess
During the position 39a~39d at center dividing, as shown in figure 12.
Here it is known that position 39a~39c continuous arrangement in the range of Rack x2.That is, can interpolate that as position
39a~39c is the brightness portion of continuous banding.On the other hand, there are not other lights in position 39d in Rack x2
Central point, be not judged as the brightness portion of banding.In the present embodiment, because multiple points do not arrange in Rack x2,
So, in Figure 11(a)The light of middle position 39d(Be equivalent to Figure 11(d)Right side peak value), do not select this point as time
Select portion, do not generate synthesis image as luminous point.
Then, the flow process being highlighted for the luminous point executing present embodiment is described using Figure 13.Enter this embodiment party
After the flow process that the luminous point of formula is highlighted, in a same manner as in the first embodiment, in step S101~S107, make determinating area respectively
X-axis and Y direction move.In step s 107, it is being judged to coordinate(X, Y)The situation that the brightness specific luminance B1 at place becomes clear
Under, judge coordinate(X, Y)The brightness of left and right(S111A).
In addition, in the 1st embodiment, the brightness having carried out surrounding A judges, but, in the 2nd embodiment, in order to
Simplify, only judge the brightness of the left and right in the range of A around entering.Certainly, in a same manner as in the first embodiment, it is not limited to left and right,
Can be determined that the brightness of surrounding.In the case of being somebody's turn to do, in the next step, judge whether surrounding A is overall darker than B1.
Brightness according to step S111A judges, it is determined that whether the brightness of left and right both sides is below B1(S112A).Separately
Outward, as the brightness of left and right here, judge the brightness of the pixel in surrounding A, and be not limited to the pixel of direct neighbor.In this step
The result of determination of rapid S112A be the left and right both sides around being comprised in A brightness be not below B1 in the case of, return to step
S105.
On the other hand, step S112A result of determination be both sides brightness be below B1 in the case of, blotter sit
Mark(X, Y)(S117).After blotter, subsequently determine that coordinate X whether in the range of the X ± X2 of last time blotter
(S118).As being illustrated in Figure 12, determine whether in the range of banding.Here, X2 considers error, for example, be set to
Several times of Δ X and Δ Y about value.This result of determination be not in the range of in the case of, return to step S105.
On the other hand, in the case that the result of determination in step S118 is in prescribed limit, final entry coordinate(X,
Y)As candidate portion(S119).After being recorded, again return to step S105.Execution step S102~S119 repeatedly, thus, energy
Enough record the coordinate in the candidate portion in the light being present in banding in picture.
When the result of determination of step S103 reaches boundary value Y1 for Y, the judgement in whole picture terminates, so, then
Carry out the generation of luminous point.In the present embodiment, in order to carry out light on picture from top to bottom(The Y direction of Figure 11)Flowing
Demonstration, after step S131, carries out luminous point according to Y data order from small to large to candidate portion and emphasizes.
First, according to Y from small to large sequentially read recorded coordinate(X, Y)(S131).Here, read in step
The coordinate of record in S119.Then, with read-out coordinate(X, Y)Centered on portion, generate and show that the brightness to periphery A portion is entered
Image after row increase(S132).Periphery A portion can be rounded portions in a same manner as in the first embodiment or others are star-like
Etc. shape.
It is determined that luminous point is highlighted whether terminating(S133).Operating portion 9 is provided with for beginning and end luminous point
The functional unit being highlighted, in step S133, judges the mode of operation of this functional unit.
In the case of being to terminate in the result of determination of step S133, return the flow process that photographing unit controls.On the other hand, do not having
In the case of having end, wait for the stipulated time(S134).After the stipulated time, return to step S131, read next seat
Mark(X, Y), carry out the display of luminous point.In the 2nd embodiment, especially do not determine whether face and contrast, but, certainly
Face can also be determined whether and judges contrast, carry out the stipulated time in switch step S134 in a same manner as in the first embodiment.
So, in the 2nd embodiment of the present invention, judge, in the range of banding, whether there is candidate portion(S118), only
In the case that candidate portion enters in the range of banding, final entry is candidate portion.Therefore, it is possible to carry out the reproduction of luminous point flowing.
As described above, in the 1st and the 2nd embodiment of the present invention, detect in the image of photographss
The candidate portion becoming clear than regulation brightness B1, generates the surrounding A in the candidate portion synthesis image brighter than regulation brightness, and synthesis should
Composograph and original photographss, reproduce this image.Can adapt to using electricity therefore, it is possible to be reproduced with shirtsleeve operation
The image appreciated depending on machine etc..That is, with simple structure, to glittering of the still image additional optical completing in the moment shooting
Effect, thus although photographss are still images, but reproduction display can have the image of change.
In addition, in the 1st and the 2nd embodiment of the present invention, from the selection candidate portion above brightness that specifies, but,
Can also the simply luminance saturation of detection image part, select this part to carry out image procossing as candidate portion.And,
When judging brightness, it is not limited to the brightness of reality naturally it is also possible to image unit using the entrance considering the aperture of photographing unit etc.
The intensity of the light of part or consider the various brightness such as brightness of light sensitivitys of time of exposure and imaging apparatuss.
In addition, in the 1st and the 2nd embodiment of the present invention, when selecting candidate portion, being set to the bright of more than the 1st regulation
Brightness in degree and scope A is not all the above brightness of the 2nd regulation, and the 1st and the 2nd regulation brightness is all identical brightness.
But, the 1st and the 2nd regulation brightness can certainly be different.
In addition, in the 1st and the 2nd embodiment of the present invention, when selecting candidate portion, the above brightness of judgement regulation,
And whole brightness of the brightness in scope A, but it is also possible to the not brightness in limit of consideration A.In the case of being somebody's turn to do, even if generating light
Point be also possible to inconspicuous, but, by making luminous point fully bright, luminous point can be made to a certain extent to become obvious.
Then, the 3rd embodiment of the present invention is described using Figure 14~Figure 27.The photograph of the 3rd embodiment of the present invention
Machine 60 is also digital camera, can shoot continuous shooting and dynamic image, and recording image data in the recording medium.And, again
Now, extract the part of brightness flop in image, this changing unit and benchmark image synthesized, can reproduction display brightness repeatedly
The composograph of change.Thereby, it is possible to obtain carefree and content the effect looking into the distance landscape.
Before the structure of the photographing unit 60 of explanation present embodiment, it is mounted with the present invention's using Figure 15 and Figure 16 explanation
The consideration method of the image reproducing in the photographing unit 60 of image-reproducing means.
Nearest digital camera simply can carry out dynamic image photography, but, with the miniaturization of photographing unit, hold
Easily cause hand shaking, and, in the photography of dynamic image, such as Figure 15(c)Shown, unexpected subject sometimes(Here it is
Automobile 83)Enter picture.When reproducing this image using the television set 70 of this big picture of Figure 16, hand shaking is very irksome, and
And, repeatedly see that curious coincidence image is also very irksome.
In addition, as the wallpaper of personal computer, big picture thin type television set 70 shows original photographss
When, hand shaking and coincidence image also improper.If still image, then can solve the problem that this problem, and, still image itself
Can be the image completing in the photography moment in the moment works shooting.Therefore, if still image, then do not need that
Trouble, can meet general user.
But, in the case of using reproduction display images such as big frame TV machines, if there is no any change completely,
Can feel dull and be sick of, thus it is possible to viewing has the image of some changes at leisure.For example, the leaf in tree 81 rocks, too
This scene of reflection optical scintillation of sunlight(With reference to Figure 15(a)、(b)), light reflex in this scene etc. on the wave on sea, can
To show glittering of this light.Even if the effect of the light that reflection of light etc. is iteratively produced in nature is repeated several times, there will not be not
, there is the gentle effect of mental state making appreciator in comfort sense.
So although being this image not having great changes of still image, but, reflection of additional optical etc. is in nature
The change of recurrent light, thereby, it is possible to be mirrored the display just like landscape outside window.But, such as Figure 15(c)It is shown,
In place of although automobile 83 passing through etc. is change, can feel unnatural when repeatedly watching and can be sick of, it is preferred, therefore, that not
Reproduce this subject.
According to this consideration method, in the image-reproducing means of present embodiment, the following image of reproduction display:For
The still image completing in the photography moment, only gives the change of the reflected light of the sun, removes this ugly part of hand shaking, the opposing party
Face, gives the change of natural light.Thus, as shown in figure 16, can show on the television set 70 of big picture and mirror outside window
The image of landscape.In addition, in the photography of dynamic image and continuous shooting image it is also possible to record to tweedle etc., in image
Tweedle is reproduced during reproduction.
Then, the structure of the above-mentioned photographing unit being capable of reproduction display image is described.Figure 14 is the photograph illustrating the 3rd embodiment
The block diagram of the electrical structure of camera 60.Photographing unit 60 have control unit 51, photography portion 52, record portion 53, compression storage unit 53b,
Represent extraction unit 54, image change extraction unit 55, collection line 56, synthesis control unit 57, output section 58, liquid crystal display part 58a, with
And operating portion 59.
Control unit 51 is by CPU(Central Processing Unit)Deng constituting, it is connected with each portion of this photographing unit 60,
Carry out overall control according to program.Photography portion 52 comprises for obtaining the optical system of shot object image, right to subject imaging
Shot object image carries out the imaging apparatuss of opto-electronic conversion, the image processing part that the picture signal exporting from imaging apparatuss is processed
Deng, and output image data.In addition, this photography portion 52 can export the view data of still image, continuous shooting, dynamic image.
Collection line 56 is passed through mike etc. and is converted sound into the signal of telecommunication, and exports acoustical signal.Record portion 53 is according to next
From the control signal of control unit 51, record the view data of the still image exporting from photography portion 52, continuous shooting, dynamic image.And
And, together with the record of view data, also carry out the record of the voice data from collection line 56 output.
Represent extraction unit 54 and extract representative image in the view data record portion 53 from record.Continuous shooting image and dynamic
Image is made up of a series of multiple still images, represents extraction unit 54 and extracts representative image from these multiple images.Image
Change detection portion 55 in a series of multiple still images constituting continuous shooting and dynamic image, to representative image and each static map
As be compared, only extract the part of change.This image change extraction unit 55 extracts the image overall variation that hand shaking etc. causes
Variable quantity, in image the part of brightness flop picture signal itself(Part modified-image).
Synthesis control unit 57 is directed to by representing the representative image that extraction unit 54 is extracted, and synthesis is carried by image change extraction unit 55
The changing unit taken out.That is, the information that how synthesis control unit 57 is changed using the image of which position, closes in representative image
Become part modified-image.Compression storage unit 53b to by the view data that record portion 53 records be compressed preserve, and, to
In synthesis control unit 57, the view data of synthesis is compressed, and is saved.
Output section 58 exports still image in record portion 53 for the record, continuous shooting, dynamic image to external equipment, and defeated
Go out to liquid crystal display part 58a.And, the image of synthesis also exports external equipment and liquid crystal display part in synthesis control unit 57
58a.As external equipment, e.g. slim television set 70 etc., for external equipment, in addition to wired connection, still may be used
With by infrared ray or electric wave output, or WLAN etc. can also be passed through be sent to specific server.
The back side that liquid crystal display part 58a is arranged on photographing unit 60 is first-class, the record image of reproduction display record portion 53 and conjunction
Become the composograph of control unit 57 synthesis.Operating portion 59 comprises the functional units such as release button, menu button, when user is to operation
When portion 59 is operated, control unit 51 is according to operation to each portion output control signal.
Then, the process of the image synthesis of present embodiment is described using Figure 17~Figure 21.Figure 17 illustrates hand-held shooting
Dynamic image(Or continuous shooting image).As Figure 17(a)~(c)Shown, this dynamic image is made up of a series of still image, is drawing
In face, the position of tree 81 is changed due to hand shaking.
Figure 18(b)、(c)By Figure 18(a)A shown initial frame, as the representative image on the basis of becoming, illustrates subject
How to change.Here, for simplicity, illustrate only longitudinal(Y direction)The situation of change.The image that subject sets 81 is inclined in longitudinal direction
Move with consistent with representative image, when detection difference is minimum side-play amount.If this minimum offset is variation delta y1, Δ y2.
When correcting Figure 17 using variation delta y1 obtained here, Δ y2(b)、(c)During the position of shown subject,
As shown in figure 19.That is, Figure 17(b)Image move up Δ y1, Figure 17 in the vertical(c)Image move down in the vertical
Δy2.
The leaf of tree 81 is waved due to wind, the reflection optical scintillation of sunlight.The part change 82 glittered with regard to this, part
Change 82a, 82b, 82c and its position at every moment change.After being corrected using variation delta y1, Δ y2, if part change 82b,
The position of 82c is y1, y2.Figure 20 is only to extract part to change 82a, 82b, 82c and make the picture signal of part in addition
Modified-image for minima.
Figure 21 illustrates representative image(Benchmark image), it is and Figure 17(a), Figure 18(a)Identical image.For this representative graph
As shown in synthesis Figure 20 only extract part change 82 modified-image when, can obtain flashing due to waving of leaf and
The image that reflected light is waved.According to the method, do not utilize the major part of dynamic image, only record representative image(With reference to Figure 21)、
Change point information(Y1, y2 etc.), and modified-image(With reference to Figure 20), thus it is possible to make the data volume of image be little Rong
Amount.And, when appreciating still image when printing or using television set 70 etc., not having of the effect that addition of light can be enjoyed
There is the enjoyment of the dynamic image of shake.
Then, illustrate to execute the concrete of the synthesis control unit 57 synthesizing in Figure 17~image illustrated in fig. 21 using Figure 22
Structure.Synthesis control unit 57 is made up of gain assigning unit 57a, multiplier 57b, 57c and adder 57d.
That is, gain assigning unit 57a is connected with the output of modified-image 55a, and connects into according to this modified-image 55a to taking advantage of
Musical instruments used in a Buddhist or Taoist mass 57b, 57c output gain.Multiplier 57b is connected with the output of gain assigning unit 57a and the output of modified-image 55a, and
Connect into and export multiplication result to adder 57d.The output of multiplier 57c and representative image 54a and gain assigning unit 57a defeated
Go out to connect, and connect into and export these multiplication results to adder 57d.Adder 57d connects into input to be had from multiplier
Each output of 57b, 57c, and connect into these addition results of output section 58 output.
Then, the action of the synthesis control unit 57 of such composition is described.As from the representative graph representing extraction unit 54 output
As 54a, the image initially being obtained using shooting operation, but naturally it is also possible to be cameraman select image, dynamic image or
In continuous shooting image the most stable when image.
Modified-image 55a from image change extraction unit 55 output is a series of multiple variation diagrams shown in described Figure 20
Picture(With reference to Figure 20(b)、(c)), it is minima beyond the part of part change 82b, 82c.Image with regard to this modified-image 55a
Data, is sequentially inputted to multiplier 57b and gain assigning unit 57a according to each pixel.Modified-image 55a is multiple, when for
During a first frame input image data, move to next frame and data input is repeated, until inputting the frame number -1 being continuously shot
Till the view data of frame.
Gain assigning unit 57a changes gain according to the data of each pixel of modified-image 55a.That is, with regard to being not changed in
Part, view data is set to minima.In the case that view data is for minima, if the gain of multiplier 57b is 0, multiplication
The gain of device 57c is 1.On the other hand, the part with regard to changing, if the gain of multiplier 57b is 1, the gain of multiplier 57c
For 0 etc., it is emphasized the control of change section.Alternatively, it is also possible to gradually change multiplier 57b gain it is also possible to emphasize for 1 with
On.According to circumstances it is also possible to changing color or making it have change.
When sequentially inputting modified-image 55a(Figure 20(b)、(c))When, in original representative image 54a(Figure 21)In gradually
The part of synthesis change simultaneously exports output section 58.Therefore, reproduce the leaf subreflexive sun color break-up waved due to wind etc.
The situation of credit.In this reproduction it is only necessary to original representative image 54a(Figure 21)With modified-image 55a(Figure 20(b)、(c))'s
View data can be it is not necessary to the view data of the multiple still images for constituting dynamic image shown in Figure 19.
Then, using the flow chart shown in Figure 23 and Figure 24, illustrate for execution in Figure 17~image illustrated in fig. 21
The action of synthesis.Figure 23 is the flow process of the change section extracting image.
After the flow process entering change detection, first, would indicate that the variable n of the picture number constituting dynamic image is initialized as
n=0(S501).In this example embodiment, image when dynamic image photography being started is as benchmark image(Representative image).Then, right
Variable n is incremented by(S502), judge whether this variable n after being incremented by is value corresponding with final frame(S503).In this judgement
In the case that result reaches final frame for variable n, return to original flow process.
In the case that the result of determination of step S503 does not reach final frame for variable n, carry out variable n and benchmark image
(Representative image)Comparison(S504), carry out side-play amount(ΔXn、ΔYn)Judgement(S505).That is, as described in using Figure 18
Like that, side-play amount is migrated image while obtaining side-play amount when consistent degree, this consistent degree highest.
Then, carry out brightness flop portion(Xan、Yan)Detection(S506).In this step, as being illustrated in Figure 19
Like that, detect the part of brightness flop, detect its X-coordinate and Y-coordinate.This detection detailed is described below using Figure 26 and Figure 27
Details condition.Behind detection brightness flop portion, then by change section(Xan、Yan)View data in addition is set to minima
(S507).That is, the view data beyond changing unit is set to minima, is set to new n-th image(With reference to Figure 26(d)).
After generating new n-th image in step s 507, it is recorded as synthesis image n(S508).Described above
Shown in Figure 20, this synthesis image n is the image being only made up of the change section of brightness flop.Record synthesis is with, after image n, returning
Step S502, is incremented by variable n, executes described action.
Then, the sub-process of the brightness flop portion detection in step S506 is described using Figure 26 and Figure 27.First, using figure
The consideration method of the detection in 26 explanation brightness flop portions.Figure 26(a)~(c)Figure 26 is shown(e)Shown image specifies along picture
The horizontal Luminance Distribution in portion.Although on the diagram is not expressly recited, Figure 26(a)~(c)Transverse axis the position of pixel is shown
Put, the longitudinal axis illustrates the output of each pixel.Brightness according to shot object image forms the pattern of diagram.
Figure 26(a)Benchmark image is shown(Representative image)LO-pattern, Figure 26(b)It is n-th image, here, brightness
Increase Δ B.Then, represent that the variable n of frame number increases further, when becoming the n-th+m image, glittering of changing unit disappears
Lose.So, luminance difference Δ B increases, and then, returns to original brightness.
In the present embodiment, it is not only the part of brightness flop to be detected as brightness flop portion, after becoming bright, sentence
Determine whether turn again to original brightness, using the part meeting this condition as brightness flop portion.Detect and meet this condition
After partly, if scope X1 of this part~X2 is Xan.For Y direction, using same consideration method, detect changing unit,
If scope Y1 of this part~Y2 is Yan.
According to Figure 26(a)~(c)Consideration method detect change section Xan after, if the value beyond this change section be minimum
Value, thus, such as Figure 26(d)Shown, composograph can be obtained, using this composograph as new n-th image(Reference
S507).
Then, the action of this brightness flop portion detection is described using the flow chart shown in Figure 27.As described above, not being detection
Glitter the bright part once just terminating, but must detect whether it returns to original brightness.That is, glittering might not be one
Pop-off, flashes the object a little while disappearing afterwards as Christmas tree and there is also, so, original bright using whether returning to
Spend and to be judged.
After entering the flow process of brightness flop portion detection, first, to benchmark image(Representative image)With n-th after position correction
Individual image is compared, and detects change section Xan, Yan(S801).In this step, as in Figure 26(a)、(b)Middle explanation that
Sample, detection produces the part of the change of luminance difference Δ B.Then, if benchmark image(Representative image)Xan, Yan brightness be B0
(S802).After n-th image is detected, the brightness of benchmark image is stored as B0, to judge that the brightness of this part is
No turn again to original brightness.
It is determined whether there is (n+1)th image(S803).In this step, for dynamic image and composition continuous shooting
The a series of still image of image terminates brightness and judges, determines whether there is next image(N+1 image).In this result of determination
In the case of there is n+1 image, obtain the brightness of Xan, Yan of this n+1 image, if it is B1(S804).
After obtaining brightness B1, it is determined that this B1 and in step S802 storage B0 whether roughly equal(S805).?
This result of determination is for, in the case of being not roughly equal, adding 1 to variable n(S807), return to step S803, carry out above-mentioned dynamic
Make.During step S803~step S807 is repeated, in the judgement of step S805, B1 and B0 becomes substantially phase
Deng.In the case of being somebody's turn to do, it is judged as brightness flop and returns to original brightness.When the result of determination of step S805 is B1 B0, will
Xan, Yan are as brightness flop portion(S806), return original flow process.
In the case of being to there is not n+1 image in the result of determination of step S803, not using Xan, Yan as brightness flop portion
(S808), return original flow process.Although there is the part that local luminance brightens in the case of being somebody's turn to do, but it is not returned to original
Brightness, so not as change section.So, even if determining whether that returning to original brightness is also not have to select repeatedly to change
The part of unnatural sense.For example, even if the light of spectacular sign flashes repeatedly does not also have unnatural sense, but, photographing
If the bright portion having extinguished the window of electric light in journey is judged as change section, flicker can be unnatural repeatedly to make it, so, at this
In the case of kind, not as change section.
Then, using the flow chart of the synthesis display shown in Figure 24, illustrate to the conjunction being obtained by the flow process shown in Figure 23
Become image(Modified-image)And benchmark image(Representative image)Carry out synthesizing the action of display.
After entering the flow process of synthesis display, first, initialized so that being represented that the variable n of the order of composograph is 0
(S601).Then, 1 is added to variable n, so that variable n is incremented by(S602).It is determined whether being processed to modified-image
Whether image to the last, i.e. variable n are last(Terminate)(S603).
In the case that the result of determination of step S603 is not last for composograph n, carry out benchmark image and composite diagram
The synthesis of picture(S604).To execute this synthesis by using the synthesis control unit 7 that Figure 22 illustrates to process.Carry out in step s 604
After the synthesis of composograph n and benchmark image, return to step S602, then, carry out the conjunction of composograph n+1 and benchmark image
Become.Synthesis is repeated till being judged to there is no composograph in step S603.
In the case of being to be over for last composograph in the result of determination of step S603, determine whether to carry out
End operation(S605).In this step, determine whether to indicate synthesis display by the functional unit in operating portion 59
Terminate.In the case of being not carry out end operation in this result of determination, return to step S601, aobvious from proceeding by synthesis again
Show.
In the case of being to have carried out end operation in the result of determination of step S605, terminate synthesis display, return original
Flow process.So, step S601~S604 is repeated, till having carried out end operation.Thus, for example, despite advertisement
Draw this still image, but display has the image of sparkling part all the time thereon, become with big frame TV machine etc.
Corresponding image appearance.
Then, it is dynamic that the photographing unit of the photographing unit that can carry out this display using the flow chart explanation shown in Figure 25 controls
Make.
After entering the flow process that photographing unit controls, first, determine whether photograph mode(S701).This photographing unit 60 can set
Determine photograph mode and this two patterns of reproduction mode.In the case of being to be photograph mode in the result of determination of step S701, judge
Whether carry out release operation(S702).In this step, determine whether to operate the release button in operating portion 59.
In the case of being not discharged in the result of determination of step S702, return to step S701, carry out above-mentioned action.
On the other hand, in the case of being to be discharged in result of determination, start sequence photography(S703).Here, sequence photography is logical
Cross dynamic image photography and the continuous shooting that photography portion 52 is carried out, dynamic image and continuous shooting can pass through menu mode etc. by user
Suitably set in advance.And, start to collect sound(S704).Carry out collecting sound by collecting line 6.Then carry out operation of recording(S705).
Start to photograph by step S703 and S704 and collect sound, so, in this step, start the record of image and sound.
After starting image and the record of sound, it is determined whether being moving body photography(S706).For example, in athletic meeting
In the scene that middle child is running, the image synthesis extracting above-mentioned such change section is inappropriate, so, judge being shot
Whether body is not moving body.That is, the scene persistently changing in the same direction with regard to the motion vector at picture center, subject can
To be considered as moving body, so, the reproducting method to the additional change of still image is inappropriate as in the present embodiment.
Therefore, detect motion vector, judge whether subject is moving body.
In the case of being not to be moving body photography in the result of determination of step S706, carry out static subject judgement
(S708).This static subject judges to be recorded together with view data, adds when whether being static subject when judging and reproducing
To utilize(With reference to S714).
After the record end that the static subject of step S708 judges, or the result of determination of step S706 is to be mobile
In the case of body photography, subsequently determine that whether photography terminates(S707).In the case of sequence photography, initial manipulation release button
When, start sequence photography, when operating release button again, terminate sequence photography.Therefore, in this step, determine whether again
Operate release button.
In the case that the result of determination of step S707 is not over for photography, return to step S705, continue executing with continuous
Photography.On the other hand, in the case that the result of determination of step S707 terminates for photography, photography and SoundRec are terminated
(S709).After end, again return to step S701.
In the case of being not to be photograph mode in the result of determination of step S701, determine whether reproduction mode(S711).
In the case of being not to be reproduction mode in this result of determination, return to step S701.On the other hand, in result of determination for being to reproduce mould
In the case of formula, carry out image selection(S712).In this step, for example carry out thumbnail to show, the image that user is selected
As reproduction candidate.
It is determined whether carrying out TV output(S713), in the case of being to be TV output in this result of determination, judge
Whether it is static subject(S714).According to the setting state of menu mode determine whether TV export, and, according to
In step S708, the static subject of record judges to be made whether the being judgement of static subject.In addition, it is defeated to be not limited to TV
Go out, it is also possible to same processed in the case of exporting outside other.Alternatively, it is also possible to the detection motion when reproducing consecutive image
Vector, thus determine whether static subject.
In the case of any one being unsatisfactory for step S713 and this two conditions of S714, generally reproduced(S719).
In this usual reproduction, directly reproduce captured consecutive image.For example, in athletic meeting, child runs in this scene, no
Need this benefit emphasizing still image of present embodiment, carry out in itself showing using dynamic image, so, as clap
Reproduced as taking the photograph.
On the other hand, in the case that step S713 and this two conditions of S714 all meet, the portion of being changed extracts
(S715).In this step, the sub-process in the change detection portion using Figure 23 explanation for the execution.Then, start audio reproduction
(S716).
Then, start synthesis display(S717).Here, begin to use the sub-process of the synthesis display of Figure 24 explanation.In step
Start sound in rapid S716, here, suppose that sound is sound of tweedle or wave etc., week can be listened in conjunction with the change of image
The sound enclosing.Start image synthesis in step S717, and this composograph of reproduction display, but, sound is not carried out especially
Process, and during being repeatedly reproduced in photography in the sound that obtains.
It is determined that reproduce whether terminating(S718).In this step, determine whether to operate the reproduction in operating portion 59
Functional unit.In the case that this result of determination is not over for reproduction, return to step S717, proceed sequence photography again
Existing action.In the case that the result of determination of step S718 terminates, terminate the reproduction of sound and image for reproduction(S720).
Then, carry out synthesizing the documentation of dynamic image(S721).Here, generate synthesis in step S715~S718
The file of synthesis dynamic image.If for example this synthesis dynamic image file can be sent to other equipment, even shining
Outside transcriber beyond camera 60 is it is also possible to equally carry out image reproducing.
As described above, in the present embodiment, setting extract from photographss with respect to benchmark image according to
The image change extraction unit 55 of the image of the part of secondary change and synthesize successively on benchmark image changing unit image conjunction
Become control unit 57.Therefore, it is possible to reproduce the image that also can be suitable for being reproduced using television set etc. with shirtsleeve operation.And
And, with respect to the completeness of still image, add the change as dynamic image and shown, so, in the degree of stability of composition
Aspect, can create an aesthetic feeling earth's surface current between movement, using the teaching of the invention it is possible to provide the image that can be appreciated calmly.
In addition, in the present embodiment, it is the image completing in moment as still image, but additional wind is micro-
The change of the light such as the glittering of the light that micro- shake, reflexion of wave cause, spectacular sign signal or Christmas tree is so that rich become
The image reproducing changed is possibly realized.
In addition, in the present embodiment, using the image of initial moment as benchmark image(Representative image)But,
Certainly, if there is more stable image in photography midway, can also be as representative image.In addition, be set to extract becoming
Change the situation to bright direction change for the part, but not limited to this are it is also possible to using the part to dark direction change as change section
Point.In addition, for changing unit it is also possible to consider the process of also change color etc. in addition to brightness adds, thus, it is possible in nature
On the basis of add surreal sensation.
In addition, in the present embodiment, dynamic image in record portion 53 for the usage record, is representing extraction unit 54, figure
Carry out image procossing as in change detection portion 55, synthesis control unit 57, but, this image procossing is not limited to record in record portion 53
In dynamic image naturally it is also possible to carry out from the view data of dynamic image of photography portion 52 output using before photography.
In addition, in the present embodiment, photographing unit 60 is photographed, and, also as image-reproducing means function,
But not limited to this, for example, it is also possible to will be installed on personal computer by the view data that photographing unit 60 is continuously shot, according to
Image after this image data extraction change section, reproduction display and benchmark image synthesis.
In the embodiments of the present invention, the view data of chronophotography image, from the view data that this is recorded
Extract characteristic point, so that extracted characteristic point is changed in the way of dynamic image, view data is carried out with image and synthesizes simultaneously
Display.Therefore, it is possible to be now able to again be suitable for use with the image that television set etc. is appreciated with shirtsleeve operation.In addition,
In the embodiments of the present invention, when extracting characteristic point, become clear than surrounding in the changing unit of extraction dynamic image, still image
Part, but not limited to this, for example can also be using other extracting method such as part extracting color change.
In addition, in the embodiments of the present invention, when being changed in the way of dynamic image, extracting only from dynamic image
Changing unit, it is synthesized with benchmark image, or the part becoming clear than surrounding in still image is amplified and closes
Become, but not limited to this are it is also possible to change selected section successively in the way of dynamic image, or it is also possible to dynamic using selecting
The part that becomes clear than surrounding in state image is simultaneously amplified the various method such as this part, is changed in the way of dynamic image.
In addition, in the embodiments of the present invention, being photographed using photographing unit 60,10, by this photographing unit 60,10 with
Outside television set 70,20 etc. connects, and is used as image-reproducing means, but not limited to this, for example, it is also possible to
To be installed on personal computer etc. by the view data that photographing unit 60,10 shoots, according to this view data come composograph, profit
With display devices such as the display part of personal computer or external television come the image after reproduction display synthesis.
In addition, in the embodiments of the present invention, as used equipment again, being said using digital camera
Bright, but, as photographing unit, can be digital single-lens reflex camera or compact digital photographing unit, can also be shooting
The special camera of this dynamic image of mechanical, electrical shadow photographing unit, furthermore, it is also possible to be portable phone, portable information terminal
(PDA:Personal Digital Assist)Deng in built-in photographing unit.In any case, as long as static map can be reproduced
The equipment of the image of the sequence photography such as picture and dynamic image, continuous shooting.
The invention is not restricted to above-mentioned embodiment, can be to structure in the range of without departing from its purport in implementation phase
Key element is deformed and is embodied.In addition, appropriately combined by the multiple structural elements disclosed in above-mentioned embodiment, can
Form various inventions.For example, it is possible to delete several structural elements all structural elements shown in from embodiment.In addition, also
Can be with the structural element in appropriately combined different embodiments.