CN101909153B - Photographic device, photographic method and reproducing method - Google Patents

Photographic device, photographic method and reproducing method Download PDF

Info

Publication number
CN101909153B
CN101909153B CN 201010196395 CN201010196395A CN101909153B CN 101909153 B CN101909153 B CN 101909153B CN 201010196395 CN201010196395 CN 201010196395 CN 201010196395 A CN201010196395 A CN 201010196395A CN 101909153 B CN101909153 B CN 101909153B
Authority
CN
China
Prior art keywords
image
mentioned
section
cycle
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN 201010196395
Other languages
Chinese (zh)
Other versions
CN101909153A (en
Inventor
高桥薰示
谷宪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Olympus Corp
Original Assignee
Olympus Imaging Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Olympus Imaging Corp filed Critical Olympus Imaging Corp
Publication of CN101909153A publication Critical patent/CN101909153A/en
Application granted granted Critical
Publication of CN101909153B publication Critical patent/CN101909153B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention provides a photographic device, photographic method and reproducing method, which can not only enjoy pictures of still images but also can film the picture image that has taste movement interest and lapse of time. The inventive photographic device has a camera shooting part 2 that can film the image of the object and output image in sequence; an image variation extracting part 5 comparing the image data output in sequence and extracting the variation part (flag 23); a cycle detection part 5a detecting the variation period of the variation part extracted from the image variation extracting part 5; and a recording part 6, recording image data homologous to one period detected by the cycle detection part 5a as continuance images, and recording as still images based on the image data output from the camera shooting part 2.

Description

Camera, method for imaging and reproducting method
Technical field
The present invention relates to digital camera, video camera, with the cameras such as mobile phone of camera, specifically, though yet relate to and can reproduce camera, method for imaging and the reproducting method that shows for the background of rest image perseveration.
Background technology
The present invention requires the priority of the Japanese patent application submitted to Japan on June 2nd, 2009 2009-132727 number.The application quotes its content for your guidance clearly.Scope of the present invention is not subjected to the restriction of any requirement of the embodiment described in specification.
In the past, usually photograph image is printed on the paper and appreciates.But what popularized in recent years is to reproduce the demonstration image at electronic display units such as personal computer and television sets to appreciate.Appreciating in the situation of photograph image by this electronic display unit, only with the rest image of the conclusive moment that often photographs all the time, can feel the deficiency that shows.Yet, if the dynamic image of taking by video camera etc. exists and expends situation and the concentrated force of appreciation time and restricted, be not to think to appreciate all the time dynamic image.
Dynamic image as appreciating at personal computer has screen protection etc.A kind of screen protection manufacturing system of making screen protection as the basis take the captured video image of individual is for example disclosed in No. 3826073 communiques of Japan Patent (below be referred to as patent documentation 1).This screen protection manufacturing system can be isolated main subject and background from dynamic image, simpler production goes out the screen protection that main subject moves around in the picture of fixed background.
Disclosed screen protection manufacturing system is made the image that main subject moves around for separating of main subject and background in the above-mentioned patent documentation 1, but is not to be the technology compatible with existing photo culture.That is to say, though can enjoy variation, photograph image can't carefully be appreciated.
Summary of the invention
The present invention In view of the foregoing finishes, its purpose is to provide a kind of not only can appreciate the rest image photo, can also take and can feel to move camera, method for imaging and the reproducting method correspondingly of photograph image of interesting and passage of time.
The camera that the present invention relates to has: image pickup part, and it takes shot object image; The image comparing section, the image that it relatively obtains from above-mentioned image pickup part in a plurality of timings; And recording image section, its above-mentioned image comparing section to temporary transient storage the 1st regularly image with regularly begin through in the consistent situation of the comparative result that compares of the image regularly of the 2nd after the scheduled time from the above-mentioned the 1st, record a series of images that is timed to the 2nd timing from the above-mentioned the 1st.
In addition, the camera that the present invention relates to has: image pickup part, and it takes shot object image, and output image data successively; The image change extraction unit, the above-mentioned view data that it is exported is more successively extracted change section; Cycle detection section, it detects the cycle of the variation of the above-mentioned change section that is extracted by above-mentioned image change extraction unit; And record section, its above-mentioned Imagery Data Recording that will be equivalent to the one-period that detected by above-mentioned cycle detection section is consecutive image, and is recorded as rest image according to the view data from above-mentioned image pickup part output.
In addition, in the method for imaging that the present invention relates to, have following steps: take shot object image, and output image data successively; The more above-mentioned view data of output extracts change section; The one-period of the variation of the above-mentioned change section that the detection said extracted goes out; The above-mentioned Imagery Data Recording that will be equivalent to detected above-mentioned one-period is consecutive image, and is rest image with above-mentioned Imagery Data Recording.
In addition, in the reproducting method that the present invention relates to, have following steps: the view data of storing static image and when the background subject changes, will be equivalent to the view data of one-period and the view data that above-mentioned rest image associates the dynamic image of record; The above-mentioned view data of above-mentioned background the subject part that changes and the above-mentioned rest image of storing is synthetic; Show above-mentioned synthetic image.
According to the present invention, can provide a kind of and not only can appreciate the rest image photo, can also take and can feel to move camera, method for imaging and the reproducting method correspondingly of photograph image of interesting and passage of time.
Description of drawings
Fig. 1 is the block diagram that the camera circuitry that relates to of expression one embodiment of the present invention consists of.
Fig. 2 is illustrated in the camera that one embodiment of the present invention relates to the figure of the relation between captured consecutive image and the image that reproduces.
Fig. 3 is the flow chart of the camera control action in expression one embodiment of the present invention.
Fig. 4 is that the periodogram of the camera in expression one embodiment of the present invention is as the flow chart of acts of determination.
Fig. 5 is that the periodogram of the camera in expression one embodiment of the present invention is as the flow chart of acts of determination.
Fig. 6 is that the periodogram of the camera in expression one embodiment of the present invention is as the flow chart of acts of determination.
Fig. 7 is in expression one embodiment of the present invention, the figure of the picture in the situation that the residing background of ship that moves to the other end from picture one end is taken.
Fig. 8 is in expression one embodiment of the present invention, the figure of the picture in the situation that the residing background of the flag that repeats same action is taken.
Fig. 9 is in expression one embodiment of the present invention, the figure of the picture in the situation that the sight that lets off fireworks in the background is taken.
Figure 10 is the flow chart of the action of the camera reproduction mode in expression an embodiment of the invention.
Figure 11 is the figure that reproduces the situation of photographs in expression an embodiment of the invention.
Figure 12 is the variation of one embodiment of the present invention, is the figure that takes a decision as to whether the situation of periodogram picture and demonstration outside being illustrated in when photographing.
Figure 13 is that expression is for the flow chart of the action of the cycle image inspection of the variation of carrying out one embodiment of the present invention.
Embodiment
Below, according to accompanying drawing, use and used camera explanation preferred implementation of the present invention.Fig. 1 is the block diagram of the circuit of the camera 10 that relates to of expression one embodiment of the present invention.Camera 10 is digital cameras, is made of control part 1, image pickup part 2, the 2a of face detection section, image processing part 3, flash memory 4, image change extraction unit 5, record section 6, synthetic control part 7, display part 8, operating portion 9 etc.
Control part 1 is controlled the whole sequence of camera 10 according to the program in the flash memory 4 of being stored in.Image pickup part 2 comprises the driving of the exposure control parts such as phtographic lens with zoom function, shutter, imaging apparatus, imaging apparatus and reading circuit etc., will be converted to view data by the shot object image that phtographic lens forms and with its output by imaging apparatus.Image processing part 3 is taken into from the picture signal of image pickup part 2 outputs, carry out the interval and reject to process, cut the various images such as processings, edge are emphasized, color correction, image compression and process, and carry out showing, be used for to record section 6 records, be used for reproducing the image processing that shows etc. for live view.
The 2a of face detection section obtains view data from image processing part 3, whether comprises character facial in the process decision chart picture, detects its position and size etc. in situation about comprising.Image Change Detection section 5 has the temporary transient storage part of temporary transient storage usefulness, obtains view data from image processing part 3, temporarily stores this view data in predetermined timing, moves by it being compared to determine whether exist.Therefore, Image Change Detection section 5 performance is as the effect of such image comparing section: the image of relatively obtaining from above-mentioned image pickup part in a plurality of timings.
In addition, in image change extraction unit 5, be provided with the 5a of cycle detection section.In the situation that is dynamic image, and in the variation of this part with action, there are starting point and terminal point and repeat in the situation of this action the 5a of cycle detection section sense cycle.Can take out the periodogram picture that is equivalent to one-period by the 5a of cycle detection section.And, obtain periodogram as the time, according to the face location information in the picture that is detected by the 2a of face detection section, detect the periodogram picture in the place leave face location.And image change extraction unit 5 and the 5a of cycle detection section both can consist of with hardware, can be processed to realize by software by control part 1 again.
Operating portion 9 comprises the various functional units such as release-push, mains switch, reproduction mode setting button, menu button, and it judges the mode of operation of these functional units, and result of determination is sent to control part 1.Above-mentioned control part 1 is according to the mode of operation of functional unit, the control of photographing and reproducing by predetermined sequence.
When having sent the photography indication by release-push, record section 6 records are obtained by image pickup part 2 and have been carried out the view data that compression is processed by image processing part 3.In addition, the dynamic image that is equivalent to one-period that temporarily is stored in the temporary transient storage part in the image change extraction unit 5 is recorded in record section 6 with rest image.In addition, the camera positions information of the photography date temporal information of never illustrated clock and watch section output, the never output such as illustrated GPS and view data associate and are recorded.These camera positions information and photography date temporal information can be utilized when image arrangement and image retrieval.Flash memory 4 is nonvolatile memories of can electricity rewriting, the program that storage is processed by image and control part 1 is carried out, the also various data such as storage adjustment data.And, so long as the memory of energy storage program etc. gets final product, can adopt the memory outside the flash memory.
The periodogram of the dynamic image that obtains in the lump when synthesizing the view data of the rest image of obtaining and be recorded in record section 6 when control part 7 will operate the release-pushes in the operating portion 9 and obtaining this rest image looks like to synthesize.The periodogram of dynamic image similarly is the image that is extracted by above-mentioned image change extraction unit 5 and the 5a of cycle detection section.The synthetic of rest image and periodogram picture is to carry out according to the face location information in the picture of being obtained by the 2a of face detection section.And synthetic control part 7 both can consist of by hardware, can be processed to realize by software by control part 1 again.
Display part 8 has the display parts such as the liquid crystal panel the back side that is disposed at camera 10 etc. located and organic EL panel, the common reproduction demonstration of the image that the live view before photographing shows, record is complete, the demonstration of camera information etc.The cameraman observes live view and shows, can determine composition and timing.In addition, display part 8 carries out also that periodogram with dynamic image looks like to be synthesized in the rest image and the reproduction of the image that obtains shows.
Then, use Fig. 2 illustrate rest image and dynamic image in the present embodiment photography and these images are synthetic after the reproduction of composograph show.Image when the image when Fig. 2 (a)~(c) is photography, Fig. 2 (d)~(f) are reproduction.
During photography, the cameraman is waiting for camera 10 that in order to photograph in the best timing of the expression of main subject 21 shutter regularly under the state of main subject 21.Among Fig. 2 (a) and Fig. 2 (b), the expression of main subject 21 is abundant not, and the expression of main subject 21 is fine among Fig. 2 (c), thereby the cameraman is recorded in record section 6 at this fixed cycle operator release-push with rest image.In addition, shown in Fig. 2 (a), (b), before the record rest image, begin to detect by pre-shooting (Pre-Capture) action cycle of the flag 23 that is in the background, the dynamic image that will be equivalent to one-period temporarily is stored in the temporary transient storage part in the image change extraction unit 5, and the dynamic image that will be equivalent to one-period when the record rest image is stored in record section 6.
When reproducing, the expression of main subject 21 is best is the captured rest image of timing at Fig. 2 (c), therefore reproduces to show this rest image.Yet, only be that the words of rest image can not be satisfied with appreciation.So, when the reproduction of present embodiment, show behind the dynamic image that is equivalent to one-period of the flag 23 of synthesis cycle motion.Namely, shown in Fig. 2 (d)~(f), main subject 21 is the captured rest images of timing at Fig. 2 (c), for the flag 23 that is in the background, then the synthetic dynamic image that is stored between Fig. 2 (a)~(c) repeatedly reproduces demonstration.
As above, in the reproduction of present embodiment, about face, show the result who captures the best smile of main subject 21 and take, for landscape, then periodically change in the dynamic image mode.And owing to caught cyclic variation, so Fig. 2 (d) and Fig. 2 (f) are identical image.Thereby repeat identical variation, can not feel to be discord even if stop somewhere reproducing yet.Although be the image of inactive basically, becoming a kind of can from the circulative dynamic image performance of any timing watching, be a kind of image with sensation time lapse.
Then, use the action of the camera 10 that flowchart text present embodiment shown in Figure 3 relates to.This flow chart and flow chart described later are to be carried out according to the program that is stored in flash memory 4 by control part 1.When starting when camera 10 power turn-ons, begin flow process shown in Figure 3.Once you begin, then at first whether to be the judgement (S1) of photograph mode.This camera 10 possesses photograph mode and reproduction mode, judges cameraman's model selection state by operating portion 9.
Whether the result of determination in step S1 is the judgement (S21) of reproduction mode then for being not in the situation of photograph mode.Result in this judgement neither return step S1 under the situation of reproduction mode.On the other hand, in the situation that is reproduction mode, then carry out the reproduction (S22) of photographs.In this step, from the photographs that is recorded in record section 6, select photographs and reproduce demonstration at display part 8 according to user's selection.When reproducing demonstration, record in the situation of cycle dynamic image having taken in the lump rest image and dynamic image (consecutive image), then use the demonstration of the composograph of Fig. 2 (d)~(f) explanation.The back will use Figure 10 to narrate the details of this reproduction mode.After finishing the reproduction of photographs, return step S1.
Result of determination in step S1 is to be in the situation of photograph mode, then whether has carried out the judgement (S2) of releasing operation.At this moment, whether operating portion 9 is supressed release-push fully and has been carried out the judgement of releasing operation.There is the repetitive operation of using Fig. 2 explanation in this result who judges as not carrying out in the situation of releasing operation, in step S11~S19, determining whether, exists in the situation of repetitive operation, obtain to be equivalent in the lump the dynamic image of this one-period.
Do not carrying out in the situation of releasing operation, at first beginning sequence photography (S11).The view data of the dynamic image (consecutive image) that will obtain this moment by image pickup part 2 temporarily is stored in the temporary transient storage part in the image change extraction unit 5.In addition, according to view data, show at display part 8 beginning live views.And, capacity as the temporary transient storage part that is used for temporarily storing, as long as greater than the capacity of the view data of setting as periodogram picture described later, when the view data of this temporary transient storage surpasses this capacity, from old view data, delete successively.
After in step S11, having begun sequence photography, then carry out face detection, AE (automatic exposure) and AF (auto-focus adjusting) (S12).In this step, according to the view data that is obtained by image pickup part 2, determine whether to have face by the 2a of face detection section, have in the situation of face its position of detection etc.In addition, obtain subject brightness according to view data, carry out the control of iso sensitivity etc. so that on display part 8, show with correct exposure; And the controlling value of computing shutter and aperture etc. makes it possible to the correct exposure recording image data.And then, carry out the focusing of phtographic lens so that the high fdrequency component of view data is in peak value.
After having carried out face detection, AE, AF, next whether change in the process decision chart picture part (S13).At this moment, by the dynamic image of the relatively more temporary transient storage of image change extraction unit 5, whether change in the part of judgement dynamic image.If this result who judges then returns step S1 as not changing.On the other hand, in situation about changing, judge whether this variation has left face (S14).The positional information of the face location information that is relatively determined by the 2a of face detection section at this moment, and the change section that detected by image change extraction unit 5 is judged.
Result of determination in step S14 is returned step S1 for not leave in the situation of face.This be because: face is that the possibility of main subject rather than background is higher.Also because: if there is change section near the face, it is synthetic then to be difficult to carry out image.On the other hand, in part the situation near face of the result who judges as variation, then carry out cycle spectral discrimination (S15).This moment as above-mentioned flag 23, the cycle of the action body by the variation of the 5a of cycle detection section determination cycles.The back will use Fig. 4 to Fig. 6 to narrate the details of this cycle spectral discrimination.
After the judgement of having carried out the periodogram picture, whether be the judgement (S16) of cycle background then.At this moment, according to the result of the cycle spectral discrimination among the step S15, whether be the judgement of carrying out periodically variable background image.As not being in the situation of cycle background, return step S1 in this result who judges.On the other hand, in the situation that is the cycle background, record period data (S17).In this step, the view data that is equivalent to one-period in the dynamic image (consecutive image) that will begin in step S11, that judge in step S15 temporarily is stored in the temporary transient storage part in the image change extraction unit 5 as the periodogram picture.
After in step S17, having carried out the record of cycle data, then whether there is the judgement (S 18) of previous image.Judge that as periodogram similarly be the no image that is recorded in the temporary transient storage part in the image change extraction unit 5 that has herein.Be not have to return step S1 in the situation of previous image in this result of determination.On the other hand, when having previous image, then remove this image (S19) in result of determination, return step S1.Because there is boundary in the memory capacity of periodogram picture, thereby deletes old view data.
Result of determination in step S2 is to have carried out in the situation of releasing operation, and (S3) then photographs.In photography, in step S12, control these elements according to exposure control values such as the shutter that calculates in advance and apertures, compress processing by the view data of the rest image obtained by image pickup part 2 image processing part 3 pairs of at this moment and wait image to process.And, in step S12, carrying out AE, AF, the exposure control value that obtain this moment and the focal position of phtographic lens can not changed in periodogram looks like to obtain.Therefore, as long as use expression to be in the mark of periodogram in looking like to obtain.After having carried out photography, next whether has the judgement (S4) of cycle data.Judge in step S17 the temporary transient storage part that whether cycle data temporarily is stored in the image change extraction unit 5 herein.
Result of determination in step S4 is to have in the situation of cycle data, then carries out composition and whether does not have vicissitudinous judgement (S5).Shown in Fig. 2 (a)~(c), judge whether main subject 21 any motion does not occur herein.Be in the situation about not changing in the composition in this result of determination, then photographs carried out the association (S6) of cycle data dynamic image.The view data of the rest image of obtaining in step S3 and the up-to-date cycle dynamic image of temporary transient storage in step S17 are associated herein.
When photographs and cycle data dynamic image are associated, perhaps the result of determination in step S4 or step S5 is in the no situation, to record (S7).Under the result of determination at step S4, S5 is no situation, only record the view data of rest image; And, in step S6, to have carried out in the situation of association of data, the view data of the dynamic image that will associate with the view data of rest image is recorded to record section 6 in the lump.
As above, in the present embodiment, for photograph mode the time, whether be the judgement of periodogram picture, in the situation that is the periodogram picture, then when taking rest image, also periodogram is looked like to associate the record section 6 that is recorded to.Then, when reproducing, shown in Fig. 2 (d)~(f), dynamic image is synthesized in rest image, main subject 21 shows with best expression, and background then shows with the image that moves.
Then, use Fig. 4 to the action of the cycle spectral discrimination of flowchart text step S15 shown in Figure 6.This periodogram as determination flow in, except using Fig. 2 background subject illustrated, that repeat same action (to be flag 23 in the example of Fig. 2 and Fig. 8, below be referred to as pattern A) outside, also judge from picture one end and move to the background subjects that disappear after the background subject (for example ship 25 shown in Figure 7 below is referred to as pattern B) of the other end and pyrotechnics as shown in Figure 9 27 occur like that (below be referred to as pattern C) in picture.
In the flow process of cycle spectral discrimination, the background subject of pattern A shown in Figure 8 (for example flag 23) is judged as no in step S101, determination cycles after step S201.In addition, the background subject of pattern B shown in Figure 7 (for example ship 25) is judged as in step S101 and is, and is judged as in step S105 and is, determination cycles after step S106.And then the background subject of pattern C shown in Figure 9 (for example pyrotechnics 27) is judged as in step S101 and is, in step S105, be judged as no, and after the step S301 determination cycles.
After entering into the flow process of periodogram picture shown in Figure 4, whether there is the judgement (S101) of nonmotile image.Judge the background subject that whether has motion in the picture by image change extraction unit 5 herein.This result who judges as the situation that has the background subject that as Fig. 2 and flag 23 shown in Figure 8, has motion under, begin most image with the predetermined timing such as last as temporary transient memory image IM01 with what be judged to be when motion, temporarily be stored in the interior temporary transient storage part (S201 of Fig. 5) of image change extraction unit 5.Next, the timing T01 with this moment is recorded in temporary transient storage part (S202).
If in step S201 and S202, stored image and timing, then next kept warning (S203) at display part 8.Owing to temporarily stored the candidate of periodogram picture, thereby kept warning so that the cameraman firmly maintains camera 10 during this.Then, judge after the temporary transient storage that has begun image, whether to have passed through 2 seconds (S204).Carry out the whether vicissitudinous judgement of tool (S211) of composition during this.Judge by image change extraction unit 5 whether the part except the motion parts that determines moves in step S101, and whether composition occurs changing herein.And, except image change extraction unit 5, can also setting example such as hand tremble test section etc., judge whether camera 10 mobile.
Do not change if the result of determination among the step S211 is composition, then return step S204.On the other hand, in the situation that the result who judges changes as composition, even if in fact may become the periodogram picture, but the cameraman has changed composition, or the figure action of subject and can't to carry out image synthetic, therefore can only be not with it as periodogram picture (S212), return former flow process.And, though whether in step S204, carried out judgement through 2 seconds, these 2 seconds only be for example expression.As described later, after 2 seconds, record temporary transient memory image IM02, this be because: this flag 23 may not carry out same action all the time very regularly, sometimes also can carry out irregular action, thereby need to consider the situation of the shape that can't turn back to the flag 23 identical with the temporary transient memory image IM01 that in step S201, obtains, the temporary transient memory image IM02 of preparation property ground record.Therefore from this viewpoint, also can suitably change 2 seconds among the step S204.
If the result of determination among the step S204 for passing through 2 seconds, then is recorded in temporary transient storage part (S205) with image at this moment as temporary transient memory image IM02, timing T02 at this moment is recorded in temporary transient storage part (S206).Then, according to the record of the temporary transient memory image IM01 among the step S201, whether passed through 10 seconds judgement (S207).Herein, 10 seconds only is for example expression, is not limited to this time.In the present embodiment, whether judgement has with the wind the periodically subject of action of such the carrying out of the flag 23 that swings in background, and as this background, and all being not suitable for of too fast or slow motion appreciated as rest image, consider this point, should suitably determine the time.
Result of determination in step S207 is just through in during 10 seconds, similarly carries out whether vicissitudinous judgement (S213) of composition with step S211.In this result who judges when not having composition to change, the then next whether judgement (S221) identical with temporary transient memory image IM01 except face.At this moment, the 5a of cycle detection section by image change extraction unit 5 carries out the whether consistent judgement of temporary transient memory image IM01 and present image.If judge whether the part that is judged to be change section by image change extraction unit 5 is identical, then can judge rapidly.And, with except the face, be that the countenance of main subject 21 can change sometimes because as Fig. 2 (a)~(c) is illustrated why.
Result of determination in step S221 causes loop cycle to become in the situation of identical image for the variation owing to the periodicity image, record timing T1 (S222) at this moment, record period image and cycle data T01~T1 (S223).Because being judged as in step S221 in the identical image is the timing of having recorded the image that is equivalent to one-period, thereby the recording image that regularly is equivalent to one-period among T01~T1 is in temporary transient storage part, and the timing of one-period also is recorded in temporary transient storage part.After recording these images etc., return former flow process.
Whether the result of determination in step S221 has passed through 4 seconds judgement (S225) for not exist in the situation of the image identical with temporary transient memory image IM01.As under not having through 4 seconds situation, return step S207 in this result who judges.On the other hand, as having passed through in 4 seconds the situation, whether be the judgement (S231) of the image identical with IM02 in the result who judges except face., about determining whether through 4 seconds, from having stored temporary transient memory image IM01, recorded temporary transient memory image IM02 after 2 seconds herein, and from the judgement the step S221 through judging as (namely 2 seconds+2 seconds) after equally spaced 4 seconds.
In the situation of result of determination in step S231 for image not identical with IM02 except face, the part that is considered as changing does not become periodically identical shape, thereby returns step S207.On the other hand, when the result who judges becomes periodically identical shape as the part that changes, then except face, become the image identical with IM02, therefore next record the timing T1 (S232) of this moment.Be judged to be in step S231 in the identical image is exactly the timing that record is equivalent to the image of one-period, therefore the recording image that is equivalent to one-period among general's timing T02~T1 is in temporary transient storage part, and also the timing with one-period also is recorded in temporary transient storage part.After having recorded these images etc., return former flow process.
Result of determination in step S207 is to have passed through in 10 seconds the situation, and perhaps the result of determination among the step S213 is considered as not being periodogram picture (S208) in the situation that composition occurs changes, and returns former flow process.For taking a decision as to whether the periodogram picture more than 10 seconds, if then can affect appreciation owing to the cycle is long, and cameraman can't change composition during this, so has unreasonable part on the method.Though be the periodogram picture, yet the cameraman also is difficult to lasting identical attitude, it is impossible that determination cycles can be considered to.But, fixedly in the situation of camera, also can wait for the longer time (more than 10 seconds) by tripod.This be because: in the situation about in composition, changing, can't obtain rest image in the present embodiment and the composograph of dynamic image (consecutive image).As having the such motion of flag 23, also can after step S201, temporarily store in the situation of periodogram picture, when next carrying out the judgement among the step S101, mark is set to enter into step S201.
Result of determination in the step S101 of Fig. 4 records nonmotile image (dynamic image) (S102) in the situation that does not have motion.Shown in Fig. 7 (a) and Fig. 9 (a), nonmotile image refers to not have the situation of the subject that moves in background.In these situations, as described later, taking dynamic image (consecutive image) afterwards, can in background, show the subject that moves, and in moment of execution in step S102, because this subject that moves is not present in the background, thereby the result of determination among the step S101 is yes.
If in step S102, recorded nonmotile image, then next record the timing T0 (S103) of nonmotile image.Then carry out the judgement (S104) of the direction of motion.As mentioned above, even if not motion when in step S102, processing, but in the example of Fig. 7 and Fig. 9, in background, show the subject that moves, therefore in step S104, come the motion of analysis background according to the view data that within 2~3 second time, obtained, judge the direction of motion by image change extraction unit 5.
After the judgement of having carried out the direction of motion, next carry out the direction of motion whether from the judgement (S105) of picture end to end.Fig. 7 is the example of pattern B, and in this example, ship 25 moves to right-hand member from the picture left end, so the result of determination among the step S105 is yes.On the other hand, Fig. 9 is the example of pattern C, and in this example, pyrotechnics 27 rises from bottom to top on the picture right side, and the result of determination among the step S105 is no.
Result of determination in step S105 is in the situation that is, then computing arrives the time (S106) of end, waits for through this time that calculates (S107)., as shown in Figure 7, go out in the picture end in the situation of spot 25, according to the action variation of this ship 25, computing arrives the required time of the other end from an end herein.This is in order to prevent that error detection is that the periodogram picture finishes when ship 25 disappears to people owner's subject 21 behind.Taked until the state of Fig. 7 (c) is provided with the design of non-sensitive band.And, be made as the short time of time outline that arrives the end of comparing this operation time.Then, determine whether through the time (S107) of institute's computing.Do not have as the time in the situation of process in this result who judges, similarly keep warning (S108) with step S203.After having carried out keeping warning, return step S107.
Result of determination in step S107 is through when arriving time till the end, next again determines whether not motion (S111).Because the time of the arrival end that calculates among the step S106 is shortened slightly, therefore in step S107, be judged to be the moment of time process, might ship 25 motions.So, in step S111, determine whether to have motion.And the judgement that whether has motion is undertaken by image change extraction unit 5.
Result of determination in step S111 is to have in the situation of motion, take a decision as to whether from subject that motion is arranged (being ship 25 herein) occur beginning 1 second~30 seconds (S121) during.Here, 1 second~30 seconds be the imagination traveling time of the subject (being ship 25 herein) that in the background of rest image, moves to another end from an end, be set as reproducing and can not feel dull appropriate time when appreciating.This time only is to illustrate for example, can suitably change in this purport scope.
Result of determination in step S121 is not in 1 second~30 seconds the situation of scope, to be considered as not being periodogram picture (S122), returns former flow process.On the other hand, be in the result who judges in 1 second to 30 seconds the situation of scope, similarly keep warning (S123) with step S108.Whether the judgement (S124) of composition variation then, is similarly arranged with step S5, S211, S213.This result who judges as the situation that has composition to change under, be considered as not being periodogram picture (S122), return former flow process.On the other hand, if there is not composition to change, then return step S111.
Result of determination in step S111 is in the situation of again not moving, and records this timing T1 (S112), and record period image and cycle data T0~T1 (S113).From the timing T0 that begins to record nonmotile image to again become nonmotile timing T1 during be exactly the subject of the backgrounds such as ship 25 moves to the other end from an end time.So be equivalent to the image of one-period among recording timing T0~T1, also record in the lump the timing of one-period.If recorded these images etc., then returned former flow process.As having the such motion of ship 25, also can after step S105, temporarily store in the situation of periodogram picture, when next carrying out the judgement among step S101 and the S105, mark is set to enter into step S106.
Result of determination in step S105 is that the direction of motion is not in the situation of picture end to end, and the possibility that belongs to pyrotechnics 27 shown in Figure 9 is higher.Therefore, after step S301 (Fig. 6), carry out the shooting of dynamic image (consecutive image), until there is not again motion.At first, carry out whether without the again judgement (S301) of motion.Judge that by image change extraction unit 5 state whether pyrotechnics 27 pass through Fig. 9 (b)~(d) disappears herein.
Result of determination in step S301 is in the situation that motion occurs, determine whether be during 10 seconds in (S311).During take a decision as to whether that the dynamic image that begins to record nonmotile image in step S102 rises herein, 10 seconds.As having passed through in 10 seconds the situation, be considered as not being periodogram picture (S312) in this result who judges, return former flow process.And in the present embodiment, the time of judging in step S311 is 10 seconds, yet is not limited to this, for the periodogram picture of pyrotechnics 27 grades, so long as the time of proper range get final product.
Result of determination in step S311 is in 10 seconds the time, similarly keeps warning (S313) with step S108, S123, S203.Then, determined whether similarly that with step S124, S213 composition changes (S314).When not having composition to change, then return step S301 in this result of determination.On the other hand, be to have in the situation of composition variation in result of determination, determine whether through 3 seconds (S315).Herein, determine whether from begin the step S102 to record without the dynamic image of moving image through 3 seconds.
Result of determination in step S315 for occur composition change be 3 seconds through before situation under change owing to produce composition, not too suitable for image is synthetic, thereby return former flow process.And the result who judges then jumps to step S302 as after having passed through 3 seconds.In this case, have and to carry out the synthetic possibility of image.Passed through 3 seconds if the moment of composition variation occurs, then can think the situation that pyrotechnics 27 is lighted, also can synthesize the record of dwelling period image in order to adopt this image even if composition changes.If the ship that in picture, passes through 25 on the way disappear fall can be very nature, yet in the such situation of pyrotechnics 27, also can be natural even if begin to be returned to the state of Fig. 9 (a) from the state of Fig. 9 (c), (d).So in the present embodiment, in the situation that has composition to change, if from the dynamic image (sequence photography) that begins to record nonmotile image, passed through 3 seconds, namely can be used as periodogram and look like to process.
Result of determination in step S301 is in the situation about not moving, and perhaps passed through in step S315 in 3 seconds the situation, records this timing T1 (S302), and record period image and cycle data T01~T1 (S303).From beginning to record nonmotile image the step S102, in the moment that motion disappears again, record is equivalent to the image of one-period.So, will be equivalent to the temporary transient storage part of recording image in image change extraction unit 5 of one-period among timing T01~T1, also record in the lump the timing of one-period.Return former flow process after having recorded these images etc.
As above, in the sub-process of cycle spectral discrimination in the present embodiment, for flag 23 (pattern A) like that picture than close limit in the background subject, ship 25 (pattern B) of repetitive operation move to the like that background subject that a bit manifests and disappear at other points in picture of the background subject of the other end and pyrotechnics 27 (pattern C) from picture one end like that, judge that each since the cycle of origin-to-destination, looks like to come record with the image during this as periodogram.And, in the present embodiment, it is whole to have recorded view data during the record period image, and because personage's part (main subject 21), because the possibility of motion is higher in during this period, therefore also can in the scenes such as flag 23 and pyrotechnics 27, only record the image of the change section of synthetic usefulness.
Then, use the reproduction of the captured periodogram picture of camera in the flowchart text present embodiment shown in Figure 10 10.The flow process of this reproduction mode is to carry out in the step S22 of Fig. 3.In the reproduction mode of step S22, also reproduce the common rest image that does not have the synthesis cycle image, and in Figure 10, illustrate that the reproduction of the composograph that has synthesized the periodogram picture in rest image shows.
After entering the flow process of reproduction mode, at first carry out the selection (S401) of reproduced image.Herein, with the reproduction of common rest image similarly, operating portion 9 operated and select among the photographs that thumbnail shows from having carried out by the user.After having carried out the selection of reproduced image, the image of compare cycle data T0~T1 (S402) next., read regularly the dynamic image (consecutive image) of T0~T1 during this from record section 6 herein, the view data of relatively reading, thus determine whether and have motion parts.
Next, the part with motion (S403) of judgement except face.Judge that the part have motion as above-mentioned flag 23, ship 25, pyrotechnics 27 is positioned at the position where of picture herein.For example example shown in Figure 11 is the consecutive image of having taken main subject 21 take pyrotechnics 27 as background, and Figure 11 (d) is rest image.In step S403, by comparing Figure 11 (a)~(d), pyrotechnics 27 is to have the part of motion except face thereby determine.And if detected face by the 2a of face detection section, and photography the time recorded face location, also can use this information.
If in step S403, determine the part with motion, then next divide face and have boundary (S404) between the part of motion.In example shown in Figure 11, between the face location of main subject 21 and pyrotechnics 27, determine boundary line 29.This boundary line 29 is straight line in example shown in Figure 11, and different according to the shape of the background subject of subject and motion, also can be curve.
Determined boundary in step S404 after, next, with respect to face, dynamic image (S405) is adopted in the boundary outside.Herein, with respect to face, the dynamic image (consecutive image) of taking during adopting from timing T0 to T1 to the image in 29 outsides, boundary line.Then, with respect to face, the inboard rest image (S406) that adopts of boundary.With respect to face, the image of 29 inboards, boundary line is adopted the rest image (corresponding with Figure 11 (d)) of in step S3, taking herein.
Then, dynamic image and the rest image that adopts synthesized and shows (S407).Herein, 29 are the boundary take the boundary line, and it is synthetic that the dynamic image (consecutive image) that adopts in step S405 and the rest image that adopts in step S406 are carried out image, shows at display part 8.Repeatedly show Figure 11 (a)~Figure 11 (d) until indicated end of reproduction to show.Therefore, main subject 21 is taken with rest image and shows, and shows the image with motion of pyrotechnics 27 till occur disappearing in background.And, in the present embodiment, as shown in figure 11, between the background subject of face and movement, get the boundary line and come synthesized still image and dynamic image, yet also can cut image along the profile of rest image or dynamic image, carry out image and synthesize.
And, in an embodiment of the invention, taking the advance record of Mobile state image (consecutive image) of rest image, can certainly after taking rest image, record dynamic image, perhaps at the forward and backward record dynamic image of taking rest image.
Then, use Figure 12 and Figure 13 that the variation of one embodiment of the present invention is described.In an embodiment of the invention, the cycle of carrying out when taking rest image is judged, also records in the lump the dynamic image (consecutive image) that is equivalent to one-period.In this variation, if the cameraman has touched the part of wishing to be recorded as the periodogram picture before taking rest image, then take a decision as to whether cyclic variation, carrying out in the periodically variable situation the pre-recorded dynamic image that is equivalent to one-period.
Figure 12 is the figure of situation of the periodogram picture of pre-recorded variation of expression.The cameraman touches the part of wishing that the cycle of carrying out is judged from live view is shown in subject landscape 31 on the display part 8 of camera 10.In the example of Figure 12, if touched flag 23, the touch panel (not shown) that then is disposed at display part 8 front surfaces can detect touch location, by the 5a of the cycle detection section sense cycle of image change extraction unit 5.If detect the cycle this moment, then show that in the cycle of display part 8 8a shows, and according to the cycle that detects, the dynamic image of recording section image 33 (consecutive image).
The action of this variation then, is described as check process according to periodogram shown in Figure 13.Align in the situation of carrying out periodically variable part record period image in hope, the cameraman can touch this part, therefore, at first carries out judgement and the record (S501) of the image of specifying part., judge that by touch panel which position is touched herein, and determining in the situation about being touched, record view data at this moment.
Then, while follow the tracks of the cycle (S502) of the image change of judging specifying part., follow the trail of the motion by the specifying part of step S401 appointment herein, by judging cycle of this specifying part with the similar mode of cycle spectral discrimination of Fig. 4 to Fig. 6 explanation.After having carried out the cycle judgement, then at display part display cycle (S503).Herein, as shown in figure 12, the cycle that will obtain in step S502 showed 8a and is shown in display part 8 as the cycle.
Next, carry out synthetic (S504) of subject photography and record period section.The photography of subject is the photography of carrying out rest image in the situation of supressing release-push fully, after having taken rest image, from the dynamic image that among step S501, records, choose the dynamic image (consecutive image) that is equivalent to one-period, similarly carry out image with one embodiment of the present invention and synthesize.
In judging in the cycle of the flow process of present embodiment, the partial periodicity of detection unit partial image 33, and recording section image 33 only are even 21 motions of therefore main subject are also no problem.When the cycle judges that rear main subject 21 is posed, if carry out the photography of rest image, then can concentrate on the photography of main subject 21.Owing to when touching parts of images 33, recorded the periodogram picture, therefore only this part is synthesized in rest image, just can obtain the composograph of background parts motion.
In this variation, even if background has car by also not exerting an influence, can only waving of flag 23 be synthesized in the background of personage's (main subject 21), can reduce failed probability, can also save invalid detection action.And, tremble even if when detecting the cycle of flag 23, produced hand, but as long as flag 23 enters in the picture, use after then only pruning the parts of images of this flag 23, can not trembled by hand and obtain the periodogram picture with affecting.For example under situation shown in Figure 8, tremble owing to hand in the situation about changing in the position of flag 23, by changing the position that cuts in the picture, can obtain the correct periodogram picture of flag 23.As above, will cut the periodogram picture (dynamic image) of obtaining the position by switching and synthesize on rest image, thereby can obtain simply the only rest image of the part motion of background.
As above illustrated, in an embodiment of the invention and variation, the movement images data are extracted change section, are equivalent to dynamic image (consecutive image) and the rest image of one-period in the change section that record extracts.Therefore, singly not a kind of rest image, can also enjoy the rest image photo, and can take and can feel the interest of moving and the photograph image of passage of time.
In addition, in an embodiment of the invention, reproduce demonstration at camera 10, yet be not limited to this, also can reproduce photographic image data with personal computer etc.In this case, can record dynamic image (consecutive image) with rest image in camera 10, it is synthetic and it is reproduced show to carry out image in personal computer etc. relatedly.
And then, in an embodiment of the invention, use digital camera to be illustrated as the equipment that is used for photography, and also can be digital slr camera or portable digital camera as camera, it can also be the such dynamic image camera of video camera, video camera, and then also can be the camera that is built in mobile phone, personal digital assistant device (PDA:Personal Digital Assist, personal digital assistant), the game station etc.In any case, so long as can record the camera of the view data of dynamic image and rest image, just can use the present invention.
The present invention is not limited only to above-mentioned execution mode, the implementation phase can be in the scope that does not break away from its purport be out of shape inscape and it is specialized.In addition, by disclosed a plurality of inscapes in the above-mentioned execution mode of appropriate combination, can form various inventions.For example can delete certain several inscape in disclosed all inscapes in the execution mode.Inscape in the different execution modes of all right appropriate combination.

Claims (13)

1. camera, it has:
Image pickup part, it takes shot object image;
The image comparing section, the image that it relatively obtains from above-mentioned image pickup part in a plurality of timings; And
Recording image section, it is consistent situation in to the 1st regularly image of temporary transient storage with regularly beginning through the comparative result that the image regularly of the 2nd the scheduled time after compares from the above-mentioned the 1st in above-mentioned image comparing section, records a series of images that is timed to above-mentioned the 2nd timing from the above-mentioned the 1st.
2. camera according to claim 1, wherein, above-mentioned image comparing section relatively is equivalent to the part of the image in precalculated position in the picture.
3. camera according to claim 2, wherein,
Above-mentioned camera has the face detection section of detecting the character facial in the picture,
The part that is equivalent to the image in precalculated position in the picture that above-mentioned image comparing section is compared is the part except character facial in the above-mentioned picture.
4. camera, it has:
Image pickup part, it can take shot object image, and output image data successively;
The image change extraction unit, the above-mentioned view data that it is exported is more successively extracted change section;
Cycle detection section, it detects the cycle of the variation of the above-mentioned change section that is extracted by above-mentioned image change extraction unit; And
Record section, its above-mentioned Imagery Data Recording that will be equivalent to the one-period that detected by above-mentioned cycle detection section is consecutive image, and is recorded as rest image according to the view data from above-mentioned image pickup part output.
5. camera according to claim 4, wherein, above-mentioned cycle detection section is according to above-mentioned view data, detect until repeat the image of the background subject of same action become till consistent during, will be during this period as the above-mentioned cycle.
6. camera according to claim 4, wherein, above-mentioned cycle detection section is according to above-mentioned view data, detect the background subject that moves to the other end from an end of picture move to the other end during, will be during this period as the above-mentioned cycle.
7. camera according to claim 4, wherein, above-mentioned cycle detection section is according to above-mentioned view data, detect beginning from appear at picture until disappear during, will be during this period as the above-mentioned cycle.
8. camera according to claim 4, wherein, this camera has:
Image synthesizes section, its synthetic above-mentioned consecutive image and above-mentioned rest image; And
Display part, it shows above-mentioned synthetic image.
9. camera according to claim 4, wherein, during the detection of being carried out the above-mentioned cycle by above-mentioned cycle detection section in, show to keep warning.
10. camera according to claim 4, wherein, this camera has face detection section, and personage's face is detected according to above-mentioned view data by this face detection section,
Above-mentioned image change extraction unit is extracted above-mentioned change section outside above-mentioned face.
11. camera according to claim 4, wherein, this camera has:
Display part, it carries out live view according to above-mentioned view data to shot object image and shows; And
Specifying part, it specifies the part on the picture that above-mentioned live view shows,
Above-mentioned cycle detection section is detected and above-mentioned cycle by shot object image corresponding to the specified above-mentioned part of above-mentioned specifying part.
12. a method for imaging, it has following steps:
Take shot object image, and output image data successively,
The more above-mentioned view data of output is extracted change section,
The one-period of the variation of the above-mentioned change section of detection said extracted,
The above-mentioned Imagery Data Recording that will be equivalent to detected above-mentioned one-period is consecutive image, and is rest image with above-mentioned Imagery Data Recording.
13. a reproducting method, it has following steps:
The view data of storing static image and when the background subject changes, will be equivalent to the view data of one-period and the view data that above-mentioned rest image associates the dynamic image of record,
Above-mentioned view data to above-mentioned background the subject part that changes and the above-mentioned rest image of storing is synthesized, and
Show above-mentioned synthetic image.
CN 201010196395 2009-06-02 2010-06-02 Photographic device, photographic method and reproducing method Expired - Fee Related CN101909153B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2009132727A JP5498059B2 (en) 2009-06-02 2009-06-02 Imaging apparatus, imaging method, reproduction method, image processing apparatus, and image processing program
JP2009-132727 2009-06-02

Publications (2)

Publication Number Publication Date
CN101909153A CN101909153A (en) 2010-12-08
CN101909153B true CN101909153B (en) 2013-03-20

Family

ID=43264461

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201010196395 Expired - Fee Related CN101909153B (en) 2009-06-02 2010-06-02 Photographic device, photographic method and reproducing method

Country Status (2)

Country Link
JP (1) JP5498059B2 (en)
CN (1) CN101909153B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5717453B2 (en) * 2011-01-14 2015-05-13 キヤノン株式会社 IMAGING DEVICE AND IMAGING DEVICE CONTROL METHOD
JP5802520B2 (en) * 2011-11-11 2015-10-28 株式会社 日立産業制御ソリューションズ Imaging device
KR101901910B1 (en) 2011-12-23 2018-09-27 삼성전자주식회사 Method and apparatus for generating or storing resultant image which changes selected area
KR101948692B1 (en) 2012-10-09 2019-04-25 삼성전자주식회사 Phtographing apparatus and method for blending images
EP3823267B1 (en) 2018-03-11 2023-05-10 Google LLC Static video recognition
CN111988520B (en) * 2020-07-07 2021-08-13 安徽文香科技有限公司 Picture switching method and device, electronic equipment and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1198059A (en) * 1997-03-17 1998-11-04 松下电器产业株式会社 System and method for correcting gray scale in imaging apparatus
CN1794791A (en) * 2004-12-24 2006-06-28 佳能株式会社 Image pickup apparatus and method of controlling same
JP2007215109A (en) * 2006-02-13 2007-08-23 Canon Inc Digital still camera

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005236483A (en) * 2004-02-18 2005-09-02 Casio Comput Co Ltd Image processing apparatus and program thereof
JP2008182499A (en) * 2007-01-25 2008-08-07 Nikon Corp Image processor and image processing program
WO2008149925A1 (en) * 2007-06-08 2008-12-11 Nikon Corporation Imaging device, image display device, and program

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1198059A (en) * 1997-03-17 1998-11-04 松下电器产业株式会社 System and method for correcting gray scale in imaging apparatus
CN1794791A (en) * 2004-12-24 2006-06-28 佳能株式会社 Image pickup apparatus and method of controlling same
JP2007215109A (en) * 2006-02-13 2007-08-23 Canon Inc Digital still camera

Also Published As

Publication number Publication date
CN101909153A (en) 2010-12-08
JP2010283412A (en) 2010-12-16
JP5498059B2 (en) 2014-05-21

Similar Documents

Publication Publication Date Title
CN101998052B (en) Photographing apparatus
US9088721B2 (en) Imaging apparatus and display control method thereof
JP4640456B2 (en) Image recording apparatus, image recording method, image processing apparatus, image processing method, and program
CN101909153B (en) Photographic device, photographic method and reproducing method
US20110063118A1 (en) Imaging device and imaging device control method
US20110007187A1 (en) Imaging Device And Image Playback Device
CN101998057A (en) Camera and display control method of the same
US9601158B2 (en) Moving image selection apparatus for selecting moving image to be combined, moving image selection method, and storage medium
US20090115857A1 (en) Image capturing apparatus providing image blur information and method thereof
CN104065857A (en) Imaging Device And Video Content Generating Method
WO2016208070A1 (en) Imaging device and image processing method
JP2014050022A (en) Image processing device, imaging device, and program
KR20100035381A (en) Image processing method and apparatus, and digital photographing apparatus
US20100079610A1 (en) Photographic apparatus and photographic control method, image display apparatus and image display method, and photographic system and control method thereof
JP5851133B2 (en) Image reproducing apparatus, image reproducing method and program
JP7362696B2 (en) Imaging device
JP5593652B2 (en) Camera and movie playback program
JP6362735B2 (en) IMAGING DEVICE, IMAGING DEVICE CONTROL METHOD AND CONTROL PROGRAM
JP2010183565A (en) Image capturing apparatus, image retrieval device, and program
JP5744606B2 (en) Display control device, display control method, program, and storage medium
JP6450879B2 (en) Recording apparatus, recording method, and recording program
JP6169963B2 (en) IMAGING DEVICE AND IMAGING DEVICE CONTROL METHOD
KR20150071650A (en) Video processing device, video processing method, and recording medium
JP5613285B2 (en) IMAGING DEVICE, IMAGING METHOD, DISPLAY DEVICE, AND DISPLAY METHOD
JP5715179B2 (en) Reproduction display device and reproduction display method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C41 Transfer of patent application or patent right or utility model
TR01 Transfer of patent right

Effective date of registration: 20151125

Address after: Tokyo, Japan, Japan

Patentee after: Olympus Corporation

Address before: Tokyo, Japan, Japan

Patentee before: Olympus Imaging Corp.

CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20130320

Termination date: 20190602