CN104869302A - Shooting Device And Image Recording Method - Google Patents
Shooting Device And Image Recording Method Download PDFInfo
- Publication number
- CN104869302A CN104869302A CN201510075125.5A CN201510075125A CN104869302A CN 104869302 A CN104869302 A CN 104869302A CN 201510075125 A CN201510075125 A CN 201510075125A CN 104869302 A CN104869302 A CN 104869302A
- Authority
- CN
- China
- Prior art keywords
- information
- image
- control part
- sub
- master image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Abstract
The present invention provides a shooting device and an image recording method. The shooting device is equipped with a recording control part capable of recording a shooting image of a shot object as a main image; a position and object determining part of setting at least one of a correlated position and a correlated object in the above main image; and an correlation control part obtaining the sub-information correlated with the above correlated position and correlated object set by the above position and object determining part, controlling the above recording control part, and correlating the above main image and the sub-information to record.
Description
Technical field
The present invention relates in image file, record auxiliary data photographic equipment and image recording process.
Background technology
In recent years, the portable equipment (photographic equipment) of the band such as digital camera camera function carries out image procossing, has various camera function.Further, in photographic equipment, there is the photographic equipment with communication function, the image that photography obtains can also be sent on miscellaneous equipment or network.
But, in the past, in photographic equipment, when image record, the auxiliary data beyond the images such as the information in photography date, photography place is carried out documentation together with image and carrys out record.That is, image file is made up of view data and auxiliary data, also can carry out the editor of image file after reordering.
Further, as Japan Patent No. 4519531 publications openly, also develop such device: differentiate the object comprised in the original image that records, extract and give priority and the object that differentiates.Such as, by character area is set as object, the word comprised in image can also be extracted, and it can be used as the auxiliary data of view data to carry out record.
Summary of the invention
Photographic equipment of the present invention has: recording control part, and the photographed images of subject can be recorded as master image by it; Position and object detection unit, it sets the relative position in above-mentioned master image and at least one party in affiliated partner thing; And association control part, it obtains the sub-information be associated with the above-mentioned relative position set by above-mentioned position and object detection unit and affiliated partner thing, controls above-mentioned recording control part, and get up above-mentioned master image and above-mentioned sub-information association record.
Further, image recording process of the present invention has: obtain step, obtains the photographed images of subject as master image: position and object determination step, sets the relative position in above-mentioned master image and at least one party in affiliated partner thing; And associated steps, obtain the sub-information associated with affiliated partner thing with above-mentioned relative position set in above-mentioned position and object determination step, above-mentioned master image and above-mentioned sub-information association are carried out record.
Above and other objects of the present invention, feature and advantage are more clearly understood with reference to the accompanying drawings from following explanation.
Accompanying drawing explanation
Fig. 1 is the block diagram of the circuit structure of the photographic equipment that the 1st execution mode of the present invention is shown.
Fig. 2 is for illustration of master image and the photography of subgraph and the key diagram of record.
Fig. 3 is the key diagram of the photography situation of the subgraph illustrated in association mode.
Fig. 4 A and Fig. 4 B is the key diagram for illustration of the image file recorded when association mode.
Fig. 5 is the key diagram of the example that sub-information is shown.
Fig. 6 is the flow chart of the action for illustration of the 1st execution mode.
Fig. 7 is the flow chart for illustration of the action in reproduction mode.
Fig. 8 is the block diagram that the 2nd execution mode of the present invention is shown.
Fig. 9 is the key diagram of the outward appearance of the photographic equipment that the 2nd execution mode is shown.
Figure 10 is the key diagram for illustration of the example from the sub-information of the Internet download.
Figure 11 is the key diagram for illustration of the example from the sub-information of the Internet download.
Figure 12 is the key diagram for illustration of the image file recorded when association mode.
Figure 13 is the key diagram of the example that sub-information is shown.
Figure 14 is the key diagram for illustration of situation when reproducing.
Figure 15 is the flow chart of the action that the 2nd execution mode is described.
Embodiment
Below, with reference to accompanying drawing, embodiments of the present invention are described in detail.
(the 1st execution mode)
Fig. 1 is the block diagram of the circuit structure of the photographic equipment that the 1st execution mode of the present invention is shown.In the present embodiment, the subgraph (sub-information) that the arbitrary position in the master image that obtaining photographs with user obtains or object associate, associatedly carries out record by master image and subgraph (sub-information).Such as, subgraph is obtained by the shooting operation of user.
Fig. 2 to Fig. 5 is for illustration of master image and the photography of subgraph and the key diagram of record.
Fig. 2 illustrates that user obtains the situation of master image by photography.As shown in Figure 2, user 21, holding with right hand 21a under the state being accommodated with the housing 22 of the circuit block of the photographic equipment 10 shown in Fig. 1, photographs to subject and personage 31.Personage 31 with mountain range 32 as a setting, near the stone tablet 33 being carved with the title 33a on Δ plateau standing in personage 31 place.The rear side of the housing 22 of photographic equipment 10 is provided with display frame 23, this display frame 23 shows the image in shooting and live view image 24.Fig. 2 illustrate to show in camera coverage comprise personage 31, mountain range 32 and stone tablet 33 photographed images as live view image 24.
User 21 presses shutter release button 22a with right hand 21a in this condition, thus record is as the photographed images shown by live view image 24.Now, assuming that such as user 21 using the photographed images of this record as master image.
In the present embodiment, master image and subgraph (sub-information) associatedly can carried out carrying out action in the association mode recorded.In association mode, user 21 can specify and associatedly photograph to subgraph with which position (hereinafter referred to as relative position) in image or object (hereinafter referred to as affiliated partner thing).Fig. 2 illustrates when association mode, and user 21 has carried out the action that left-handed finger 21b touches the image 25 corresponding with the stone tablet 33 in live view image 24.By this touch operation, the position of the image 25 corresponding with the stone tablet 33 in master image is set as relative position.Like this, the position of image can be made to have meaning, based on photographs, read other information from the position this image.Thus, it is not stay on the surface that image is appreciated, but becomes the key of further information reading, and the experience subsequently of appreciator can be made abundanter.Such as, when the content that the billboard that curiosity cannot be seen clearly or mailbox are write, if touched it, just can reproduce further information, thus meet curiosity.The following additional information meeting this curiosity.
Fig. 3 illustrates the photography situation of the subgraph in association mode.User 21, under the state of housing 22 holding photographic equipment 10 with right hand 21a, carries out the photography of the subgraph corresponding with the stone tablet 33 being appointed as affiliated partner by touch operation.Both can photograph after appointment, also can photograph while specifying.When photographing after appointment, as shown in Figure 3, such as, user 21 carries out zoom operation, or changes camera positions, of photography mode, carry out the adjustment of the angle of visual field with stone tablet 33 in the whole indication range of display frame 23.Fig. 3 illustrates this state, and the image 43 corresponding with stone tablet 33 is presented in whole indication range.Further, the display 44 of " in the association photography " that represent in the photography being subgraph in association mode is shown on the top of display frame 23.This display is important, this is because if not this display, then user cannot know and photographs to master image as photo works or photograph as frame.Further, when works are photographed, naturalness, toning, expressing gradation etc. are important, but, when word etc. being photographed when Information Photographic, can reading characters be important, can be black and white, also contrast can be brought up to not from however easily read.Although comprise spectrum assignment or the control of diaphragm etc. to carry out photography control, however different when can make itself and main photography, easy reading characters can be become or suppress fuzzy photography.Further, black and white or edge enhancing etc. are image procossing, can carry out either party in photography control and image procossing or both sides, make the performance as supplementary become master image.Not only when recording, also such control can be become master image when live view image shows.In this condition, user 21 presses shutter release button 22a, thus the photographed images that will show as live view image 24 is recorded as subgraph.Before this photography, display appreciator can be guided to have the part of curiosity when main photography.Such as, can by face or word, being feature with the landscape of background, mountain etc. is judged to photograph candidate in spectral discrimination again, suggestion is shown as and obtains the relevant information of this part.Such as, Ke Yishi, when confirming to specify this part with finger in image in photography, this part becomes live view image state, and display needs information further in the portion, meanwhile, observes this live view image and photographs.Can photograph while carrying out specifying, the above is this method for imaging.
Fig. 4 A and Fig. 4 B is the key diagram for illustration of the image file recorded when association mode.Fig. 4 A is the figure that the state only recording master image is described, Fig. 4 B is the figure that declare record has the state of master image and subgraph.
As shown in Figure 4 A and 4 B shown in FIG., image file comprises the view data 45 of master image and the label information 46 as auxiliary data.The information etc. of the information including the information relevant to master image and be correlated with the photography of master image in label information 46 etc., such as subject face information, photograph place, photography time.And, in the present embodiment, also include in label information subgraph supposition information, this subgraph supposition information be represent use association mode photography in whether the subgraph associated with this master image associatedly recorded or subscribed the information of record.Further, in the present embodiment, in image file, also include the sub-information 47 recorded in association mode.
Fig. 5 is the key diagram of the example that sub-information is shown.Fig. 5 is the figure corresponding with the photography of Fig. 2 and Fig. 3.In the present embodiment, sub-information each relative position of specifying by user or each affiliated partner thing are registered.Illustrate in the example of fig. 5 picture is divided into central authorities, upper right, bottom right, upper left, lower-left 5 regions and in each region, register the example of sub-information.The name be registered with accordingly with the region of picture central authorities.This sub-information represents the information relevant to the name of the personage (personage 31 of Fig. 2 and Fig. 3) captured by the substantial middle of camera coverage.Further, shown in Figure 5ly to record accordingly by the subgraph acquired by the photography shown in Fig. 3 with the lower-left of picture.Further, the Word message also recorded by " the Δ plateau " acquired by the Text region to the character string in this subgraph shown in Figure 5.In order to carry out such Text region, subgraph photography carry out photographing from master image different (also comprising image procossing) control.
In FIG, photographic equipment 10 has the image pickup part 11 be made up of the imaging apparatus such as CCD or cmos sensor.Image pickup part 11 pairs of subjects are photographed, and export photographs.Photographed images is provided to association portion 20.The association control part 14 in association portion 20 is made up of not shown CPU and memory etc., carries out camera control according to the program be stored in memory.Association control part 14 controls image pickup part 11 (omitting diagram), and the signal transacting that the photographs that image pickup part 11 exports is specified, such as color adjustment process, matrixing process, noise removal process, other various signal transacting.
Further, associate control part 14 can perform and show relevant various process.Photographs after signal transacting can be supplied to display and operating portion 17 by association control part 14.Display and operating portion 17 have the display frames such as LCD, show the image be provided from association control part 14.Further, associate control part 14 various menu displays etc. to be presented in the display frame 23 (with reference to Fig. 2) of display and operating portion 17.
Further, display and operating portion 17 have the not shown operating portion of accepted user operation.As this operating portion, display and operating portion 17 can have the touch panel such as formed in display frame 23.Touch panel can produce with user with operation signal corresponding to the position pointed in the display frame that indicates.This operation signal is supplied to association control part 14.Thus, when user touches or slides in display frame, association control part 14 can detect user touch location, make finger close the operation (kneading operation) of separation, slide or the position reached by slide, glide direction, touch during etc. various operation, the process corresponding with user operation can be performed.
Record-playback control part 12 can carry out the process relevant to the recording and reconstruction of photographed images.Such as, record-playback control part 12 can carry out compression process to the photographs after signal transacting, the image after compression is supplied to recording unit 16 and carries out record.As recording unit 16, such as card interface can be adopted, recording unit 16 can in the recording mediums such as storage card recording image information and acoustic information etc.
Record-playback control part 12 can read the photographed images that is recorded in recording unit 16 and carry out decompression.Record-playback control part 12, by the photographed images after decompression being supplied to display and operating portion 17, can carry out the reproduction of document image.
In addition, the display frame 23 of display and operating portion 17 is arranged to the roughly Zone Full at the such as back side occupying photographic equipment 10, cameraman can confirm the live view image be presented in the display frame 23 of display and operating portion 17 when photographing, can also carry out shooting operation while confirmation live view image.
In the present embodiment, association control part 14, when association mode, can obtain master image and sub-information, and be recorded in recording unit 16.When by the operation of display and operating portion 17, such as the touch operation of touch panel is specified in image position time, this position is set as relative position by position and object detection unit 13.Further, when by the operation of display and operating portion 17, such as the touch operation of touch panel is specified in image object time, this object is set as affiliated partner thing by position and object detection unit 13.In addition, position and object detection unit 13 not only for the photographed images from image pickup part 11, but also for the reproduced image reproduced from recording unit 16, can set relative position and affiliated partner thing.As object decision-making function, there is the face detection, text detection etc. of the pattern using image, because landscape etc. is remote, thus can reflect range information etc., judge sky according to color, judge object according to shape decision mountain etc.Can judge like this to consider that user also has interest, the suggestion of photographing again can be pointed out to judged part.
Sub-information is recorded in related information storage part 15.The sub-information be recorded in related information storage part 15 comprises: specified the information of relative position or affiliated partner thing and the information of also non-specified associations position or affiliated partner thing.
Photographed images from image pickup part 11, when association mode, carries out processing or processing as subgraph as master image by association control part 14.Sometimes this subgraph is recorded in related information storage part and is also used as sub-information.Further, associate control part 14 the various information obtained from the photographed images from image pickup part 11, such as Word message to be obtained as sub-information.Sometimes associate control part 14 acquired sub-information is recorded in related information storage part 15.
Association control part 14 can divide gamete information by each relative position of master image or each affiliated partner thing, is recorded in recording unit 16 by record-playback control part 12.
Below, with reference to Fig. 6 and Fig. 7, the action of the execution mode formed like this is described.Fig. 6 is the flow chart of the action for illustration of execution mode.Fig. 6 illustrates that camera controls.
In step s in fig. 6, associate control part 14 and determine whether photograph mode.Now, assuming that indicate photograph mode.In this case, association control part 14 in step s 2, controls image pickup part 11 and starts shooting, be taken into the photographs from image pickup part 11.Association control part 14 carries out the judgement of the subject in be taken into photographed images.
Association control part 14, in next step S3, determines whether association mode.When not being association mode, association control part 14 carries out the photographing actions of normal mode.That is, associate control part 14 and show live view image in step s 4 which, determine whether in step s 5 to photograph.When user presses shutter release button 22a, association control part 14 is photographed in step s 6, the photographed images from image pickup part 11 is implemented to the signal transacting of regulation, photographed images is recorded in recording unit 16 afterwards by record-playback control part 12.
Now, assuming that specify association mode by user operation.In this case, in step s 11, judgement specifies the photography of master image or specifies the photography of subgraph association control part 14.In the present embodiment, first can photograph to master image, also can first photograph to subgraph.
Namely, in the present embodiment, following pattern can realize: photographic recording has master image, by each relative position or each affiliated partner thing, subgraph and the master image recorded associatedly is carried out the pattern (hereinafter referred to as master-sub-association mode) recorded; And photographic recording has subgraph, recorded subgraph is associatedly carried out the pattern (hereinafter referred to as son-main association mode) recorded by each relative position of photographed master image or each affiliated partner thing.Step S23 ~ the S30 of Fig. 6 represents the action of master-sub-association mode, and step S12 ~ S20, S31 ~ S37 represents the action of son-main association mode.
Now, assuming that user specifies boss's association mode.That is, suppose photographic recording master image, user specifies the photography of subgraph, associate with recorded master image to make subgraph.In this case, association control part 14 make process transfer to step S21 from step S11, read the master image recorded from recording unit 16, be supplied to display and operating portion 17 carry out the stipulated time thumbnail show.Association control part 14, in next step S22, determines whether that selection operates master image.
Even if association control part 14 is when through the stipulated time also non-selected master image, be judged to be that photography, the i.e. user of the subgraph that will carry out in son-main association mode do not associate with master image and carry out the photography of subgraph, make process move to step S31 from step S22.
Now, because user will make subgraph associate with the master image recorded, thus user carries out the selection operation of master image.Association control part 14 accepts the assigned operation of touch location in step S23.Such as, user touches the display position of the image 25 of Fig. 2.Thus, such as picture lower-left is set as relative position by position and object detection unit 13.Then, associate control part 14 makes the photographed images in current shooting be presented in the display frame of display and operating portion 17 (step S24) in live view image mode in image pickup part 11.User is received in mode within the vision to make the relative position in master image or affiliated partner thing, carries out camera positions or zoom operation, photographs.
Association control part 14 determines whether to have carried out the shooting operation of subgraph in step s 25.When having carried out shooting operation, association control part 14 controls image pickup part 11 to have carried out photograph (step S26).This also can be expressed as works photography, and naturalness, toning, expressing gradation etc. are important.In son photography described later, when photographing to word etc. when Information Photographic, it is important for can read word etc., but here, it is important for firmly skipping exposure or changing color, reflect the photography of user preferences.Certainly, in order to carry out Text region etc., when can be arranged on live view image or after just having photographed, judge which part is distinctive step.Not only when recording, and when the live view image of S24, can be subgraph described later by such control break.Then, associate control part 14 to determine whether in step s 27 to identify the word in the relative position of photographed images.When identifying, in order to this word is recorded as sub-information, association control part 14 carries out the reading (step S28) of Word message, makes read word carry out son information-based (step S29).
Then, associate control part 14 and the sub-information be made up of with read word photographed subgraph is recorded in (step S30) in the image file of selected master image together with the information of relative position, affiliated partner thing.Can not be only record the side in relative position and affiliated partner thing, but judge the affiliated partner thing of relative position and its position, the both sides of record relative position and affiliated partner thing.Such as, setting screen central authorities are as relative position, and the object being recorded as this position is face in kind.Like this, in recording unit 16, the image file shown in Fig. 4 B is recorded.
The photograph processing of the subgraph in son-main association mode is carried out in step S31 ~ S37.The process of step S31 ~ S36 is except non-specified associations position or affiliated partner thing, identical with step S24 ~ S29.Photographed subgraph, in step S37, is recorded in related information storage part 15 by association control part 14.
Then, assuming that in son-main association mode, carry out the photography of master image.In this case, associating control part 14 makes process transfer to step S12 from step S11.User, in order to photograph to master image, photographs after performing angle of visual field setting.Such as, when the stone tablet 33 of Fig. 3 having been carried out photographing as subgraph, such as, as shown in Figure 2, with the angle of visual field comprising this stone tablet 33, master image has been photographed.
Association control part 14 determines whether to have carried out the shooting operation of master image in step s 13.When having carried out shooting operation, association control part 14 controls image pickup part 11 to have carried out photograph (step S14).The naturalness, toning, expressing gradation etc. important when main photography (works photography) are compared in this photography, and easy reading characters etc., easily detection face etc. are important, can be black and white, also can improve contrast.Although comprise spectrum assignment or the control of diaphragm etc. and carry out photography control, however different when can make itself and main photography, easy reading characters can be become or suppress fuzzy photography.Further, black and white or edge enhancing etc. are image procossing, can carry out either party in photography control and image procossing or both sides, make the performance as supplementary become master image.Certainly, can not only when recording, but also when the live view image of S12, be all master image by such control break.Then, association control part 14, in step S15, makes photographed image confirming display (record is browsed) be presented in display frame 23, accepts the appointment (step S16) of relative position or affiliated partner thing.Now, as mentioned above, enhancing display can be carried out to the part of the image with special characteristic.That is, the face identification be developed as detection technique and Text region are the representatives of the identification that user pays close attention to, and display determined such part, as the candidate that photographs again, surround with frame, or change color, or with arrow instruction, suggestion display is carried out to user.Further, when range data can be obtained, also can detection background, judge sky and mountain etc., obtaining mountain in conversational mode is the information such as mountain where.Now, except road sign, destination display panel, hand-held map etc. can also be photographed, also can photograph to guiding book etc., information displaying can be carried out to only this place.User sometimes can not remember and photographs etc. to guiding book, can show suggestion: " photographing to hand-held map or guiding book " etc.Such display information can be recorded in recording unit 16.User can specify the subgraph associated with now captured master image is clapped which position in master image.Such as, when subgraph is image 43 of the stone tablet 33 of Fig. 3, when having carried out the master image shown in Fig. 2 making a video recording, user has touched the lower left position of picture.Thus, the appointment that control part 14 carries out relative position or affiliated partner thing is associated.
Association control part 14 is in step S17, and the icon making expression be stored in the guide look of the sub-information in related information storage part 15 is presented in the display frame 23 of display and operating portion 17.User, by referring to this display, specifies sub-information.
Association control part 14, in step S18, determines whether to specify sub-information.When specifying, associate control part 14 in step S19, to the sub-information of image file addition record of master image.Further, when not specifying sub-information at the appointed time, only record has carried out the master image (step S20) of specifying of relative position or affiliated partner thing.
Fig. 7 is the flow chart for illustration of the action in reproduction mode.
Association control part 14, in the step S41 of Fig. 7, determines whether to specify reproduction mode.Association control part 14 when specifying reproduction mode, in step S42, read the master image recorded from recording unit 16, be supplied to display and operating portion 17 carry out the stipulated time guide look show.Association control part 14, in next step S43, determines whether to have carried out selecting operation to image.When having carried out image and having selected, selected image, in step S44, has been presented on whole picture and (has amplified display) by association control part 14.
In the present embodiment, association control part 14, in step S45, determines whether to change to association photography.In the present embodiment, even if when reproduction mode, the photography of subgraph also can be carried out.When being indicated association photography by user, association control part 14 makes process transfer to step S46, determines whether the appointment of touch location.The judgement of step S46 is the judgement identical with the judgement of the step S23 of Fig. 6, after, the step S24 of Fig. 6 is transferred in process.
Like this, in the present embodiment, even if when the reproduction mode of master image, also can specified associations position or affiliated partner thing, subgraph is photographed again and preserves.
When not indicating to association photography change, association control part 14 makes process transfer to step S51 from step S45, judges whether user has carried out the process getting back to other patterns from reproduction mode.
Then, if do not carry out the change to association photography when reproduction mode, then associate control part 14 in step S52, determine whether the touch operation having carried out specified associations position or affiliated partner thing.When having carried out touch operation, from related information storage part 15 read with by the relative position specified by this touch operation or the relevant sub-information of affiliated partner thing, be supplied to and show and operating portion 17 shows.
Like this, user can display and operating portion 17 display frame 23 on, show sub-information for the relative position in master image or affiliated partner thing.Further, as shown in the example of figure 5, sometimes multiple sub-information is recorded about the relative position specified or affiliated partner thing.In this case, user can delete and be judged as unwanted sub-information.Association control part 14, in step S54, accepts the selection of the sub-information that will delete.When specifying the sub-information that will delete, association control part 14 deletes the sub-information corresponding with this deletion action from related information storage part 15.
So in the present embodiment, can specify the relative position in master image or affiliated partner thing, point gamete information carries out record.As sub-information, can records photographing to photographed images or the information that obtains from photographed images, the information that the mode further user can expected with user in master image is expected carries out record.
(the 2nd execution mode)
Fig. 8 is the block diagram that the 2nd execution mode of the present invention is shown.Further, Fig. 9 is the key diagram of the outward appearance of the photographic equipment that the 2nd execution mode is shown.
Present embodiment is applied to the dull and stereotyped PC (personal computer) being provided with lens type camera.Smart phone or portable phone can be adopted and replace dull and stereotyped PC.On the display part 68 of dull and stereotyped PC61, as described later, the photographed images using lens type camera 51 to obtain is shown.
In fig. 8, be provided with camera Department of Communication Force 62 in dull and stereotyped PC61, be provided with Department of Communication Force 55 in lens type camera 51, dull and stereotyped PC61 and lens type camera 51 are configured to can intercom mutually via these Department of Communication Forces 62,55.
As shown in Figure 9, in the housing 61a of dull and stereotyped PC61, dismounting is provided with mounted apparatus 71 freely, and mounted apparatus 71 is provided with the installation portion 72 for installing lens type camera 51.Lens type camera 51 is provided with installation portion 51b at base end side, is arranged in the installation portion 72 of mounted apparatus 71 by this installation portion 51b by embed or screw-in etc.
In addition, in the present embodiment, dull and stereotyped PC61 has control lens type camera 51 and controls the photography of master image and subgraph and the function of record, but about this function, can by the function setting of part or all in lens type camera 51 side.
The image pickup part 52 with optical system 52a is provided with in lens type camera 51.In image pickup part 52, be provided with the not shown imaging apparatus be made up of CCD or cmos sensor etc., by optical system 52a, shot object image be directed to the imaging surface of imaging apparatus.Optical system 52a has to be set as focusing state and movable focus lens by focusing and carry out the varifocal mirror of zoom in lens barrel 51a under focusing state first-class.Further, optical system 52a has the not shown mechanism part driving these camera lenses and aperture.The mechanism part of control part 53 control both optical system 52a, carries out drived control to these focus lens, zoom lens and aperture.
The operating portions 54 such as operation ring 54a are provided with, for the parameter relevant to the photography that user carries out, the setting operation of parameter of being such as correlated with focusing, zoom and aperture in lens type camera 51.Control part 53 detects user operation to operating portion 54 and the control carried out based on testing result.Control part 53 is made up of CPU etc., according to the user operation of operating portion 54 and the signal from dull and stereotyped PC61 described later, controls each portion of lens type camera 51.
Photography control part 53c produces focusing signal, zoom signal and the control of diaphragm signal, carries out drived control to the focusing of optical system 52a, zoom and aperture.Further, drive singal is supplied to imaging apparatus by photography control part 53c, controls the shooting of subject.
Image processing part 53b can be provided to the photographed images from imaging apparatus, implement the picture signal process of regulation, such as color adjustment process, matrixing process, noise removal process, other various signal transacting, be supplied to recording unit 56 afterwards and carry out record.Such as IC memory can be adopted as recording unit 56.Further, photographed images can be forwarded to dull and stereotyped PC61 via Department of Communication Force 55 by image processing part 53b.
Shot information handling part 53a can obtain the camera lens relevant information of the camera lens state, aperture state etc. of zoom lens, focus lens etc., is forwarded to dull and stereotyped PC61 via Department of Communication Force 55.In camera lens relevant information, include focusing position, take the information of the distance of the optical axis directions such as the scope of the depth of field.
Department of Communication Force 55 can communicate via the transfer path specified with between the camera Department of Communication Force 62 be arranged in dull and stereotyped PC61.As transfer path, can adopt and use wired and wireless various transfer paths, such as USB (Universal Serial Bus, USB) transfer path etc. of the WLAN such as cable, Wifi (Wireless Fidelity, Wireless Fidelity).When control part 53 establishes communication between dull and stereotyped PC61, according to the control part 65 of dull and stereotyped PC61 by control photography, and photographed images and camera lens relevant information can be forwarded to dull and stereotyped PC61.
The control part 65 of dull and stereotyped PC61 is made up of such as CPU etc. and controls each portion of dull and stereotyped PC61.Control part 65 exports the signal of the image pickup part 52 for driving lens type camera 51, and receives the photographed images from lens type camera 51.The signal transacting that control part 65 specifies the photographed images received, such as color adjustment process, matrixing process, noise removal process, other various signal transacting.
Operating portion 66 is also equipped in dull and stereotyped PC61.Operating portion 66 is made up of the not shown various operating portion such as switch, key, software keyboard be arranged in dull and stereotyped PC61, produces the operation signal based on user operation, outputs to control part 65.Control part 65 controls each portion according to operation signal.
The process that the recording and reconstruction that control part 65 can carry out photographed images is correlated with.Such as, control part 65 can carry out compression process to the photographs after signal transacting, the image after compression is supplied to recording unit 64 and carries out record.As recording unit 64, the various recording mediums such as such as IC memory can be adopted, recording unit 64 can in recording medium recording image information and acoustic information etc.
Display control unit 67 performs the various process relevant to display.Display control unit 67 can be provided the photographs after signal transacting from control part 65, is supplied to display part 68.Display part 68 has the display frame 68a such as LCD (with reference to Fig. 1), shows the image be provided from display control unit 67.Further, various menu displays etc. can also be presented on the display frame 68a of display part 68 by display control unit 67.Control part 65 can read the photographed images that is recorded in recording unit 64 and carry out decompression.Display control unit 67, by the photographed images after decompression is supplied to display part 68, can carry out the reproduction of document image.
The display frame 68a of display part 68 is provided with not shown touch panel.Touch panel can produce with user with operation signal corresponding to the position pointed on the display frame 68a that indicates.This operation signal is fed into control part 65.Thus, when user touches or slides on display frame 68a, control part 65 can detect user touch location, make finger close the operation (kneading operation) of separation, slide or the position reached by slide, glide direction, touch during etc. various operations, the process corresponding with user operation can be performed.By this touch panel, the appointment of relative position or affiliated partner thing can be carried out.
In addition, display part 68 is arranged to the roughly Zone Full of the such as front surface occupying dull and stereotyped PC61, user can confirm the photographed images be presented on the display frame 68a of display part 68 when using the photography of lens type camera 51, can carry out shooting operation while confirmation photographed images.
Further, in the present embodiment, dull and stereotyped PC61 has network connection 63.Network connection 63 is controlled by control part 65, can be connected by wireless or wired with not shown the Internet lines.Network connection 63 can conduct interviews to website according to the user operation of operating portion 66, carries out the data transmit-receive corresponding with user operation and carries out the download of the data of user's expectation.In the present embodiment, the data that download not only directly can be specified by user, automatically can also be obtained by control part 65.
Control part 65 has with the position in the 1st execution mode and object detection unit 13 and associates the identical function of the both sides of control part 14, can carry out the action in association mode.Such as, control part 65 according to the touch operation setting relative position of user or affiliated partner thing, and can correspond to set relative position or affiliated partner thing, in a same manner as in the first embodiment, obtains sub-information from the photographed images of lens type camera 51.
Further, in the present embodiment, in recording unit 64, sometimes record the information of the residence registration of user's registration, the information that this residence can be registered by control part 65 and other information be recorded in recording unit 64 are used as sub-information.
Further, in the present embodiment, control part 65 associatedly can also be recorded in by the data acquired by network connection 63 in recording unit 64 with relative position or affiliated partner thing as sub-information.
Figure 10 and Figure 11 is the key diagram for illustration of the example from the sub-information of the Internet download.
Figure 10 illustrates that user passes through to photograph and obtains the situation of master image.As shown in Figure 10, user 81, under the state using right hand 81a to hold the housing 61a of the circuit module of the dull and stereotyped PC61 being accommodated with Fig. 8, is photographed by lens type camera 51 pairs of subjects and personage 91.Personage 91 with wall 92 as a setting, stand in be shown as " concert " bulletin board 93 near.The rear side of housing 61a is provided with display frame 68a, this display frame 68a shows the image in shooting and live view image 85.Figure 10 illustrate to show in camera coverage comprise personage 91, wall 92 and bulletin board 93 photographed images as live view image 85.
User 81 presses shutter release button 61b with right hand 81a in this condition, thus record is as the photographed images shown by live view image 85.Now, assuming that such as user 81 using the photographed images of this record as master image.
In the present embodiment, the action in association mode master image and subgraph associatedly recorded can be carried out.In association mode, user 81 can specified associations position or affiliated partner thing in the picture, specifies and photographs to subgraph.Further, as mentioned above, in association mode, the sub-information corresponding with relative position set in image or affiliated partner thing can also be obtained via the Internet lines.
Now, assuming that user 81 obtains sub-information when association mode from the Internet lines.Such as, assuming that user 81 carries out using left hand 81b to touch the operation of the image 87 in the live view image 85 corresponding with bulletin board 93.By this touch operation, the position of the image 87 corresponding with bulletin board 93 in master image is set as relative position, transfers to the sub-information obtaining the sub-information relevant to this relative position and obtain pattern.
Figure 11 illustrates the situation that the sub-information in association mode obtains.Obtain in pattern in sub-information, obtained the Word message of relative position by the Text region process etc. of the image to relative position.Further, obtain in pattern in sub-information, carry out the connection with the Internet lines, display frame 68a shows information and obtains picture 95.User 81 holds dull and stereotyped PC61 with left hand 81b, touches the information that is presented at obtain index button 96 on picture 95 by the touch operation of right hand 81a.Thus, carry out, using from the Word message acquired by relative position as the retrieval of keyword, obtaining the information with this word information association.
Such as, when achieving the name of player as Word message, profile (profile) information relevant to this player can be obtained as sub-information.Further, when achieving performance song name as Word message, the voice data etc. of this performance song name can be obtained as sub-information.
Figure 12 is the key diagram for illustration of the image file recorded when association mode.As shown in figure 12, image file comprises the view data 45 of master image and the label information 46 as auxiliary data.The information etc. of the information including the information relevant to master image and be correlated with the photography of master image in label information 46 etc., such as subject face information, photograph place, photography time.In label information, also include subgraph supposition information, whether this subgraph supposition information represents associatedly have recorded by the subgraph associated with this master image or subscribed the information of record in the photography of association mode.Further, in image file, also include the sub-information 47 recorded in association mode.Record each institute information corresponding with relative position or affiliated partner thing as sub-information 47.Such as, the information based on the URL information, associated with name etc. from the Word message acquired by relative position or affiliated partner thing etc. is included.
Figure 13 is the key diagram of the example that sub-information is shown.Figure 13 is the figure corresponding with Figure 10 and Figure 11.In the present embodiment, sub-information each relative position of specifying by user or each affiliated partner thing are registered.The example of Figure 13 illustrates the example registering sub-information for the object on picture and subject by the face of each personage, each personage and each word.Name is registered with for personage, and, about the face of personage, be registered with URL information and filename etc.Further, about word, acoustic information, URL information and filename etc. are recorded.Filename is used to specify the audio files be recorded in recording unit 64.This audio files can be previously recorded in recording unit 64, and also can obtain in pattern in above-mentioned sub-information and obtain.
User, when the reproduction of master image, by touching relative position, can point out sub-information.Figure 14 is the key diagram for illustration of this situation.As shown in figure 14, such as, when recording the sub-information shown in Figure 13 in recording unit 64, user 81 is presented at the position of the image 98 of the bulletin board in the reproduced image 97 on display frame 68a by touch, can reproduce the voice data as sub-information using the position of the image 97 of bulletin board as relative position.Figure 14 illustrates the voice output 99 exported based on this voice data.
Below, with reference to Figure 15, the action of the execution mode formed like this is described.Figure 15 is the flow chart of the action for illustration of the 2nd execution mode.In fig .15 identical label enclosed to the step identical with Fig. 6 and omit the description.
The step S23 of Figure 15, S71 ~ S77 represent the action of master-sub-association mode, and step S12 ~ S20, S81 ~ S87 represents the action of son-main association mode.
Now, assuming that user specifies master-sub-association mode.That is, suppose photographic recording master image, user specifies obtaining of sub-information, associate with recorded master image to make sub-information.In this case, control part 65 makes process transfer to step S21 from step S11, reads the master image recorded from recording unit 16, be supplied to display and operating portion 17 carry out the stipulated time thumbnail show.Control part 65, in next step S22, determines whether that selection operates master image.
Even if control part 65 is when through the stipulated time also non-selected master image, be judged to be that the obtaining of the sub-information in son-main association mode of will carrying out, i.e. user do not associate with master image and will carry out obtaining of sub-information, make process move to step S81 from step S22.
Now, because hypothesis user will make sub-information associate with the master image recorded, thus user carries out the selection operation of master image.Control part 65 accepts the assigned operation of touch location in step S23.Such as, user touches the display position of the image 87 of Figure 10.Thus, the image 87 of bulletin board is set as affiliated partner thing by control part 65.Then, control part 65 determines whether that specifying sub-information obtains pattern (step S71).Control part 65, when specifying sub-information and obtaining pattern, shows the information shown in Figure 11 and obtains picture 95 in step S72.
The index button 96 that user is obtained on picture 95 by operation information is retrieved.Search key can be inputted by user oneself, also can be used by control part 65 and set from the text strings acquired by the image of affiliated partner thing.Control part 65 determines whether to there occurs retrieval input in step S73, when there being retrieval input, carry out inputting with this retrieval corresponding in perhaps the obtaining (step S74) of URL.That is, control part 65 net control connecting portion 63 and being connected with the Internet lines, from corresponding website Download Info.Acquired sub-information is recorded in (step S77) in the image file of selected master image by control part 65 together with the information of relative position, affiliated partner thing.
And, control part 65, in step S73, when there is not network input, obtains subgraph as sub-information, make the photographed images from lens type camera 51 carry out showing (step S75) in live view image mode, in step S76, carry out the process of photographing etc.This subgraph photography in, under carrying out to word etc. the situation of photographing etc. when Information Photographic, can reading characters be important, can be black and white, contrast also can bring up to not from however easily read.Although comprise spectrum assignment or the control of diaphragm etc. and carry out photography control, however different when can make itself and main photography, easy reading characters can be become or suppress fuzzy photography.Further, black and white or edge enhancing etc. are image procossing, preferably carry out either party in photography control and image procossing or both sides, make the performance as supplementary become master image.Not only when recording, and when the live view image of S75, can be master image by such control break.Like this, in this case, acquired subgraph is recorded in (step S77) in the image file of selected master image by control part 65 together with the information of relative position, affiliated partner thing.
The process that obtains of the sub-information in son-main association mode is carried out in step S81 ~ S87.The process of step S81 ~ S86 is identical with step S71 ~ S76.Acquired sub-information, in step S87, is recorded in recording unit 64 by control part 65.
Other effect is identical with the 1st execution mode.In this embodiment, when obtaining sub-information, owing to being not limited to image information, thus can recording musical, or can place name be recorded, or can advise that the information shown according to spectral discrimination obtains.Carry out the result of Text region in the picture, as long as " concert " or " concert ", just can supervise music record.In fact this go up and can record, and also can download.When detect the mountains and rivers of landscape portion uniqueness, the shape of ocean or color or wave motion etc., sub-information can be set to place name.When place name, as long as obtain the cartographic information cooperated with GPS.About flower and animal etc., suggestion can be carried out in the mode cooperated with illustrated handbook.In these cases, be presented on display part in the form of text, or carry out suggestion by transmission sound.
The effect identical with the 1st execution mode can be obtained so in the present embodiment, and the image that can not only will photograph or the information that recorded are as sub-information, and using the information that obtains from the Internet lines as sub-information, can carry out more effective information record.
And, in the embodiments of the present invention, as the equipment of photography, use digital camera is described, but as camera, can be lens type camera, digital simple eye reflex camera, small digital camera, also can be the camera of the such dynamic image of video camera, video camera, and can certainly be built in the middle cameras such as the portable information terminal such as portable phone, smart phone (PDA:Personal Digital Assist, personal digital assistant).Further, can be the such industry of endoscope, microscope with, therapeutic medical optical device, also can be monitor camera, vehicle-mounted camera, fixed camera, be such as arranged on camera in television receiver, personal computer etc.
The present invention is not limited to the respective embodiments described above, can implementation phase in the scope not deviating from purport of the present invention, distortion is carried out to inscape and specializes.Further, appropriately combined by inscape multiple disclosed in the respective embodiments described above, various invention can be formed.Such as, some inscapes can be deleted from the whole inscapes shown in execution mode.And, can be appropriately combined by the inscape in different execution mode.
In addition, about the motion flow in the scope of claim, specification and accompanying drawing, use " first ", " then " etc. to be described for convenience's sake, but and do not mean that and must implement by this order.Further, each step forming these motion flows, for the part not affecting invention essence, can suitably be omitted certainly.
Further, the control in the technology illustrated here, mainly illustrated in flow charts and function can be set by program mostly, performing this program, can realize above-mentioned control and function by being obtained by computer.This program can by it overall or part of records or be stored in following computer program, namely, floppy disk, CD-ROM etc., nonvolatile memory etc. removable medium, hard disk, volatile memory etc. storage medium in, can carry out circulating or providing when product is delivered or via removable medium or communication line.User is via this program of downloaded and be installed in computer, or is installed in computer from recording medium, thus easily can realize the photographic equipment of present embodiment.
Claims (8)
1. a photographic equipment, is characterized in that, described photographic equipment has:
Recording control part, the photographed images of subject can be recorded as master image by it;
Position and object detection unit, it sets the relative position in described master image and at least one party in affiliated partner thing; And
Association control part, it obtains the sub-information be associated with the described relative position set by described position and object detection unit and affiliated partner thing, controls described recording control part, and get up described master image and described sub-information association record.
2. photographic equipment according to claim 1, is characterized in that,
Described association control part controls image pickup part, carries out image procossing, obtain the image after image procossing as described sub-information to control diverse ways pair with the photography of described master image with the image that described relative position associates with affiliated partner thing.
3. photographic equipment according to claim 1 and 2, is characterized in that,
Described photographic equipment has display control unit, this display control unit for showing described master image,
At least one party that described position and object detection unit are designated position and set in described relative position and affiliated partner thing in shown described master image.
4. photographic equipment according to claim 3, is characterized in that,
Described display control unit carries out the suggestion display of subgraph photography when the photography of described master image.
5. photographic equipment according to claim 1 and 2, is characterized in that,
Described association control part records described sub-information accordingly for each described relative position or described affiliated partner thing.
6. photographic equipment according to claim 1 and 2, is characterized in that,
Described association control part obtains described sub-information for the described master image of having taken.
7. photographic equipment according to claim 1 and 2, is characterized in that,
Acquired described sub-information distribution is given the described master image of shooting by described association control part.
8. an image recording process, is characterized in that, described image recording process has:
Obtain step, obtain the photographed images of subject as master image:
Position and object determination step, set the relative position in described master image and at least one party in affiliated partner thing; And
Associated steps, obtain the sub-information be associated with described relative position set in described position and object determination step and affiliated partner thing, get up described master image and described sub-information association record.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2014-034511 | 2014-02-25 | ||
| JP2014034511A JP2015159511A (en) | 2014-02-25 | 2014-02-25 | Photographing apparatus and image recording method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104869302A true CN104869302A (en) | 2015-08-26 |
| CN104869302B CN104869302B (en) | 2019-06-28 |
Family
ID=53914789
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510075125.5A Expired - Fee Related CN104869302B (en) | 2014-02-25 | 2015-02-12 | Photographic equipment and image recording process |
Country Status (2)
| Country | Link |
|---|---|
| JP (1) | JP2015159511A (en) |
| CN (1) | CN104869302B (en) |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH05284448A (en) * | 1991-12-20 | 1993-10-29 | Kyocera Corp | Electronic still camera |
| JP2006197579A (en) * | 1998-05-20 | 2006-07-27 | Fuji Photo Film Co Ltd | Method and device for reproducing image |
| JP2007068045A (en) * | 2005-09-01 | 2007-03-15 | Sony Corp | Additional information communication system, imaging apparatus, and method of automatically recording object additional information |
| CN101017696A (en) * | 2005-07-06 | 2007-08-15 | 索尼株式会社 | Tag information generating apparatus, tag information generating method, and recording medium |
| CN101275854A (en) * | 2007-03-26 | 2008-10-01 | 日电（中国）有限公司 | Method and equipment for updating map data |
| CN101411187A (en) * | 2006-04-05 | 2009-04-15 | 奥林巴斯株式会社 | Electronic still camera and image processing method |
| CN101584205A (en) * | 2007-01-15 | 2009-11-18 | 松下电器产业株式会社 | Imaging device |
| JP2010050757A (en) * | 2008-08-21 | 2010-03-04 | Kwansei Gakuin | Information providing method and information providing system |
| CN101867706A (en) * | 2009-04-20 | 2010-10-20 | 三洋电机株式会社 | The data structure of camera head and image file |
| CN102457778A (en) * | 2010-10-27 | 2012-05-16 | 巴比禄股份有限公司 | Tag information management apparatus, tag information management system, computer readable medium, and tag information management method |
| CN102749966A (en) * | 2011-04-19 | 2012-10-24 | 富士施乐株式会社 | Image processing apparatus, image processing system, image processing method |
| CN105229999A (en) * | 2013-03-28 | 2016-01-06 | 日本电气株式会社 | Image recording structure, image recording process and program |
-
2014
- 2014-02-25 JP JP2014034511A patent/JP2015159511A/en active Pending
-
2015
- 2015-02-12 CN CN201510075125.5A patent/CN104869302B/en not_active Expired - Fee Related
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH05284448A (en) * | 1991-12-20 | 1993-10-29 | Kyocera Corp | Electronic still camera |
| JP2006197579A (en) * | 1998-05-20 | 2006-07-27 | Fuji Photo Film Co Ltd | Method and device for reproducing image |
| CN101017696A (en) * | 2005-07-06 | 2007-08-15 | 索尼株式会社 | Tag information generating apparatus, tag information generating method, and recording medium |
| JP2007068045A (en) * | 2005-09-01 | 2007-03-15 | Sony Corp | Additional information communication system, imaging apparatus, and method of automatically recording object additional information |
| CN101411187A (en) * | 2006-04-05 | 2009-04-15 | 奥林巴斯株式会社 | Electronic still camera and image processing method |
| CN101584205A (en) * | 2007-01-15 | 2009-11-18 | 松下电器产业株式会社 | Imaging device |
| CN101275854A (en) * | 2007-03-26 | 2008-10-01 | 日电（中国）有限公司 | Method and equipment for updating map data |
| JP2010050757A (en) * | 2008-08-21 | 2010-03-04 | Kwansei Gakuin | Information providing method and information providing system |
| CN101867706A (en) * | 2009-04-20 | 2010-10-20 | 三洋电机株式会社 | The data structure of camera head and image file |
| CN102457778A (en) * | 2010-10-27 | 2012-05-16 | 巴比禄股份有限公司 | Tag information management apparatus, tag information management system, computer readable medium, and tag information management method |
| CN102749966A (en) * | 2011-04-19 | 2012-10-24 | 富士施乐株式会社 | Image processing apparatus, image processing system, image processing method |
| CN105229999A (en) * | 2013-03-28 | 2016-01-06 | 日本电气株式会社 | Image recording structure, image recording process and program |
Also Published As
| Publication number | Publication date |
|---|---|
| JP2015159511A (en) | 2015-09-03 |
| CN104869302B (en) | 2019-06-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8599251B2 (en) | Camera | |
| KR100596910B1 (en) | Image display controlling method, and image display controlling apparatus | |
| JP6223534B2 (en) | Imaging device, imaging method, and imaging control program | |
| JP2007027945A (en) | Photographing information presenting system | |
| KR100733095B1 (en) | Information processing apparatus and information processing method | |
| JP6108755B2 (en) | Shooting device, shot image transmission method, and shot image transmission program | |
| JP2007096379A (en) | Imaging apparatus, image recording and retrieving apparatus and program | |
| KR20070086615A (en) | Apparatus, method and program for information processing | |
| JP2003111009A (en) | Electronic album editing device | |
| JP2004247983A (en) | Photographing apparatus, image processing apparatus, and image processing program | |
| JP5874982B2 (en) | Image processing apparatus, image processing method, and program | |
| JP4989362B2 (en) | IMAGING DEVICE, THROUGH IMAGE DISPLAY METHOD, AND CAPTURED IMAGE RECORDING METHOD | |
| JP4870503B2 (en) | Camera and blog management system | |
| JP5337420B2 (en) | Video search device, video search method, and computer program | |
| JP2008066886A (en) | Camera, communication control device, photography technical assistance system, photography technical assistance method, program | |
| KR102138835B1 (en) | Apparatus and method for providing information exposure protecting image | |
| JP4889554B2 (en) | Camera, content creation method, and program | |
| JP4891123B2 (en) | Image display device, image display method, and program | |
| CN104869302B (en) | Photographic equipment and image recording process | |
| JP2010257266A (en) | Content output system, server device, device, method, and program for outputting content, and recording medium storing the content output program | |
| JP4876736B2 (en) | Document camera device | |
| WO2022158201A1 (en) | Image processing device, image processing method, and program | |
| JP2017092528A (en) | Imaging apparatus, imaging method, image management system, and program | |
| JP5249090B2 (en) | Display device | |
| JP2017017471A (en) | Information processing system, and control method and program thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20151117 Address after: Tokyo, Japan Applicant after: OLYMPUS Corp. Address before: Tokyo, Japan Applicant before: OLYMPUS Corp. Applicant before: Olympus Imaging Corp. |
|
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20211220 Address after: Tokyo, Japan Patentee after: Aozhixin Digital Technology Co.,Ltd. Address before: Tokyo, Japan Patentee before: OLYMPUS Corp. |
|
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20190628 Termination date: 20220212 |