JP2006166012A - Imaging apparatus, and control method and program for imaging apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging apparatus, and a control method and program for the imaging apparatus whereby any user can easily photograph an image with high reproducibility corresponding to a key image without the need for carrying out complicated image recognition processing or the like. <P>SOLUTION: A digital camera includes: a display section 22 for displaying an image; a lens optical system 12 for photographing the image; an imaging section including a CCD 13; a built-in memory 29 for registering the image obtained by the imaging section as the key image; and a control section 22 that displays the registered key image on the screen of the display section 25 in a translucent state, overlaps the image of the object imaged by the imaging section on the key image in the translucent state, displays the overlapped image on the display section 25, collates the coincidence of the two images, and executes preset processes. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an imaging apparatus suitable for, for example, a digital camera or a mobile phone with a camera function, a method for controlling the imaging apparatus, and a program.

In a small electronic device with a camera function, for example, a wristwatch, an image captured in advance is registered as a secret key (password), and when a match is obtained by collating with a newly captured image, the secret state of the operation is set. A technology that applies the display of the secret information and the like is applied. (For example, Patent Document 1)
JP 2001-195146 A

  However, the present invention is not limited to the technique described in the above-mentioned Patent Document 1. In the case of a newly captured image and an already registered image, various shooting conditions such as a zoom lens zoom may be used even if the subject is actually the same. It is conceivable that the position, light source, composition, and the like are different, and it is very difficult to reproduce and photograph the same image as the registered key image.

  For this reason, it is possible to easily assume that the secret image cannot be canceled because the coincidence with the key image is not obtained even though the correct subject is photographed.

  In order to solve this situation, it may be possible to increase the accuracy of pattern matching between images by executing more complex image processing. However, both the hardware and software burden will increase, and one function will be realized. The cost required to do so will increase significantly.

  The present invention has been made in view of the above circumstances, and the object of the present invention is to enable anyone to easily create a highly reproducible image corresponding to a key image without the need for complicated image recognition processing or the like. It is an object to provide an imaging apparatus capable of taking an image, a method for controlling the imaging apparatus, and a program.

  According to the first aspect of the present invention, there is provided a display unit that displays an image, an imaging unit that captures an image, a registration unit that registers an image obtained by the imaging unit as a key image, and a key image registered by the registration unit. First display control means for displaying in a semi-transparent state on the screen of the display section, and displaying an image of the subject imaged by the imaging means on the screen of the display section superimposed on the key image in the semi-transparent state Second display control means to be matched, collation means for collating a match between the image of the subject imaged by the imaging means and the key image registered by the registration means, and preset according to the collation result of the collation means And a processing means for executing the processed processing.

  According to a second aspect of the present invention, in the first aspect of the present invention, the collating means collates the coincidence of two images at the preset timing.

  According to a third aspect of the present invention, in the first aspect of the present invention, the collating unit collates the coincidence of two images based on a shutter key operation for instructing image capturing by the imaging unit. Features.

  According to a fourth aspect of the present invention, in the first aspect of the present invention, the processing means releases an operation lock state of a predetermined function.

  According to a fifth aspect of the present invention, in the first aspect of the invention, the processing means activates a predetermined function.

  According to a sixth aspect of the invention, in the first aspect of the invention, the registration unit registers a plurality of key images in association with a plurality of functions, and the first display control unit includes the registration unit. One of a plurality of registered key images is displayed in a semi-transparent state on the screen of the display unit, and the processing means executes processing of a function associated with the key image that has been matched by the matching means. It is characterized by doing.

  The invention described in claim 7 has two types of non-volatile memories, the memory built in the apparatus and the memory detachably attached to the apparatus in the invention described in claim 1 or 6, wherein the registration means A key image is registered in a predetermined area of a memory built in the apparatus.

  According to an eighth aspect of the present invention, in the first aspect of the invention, the registration unit registers a photographing condition at the time of photographing a key image together with the key image, and the second display control unit registers the key image together with the key image. The imaging conditions are automatically set by the imaging means.

  The invention according to claim 9 is a method of controlling an imaging apparatus including a display unit that displays an image and an imaging unit that captures an image, and a registration step of registering the image obtained by the imaging unit as a key image; A first display control step of displaying the key image registered in the registration step in a semi-transparent state on the screen of the display unit; and an image of the subject captured by the imaging unit on the screen of the display unit. A second display control step of superimposing and displaying the transparent key image, a collation step of collating a match between the subject image captured by the imaging unit and the key image registered in the registration step, And a processing step of executing a preset process according to the verification result in the verification step.

  According to a tenth aspect of the present invention, there is provided a program executed by a computer incorporated in an imaging apparatus including a display unit that displays an image and an imaging unit that captures an image, and the image obtained by the imaging unit is a key image. A registration step for registering as a first display control step for displaying the key image registered in the registration step in a semi-transparent state on the screen of the display unit; A second display control step for displaying the key image in the semi-transparent state on the screen of the image on the screen, and matching between the image of the subject imaged by the imaging unit and the key image registered in the registration step And a processing step of executing a process set in advance according to a result of the collation in the collation step.

  According to the first aspect of the present invention, since the semi-transparent key image and the currently captured image are displayed superimposed on the screen of the display unit, complicated image recognition processing or the like is performed. Anyone can easily take a highly reproducible image corresponding to the key image without necessity.

  According to the second aspect of the invention, in addition to the effect of the first aspect of the invention, there is no need to perform a key operation or the like, for example, collation is performed every predetermined period, and the usability can be further improved.

  According to the third aspect of the present invention, in addition to the effect of the first aspect of the invention, the user can operate the shutter key in a state in which the user is convinced to more reliably obtain a match between the two images. .

  According to the invention described in claim 4, in addition to the effect of the invention described in claim 1, it is easily realized even with an electronic device having a small number of operation keys for inputting a password, such as a compact digital camera. It becomes possible.

  According to the invention described in claim 5, in addition to the effect of the invention described in claim 1, activation of a predetermined function by key operation can be simplified.

  According to the invention described in claim 6, in addition to the effect of the invention described in claim 1, by registering a different key image for each of a plurality of functions, the user's preference is reflected and used with more attachment As well as greatly restricting the use of the device by non-authorized users.

  According to the invention described in claim 7, in addition to the effect of the invention described in claim 1 or 6, it is possible not only to ensure the operation even when the memory card is removed or replaced, in particular, a plurality of A memory area for registering the key image can be secured in advance.

  According to the eighth aspect of the invention, in addition to the effect of the first aspect of the invention, for example, the zoom position of the zoom lens, the white balance value, the ISO sensitivity, the aperture value, the shutter speed, the flash emission mode, etc. Since the same shooting conditions as the image are automatically set, it is possible to obtain matching of images with higher probability without any burden on the user.

  According to the ninth aspect of the present invention, since the semi-transparent key image and the currently captured image are displayed superimposed on the screen of the display unit, complicated image recognition processing or the like is performed. Anyone can easily take a highly reproducible image corresponding to the key image without necessity.

  According to the tenth aspect of the present invention, since the semi-transparent key image and the currently captured image are superimposed on the screen of the display unit, a complicated image recognition process or the like is performed. Anyone can easily take a highly reproducible image corresponding to the key image without necessity.

(First embodiment)
A first embodiment when the present invention is applied to a digital camera will be described below with reference to the drawings.

FIG. 1 shows a functional configuration of an electronic circuit in the digital camera 10.
In the monitoring (through image display) state in the photographing mode which is the basic mode, the focus position and the aperture position are moved by driving the motor (M) 11, and the rear of the photographing optical axis of the lens optical system 12 including the photographing lens. The CCD 13, which is an image pickup device arranged in the, is scanned and driven by a timing generator (TG) 14 and a CCD driver 15, and outputs a photoelectric conversion output corresponding to a light image formed at regular intervals for one screen.

  The photoelectric conversion output is appropriately gain-adjusted for each primary color component of RGB in the state of an analog value signal, sampled and held by a sample hold circuit (S / H) 16, and digital data by an A / D converter 17. The color process circuit 18 is subjected to color process processing including pixel interpolation processing and γ correction processing to generate a luminance signal Y and color difference signals Cb and Cr (YUV signals), and DMA (Direct Memory). Access) is output to the controller 19.

  The DMA controller 19 once uses the luminance signal Y and the color difference signals Cb and Cr output from the color process circuit 18 by using the composite synchronization signal, the memory write enable signal, and the clock signal from the color process circuit 18 once. And the DMA transfer to the DRAM 21 used as a buffer memory through the DRAM interface (I / F) 20.

  The control unit 22 is composed of a CPU, a ROM in which an operation program executed by the CPU is fixedly stored, a RAM used as a work memory, and the like, and is responsible for the overall control operation of the digital camera 10. After the DMA transfer of the luminance and color difference signals to the DRAM 21 is completed, the luminance and color difference signals (YUV signals) are read from the DRAM 21 via the DRAM interface 20 and written to the VRAM 24 via the display control unit 23.

  The display control unit 23 periodically reads the luminance and color difference signals from the VRAM 24, generates a video signal based on these data, and outputs the video signal to the display unit 25.

  The display unit 25 is composed of a color liquid crystal panel with a backlight, and functions as a monitor display unit (electronic finder) in an image shooting mode, and performs display based on a video signal from the display control unit 23. Thus, an image based on the image information captured by the CCD 13 serving as the image pickup element at that time is displayed in real time (through image display).

  In this way, when a through image that can be captured at that time is displayed on the display unit 25 in real time, when a shutter key that constitutes a part of the key input unit 26 is operated at a timing at which still image capturing is desired, Generate a trigger signal.

  In response to this trigger signal, the control unit 22 cancels the DMA transfer of the luminance and color difference signals for one screen being captured from the CCD 13 at that time to the DRAM 21, and again the aperture value and shutter speed according to appropriate exposure conditions. Then, the CCD 13 is driven to scan to obtain luminance and color difference signals for one screen and transfer them to the DRAM 21. Thereafter, this path is stopped and the state is changed to the storage and storage state.

  In this storage and storage state, the control unit 22 outputs the luminance and color difference signals for one frame written in the DRAM 21 through the DRAM interface 20 for each of Y, Cb, and Cr components of 8 pixels × 8 pixels horizontally. And is written in a JPEG (Joint Photographic Coding Experts Group) circuit 27. The JPEG circuit 27 uses an ADCT (Adaptive Discrete Cosine Transform), an entropy coding system. Data compression is performed by processing such as conversion.

  Then, the obtained code data is read out from the JPEG circuit 27 as a data file of one image, and is fixedly incorporated in the digital camera 10 and a memory card 28 that is detachably mounted as a storage medium of the digital camera 10. Write to either one of the built-in memory 29.

  The memory card 28 is a card-like medium in which a flash memory that is a nonvolatile memory is enclosed. One built-in memory 29 is similarly constituted by a flash memory, but is fixedly mounted on a flexible board or the like in the same manner as other circuits.

  Then, along with the compression processing of the luminance and color difference signals for one frame and the writing of all the compressed data to the memory card 28 or the built-in memory 29, the control unit 22 activates the path from the CCD 13 to the DRAM 21 again.

  As shown in FIG. 2, the built-in memory 29 has “image A” as a common key image corresponding to three functions such as “image reproduction”, “image shooting”, and “image editing”. It is written and stored in a preset file data area. In this key image, arbitrary photographing contents are registered in advance by the user as a correct key for releasing the secret state in which the operation is locked when the function mode is designated.

  The control unit 22 is connected to a key input unit 26, a strobe driving unit 30, and a USB interface (I / F) 31.

  In addition to the shutter key described above, the key input unit 26 includes a power key, a shooting mode key, a playback mode key, a macro key, a strobe key, a menu (MENU) key, a cross key, a set (SET) key, and the like. The signals accompanying these key operations are sent directly to the control unit 22.

  The strobe driving unit 30 charges a large-capacitance capacitor for strobe (not shown) at the time of still image shooting, and then flash-drives the strobe light emitting unit 32 based on the control from the control unit 22.

  The USB interface 31 performs communication control when image data or other data is transmitted / received to / from an external information device, for example, a personal computer, which is wired via the USB connector 33.

  In addition to the normal shooting mode, moving images can be shot by operating the shooting mode key of the key input unit 26. At the time of shooting this moving image, after the shutter key of the key input unit 26 is operated for the first time, the above-described storage of the still image data in the memory card 28 or the built-in memory 29 is executed continuously in time. When a second operation of the shutter key is performed or a predetermined time limit, for example, 30 seconds elapses, a series of still image data stored in the memory card 28 or the built-in memory 29 is transferred to the motion JPEG Re-store as a movie data file (AVI file).

  In the playback mode, the control unit 22 selectively reads out image data stored in the memory card 28 or the built-in memory 29, and is compressed by a procedure that is completely opposite to the procedure in which data is compressed in the shooting mode by the JPEG circuit 27. The decompressed image data is decompressed, and the decompressed image data is held in the DRAM 21 via the DRAM interface 20, and then the content held in the DRAM 21 is stored in the VRAM 24 via the display control unit 23. 23 periodically reads out the image data, generates RGB signals, and outputs them to the display unit 25.

  If the selected image data is not a still image but a moving image, the reproduction of the individual still image data constituting the selected moving image data file is executed continuously in time, and all the still image data When the reproduction of the video data is finished, only the still image data located at the head of the moving image data is reproduced and displayed until the next reproduction instruction is given.

(Operation of the first embodiment)
Next, the operation of the above embodiment will be described.

  FIG. 3 shows the processing contents when the key image is registered in the built-in memory 29 as shown in FIG. 2, and the control operation is basically an operation program stored in the ROM in the control unit 22 in advance. To execute based on.

  At the beginning, for example, a key image registration is instructed by a combination operation of the menu key of the key input unit 26, the cross key, and the set key (step A01).

When it is determined that the registration is instructed, the through image display state in which the image captured at that time by the CCD 13 is displayed on the display unit 25 as it is, and the image that becomes the key image on the display unit 25 is also taken. A character guide message prompting the shutter key to be saved, for example,
"Please press the shutter to shoot the key image"
Is displayed (step A02), and it is determined whether or not the shutter key is actually operated (step A03), and the process of repeatedly executing the shutter key is awaited.

  When the shutter key is operated, this is determined in step A03, and the image data obtained by photographing and held in the DRAM 21 is fixedly displayed on the display unit 25 for user confirmation (step A04).

  FIG. 4 illustrates the contents of the captured image displayed on the display unit 25 at this time. Here, the case where the user holds the digital camera 10 with the right hand and photographs a part of the palm of the left hand is illustrated. The palm print of the user's left hand can be used as the key image.

At this time, the display unit 25 also displays a character guide message that prompts an instruction to save the displayed image as a key image, for example,
"Do you want to save this image as a key image?
YES → SET / NO → MENU ”
Is displayed (step A05), and it is determined whether or not a key operation for instructing storage is performed according to the guide message or a key operation for not storing is performed (step A06).

  If it is determined that a key operation for not saving is performed, the user has determined that the captured image displayed in step A04 is not a key image. Therefore, a new key image should be captured. Returning to the process from step A02.

  If it is determined in step A06 that a key operation for instructing saving has been performed, the JPEG circuit 27 compresses the image data held in the DRAM 21 as a key image in a predetermined format, and then the above-described figure. As shown in FIG. 2, data is written in a predetermined file area of the built-in memory 29 (step A07).

At the same time, the display unit 25 displays a character guide message indicating that the registration of the key image has been completed, for example,
"Key image registration completed"
Thus, the key image registration process in FIG. 3 is terminated and the original mode is restored.

  Next, the operation at the time of unlocking determination using the key image registered as described above will be described.

  FIG. 5 shows a playback mode in which an image is played back as one of the basic modes after the power is turned on in a state where the key image is registered in the built-in memory 29, and a shooting mode in which an image is shot as one of the basic modes. FIG. 5 shows the details of the unlock determination processing that is automatically transferred to and executed when the image editing mode for editing the image being reproduced from the reproduction mode is entered. The program is executed based on an operation program stored in advance in the ROM.

  Initially, the key image data registered in the built-in memory 29 is read (step B01), and the read image data is developed and held in the DRAM 21, and a translucent image is created from the image and displayed on the display unit 25. (Step B02).

  FIG. 6A illustrates a key image displayed in a semi-transparent state on the display unit 25 at this time. For example, each gradation value of the primary color component RGB of the image shown in FIG. Image data for transflective display can be easily generated by shifting down by a bit (that is, setting the gradation value to 1/2 or 1/4).

  Along with this semi-transparent display of the key image, the display state of the through image that is acquired by the CCD 13 and is displayed as it is on the display unit 25 is set (step B03).

  Thereby, the data of the through image obtained by photographing is displayed on the display unit 25 so as to be superimposed on the semi-transparent key image (step B04). When it is determined whether or not the recognition timing has reached a preset period, for example, 0.5 [seconds] in the state of being displayed in a superimposed manner (step B05), The processing returns to step B03 again.

  FIG. 6B illustrates a through image obtained by photographing at this time, and shows a state in which the user is photographing the palm of his / her left hand in the same manner as when the key image of the digital camera 10 is photographed. For example, as compared with the key image shown in FIGS. 4 and 6A, the focal length position of the zoom lens constituting the lens optical system 12 is larger (telephoto than when the key image is registered). The composition of the lens optical system 12 and the palm of the left hand are closer to each other for at least one of the reasons.

  When the recognition timing set in advance in the process of repetitively executing the processes of steps B03 to B05 and updating the through image by photographing as needed, this is determined by step B05, and image recognition technology, mainly contour extraction technology and pattern matching are determined. The similarity between the key image and the through image is calculated by the technique (step B06).

  Then, it is determined whether or not the two images coincide with each other based on whether or not the calculated similarity is a preset tolerance, for example, 95% or more (step B07). Is less than the preset tolerance, the process returns to step B03.

  In this way, the processes in steps B03 to B07 are repeatedly executed until it is determined that the two images match each other, and the similarity between the two images is automatically calculated and determined to match every time the recognition timing of a predetermined period comes. The user appropriately moves the position of the digital camera 10 with respect to the key image displayed in the semi-transparent state on the display unit 25 so that the through images accurately overlap and coincide with each other to have the same composition.

  Accordingly, when the key image and the through image obtained by photographing coincide with each other, this is determined in step B07, and the subsequent operation is permitted by executing the setting for releasing the locked state (step B08). Then, the process of FIG. 5 is terminated, and the process shifts to any one of the reproduction mode, shooting mode, and image editing mode designated immediately before the process of FIG.

  In this way, the translucent key image and the currently captured image are displayed superimposed on the screen of the display unit 25, so that the user can visually understand the alignment of the captured image. As a result, anyone can easily shoot a highly reproducible image with the same composition corresponding to the key image without having to perform complicated image recognition processing or the like on the apparatus side. .

  Further, since the recognition for comparing the two images is continuously performed at a timing according to a preset cycle, the user does not need to perform any key operation or the like, and the usability can be further improved.

(Other operations of the first embodiment)
Next, the operation at the time of unlock determination using the key image registered in FIG. 7 in place of FIG. 5 will be described.

  Similarly to FIG. 5, FIG. 7 is also a playback mode for performing image playback, which is one of the basic modes after the power is turned on, with the key image registered in the built-in memory 29, and is also one of the basic modes. This shows the details of the unlock determination process that is automatically performed when the mode is switched to the shooting mode for shooting an image and the image editing mode for editing the image being played back from the playback mode. The control operation is executed by the control unit 22 based on an operation program stored in advance in the ROM.

  Initially, the key image data registered in the built-in memory 29 is read (step B01), and the read image data is developed and held in the DRAM 21, and a translucent image is created from the image and displayed on the display unit 25. (Step B02).

  FIG. 6A illustrates a key image displayed in a semi-transparent state on the display unit 25 at this time. For example, each gradation value of the primary color component RGB of the image shown in FIG. Image data for transflective display can be easily generated by shifting down by a bit (that is, setting the gradation value to 1/2 or 1/4).

  Along with this semi-transparent display of the key image, the display state of the through image that is acquired by the CCD 13 and is displayed as it is on the display unit 25 is set (step B03).

  Thereby, the data of the through image obtained by photographing is displayed on the display unit 25 so as to be superimposed on the semi-transparent key image (step B04). It is determined whether or not the shutter key of the key input unit 26 has been operated in the state of being displayed in a superimposed manner (step B05 ′). If it is determined that the shutter key has not been operated, the process returns to step B03 again.

  FIG. 6B illustrates a through image obtained by photographing at this time, and shows a state in which the user is photographing the palm of his / her left hand in the same manner as when the key image of the digital camera 10 is photographed. For example, as compared with the key image shown in FIGS. 4 and 6A, the focal length position of the zoom lens constituting the lens optical system 12 is larger (telephoto than when the key image is registered). The composition of the lens optical system 12 and the palm of the left hand are closer to each other for at least one of the reasons.

  In the process of repetitively executing the processing of steps B03 to B05 and updating the through image by photographing at any time, the user performs a shutter key when he / she is convinced that the through image exactly matches the key image. This is determined in step B05 ′ for the operation, and the similarity between the key image and the through image is calculated by the image recognition technique, mainly the contour extraction technique and the pattern matching technique (step B06).

  Then, it is determined whether or not the two images coincide with each other based on whether or not the calculated similarity is a preset tolerance, for example, 95% or more (step B07). Is determined to be equal to or greater than the preset tolerance, the subsequent operation is permitted by executing the setting for releasing the lock state (step B08), and the processing of FIG. Transition is made to any one of the reproduction mode, photographing mode, and image editing mode designated immediately before the processing of FIG.

  In this way, since the timing for performing the matching determination between the two images can be instructed according to the user's intention, the matching between the two images can be obtained more reliably by operating the shutter key in a state in which the user is satisfied.

(Second Embodiment)
A second embodiment when the present invention is applied to a digital camera will be described below with reference to the drawings.

  Note that the functional configuration of the electronic circuit in the digital camera is basically the same as that in FIG. 1 described above, and the same parts are denoted by the same reference numerals and the illustration and description thereof are omitted.

  In addition, as shown in FIG. 8, the built-in memory 29 has a predetermined function, for example, “image A” as a common key image corresponding to three functions of “image reproduction”, “image shooting”, and “image editing”. “Key image B” and “key image C” are individually written and stored in a preset file data area. In these key images, arbitrary photographing content is registered in advance by the user as a correct key for releasing the secret state in which the operation is locked when each of the function modes is designated.

(Operation of Second Embodiment)
Next, the operation of the above embodiment will be described.

  FIG. 9 shows the processing contents when the key image is registered in the built-in memory 29 as shown in FIG. 8, and the control operation is basically an operation program stored in the ROM in advance by the control unit 22. To execute based on.

  At the beginning, it waits for an instruction to register the key image by, for example, a combination operation of the menu key of the key input unit 26, the cross key, and the set key (step C01).

When it is determined that registration is instructed, a list of functions for registering a key image next and a character guide message that prompts to select one of them, for example,
"Image playback
Image shooting
edit a picture
Please select any function
↑, ↓ / Selection → SET ”
(Step C02) and waits for any one of the functions to be set (step C03).

If one of these functions is selected and instructed, this is determined in step C03, and the through image display state in which the image captured at that time by the CCD 13 is displayed on the display unit 25 as it is is displayed. A character guide message that prompts the display unit 25 to operate the shutter key to capture and store an image as a key image corresponding to the function, for example,
"Please press the shutter to shoot the key image"
Is displayed (step C04), and it is determined whether or not the shutter key has actually been operated (step C05). The process of repeatedly executing the shutter key is awaited.

  When the shutter key is operated, this is determined in step C05, and the image data obtained by photographing and held in the DRAM 21 is fixedly displayed on the display unit 25 for user confirmation (step C06).

  FIG. 4 illustrates the contents of the captured image displayed on the display unit 25 at this time. Here, the case where the user holds the digital camera 10 with the right hand and photographs a part of the palm of the left hand is illustrated. The palm print of the user's left hand can be used as the key image.

At this time, the display unit 25 also displays a character guide message prompting an instruction to save the displayed image as a key image of the selected function, for example,
“This image is
Do you want to save it as a key image?
YES → SET / NO → MENU ”
Is displayed (step C07), and it is determined whether or not a key operation for instructing saving is performed according to the guide message or a key operation for not storing is performed (step C08).

  If it is determined that the key operation for not saving is performed, the user has determined that the captured image displayed in step C06 is not the key image of the function, so a new key image is captured. Return to the process from step C04 to execute.

  If it is determined in step C08 that a key operation for instructing storage has been performed, the JPEG circuit 27 performs data compression in a predetermined format so as to register the image data held in the DRAM 21 as a key image of the function that has been selected and instructed. After that, as shown in FIG. 8, the data is written in a predetermined file area assigned to the corresponding function of the built-in memory 29 (step C09).

At the same time, in the display unit 25, a character guide message that asks the user whether the registration of the key image of the selected function has been completed and whether to continue the registration of the key image for other functions, for example,
“Registration of key image for XXX (function name) completed. Do you want to move to registration of key images for other functions?
YES → SET / NO → MENU ”
(Step C10), it is determined whether a key operation for continuing the registration of the key image has been performed or a key operation for ending without continuing is performed according to the guide message (step C10). C11).

  Here, when the key operation for continuing is performed, it returns to the process from said step C02 again.

In this way, a different key image for each function is written in a predetermined area assigned for each function of the built-in memory 29.

  When the key images for all functions have been registered in the built-in memory 29 and the key operation for ending the registration operation has already been performed, this is determined in step C11. Each key image registration process is terminated and the original mode is restored.

  Next, the operation at the time of unlock determination using the key image registered for each function as described above will be described.

  FIG. 10 shows a state in which a key image for each function is registered in the built-in memory 29. When the power is turned on, the digital camera 10 automatically shifts and executes when at least one function is in a locked state. The contents of the determination process are shown, and the control operation is executed by the control unit 22 based on an operation program stored in advance in the ROM.

Initially, a character guide message that prompts the user to specify a function to be unlocked among a plurality of locked functions, for example,
"Image playback
Image shooting
edit a picture
Please select one of the functions to unlock
↑, ↓ / Selection → SET ”
As shown on the display unit 25 (step D01), and waits for any one of the functions to be designated (step D02).

  If one of the functions is designated, it is determined in step D02, and data corresponding to the designated function is read out from the plurality of key images registered in the built-in memory 29 (step D03). The read image data is developed and held in the DRAM 21, and a translucent image is created from the image and displayed on the display unit 25 (step D04).

  FIG. 6A illustrates a key image displayed in a semi-transparent state on the display unit 25 at this time. For example, each gradation value of the primary color component RGB of the image shown in FIG. Image data for transflective display can be easily generated by shifting down by a bit (that is, setting the gradation value to 1/2 or 1/4).

  Along with this semi-transparent display of the key image, the display state of the through image that is acquired by the CCD 13 and displayed as it is on the display unit 25 is set (step D05).

  Thereby, the data of the through image obtained by photographing is displayed on the display unit 25 so as to be superimposed on the semi-transparent key image (step D06). When it is determined whether or not the recognition timing has reached a preset cycle, for example, 0.5 [seconds] in a state of being displayed in a superimposed manner (step D07), The processing returns to step D05 again.

  FIG. 6B illustrates a through image obtained by photographing at this time, and shows a state in which the user is photographing the palm of his / her left hand in the same manner as when the key image of the digital camera 10 is photographed. For example, as compared with the key image shown in FIGS. 4 and 6A, the focal length position of the zoom lens constituting the lens optical system 12 is larger (telephoto than when the key image is registered). The composition of the lens optical system 12 and the palm of the left hand are closer to each other for at least one of the reasons.

  When the recognition timing set in advance in the process of repetitively executing the processes of steps D05 to D07 and updating the through image by photographing as needed, this is determined by step D07, and the image recognition technique, mainly the contour extraction technique and pattern matching are determined. The similarity between the key image and the through image is calculated by the technique (step D08).

  Then, it is determined whether or not the two images match based on whether or not the calculated similarity is a preset tolerance, for example, 95% or more (step D09). Is less than the preset tolerance, the process returns to step D05.

  In this way, the processes in steps D05 to D09 are repeatedly executed until it is determined that the two images match each other, and the similarity between the two images is automatically calculated and determined to match each time the recognition timing of the predetermined period comes. The user appropriately moves the position of the digital camera 10 with respect to the key image displayed in the semi-transparent state on the display unit 25 so that the through images accurately overlap and coincide with each other to have the same composition.

  Therefore, when the key image and the through image obtained by photographing coincide with each other, this is determined in step D07, and setting for releasing the lock state relating to the operation of the function is executed, so that the operation is permitted for the function thereafter. (Step D10), the processing of FIG. 10 is finished as described above, and the operation is shifted to the function with the function released from the locked state.

  Further, when it is desired to release the lock of another function in the locked state and execute the function, the process of FIG. 10 is executed in the same manner.

  Thus, in addition to the effects of the first embodiment, by registering different key images for each of a plurality of functions, the user's preference is reflected, and the digital camera 10 is used more lovingly. And the use of the device by other than authorized users can be greatly restricted.

  Further, since the recognition for comparing the two images is continuously performed at a timing according to a preset cycle, the user does not need to perform any key operation or the like, and the usability can be further improved.

(Other operations of the second embodiment)
Next, the operation at the time of unlock determination using the key image registered in FIG. 11 instead of FIG. 10 will be described.

  Similarly to FIG. 10, FIG. 11 also automatically shifts when the digital camera 10 is in the locked state when the power is turned on with the key image for each function registered in the built-in memory 29. The unlocking determination processing content to be executed is shown, and the control operation is executed by the control unit 22 based on an operation program stored in advance in the ROM.

Initially, a character guide message that prompts the user to specify a function to be unlocked from among a plurality of locked functions, for example,
"Image playback
Image shooting
edit a picture
Please select one of the functions to unlock
↑, ↓ / Selection → SET ”
As shown on the display unit 25 (step D01), and waits for any one of the functions to be designated (step D02).

  If one of the functions is designated, it is determined in step D02, and data corresponding to the designated function is read out from the plurality of key images registered in the built-in memory 29 (step D03). The read image data is developed and held in the DRAM 21, and a translucent image is created from the image and displayed on the display unit 25 (step D04).

  FIG. 6A illustrates a key image displayed in a semi-transparent state on the display unit 25 at this time. For example, each gradation value of the primary color component RGB of the image shown in FIG. Image data for transflective display can be easily generated by shifting down by a bit (that is, setting the gradation value to 1/2 or 1/4).

  Along with this semi-transparent display of the key image, the display state of the through image that is acquired by the CCD 13 and displayed as it is on the display unit 25 is set (step D05).

  Thereby, the data of the through image obtained by photographing is displayed on the display unit 25 so as to be superimposed on the semi-transparent key image (step D06). It is determined whether or not the shutter key of the key input unit 26 has been operated in the state of being displayed in a superimposed manner (step D07 '). If it is determined that the shutter key has not been operated, the process returns to step D05.

  FIG. 6B illustrates a through image obtained by photographing at this time, and shows a state in which the user is photographing the palm of his / her left hand in the same manner as when the key image of the digital camera 10 is photographed. For example, as compared with the key image shown in FIGS. 4 and 6A, the focal length position of the zoom lens constituting the lens optical system 12 is larger (telephoto than when the key image is registered). The composition of the lens optical system 12 and the palm of the left hand are closer to each other for at least one of the reasons.

  In the process of repetitively executing the processing of steps D05 to D07 and updating the through image by photographing at any time, the user performs a shutter key when he / she is convinced that the through image exactly matches the key image. This is determined in step D07 ′ for the operation, and the similarity between the key image and the through image is calculated by the image recognition technique, mainly the contour extraction technique and the pattern matching technique (step D08).

  Then, it is determined whether or not the two images match based on whether or not the calculated similarity is a preset tolerance, for example, 95% or more (step D09). Is determined to be equal to or greater than the preset tolerance, the subsequent operation is permitted by executing the setting for releasing the locked state (step D10), and the processing of FIG. The operation shifts to a function based on the unlocked function.

  Further, when it is desired to release the lock of another function in the locked state and execute the function, the process of FIG. 10 is executed in the same manner.

  In this way, since the timing for performing the matching determination between the two images can be instructed according to the user's intention, the matching between the two images can be obtained more reliably by operating the shutter key in a state in which the user is satisfied.

  In the first and second embodiments, since the key image is used as a secret key to release the lock state, the number of operation keys for inputting a password, such as a compact digital camera, is used. Even an electronic device with a small amount can be easily realized.

  In the first and second embodiments, the key image is registered in order to release the lock corresponding to the predetermined function. However, the shooting condition data obtained at the time of shooting the key image is used. Specifically, the zoom position, white balance value, ISO sensitivity, aperture value, shutter speed, strobe flashing mode, etc. of the zoom lens constituting the lens optical system 12 are registered in the built-in memory 29 together with the key image, and built-in. When the key image is read from the memory 29, the condition data is also read at the same time so that the shooting environment for obtaining the through image data including the lens optical system 12 and the CCD 13 is the same as that for the corresponding key image shooting. By automatically setting to, it is possible to obtain a match between two images with higher probability without any burden on the user.

  Furthermore, in the first and second embodiments, a memory card 28 that is detachable from the digital camera 10 as a storage medium for storing image data, and a built-in memory 29 that is fixedly provided in the digital camera 10 are provided. It is assumed that two key images are used and the key image is stored in an area provided in advance in the built-in memory 29. However, when the memory card 28 is removed from the digital camera 10 or the memory card 28 is replaced and attached. Even in this case, the key image data is not lost, and the operation can be surely ensured. In addition, as described in the second embodiment, a plurality of key images are registered corresponding to each function. A memory area can be secured in advance.

  In the first and second embodiments, the key image is used for releasing the lock state. However, the present invention is not limited to this, and other processing, for example, activation of a predetermined function, It can also be used for confirmation to avoid accidental erasure of data, and any device having a camera function can be executed instead of performing key operations, etc. it can.

  The first and second embodiments have been described with respect to a case where the present invention is applied to a digital camera. However, the present invention is not limited to this, and the present invention is not limited to this. Portable devices), handheld terminals with cameras, personal computers with cameras, video movie cameras, body action-related video game software, and other electronic devices having various camera functions, their control methods, and operation programs can be easily applied. Of course.

  In addition, the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the scope of the invention.

  Further, the above embodiments include inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some constituent elements are deleted from all the constituent elements shown in the embodiment, at least one of the problems described in the column of the problem to be solved by the invention can be solved, and described in the column of the effect of the invention. In a case where at least one of the obtained effects can be obtained, a configuration in which this configuration requirement is deleted can be extracted as an invention.

1 is a block diagram showing a functional configuration of an electronic circuit of a digital camera according to a first embodiment of the present invention. The figure which illustrates the key image registered into the built-in memory of FIG. 1 which concerns on the embodiment. The flowchart which shows the processing content at the time of the key image registration by the control part which concerns on the embodiment. The figure which illustrates the display part screen at the time of the key image registration which concerns on the embodiment. The flowchart which shows the processing content at the time of the lock release determination by the control part which concerns on the embodiment. The figure which illustrates the display part screen at the time of the lock release determination which concerns on the same embodiment. The flowchart which shows the other processing content at the time of the lock release determination by the control part which concerns on the embodiment. The figure which illustrates the key image for every function registered into the built-in memory of FIG. 1 which concerns on the 2nd Embodiment of this invention. The flowchart which shows the processing content at the time of the key image registration for every function which concerns on the embodiment. The flowchart which shows the processing content at the time of the lock release determination which concerns on the embodiment. The flowchart which shows the other processing content at the time of the lock release determination which concerns on the embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 ... Digital camera, 11 ... Motor (M), 12 ... Lens optical system, 13 ... CCD, 14 ... Timing generator (TG), 15 ... CCD driver, 16 ... Sample hold circuit (S / H), 17 ... A / D converter, 18 ... color process circuit, 19 ... DMA controller, 20 ... DRAM interface (I / F), 21 ... DRAM, 22 ... control unit, 23 ... display control unit, 24 ... VRAM, 25 ... display unit, 26: Key input unit, 27: JPEG circuit, 28 ... Memory card, 29 ... Built-in memory, 30 ... Strobe drive unit, 31 ... USB interface (I / F), 32 ... Strobe light emitting unit, 33 ... USB connector, SB ... System bus.

Claims (10)

A display for displaying an image;
Imaging means for taking an image;
Registration means for registering an image obtained by the imaging means as a key image;
First display control means for displaying the key image registered by the registration means on the screen of the display section in a semi-transparent state;
Second display control means for displaying an image of a subject imaged by the imaging means on the screen of the display unit so as to be superimposed on the semi-transparent key image;
Collating means for collating a match between the image of the subject imaged by the imaging means and the key image registered by the registration means;
An image pickup apparatus comprising: processing means for executing processing set in advance according to the collation result of the collation means.   The imaging apparatus according to claim 1, wherein the collating unit collates a match between the two images at the preset timing.   2. The imaging apparatus according to claim 1, wherein the collating unit collates the coincidence of the two images based on a shutter key operation for instructing image capturing by the imaging unit.   The imaging apparatus according to claim 1, wherein the processing unit releases an operation lock state of a predetermined function.   The imaging apparatus according to claim 1, wherein the processing unit activates a predetermined function. The registration means registers a plurality of key images in association with a plurality of functions,
The first display control unit displays one of a plurality of key images registered by the registration unit on the screen of the display unit in a semi-transparent state,
The imaging apparatus according to claim 1, wherein the processing unit executes processing of a function associated with the key image whose match is verified by the verification unit. There are two types of non-volatile memory, a memory built into the device and a memory that is detachably attached to the device,
7. The imaging apparatus according to claim 1, wherein the registration unit registers a key image in a predetermined area of a memory built in the apparatus. The registration means registers the shooting conditions at the time of key image shooting together with the key image,
The imaging apparatus according to claim 1, wherein the second display control unit automatically sets the imaging condition registered together with the key image by the imaging unit. A method for controlling an imaging apparatus including a display unit that displays an image and an imaging unit that captures an image,
A registration step of registering an image obtained by the imaging unit as a key image;
A first display control step for displaying the key image registered in the registration step on the screen of the display unit in a semi-transparent state;
A second display control step of displaying an image of a subject imaged by the imaging unit on the screen of the display unit so as to be superimposed on the translucent key image;
A collation process for collating a match between the image of the subject imaged by the imaging unit and the key image registered in the registration process;
A control method for an imaging apparatus, comprising: a processing step of executing a process set in advance according to a matching result in the matching step. A program executed by a computer built in an imaging device including a display unit that displays an image and an imaging unit that captures an image,
A registration step of registering an image obtained by the imaging unit as a key image;
A first display control step for displaying the key image registered in the registration step on the screen of the display unit in a semi-transparent state;
A second display control step for displaying an image of the subject imaged by the imaging unit on the screen of the display unit so as to be superimposed on the semi-transparent key image;
A collation step for collating a match between the image of the subject imaged by the imaging unit and the key image registered in the registration step;
A program for causing a computer to execute a processing step for executing a process set in advance in accordance with a collation result in the collation step.

Images