JP2011095980A - Electronic equipment - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide electronic equipment for increasing the secrecy of photographed image data, and for suppressing manufacturing costs. <P>SOLUTION: The electronic equipment is provided with: a sharpening processing part 71 for sharpening an image, and for emphasizing the neighborhood of a contour section; a similarity derivation part 72 for deriving similarity by collating the sharpened registration image with a collation image; and a collation result determination part 73 for determining whether or not the features of the registration image are matched with the features of the collation image on the basis of the derived similarity. When it is determined that the features of the registration image are matched with the features of the collation image, an operation to the image recorded in a directory corresponding to the registration image is made attainable. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an electronic device.

  In recent years, electronic devices such as PCs (personal computers) and digital cameras have become widespread. This type of electronic device is often shared and used by multiple people such as family members and companies. In such a case, anyone can easily play back, display, copy, delete, edit, etc. the data recorded on the recording medium, so there was a problem with safety in terms of privacy and security. . Therefore, in recent years, electronic devices that consider the confidentiality of data have been proposed. For example, Patent Document 1 discloses an invention related to an imaging device including a shutter button having a fingerprint detection device. The imaging apparatus includes storage means for storing in advance a fingerprint detected by the fingerprint detection function by touching a shutter button having a fingerprint detection function, and the shutter having the fingerprint stored by the storage means and the fingerprint detection function The fingerprint detection function collates with the newly detected fingerprint by touching the button, and when the fingerprint stored in the storage means matches the newly detected fingerprint feature, the image file recorded in the imaging device Allow operation.

JP 2000-115624 A

  According to the invention according to Patent Document 1, a fingerprint detection apparatus for detecting a fingerprint is required. However, providing an electronic device with a biometric authentication device such as a fingerprint detection device increases safety in terms of privacy and security, but this may increase the manufacturing cost of the electronic device.

  The present invention has been made in view of the above problems, and includes a generation unit that generates a folder for storing first data in a recording medium, an association unit that associates second data with the folder, and an association unit. A restriction means for restricting operations on the first data stored in the associated folder, a determination means for determining whether or not the characteristics of the third data and the second data substantially match, and a feature of the determination means And a release means for releasing the restriction state by the restriction means when it is determined that the two substantially match.

  ADVANTAGE OF THE INVENTION According to this invention, the electronic device which can suppress the manufacturing cost of the said electronic device while maintaining the confidentiality of the data which the electronic device acquired can be provided.

It is a block diagram which shows the outline of the internal structure of the imaging device which concerns on this invention. 3 is a flowchart showing an outline of a basic operation during still image shooting of the imaging apparatus according to the present invention. 3 is an illustrative view showing an outline of a folder structure of an external memory 27. FIG. It is an illustration figure which shows the outline of the structure of TABLE. It is an illustration figure which shows the state of the display part of the imaging device at the time of registration image photography and collation image photography. It is a flowchart which shows the outline of the basic operation | movement of a folder lock process. It is a flowchart which shows the outline of the basic operation | movement of a folder lock release process. It is a flowchart which shows the outline of the internal structure of the image collation part 7b. It is a flowchart which shows the outline of the basic operation | movement of an image collation process.

An imaging apparatus according to an embodiment of the present invention will be described with reference to the drawings. The imaging device may be capable of shooting a moving image as long as it can capture a still image.
(Configuration of imaging device)
First, the internal configuration of the imaging apparatus will be described with reference to FIG. FIG. 1 is a block diagram illustrating an internal configuration of the imaging apparatus according to the present embodiment.

  The image pickup apparatus of FIG. 1 images an optical image of a subject and a solid-state image pickup device (image sensor) 1 such as a CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor) sensor that converts incident light into an electrical signal. The lens unit 3 includes a zoom lens that forms an image on the sensor 1, a motor that changes a focal length of the zoom lens, that is, an optical zoom magnification, and a motor that focuses the zoom lens on the subject.

  In addition, the imaging apparatus of FIG. 1 has an AFE (Analog Front End) 5 that converts an image signal that is an analog signal output from the image sensor 1 into a digital signal, and an image signal that is a digital signal from the AFE 5. When shooting a moving image such as JPEG (Joint Photographic Experts Group) compression method for the image signal from the image processing unit 7 when the image processing unit 7 performs various image processing such as gradation correction and a still image is shot. Performs compression coding processing such as MPEG (Moving Picture Experts Group) compression method on the image signal from the image processing unit 7 and the audio signal output from an audio processing unit (not shown) including a sound collecting microphone. A compression processing unit 9; a driver unit 29 that records the compression-encoded signal compression-encoded by the compression processing unit 9 in an external memory 27 such as an SD memory card; and a driver unit 29 A decompression processing unit 11 that decompresses and decodes a compressed encoded signal read from the external memory 27, an LCD (Liquid Crystal Display) that displays an image based on an image signal obtained by decoding by the decompression processing unit 11, and the like And a display unit 13 having.

  In addition, the imaging apparatus in FIG. 1 includes a timing generator (TG) 15 that outputs a timing control signal for making the operation timings of the blocks coincide with each other, and a CPU (Central Processing Unit) 17 that controls the overall driving operation in the imaging apparatus. A memory 19 for storing each program for each operation and temporarily storing data when the program is executed; an operation unit 21 including a shutter button for still image shooting; Is further provided.

  1 further includes a bus 23 for exchanging data between the CPU 17 and each block, and a bus 25 for exchanging data between the memory 19 and each block. Prepare.

  In the lens unit 3, the CPU 17 controls the focus and the diaphragm by driving the motor in accordance with the image signal detected by the image processing unit 7.

The image processing unit 7 further includes an image cutout unit 7a for cutting out a part of an image corresponding to the image signal output from the AFE 5 and an image collation unit 7b for collating the images.
(Basic operation of the imaging device)
Next, with reference to FIG. 2, the basic operation of the imaging apparatus during still image shooting will be described using a flowchart. When the user turns on the power of the imaging apparatus, the driving mode of the imaging apparatus, that is, the driving mode of the image sensor 1 is set to the preview mode (S200). The preview mode is a mode in which an image to be photographed is displayed on the display unit 13 without being recorded, and can be used to determine the photographing object and determine the composition. Next, the camera enters the shooting mode input waiting mode, and a mode suitable for the imaging device function and shooting scene, such as a mode suitable for portrait shooting, a mode suitable for shooting moving objects, and a mode suitable for shooting in backlight, are selected. The When the shooting mode is not input, it is assumed that the normal shooting mode is selected (S202).

In the preview mode, an analog image signal obtained by the photoelectric conversion operation of the image sensor 1 is converted into a digital image signal by the AFE 5, and image processing such as color separation, white balance adjustment, and YUV conversion is performed by the image processing unit 9. Applied to the memory 19. The image signals written in the memory 19 are sequentially displayed on the display unit 13. As a result, a real-time moving image (preview image) representing the shooting area is displayed on the display unit 23.
Subsequently, the user sets the zoom magnification with the optical zoom so that the desired angle of view is obtained with respect to the subject to be imaged (S204). At this time, the lens unit 3 is controlled by the CPU 37 based on the image signal input to the image processing unit 9, and optimal exposure control (Automatic Exposure; AE) and focusing control (Automatic Focus: AF) are performed ( S206). When the user determines the shooting angle of view and composition and presses the shutter button of the operation unit 41 halfway (Yes in S208), the AE is adjusted (S210), and the AF optimization process is performed (S212).

Thereafter, when the shutter button is fully pressed (Yes in S214), a timing control signal is given from the TG 35 to the image sensor 1, the AFE 5, the image processing unit 9, and the compression processing unit 13, and the operation timing of each unit is determined. In synchronization, the drive mode of the image sensor 1 is set to the still image shooting mode (S216), the analog image signal output from the image sensor 1 is converted into a digital image signal by the AFE 5 and stored in the frame memory in the image processing unit 9. Write (S218). This digital signal is read from the frame memory, and various image processing such as signal conversion processing for generating a luminance signal and a color difference signal is performed in the image processing unit 9, and the signal subjected to the image processing is processed in the compression processing unit 13. After being compressed into a JPEG (Joint Photographic Experts Group) format (S220), the compressed image is written in the external memory 47 (S222), and photographing is completed. Then, it returns to preview mode.
(Basic operation of the imaging device)
When it is instructed through the operation unit 21 to reproduce the moving image recorded in the external memory 27, the compressed signal selected for reproduction is read out by the driver unit 29 and provided to the decompression processing unit 17. Then, the decompression processing unit 17 decompresses and decodes the image signal based on the compression coding method to obtain an image signal. Then, the image signal is given to the display unit 13 to reproduce the image. Thereby, an image based on the compressed signal recorded in the external memory 27 is reproduced.
(Folder lock function)
The imaging apparatus according to the present invention has a folder lock function for preventing a person other than the photographer from operating the image file recorded in the external memory 27 without permission. The image file recorded in the folder where the folder is locked is subjected to collation processing to be described later, and operations such as playback, display, copy, deletion, and editing are performed unless the lock is released by the collation processing. Can't do it.

  The folder lock function is realized as follows, for example. FIG. 3 shows a folder hierarchical structure of the external memory 27 of the imaging apparatus according to the present embodiment. Images taken by the imaging apparatus are recorded in the DCIM folder. In the hierarchical structure shown in FIG. 3, a 123ABCDE folder F2 is created below the DCIM folder F1, and a 2009090101 folder F3a and a 2009090102 folder F3b indicating shooting dates are created below the 123ABCDE folder F2, and the shot images are classified by shooting date. And recorded. For example, DCIM0001. jpg means the first image taken on January 1, 2009.

  Also, a NINSYO folder F3c is created in the same hierarchy as the folders F3a and F3b. In the NINSYO folder F3c, a registered image RP photographed at the time of executing the folder lock described later and a TABLE used for releasing the folder lock are stored.

  As shown in FIG. 4, in TABLE, a folder name that is folder-locked and an image file name of a registered image that is captured when the folder lock is executed are recorded in association with each other.

  The registered image RP is, for example, an image including portions with different characteristics such as a human palm, fingerprint, and face. To release the folder lock, a new image is captured, and the registered image and the newly captured image are captured. Authentication is performed by checking the images that have been checked. The release of the folder lock will be described later.

  In this embodiment, it is assumed that the registered image is a person's palm. As a result of the collation, if the palm features included in the registered image match the palm features included in the newly captured collation image, the folder lock is released and the file operation of the image file recorded in the folder is performed. Is possible.

  Here, a folder lock and a method for capturing and registering a registered image will be described. When a user performs an operation for performing folder lock processing via the operation unit 21, a list of folders is displayed on the display unit 13, and the user selects a folder to be locked via the operation unit 21. When the user selects a folder to be locked, the CPU 17 writes the folder name of the selected folder in the TABLE folder name field.

  Subsequently, the imaging device shifts to an authentication image shooting mode. The basic shooting processing operation in the authentication image shooting mode is the same as that in the above-described still image shooting, but a rectangular frame 13a is displayed together with the image obtained through the lens unit in the preview mode as shown in FIG. To do. The user performs shooting by adjusting the shooting composition so that his / her palm fits within the rectangular frame 13a. At this time, the user's palm may be guided to fit within the rectangular frame 13a.

  When the shutter button 21s is pressed, the image processing unit 7 and the compression processing unit 9 perform the above-described processing, and then the partial image included in the rectangular frame 13a is cut out. The cut out partial image is stored in the NINYO of the external memory 27. Record in folder F3c.

  When the palm photographing is completed, the CPU 17 assigns a file name to the photographed image and records it in the NINSYO folder F3c of the external memory 47, and also associates the file name with the selected folder name in the TABLE image file name field. Write to. As a result, file operations on image files recorded in the folder are prohibited.

  If the authentication image shooting mode is canceled without performing the authentication image shooting during the authentication image shooting mode, the CPU 17 deletes the folder name written in the TABLE.

  FIG. 6 is a flowchart showing the folder lock processing operation. When the user performs an operation to lock the folder, the CPU 17 starts the folder locking process and proceeds to step S600.

  In step S600, a list of folders is displayed on the display unit 13. In step S602, it is determined whether a folder to be locked has been selected. If a folder is selected, the process proceeds to step S604, and if not, the process proceeds to step S614.

  In step S604, the folder name of the selected folder is written in the TABLE folder name field. When the writing is completed, the process proceeds to step S606.

  In step S606, the process shifts to a registered image shooting mode. In step S608, it is determined whether an image has been shot. If an image has been taken, the process proceeds to step S610; otherwise, the process proceeds to step S618.

  In step S610, a partial image included in the rectangular frame is cut out from the captured image. In step S612, the cut-out partial image is recorded as a registered image in the external memory 27, and the file name of the registered image is written in the TABLE image file name field in association with the folder name.

  In step S614, the operation on the image file stored in the selected folder is restricted. When the restriction of the operation on the image file is completed, the folder lock process is terminated.

  In step S616, it is determined whether or not folder selection has been canceled. If the folder selection is canceled, the folder lock process is terminated. Otherwise, the process returns to step S602.

  In step S618, it is determined whether shooting of the registered image has been canceled. If the authentication image shooting is canceled, the process proceeds to step S620, and if not, the process returns to step S608.

In step S620, the folder name written in TABLE in step S604 is deleted. When the deletion of the folder name is completed, the folder lock process is terminated.
In this embodiment, the folder to be locked is selected after the authentication image is shot. However, the folder to be locked may be selected after the authentication image is shot.
(Folder unlock function)
The imaging apparatus according to the present invention includes a folder lock release function for releasing the lock applied by the folder lock function. The folder lock is released by performing an authentication process. When the folder lock is released, operations such as reproduction, display, copy, deletion, and editing can be performed on the image files recorded in the folder.

  The folder lock release function is realized as follows, for example. When the user performs an operation for unlocking the folder via the operation unit 21, a list of folders currently locked by the folder is displayed on the display unit 13. When the user selects a folder to be unlocked, the verification image shooting mode is entered.

  In the collation image shooting mode, similarly to the registered image shooting mode, the rectangular frame 13a is displayed together with the image obtained by solving the lens unit in the preview mode. The user performs shooting by adjusting the shooting composition so that the palm fits in the rectangular frame 13a. The captured image is processed by the image processing unit 7 and then output to the image cutout unit 7a. After the partial image included in the rectangular frame 13a is cut out by the image cutout unit 7a, the image verification unit 7b Is output.

  When the collation image capturing is completed, the CPU 17 extracts the registered image from the NINSYO folder F3c based on the registered image file name written in association with the folder selected from TABLE in the NINSYO folder F3c in the external memory 27. Explore.

  When the registered image is found in the NINSYO folder F3c, the image data is read from the external memory 27 through the driver 29, decompressed by the decompression processing unit 11, and then output to the image collation unit 7b. At this time, in order to notify the user what the registered image is, the image may be displayed on the display unit 13 for a certain period of time.

  The image collating unit 7b collates the registered image and the collated image, and determines whether or not the features of the registered image and the collated image match. This collation process will be described later.

  As a result of the collation, when the features of the registered image and the collated image match, the folder is unlocked, and the file operation can be performed on the image recorded in the folder.

  On the other hand, if the characteristics of the registered image and the verification image do not match, an error message is displayed on the display unit 13. After the error message is displayed, the mode again shifts to the collation image shooting mode.

  FIG. 7 is a flowchart showing a folder lock release processing operation. When the user performs an operation to release the folder lock, the CPU 17 starts a folder lock release process and proceeds to step S700.

  In step S700, a list of folders currently locked is displayed on the display unit 13. In step S702, it is determined whether or not a folder to be unlocked has been selected. If a folder has been selected, the process proceeds to step S704, and if not, the process proceeds to step S716.

  In step S704, the process proceeds to the collation image shooting mode. In step S706, it is determined whether or not a collation image has been shot. If a collation image has been captured, the process proceeds to step S708; otherwise, the process proceeds to step S718.

  In step S708, the partial image included in the rectangular frame 13a is cut out from the photographed image, and the cut out image is output to the image matching unit 7b. In step S710, the registered image and the collation image are collated, it is determined whether the features of the images match, and the determination result is output to the CPU 17. In step S712, it is determined whether or not the characteristics of the registered image and the matching image match as a result of the determination. If the features match, the process proceeds to step S714, and if not, the process proceeds to step S720.

  In step S714, the folder lock is released. When the folder lock is released, the folder lock release process is terminated.

  In step S716, it is determined whether or not the folder unlock processing has been canceled. If canceled, the folder unlock processing is terminated, and if not, the process returns to step S702.

  In step S718, it is determined whether or not the collation image capturing has been canceled. If cancelled, the folder unlock processing ends, and if not, the process returns to step S706.

In step S720, error notification is performed. When the error notification is completed, the process returns to step S704.
(Image verification processing)
Here, the image matching process will be described. The image matching process can be realized, for example, by using image pattern matching. A similarity measure SM between the registered image and the matching image is derived using pattern matching. Pattern matching is performed, for example, by a technique described in the second edition of digital image processing (CG-ARTS Association publication, issued on March 1, 2007). The similarity is derived using, for example, SSD (Sum of Squared Difference) or SAD (Sum of Absolute Difference). The similarity value becomes smaller as the images are more similar.

  FIG. 8 is a block diagram schematically showing the internal structure of the image matching unit 7b. The image matching unit 7b includes a sharpening processing unit 71 that emphasizes the vicinity of the edge of the image, a similarity derivation unit 72 that derives a similarity based on the sharpened image, and a matching result determination unit that outputs a matching result based on the similarity. 73 is provided. The sharpening processing unit 71 performs a sharpening process on the output registered image and collation image, and outputs the result to the similarity deriving unit 72. The sharpening process can be realized, for example, by applying a Laplacian filter. A Laplacian filter is a filter that sharpens an image by multiplying a spatial second-order differential value in a neighborhood region of the pixel of interest (for example, a 3 × 3 pixel region centered on the pixel of interest) by a coefficient and subtracting it from the pixel of interest. It is. That is, on both sides of the contour (edge) portion, the bright (in other words, the pixel value is large) portion is brighter, the dark (in other words, the pixel value is small) portion is darker, and the slope of the edge is abrupt. Become. As a result, a sharpened image is obtained.

  The similarity deriving unit 72 derives the similarity SM between the registered image output from the sharpening processing unit 71 and the matching image, and outputs the derived result to the matching result determining unit 73.

  The matching result determination unit 73 determines whether or not the similarity SM output from the similarity deriving unit 72 is equal to or less than a threshold value TH. If the similarity is equal to or less than the threshold value, it is determined that the features of the images match. If the similarity is equal to or greater than the threshold, it is determined that the features of the images do not match. The determination result is output to the CPU 17.

  FIG. 9 is a flowchart showing the image matching processing operation (FIG. 7, S710). In step S900, the registered image and the collation image are subjected to a sharpening process to emphasize pixels near the edge. Each image subjected to the sharpening process is output to the similarity deriving unit 72. In step S902, the similarity SM between the registered image output from the sharpening processing unit 71 and the collation image is derived, and the derivation result is output to the collation result determination unit 73.

  In step 904, it is determined whether or not the similarity SM is below a threshold value TH. If SM ≦ TH, the process proceeds to step S906, and if not, the process proceeds to step S908.

In step 906, it is determined that the characteristics of the registered image and the collation image match, and the determination result is output to the CPU 17. In step S908, it is determined that the characteristics of the registered image and the collation image do not match, and the determination result is output to the CPU 17.
(Summary)
As described above, the electronic device according to the present invention can maintain the confidentiality of the captured image data and can reduce the manufacturing cost of the electronic device.

  In the present embodiment, the palm image is stored as an authentication key for releasing the folder lock. However, the palm feature information may be extracted and stored.

  In addition, as for the collation processing for releasing the folder lock, it is possible to use palm shape authentication for performing collation based on the surface area of the palm, the length of the finger, the position of the joint, etc. instead of pattern matching.

  Moreover, although an imaging apparatus has been described as an example of an embodiment of the present invention, the present invention can also be applied to an electronic device having an imaging function such as a camera-equipped mobile phone, a PC, and an IC recorder. .

  When applied to a PC, an image is prepared in advance on a PC recording medium or a recording medium that can be attached to the PC, the feature portion of the image is specified when the folder is locked, the specified portion is cut out, and the cut-out image is extracted. It may be registered as a registered image. The same processing as described above may be performed when releasing the folder lock. During the folder lock, the confidentiality of the data is ensured by recording the image used for the folder lock on a recording medium removable from the PC and storing the recording medium isolated from the PC.

  When applied to an IC recorder, audio is used for folder locking instead of images. When releasing the folder lock, the voice may be acquired by the IC recorder, and the folder lock may be released when the characteristics of the voice and the voice used for the folder lock match.

  As mentioned above, although one Example of this invention was described, this invention is not limited to these embodiment, A deformation | transformation and change are possible within the range of the summary.

1 Image sensor 3 Lens unit 5 AFE
7 Image processing unit 7a Image cutout unit 7b Image matching unit 9 Compression processing unit 11 Decompression processing unit 13 Display unit 15 TG
17 CPU
19 Memory 21 Operation unit 21 s Shutter button 23 Bus line 25 Bus line 27 External memory 29 Driver part

Claims (6)

Generating means for generating a folder for storing the first data in the recording medium;
Association means for associating second data with the folder;
Restriction means for restricting an operation on the first data stored in the folder associated by the association means;
An electronic device comprising: Determining means for determining whether or not the characteristics of the third data and the second data substantially match;
Release means for releasing the restriction state by the restriction means when it is determined by the determination means that the features are substantially the same;
The electronic apparatus according to claim 1, further comprising:   The second data and the third data are images, and operations on the first data include operations for reproducing an image, operations for displaying an image, operations for copying an image, operations for deleting an image, The electronic apparatus according to claim 1, further comprising at least one of operations for editing an image. First folder selecting means for selecting M (M is an integer of 1 or more and M ≦ N) folders from N (N is an integer of 1 or more) folders;
First receiving means for receiving first data;
Associating means for associating the first data with the M folders selected by the folder selecting means;
Restricting means for restricting operations on data stored in the M folders;
An electronic device comprising: Second folder selecting means for selecting a desired folder from the M folders in the restricted state;
Second receiving means for receiving second data;
A determination unit that collates the first data with the second data and determines whether or not the characteristics substantially match;
Release means for releasing the restriction when the characteristics are substantially matched by the determination means;
The electronic apparatus according to claim 4, further comprising:   6. The electronic apparatus according to claim 4, wherein the operation on the data includes at least one of data execution, data duplication, data deletion, and data editing.