JP2019164707A - Electronic apparatus, control device of electronic apparatus, control program, and control method - Google Patents

Abstract

To reduce the number of special members for fingerprint authentication.SOLUTION: A control device (1) includes a mode determination part (12) for determining whether a sub camera (3) is operated in a fingerprint authentication mode for performing photographing to perform the fingerprint authentication or in a mode different from the fingerprint authentication mode and a fingerprint authentication part (14) for performing the fingerprint authentication by comparing the image of a fingerprint included in a photographed image photographed by the sub camera (3) with a previously registered fingerprint pattern, when it is determined that the sub camera (3) is operated in the fingerprint authentication mode.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an electronic device, a control device for the electronic device, a control program for the electronic device, and a control method for the electronic device.

  In recent years, smartphones with a camera function are widely distributed, and it is possible to use a telephone or browse a WEB site while transmitting and receiving images. Such a smartphone can shoot a subject while displaying a through image on a liquid crystal screen.

  On the other hand, since smartphones store personal information such as telephone numbers and communication records, there is a case where security for such information and prohibition of unauthorized use by others are required. Similarly, even in an electronic still camera, security may be required for unauthorized use and captured images.

  In order to solve the above-described problem, Patent Document 1 discloses a mobile phone that enables use restriction and protection of recorded information with a simple configuration. This mobile phone has a lens unit and an image sensor, has a camera function, can be stored in a housing, and can be touched by a user's finger when moved. A fingerprint collation unit that photographs the fingerprint of the finger that has been captured by the lens unit and the image sensor and collates based on the captured image whether the fingerprint is the same as the registered fingerprint or not is provided. Further, when the fingerprint collation unit determines that the fingerprint is the same as the registered fingerprint, a limiting function such as a power switch can be used.

JP 2002-77684 A (published on March 15, 2002)

  However, in the mobile phone described in Patent Document 1, special members such as a lens unit and a finger contact member are provided for fingerprint authentication, and the number of special members for such fingerprint authentication is large. There is a problem.

  One embodiment of the present invention has been made in view of the above-described problems, and an object thereof is to realize an electronic device or the like that can reduce the number of special members for fingerprint authentication. .

  In order to solve the above-described problem, an electronic apparatus according to one embodiment of the present invention is an electronic apparatus including at least one imaging device and at least one control device, and the control device includes the imaging device. Is determined to operate in a fingerprint authentication mode for photographing for fingerprint authentication or to operate in a mode different from the fingerprint authentication mode, and when it is determined to operate the imaging device in the fingerprint authentication mode, The fingerprint authentication is performed by comparing a fingerprint image included in a photographed image photographed by the photographing apparatus with a fingerprint pattern registered in advance.

  In order to solve the above-described problem, an electronic device control device according to one embodiment of the present invention is an electronic device control device including at least one photographing device, and the photographing device performs fingerprint authentication. A mode deciding unit that decides whether to operate in a fingerprint authentication mode for photographing or to operate in a mode different from the fingerprint authentication mode, and when it is decided to operate the photographing apparatus in the fingerprint authentication mode, The image forming apparatus includes a fingerprint authentication unit that performs fingerprint authentication by comparing a fingerprint image included in a captured image captured by the image capturing apparatus with a fingerprint pattern registered in advance.

  In order to solve the above problem, an electronic device control method according to one embodiment of the present invention is an electronic device control method including at least one imaging device, and the imaging device performs fingerprint authentication. A mode determining step for determining whether to operate in a fingerprint authentication mode for photographing or to operate in a mode different from the fingerprint authentication mode, and when determining to operate the imaging device in the fingerprint authentication mode, This is a method including a fingerprint authentication step of performing fingerprint authentication by comparing a fingerprint image included in a captured image captured by the imaging apparatus with a fingerprint pattern registered in advance.

  According to one aspect of the present invention, there is an effect that the number of special members for fingerprint authentication can be reduced.

It is a block diagram which shows schematic structure of the portable terminal which concerns on one Embodiment of this invention. It is a flowchart which shows the flow of operation | movement of the said electronic device. (A) is a schematic diagram which shows the external appearance of the conventional portable terminal, (b) is a schematic diagram which shows the external appearance of the portable terminal which concerns on one Embodiment of this invention, (c) is the said book It is a schematic diagram which shows the state which reversed up and down of the portable terminal which concerns on one Embodiment of invention. It is a figure which shows the cross-section of the imaging device with which the said portable terminal is provided.

[Embodiment 1]
Hereinafter, an embodiment of the present invention will be described in detail. As shown in FIG. 1, a portable terminal (electronic device) 10 according to Embodiment 1 of the present invention includes a control device 1, a storage device 2, a sub camera (photographing device) 3, a touch panel 4, a motion sensor 5, a grip sensor 6, A side key (switching button) 7, a microphone (voice input device) 8, and a speaker 9 are provided. The sub camera 3 and the control device 1 may be singular or plural.

  In addition, although the portable terminal 10 shall be provided with the main camera (not shown) other than said sub camera 3, it does not need to be provided with the main camera.

  The main camera (out camera) is a camera for photographing a subject on the opposite side of the touch panel 4 (display screen), and the sub camera (in camera) is a subject on the touch panel 4 side (for example, a mobile terminal). 10 is a camera for photographing the face of the user who holds 10).

  The mobile terminal 10 includes a mobile phone, a PHS (registered trademark) terminal, a PDA (Personal Digital), which has a recording function for recording images, sounds, moving pictures and the like, a shooting function by the sub camera 3 and the like, and a communication function for transmitting and receiving data. Assistant) or a communication terminal device such as a personal computer (PC). In the present embodiment, the mobile terminal 10 will be described by taking a smartphone with a sub camera 3 as an example. Other examples of electronic devices to which the present invention can be applied include digital cameras.

  The mobile terminal 10 of the present embodiment is operated in a fingerprint authentication mode in which a fingerprint is photographed in order to perform fingerprint authentication with the sub camera 3, or a mode different from the fingerprint authentication mode (for example, the normal mode or the subject automatic selection mode). It is possible to switch between.

  In the fingerprint authentication mode, a fingerprint existing at a position near the sub camera 3 is photographed, a fingerprint pattern is extracted from the generated photographed image, and the extracted fingerprint pattern is recorded (registered) in the storage device 2 in advance. In this mode, fingerprint authentication is performed by comparing with a fingerprint pattern.

  Further, the mode different from the fingerprint authentication mode may be any mode as long as the mode is different from the fingerprint authentication mode. The normal mode is, for example, a mode in which a subject located at the center is focused, and usually a subject existing at a position away from the sub camera 3 is photographed. The subject automatic selection mode is a mode for automatically selecting a subject to be focused, for example.

  The control device 1 comprehensively controls the operation of each unit of the mobile terminal 10, and includes a photographing processing unit 11, a mode determination unit 12, a fingerprint detection unit 13, a fingerprint authentication unit 14, a fingerprint pattern registration unit 15, and sensor control. Unit 16, terminal state specifying unit 17, input receiving unit 18, and voice recognition unit 19.

  In the normal mode described above, the photographing processing unit 11 executes processing for generating a photographed image obtained by photographing the subject with the sub camera 3. In addition, in the above-described fingerprint authentication mode, the photographing processing unit 11 executes processing for generating a photographed image including the fingerprint image obtained by photographing the fingerprint with the sub camera 3.

  The mode determination unit 12 causes the sub camera 3 to operate in a fingerprint authentication mode in which a fingerprint existing near the sub camera 3 is photographed to perform fingerprint authentication, or to operate in a mode different from the fingerprint authentication mode. To decide.

  Here, a specific structure of the sub camera 3 will be described with reference to FIG. As shown in the figure, the sub camera 3 includes an optical system such as a camera window (translucent member) 31, a lens 32, and a cover glass 33, and an image sensor 34 such as a charge-coupled device (CCD).

  A camera window 31 that covers the light receiving side of the lens 32 is provided on the opposite side of the imaging element 34 with respect to the lens 32. The camera window 31 is made of tempered glass having translucency. The sub camera 3 can capture an image of the fingerprint while the finger is in contact with or close to the camera window 31.

  The fingerprint detection unit 13 detects a fingerprint from a captured image including a fingerprint image. Specifically, it is determined whether or not there is an object that occupies A% of the image area in the captured image. As a result, when the object exists, it is determined whether or not a fingerprint pattern exists on the object.

  More specifically, when there is an object of 50% or more of the image area in the photographed image, a fingerprint pattern is formed on the object depending on whether or not there is a set of thin lines of 1 mm or less corresponding to the fingerprint in the object. It may be determined whether or not it exists. In addition, when there is an object of 50% or more of the image area in the photographed image, depending on whether or not there are a certain number or more of fingerprint feature points (start point, end point, branch point, junction point, etc.) It may be determined whether a fingerprint pattern exists on the object.

  The fingerprint detection unit 13 extracts (detects) the fingerprint pattern from the captured image when the fingerprint pattern exists on the object. The fingerprint authentication unit 14 performs fingerprint authentication by comparing a fingerprint image included in a photographed image captured by the sub camera 3 with a previously registered fingerprint pattern. Specifically, pattern matching between a fingerprint pattern extracted from a captured image and a pre-registered fingerprint pattern is performed to determine whether or not B% or more matches. As a result, when B% or more matches, it is assumed that the fingerprint authentication is successful. On the other hand, if the values match less than B%, it is assumed that fingerprint authentication has failed.

  More specifically, pattern matching may be based on image comparison or feature point matching, and the comparison is not perfect matching. If 50% to 80% or more matches, the pattern is recognized as the same pattern. To do.

  The fingerprint pattern registration unit 15 records (registers) the fingerprint image included in the captured image captured by the sub camera 3 in the storage device 2 as the fingerprint pattern. According to the above configuration, a fingerprint pattern can be registered by photographing a fingerprint with the sub camera 3 included in the mobile terminal 10. Examples of the fingerprint pattern registration method include a method for storing the fingerprint image itself and a method for registering the position information of the feature points of the fingerprint.

  The sensor control unit 16 controls the operations of the motion sensor 5 and the grip sensor 6. The detection results of the motion sensor 5 and the grip sensor 6 are notified to the terminal state specifying unit 17.

  The terminal state specifying unit 17 specifies the state of the mobile terminal 10 with reference to the detection result of the motion sensor 5 or the detection result of the grip sensor 6. Specifically, when the sub camera 3 is provided in the vicinity of the upper side of the touch panel 4 in the mobile terminal 10 (see FIG. 3B), the upper side of the touch panel 4 in the mobile terminal 10 It is specified whether the side is the lower side (that is, the position of the sub camera 3 in the portable terminal 10 is the lower side) (see (c) of FIG. 3).

  When the terminal state identification unit 17 detects that the position of the sub camera 3 in the mobile terminal 10 is on the lower side, the mode determination unit 12 determines to operate the imaging device in the fingerprint authentication mode. According to the above configuration, it is possible to switch from the normal mode to the fingerprint authentication mode by a simple operation in which the position of the sub camera 3 in the mobile terminal 10 is set to the lower side.

  The input receiving unit 18 specifies whether or not there is an input to the touch panel 4 (input device 42) and whether or not there is an input by pressing the side key (switching button) 7. The side key 7 is a switching button for switching from the normal mode to the fingerprint authentication mode.

  When the input reception unit 18 detects that the side key 7 has been pressed, the mode determination unit 12 operates the imaging device in the fingerprint authentication mode. According to the above configuration, the normal mode can be switched to the fingerprint authentication mode by a simple operation of pressing the side key 7.

  As a trigger for switching to the fingerprint authentication mode, detection of pressing of the side key 7 is prioritized over detection of a change in the state of the mobile terminal 10 (for example, upside down) by the terminal state specifying unit 17 described above. .

  The voice recognition unit 19 performs voice recognition on the voice information collected by the microphone 8. Specifically, the microphone 8 receives an input of a command voice commanding to perform fingerprint authentication. When the microphone 8 receives the command voice input and the voice recognition unit 19 recognizes the command voice, the mode determination unit 12 operates the photographing apparatus in the fingerprint authentication mode. According to the above configuration, it is possible to switch from the normal mode to the fingerprint authentication mode with a simple operation of uttering a command voice commanding to perform fingerprint authentication.

  Note that, as a trigger for switching to the fingerprint authentication mode, the reception of the command voice is given priority over the detection of the change (for example, upside down) of the state of the mobile terminal 10 by the terminal state specifying unit 17 described above.

  According to the mobile terminal 10 having the above-described configuration, fingerprint authentication can be performed using the sub camera 3 provided in the mobile terminal 10. That is, in the above configuration, the sub camera 3 can be used for both normal photographing and fingerprint authentication. For this reason, the number of special members for fingerprint authentication can be reduced. The storage device 2 stores the above-described fingerprint pattern, operation mode type, and the like.

  The touch panel 4 includes a display device 41 and an input device 42. As the display device 41, for example, a liquid crystal panel is used. However, the display panel used for the display device 41 is not limited to a liquid crystal panel, and may be an organic EL (electroluminescence) panel, an inorganic EL panel, a plasma panel, or the like. The input device 42 is, for example, an electrostatic capacitance type input device, but is not limited thereto, and is, for example, a resistance film type, infrared type, ultrasonic type, or electromagnetic inductive coupling type input device. There may be.

  As an example of the motion sensor 5, an acceleration sensor, a gyro sensor, and a geomagnetic sensor can be listed. The acceleration sensor is a sensor that detects the orientation of the mobile terminal 10 and the acceleration of the mobile terminal 10 itself. Here, the acceleration of the mobile terminal 10 itself refers to a speed change per unit time indicated by the mobile terminal 10 itself moving, for example.

  The acceleration sensor is a three-dimensional acceleration sensor for detecting the position and orientation of the mobile terminal 10. The acceleration sensor measures each acceleration in the X direction, the Y direction, and the Z direction defined with respect to the reference posture in the mobile terminal 10 at a predetermined timing or a predetermined sampling interval. The acceleration detected by the acceleration sensor is input to the sensor control unit 16.

  The gyro sensor (angular velocity sensor) detects the movement of the mobile terminal 10 itself in the X direction or the Y direction. For example, the gyro sensor detects a rotational movement of the mobile terminal 10 itself in the X direction or the Y direction. The rotational movement of the mobile terminal 10 detected by the gyro sensor in the X direction or the Y direction is input to the sensor control unit 16.

  The geomagnetic sensor measures geomagnetism and detects geomagnetic values (Mx, My, Mz). The geomagnetic value detected by the geomagnetic sensor is input to the sensor control unit 16.

  For example, the grip sensor 6 is arranged on the side surface of the mobile terminal 10 and has the sub camera 3 in the upper (upper) state or the lower (lower) state depending on which side of the side is touching. Judge whether it is. When it is determined from the detection result of the grip sensor 6 that the sub camera 3 is held in the lower part, the normal mode is switched to the fingerprint authentication mode.

  The microphone 8 is a sound collector having a sound collecting function. The speaker 9 outputs the sound indicated by the sound signal by vibrating the diaphragm included in the speaker 9 according to the input sound signal.

(Mobile device operation)
Next, the operation flow of the mobile terminal 10 will be described with reference to the flowchart shown in FIG. The portable terminal 10 is turned on to start operation, and the process proceeds to step S (hereinafter, “step” is omitted) 101.

  In S101, the mode determination unit 12 confirms whether or not a mode switching operation for switching from a mode different from the fingerprint authentication mode (for example, the normal mode or the subject automatic selection mode) to the fingerprint authentication mode has occurred.

  As an example of the trigger for the mode switching operation, detection of a change in the state of the mobile terminal 10 (for example, upside down), pressing of the side key 7, reception of a voice command, and the sub camera 3 by the grip sensor 6 may be used. For example, detection of a state held in the lower portion can be exemplified. In other words, the control device 1 may determine whether to operate in the fingerprint authentication mode or a mode different from the fingerprint authentication mode according to the detection result of the state of the mobile terminal 10.

  When the mode switching operation occurs, the mode determination unit 12 determines to operate the mobile terminal 10 in the fingerprint authentication mode. As a result, when the mode switching operation has not occurred, the process returns to the original (S101). On the other hand, when the mode switching operation has occurred, the process proceeds to S102.

  In S102, it is confirmed whether or not the photographing processing unit 11 has a valid detection screen. For example, when the fingerprint detection mode valid screen is being displayed (such as a lock release screen), it is determined that the screen is a valid detection screen. As a result, if the screen is valid for detection, the process proceeds to S103. On the other hand, if the screen is not valid for detection, the process returns to the original (S102). Note that as an example of a scene in which the sub camera 3 is used for fingerprint detection, a lock release operation by fingerprint detection may be enabled in an operation on a lock screen.

  In S103, the imaging processing unit 11 operates the sub camera 3 as a fingerprint detection mode (fingerprint authentication mode) (starts continuous imaging of the sub camera 3), and proceeds to S104.

  In S104, the fingerprint detection unit 13 determines whether or not an object occupying A% of the screen is detected in the shooting data. As a result, when the object is detected, the process proceeds to S105. On the other hand, if the object is not detected, the process proceeds to S107.

  In S105, the fingerprint detection unit 13 determines whether a fingerprint pattern exists on the object. As a result, if a fingerprint pattern exists, the process proceeds to S106. On the other hand, if there is no fingerprint pattern, the process proceeds to S107.

  In S <b> 106, the fingerprint authentication unit 14 determines whether or not the fingerprint pattern extracted from the captured data matches the registered fingerprint pattern by B% or more. As a result, if B% or more matches, the process proceeds to S108. On the other hand, if they do not match B% or more, the process proceeds to S107.

  In S108, the control device 1 executes an operation that has been set for each fingerprint pattern for each fingerprint pattern, and the process proceeds to S108. Here, executing an operation set for each fingerprint pattern for each fingerprint pattern means that an operation different for each user is performed or a different operation is performed for each finger of one user. Therefore, the fingerprint pattern may be registered for each of a plurality of users (family members, etc.), or may be registered for each type of finger such as the middle finger and index finger of one user.

  If the user's fingerprint matches the fingerprint registered as “fingerprint 1”, for example, the “browser application” is started. If the user's fingerprint matches the fingerprint registered as “fingerprint 2”, for example, It may be possible to launch a “map app”. It should be noted that the above “operation already set in the fingerprint pattern” can be arbitrarily set by the user from the setting screen or the like when the fingerprint pattern is registered.

  In S107, the mode determination unit 12 confirms whether or not a mode switching operation has occurred. As a result, when the mode switching operation occurs, the process proceeds to S110. On the other hand, if no mode switching operation has occurred, the process returns to S104.

  In S109, it is confirmed whether or not the photographing processing unit 11 has a valid detection screen. As a result, if the screen is valid for detection, the process proceeds to S110. On the other hand, if the screen is not valid for detection, the process returns to S104.

  In S110, the imaging processing unit 11 stops the operation of the sub camera 3, and the fingerprint detection mode ends.

(Comparison with conventional technology)
Next, (a) of FIG. 3 shows the appearance of the conventional portable terminal 100. As shown in the figure, the mobile terminal 100 includes a fingerprint sensor 104 in addition to the sub camera 103 on the touch panel surface side of the terminal. In the mobile terminal 10 according to an embodiment of the present invention, the sub camera 103 is also used as a fingerprint sensor, so that the fingerprint sensor can be removed as shown in FIG. For this reason, the area occupied by the touch panel 4 is increased by the area AR.

  As shown in FIG. 3C, when the portable terminal 10 is turned upside down, it is easy to hold the finger over the sub camera 3, so that the sub camera 3 can be easily used for fingerprint authentication.

[Embodiment 2: Implementation by software]
Control blocks of the control device 1 of the portable terminal 10 (in particular, the mode determination unit 12, the fingerprint detection unit 13, the fingerprint authentication unit 14, the fingerprint pattern registration unit 15, the sensor control unit 16, the terminal state identification unit 17, the input reception unit 18, and The voice recognition unit 19) may be realized by a logic circuit (hardware) formed in an integrated circuit (IC chip) or the like, or may be realized by software.

  In the latter case, the control device 1 includes a computer that executes instructions of a program that is software for realizing each function. The computer includes, for example, at least one processor (control device) and at least one computer-readable recording medium storing the program. In the computer, the processor reads the program from the recording medium and executes the program, thereby achieving the object of the present invention. As the processor, for example, a CPU (Central Processing Unit) can be used. As the recording medium, a “non-temporary tangible medium” such as a ROM (Read Only Memory), a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. Further, a RAM (Random Access Memory) for expanding the program may be further provided. The program may be supplied to the computer via an arbitrary transmission medium (such as a communication network or a broadcast wave) that can transmit the program. Note that one embodiment of the present invention can also be realized in the form of a data signal embedded in a carrier wave, in which the program is embodied by electronic transmission.

[Summary]
An electronic device (portable terminal 10) according to an aspect 1 of the present invention is an electronic device including at least one photographing device (sub camera 3) and at least one control device (1). Determining whether to operate the imaging apparatus in a fingerprint authentication mode for photographing for fingerprint authentication or to operate in a mode different from the fingerprint authentication mode, and determining to operate the imaging apparatus in the fingerprint authentication mode. In this case, the fingerprint authentication is performed by comparing the fingerprint image included in the photographed image photographed by the photographing apparatus with the fingerprint pattern registered in advance. According to the above configuration, fingerprint authentication can be performed using the imaging device provided in the electronic device. In other words, in the above-described configuration, the photographing device provided in the electronic device can be used for both ordinary photographing and fingerprint authentication. For this reason, the number of special members for fingerprint authentication can be reduced. As a mode different from the fingerprint authentication mode, for example, a normal mode for focusing a subject located at the center, a subject automatic selection mode for automatically selecting a subject to be focused, and the like can be exemplified.

  In the electronic device according to aspect 2 of the present invention, in the aspect 1, it is preferable that the photographing apparatus is a camera for photographing a subject on the display screen side.

  An electronic apparatus according to aspect 3 of the present invention is the electronic apparatus according to aspect 2, in which the camera includes at least an imaging element and a lens, and the light receiving side of the lens is disposed on the opposite side of the imaging element with respect to the lens. It is preferable that a light-transmitting member is provided, and the camera can capture the image of the fingerprint in a state where a finger is in contact with or close to the light-transmitting member.

  The electronic device according to aspect 4 of the present invention is the electronic device according to any one of the aspects 1 to 3, wherein the control device is operated in the fingerprint authentication mode or in the mode according to the detection result of the state of the electronic device. You may decide whether to operate.

  An electronic device according to aspect 5 of the present invention is the electronic device according to aspect 4, wherein the electronic device includes a display screen, and the photographing apparatus is provided in the vicinity of the upper side of the display screen in the electronic device. The control device may determine to operate the photographing device in the fingerprint authentication mode when detecting that the upper side of the display screen is on the lower side. According to the above configuration, it is possible to switch from the normal mode to the fingerprint authentication mode with a simple operation in which the position of the photographing apparatus with respect to the electronic device is set downward.

  In the electronic device according to Aspect 6 of the present invention, in any one of Aspects 1 to 5, the control device determines whether or not an object occupying a predetermined% or more of the image area exists in the captured image. When the object exists, it is preferable to determine whether or not a fingerprint pattern exists on the object. According to the above configuration, it is possible to extract a fingerprint pattern from a captured image.

  An electronic device control device (1) according to an aspect 7 of the present invention is a control device for an electronic device (mobile terminal 10) including at least one photographing device (sub-camera 3). A mode determination unit (12) for determining whether to operate in a fingerprint authentication mode for photographing for authentication or a mode different from the fingerprint authentication mode, and to determine to operate the imaging device in the fingerprint authentication mode In this case, the image forming apparatus includes a fingerprint authentication unit (14) that performs fingerprint authentication by comparing a fingerprint image included in a photographed image photographed by the photographing apparatus with a fingerprint pattern registered in advance. According to the said structure, the effect similar to the said aspect 1 can be acquired.

  An electronic apparatus control method according to an aspect 8 of the present invention is an electronic apparatus control method including at least one imaging apparatus, and operates the imaging apparatus in a fingerprint authentication mode for imaging for fingerprint authentication. Or a mode determination step for determining whether to operate in a mode different from the fingerprint authentication mode, and a fingerprint included in a captured image captured by the imaging device when it is determined to operate the imaging device in the fingerprint authentication mode. And a fingerprint authentication step in which fingerprint authentication is performed by comparing a fingerprint pattern registered in advance with a fingerprint pattern registered in advance. According to the said method, the effect similar to the said aspect 1 or 7 can be acquired.

  The control device for an electronic device according to each aspect of the present invention may be realized by a computer. In this case, the control device is operated on each computer by causing the computer to operate as each unit (software element) included in the control device. The control program of the control device to be realized in this way and a computer-readable recording medium on which the control program is recorded also fall within the scope of the present invention.

[Additional Notes]
The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention. Furthermore, a new technical feature can be formed by combining the technical means disclosed in each embodiment.

1 Control device 3 Sub camera (photographing device)
10 Mobile devices (electronic devices)
12 Mode decision unit 14 Fingerprint authentication unit 15 Fingerprint pattern registration unit

Claims (9)

An electronic device comprising at least one photographing device and at least one control device,
The control device
Decide whether to operate the imaging device in a fingerprint authentication mode for photographing for fingerprint authentication or in a mode different from the fingerprint authentication mode,
When it is determined to operate the photographing apparatus in the fingerprint authentication mode, fingerprint authentication is performed by comparing a fingerprint image included in a photographed image photographed by the photographing apparatus with a pre-registered fingerprint pattern. Features electronic equipment.   The electronic apparatus according to claim 1, wherein the photographing apparatus is a camera for photographing a subject on the display screen side. The camera includes at least an image sensor and a lens,
On the opposite side of the imaging element with respect to the lens, a translucent member that covers the light receiving side of the lens is provided,
The electronic apparatus according to claim 2, wherein the camera is capable of capturing an image of the fingerprint in a state where a finger is in contact with or close to the translucent member. The control device
4. The electronic device according to claim 1, wherein whether to operate in the fingerprint authentication mode or to operate in the mode is determined according to a detection result of the state of the electronic device. 5. machine. The electronic device includes a display screen,
The imaging device is provided near the upper side of the display screen in the electronic device,
The control device
5. The electronic apparatus according to claim 4, wherein when it is detected that the upper side of the display screen is on the lower side, it is determined that the photographing apparatus is operated in the fingerprint authentication mode. .   The control device determines whether or not there is an object that occupies a predetermined% or more of the image area in the captured image, and if the object exists, whether or not a fingerprint pattern exists on the object. The electronic device according to claim 1, wherein the electronic device is determined. A control device for an electronic device including at least one photographing device,
A mode determination unit that determines whether to operate the imaging apparatus in a fingerprint authentication mode for capturing an image for fingerprint authentication or to operate in a mode different from the fingerprint authentication mode;
Fingerprint authentication for performing fingerprint authentication by comparing a fingerprint image included in a photographed image photographed by the photographing device with a pre-registered fingerprint pattern when it is determined that the photographing device is to be operated in the fingerprint authentication mode. And a control unit.   A control program for causing a computer to function as the control device according to claim 7, wherein the control program causes the computer to function as the mode determination unit and the fingerprint authentication unit. A method for controlling an electronic device including at least one photographing apparatus,
A mode determining step for determining whether to operate the photographing apparatus in a fingerprint authentication mode for photographing to perform fingerprint authentication or a mode different from the fingerprint authentication mode;
Fingerprint authentication for performing fingerprint authentication by comparing a fingerprint image included in a photographed image photographed by the photographing device with a pre-registered fingerprint pattern when it is determined that the photographing device is to be operated in the fingerprint authentication mode. A control method comprising: steps.

Images