JP2006011711A - Authentication device and portable terminal - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To do away with a state such that an authenticating sensor part is always exposed to the outside, and to authenticate a specific user without requiring a dedicated installation space. <P>SOLUTION: This authentication device has: a sub liquid crystal display 25 having a prescribed area allowing transmission display; an authenticating camera module 21 disposed inside the sub liquid crystal display 25; an LED part 23 for backlight incorporating an infrared LED emitting infrared light; and a pressure sensor 20 detecting that the sub liquid crystal display 25 is pressed by a finger of the user. When the pressure sensor 20 is pressed by the finger, a cellphone terminal makes the sub liquid crystal display 25 be in the transmission display, turns on the infrared LED, makes the authenticating camera module 21 start photographing, extracts a vein pattern of the finger from its photographic image information, and collates the vein pattern and a previously registered vein pattern to authenticate the specific user. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an authentication device and a mobile terminal for authenticating a specific user.

  Conventionally, as an authentication technique for authenticating a specific user, Japanese Patent Application Laid-Open No. 2002-159052 (Patent Document 1) discloses a fingerprint authentication sensor formed of a transparent member on a liquid crystal panel portion of a mobile terminal. And a technique for performing fingerprint authentication by reading a fingerprint with a fingerprint authentication sensor when a pressure sensor is provided under the liquid crystal panel and the pressure sensor detects that a finger is placed on the liquid crystal panel. Yes.

  Japanese Patent Laid-Open No. 2002-374346 (Patent Document 2) discloses a foldable mobile phone including a casing having a display portion and a casing having an operation portion. The structure which provided the fingerprint reading part in the surface on the opposite side of a display part is disclosed.

Japanese Patent Laid-Open No. 2002-159052 (FIG. 5) JP 2002-374346 A (FIG. 6)

  By the way, in the authentication technique described in Patent Document 1 described above, a fingerprint authentication sensor made of a transparent member is provided on the liquid crystal panel, and the fingerprint authentication sensor reads a fingerprint by a capacitance method. It is made like that.

  However, the fingerprint authentication sensor in this case is always exposed to the outside world, and there is a very high possibility that the capacitance detection function will fail or malfunction. The same problem is considered to be the same in the technique of Patent Document 2. In the case of the technique disclosed in Patent Document 2, a dedicated fingerprint reading unit must be provided, so that a separate installation space is required, and it may be a limitation in determining the appearance design of the mobile phone.

  The present invention has been made in view of such a problem, and can eliminate the state in which the sensor unit for authentication is always exposed to the outside, and does not require a dedicated installation space. An object of the present invention is to provide an authentication device and a portable terminal that can authenticate a user.

  An authentication apparatus according to the present invention includes a liquid crystal display means in which at least a predetermined area of a display surface can be transmissively displayed, and is disposed at a position on the inner side with respect to the display surface of the liquid crystal display means and corresponds to the predetermined area Photographing means arranged at a position, photographing auxiliary light emitting means for emitting photographing auxiliary light used in photographing by the photographing means from the inside to the outside of the liquid crystal display means, and a predetermined pressing force to the liquid crystal display means A pressure detection means for detecting the application of light, and when the pressure detection means detects a predetermined pressing force, at least a predetermined area of the liquid crystal display means is transmissively displayed and the photographing auxiliary light emitting means is turned on, Control that starts photographing by means, extracts an image pattern from the image information, and compares the extracted image pattern with a pre-registered image pattern to authenticate a specific person By having a stage, to solve the problems described above.

  In addition, the portable terminal of the present invention is on the inner side with respect to the communication means for performing wireless communication, the liquid crystal display means in which at least a predetermined area of the display surface can be transmissively displayed, and the display surface of the liquid crystal display means. An imaging unit arranged at a position and arranged at a position corresponding to a predetermined area, and an imaging auxiliary light emitting unit for emitting imaging auxiliary light used for imaging by the imaging unit from the inside of the liquid crystal display unit to the outside And a pressure detecting means for detecting that a predetermined pressing force is applied to the liquid crystal display means, and at least a predetermined area of the liquid crystal display means is made to be a transparent display when the pressure detecting means detects the predetermined pressing force, and a photographing assist After the light emitting means is turned on, photographing by the photographing means is started, the photographing means extracts an image pattern from the image information, and the extracted image pattern and a pre-registered image pattern When the comparison to authenticate a particular user, by a control means for releasing a predetermined function limitation when it is authenticated for a particular person, to solve the problems described above.

  That is, according to the present invention, the photographing auxiliary light is emitted from the inner side than the display surface of the liquid crystal display means, and the light reflected by the object to be authenticated is taken inside the liquid crystal display means. A specific person is authenticated by an image pattern extracted from the captured image.

  In the present invention, since the photographing means which is an authentication sensor unit for authenticating a specific user is provided inside the liquid crystal display means, the state where the authentication sensor is always exposed to the outside. It can be lost. Therefore, according to the present invention, erroneous authentication and failure are reduced. In the present invention, since the photographing means and the photographing auxiliary light emitting means are provided inside the liquid crystal display means, it is not necessary to provide a sensor unit for authentication on the casing. Therefore, according to the present invention, there is no need for a dedicated installation space for the sensor unit for authentication, and there are fewer restrictions when determining the appearance design.

  Hereinafter, an embodiment of an authentication device and a mobile terminal according to the present invention will be described with reference to the drawings. In the present embodiment, a mobile phone terminal is cited as an example of the authentication device and the mobile terminal of the present invention. However, the contents described here are merely examples, and the present invention is not limited to this example. Needless to say.

[Schematic appearance of mobile phone terminal]
1 and 2 show an example of the external configuration of a mobile phone terminal according to an embodiment of the present invention. 1 shows a schematic external view of the mobile phone terminal according to the embodiment of the present invention viewed from the front side, and FIG. 2 shows a schematic external view of the mobile phone terminal viewed from the back side.

  The mobile phone terminal according to the present embodiment includes, for example, a first casing 1 and a second casing 2, and the first casing 1 and the second casing are provided via a hinge portion (connection means) 6. This is a so-called foldable mobile phone terminal that can be folded in two so that 2 can be folded. That is, the portable terminal of the present embodiment is a terminal in which the first casing 1 and the second casing are connected by the hinge portion 6 and the positional relationship between the casings can be changed via the hinge portion 6. is there. Hereinafter, as shown in FIGS. 1 and 2, a state in which the mobile phone terminal is opened is referred to as an open state, and a folded state is referred to as a closed state.

  As shown in FIG. 1, the first housing 1 is provided with a main liquid crystal display 3 constituted by, for example, a liquid crystal device, a receiving speaker 5, and the like. In addition, as shown in FIG. 2, on the back side of the first housing 1 (on the back side with respect to the main liquid crystal display 3 side), a sub liquid crystal display 10 constituted by a liquid crystal device, a camera unit 11, A photographing auxiliary light 12 that emits photographing auxiliary light for photographing with the camera unit 11 is provided. Although details will be described later, the sub liquid crystal display 10 of the first housing of the mobile phone terminal of the present embodiment is provided with an authentication device for authenticating a specific user by, for example, vein imaging. Yes.

  On the other hand, the main circuit part of the mobile phone terminal is built in the second casing 2. On the upper surface of the second housing 2 (the surface facing the main liquid crystal display 3 side of the first housing 1 when folded) is a numeric keypad (key buttons for inputting telephone numbers, characters, etc.). 12 key) 4, each key such as an utterance key, a clear key, an end / power key, an operation unit including a jog dial unit 8, and a microphone 7 for transmission. The jog dial unit 8 detects, for example, a cylindrical rotary dial, a left press key and a right press key respectively disposed at both ends of the rotary dial in the longitudinal direction, and that the rotary dial has been pressed. For this purpose, it is configured by a pressing detection unit (not shown). Although details will be described later, the circuit unit of the mobile phone terminal according to the present embodiment performs control of the authentication device, image analysis, and authentication operation when authenticating a specific user by the vein imaging. A control unit is provided.

  In addition, in this embodiment, illustration of the structure normally provided in the mobile phone terminal and the description thereof are omitted.

[Internal circuit configuration of mobile phone terminal]
Next, FIG. 3 shows a schematic internal configuration of the mobile phone terminal according to the embodiment of the present invention.

  The antenna 82 is, for example, a built-in antenna, and transmits and receives signal radio waves for calls and packet communications. The communication circuit 83 performs frequency conversion, modulation, demodulation, and the like of transmission / reception signals. Note that data transmitted and received by packet communication is image data, e-mail, program data, and other various data.

  The received call voice data is sent to the control unit 81 via the data line. The control unit 81 is composed of a CPU (Central Processing Unit), decodes call voice data, and sends the decoded voice data to the speaker 89 via a data line.

  The speaker 89 corresponds to the above-described receiving speaker 5 and linger speaker, and includes a digital / analog converter and an amplifier. The speaker 89 digitally / analog-converts and amplifies the data of the call voice and the ringer sound, and then outputs them. Thereby, a call voice and a ringer sound are obtained.

  The microphone 90 corresponds to the microphone 7 for transmission, and includes an analog / digital converter and an amplifier. The call voice signal input via the microphone 90 is amplified to a predetermined level by an amplifier, then converted to digital voice data by an analog / digital converter, and sent to the control unit 81 via a data line. After being encoded, it is sent to the communication circuit 83.

  The display control unit 86 controls the display of the main display unit 85 that is the main liquid crystal display 3 and the sub display unit 87 that is the sub liquid crystal display 10 of the first housing 1.

  The operation unit 84 corresponds to the operation unit of the second housing 2 and includes a numeric keypad 4, a jog dial unit 8, and an operation signal generation unit that generates an operation signal corresponding to the operation.

  The memory 88 includes a ROM (Read Only Memory) and a RAM (Random Access Memory). The ROM includes a control program for the control unit 81 to control each unit, various initial setting values, font data, dictionary data, a program code for performing authentication processing and control of a specific user described later in the present embodiment, Program code for applications for creating and editing e-mails, program code for applications for performing various processing on images, program codes for various applications installed in mobile phone terminals, The identification information (ID) of the mobile phone terminal is stored. The ROM includes a rewritable ROM such as an EEPROM (Electrically Erasable Programmable Read-Only Memory), and includes e-mail data, a telephone book and e-mail address set by the user, a photograph image taken by the camera unit 11 and the like. Data, downloaded photo data and ringtone data, character data, prediction conversion candidate word registration data, prediction conversion learning data, vein pattern information registered in advance for authentication of a specific user to be described later, etc. It is also possible to save various user setting values and the like. The RAM stores data as needed as a work area when the control unit 81 performs various data processing.

  The open / close detection sensor 92 is, for example, a switch that can detect whether the current state of the mobile phone terminal according to the present embodiment is an open state as shown in FIGS. 1 and 2 or a folded closed state. It is a sensor which consists of etc.

  The camera unit 91 corresponds to the camera unit 11 shown in FIG. 2 and includes a lens system, an autofocus mechanism for automatically performing focusing of the lens system, an image sensor, and the like.

  The authentication camera module 21 is a device for taking a vein image of a finger, for example, when authenticating a specific user in the present embodiment, and the detailed configuration and operation thereof will be described later.

  The pressure sensor 20 is a device for generating a trigger signal for starting authentication of a specific user in the present embodiment, and a detailed configuration and operation thereof will be described later.

  The infrared LED 95 is a light emitting device for emitting photographing auxiliary light for photographing a vein such as a finger, for example, at the time of authentication of a specific user in the present embodiment. This is a drive circuit that supplies a drive current to the LED 95. These detailed configurations and operations will be described later.

  The slide plate drive unit 96 is a device for driving a slide plate, which will be described later, attached to the authentication camera module 21 by supplying a drive current to the electromagnet 38, and the detailed configuration and operation thereof. Will be described later.

  The mobile phone terminal of this embodiment includes the authentication camera module 21, the pressure sensor 20, the infrared LED 95, the slide plate driving unit 96, the electromagnet 38, and the like as an authentication device for a specific user.

  The control unit 81 performs various arithmetic processes such as control of each component of the mobile phone terminal via the control line in addition to the above-described encoding and decoding of the call voice data. In the case of the present embodiment, the control unit 81 performs control of the authentication device, image analysis, and the like as will be described later when authenticating a specific user.

  In addition, although not shown in FIG. 3, the mobile phone terminal of the present embodiment includes a power supply circuit that supplies power to each unit, a recording / playback unit for recording and playback of music and images, a browser function, It includes an external cable connector, a connection connector for an external remote controller, a GPS (Global Positioning System) communication unit that is a positioning device for detecting the current position of the mobile phone terminal, and its antenna.

[Configuration for user authentication]
Hereinafter, a specific configuration of the authentication device of the mobile phone terminal according to the present embodiment will be described.

  FIG. 4 is a schematic perspective view of the mobile phone terminal according to the present embodiment in a closed state as viewed from the side, and particularly, the sub liquid crystal display 10 which is a main part according to the present invention and the sub liquid crystal display 10 which is attached to or built in the sub liquid crystal display. The structure about the device part for authentication is shown. Note that FIG. 4 omits the illustration of the configuration other than the main part according to the present invention.

  In FIG. 4, the liquid crystal module 25 corresponds to the main body of the sub liquid crystal display 10. As shown in the schematic diagrams of FIGS. 5 and 6, the liquid crystal module 25 includes a glass plate portion 50 and R (red), G (green), and B (blue) color filter portions 51 as main components. A liquid crystal molecule 52, a liquid crystal molecule encapsulating portion 53 enclosing and aligning the liquid crystal molecule 52, a TFT (Thin Film Transistor) portion 54 which is an active element for driving the liquid crystal molecule 52 to be deflected, and an LED ( Light Emitting Diode) portion 23 is provided on the side portion, and the backlight portion 55 is provided with a prism portion 58 and a reflecting plate 57 that guide light from the LED 23 portion toward the glass plate portion 50 (that is, the external direction) on the bottom surface. have. In particular, in the present embodiment, the LED 23 portion of the backlight unit 55 includes a backlight light source LED that emits normal visible light as a so-called backlight, and an infrared LED (infrared LED 95 in FIG. 3) provided therewith. . 5 shows a state in which the liquid crystal molecules 52 are aligned in a substantially parallel direction with respect to the surface of the reflection plate 57 of the backlight unit 55, and FIG. 6 shows an alignment in a substantially vertical direction. It shows the state.

  As shown in FIG. 4, a pressure sensor 20 made of a transparent member is provided outside the liquid crystal module 25. The pressure sensor 20 detects, for example, when the pressure sensor 20 is pressed with a force of at least a predetermined value by a user's finger or the like, that is, when the sub liquid crystal display 10 is pressed by the user's finger or the like. It is a device to do.

  On the other hand, as shown in FIG. 4, an authentication camera module 21 capable of receiving at least infrared rays is provided inside the liquid crystal module 25.

  Here, in the mobile phone terminal according to the present embodiment, the reflector 57 of the backlight unit 55 of the liquid crystal module 25 is used for authentication arranged on the inner side of the liquid crystal module 25 as shown in FIGS. A hole 60 is provided so that the lens 41 of the camera module 21 can capture light from the outside. That is, the hole 60 of the reflection plate 57 is provided at a position corresponding to the lens 41 of the authentication camera module 21. Thereby, when the hole 60 of the reflecting plate 57 is viewed from the lens 41 side of the authentication camera module 21, the hole 60 becomes a transmission part that transmits light from the outside. In particular, as shown in FIG. 6, when the liquid crystal molecules 52 of the liquid crystal module 25 are oriented substantially in the vertical direction, the authentication camera module 21 receives light from the outside incident through the transmission portion. In other words, an external image can be taken. 7 shows a state in which the vicinity of the transmission part of the liquid crystal module 25 is viewed from the glass plate part 50 side. In the example of FIG. 7, Al (aluminum) wiring and Mo (molybten) wiring of the TFT are used. The state where the R, G, and B regions of the color filter are visible is shown. FIG. 8 is a perspective view of only the reflection camera 57 of the authentication camera module 21 and the liquid crystal module 25 as seen from an oblique direction.

  Further, in the mobile phone terminal according to the present embodiment, the authentication camera module 21 is arranged on the bottom surface (surface on which the reflection plate 57 is provided) of the backlight unit 55 of the liquid crystal module 25 as shown in FIG. In addition, one end of the slide plate 35 having the reflection surface 34 having substantially the same reflectance as that of the reflection plate 57 of the backlight unit 55 is fixed to the housing of the authentication camera module 21 and the other end side is slid. A fulcrum 36 that is rotatably fitted in a through-hole provided at a predetermined position of the plate 35, and an end portion in the vicinity of the end portion corresponding to the end portion where the reflecting surface 34 is provided on the slide plate 35. The electromagnet 3 for moving the magnet 37 in the directions of arrows A3 and A4 in FIG. 9 by the fixed magnet 37 and the current supplied from the slide plate driving unit 96 in FIG. Door is provided. That is, when the magnet 37 is moved in the direction of arrow A3 in FIG. 9 by passing a current through the electromagnet 38, the slide plate 35 rotates counterclockwise with respect to the fulcrum 36, and the reflecting surface 34 on the slide plate 35 is rotated. The side moves in the direction of arrow A1 in FIG. 9. Conversely, when the magnet 37 is moved in the direction of arrow A4 in FIG. 9 by passing a current through the electromagnet 38, the slide plate 35 moves relative to the fulcrum 36. Then, the reflecting surface 34 on the slide plate 35 moves in the direction of arrow A2 in FIG.

  Here, in the mobile phone terminal of the present embodiment, the current supply from the slide plate driving unit 96 to the electromagnet 38 is controlled by the control unit 81 of FIG. For example, when the magnet 37 is moved in the direction of the arrow A3 in FIG. 9 by passing a current through the electromagnet 38, the current supply to the electromagnet 38 is a hole provided in the reflection plate 57 of the backlight unit 55. When the reflecting surface 34 of the slide plate 35 is matched on the part 60, and conversely, when the magnet 37 is moved in the direction of arrow A4 in FIG. The supply is stopped when the slide plate 35 is completely removed from the hole 60 provided in the reflection plate 57 of the backlight unit 55. That is, according to the mobile phone terminal of this embodiment, when displaying an image or the like on the liquid crystal module 25, the hole 60 of the reflection plate 57 of the backlight unit 55 is closed by the reflection surface 34 of the slide plate 35. Thus, the liquid crystal display is prevented from being darkened by the hole portion 60 provided in the backlight portion 55. On the other hand, when photographing with the authentication camera module 21, the slide plate 35 is set. By removing from the hole 60 of the reflection plate 57 of the backlight unit 55, an external image can be taken by the authentication camera module 21 through the hole 60.

  In the above-described example, the example in which the slide plate 35 is provided with the reflection surface 34 has been described. However, if the entire surface of the slide plate 35 is a reflection surface, the reflection plate 57 of the backlight unit 55 as described above is provided. Current control for accurately matching the hole 60 and the reflective surface 34 of the slide plate 35 is not required. Further, in the present embodiment, when the reflecting surface 34 of the slide plate 35 is stopped on the hole 60 of the reflecting plate 57 of the backlight unit 55 when it is stopped, the reflecting plate of the backlight unit 55 is actually stopped. 57 and the reflecting surface 34 of the slide plate 35 cause a position error in the height direction (perpendicular to the reflecting surface). In this embodiment, the error is absorbed by the prism 58. It has become.

  In the above-described embodiment, an example in which the infrared LED 95 is attached to each LED element in the LED unit 23 of the backlight unit 55 has been described. However, as illustrated in FIG. 10, for example, the hole 60 of the reflection plate 57 of the liquid crystal module 25. (Infrared LEDs 22 and 22) may be provided in the vicinity of the authentication camera module 21. However, when the infrared LED 95 is provided in the LED 23 of the backlight unit 55 as in the example of FIG. 4 described above, it is not necessary to separately provide the infrared LED as in the example of FIG. This is advantageous for downsizing the configuration.

[User vein authentication]
Next, an authentication operation by vein photography of a specific user in the mobile phone terminal of this embodiment will be described.

  In the mobile phone terminal of the present embodiment having the authentication device configured as described above, when performing vein authentication of a specific user, the control unit 81 displays an image for designating a position where the user's finger should be placed. The image is generated and displayed on the screen of the sub liquid crystal display 10 via the display control unit 86. Here, as shown in FIG. 11, the image showing the position where the user's finger should be placed is, for example, an area that can be photographed by the authentication camera module 21 through the transmission part of the liquid crystal module 25 described above (capable of photographing). An area 45).

  Next, for example, when the sub liquid crystal display 10 is pressed by a user's finger or the like and the pressure sensor 20 detects a pressure equal to or higher than a predetermined value, the control unit 81 controls the slide plate driving unit 96. By supplying current to the electromagnet 38 described with reference to FIG. 9, the slide plate 35 is rotated in a direction away from the lens 41 of the authentication camera module 21 (in the direction of arrow A2 in FIG. 9). At this time, the control unit 81 controls the LED driving unit 94 to turn on the infrared LED 95 of the LED unit 23 provided in the backlight unit 55 of the liquid crystal module 25 and at the same time, the display control unit 86 is switched on. By controlling, the liquid crystal molecules 52 in the liquid crystal module 25 are aligned in the vertical direction as shown in FIG. As a result, the path of the infrared light emitted from the infrared LED 95 of the LED unit 23 is bent by the prism 58 of the backlight unit 55 and is emitted outward through the transmission unit of FIG. At this time, since the finger of the user or the like is placed on the sub liquid crystal display 10, the infrared light is applied to the finger.

  The infrared light applied to the finger of the user or the like reaches the inside of the finger and is reflected by a vein or the like at the same time. The infrared light reflected by the vein or the like passes through the transmission part of the liquid crystal module 25 and further passes through the hole part 60 provided in the reflection plate 57 of the backlight part 55, and the authentication camera module 21. The light enters the lens 41. As a result, an image of the finger vein or the like is formed on the image sensor of the authentication camera module 21. The image information from the authentication camera module 21 is sent to the control unit 81.

  When receiving the image information from the authentication camera module 21, the control unit 81 analyzes the image and extracts a finger vein pattern. However, in this embodiment, the image formed on the image sensor of the authentication camera module 21 is an image that has passed through each prism 58 provided in the backlight unit 55 of the liquid crystal module 25. . That is, since the prisms 58 arranged as shown in FIG. 12 can be seen in the transmission part of the liquid crystal module 25 as viewed from the authentication camera module 21, the authentication camera module 21 is shown in FIG. An image through each prism 58 is formed on each pixel 70 of the image sensor. That is, when a specific example is illustrated, a fragmentary (discontinuous) vein image as shown in FIG. 14 is formed on the image sensor of the authentication camera module 21. Therefore, the image information obtained from the vein image of FIG. 14 is fragmentary (discontinuous) image information as shown in FIG. 15, for example. For this reason, the control unit 81 uses, for example, the authentication image of the present embodiment for the fragmentary (discontinuous) vein image information shown in FIG. 15 sent from the authentication camera module 21. A continuous vein pattern as shown in FIG. 16 is extracted by performing image analysis processing such as interpolation based on the pattern held by the program.

  Thereafter, the control unit 81 collates the vein pattern obtained by the image analysis process as described above with the vein pattern of the specific user registered in advance and stored in the memory 88, and the vein patterns are matched. Sometimes it is determined that the user is a legitimate user, and various function restrictions placed on the mobile phone terminal are released. On the other hand, when the extracted vein pattern does not match the vein pattern of the user registered in advance, the control unit 81 does not release the function restriction. As a result, the mobile phone terminal of the present embodiment can be used only by a legitimate specific user. When the above authentication is not performed, the control unit 81 displays a normal screen such as a standby screen on the sub liquid crystal display 10.

  As described above, according to the mobile phone terminal of the present embodiment, when vein authentication of a specific user is performed, an image representing the shootable area 45 is displayed on the sub liquid crystal display 10 to the user. The position where the finger should be placed can be informed.

  Further, according to the authentication device of the present embodiment, a transmissive part is provided only in part with respect to the entire display surface of the liquid crystal module 25, and photographing is performed by the authentication camera module 21 through the transmissive part. As a result, it is possible to cut a portion of the authentication camera module 21 near the field of view of the lens 41 where the aberration is large and where it is difficult to obtain a precise image. The accurate vein authentication used can be performed, and only the image information through the transmission unit is handled, so that extra photographing data can be omitted and the load of image analysis processing can be reduced. Furthermore, according to the authentication device of the present embodiment, since the infrared irradiation area is limited by the transmission part, it is possible to efficiently install the infrared LED.

[Registration process of specific user's vein pattern]
FIG. 17 shows the flow of processing when registering a vein pattern of a specific user in the memory 88 of FIG.

  In FIG. 17, first, when it is detected that a user has input a vein pattern registration mode start instruction via the operation unit 84 (step S <b> 1), the control unit 81 performs pressure processing as step S <b> 2. The sensor 20 and the authentication camera module 21 are activated, the slide plate drive unit 96 is controlled to rotate the slide plate 35 in the direction of arrow A2 in FIG. 9, and the display control unit 86 is controlled. The liquid crystal molecules 52 of the liquid crystal module 25 of the sub liquid crystal display 10 are aligned in the vertical direction as shown in FIG. 6, and the infrared LED 59 is turned on by controlling the LED driving unit 94.

  Next, as a process of step S3, the control unit 81 determines whether or not the pressure sensor 20 is pressed with a force equal to or greater than a predetermined value by a user's finger or the like, based on a detection signal from the pressure sensor 20. When it is detected in step S3 that the pressure sensor 20 has been pressed with a force equal to or greater than a predetermined value, the control unit 81 advances the process to step S4.

  When the processing proceeds to step S4, the control unit 81 takes in image information obtained by photographing the vein of the user's finger by the authentication camera module 21, extracts the vein pattern by analyzing and interpolating the image information.

  Next, as a process of step S5, the control unit 81 stores (registers) the vein pattern extracted in step S4 in the memory 88 as a vein pattern of a valid specific user.

  Thereafter, when the control unit 81 detects that an instruction to end the vein pattern registration mode is input from the user via the operation unit 84 (step S6), the control unit 81 ends the registration process of FIG.

[Authentication processing of specific user vein patterns]
FIG. 18 shows a flow of processing when vein authentication is performed in the mobile phone terminal according to the present embodiment and the function restriction is released by vein authentication. Here, the description will be made assuming that the mobile phone terminal is in a function-restricted state, for example, immediately after the power is turned on.

  In FIG. 18, the control unit 81 determines whether or not the mobile phone terminal is in the closed state as the process of step S <b> 10, and activates the pressure sensor 20 as the process of step S <b> 11 when it is in the closed state.

  Next, as a process of step S12, the control unit 81 determines whether or not the pressure sensor 20 is pressed with a force equal to or greater than a predetermined value with a user's finger or the like, based on a detection signal from the pressure sensor 20. When it is detected in step S12 that the pressure sensor 20 is pressed with a force equal to or greater than a predetermined value, the control unit 81 advances the process to step S13.

  In step S13, the control unit 81 activates the authentication camera module 21 and controls the slide plate driving unit 96 to rotate the slide plate 35 in the direction of arrow A2 in FIG. By controlling the display control unit 86, the liquid crystal molecules 52 of the liquid crystal module 25 of the sub liquid crystal display 10 are aligned in the vertical direction as shown in FIG. 6, and further, the infrared LED 59 is turned on by controlling the LED driving unit 94. .

  Next, as the process of step S14, the control unit 81 takes in image information obtained by photographing the vein of the user's finger by the authentication camera module 21, and analyzes and interpolates the image information to extract a vein pattern.

  Next, as a process of step S15, the control unit 81 reads a legitimate specific user vein pattern registered in advance from the memory 88, and the legitimate specific user vein pattern extracted in step S14. And match.

  In step S15, if both vein patterns match, the control unit 81 releases the function restriction of the mobile phone terminal as the process of step S16, and ends the process of FIG.

[Summary]
As described above, according to the mobile phone terminal of the present embodiment, the authentication camera module 21 and the infrared LED 59 that are the main parts of the authentication device are arranged inside the liquid crystal module 25 of the sub liquid crystal display 3. Therefore, the main part of the authentication device is not always exposed to the outside, and therefore, failure and erroneous authentication of a specific user can be reduced.

  Further, according to the mobile phone terminal of the present embodiment, since the main part of the authentication device is arranged in the sub liquid crystal display 3, a dedicated installation space is not required, and therefore the housing can be downsized. In addition, there are few restrictions on determining the appearance design of the mobile phone terminal.

  The above description of the embodiment is an example of the present invention. For this reason, the present invention is not limited to the above-described embodiment, and it is needless to say that various modifications can be made according to the design or the like as long as the technical idea according to the present invention is not deviated.

  For example, the mobile terminal of the present invention may be not only a mobile phone terminal but also a PDA device (PDA: Personal Digital Assistants), and the authentication device of the present invention is not limited to a mobile terminal such as a mobile phone terminal, It can also be mounted on various other electronic devices.

  The authentication device of the present invention can be applied not only to vein authentication as in the above-described embodiment, but also to, for example, fingerprint authentication. When performing fingerprint authentication, the distance between the authentication camera module 21 and the surface of the finger is close. Therefore, for example, a concave lens is provided as a configuration of the lens 41 of the authentication camera module 21 so that a focus can be obtained even at a short distance. To be able to match.

  In addition, the present invention provides a rotating shaft in which the first housing having the display unit and the second housing having the operation unit are substantially perpendicular to the surface of the display unit or the operation unit. A so-called rotary open type mobile phone terminal that can be rotated horizontally in the horizontal direction via a hinge mechanism (connecting means) provided, and the relative positional relationship between the housings can be changed by the hinge mechanism. Or a terminal in which three or more casings are relatively rotatable via a connecting means such as a hinge, or a first casing mainly including a display unit and a display surface of the display unit The present invention can also be applied to a slide-type terminal or the like in which the second housing having the operation unit on the surface in the same direction can be linearly slid in the horizontal direction.

It is the schematic external view which looked at the mobile telephone terminal of this embodiment from the front side. It is the schematic external view which looked at the mobile telephone terminal of this embodiment from the back side. It is a block diagram which shows the schematic internal structure of the mobile telephone terminal of embodiment of this invention. It is the schematic perspective view which looked at the mobile telephone terminal of this embodiment from the side. It is a figure which shows schematic structure of a liquid crystal module and a camera module for authentication, and shows a state in which each liquid crystal molecule of the liquid crystal module is aligned in a direction substantially parallel to the surface of the reflector of the backlight unit. It is a figure which shows schematic structure of a liquid crystal module and a camera module for authentication, and shows a state in which each liquid crystal molecule of the liquid crystal module is aligned in a substantially vertical direction with respect to the surface of the reflector of the backlight unit. It is a figure which shows a mode that the permeation | transmission part vicinity of the liquid crystal module was seen from the glass plate part side. It is the external appearance perspective view which looked at only the reflecting plate of the authentication camera module and the liquid crystal module from the diagonal direction. It is a figure which shows schematic structure of the slide plate with which the camera module for authentication was equipped, and its drive part. It is the schematic perspective view which looked at the mobile telephone terminal of other embodiment of this invention from the side surface side. It is a figure which shows an example of the display image showing the imaging | photography possible area | region of the camera module for authentication. It is a figure which shows the arrangement | sequence of the prism in the permeation | transmission part of the liquid crystal module seen from the camera module for authentication. It is a figure used for description of the relationship between the prism arranged in the transmission part of the liquid crystal module and the imaged pixels on the image sensor of the authentication camera module. It is a figure used for description of the example of the vein image imaged on the image pick-up element of the camera module for authentication by imaging through the prism arranged in the transmission part of a liquid crystal module. It is a figure showing the discontinuous vein image obtained by imaging | photography through the prism arrange | positioned in the permeation | transmission part of a liquid crystal module. It is a figure showing the continuous vein pattern extracted by interpolating the discontinuous vein image obtained by imaging | photography through the prism arrange | positioned in the permeation | transmission part of a liquid crystal module. It is a flowchart which shows the flow of a process at the time of registering a vein pattern of a specific user in memory. It is a flowchart which shows the flow of the process at the time of cancellation | release of the function restriction | limiting by vein authentication and vein authentication in the mobile telephone terminal of this embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 1st housing | casing, 2nd housing | casing, 3 main liquid crystal display, 4 numeric keypad, 5,89 speaker, 6 hinge part, 7,90 microphone, 8 jog dial part, 10 sub liquid crystal display, 11, 91 camera part , 12 Auxiliary shooting light for camera unit, 20 Pressure sensor, 21 Camera module for authentication, 22, 22, 95 Infrared LED, 23 LED unit for backlight, 25 Liquid crystal module, 34 Reflecting surface on slide plate, 35 slide Plate, 36 fulcrum, 37 magnet, 38 electromagnet, 41 lens, 45 imageable area, 50 glass plate part, 51 color filter part, 52 liquid crystal molecule, 53 liquid crystal molecule enclosure part, 54 TFT part, 55 backlight part, 57 back Light reflector, 58 prism, 60 reflector hole, 70 Pixel of image sensor of authentication camera module, 81 control unit, 82 antenna, 83 communication circuit, 84 operation unit, 85 main display unit, 86 display control unit, 87 sub display unit, 88 memory, 92 open / close detection sensor, 94 LED Drive unit, 96 Slide plate drive unit

Claims (20)

Liquid crystal display means in which at least a predetermined area of the display surface can be transmissively displayed;
Photographing means disposed at a position on the inner side with respect to the display surface of the liquid crystal display means and disposed at a position corresponding to the predetermined region of the liquid crystal display means;
Photographing auxiliary light emitting means for emitting photographing auxiliary light used in photographing by the photographing means from the inside of the liquid crystal display means to the outside of the display surface of the liquid crystal display means;
Pressure detecting means for detecting that a predetermined pressing force is applied to the liquid crystal display means;
When the pressure detecting means detects the predetermined pressing force, at least the predetermined area of the liquid crystal display means is displayed in a transmissive manner and the photographing auxiliary light emitting means is turned on, and then photographing by the photographing means is started. The image pattern is extracted from the image information photographed by the photographing means through the transparent display predetermined area of the liquid crystal display means, and the extracted image pattern and the pre-registered image pattern are collated and specified. And a control means for authenticating the person. The authentication device according to claim 1,
The liquid crystal display means has a backlight unit including a reflector having a hole that transmits light at a position corresponding to the predetermined region,
The authentication device according to claim 1, wherein when the pressure detecting means detects the predetermined pressing force, the control means changes the liquid crystal display means to a transmissive display. The authentication device according to claim 2,
The authentication device according to claim 1, wherein the light emitting unit of the photographing auxiliary light emitting means is provided in the light emitting element of the backlight unit. The authentication device according to claim 2,
The authentication apparatus according to claim 1, wherein the light emitting portion of the photographing auxiliary light emitting means is disposed substantially directly below the hole of the reflecting plate. The authentication device according to claim 2,
An open / close plate having a reflective surface having substantially the same reflectance as the reflective plate of the backlight, and covering the hole portion opened in the reflective plate with the reflective surface as necessary,
A plate driving means for driving the opening / closing plate in a covering state in which the opening / closing plate covers the hole and an uncovering state in which the hole is not covered;
The control means controls the plate driving means when photographing with the photographing means to bring the open / close plate into the uncovered state, while the plate driving when not photographing with the photographing means. An authentication apparatus characterized by controlling the means to control the opening / closing plate to the covering state. The authentication device according to claim 1,
Prior to the authentication of the specific person, the control means performs control to display an image for showing the predetermined area as a shootable area on the display screen of the liquid crystal display means. The authentication device according to claim 1,
The photographing means has an image sensor capable of receiving at least infrared rays,
The photographing auxiliary light emitting means has an infrared light emitting element that emits infrared light,
The authentication device, wherein the control means extracts the image pattern from infrared image information taken by the photographing means. The authentication device according to claim 7,
The control means performs authentication of a specific person by comparing a vein pattern of a specific person's finger registered in advance with an image pattern extracted from infrared image information captured by the imaging means. An authentication device. The authentication device according to claim 1,
The authentication apparatus according to claim 1, wherein the control means performs a predetermined interpolation process on the image information photographed by the photographing means to extract the image pattern. A communication means for performing wireless communication;
Liquid crystal display means in which at least a predetermined area of the display surface can be transmissively displayed;
Photographing means disposed at a position on the inner side with respect to the display surface of the liquid crystal display means and disposed at a position corresponding to the predetermined region of the liquid crystal display means;
Photographing auxiliary light emitting means for emitting photographing auxiliary light used in photographing by the photographing means from the inside of the liquid crystal display means to the outside of the display surface of the liquid crystal display means;
Pressure detecting means for detecting that a predetermined pressing force is applied to the liquid crystal display means;
When the pressure detecting means detects the predetermined pressing force, at least the predetermined area of the liquid crystal display means is displayed in a transmissive manner and the photographing auxiliary light emitting means is turned on, and then photographing by the photographing means is started. The image pattern is extracted from the image information photographed by the photographing means through the transparent display predetermined area of the liquid crystal display means, and the extracted image pattern and the pre-registered image pattern are collated and specified. And a control means for canceling a predetermined function restriction when the specific person is authenticated. The mobile terminal according to claim 10,
The liquid crystal display means has a backlight unit including a reflector having a hole that transmits light at a position corresponding to the predetermined region,
The portable terminal according to claim 1, wherein the control means causes the liquid crystal display means to be transmissive display when the pressure detecting means detects the predetermined pressing force. The mobile terminal according to claim 11,
A portable terminal, wherein a light emitting part of the photographing auxiliary light emitting means is provided alongside a light emitting element of the backlight part. The mobile terminal according to claim 11,
The portable terminal according to claim 1, wherein the light emitting portion of the photographing auxiliary light emitting means is disposed substantially directly below the hole of the reflecting plate. The mobile terminal according to claim 11,
An open / close plate having a reflective surface having substantially the same reflectance as the reflective plate of the backlight, and covering the hole portion opened in the reflective plate with the reflective surface as necessary,
A plate driving means for driving the opening / closing plate in a covering state in which the opening / closing plate covers the hole and an uncovering state in which the hole is not covered;
The control means controls the plate driving means when photographing with the photographing means to bring the open / close plate into the uncovered state, while the plate driving when not photographing with the photographing means. A portable terminal characterized in that control is performed to control the means so that the open / close plate is in the covering state. The mobile terminal according to claim 10,
Prior to authentication of the specific person, the control means performs control to display an image for showing the predetermined area as a shootable area on the display screen of the liquid crystal display means. The mobile terminal according to claim 10,
The photographing means has an image sensor capable of receiving at least infrared rays,
The photographing auxiliary light emitting means has an infrared light emitting element that emits infrared light,
The portable terminal characterized in that the control means extracts the image pattern from infrared image information photographed by the photographing means. The mobile terminal according to claim 16, wherein
The control means performs authentication of a specific person by comparing a vein pattern of a specific person's finger registered in advance with an image pattern extracted from infrared image information captured by the imaging means. Mobile terminal. The mobile terminal according to claim 10,
The portable terminal according to claim 1, wherein the control means performs a predetermined interpolation process on the image information photographed by the photographing means to extract the image pattern. The mobile terminal according to claim 10,
First and second at least two housings;
A connecting means for connecting the first and second housings and changing the positional relationship between the housings;
A state detecting means for detecting a state where the positional relationship between the housings is at least a predetermined positional relationship;
The control means performs control to activate the pressure detection means in a state where the pressing force can be detected when the state detection means detects that the positional relation between the casings has reached a predetermined positional relation. A portable terminal characterized by performing. The mobile terminal according to claim 19, wherein
Having at least two of main liquid crystal display means and auxiliary liquid crystal display means,
The liquid crystal display means in which the predetermined area can be transmissively displayed is the auxiliary liquid crystal display means,
The auxiliary liquid crystal display means is arranged on one of the first and second housings and at a position that is always outside the housing, regardless of the positional relationship between the housings. A mobile terminal characterized by

Images