EP3488372B1 - Method for protecting personal information and electronic device thereof - Google Patents
Method for protecting personal information and electronic device thereof Download PDFInfo
- Publication number
- EP3488372B1 EP3488372B1 EP17849096.7A EP17849096A EP3488372B1 EP 3488372 B1 EP3488372 B1 EP 3488372B1 EP 17849096 A EP17849096 A EP 17849096A EP 3488372 B1 EP3488372 B1 EP 3488372B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- electronic device
- fingerprint
- mark
- touch input
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 44
- 230000033001 locomotion Effects 0.000 claims description 9
- 230000004044 response Effects 0.000 claims description 7
- 230000006870 function Effects 0.000 description 41
- 238000004891 communication Methods 0.000 description 36
- 239000000470 constituent Substances 0.000 description 25
- 238000012545 processing Methods 0.000 description 25
- 238000003860 storage Methods 0.000 description 21
- 230000008569 process Effects 0.000 description 20
- 230000003287 optical effect Effects 0.000 description 18
- 230000001413 cellular effect Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 8
- 230000002265 prevention Effects 0.000 description 6
- 239000011521 glass Substances 0.000 description 5
- 239000003990 capacitor Substances 0.000 description 4
- 230000008859 change Effects 0.000 description 4
- 239000000463 material Substances 0.000 description 4
- 238000010276 construction Methods 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 230000003252 repetitive effect Effects 0.000 description 3
- 239000008280 blood Substances 0.000 description 2
- 210000004369 blood Anatomy 0.000 description 2
- 238000007664 blowing Methods 0.000 description 2
- 238000002591 computed tomography Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000036541 health Effects 0.000 description 2
- 238000012905 input function Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000035945 sensitivity Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- WQZGKKKJIJFFOK-GASJEMHNSA-N Glucose Natural products OC[C@H]1OC(O)[C@H](O)[C@@H](O)[C@@H]1O WQZGKKKJIJFFOK-GASJEMHNSA-N 0.000 description 1
- BQCADISMDOOEFD-UHFFFAOYSA-N Silver Chemical compound [Ag] BQCADISMDOOEFD-UHFFFAOYSA-N 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 238000002583 angiography Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000036772 blood pressure Effects 0.000 description 1
- 230000036760 body temperature Effects 0.000 description 1
- 230000010267 cellular communication Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- -1 electricity Substances 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 238000002567 electromyography Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 239000000446 fuel Substances 0.000 description 1
- 239000008103 glucose Substances 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000002513 implantation Methods 0.000 description 1
- 230000006698 induction Effects 0.000 description 1
- 239000004615 ingredient Substances 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000002595 magnetic resonance imaging Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000007639 printing Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 229910052709 silver Inorganic materials 0.000 description 1
- 239000004332 silver Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 239000008399 tap water Substances 0.000 description 1
- 235000020679 tap water Nutrition 0.000 description 1
- 210000003462 vein Anatomy 0.000 description 1
- 238000005406 washing Methods 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
- 229910052724 xenon Inorganic materials 0.000 description 1
- FHNFHKCVQCLJFQ-UHFFFAOYSA-N xenon atom Chemical compound [Xe] FHNFHKCVQCLJFQ-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
- G06F21/316—User authentication by observing the pattern of computer usage, e.g. typical user behaviour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
- G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/45—Structures or tools for the administration of authentication
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
- G06F21/6218—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
- G06F21/6245—Protecting personal data, e.g. for financial or medical purposes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0412—Digitisers structurally integrated in a display
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/12—Fingerprints or palmprints
- G06V40/13—Sensors therefor
- G06V40/1306—Sensors therefor non-optical, e.g. ultrasonic or capacitive sensing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/12—Fingerprints or palmprints
- G06V40/13—Sensors therefor
- G06V40/1318—Sensors therefor using electro-optical elements or layers, e.g. electroluminescent sensing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/12—Fingerprints or palmprints
- G06V40/13—Sensors therefor
- G06V40/1324—Sensors therefor by using geometrical optics, e.g. using prisms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/12—Fingerprints or palmprints
- G06V40/1365—Matching; Classification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
- G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/60—Static or dynamic means for assisting the user to position a body part for biometric acquisition
- G06V40/67—Static or dynamic means for assisting the user to position a body part for biometric acquisition by interactive indications to the user
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
- G06F2203/04105—Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
Definitions
- the present disclosure relates to a method and an electronic device for protecting personal information. More particularly, the present disclosure relates to a method and an electronic device for preventing biometric information from being stolen in the electronic device.
- the electronic device may perform user authentication by using biometric information among personal information of the specific user when the electronic device is unlocked or when the user authentication is required in a specific application in the electronic device.
- the method for acquiring biometric information may include iris recognition, fingerprint recognition, face recognition, palm print recognition, vein distribution recognition, and the like.
- a sensor for fingerprint recognition is widely used because it is possible to implement a fingerprint recognition sensor with high security, with low cost or in a small size.
- the electronic device may acquire fingerprint information through a sensor embedded in the electronic device or through a module outside the electronic device, and prevent fingerprint information leakage by establishing security for the acquired fingerprint information.
- physical fingerprint mark generated during the fingerprint recognition process may remain on the surface or outside of the electronic device. The fingerprint mark may be stolen easily.
- WO-2015/053573-A1 discloses a fingerprint recognition hacking prevention apparatus and a fingerprint hacking prevention surface member for a mobile terminal, and a fingerprint hacking prevention method therefor.
- the purpose of the present invention is to provide a fingerprint recognition hacking prevention apparatus and a fingerprint hacking prevention surface member for a mobile terminal and a fingerprint hacking prevention method therefor, for preventing fingerprint recognition hacking and improving convenience by unlocking a screen using a fingerprint authentication function and at the same time not leaving any hackable fingerprint mark on the surface of the mobile terminal while executing a menu shortcut function by a single action.
- the purpose of the present invention is to enhance personal privacy security by unlocking a screen using a fingerprint authentication function and at the same time executing a screen menu shortcut function using voice authentication for certain words or sentences.
- US-2009/034804-A1 discloses a security method and system using a touch screen that allows manipulation input using only an input tool which is not part of a user's body, i.e., finger manipulation, when a secure function such as secure printing is set instead of a normal function when the touch screen is manipulated, so as to prevent leakage of secure information due to fingerprint marks and smudges caused by finger manipulation.
- the security method includes checking whether or not a password is input, and inputting to the touch screen a password using an input tool which is not part of a user body.
- US-2013/169572-A1 discloses a method for protecting a touch-sensitive device includes: switching the touch-sensitive device from a normal mode to a protection mode when a preset operation is exerted; determining whether a touch operation is exerted after the touch-sensitive device enters the protection mode, and further determine whether a duration of the touch-sensitive device in the protection mode exceeds a preset time interval; comparing a touch size of the touch operation with a preset size when the duration of the touch-sensitive device in the protection mode exceeds the preset time interval; and generating an alarm signal when the touch size is less than the preset size.
- a related touch-sensitive device is also provided.
- KR-2011/0103598-A relates to a method of authenticating fingerprint information of a finger in contact with the touch screen of a device.
- KR-2006/0003689-A relates to a method of fingerprint recognition and a device including a fingerprint sensor.
- US-2016/140379-A1 relates to a user authentication method and system, in which the same sensor surface is used for scanning a fingerprint and for entry of a user-specific code.
- the user specific-code comprises gestures that are guided by a frame
- the expression “configured (or set) to-” used in the present document may be used interchangeably with, for example, “suitable for-”, “having the capacity to-", “designed to-”, “adapted to-”, “made to-”, or “capable of-” in a hardware or software manner in accordance to circumstances.
- the expression “device configured to-” may represent that the device is “capable of ⁇ " together with other devices or components.
- processor configured (or set) to perform A, B and C may represent an exclusive processor (e.g., embedded processor) for performing a corresponding operation, or a generic-purpose processor (e.g., a central processing unit (CPU) or an application processor (AP)) capable of performing corresponding operations by executing one or more software programs stored in a memory device.
- an exclusive processor e.g., embedded processor
- a generic-purpose processor e.g., a central processing unit (CPU) or an application processor (AP) capable of performing corresponding operations by executing one or more software programs stored in a memory device.
- a fingerprint refers to a pattern formed on the surface of finger of a human body. It should be noted that although fingerprint is described as an example of user authentication in the present document, patterns are not excluded as an example of means for performing user authentication.
- An electronic device may, for example, include at least one of a smartphone, a tablet personal computer (PC), a mobile phone, a video phone, an electronic book reader, a desktop PC, a laptop PC, a netbook computer, a workstation, a server, a portable digital assistant (PDA), a portable multimedia player (PMP), a Motion Picture Experts Group (MPEG-1 or MPEG-2) Audio Layer-3 (MP3) player, a medical device, a camera or a wearable device.
- a smartphone a tablet personal computer (PC)
- PC personal computer
- PMP portable multimedia player
- MPEG-1 or MPEG-2 Motion Picture Experts Group Audio Layer-3
- the wearable device may include at least one of an accessory type (e.g., a watch, a ring, a wristlet, an anklet, a necklace, glasses, a contact lens or a head-mounted-device (HMD)), a fabric or clothing integrated type (e.g., electronic clothes), a human-body mount type (e.g., a skin pad or tattoo) or a bio implantation type (e.g., an implantable circuit).
- an accessory type e.g., a watch, a ring, a wristlet, an anklet, a necklace, glasses, a contact lens or a head-mounted-device (HMD)
- a fabric or clothing integrated type e.g., electronic clothes
- a human-body mount type e.g., a skin pad or tattoo
- a bio implantation type e.g., an implantable circuit
- the electronic device may, for example, include at least one of a television (TV), a digital versatile disc (DVD) player, an audio system, a refrigerator, an air conditioner, a cleaner, an oven, a microwave, a washing machine, an air cleaner, a set-top box, a home automation control panel, a security control panel, a media box (for example, Samsung HomeSync TM , Apple TV TM or Google TV TM ), a game console (e.g., Xbox TM or PlayStation TM ), an electronic dictionary, an electronic locking system, a camcorder or an electronic frame.
- TV television
- DVD digital versatile disc
- the electronic device may include at least one of various medical devices (e.g., various portable medical measurement devices (e.g., a blood glucose sensor, a heat rate sensor, a blood pressure monitor, a body temperature meter, etc.), magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), computed tomography (CT), a imaging equipment, an ultrasonic instrument, etc.)), a navigation device, a global navigation satellite system (GNSS), an event data recorder (EDR), a flight data recorder (FDR), a car infotainment device, an electronic equipment for ship (e.g., a vessel navigation device, a gyro compass, etc.), avionics, a security device, a car head unit, an industrial or domestic robot, a drone, an automatic teller's machine (ATM) of a financial institution, point of sales (POS) of shops, an Internet of things (IoT) device (e.g., an electric bulb, various sensors, a sprinkler device
- the electronic device may include at least one of a part of furniture, a building/structure or a car, an electronic board, an electronic signature receiving device, a projector or various metering devices (e.g., tap water, electricity, gas, radio wave metering devices or the like).
- the electronic device may be flexible, or be a combination of two or more of the aforementioned various devices.
- the electronic device according to an embodiment of the present document is not limited to the aforementioned devices.
- the term 'user' may denote a person who uses the electronic device or a device (e.g., an artificial-intelligent electronic device) which uses the electronic device.
- FIG. 1 illustrates a block diagram of a network environment according to an embodiment of the present disclosure.
- the electronic device 101 may include a bus 110, a processor 120, a memory 130, an input/output interface 150, a display 160, and a communication interface 170.
- the electronic device 101 may omit at least one of the constituent elements or additionally have another constituent element.
- the bus 110 may, for example, include a circuit coupling the constituent elements 110, 120, 150, 160 and 170 with one another and forwarding communication (e.g., a control message or data) between the constituent elements.
- the processor 120 may include one or more of a CPU, an AP or a communication processor (CP).
- the processor 120 may, for example, execute operation or data processing for control and/or communication of at least one another constituent element of the electronic device 101. Also, the processor 120 may recognize (or identify) the fingerprint through the input/output interface 150 or the communication interface 170 and may control operation for detecting a fingerprint mark.
- the memory 130 may include a volatile and/or non-volatile memory.
- the memory 130 may, for example, store a command or data related to at least one another constituent element of the electronic device 101.
- the memory 130 may store a software and/or program 140.
- the program 140 may, for example, include a kernel 141, a middleware 143, an application programming interface (API) 145, an application program (or "application”) 147, and the like. At least some of the kernel 141, the middleware 143 or the API 145 may be called an operating system (OS).
- OS operating system
- the kernel 141 may, for example, control or manage system resources (e.g., bus 110, processor 120, memory 130, and the like) that are used for executing operations or functions implemented in other programs (e.g., middleware 143, API 145 or application program 147). Also, the kernel 141 may provide an interface through which the middleware 143, the API 145 or the application program 147 may control or manage the system resources of the electronic device 101 by accessing the individual constituent element of the electronic device 101.
- system resources e.g., bus 110, processor 120, memory 130, and the like
- other programs e.g., middleware 143, API 145 or application program 147.
- the kernel 141 may provide an interface through which the middleware 143, the API 145 or the application program 147 may control or manage the system resources of the electronic device 101 by accessing the individual constituent element of the electronic device 101.
- the middleware 143 may, for example, perform a relay role of enabling the API 145 or the application program 147 to communicate and exchange data with the kernel 141. Also, the middleware 143 may process one or more work requests that are received from the application program 147, in accordance with priority. For example, the middleware 143 may grant priority capable of using the system resources (e.g., the bus 110, the processor 120, the memory 130 or the like) of the electronic device 101 to at least one of the application programs 147, and process one or more work requests.
- system resources e.g., the bus 110, the processor 120, the memory 130 or the like
- the API 145 is, for example, an interface enabling the application program 147 to control a function provided by the kernel 141 or the middleware 143 and may, for example, include at least one interface or function (e.g., an instruction) for file control, window control, image processing, character control or the like
- the input/output interface 150 may forward a command or data inputted from a user or another external device, to another constituent element(s) of the electronic device 101, or output a command or data received from the another constituent element(s) of the electronic device 101, to the user or another external device.
- the display 160 may, for example, include a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, a microelectromechanical systems (MEMS) display or an electronic paper display.
- the display 160 may, for example, display various contents (e.g., a text, an image, a video, an icon, a symbol and/or the like) to a user.
- the display 160 may include a touch screen. And, for example, the display 160 may receive a touch, gesture, proximity or hovering input that uses an electronic pen or a part of the user's body.
- the display 160 may include a fingerprint sensor capable of detecting a user's fingerprint through a touch screen.
- the communication interface 170 may, for example, establish communication between the electronic device 101 and an external device (e.g., the first external electronic device 102, the second external electronic device 104, or the server 106).
- the communication interface 170 may be coupled to a network 162 through wireless communication or wired communication, to communicate with the external device (e.g., the second external electronic device 104 or the server 106).
- the communication interface 170 may transmit and receive a signal including fingerprint information through wireless communication or wired communication with another external device and may acquire position information of the electronic device 101.
- the communication interface 170 may communicate with the external device (e.g., the first external electronic device 102) using a short-range communication link 164.
- the wireless communication may, for example, include a cellular communication that uses at least one of long term evolution (LTE), LTE-advanced (LTE-A), code division multiple access (CDMA), wideband CDMA (WCDMA), universal mobile telecommunications system (UMTS), wireless broadband (WiBro), global system for mobile communications (GSM) and the like.
- LTE long term evolution
- LTE-A LTE-advanced
- CDMA code division multiple access
- WCDMA wideband CDMA
- UMTS universal mobile telecommunications system
- WiBro global system for mobile communications
- GSM global system for mobile communications
- the wireless communication may, for example, include at least one of wireless fidelity (WiFi), Bluetooth (BT), Bluetooth low energy (BLE), Zigbee, near field communication (NFC), magnetic secure transmission (MST), radio frequency (RF) or body area network (BAN).
- the wireless communication may include GNSS.
- the GNSS may, for example, be a global positioning system (GPS), a global navigation satellite system (Glonass), Beidou navigation satellite system (hereinafter, "Beidou”)) or Galileo, the European global satellite-based navigation system.
- GPS global positioning system
- the wired communication may, for example, include at least one of a universal serial bus (USB), a high definition multimedia interface (HDMI), a recommended standard-232 (RS-232), power line communication (PLC), a plain old telephone service (POTS), and the like.
- the network 162 may include at least one of a telecommunications network, for example, a computer network (e.g., local area network (LAN) or wide area network (WAN)), the Internet or a telephone network.
- Each of the first and second external electronic devices 102 and 104 may be a device of the same or different type from that of the electronic device 101. According to various embodiments, all or some of operations executed in the electronic device 101 may be executed in another one electronic device or a plurality of electronic devices (e.g., the first and second external electronic devices 102 and 104 or the server 106). According to an embodiment, in case where the electronic device 101 performs some function or service automatically or in response to a request, the electronic device 101 may, instead of or additionally to executing the function or service in itself, send a request for execution of at least a partial function associated with this to another device (e.g., the first and second external electronic device 102, 104 or server 106).
- another device e.g., the first and second external electronic device 102, 104 or server 106.
- the other electronic device may execute the requested function or additional function, and forward the execution result to the electronic device 101.
- the electronic device 101 may process the received result as it is or additionally, to provide the requested function or service.
- a cloud computing, distributed computing or client-server computing technology may be used, for example.
- FIG. 2 illustrates a block diagram of an electronic device according to an embodiment of the present disclosure.
- an electronic device 201 may, for example, include the entire or part of the electronic device 101 illustrated in FIG. 1 .
- the electronic device 201 may include one or more processors (e.g., APs) 210, a communication module 220, a subscriber identification module (SIM) 224, a memory 230, a sensor module 240, an input device 250, a display 260, an interface 270, an audio module 280, a camera module 291, a power management module 295, a battery 296, an indicator 297 and a motor 298.
- processors e.g., APs
- SIM subscriber identification module
- the processor 210 may, for example, drive an operating system (OS) or an application program to control a majority of hardware or software constituent elements coupled to the processor 210, and may perform various data processing and operations.
- the processor 210 may be, for example, implemented as a system on chip (SoC).
- SoC system on chip
- the processor 210 may further include a graphic processing unit (GPU) and/or an image signal processor (ISP).
- the processor 210 may include at least some (e.g., a cellular module 221) of the constituent elements illustrated in FIG. 2 as well.
- the processor 210 may load a command or data received from at least one of the other constituent elements (e.g., non-volatile memory), to a volatile memory, to process the loaded command or data, and store the result data in the non-volatile memory.
- the communication module 220 may, for example, have the same or similar construction with the communication interface 170.
- the communication module 220 may, for example, include a cellular module 221, a WiFi module 223, a BT module 225, a GNSS module 227, an NFC module 228, and an RF module 229.
- the cellular module 221 may, for example, provide voice telephony, video telephony, a text service, an Internet service or the like through a telecommunication network.
- the cellular module 221 may perform the distinction and authentication of the electronic device 201 within the telecommunication network, by using the SIM (e.g., SIM card) 224.
- SIM e.g., SIM card
- the cellular module 221 may perform at least some functions among functions that the processor 210 may provide.
- the cellular module 221 may include a CP.
- at least some (e.g., two or more) of the cellular module 221, the WiFi module 223, the BT module 225, the GNSS module 227 or the NFC module 228 may be included within one integrated chip (IC) or IC package.
- the RF module 229 may, for example, transmit and receive a communication signal (e.g., RF signal).
- the RF module 229 may, for example, include a transceiver, a power amplifier module (PAM), a frequency filter, a low noise amplifier (LNA), an antenna or the like.
- PAM power amplifier module
- LNA low noise amplifier
- the cellular module 221, the WiFi module 223, the BT module 225, the GNSS module 227 or the NFC module 228 may transmit and receive an RF signal through a separate RF module.
- the SIM 224 may, for example, include a card including a SIM and/or an embedded SIM. And, the SIM 224 may include unique identification information (e.g., integrated circuit card identifier (ICCID)) or subscriber information (e.g., international mobile subscriber identity (IMSI)).
- ICCID integrated circuit card identifier
- IMSI international mobile subscriber identity
- the memory 230 may, for example, include an internal memory 232 or an external memory 234.
- the internal memory 232 may, for example, include at least one of a volatile memory (e.g., a random access memory (RAM) a dynamic RAM (DRAM), a static RAM (SRAM), a synchronous dynamic RAM (SDRAM) or the like) and a non-volatile memory (e.g., a read only memory (ROM), a one time programmable ROM (OTPROM), a programmable ROM (PROM), an erasable PROM (EPROM), an electrically EPROM (EEPROM), a mask ROM, a flash ROM, a flash memory, a hard drive or a solid state drive (SSD)).
- a volatile memory e.g., a random access memory (RAM) a dynamic RAM (DRAM), a static RAM (SRAM), a synchronous dynamic RAM (SDRAM) or the like
- a non-volatile memory e.g., a read
- the external memory 234 may include a flash drive, for example, a compact flash (CF), a secure digital (SD), a micro-SD, a mini-SD, an extreme Digital (xD), a MultiMediaCard (MMC), a memory stick or the like.
- the external memory 234 may be operatively or physically coupled with the electronic device 201 through various interfaces.
- the sensor module 240 may, for example, measure a physical quantity or sense an activation state of the electronic device 201, to convert measured or sensed information into an electrical signal.
- the sensor module 240 may, for example, include at least one of a gesture sensor 240A, a gyro sensor 240B, a barometer 240C, a magnetic sensor 240D, an acceleration sensor 240E, a grip sensor 240F, a proximity sensor 240G, a color sensor 240H (e.g., a red, green, blue (RGB) sensor), a medical sensor 240I, a temperature/humidity sensor 240J, an illuminance sensor 240K or an ultra violet (UV) sensor 240M.
- a gesture sensor 240A e.g., a gyro sensor 240B, a barometer 240C, a magnetic sensor 240D, an acceleration sensor 240E, a grip sensor 240F, a proximity sensor 240G, a color sensor
- the sensor module 240 may, for example, include an E-nose sensor, an electromyography (EMG) sensor, an electroencephalogram (EEG) sensor, an electrocardiogram (ECG) sensor, an infrared (IR) sensor, an iris scan sensor and/or a finger scan sensor.
- the sensor module 240 may further include a control circuit for controlling at least one or more sensors belonging therein.
- the electronic device 201 may further include a processor configured to control the sensor module 240 as a part of the processor 210 or separately, thereby controlling the sensor module 240 while the processor 210 is in a sleep state.
- the input device 250 may, for example, include a touch panel 252, a (digital) pen sensor 254, a key 256 or an ultrasonic input device 258.
- the touch panel 252 may, for example, use at least one scheme among a capacitive overlay scheme, a pressure sensitive scheme, an infrared beam scheme or an ultrasonic scheme.
- the touch panel 252 may further include a control circuit as well.
- the touch panel 252 may further include a tactile layer, to provide a tactile response to a user.
- the (digital) pen sensor 254 may, for example, be a part of the touch panel 252, or include a separate sheet for recognition.
- the key 256 may, for example, include a physical button, an optical key or a keypad.
- the ultrasonic input device 258 may sense an ultrasonic wave generated in an input tool, through a microphone (e.g., microphone 288), to confirm data corresponding to the sensed ultrasonic wave.
- the display 260 may include a panel 262, a hologram device 264, a projector 266, and/or a control circuit for controlling them.
- the panel 262 may, for example, be implemented to be flexible, transparent, or wearable.
- the panel 262 may be constructed as one or more modules together with the touch panel 252.
- the hologram device 264 may show a three-dimensional image to the air using an interference of light.
- the projector 266 may project light onto a screen, to display an image.
- the screen may, for example, be located inside or outside the electronic device 201.
- the interface 270 may, for example, include an HDMI 272, a USB 274, an optical interface 276 or a D-subminiature (D-sub) 278.
- the interface 270 may, for example, be included in the communication interface 170 illustrated in FIG. 1 . Additionally or alternatively, the interface 270 may, for example, include a Mobile High-definition Link (MHL) interface, an SD card/MMC interface or an Infrared Data Association (IrDA) standard interface.
- MHL Mobile High-definition Link
- IrDA Infrared Data Association
- the audio module 280 may, for example, convert a sound and an electrical signal interactively. At least some constituent elements of the audio module 280 may be, for example, included in the input/output interface 150 illustrated in FIG. 1 .
- the audio module 280 may for example, process sound information that is inputted or outputted through a speaker 282, a receiver 284, an earphone 286, the microphone 288 or the like.
- the camera module 291 is, for example, a device able to photograph a still image and a video. According to an embodiment, the camera module 291 may include one or more image sensors (e.g., front sensor or rear sensor), a lens, an ISP or a flash (e.g., an LED, a xenon lamp or the like).
- the power management module 295 may, for example, manage the electric power of the electronic device 201.
- the power management module 295 may include a power management integrated circuit (PMIC), a charger IC or a battery or fuel gauge.
- the PMIC may, for example, employ a wired and/or wireless charging scheme.
- the wireless charging scheme may, for example, include a magnetic resonance scheme, a magnetic induction scheme, an electromagnetic wave scheme or the like.
- the wireless charging scheme may further include a supplementary circuit for wireless charging, for example, a coil loop, a resonance circuit, a rectifier or the like.
- the battery gauge may, for example, measure a level of the battery 296, a voltage being in charge, an electric current or a temperature.
- the battery 296 may, for example, include a rechargeable battery and/or a solar battery.
- the indicator 297 may display a specific state, for example, a booting state, a message state, a charging state or the like of the electronic device 201 or a part (e.g., processor 210) of the electronic device 201.
- the motor 298 may convert an electrical signal into a mechanical vibration, and may generate a vibration, a haptic effect or the like.
- the electronic device 201 may, for example, include a mobile TV support device (e.g., GPU) capable of processing media data according to the standards of digital multimedia broadcasting (DMB), digital video broadcasting (DVB), mediaFlo TM or the like.
- DMB digital multimedia broadcasting
- DVD digital video broadcasting
- mediaFlo TM mediaFlo TM
- Each of the constituent elements described in the present document may consist of one or more components, and a name of the corresponding constituent element may be varied according to the kind of the electronic device.
- the electronic device e.g., electronic device 201) may omit some constituent elements, or further include additional constituent elements, or combine some of
- FIG. 3 illustrates a block diagram of a program module according to an embodiment of the present disclosure.
- a program module 310 may include an OS for controlling resources related to an electronic device (e.g., the electronic device 101) and/or various applications (e.g., the application program 147) driven on the OS.
- the OS may, for example, include Android TM , iOS TM , Windows TM , Symbian TM , Tizen TM or Bada TM .
- the program module 310 may include a kernel 320 (e.g., the kernel 141), a middleware 330 (e.g., the middleware 143), an API 360 (e.g., the API 145), and/or an application 370 (e.g., the application program 147). At least a part of the program module 310 may be preloaded onto an electronic device, or be downloaded from an external electronic device (e.g., the first and second external electronic devices 102 and 104, the server 106, etc.).
- an external electronic device e.g., the first and second external electronic devices 102 and 104, the server 106,
- the kernel 320 may, for example, include a system resource manager 321 and/or a device driver 323.
- the system resource manager 321 may perform control of a system resource, allocation thereof, recovery thereof or the like.
- the system resource manager 321 may include a process management unit, a memory management unit or a file system management unit.
- the device driver 323 may, for example, include a display driver, a camera driver, a BT driver, a shared memory driver, a USB driver, a keypad driver, a WiFi driver, an audio driver or an interprocess communication (IPC) driver.
- IPC interprocess communication
- the middleware 330 may, for example, provide a function that the application 370 commonly needs, or provide various functions to the application 370 through the API 360 so that the application 370 may make use of restricted system resources within an electronic device.
- the middleware 330 may include at least one of a runtime library 335, an application manager 341, a window manager 342, a multimedia manager 343, a resource manager 344, a power manager 345, a database manager 346, a package manager 347, a connectivity manager 348, a notification manager 349, a location manager 350, a graphic manager 351 or a security manager 352.
- the runtime library 335 may, for example, include a library module that a compiler uses to add a new function through a programming language while the application 370 is executed.
- the runtime library 335 may perform input output management, memory management or arithmetic function processing.
- the application manager 341 may, for example, manage a lifecycle of the application 370.
- the window manager 342 may manage a graphic user interface (GUI) resource used by a screen.
- the multimedia manager 343 may detect a format required for playing media files, and perform encoding or decoding of the media file by using a codec suitable to the corresponding format.
- the resource manager 344 may manage a source code of the application 370 or a space of a memory.
- the power manager 345 may, for example, manage a battery capacity or a power supply, and provide power information required for an operation of an electronic device. According to an embodiment, the power manager 345 may interwork with a basic input/output system (BIOS).
- the database manager 346 may, for example, create, search or change a database that will be used by the application 370.
- the package manager 347 may manage installation or updating of an application that is distributed in a form of a package file.
- the connectivity manager 348 may, for example, manage wireless connectivity.
- the notification manager 349 may, for example, provide events such as an arrival message, an appointment, a proximity notification, etc. to a user.
- the location manager 350 may, for example, manage location information of an electronic device.
- the graphic manager 351 may, for example, manage a graphic effect that will be provided to a user, or a user interface related with this.
- the security manager 352 may, for example, provide system security or user authentication.
- the middleware 330 may include a telephony manager for managing a voice or video telephony function of an electronic device, or a middleware module capable of forming a combination of functions of the aforementioned constituent elements.
- the middleware 330 may provide a module that is specialized based on the type of an OS.
- the middleware 330 may dynamically delete some of the existing constituent elements or add new constituent elements.
- the API 360 is, for example, a set of API programming functions, and may be provided to have another construction in accordance with the OS.
- Android or iOS may provide one API set by platform
- Tizen may provide two or more API sets by platform.
- the application 370 may, for example, include a home 371, a dialer 372, a short message service (SMS)/multimedia messaging service (MMS) 373, an instant message (IM) 374, a browser 375, a camera 376, an alarm 377, a contact 378, a voice dial 379, an electronic mail (e-mail) 380, a calendar 381, a media player 382, an album 383, a watch 384, health care (e.g., measuring a momentum, a blood sugar or the like), or an environment information (e.g., air pressure, humidity or temperature information) provision application. Also, the application 370 may include a fingerprint recognition application 385 for fingerprint recognition.
- the application 370 may include an information exchange application that may support information exchange between an electronic device and an external electronic device.
- the information exchange application may, for example, include a notification relay application for relaying specific information to the external electronic device, or a device management application for managing the external electronic device.
- the notification relay application may relay notification information generated by another application of an electronic device to an external electronic device, or receive notification information from the external electronic device to provide the received notification information to a user.
- the device management application may, for example, install, delete or update a function (e.g., turn-on / turn-off of the external electronic device itself (or some constituent components) or adjustment of a brightness (or resolution) of a display) of the external electronic device that communicates with the electronic device, or an application operating in the external electronic device.
- the application 370 may include an application (e.g., a health care application of a mobile medical instrument) designated according to an attribute of the external electronic device.
- the application 370 may include an application received from the external electronic device.
- At least a part of the program module 310 may be implemented (e.g., executed) by software, firmware, hardware (e.g., the processor 210) or a combination of at least two or more of them, and may include a module for performing one or more functions, a program, a routine, sets of instructions or a process.
- module used in the present document may include a unit consisting of hardware, software or firmware and, for example, may be used interchangeably with the terms “logic”, “logic block”, “component”, “circuit” or the like.
- the “module” may be an integrally configured component or the minimum unit performing one or more functions or a part thereof.
- the “module” may be implemented mechanically or electronically and, for example, may include an application-specific integrated circuit (ASIC) chip, field-programmable gate arrays (FPGAs) or a programmable logic device, which has been known or will be developed in future, performing some operations.
- ASIC application-specific integrated circuit
- FPGAs field-programmable gate arrays
- programmable logic device which has been known or will be developed in future, performing some operations.
- At least a part of an apparatus (e.g., modules or functions thereof) or method (e.g., operations) may, for example, be implemented by an instruction that is stored in a computer-readable storage media in the form of a program module.
- the instruction is executed by a processor (e.g., the processor 120)
- the processor may perform a function corresponding to the instruction.
- the computer-readable recording media may include a hard disk, a floppy disk, a magnetic media (e.g., a magnetic tape), an optical recording media (e.g., a compact disc - read only memory (CD-ROM) or a DVD), a magneto-optical media (e.g., a floptical disk), an internal memory, etc.
- the instruction may include a code that is made by a compiler or a code that is executable by an interpreter.
- the module or program module may include at least one or more of the aforementioned constituent elements, or omit some, or further include another constituent element. Operations carried out by the module, the program module or the another constituent element according to various embodiments may be executed in a sequential, parallel, repeated or heuristic manner, or at least some operations may be executed in different order or be omitted, or another operation may be added.
- FIG. 4 illustrates a functional block diagram of an electronic device according to various embodiments of the present disclosure.
- the electronic device 401 may include a display unit 410, a control unit 420, an input unit 430, and a storage unit 440.
- the display unit 410 may perform a display function based on the control of the control unit 420. More specifically, the display unit 410 may receive information on at least one frame for configuring a screen of the display unit 410 from the control unit 420, and display a screen by controlling a plurality of pixels included in the display unit 410 based on the information.
- the display unit 410 may correspond to the display 160 of FIG. 1 and the display 260 of FIG. 2 .
- the control unit 420 may control the overall operation of the electronic device 401.
- the control unit 420 may control components (e.g., the display unit 410, the input unit 430, the storage unit 440, and the like) for performing functions of the electronic device 401.
- the control unit 420 may control the components of the electronic device by using data or instructions stored in the storage unit 440, and perform functions of the electronic device by controlling the components of the electronic device.
- the control unit 420 may include a fingerprint recognition processing unit 421 for processing fingerprint information.
- the control unit 420 may include a fingerprint mark removing unit 422 for determining the presence of a fingerprint mark and determining whether to display an interface for removing the fingerprint mark.
- the control unit 420 may correspond to the processor 120 of FIG. 1 and the processor 210 of FIG. 2 .
- the control unit 420 may be configured with a CPU, an AP, a microcontroller and the like. Also, the control unit 420 may be configured with one or more processors. For example, the control unit 420 may include one or more of an AP or a CP.
- the input unit 430 may perform an input function of the electronic device 401.
- the input unit 430 may receive (or detect) an input from a user of the electronic device 401, generate a signal corresponding to the input of the user, and transmit the generated signal to the control unit 420 to perform a function according to the intention of the user.
- the input unit 430 may include plurality of components for receiving input from the user. For example, for fingerprint recognition function, the input unit 430 may transmit a signal corresponding to fingerprint information recognized by the input unit to the control unit 420, and the control unit 420 may identify the fingerprint information based on the signal received from the input unit 430.
- the input unit 430 may correspond to the input/output interface 150 of FIG. 1 and the input device 250 of FIG. 2 .
- the input unit 430 may include a fingerprint sensor.
- the fingerprint sensor may include various sensors used for fingerprint recognition function.
- the fingerprint sensor may include a sensor as shown in FIGS. 5A to 5C .
- the input unit 430 may transmit a signal corresponding to fingerprint information recognized by the fingerprint sensor to the control unit 420, and the control unit 420 may identify the fingerprint information based on the signal received from the input unit 430.
- the fingerprint sensor may correspond to the sensor module 240 of FIG. 2 .
- the storage unit 440 may store various programs for operating the electronic device 401, store downloaded data or generated data while performing the various programs. Also, the storage unit 440 may store various commands or instructions for operating the electronic device 401.
- the storage unit 440 may include a storage device embedded in the electronic device 401 or a storage device attachable to the electronic device 401.
- the storage unit 440 may correspond to the memory 130 of FIG. 1 and the memory 230 of FIG. 2 .
- the input unit 430 may disposed in the display unit 410.
- the display unit 410 and the input unit 430 may be integrated as a touch screen.
- the fingerprint sensor disposed in the input unit 430 may be located in the display unit 410 as shown in FIG. 6A or 6B .
- the display unit 410 may provide an input function as well as an output function through the touch panel of the display unit 410.
- the display unit 410 may detect (or identify) physical characteristics (capacitance, frequency, etc.) based on the various touch inputs (e.g., tap, double tap, touch, touch move, multi touch, pressure touch, etc.) caused by an input tool (or means) such as a finger, a stylus, or an electronic pen.
- the display unit 410 may generate a signal for indicating the detected physical characteristics, and may transmit the generated signal to the control unit 420.
- FIG. 5A illustrates a capacitive sensor for fingerprint recognition in the electronic device according to an embodiment of the present disclosure.
- a capacitive sensor 501 may facilitate fingerprint recognition.
- the capacitive sensor 501 includes a micro-capacitor plate 510.
- the capacitive sensor 501 may detect voltage difference between the voltage of a point, on the micro-capacitor plate 510, corresponding to the contact point 514 where the ridge 511 of the finger surface is located and the voltage of a point, on the micro-capacitor plate 510, corresponding to the air region 513 where the valley 512 is located on the micro-capacitor plate 510.
- the capacitive sensor 501 may transmit the information on the voltage difference to the control unit 420, and the control unit 420 may identify the fingerprint information 502 from the information received from the fingerprint sensor.
- the capacitive sensor 501 may be positioned in or under a display panel of the display unit 410, and the control unit 420 may perform fingerprint authentication for the user's finger contacted to the display unit 410. In other words, the control unit 420 may acquire the fingerprint information 502 by identifying the positions of the ridge 511 and the valley 512 through the capacitive sensor 501 from the user's finger contacted to the display unit 410.
- the capacitive sensor 501 may be disposed under the lower surface of the display panel of the display unit 410.
- the detection sensitivity of the capacitive sensor 501 may largely be changed depending on the distance from the touch input. In other words, when a distance between a position where the capacitive sensor 501 is disposed and a position to which the user's finger is contacted is more than a specific distance, the detection sensitivity may be lowered and the accuracy of the detected fingerprint may be lower than a specific level. Therefore, in order to perform more precise detection, the capacitive sensor 501 may be disposed in a region that is relatively closer (e.g., a region having a depth of less than 50 micrometers) to the outer surface of the display panel of the display unit 410 than the other fingerprint sensors (e.g., optical sensor, ultrasonic sensor). However, the arrangement of the capacitive sensor 501 is merely an example, and the capacitive sensor 501 may be variously arranged according to the implementation.
- FIG. 5B illustrates an optical sensor for fingerprint recognition in the electronic device according to various embodiments of the present disclosure.
- an optical sensor 521 may facilitate fingerprint recognition.
- the optical sensor 521 may include a photodetector 544.
- the photodetector 544 may identify the position of the ridge 531 and the position of the valley 532 in the region where the user's finger is contacted based on information on the light, which is passed through the glass prism 542 and the lens 543, emitted from the light source 541.
- the light source 541 emits the light for detecting the fingerprint, and the light emitted from the light source 541 enters the glass prism 542 along the optical path 545.
- the light entered into the glass prism 542 reaches the air region 533 where contact is not occurred, the light is regularly reflected with an angle of reflection equal to the incident angle and forms an optical path A.
- the light entered into the glass prism 542 reaches the contact region 534 where contact is occurred, the light is not reflected but absorbed and does not form an optical path B.
- the light reflected from the air region 533 is refracted through the lens 543 and reaches the photodetector 544.
- the photodetector 544 may identify the region where the light arrives as the region where the valley 532 is located and the region where the light does not arrive as the region where the ridge 531 is located.
- the control unit may identify the fingerprint information 522 from the information on the positions of the ridge 531 and the valley 532.
- the optical sensor 521 may be disposed in a region that is deeper from the outer surface of the display panel of the display unit 410 than the capacitive sensor 501 shown in FIG. 5A .
- the photodetector 544 may be spaced apart from the surface of panel of the display unit 410 by 100 micrometers.
- the photodetector 544 may be configured with a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS).
- CCD charge coupled device
- CMOS complementary metal-oxide-semiconductor
- FIG. 5C illustrates an ultrasonic sensor for fingerprint recognition in the electronic device according to an embodiment of the present disclosure.
- an ultrasonic sensor 551 may facilitate fingerprint recognition at a contact point 564 on the location of a ridge 561 and an air region 563 where a valley 562 is located on the display panel 570.
- the ultrasonic sensor 551 includes at least one transducer 572.
- the at least one transducer 572 may emit an ultrasonic signal 571 toward the display panel 570 of the electronic device 401, and may generate a signal for identifying a touch pattern on the display panel 570 by converting the ultrasonic signal reflected from the display panel 570 into an electric signal.
- an ultrasonic signal 571 reflected from the region where the ridge 561 is located arrives to the transducer 572 earlier than an ultrasonic signal reflected from the region where the valley 562 is located.
- the transducer 572 may generate the electric signal based on the difference between timings at which the ultrasonic signals arrive.
- the transducer 572 may transmit the generated electric signal to the control unit 420 of the electronic device 401, and the control unit 420 may acquire fingerprint information 552 from the transmitted signal.
- the ultrasonic sensor 551 may have a larger volume relative to the capacitive sensor 501 or the optical sensor 521, or may be located within a wider range relative to the capacitive sensor 501 or the optical sensor 521. Therefore, the ultrasonic sensor 551 may be disposed in a region that is deeper from the outer surface of the display panel of the display unit 410 than the capacitive sensor 501 shown in FIG. 5A and the optical sensor 521 shown in FIG. 5B .
- FIG. 6A illustrates an arrangement of a fingerprint sensor disposed under a touch panel of an electronic device according to an embodiment of the present disclosure.
- a fingerprint sensor 601 may correspond to one or more of the capacitive sensor 501 of FIG. 5A , the optical sensor 521 of FIG. 5B , or the ultrasonic sensor 551 of FIG. 5C .
- the fingerprint sensor 601 is located in a partial area 611 of the display panel 602, and the fingerprint recognition of the electronic device 401 is performed through the partial area 611.
- the display unit 410 of the electronic device 401 may display a user interface (e.g., GUI) for removing a fingerprint mark (or a fingerprint trace) in the partial area 611.
- GUI user interface
- FIG. 6B illustrates an arrangement of a fingerprint sensor disposed under a touch panel of the electronic device according to an embodiment of the present disclosure.
- the fingerprint sensor 601 may correspond to one or more of the capacitive sensor 501 of FIG. 5A , the optical sensor 521 of FIG. 5B , or the ultrasonic sensor 551 of FIG. 5C .
- the fingerprint sensor 601 is located in an entire area 612 of the display panel 602.
- the fingerprint recognition is performed through the entire area 612.
- the control unit 420 of the electronic device 401 may determine the region where the fingerprint mark is present among the entire area, and the display unit 410 of the electronic device 401 may display the user interface for removing a fingerprint mark in the determined region.
- the user experience (UX), i.e., usability
- the fingerprint sensor 601 is disposed in or under the display panel 602 in the embodiments of FIGS. 6A and 6B , the fingerprint sensor 601 may be variously positioned in the electronic device 401.
- the fingerprint sensor 601 may be located in the home button of the electronic device or may be located on inner surface of the side part or inner surface of rear part of the electronic device.
- the fingerprint sensor 601 may be located in another electronic device connected to the electronic device, and display the user interface for removing a fingerprint mark on the another electronic device in order to prevent fingerprint mark stealing from the another electronic device.
- the operation of the electronic device 401 for removing fingerprint marks will be described with reference to FIGS. 7 to 16 .
- the following description is based on the electronic device 401 of FIG. 4 , it may be performed by the electronic device 101 of FIG. 1 or the electronic device 201 of FIG. 2 .
- the following embodiments may be performed by components of the electronic device 101 of FIG. 1 or the electronic device 201 of FIG. 2 that substantially correspond to the components of the electronic device 401 of FIG. 4 .
- FIG. 7 illustrates an operation of an electronic device according to an embodiment of the present disclosure.
- the fingerprint recognition processing unit 421 of the electronic device 401 may detect a touch input on the electronic device through the fingerprint sensor 601.
- the touch input may include a touch input for switching the operation mode of the electronic device 401 from a lock mode to an unlock mode as shown in FIG. 17 .
- the electronic device 401 may display a screen 1711 indicating that the electronic device 401 is operating in the lock mode.
- Fingerprint recognition may be performed based on a touch input received via a partial area 1701 of the display unit 410, and the lock mode can be released according a result the fingerprint recognition. After the lock mode is released, the electronic device may switch to the unlock mode and display the main screen 1712.
- FIG. 17 illustrates a user interface for access through fingerprint recognition in an electronic device according to an embodiment of the present disclosure.
- FIG. 18 illustrates a fingerprint mark in a state where the fingerprint mark is capable of being stolen in an electronic device according to various embodiments of the present disclosure.
- the touch input in the operation 701 in FIG. 7 may include a touch input for executing security mode, proceeding payment, or a personal authentication procedure.
- the touch input in the operation 701 of FIG. 7 includes a touch input that is inputted during an operation of the electronic device 401.
- the touch input in the operation 701 includes not only a touch input inputted in the process of executing an application of the electronic device 401 but also a long press touch associated with the function of the electronic device 401 or a force touch, which is distinguished according to a pressure in the electronic device 401.
- the fingerprint sensor located at the home button or around the home button may be generally configured with a capacitive sensor.
- a fingerprint mark may be captured using a sticky material having fat or oil as an ingredient at the home button.
- the captured fingerprint mark 1801 may be transferred to an electric charge sensitive material (e.g., AgIC4 silver conductive ink).
- the shape of the fingerprint can be acquired through the electric charge sensitive material.
- a fingerprint image 1802 of FIG. 18 can be obtained by performing a simple image processing (e.g., contrast enhancement) on the image 1803 for the fingerprint mark, without additional physical procedures.
- a simple image processing e.g., contrast enhancement
- the user can conveniently perform the fingerprint recognition, the risk of the fingerprint stealing increases.
- the electronic device 401 of FIG. 4 is a public device that can be used by unspecified number of people, the risk is further increased.
- the control unit 420 may determine whether there is a risk that fingerprints may be stolen.
- the control unit 420 of the electronic device 401 may determine whether the electronic device 401 is a public device commonly used by a plurality of users.
- the public device may refer to a device that is configured to be accessible by an unspecified number of users, unlike a personal device that is configured to allow access only to a specific user or a specific user group.
- the public device may include at least one of a desktop PC, a laptop PC, a tablet, a medical device, an ATM, or a kiosk located in a public place.
- the control unit 420 may determine whether the electronic device 401 is a public device based on at least one of the type, the user log, or the location of the electronic device 401.
- An example of the process for determining whether the electronic device 401 is a public device may be performed as the operations to be described by FIGS. 8 to 12 .
- the control unit 420 may determine whether the electronic device is in a state in which the fingerprint mark according to a touch input is at risk of being stolen. In an embodiment, when the touch input received through the display unit 410 stays long enough at one point, the control unit 420 may determine that the electronic device is in a state in which there is a risk that the fingerprint mark caused by the touch input can be stolen. For example, the control unit 420 may detect amount of change of touch tower (long/short axis) information or touch coordinate information of the touch input. When the amount of change is less than a specific value, the control unit 420 may determine that the electronic device is in a state in which there is a risk of fingerprint mark being stolen. In another embodiment, the control unit 420 may determine that the electronic device is in a state in which there is a risk of fingerprint mark being stolen when a pressure due to the touch input is detected but a movement of the touch input is not detected.
- operation 703 of FIG. 7 may be omitted.
- the control unit 420 may perform an operation for removing the fingerprint mark regardless of whether the electronic device is in a state in which there is a risk of fingerprint mark being stolen.
- the control unit 420 may perform processing for removing the fingerprint mark.
- the fingerprint recognition processing unit 421 of the control unit 420 may determine whether a fingerprint mark is left on the electronic device 401.
- the fingerprint mark is a physical trace formed similar to the shape of the user's fingerprint from a material that is on the surface of the electronic device 401 or on the surface of the user's finger.
- the fingerprint mark may be identified by the fingerprint sensor 601.
- the process for removing the fingerprint mark in operation 705 may be performed as the operations to be described by FIGS. 13 to 15 .
- the process for removing the fingerprint mark in operation 705 may include an operation displaying a user interface that guides removing the fingerprint mark.
- the user interface that guides removing the fingerprint mark may be a user interface that guides or induces a specific gesture (e.g., a swipe gesture) on the location where the fingerprint mark is present.
- the user interface may be configured to disappear on condition of receiving a touch input of at least one of a designated intensity or more, a designated distance or more, or a designated number or more.
- FIG. 19 illustrates a user interface that guides to remove a fingerprint mark from an electronic device according to various embodiments of the present disclosure.
- a user interface 1901 of FIG. 19 is an example of an interface that guides a simple cross swipe gesture.
- the user interface 1901 can derive the removal of the fingerprint mark by guiding that the user performs a swipe gesture on the location of the user interface 1901.
- the user interface 1901 may be configured to disappear on condition of receiving a gesture input corresponding to the user interface 1901.
- the interface 1901 may be configured to disappear on condition of that a touch input with designated pressure is repeatedly swiped a designated number of times or more within the area of the user interface 1901.
- the user interface 1902 of FIG. 19 shows an example of a user interface, which guides a touch input for animation (or visual effect) in which a plurality of sub-objects (e.g., petals) in an object (e.g., flower) move, blowing the petals off the flower.
- the user interface 1902 may initially display the object (e.g., flower) including the plurality of sub-objects (e.g., petals). Then, the user interface 1902 may display an animation (e.g., blowing the petals off the flow) in which some of the plurality of sub-objects sequentially move (e.g., fly) while receiving the user's repetitive touch input (e.g., repetitive swipe gesture).
- the plurality of sub-objects moved by the touch input may be configured to fade out according to moving out of the area of the user interface 1902. Also, the user interface 1902 may be configured to disappear when all of the plurality of sub-objects move out.
- the user interface 1903 of FIG. 19 shows an example of a user interface that guides a touch input for animation (or visual effect) in which an object (e.g., bird) moves (e.g., fly).
- the user interface 1903 may initially display an object (e.g., bird).
- the user interface 1903 may display the animation in which the object moves (e.g., fly) while receiving the user's touch input.
- the object may be moved in a direction corresponding to a direction of the touch input, and may be configured to disappear when the object moves out of the area of the user interface 1903.
- the user interface 1904 of FIG. 19 shows an example of a user interface that guides a touch input for animation in which an object (e.g., wheel) changes (e.g., spin).
- the user interface 1904 may initially display an object (e.g., wheel). Then, when the user's touch input (e.g., rotation gesture) is received on the user interface 1904, the user interface 1904 may display an animation in which the object changes (e.g., spin) while receiving the user's touch input.
- the speed of change of the object e.g., rotational speed
- the user interface 1904 may be configured to disappear when the object is changed more than a designated number of times (e.g., rotate more than 10 times).
- the user interface 1905 of FIG. 19 shows an example of a user interface (e.g., tick marks) that guides a gesture corresponding to a specific mark (e.g., V mark).
- the user interface 1905 may initially display a specific mark (e.g., V mark). Then, the user interface 1905 may be configured to disappear when a gesture corresponding to the mark (e.g., V gesture) is inputted. In some embodiments, the mark may be configured to disappear when the gesture corresponding to the mark is received at a designated intensity or more.
- FIG. 20A illustrates a user interface that guides to remove a fingerprint mark from an electronic device according to various embodiments of the present disclosure.
- a user interface that guides removing the fingerprint mark may be combined with another user interface for performing a particular function of the electronic device 401.
- the control unit 420 may control the display unit 410 to display a user interface 2001 including a slide toggle within the area where the fingerprint mark is present, when a mode (or state) of the electronic device 401 is switched to a lock mode (state) due to any reason (e.g., log off).
- the fingerprint mark can be removed by receiving a gesture corresponding to the toggle slide in the user interface.
- the control unit 420 may convert the operation mode of the electronic device 401 from the lock mode to the unlock mode based on determining that the fingerprint mark is removed.
- FIG. 20B illustrates a user interface that guides to remove a fingerprint mark from an electronic device according to various embodiments of the present disclosure.
- the user interface that guides removing the fingerprint mark may include a message notifying the presence of the fingerprint mark or guiding the removal of the fingerprint mark.
- the control unit 420 may control the display unit 410 to display a user interface 2051 that includes a message notifying to remove the fingerprint mark to the user.
- the control unit 420 may control the display unit 410 to display information indicating the location of the fingerprint mark together with the message.
- the user interface 2051 may be configured to inform that a fingerprint mark exists and to disappear upon receiving an input on a specific object (e.g., an OK button).
- FIGS. 19 , 20A , and 20B illustrate embodiments that utilize a graphical user interface to guide removal of fingerprint mark
- various methods e.g., sound or vibration
- the electronic device 401 may guide to remove the fingerprint mark by vibrating the electronic device 401 or by outputting sound indicating that the fingerprint mark exists.
- the electronic device 401 may remove the fingerprint mark due to the touch input of the user. By removing the fingerprint mark, it is possible to prevent the fingerprint from being stolen.
- FIG. 8 illustrates an operation for determining whether a fingerprint is capable of being stolen from an electronic device according to an embodiment of the present disclosure.
- the control unit 420 of FIG. 4 may identify whether a type of the electronic device 401 is configured and the type of the electronic device.
- the type of the electronic device 401 includes a type corresponding to a personal device for a specific user or a type corresponding to a public device for unspecified (or common) users.
- the type of the electronic device 401 may be preset for the electronic device, and information on the preset type of the electronic device 401 may be stored in the storage unit 440 of the electronic device.
- the information on the type of the electronic device 401 may be configured, by the administrator, at the time of manufacture or initial setting, and may be stored in the storage unit 440 with other configuration information.
- the control unit 420 may identify the configuration information stored in the storage unit 440 to determine whether information on the type of the electronic device is stored in the storage unit 440. If the type of the electronic device 401 is not identified from the configuration information, the control unit 420 may perform one of the operations shown in FIGS. 9 to 12 . Alternatively, if the type of the electronic device 401 is not identified from the configuration information, the control unit 420 may determine (or assume) that the electronic device corresponds to a public device.
- the control unit 420 identifies whether the type of the electronic device 401 corresponds to a public device. If the control unit 420 identifies that the electronic device 401 is configured as a public device, the control unit 420 may determine that the electronic device 401 is a public device by proceeding to operation 805. For example, the control unit 420 may identify configuration information on the type of the electronic device 401, and when the type of the electronic device 401 is ATM, the fingerprint mark removing unit 422 may determine that the electronic device 401 is configured as a public device. If the control unit 420 identifies that the electronic device 401 is configured as a personal device, the control unit 420 may determine that the electronic device 401 is configured as a personal device by proceeding to operation 807.
- the control unit 420 may determine that a fingerprint of the user of the electronic device 401 is capable of being stolen from the electronic device based on determining that the electronic device 401 is a public device. Thereafter, the control unit 420 may perform a process for removing the fingerprint mark by proceeding to operation 705 of FIG. 7 .
- FIG. 9 illustrates an operation for determining whether a fingerprint is capable of being stolen from an electronic device according to an embodiment of the present disclosure.
- the control unit 420 of FIG. 4 may identify an access log to the electronic device 401. For example, the control unit 420 may identify whether information on user access to the electronic device 401 exists or whether the information on the user access is valid.
- the information on the user access may include one or more of information on an identifier (ID) used for accessing the electronic device 401 or information on access time.
- ID information on an identifier
- the control unit 420 may identify whether the information on ID used for user access and the information on access time exist, and if so, the control unit 420 may identify whether the information on the user access is valid.
- the control unit 420 may determine whether the information on user access is valid based on the information on the access time.
- the control unit 420 may determine that the access to the electronic device 401 via the ID is not valid. Also, the control unit 420 may determine whether the information on user access is valid based on the number of the user access. For example, if the number of user access is less than the reference number (e.g., less than 5 times), the control unit 420 may determine that the information on user access is not valid. When the information on user access is not valid, the control unit 420 may perform the operation of FIG. 8 or 10 to 12 , or may determine that the electronic device 401 is a public device.
- a reference time e.g., a month before
- control unit 420 may identify the number of users accessed to the electronic device 401, and determine whether the number of users is greater than the reference number of users by proceeding to operation 903. For example, the control unit 420 may determine the number of IDs that accessed to the electronic device 401 as the number of users.
- the control unit 420 may determine that the electronic device 401 is a public device by proceeding to operation 905.
- the information on user access comprises repetitive accesses utilizing guest ID
- the control unit 420 may determine that the electronic device 401 is a public device.
- control unit 420 may determine that the electronic device 401 is a personal device by proceeding to operation 907.
- the control unit 420 may determine that the state of the electronic device 401 is a state where the fingerprint of the user is capable of being stolen. Thereafter, the control unit 420 may perform a process for removing the fingerprint mark by proceeding to operation 705 of FIG. 7 .
- FIG. 10 illustrates an operation for determining whether a fingerprint is capable of being stolen from an electronic device according to various embodiments of the present disclosure.
- the control unit 420 of FIG. 4 may identify a GPS coordinate of the electronic device.
- the GPS coordinate is merely an example of information for indicating the location of the electronic device, and other information for indicating the location of the electronic device may be utilized.
- the electronic device 401 may include a communication unit or at least one transceiver.
- the transceiver is a component corresponding to the communication interface 170 of FIG. 1 or the communication module 220 of FIG. 2 .
- the control unit 420 may identify information on the location of the electronic device 401 through the communication unit.
- the control unit 420 may acquire information on the GPS coordinate of the electronic device 401 through the communication unit.
- the control unit 420 may utilize the information on map information that is acquired from a server (e.g., server 106 of FIG. 1 ) connected to the electronic device or that is stored in the storage unit 440 of the electronic device.
- a server e.g., server 106 of FIG. 1
- the control unit 420 may determine whether the electronic device 401 is located in public place by proceeding to operation 1003. For example, when a location corresponding to the GPS coordinate corresponds to a public place (e.g., bank), the control unit 420 may determine that the electronic device 401 is in a public place. In various embodiments of the present disclosure, the control unit 420 may determine whether the electronic device 401 is a public device based on whether the electronic device is located in a public place during a period longer than a reference time. For example, when the electronic device 401 is located in a public place (e.g., bank) during a period longer than a reference time (e.g., a week), the control unit 420 may determine that the electronic device 401 is a public device.
- a public place e.g., bank
- a reference time e.g., a week
- control unit 420 may determine that the electronic device 401 is a public device by proceeding to operation 1005.
- control unit 420 may determine that the electronic device 401 is a personal device by proceeding to operation 1007.
- control unit 420 may determine that the state where the fingerprint of the user is capable of being stolen. Thereafter, the control unit 420 may perform a process for removing the fingerprint mark by proceeding to operation 705 of FIG. 7 .
- FIG. 11 illustrates an operation for determining whether a fingerprint is capable of being stolen from an electronic device according to an embodiment of the present disclosure.
- the control unit 420 of FIG. 4 may identify information regarding an access point (AP) that the electronic device accesses.
- the fingerprint mark removing unit 422 may determine whether the electronic device 401 is a public device based on information regarding the AP or a base station that the electronic device accesses.
- the control unit 420 may acquire the information regarding the AP based on a signal associated with advertisement received from the AP before accessing the AP, or a signal received after accessing the AP.
- the electronic device 401 may be connected to a mobile communication network (e.g., LTE network) and in this case, the electronic device 401 may identify information regarding the base station (e.g., eNodeB) that the electronic device 401 accesses.
- a mobile communication network e.g., LTE network
- the electronic device 401 may identify information regarding the base station (e.g., eNodeB) that the electronic device 401 accesses.
- control unit 420 may identify whether the AP that the electronic device 401 accesses is a public AP by proceeding to operation 1103. For example, if the AP, that the electronic device 401 accesses, is configured as a public AP or if the number of electronic devices that access the AP is greater than reference number (e.g., 10), the control unit 420 may determine that the AP is a public AP.
- reference number e.g. 10
- the control unit 420 may determine that the electronic device 401 is a public device by proceeding to operation 1105. In various embodiments of the present disclosure, the control unit 420 may determine whether the electronic device 401 is a public device based on whether the electronic device accesses a public AP during a period longer than a reference time. For example, when the electronic device 401 accesses a public AP during a period longer than a reference time (e.g., two hours), the control unit 420 may determine that the electronic device 401 is a public device.
- a reference time e.g., two hours
- control unit 420 may determine that the electronic device 401 is a personal device by proceeding to operation 1107.
- control unit 420 may determine that the state of the electronic device 401 is a state where the fingerprint of the user is capable of being stolen. Thereafter, the control unit 420 may perform a process for removing the fingerprint mark by proceeding to operation 705.
- FIG. 12 illustrates an operation for determining whether a fingerprint is capable of being stolen from an electronic device according to an embodiment of the present disclosure.
- the control unit 420 of FIG. 4 may identify an adjacent device of the electronic device 401.
- the control unit 420 may identify an electronic device located within a designated range from the location of the electronic device 401.
- the control unit 420 may determine whether the electronic device 401 is located in a public place based on the number of the identified adjacent devices.
- control unit 420 may identify one or more device around the electronic device as the adjacent device by using a discovery signal, which is received at the electronic device 401, for BT communication.
- the control unit 420 determines whether the number of the adjacent devices is greater than a reference value. For example, the control unit 420 may determine whether the number of the adjacent devices which are identified is greater than a reference number (e.g., 20). If the number of the adjacent devices is greater than the reference value, the control unit 420 may determine that the electronic device 401 is a public device by proceeding to operation 1205.
- a reference number e.g. 20
- control unit 420 may determine that the electronic device 401 is a personal device by proceeding to operation 1207.
- the control unit 420 may determine whether the electronic device 401 is a public device based on the type of the adjacent device. For example, if the control unit 420 determines that the adjacent device is not a device that has previously communicated with the electronic device 401 or that the adjacent is a public device, the control unit 420 may determine that the electronic device 401 is a public device. If the adjacent device is frequently changed, the control unit 420 may determine that the electronic device 401 is a public device.
- the control unit 420 may determine that the state of the electronic device 401 is a state where the fingerprint of the user is capable of being stolen. Thereafter, the control unit 420 may perform a process for removing the fingerprint mark by proceeding to operation 705 of FIG. 7 .
- FIG. 13 illustrates an operation for determining whether a fingerprint mark exists in an electronic device according to an embodiment of the present disclosure.
- the operations to be described by FIGS. 13 to 15 may be operations after determining that the state of the electronic device 401 is a state where the fingerprint of the user is capable of being stolen.
- the operations in FIG. 13 to 15 may be operations after determining that the electronic device 401 is a public device.
- the operations in FIGS. 13 to 15 may be performed regardless of whether or not the electronic device 401 is a public device.
- the fingerprint recognition processing unit 421 of the control unit 420 may determine whether fingerprint matching score is greater than a first reference value in order to identify whether a fingerprint mark is present on the electronic device 401.
- the fingerprint matching score is a value for indicating how much the shape of the fingerprint mark on the electronic device 401 is like (or resemble) the shape of the fingerprint of the user.
- the shape of the fingerprint mark on the electronic device 401 can be detected through the fingerprint sensor 601.
- the fingerprint recognition processing unit 421 may generate the fingerprint matching score by comparing the shape of the fingerprint mark detected by the fingerprint sensor 601 and the fingerprint information acquired for user authentication.
- the fingerprint recognition processing unit 421 may generate the fingerprint matching score by comparing the shape of the fingerprint mark detected by the fingerprint sensor 601 and the fingerprint information stored in the storage unit 440 of FIG. 4 .
- the fingerprint recognition processing unit 421 compares the generated fingerprint matching score with the first reference value for determining whether the fingerprint mark exists.
- the first reference value may be a value for determining whether the fingerprint mark is present on the electronic device 401.
- the first reference value may be a preset value stored in the storage unit 440.
- the fingerprint mark removing unit 422 may, by proceeding to operation 1303, determine whether the number of touch inputs on the electronic device 401 is greater than a second reference value in order to determine whether the fingerprint mark exists on the electronic device. In operation 1301, even if the presence of the fingerprint mark on the electronic device 401 is not identified, there is a risk that the fingerprint mark remains, so that operation 1303 may be required as additional procedure. If the number of user's touch inputs on the electronic device 401 for operating the electronic device 401 is greater than a designated number, it may be practically impossible to steal the fingerprint mark because of smudging or blurring.
- the fingerprint sensor 601 included in the input unit 430 of FIG. 4 may be utilized. Alternatively, for identifying the number of touch inputs, at least another sensor for detecting the touch input on the electronic device 401 may be utilized.
- operation 1303 in FIG. 13 shows an example in which the number of touch inputs is compared with the second reference value
- the fingerprint mark removing unit 422 may compare a value indicating an intensity of the touch input with a third reference value.
- the intensity of the touch input may be detected by a pressure sensor.
- the comparing the number of touch inputs with the second reference value and the comparing the intensity of the touch input with the third reference value may be performed simultaneously or sequentially in order to determining whether the fingerprint mark exists on the electronic device.
- the fingerprint mark removing unit 422 may determine that the fingerprint mark is not nearly left on the electronic device 401. Then, the fingerprint mark removing unit 422 may determine that the fingerprint mark does not exist on the electronic device by proceeding to operation 1305.
- the fingerprint mark removing unit 422 may determine that the fingerprint mark is left on the electronic device 401, and display an interface for removing the fingerprint mark by proceeding to operation 1307. Also, in operation 1303, if the fingerprint mark removing unit 422 determines that the fingerprint mark exists on the electronic device (e.g., that the number of touch inputs is less than or equal to the second reference value), the fingerprint mark removing unit 422 may display a user interface for removing the fingerprint mark by proceeding to operation 1307.
- operations 1301 and 1303 are depicted as being performed sequentially to determine whether the fingerprint mark is left on the electronic device 401 in FIG. 13 , the order of operations 1301 and 1303 may be changed or the operations 1301 and 1303 may be performed independently or concurrently according to an embodiment of the present disclosure.
- FIG. 14 illustrates an operation for determining whether a fingerprint mark exists in an electronic device according to an embodiment of the present disclosure.
- the operation to be described by FIG. 14 may be an operation of the electronic device utilizing a touch sensor for determining whether the fingerprint mark exists.
- the fingerprint mark removing unit 422 of the control unit 420 may determine whether to display the user interface for removing the fingerprint mark based on a touch input through the touch sensor.
- the fingerprint mark removing unit 422 may detect the movement of the touch input. For example, the fingerprint mark removing unit 422 may trace, in an operation process of the electronic device 401 such as fingerprint registration or recognition, the occurrence of a touch input (e.g., a touch by a finger) on the electronic device 401 and the movement of the touch input.
- a touch input e.g., a touch by a finger
- the fingerprint mark removing unit 422 may determine whether the touch input is released. For example, the fingerprint mark removing unit 422 may determine that the touch input is released when the touch input through the touch sensor is no longer detected.
- the fingerprint mark removing unit 422 may determine whether the moving distance of the touch input is greater than a reference distance by proceeding to operation 1405.
- the moving distance of the touch input may be determined based on information on the movement of the touch input acquired through the touch sensor.
- the reference distance is used as a criterion for removing the fingerprint mark.
- the reference distance may be predetermined and stored in the storage unit 440 of FIG. 4 .
- the fingerprint mark removing unit 422 may compare the moving distance of the touch input with the reference distance to determine whether the fingerprint mark is removed by the movement of the touch input. In another embodiment, the fingerprint mark removing unit 422 may compare the speed of the touch input with a reference speed to determine whether the fingerprint mark is removed by the movement of the touch input.
- the fingerprint mark removing unit 422 may determine whether to display the user interface for removing the fingerprint mark based on a result of the comparison of the moving distance of the touch input with the reference distance or the comparison of the speed of the touch input with the reference speed. In other words, in operation 1405, when the moving distance of the touch input (or the speed of the touch input) is greater than the reference distance (or the reference speed), the fingerprint mark removing unit 422 may detect the touch input on the electronic device, without displaying the interface for removing the fingerprint mark, by proceeding to operation 1401.
- FIG. 1405 when the moving distance of the touch input (or the speed of the touch input) is greater than the reference distance (or the reference speed), the fingerprint mark removing unit 422 may detect the touch input on the electronic device, without displaying the interface for removing the fingerprint mark, by proceeding to operation 1401.
- the fingerprint mark removing unit 422 may determine that no additional operation is required and may terminate the operation of FIG. 14 .
- the fingerprint mark removing unit 422 may displays the user interface for removing the fingerprint mark through the display unit 410 of FIG. 4 by proceeding to operation 1407.
- the fingerprint mark removing unit 422 may determine a position to display the user interface for removing the fingerprint mark based on the touch input received through the touch sensor. For example, when registering or recognizing a fingerprint, the fingerprint mark removing unit 422 may determine a position at which the touch input occurs by using the touch sensor, and determine the position as a position to display the user interface for removing the fingerprint mark.
- the fingerprint mark removing unit 422 determines display characteristics of the user interface for removing the fingerprint mark based on the touch input received through the touch sensor. When registering or recognizing a fingerprint, the fingerprint mark removing unit 422 determines the width or height of the touch input and displays the user interface for removing the fingerprint mark in size corresponding to the width or height of the touch input.
- the fingerprint mark removing unit 422 may determine whether an appropriate (or suitable) touch input on the user interface is detected. For example, the fingerprint mark removing unit 422 may determine whether a touch input through the touch sensor is an appropriate touch input on the user interface for removing the fingerprint mark. The fingerprint mark removing unit 422 may determine whether to display the user interface again, based on whether the touch input is detected at appropriate location for removing the fingerprint mark.
- the fingerprint mark removing unit 422 may control the display unit 410 to display the user interface for removing the fingerprint mark by returning to operation 1407.
- the fingerprint mark removing unit 422 may determine that no fingerprint mark remains on the electronic device 401 by proceeding to operation 1411.
- the fingerprint mark removing unit 422 may determine an offset value based on a difference between the position at which the user interface is displayed and the position at which the touch input is actually received. Based on the offset value, the fingerprint mark removing unit 422 may correct the position to display the user interface and may control the display unit 410 to display the user interface at the corrected position.
- FIG. 15 illustrates an operation for determining whether a fingerprint mark exists in an electronic device according to an embodiment of the present disclosure.
- the operation to be described by FIG. 15 may be an operation of the electronic device utilizing a pressure sensor for determining whether the fingerprint mark exists.
- the fingerprint mark removing unit 422 of the control unit 420 may determine whether to display the user interface for removing the fingerprint mark based on information on the pressure of the touch input detected by the pressure sensor.
- the pressure sensor may detect a pressure of the touch input.
- the pressure sensor may generate a signal indicating a value corresponding to the pressure of the touch input, and provide the generated signal to the control unit 420.
- the fingerprint mark removing unit 422 may determine whether the value corresponding to the pressure of the touch input is within a reference range.
- the fingerprint mark removing unit 422 may identify the value corresponding to the pressure of the touch input based on a signal provided from the touch sensor.
- the reference range may be predetermined and stored in the storage unit 440 to be used for determining whether the fingerprint mark is present on the electronic device 401. For example, if the pressure is too weak or too high, the fingerprint mark is not maintained in a distinct form. Therefore, if the intensity of the pressure is smaller than the minimum value of the reference range or larger than the maximum value of the reference range, the fingerprint mark removing unit 422 may determine not to display the user interface for removing the fingerprint mark.
- the fingerprint mark removing unit 422 may display the interface for removing the fingerprint mark by proceeding to operation 1505.
- the fingerprint mark removing unit 422 may determine that that no fingerprint mark remains on the electronic device 401 by proceeding to operation 1507.
- FIG. 16 illustrates an example of an operation for removing a fingerprint mark generated from authentication means other than fingerprint recognition in the electronic device according to an embodiment of the present disclosure.
- FIG. 16 illustrates an example of fingerprint recognition for releasing the lock mode of the electronic device 401
- the operations shown in FIG. 16 can be performed in the case performing not only fingerprint recognition for releasing the lock mode but also user authentication (e.g., when running a financial service application).
- the fingerprint recognition processing unit 421 may determine whether the fingerprint mark is left on the electronic device 401. For example, before performing the authentication for switching (or changing) the operation mode of the electronic device 401 from the lock mode to the unlock mode by using the fingerprint sensor 601, the fingerprint recognition processing unit 421 determines whether the fingerprint mark is left on the electronic device 401.
- the lock mode refers to an operation mode in which only some of the functions of the electronic device 401 are available.
- the lock mode may be released by a preconfigured authentication means.
- control unit 420 may, by proceeding to operation 1605, control the display unit 410 to display the user interface for removing the fingerprint mark before the fingerprint recognition is performed. Operations for removing the fingerprint can be performed as the examples in FIGS. 13 to 15 .
- the fingerprint recognition processing unit 421 proceeds to operation 1603 and tries fingerprint recognition.
- the fingerprint recognition processing unit 421 may control the display unit 410 to display an interface for releasing the lock mode of the electronic device 401.
- the fingerprint recognition processing unit 421 may determine whether the fingerprint recognition is successful, by proceeding to operation 1607. For example, when a fingerprint detected from the touch input corresponds to the fingerprint information stored in the storage unit 440 in operation 1603, the fingerprint recognition processing unit 421 may determine that the fingerprint recognition is successful.
- the fingerprint recognition processing unit 421 may detect additional touch input. This means that a touch input in general operation of the electronic device 401 in the unlock mode may be detected and that the procedure for removing fingerprint mark shown in FIG. 7 can be additionally performed.
- the control unit 420 may perform a second authentication by proceeding to operation 1609.
- the second authentication refers to the secondary authentication means for the case where the fingerprint recognition as the first authentication means has failed.
- the second authentication means may include one or more of a password, iris recognition, pattern lock, voice, e-mail, or query response, other than the fingerprint recognition.
- the information on the second authentication means may be preconfigured and stored in the storage unit 440 to release the lock mode of the electronic device 401.
- the control unit 420 may determine whether the second authentication means accompanies a touch input by a user, by proceeding to operation 1611. For example, the control unit 420 may determine whether the password or the pattern lock is used as the second authentication means. If so, the control unit 420 may determine a region where the touch input is received and determine to display the user interface for removing the fingerprint mark according to the presence of the fingerprint mark. Thus, the electronic device can prevent a fingerprint stealing in the case that the fingerprint mark has remained on the electronic device 401 even if the user did not intend to input the fingerprint.
- the fingerprint mark removing unit 422 may perform the operation for removing a fingerprint mark generated from a touch input accompanied by the second authentication means, by proceeding to operation 1613. Operations for removing the fingerprint mark may be performed as operations described by FIGS. 13 to 15 .
- control unit 420 may perform an additional operation such as detecting an additional touch input.
- FIG. 21 illustrates a fingerprint mark located on a camera of an electronic device according to various embodiments of the present disclosure.
- FIG. 21 an example of fingerprint mark located on a camera 2101 of the electronic device 401 is illustrated.
- the embodiment of FIG. 21 shows a case of identifying the fingerprint mark 2111 through an image sensor located in the camera 2101.
- the control unit 420 may identify the fingerprint mark which is left on a lens of the camera 2101, based on data received through the image sensor of the camera and control the display unit 410 to display the user interface that guides removing the fingerprint mark.
- the electronic device 401 may further include a supplementary camera 2102 other than the camera 2101. In case of including the supplementary camera 2102, the above embodiments of the present disclosure can be applied.
- the electronic device can prevent not only the fingerprint being stolen but also degraded quality of the image through the camera on which the fingerprint mark is present.
- embodiments described above illustrate a process for preventing the fingerprint mark on the electronic device 401 from being stolen
- embodiments of the present disclosure may be used not only to prevent the fingerprint from being stolen but also to recognize foreign substances adhered to the surface of the electronic device 401.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Computer Security & Cryptography (AREA)
- Multimedia (AREA)
- Computer Hardware Design (AREA)
- Health & Medical Sciences (AREA)
- Software Systems (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Bioethics (AREA)
- Optics & Photonics (AREA)
- Medical Informatics (AREA)
- Databases & Information Systems (AREA)
- Social Psychology (AREA)
- Ophthalmology & Optometry (AREA)
- Computer Vision & Pattern Recognition (AREA)
- User Interface Of Digital Computer (AREA)
- Telephone Function (AREA)
Description
- The present disclosure relates to a method and an electronic device for protecting personal information. More particularly, the present disclosure relates to a method and an electronic device for preventing biometric information from being stolen in the electronic device.
- For allowing an access only to a specific user during operation of the electronic device, personal information of the specific user may be required. The electronic device may perform user authentication by using biometric information among personal information of the specific user when the electronic device is unlocked or when the user authentication is required in a specific application in the electronic device. The method for acquiring biometric information may include iris recognition, fingerprint recognition, face recognition, palm print recognition, vein distribution recognition, and the like. A sensor for fingerprint recognition is widely used because it is possible to implement a fingerprint recognition sensor with high security, with low cost or in a small size.
- For fingerprint recognition, the electronic device may acquire fingerprint information through a sensor embedded in the electronic device or through a module outside the electronic device, and prevent fingerprint information leakage by establishing security for the acquired fingerprint information. However, physical fingerprint mark generated during the fingerprint recognition process may remain on the surface or outside of the electronic device. The fingerprint mark may be stolen easily.
- The above information is presented as background information only to assist with an understanding of the present disclosure. No determination has been made, and no assertion is made, as to whether any of the above might be applicable as prior art with regard to the present disclosure.
WO-2015/053573-A1 discloses a fingerprint recognition hacking prevention apparatus and a fingerprint hacking prevention surface member for a mobile terminal, and a fingerprint hacking prevention method therefor. The purpose of the present invention is to provide a fingerprint recognition hacking prevention apparatus and a fingerprint hacking prevention surface member for a mobile terminal and a fingerprint hacking prevention method therefor, for preventing fingerprint recognition hacking and improving convenience by unlocking a screen using a fingerprint authentication function and at the same time not leaving any hackable fingerprint mark on the surface of the mobile terminal while executing a menu shortcut function by a single action. In addition, the purpose of the present invention is to enhance personal privacy security by unlocking a screen using a fingerprint authentication function and at the same time executing a screen menu shortcut function using voice authentication for certain words or sentences.
US-2009/034804-A1 discloses a security method and system using a touch screen that allows manipulation input using only an input tool which is not part of a user's body, i.e., finger manipulation, when a secure function such as secure printing is set instead of a normal function when the touch screen is manipulated, so as to prevent leakage of secure information due to fingerprint marks and smudges caused by finger manipulation. The security method includes checking whether or not a password is input, and inputting to the touch screen a password using an input tool which is not part of a user body.US-2013/169572-A1 discloses a method for protecting a touch-sensitive device includes: switching the touch-sensitive device from a normal mode to a protection mode when a preset operation is exerted; determining whether a touch operation is exerted after the touch-sensitive device enters the protection mode, and further determine whether a duration of the touch-sensitive device in the protection mode exceeds a preset time interval; comparing a touch size of the touch operation with a preset size when the duration of the touch-sensitive device in the protection mode exceeds the preset time interval; and generating an alarm signal when the touch size is less than the preset size. A related touch-sensitive device is also provided.
KR-2011/0103598-A
KR-2006/0003689-A
US-2016/140379-A1 relates to a user authentication method and system, in which the same sensor surface is used for scanning a fingerprint and for entry of a user-specific code. The user specific-code comprises gestures that are guided by a frame - The invention is defined by the independent claims. Further aspects of the invention are outlined in the dependent claims. When the term embodiment is used for describing unclaimed combination of features, the term has to be understood as referring to examples useful for understanding the present invention.
- The above and other aspects, features, and advantages of certain embodiments of the present disclosure will be more apparent from the following description taken in conjunction with the accompanying drawings, in which:
-
FIG. 1 illustrates a block diagram of a network environment according to an embodiment of the present disclosure; -
FIG. 2 illustrates a block diagram of an electronic device according to an embodiment of the present disclosure; -
FIG. 3 illustrates a block diagram of a program module according to an embodiment of the present disclosure;FIG. 4 illustrates a functional block diagram of an electronic device according to an embodiment of the present disclosure; -
FIG. 5A illustrates a capacitive sensor for fingerprint recognition in an electronic device according to an embodiment of the present disclosure; -
FIG. 5B illustrates an optical sensor for fingerprint recognition in an electronic device according to an embodiment of the present disclosure; -
FIG. 5C illustrates an ultrasonic sensor for fingerprint recognition in an electronic device according to an embodiment of the present disclosure; -
FIG. 6A illustrates an arrangement of a fingerprint sensor disposed under a touch panel of an electronic device according to an embodiment of the present disclosure; -
FIG. 6B illustrates an arrangement of a fingerprint sensor disposed under a touch panel of an electronic device according to an embodiment of the present disclosure; -
FIG. 7 illustrates an operation of an electronic device according to an embodiment of the present disclosure; -
FIG. 8 illustrates an operation for determining whether a fingerprint is capable of being stolen from an electronic device according to various embodiments of the present disclosure; -
FIG. 9 illustrates an operation for determining whether a fingerprint is capable of being stolen from an electronic device according to an embodiment of the present disclosure; -
FIG. 10 illustrates an operation for determining whether a fingerprint is capable of being stolen from an electronic device according to various embodiments of the present disclosure; -
FIG. 11 illustrates an operation for determining whether a fingerprint is capable of being stolen from an electronic device according to an embodiment of the present disclosure; -
FIG. 12 illustrates an operation for determining whether a fingerprint is capable of being stolen from an electronic device according to an embodiment of the present disclosure; -
FIG. 13 illustrates an operation for determining whether a fingerprint mark exists in an electronic device according to an embodiment of the present disclosure; -
FIG. 14 illustrates an operation for determining whether a fingerprint mark exists in an electronic device according to an embodiment of the present disclosure; -
FIG. 15 illustrates an operation for determining whether a fingerprint mark exists in an electronic device according to an embodiment of the present disclosure; -
FIG. 16 illustrates an operation for removing a fingerprint mark generated from authentication means other than fingerprint recognition in an electronic device according to an embodiment of the present disclosure; -
FIG. 17 illustrates a user interface for access through fingerprint recognition in an electronic device according to an embodiment of the present disclosure; -
FIG. 18 illustrates a fingerprint mark in a state where the fingerprint mark is capable of being stolen in an electronic device according to various embodiments of the present disclosure; -
FIG. 19 illustrates a user interface that guides to remove a fingerprint mark from an electronic device according to various embodiments of the present disclosure; -
FIG. 20A illustrates a user interface that guides to remove a fingerprint mark from an electronic device according to various embodiments of the present disclosure; -
FIG. 20B illustrates a user interface that guides to remove a fingerprint mark from an electronic device according to various embodiments of the present disclosure; and -
FIG. 21 illustrates a fingerprint mark located on a camera of an electronic device according to various embodiments of the present disclosure. - Throughout the drawings, it should be noted that like reference numbers are used to depict the same or similar elements, features, and structures.
- The following description with reference to the accompanying drawings is provided to assist in a comprehensive understanding of various embodiments of the present disclosure as defined by the claims and their equivalents. It includes various specific details to assist in that understanding but these are to be regarded as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the various embodiments described herein can be made without departing from the scope of the claims. In addition, descriptions of well-known functions and constructions may be omitted for clarity and conciseness.
- The terms and words used in the following description and claims are not limited to the bibliographical meanings, but, are merely used by the inventor to enable a clear and consistent understanding of the present disclosure. Accordingly, it should be apparent to those skilled in the art that the following description of various embodiments of the present disclosure is provided for illustration purpose only and not for the purpose of limiting the present disclosure as defined by the appended claims and their equivalents.
- It is to be understood that the singular forms "a," "an," and "the" include plural referents unless the context clearly dictates otherwise. Thus, for example, reference to "a component surface" includes reference to one or more of such surfaces.
- The expression "configured (or set) to-" used in the present document may be used interchangeably with, for example, "suitable for-", "having the capacity to-", "designed to-", "adapted to-", "made to-", or "capable of-" in a hardware or software manner in accordance to circumstances. In any situation, the expression "device configured to-" may represent that the device is "capable of ~" together with other devices or components. For example, the phrase "processor configured (or set) to perform A, B and C" may represent an exclusive processor (e.g., embedded processor) for performing a corresponding operation, or a generic-purpose processor (e.g., a central processing unit (CPU) or an application processor (AP)) capable of performing corresponding operations by executing one or more software programs stored in a memory device.
- In the present document, a fingerprint refers to a pattern formed on the surface of finger of a human body. It should be noted that although fingerprint is described as an example of user authentication in the present document, patterns are not excluded as an example of means for performing user authentication.
- An electronic device according to various embodiments of the present document may, for example, include at least one of a smartphone, a tablet personal computer (PC), a mobile phone, a video phone, an electronic book reader, a desktop PC, a laptop PC, a netbook computer, a workstation, a server, a portable digital assistant (PDA), a portable multimedia player (PMP), a Motion Picture Experts Group (MPEG-1 or MPEG-2) Audio Layer-3 (MP3) player, a medical device, a camera or a wearable device. The wearable device may include at least one of an accessory type (e.g., a watch, a ring, a wristlet, an anklet, a necklace, glasses, a contact lens or a head-mounted-device (HMD)), a fabric or clothing integrated type (e.g., electronic clothes), a human-body mount type (e.g., a skin pad or tattoo) or a bio implantation type (e.g., an implantable circuit). According to certain embodiment, the electronic device may, for example, include at least one of a television (TV), a digital versatile disc (DVD) player, an audio system, a refrigerator, an air conditioner, a cleaner, an oven, a microwave, a washing machine, an air cleaner, a set-top box, a home automation control panel, a security control panel, a media box (for example, Samsung HomeSync ™, Apple TV™ or Google TV™), a game console (e.g., Xbox™ or PlayStation™), an electronic dictionary, an electronic locking system, a camcorder or an electronic frame.
- In another embodiment, the electronic device may include at least one of various medical devices (e.g., various portable medical measurement devices (e.g., a blood glucose sensor, a heat rate sensor, a blood pressure monitor, a body temperature meter, etc.), magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), computed tomography (CT), a imaging equipment, an ultrasonic instrument, etc.)), a navigation device, a global navigation satellite system (GNSS), an event data recorder (EDR), a flight data recorder (FDR), a car infotainment device, an electronic equipment for ship (e.g., a vessel navigation device, a gyro compass, etc.), avionics, a security device, a car head unit, an industrial or domestic robot, a drone, an automatic teller's machine (ATM) of a financial institution, point of sales (POS) of shops, an Internet of things (IoT) device (e.g., an electric bulb, various sensors, a sprinkler device, a fire alarm, a thermostat, a streetlight, a toaster, an exerciser, a hot water tank, a heater, a boiler, etc.) or a public device (e.g., kiosk) located in public place. According to certain embodiment, the electronic device may include at least one of a part of furniture, a building/structure or a car, an electronic board, an electronic signature receiving device, a projector or various metering devices (e.g., tap water, electricity, gas, radio wave metering devices or the like). In various embodiments, the electronic device may be flexible, or be a combination of two or more of the aforementioned various devices. The electronic device according to an embodiment of the present document is not limited to the aforementioned devices. In the present document, the term 'user' may denote a person who uses the electronic device or a device (e.g., an artificial-intelligent electronic device) which uses the electronic device.
-
FIG. 1 illustrates a block diagram of a network environment according to an embodiment of the present disclosure. - Referring to
FIG. 1 , anelectronic device 101 within anetwork environment 100 in various embodiments is described. Theelectronic device 101 may include abus 110, aprocessor 120, amemory 130, an input/output interface 150, adisplay 160, and acommunication interface 170. In some embodiment, theelectronic device 101 may omit at least one of the constituent elements or additionally have another constituent element. Thebus 110 may, for example, include a circuit coupling theconstituent elements processor 120 may include one or more of a CPU, an AP or a communication processor (CP). Theprocessor 120 may, for example, execute operation or data processing for control and/or communication of at least one another constituent element of theelectronic device 101. Also, theprocessor 120 may recognize (or identify) the fingerprint through the input/output interface 150 or thecommunication interface 170 and may control operation for detecting a fingerprint mark. - The
memory 130 may include a volatile and/or non-volatile memory. Thememory 130 may, for example, store a command or data related to at least one another constituent element of theelectronic device 101. According to an embodiment, thememory 130 may store a software and/orprogram 140. Theprogram 140 may, for example, include akernel 141, amiddleware 143, an application programming interface (API) 145, an application program (or "application") 147, and the like. At least some of thekernel 141, themiddleware 143 or theAPI 145 may be called an operating system (OS). Thekernel 141 may, for example, control or manage system resources (e.g.,bus 110,processor 120,memory 130, and the like) that are used for executing operations or functions implemented in other programs (e.g.,middleware 143,API 145 or application program 147). Also, thekernel 141 may provide an interface through which themiddleware 143, theAPI 145 or theapplication program 147 may control or manage the system resources of theelectronic device 101 by accessing the individual constituent element of theelectronic device 101. - The
middleware 143 may, for example, perform a relay role of enabling theAPI 145 or theapplication program 147 to communicate and exchange data with thekernel 141. Also, themiddleware 143 may process one or more work requests that are received from theapplication program 147, in accordance with priority. For example, themiddleware 143 may grant priority capable of using the system resources (e.g., thebus 110, theprocessor 120, thememory 130 or the like) of theelectronic device 101 to at least one of theapplication programs 147, and process one or more work requests. TheAPI 145 is, for example, an interface enabling theapplication program 147 to control a function provided by thekernel 141 or themiddleware 143 and may, for example, include at least one interface or function (e.g., an instruction) for file control, window control, image processing, character control or the like The input/output interface 150 may forward a command or data inputted from a user or another external device, to another constituent element(s) of theelectronic device 101, or output a command or data received from the another constituent element(s) of theelectronic device 101, to the user or another external device. - The
display 160 may, for example, include a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, a microelectromechanical systems (MEMS) display or an electronic paper display. Thedisplay 160 may, for example, display various contents (e.g., a text, an image, a video, an icon, a symbol and/or the like) to a user. Thedisplay 160 may include a touch screen. And, for example, thedisplay 160 may receive a touch, gesture, proximity or hovering input that uses an electronic pen or a part of the user's body. Also, thedisplay 160 may include a fingerprint sensor capable of detecting a user's fingerprint through a touch screen. Thecommunication interface 170 may, for example, establish communication between theelectronic device 101 and an external device (e.g., the first externalelectronic device 102, the second externalelectronic device 104, or the server 106). For example, thecommunication interface 170 may be coupled to anetwork 162 through wireless communication or wired communication, to communicate with the external device (e.g., the second externalelectronic device 104 or the server 106). Also, thecommunication interface 170 may transmit and receive a signal including fingerprint information through wireless communication or wired communication with another external device and may acquire position information of theelectronic device 101. Thecommunication interface 170 may communicate with the external device (e.g., the first external electronic device 102) using a short-range communication link 164. - The wireless communication may, for example, include a cellular communication that uses at least one of long term evolution (LTE), LTE-advanced (LTE-A), code division multiple access (CDMA), wideband CDMA (WCDMA), universal mobile telecommunications system (UMTS), wireless broadband (WiBro), global system for mobile communications (GSM) and the like. According to an embodiment, the wireless communication may, for example, include at least one of wireless fidelity (WiFi), Bluetooth (BT), Bluetooth low energy (BLE), Zigbee, near field communication (NFC), magnetic secure transmission (MST), radio frequency (RF) or body area network (BAN). According to an embodiment, the wireless communication may include GNSS. The GNSS may, for example, be a global positioning system (GPS), a global navigation satellite system (Glonass), Beidou navigation satellite system (hereinafter, "Beidou")) or Galileo, the European global satellite-based navigation system. Hereinafter, the "GPS" may be used interchangeably with the "GNSS". The wired communication may, for example, include at least one of a universal serial bus (USB), a high definition multimedia interface (HDMI), a recommended standard-232 (RS-232), power line communication (PLC), a plain old telephone service (POTS), and the like. The
network 162 may include at least one of a telecommunications network, for example, a computer network (e.g., local area network (LAN) or wide area network (WAN)), the Internet or a telephone network. - Each of the first and second external
electronic devices electronic device 101. According to various embodiments, all or some of operations executed in theelectronic device 101 may be executed in another one electronic device or a plurality of electronic devices (e.g., the first and second externalelectronic devices electronic device 101 performs some function or service automatically or in response to a request, theelectronic device 101 may, instead of or additionally to executing the function or service in itself, send a request for execution of at least a partial function associated with this to another device (e.g., the first and second externalelectronic device electronic device electronic device 101. Theelectronic device 101 may process the received result as it is or additionally, to provide the requested function or service. For this, a cloud computing, distributed computing or client-server computing technology may be used, for example. -
FIG. 2 illustrates a block diagram of an electronic device according to an embodiment of the present disclosure. - Referring to
FIG. 2 , anelectronic device 201 may, for example, include the entire or part of theelectronic device 101 illustrated inFIG. 1 . Theelectronic device 201 may include one or more processors (e.g., APs) 210, acommunication module 220, a subscriber identification module (SIM) 224, amemory 230, asensor module 240, aninput device 250, adisplay 260, aninterface 270, anaudio module 280, acamera module 291, apower management module 295, abattery 296, anindicator 297 and amotor 298. - The
processor 210 may, for example, drive an operating system (OS) or an application program to control a majority of hardware or software constituent elements coupled to theprocessor 210, and may perform various data processing and operations. Theprocessor 210 may be, for example, implemented as a system on chip (SoC). According to an embodiment, theprocessor 210 may further include a graphic processing unit (GPU) and/or an image signal processor (ISP). Theprocessor 210 may include at least some (e.g., a cellular module 221) of the constituent elements illustrated inFIG. 2 as well. Theprocessor 210 may load a command or data received from at least one of the other constituent elements (e.g., non-volatile memory), to a volatile memory, to process the loaded command or data, and store the result data in the non-volatile memory. - The
communication module 220 may, for example, have the same or similar construction with thecommunication interface 170. Thecommunication module 220 may, for example, include acellular module 221, aWiFi module 223, aBT module 225, aGNSS module 227, anNFC module 228, and anRF module 229. Thecellular module 221 may, for example, provide voice telephony, video telephony, a text service, an Internet service or the like through a telecommunication network. According to an embodiment, thecellular module 221 may perform the distinction and authentication of theelectronic device 201 within the telecommunication network, by using the SIM (e.g., SIM card) 224. According to an embodiment, thecellular module 221 may perform at least some functions among functions that theprocessor 210 may provide. According to an embodiment, thecellular module 221 may include a CP. According to some embodiment, at least some (e.g., two or more) of thecellular module 221, theWiFi module 223, theBT module 225, theGNSS module 227 or theNFC module 228 may be included within one integrated chip (IC) or IC package. TheRF module 229 may, for example, transmit and receive a communication signal (e.g., RF signal). TheRF module 229 may, for example, include a transceiver, a power amplifier module (PAM), a frequency filter, a low noise amplifier (LNA), an antenna or the like. According to another embodiment, at least one of thecellular module 221, theWiFi module 223, theBT module 225, theGNSS module 227 or theNFC module 228 may transmit and receive an RF signal through a separate RF module. TheSIM 224 may, for example, include a card including a SIM and/or an embedded SIM. And, theSIM 224 may include unique identification information (e.g., integrated circuit card identifier (ICCID)) or subscriber information (e.g., international mobile subscriber identity (IMSI)). - The memory 230 (e.g., memory 130) may, for example, include an
internal memory 232 or anexternal memory 234. Theinternal memory 232 may, for example, include at least one of a volatile memory (e.g., a random access memory (RAM) a dynamic RAM (DRAM), a static RAM (SRAM), a synchronous dynamic RAM (SDRAM) or the like) and a non-volatile memory (e.g., a read only memory (ROM), a one time programmable ROM (OTPROM), a programmable ROM (PROM), an erasable PROM (EPROM), an electrically EPROM (EEPROM), a mask ROM, a flash ROM, a flash memory, a hard drive or a solid state drive (SSD)). Theexternal memory 234 may include a flash drive, for example, a compact flash (CF), a secure digital (SD), a micro-SD, a mini-SD, an extreme Digital (xD), a MultiMediaCard (MMC), a memory stick or the like. Theexternal memory 234 may be operatively or physically coupled with theelectronic device 201 through various interfaces. - The
sensor module 240 may, for example, measure a physical quantity or sense an activation state of theelectronic device 201, to convert measured or sensed information into an electrical signal. Thesensor module 240 may, for example, include at least one of agesture sensor 240A, agyro sensor 240B, abarometer 240C, amagnetic sensor 240D, anacceleration sensor 240E, agrip sensor 240F, aproximity sensor 240G, acolor sensor 240H (e.g., a red, green, blue (RGB) sensor), a medical sensor 240I, a temperature/humidity sensor 240J, anilluminance sensor 240K or an ultra violet (UV)sensor 240M. Additionally or alternatively, thesensor module 240 may, for example, include an E-nose sensor, an electromyography (EMG) sensor, an electroencephalogram (EEG) sensor, an electrocardiogram (ECG) sensor, an infrared (IR) sensor, an iris scan sensor and/or a finger scan sensor. Thesensor module 240 may further include a control circuit for controlling at least one or more sensors belonging therein. In some embodiment, theelectronic device 201 may further include a processor configured to control thesensor module 240 as a part of theprocessor 210 or separately, thereby controlling thesensor module 240 while theprocessor 210 is in a sleep state. - The
input device 250 may, for example, include atouch panel 252, a (digital)pen sensor 254, a key 256 or anultrasonic input device 258. Thetouch panel 252 may, for example, use at least one scheme among a capacitive overlay scheme, a pressure sensitive scheme, an infrared beam scheme or an ultrasonic scheme. Also, thetouch panel 252 may further include a control circuit as well. Thetouch panel 252 may further include a tactile layer, to provide a tactile response to a user. The (digital)pen sensor 254 may, for example, be a part of thetouch panel 252, or include a separate sheet for recognition. The key 256 may, for example, include a physical button, an optical key or a keypad. Theultrasonic input device 258 may sense an ultrasonic wave generated in an input tool, through a microphone (e.g., microphone 288), to confirm data corresponding to the sensed ultrasonic wave. - The display 260 (e.g., the display 160) may include a
panel 262, ahologram device 264, aprojector 266, and/or a control circuit for controlling them. Thepanel 262 may, for example, be implemented to be flexible, transparent, or wearable. Thepanel 262 may be constructed as one or more modules together with thetouch panel 252. Thehologram device 264 may show a three-dimensional image to the air using an interference of light. Theprojector 266 may project light onto a screen, to display an image. The screen may, for example, be located inside or outside theelectronic device 201. Theinterface 270 may, for example, include anHDMI 272, aUSB 274, anoptical interface 276 or a D-subminiature (D-sub) 278. Theinterface 270 may, for example, be included in thecommunication interface 170 illustrated inFIG. 1 . Additionally or alternatively, theinterface 270 may, for example, include a Mobile High-definition Link (MHL) interface, an SD card/MMC interface or an Infrared Data Association (IrDA) standard interface. - The
audio module 280 may, for example, convert a sound and an electrical signal interactively. At least some constituent elements of theaudio module 280 may be, for example, included in the input/output interface 150 illustrated inFIG. 1 . Theaudio module 280 may for example, process sound information that is inputted or outputted through aspeaker 282, areceiver 284, anearphone 286, themicrophone 288 or the like. Thecamera module 291 is, for example, a device able to photograph a still image and a video. According to an embodiment, thecamera module 291 may include one or more image sensors (e.g., front sensor or rear sensor), a lens, an ISP or a flash (e.g., an LED, a xenon lamp or the like). Thepower management module 295 may, for example, manage the electric power of theelectronic device 201. According to an embodiment, thepower management module 295 may include a power management integrated circuit (PMIC), a charger IC or a battery or fuel gauge. The PMIC may, for example, employ a wired and/or wireless charging scheme. The wireless charging scheme may, for example, include a magnetic resonance scheme, a magnetic induction scheme, an electromagnetic wave scheme or the like. And, the wireless charging scheme may further include a supplementary circuit for wireless charging, for example, a coil loop, a resonance circuit, a rectifier or the like. The battery gauge may, for example, measure a level of thebattery 296, a voltage being in charge, an electric current or a temperature. Thebattery 296 may, for example, include a rechargeable battery and/or a solar battery. - The
indicator 297 may display a specific state, for example, a booting state, a message state, a charging state or the like of theelectronic device 201 or a part (e.g., processor 210) of theelectronic device 201. Themotor 298 may convert an electrical signal into a mechanical vibration, and may generate a vibration, a haptic effect or the like. Theelectronic device 201 may, for example, include a mobile TV support device (e.g., GPU) capable of processing media data according to the standards of digital multimedia broadcasting (DMB), digital video broadcasting (DVB), mediaFlo™ or the like. Each of the constituent elements described in the present document may consist of one or more components, and a name of the corresponding constituent element may be varied according to the kind of the electronic device. In various embodiments, the electronic device (e.g., electronic device 201) may omit some constituent elements, or further include additional constituent elements, or combine some of the constituent elements to configure one entity, but identically perform functions of corresponding constituent elements before combination. -
FIG. 3 illustrates a block diagram of a program module according to an embodiment of the present disclosure. - Referring to
FIG. 3 , a program module 310 (e.g., the program 140) may include an OS for controlling resources related to an electronic device (e.g., the electronic device 101) and/or various applications (e.g., the application program 147) driven on the OS. The OS may, for example, include Android™, iOS™, Windows™, Symbian™, Tizen™ or Bada™. Referring toFIG. 3 , theprogram module 310 may include a kernel 320 (e.g., the kernel 141), a middleware 330 (e.g., the middleware 143), an API 360 (e.g., the API 145), and/or an application 370 (e.g., the application program 147). At least a part of theprogram module 310 may be preloaded onto an electronic device, or be downloaded from an external electronic device (e.g., the first and second externalelectronic devices server 106, etc.). - The
kernel 320 may, for example, include asystem resource manager 321 and/or adevice driver 323. Thesystem resource manager 321 may perform control of a system resource, allocation thereof, recovery thereof or the like. According to an embodiment, thesystem resource manager 321 may include a process management unit, a memory management unit or a file system management unit. Thedevice driver 323 may, for example, include a display driver, a camera driver, a BT driver, a shared memory driver, a USB driver, a keypad driver, a WiFi driver, an audio driver or an interprocess communication (IPC) driver. Themiddleware 330 may, for example, provide a function that theapplication 370 commonly needs, or provide various functions to theapplication 370 through theAPI 360 so that theapplication 370 may make use of restricted system resources within an electronic device. According to an embodiment, themiddleware 330 may include at least one of aruntime library 335, anapplication manager 341, awindow manager 342, amultimedia manager 343, aresource manager 344, apower manager 345, adatabase manager 346, apackage manager 347, aconnectivity manager 348, anotification manager 349, alocation manager 350, agraphic manager 351 or asecurity manager 352. - The
runtime library 335 may, for example, include a library module that a compiler uses to add a new function through a programming language while theapplication 370 is executed. Theruntime library 335 may perform input output management, memory management or arithmetic function processing. Theapplication manager 341 may, for example, manage a lifecycle of theapplication 370. Thewindow manager 342 may manage a graphic user interface (GUI) resource used by a screen. Themultimedia manager 343 may detect a format required for playing media files, and perform encoding or decoding of the media file by using a codec suitable to the corresponding format. Theresource manager 344 may manage a source code of theapplication 370 or a space of a memory. Thepower manager 345 may, for example, manage a battery capacity or a power supply, and provide power information required for an operation of an electronic device. According to an embodiment, thepower manager 345 may interwork with a basic input/output system (BIOS). Thedatabase manager 346 may, for example, create, search or change a database that will be used by theapplication 370. Thepackage manager 347 may manage installation or updating of an application that is distributed in a form of a package file. - The
connectivity manager 348 may, for example, manage wireless connectivity. Thenotification manager 349 may, for example, provide events such as an arrival message, an appointment, a proximity notification, etc. to a user. Thelocation manager 350 may, for example, manage location information of an electronic device. Thegraphic manager 351 may, for example, manage a graphic effect that will be provided to a user, or a user interface related with this. Thesecurity manager 352 may, for example, provide system security or user authentication. According to an embodiment, themiddleware 330 may include a telephony manager for managing a voice or video telephony function of an electronic device, or a middleware module capable of forming a combination of functions of the aforementioned constituent elements. According to an embodiment, themiddleware 330 may provide a module that is specialized based on the type of an OS. Themiddleware 330 may dynamically delete some of the existing constituent elements or add new constituent elements. TheAPI 360 is, for example, a set of API programming functions, and may be provided to have another construction in accordance with the OS. For example, Android or iOS may provide one API set by platform, and Tizen may provide two or more API sets by platform. - The
application 370 may, for example, include ahome 371, adialer 372, a short message service (SMS)/multimedia messaging service (MMS) 373, an instant message (IM) 374, abrowser 375, acamera 376, analarm 377, acontact 378, avoice dial 379, an electronic mail (e-mail) 380, acalendar 381, amedia player 382, analbum 383, awatch 384, health care (e.g., measuring a momentum, a blood sugar or the like), or an environment information (e.g., air pressure, humidity or temperature information) provision application. Also, theapplication 370 may include afingerprint recognition application 385 for fingerprint recognition. According to an embodiment, theapplication 370 may include an information exchange application that may support information exchange between an electronic device and an external electronic device. The information exchange application may, for example, include a notification relay application for relaying specific information to the external electronic device, or a device management application for managing the external electronic device. For example, the notification relay application may relay notification information generated by another application of an electronic device to an external electronic device, or receive notification information from the external electronic device to provide the received notification information to a user. The device management application may, for example, install, delete or update a function (e.g., turn-on / turn-off of the external electronic device itself (or some constituent components) or adjustment of a brightness (or resolution) of a display) of the external electronic device that communicates with the electronic device, or an application operating in the external electronic device. According to an embodiment, theapplication 370 may include an application (e.g., a health care application of a mobile medical instrument) designated according to an attribute of the external electronic device. According to an embodiment, theapplication 370 may include an application received from the external electronic device. At least a part of theprogram module 310 may be implemented (e.g., executed) by software, firmware, hardware (e.g., the processor 210) or a combination of at least two or more of them, and may include a module for performing one or more functions, a program, a routine, sets of instructions or a process. - The term "module" used in the present document may include a unit consisting of hardware, software or firmware and, for example, may be used interchangeably with the terms "logic", "logic block", "component", "circuit" or the like. The "module" may be an integrally configured component or the minimum unit performing one or more functions or a part thereof. The "module" may be implemented mechanically or electronically and, for example, may include an application-specific integrated circuit (ASIC) chip, field-programmable gate arrays (FPGAs) or a programmable logic device, which has been known or will be developed in future, performing some operations. At least a part of an apparatus (e.g., modules or functions thereof) or method (e.g., operations) according to various embodiments may, for example, be implemented by an instruction that is stored in a computer-readable storage media in the form of a program module. In case where the instruction is executed by a processor (e.g., the processor 120), the processor may perform a function corresponding to the instruction. The computer-readable recording media may include a hard disk, a floppy disk, a magnetic media (e.g., a magnetic tape), an optical recording media (e.g., a compact disc - read only memory (CD-ROM) or a DVD), a magneto-optical media (e.g., a floptical disk), an internal memory, etc. The instruction may include a code that is made by a compiler or a code that is executable by an interpreter. The module or program module according to various embodiments may include at least one or more of the aforementioned constituent elements, or omit some, or further include another constituent element. Operations carried out by the module, the program module or the another constituent element according to various embodiments may be executed in a sequential, parallel, repeated or heuristic manner, or at least some operations may be executed in different order or be omitted, or another operation may be added.
-
FIG. 4 illustrates a functional block diagram of an electronic device according to various embodiments of the present disclosure. - Referring to
FIG. 4 , theelectronic device 401 according to various embodiments of the present disclosure may include adisplay unit 410, acontrol unit 420, aninput unit 430, and astorage unit 440. - The
display unit 410 may perform a display function based on the control of thecontrol unit 420. More specifically, thedisplay unit 410 may receive information on at least one frame for configuring a screen of thedisplay unit 410 from thecontrol unit 420, and display a screen by controlling a plurality of pixels included in thedisplay unit 410 based on the information. Thedisplay unit 410 may correspond to thedisplay 160 ofFIG. 1 and thedisplay 260 ofFIG. 2 . - The
control unit 420 may control the overall operation of theelectronic device 401. Thecontrol unit 420 may control components (e.g., thedisplay unit 410, theinput unit 430, thestorage unit 440, and the like) for performing functions of theelectronic device 401. For example, thecontrol unit 420 may control the components of the electronic device by using data or instructions stored in thestorage unit 440, and perform functions of the electronic device by controlling the components of the electronic device. Thecontrol unit 420 may include a fingerprintrecognition processing unit 421 for processing fingerprint information. Thecontrol unit 420 may include a fingerprintmark removing unit 422 for determining the presence of a fingerprint mark and determining whether to display an interface for removing the fingerprint mark. Thecontrol unit 420 may correspond to theprocessor 120 ofFIG. 1 and theprocessor 210 ofFIG. 2 . - The
control unit 420 may be configured with a CPU, an AP, a microcontroller and the like. Also, thecontrol unit 420 may be configured with one or more processors. For example, thecontrol unit 420 may include one or more of an AP or a CP. - The
input unit 430 may perform an input function of theelectronic device 401. In other words, theinput unit 430 may receive (or detect) an input from a user of theelectronic device 401, generate a signal corresponding to the input of the user, and transmit the generated signal to thecontrol unit 420 to perform a function according to the intention of the user. Also, theinput unit 430 may include plurality of components for receiving input from the user. For example, for fingerprint recognition function, theinput unit 430 may transmit a signal corresponding to fingerprint information recognized by the input unit to thecontrol unit 420, and thecontrol unit 420 may identify the fingerprint information based on the signal received from theinput unit 430. Theinput unit 430 may correspond to the input/output interface 150 ofFIG. 1 and theinput device 250 ofFIG. 2 . - To acquire the fingerprint information, the
input unit 430 may include a fingerprint sensor. The fingerprint sensor may include various sensors used for fingerprint recognition function. For example, the fingerprint sensor may include a sensor as shown inFIGS. 5A to 5C . Theinput unit 430 may transmit a signal corresponding to fingerprint information recognized by the fingerprint sensor to thecontrol unit 420, and thecontrol unit 420 may identify the fingerprint information based on the signal received from theinput unit 430. The fingerprint sensor may correspond to thesensor module 240 ofFIG. 2 . - The
storage unit 440 may store various programs for operating theelectronic device 401, store downloaded data or generated data while performing the various programs. Also, thestorage unit 440 may store various commands or instructions for operating theelectronic device 401. Thestorage unit 440 may include a storage device embedded in theelectronic device 401 or a storage device attachable to theelectronic device 401. Thestorage unit 440 may correspond to thememory 130 ofFIG. 1 and thememory 230 ofFIG. 2 . - In an embodiment of the present disclosure, at least a portion of the
input unit 430 may disposed in thedisplay unit 410. In other words, thedisplay unit 410 and theinput unit 430 may be integrated as a touch screen. For example, the fingerprint sensor disposed in theinput unit 430 may be located in thedisplay unit 410 as shown inFIG. 6A or6B . - The
display unit 410 may provide an input function as well as an output function through the touch panel of thedisplay unit 410. For example, thedisplay unit 410 may detect (or identify) physical characteristics (capacitance, frequency, etc.) based on the various touch inputs (e.g., tap, double tap, touch, touch move, multi touch, pressure touch, etc.) caused by an input tool (or means) such as a finger, a stylus, or an electronic pen. Thedisplay unit 410 may generate a signal for indicating the detected physical characteristics, and may transmit the generated signal to thecontrol unit 420. -
FIG. 5A illustrates a capacitive sensor for fingerprint recognition in the electronic device according to an embodiment of the present disclosure. - Referring to
FIG. 5A , acapacitive sensor 501 may facilitate fingerprint recognition. Thecapacitive sensor 501 includes a micro-capacitor plate 510. Thecapacitive sensor 501 may detect voltage difference between the voltage of a point, on the micro-capacitor plate 510, corresponding to thecontact point 514 where theridge 511 of the finger surface is located and the voltage of a point, on the micro-capacitor plate 510, corresponding to theair region 513 where thevalley 512 is located on the micro-capacitor plate 510. Thecapacitive sensor 501 may transmit the information on the voltage difference to thecontrol unit 420, and thecontrol unit 420 may identify thefingerprint information 502 from the information received from the fingerprint sensor. - The
capacitive sensor 501 may be positioned in or under a display panel of thedisplay unit 410, and thecontrol unit 420 may perform fingerprint authentication for the user's finger contacted to thedisplay unit 410. In other words, thecontrol unit 420 may acquire thefingerprint information 502 by identifying the positions of theridge 511 and thevalley 512 through thecapacitive sensor 501 from the user's finger contacted to thedisplay unit 410. Thecapacitive sensor 501 may be disposed under the lower surface of the display panel of thedisplay unit 410. - Generally, the detection sensitivity of the
capacitive sensor 501 may largely be changed depending on the distance from the touch input. In other words, when a distance between a position where thecapacitive sensor 501 is disposed and a position to which the user's finger is contacted is more than a specific distance, the detection sensitivity may be lowered and the accuracy of the detected fingerprint may be lower than a specific level. Therefore, in order to perform more precise detection, thecapacitive sensor 501 may be disposed in a region that is relatively closer (e.g., a region having a depth of less than 50 micrometers) to the outer surface of the display panel of thedisplay unit 410 than the other fingerprint sensors (e.g., optical sensor, ultrasonic sensor). However, the arrangement of thecapacitive sensor 501 is merely an example, and thecapacitive sensor 501 may be variously arranged according to the implementation. -
FIG. 5B illustrates an optical sensor for fingerprint recognition in the electronic device according to various embodiments of the present disclosure. - Referring to
FIG. 5B , anoptical sensor 521 may facilitate fingerprint recognition. Theoptical sensor 521 may include aphotodetector 544. Thephotodetector 544 may identify the position of theridge 531 and the position of thevalley 532 in the region where the user's finger is contacted based on information on the light, which is passed through theglass prism 542 and thelens 543, emitted from thelight source 541. - More specifically, the
light source 541 emits the light for detecting the fingerprint, and the light emitted from thelight source 541 enters theglass prism 542 along theoptical path 545. When the light entered into theglass prism 542 reaches theair region 533 where contact is not occurred, the light is regularly reflected with an angle of reflection equal to the incident angle and forms an optical path A. On the other hand, when the light entered into theglass prism 542 reaches thecontact region 534 where contact is occurred, the light is not reflected but absorbed and does not form an optical path B. The light reflected from theair region 533 is refracted through thelens 543 and reaches thephotodetector 544. Thephotodetector 544 may identify the region where the light arrives as the region where thevalley 532 is located and the region where the light does not arrive as the region where theridge 531 is located. The control unit may identify thefingerprint information 522 from the information on the positions of theridge 531 and thevalley 532. - Since the
optical sensor 521 uses light, theoptical sensor 521 may be disposed in a region that is deeper from the outer surface of the display panel of thedisplay unit 410 than thecapacitive sensor 501 shown inFIG. 5A . For example, thephotodetector 544 may be spaced apart from the surface of panel of thedisplay unit 410 by 100 micrometers. - The
photodetector 544 may be configured with a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS). -
FIG. 5C illustrates an ultrasonic sensor for fingerprint recognition in the electronic device according to an embodiment of the present disclosure. - Referring to
FIG. 5C , anultrasonic sensor 551 may facilitate fingerprint recognition at acontact point 564 on the location of aridge 561 and anair region 563 where avalley 562 is located on thedisplay panel 570. Theultrasonic sensor 551 includes at least onetransducer 572. The at least onetransducer 572 may emit anultrasonic signal 571 toward thedisplay panel 570 of theelectronic device 401, and may generate a signal for identifying a touch pattern on thedisplay panel 570 by converting the ultrasonic signal reflected from thedisplay panel 570 into an electric signal. More specifically, anultrasonic signal 571 reflected from the region where theridge 561 is located arrives to thetransducer 572 earlier than an ultrasonic signal reflected from the region where thevalley 562 is located. Thetransducer 572 may generate the electric signal based on the difference between timings at which the ultrasonic signals arrive. Thetransducer 572 may transmit the generated electric signal to thecontrol unit 420 of theelectronic device 401, and thecontrol unit 420 may acquirefingerprint information 552 from the transmitted signal. - Generally, the
ultrasonic sensor 551 may have a larger volume relative to thecapacitive sensor 501 or theoptical sensor 521, or may be located within a wider range relative to thecapacitive sensor 501 or theoptical sensor 521. Therefore, theultrasonic sensor 551 may be disposed in a region that is deeper from the outer surface of the display panel of thedisplay unit 410 than thecapacitive sensor 501 shown inFIG. 5A and theoptical sensor 521 shown inFIG. 5B . -
FIG. 6A illustrates an arrangement of a fingerprint sensor disposed under a touch panel of an electronic device according to an embodiment of the present disclosure. - Referring to
FIG. 6A , afingerprint sensor 601 may correspond to one or more of thecapacitive sensor 501 ofFIG. 5A , theoptical sensor 521 ofFIG. 5B , or theultrasonic sensor 551 ofFIG. 5C . Thefingerprint sensor 601 is located in apartial area 611 of thedisplay panel 602, and the fingerprint recognition of theelectronic device 401 is performed through thepartial area 611. In this case, thedisplay unit 410 of theelectronic device 401 may display a user interface (e.g., GUI) for removing a fingerprint mark (or a fingerprint trace) in thepartial area 611. By positioning thefingerprint sensor 601 in thepartial area 611 instead of the entire area of the display panel, the manufacturing cost can be reduced. Also, according to the embodiment ofFIG. 6A , since the area for identifying the fingerprint mark or the area for displaying the user interface for removing the fingerprint mark is predefined, the processing for preventing fingerprint stealing (or finger abstraction, finger extraction) can be performed more quickly. -
FIG. 6B illustrates an arrangement of a fingerprint sensor disposed under a touch panel of the electronic device according to an embodiment of the present disclosure. - Referring to
FIG. 6B , thefingerprint sensor 601 may correspond to one or more of thecapacitive sensor 501 ofFIG. 5A , theoptical sensor 521 ofFIG. 5B , or theultrasonic sensor 551 ofFIG. 5C . Thefingerprint sensor 601 is located in anentire area 612 of thedisplay panel 602. The fingerprint recognition is performed through theentire area 612. Thecontrol unit 420 of theelectronic device 401 may determine the region where the fingerprint mark is present among the entire area, and thedisplay unit 410 of theelectronic device 401 may display the user interface for removing a fingerprint mark in the determined region. By positioning thefingerprint sensor 601 in theentire area 612 instead of thepartial area 611 of thedisplay panel 602, the user experience (UX), (i.e., usability) can be increased since the fingerprint can be inputted anywhere in thedisplay panel 602. - Although the
fingerprint sensor 601 is disposed in or under thedisplay panel 602 in the embodiments ofFIGS. 6A and6B , thefingerprint sensor 601 may be variously positioned in theelectronic device 401. For example, thefingerprint sensor 601 may be located in the home button of the electronic device or may be located on inner surface of the side part or inner surface of rear part of the electronic device. In another embodiment, thefingerprint sensor 601 may be located in another electronic device connected to the electronic device, and display the user interface for removing a fingerprint mark on the another electronic device in order to prevent fingerprint mark stealing from the another electronic device. - Hereinafter, the operation of the
electronic device 401 for removing fingerprint marks will be described with reference toFIGS. 7 to 16 . Although the following description is based on theelectronic device 401 ofFIG. 4 , it may be performed by theelectronic device 101 ofFIG. 1 or theelectronic device 201 ofFIG. 2 . In other words, the following embodiments may be performed by components of theelectronic device 101 ofFIG. 1 or theelectronic device 201 ofFIG. 2 that substantially correspond to the components of theelectronic device 401 ofFIG. 4 . -
FIG. 7 illustrates an operation of an electronic device according to an embodiment of the present disclosure. - Referring to
FIG. 7 , inoperation 701, the fingerprintrecognition processing unit 421 of theelectronic device 401 may detect a touch input on the electronic device through thefingerprint sensor 601. The touch input may include a touch input for switching the operation mode of theelectronic device 401 from a lock mode to an unlock mode as shown inFIG. 17 . Referring toFIGS. 17 and18 , theelectronic device 401 may display ascreen 1711 indicating that theelectronic device 401 is operating in the lock mode. Fingerprint recognition may be performed based on a touch input received via apartial area 1701 of thedisplay unit 410, and the lock mode can be released according a result the fingerprint recognition. After the lock mode is released, the electronic device may switch to the unlock mode and display themain screen 1712. -
FIG. 17 illustrates a user interface for access through fingerprint recognition in an electronic device according to an embodiment of the present disclosure.FIG. 18 illustrates a fingerprint mark in a state where the fingerprint mark is capable of being stolen in an electronic device according to various embodiments of the present disclosure. - Referring to
FIGS. 17 and18 , an example of a fingerprint mark is illustrated that is caused by a touch input generated during the fingerprint authentication process for unlock. In this example, the touch input in theoperation 701 inFIG. 7 may include a touch input for executing security mode, proceeding payment, or a personal authentication procedure. Also, the touch input in theoperation 701 ofFIG. 7 includes a touch input that is inputted during an operation of theelectronic device 401. For example, the touch input in theoperation 701 includes not only a touch input inputted in the process of executing an application of theelectronic device 401 but also a long press touch associated with the function of theelectronic device 401 or a force touch, which is distinguished according to a pressure in theelectronic device 401. - In the case of fingerprint recognition through the touch on the
display panel 602 as shown inFIGS. 17 and18 , there is a high risk that the fingerprint is stolen. Unlike the examples ofFIGS. 17 and18 , in the case that the fingerprint sensor is located at the home button, the fingerprint sensor located at the home button or around the home button may be generally configured with a capacitive sensor. In this case, a fingerprint mark may be captured using a sticky material having fat or oil as an ingredient at the home button. Next, the capturedfingerprint mark 1801 may be transferred to an electric charge sensitive material (e.g., AgIC4 silver conductive ink). Finally, the shape of the fingerprint can be acquired through the electric charge sensitive material. - However, in the case that the fingerprint mark is present at the
partial area 1701 of thedisplay panel 602, it is possible to capture animage 1803 for the fingerprint mark presented at thepartial area 1701. Next, afingerprint image 1802 ofFIG. 18 can be obtained by performing a simple image processing (e.g., contrast enhancement) on theimage 1803 for the fingerprint mark, without additional physical procedures. In other words, while thefingerprint sensor 601 is located at thedisplay panel 602, the user can conveniently perform the fingerprint recognition, the risk of the fingerprint stealing increases. Particularly, in the case that theelectronic device 401 ofFIG. 4 is a public device that can be used by unspecified number of people, the risk is further increased. - Referring back to
FIG. 7 , in order to prevent the fingerprint from being stolen, inoperation 703 ofFIG. 7 , thecontrol unit 420 may determine whether there is a risk that fingerprints may be stolen. Inoperation 703, thecontrol unit 420 of theelectronic device 401 may determine whether theelectronic device 401 is a public device commonly used by a plurality of users. The public device may refer to a device that is configured to be accessible by an unspecified number of users, unlike a personal device that is configured to allow access only to a specific user or a specific user group. For example, the public device may include at least one of a desktop PC, a laptop PC, a tablet, a medical device, an ATM, or a kiosk located in a public place. Thecontrol unit 420 may determine whether theelectronic device 401 is a public device based on at least one of the type, the user log, or the location of theelectronic device 401. An example of the process for determining whether theelectronic device 401 is a public device may be performed as the operations to be described byFIGS. 8 to 12 . - In
operation 703, thecontrol unit 420 may determine whether the electronic device is in a state in which the fingerprint mark according to a touch input is at risk of being stolen. In an embodiment, when the touch input received through thedisplay unit 410 stays long enough at one point, thecontrol unit 420 may determine that the electronic device is in a state in which there is a risk that the fingerprint mark caused by the touch input can be stolen. For example, thecontrol unit 420 may detect amount of change of touch tower (long/short axis) information or touch coordinate information of the touch input. When the amount of change is less than a specific value, thecontrol unit 420 may determine that the electronic device is in a state in which there is a risk of fingerprint mark being stolen. In another embodiment, thecontrol unit 420 may determine that the electronic device is in a state in which there is a risk of fingerprint mark being stolen when a pressure due to the touch input is detected but a movement of the touch input is not detected. - In some embodiments,
operation 703 ofFIG. 7 may be omitted. In other words, thecontrol unit 420 may perform an operation for removing the fingerprint mark regardless of whether the electronic device is in a state in which there is a risk of fingerprint mark being stolen. - Then, in
operation 705, thecontrol unit 420 may perform processing for removing the fingerprint mark. Inoperation 705, the fingerprintrecognition processing unit 421 of thecontrol unit 420 may determine whether a fingerprint mark is left on theelectronic device 401. The fingerprint mark is a physical trace formed similar to the shape of the user's fingerprint from a material that is on the surface of theelectronic device 401 or on the surface of the user's finger. The fingerprint mark may be identified by thefingerprint sensor 601. The process for removing the fingerprint mark inoperation 705 may be performed as the operations to be described byFIGS. 13 to 15 . - The process for removing the fingerprint mark in
operation 705 may include an operation displaying a user interface that guides removing the fingerprint mark. For example, the user interface that guides removing the fingerprint mark may be a user interface that guides or induces a specific gesture (e.g., a swipe gesture) on the location where the fingerprint mark is present. Also, the user interface may be configured to disappear on condition of receiving a touch input of at least one of a designated intensity or more, a designated distance or more, or a designated number or more. -
FIG. 19 illustrates a user interface that guides to remove a fingerprint mark from an electronic device according to various embodiments of the present disclosure. - Referring to
FIG. 19 , examples are illustrated of user interfaces guiding a specific gesture on the location where the fingerprint mark is present. Auser interface 1901 ofFIG. 19 is an example of an interface that guides a simple cross swipe gesture. Theuser interface 1901 can derive the removal of the fingerprint mark by guiding that the user performs a swipe gesture on the location of theuser interface 1901. Also, theuser interface 1901 may be configured to disappear on condition of receiving a gesture input corresponding to theuser interface 1901. For example, theinterface 1901 may be configured to disappear on condition of that a touch input with designated pressure is repeatedly swiped a designated number of times or more within the area of theuser interface 1901. - The
user interface 1902 ofFIG. 19 shows an example of a user interface, which guides a touch input for animation (or visual effect) in which a plurality of sub-objects (e.g., petals) in an object (e.g., flower) move, blowing the petals off the flower. Theuser interface 1902 may initially display the object (e.g., flower) including the plurality of sub-objects (e.g., petals). Then, theuser interface 1902 may display an animation (e.g., blowing the petals off the flow) in which some of the plurality of sub-objects sequentially move (e.g., fly) while receiving the user's repetitive touch input (e.g., repetitive swipe gesture). In some embodiments, the plurality of sub-objects moved by the touch input may be configured to fade out according to moving out of the area of theuser interface 1902. Also, theuser interface 1902 may be configured to disappear when all of the plurality of sub-objects move out. - The
user interface 1903 ofFIG. 19 shows an example of a user interface that guides a touch input for animation (or visual effect) in which an object (e.g., bird) moves (e.g., fly). Theuser interface 1903 may initially display an object (e.g., bird). Then, when the user's touch input (e.g., swipe gesture) is received on theuser interface 1903, theuser interface 1903 may display the animation in which the object moves (e.g., fly) while receiving the user's touch input. In some embodiments, the object may be moved in a direction corresponding to a direction of the touch input, and may be configured to disappear when the object moves out of the area of theuser interface 1903. - The
user interface 1904 ofFIG. 19 shows an example of a user interface that guides a touch input for animation in which an object (e.g., wheel) changes (e.g., spin). Theuser interface 1904 may initially display an object (e.g., wheel). Then, when the user's touch input (e.g., rotation gesture) is received on theuser interface 1904, theuser interface 1904 may display an animation in which the object changes (e.g., spin) while receiving the user's touch input. In some embodiments, the speed of change of the object (e.g., rotational speed) may correspond to the speed of the touch input. Also, theuser interface 1904 may be configured to disappear when the object is changed more than a designated number of times (e.g., rotate more than 10 times). - The
user interface 1905 ofFIG. 19 shows an example of a user interface (e.g., tick marks) that guides a gesture corresponding to a specific mark (e.g., V mark). Theuser interface 1905 may initially display a specific mark (e.g., V mark). Then, theuser interface 1905 may be configured to disappear when a gesture corresponding to the mark (e.g., V gesture) is inputted. In some embodiments, the mark may be configured to disappear when the gesture corresponding to the mark is received at a designated intensity or more. -
FIG. 20A illustrates a user interface that guides to remove a fingerprint mark from an electronic device according to various embodiments of the present disclosure. - Referring to
FIG. 20A , a user interface that guides removing the fingerprint mark may be combined with another user interface for performing a particular function of theelectronic device 401. In such an example, thecontrol unit 420 may control thedisplay unit 410 to display auser interface 2001 including a slide toggle within the area where the fingerprint mark is present, when a mode (or state) of theelectronic device 401 is switched to a lock mode (state) due to any reason (e.g., log off). The fingerprint mark can be removed by receiving a gesture corresponding to the toggle slide in the user interface. Thecontrol unit 420 may convert the operation mode of theelectronic device 401 from the lock mode to the unlock mode based on determining that the fingerprint mark is removed. -
FIG. 20B illustrates a user interface that guides to remove a fingerprint mark from an electronic device according to various embodiments of the present disclosure. - Referring to
FIG. 20B , the user interface that guides removing the fingerprint mark may include a message notifying the presence of the fingerprint mark or guiding the removal of the fingerprint mark. In this example, thecontrol unit 420 may control thedisplay unit 410 to display auser interface 2051 that includes a message notifying to remove the fingerprint mark to the user. In some embodiments, thecontrol unit 420 may control thedisplay unit 410 to display information indicating the location of the fingerprint mark together with the message. Also, theuser interface 2051 may be configured to inform that a fingerprint mark exists and to disappear upon receiving an input on a specific object (e.g., an OK button). - Although
FIGS. 19 ,20A , and20B illustrate embodiments that utilize a graphical user interface to guide removal of fingerprint mark, various methods (e.g., sound or vibration) may be utilized to guide removing the fingerprint mark according to the implementation. For example, when there is a fingerprint mark, theelectronic device 401 may guide to remove the fingerprint mark by vibrating theelectronic device 401 or by outputting sound indicating that the fingerprint mark exists. - By performing the operations shown in
FIG. 7 , theelectronic device 401 may remove the fingerprint mark due to the touch input of the user. By removing the fingerprint mark, it is possible to prevent the fingerprint from being stolen. -
FIG. 8 illustrates an operation for determining whether a fingerprint is capable of being stolen from an electronic device according to an embodiment of the present disclosure. - Referring to
FIG. 8 , inoperation 801, thecontrol unit 420 ofFIG. 4 may identify whether a type of theelectronic device 401 is configured and the type of the electronic device. The type of theelectronic device 401 includes a type corresponding to a personal device for a specific user or a type corresponding to a public device for unspecified (or common) users. The type of theelectronic device 401 may be preset for the electronic device, and information on the preset type of theelectronic device 401 may be stored in thestorage unit 440 of the electronic device. For example, the information on the type of theelectronic device 401 may be configured, by the administrator, at the time of manufacture or initial setting, and may be stored in thestorage unit 440 with other configuration information. Thecontrol unit 420 may identify the configuration information stored in thestorage unit 440 to determine whether information on the type of the electronic device is stored in thestorage unit 440. If the type of theelectronic device 401 is not identified from the configuration information, thecontrol unit 420 may perform one of the operations shown inFIGS. 9 to 12 . Alternatively, if the type of theelectronic device 401 is not identified from the configuration information, thecontrol unit 420 may determine (or assume) that the electronic device corresponds to a public device. - In
operation 803, thecontrol unit 420 identifies whether the type of theelectronic device 401 corresponds to a public device. If thecontrol unit 420 identifies that theelectronic device 401 is configured as a public device, thecontrol unit 420 may determine that theelectronic device 401 is a public device by proceeding tooperation 805. For example, thecontrol unit 420 may identify configuration information on the type of theelectronic device 401, and when the type of theelectronic device 401 is ATM, the fingerprintmark removing unit 422 may determine that theelectronic device 401 is configured as a public device. If thecontrol unit 420 identifies that theelectronic device 401 is configured as a personal device, thecontrol unit 420 may determine that theelectronic device 401 is configured as a personal device by proceeding tooperation 807. - The
control unit 420 may determine that a fingerprint of the user of theelectronic device 401 is capable of being stolen from the electronic device based on determining that theelectronic device 401 is a public device. Thereafter, thecontrol unit 420 may perform a process for removing the fingerprint mark by proceeding tooperation 705 ofFIG. 7 . -
FIG. 9 illustrates an operation for determining whether a fingerprint is capable of being stolen from an electronic device according to an embodiment of the present disclosure. - Referring to
FIG. 9 , inoperation 901, thecontrol unit 420 ofFIG. 4 may identify an access log to theelectronic device 401. For example, thecontrol unit 420 may identify whether information on user access to theelectronic device 401 exists or whether the information on the user access is valid. The information on the user access may include one or more of information on an identifier (ID) used for accessing theelectronic device 401 or information on access time. Thecontrol unit 420 may identify whether the information on ID used for user access and the information on access time exist, and if so, thecontrol unit 420 may identify whether the information on the user access is valid. Thecontrol unit 420 may determine whether the information on user access is valid based on the information on the access time. For example, if the last access time of the ID that accessed to theelectronic device 401 is before a reference time (e.g., a month before), thecontrol unit 420 may determine that the access to theelectronic device 401 via the ID is not valid. Also, thecontrol unit 420 may determine whether the information on user access is valid based on the number of the user access. For example, if the number of user access is less than the reference number (e.g., less than 5 times), thecontrol unit 420 may determine that the information on user access is not valid. When the information on user access is not valid, thecontrol unit 420 may perform the operation ofFIG. 8 or10 to 12 , or may determine that theelectronic device 401 is a public device. - After identifying the access log of the
electronic device 401, thecontrol unit 420 may identify the number of users accessed to theelectronic device 401, and determine whether the number of users is greater than the reference number of users by proceeding tooperation 903. For example, thecontrol unit 420 may determine the number of IDs that accessed to theelectronic device 401 as the number of users. - When the number of users is greater than the reference number of users (e.g., 10 people), the
control unit 420 may determine that theelectronic device 401 is a public device by proceeding tooperation 905. In another embodiment, when the information on user access comprises repetitive accesses utilizing guest ID, thecontrol unit 420 may determine that theelectronic device 401 is a public device. - When the number of users is less than or equal to the reference number of users, the
control unit 420 may determine that theelectronic device 401 is a personal device by proceeding tooperation 907. - When the
electronic device 401 is determined as the public device, thecontrol unit 420 may determine that the state of theelectronic device 401 is a state where the fingerprint of the user is capable of being stolen. Thereafter, thecontrol unit 420 may perform a process for removing the fingerprint mark by proceeding tooperation 705 ofFIG. 7 . -
FIG. 10 illustrates an operation for determining whether a fingerprint is capable of being stolen from an electronic device according to various embodiments of the present disclosure. - Referring to
FIG. 10 , inoperation 1001, thecontrol unit 420 ofFIG. 4 may identify a GPS coordinate of the electronic device. The GPS coordinate is merely an example of information for indicating the location of the electronic device, and other information for indicating the location of the electronic device may be utilized. Theelectronic device 401 may include a communication unit or at least one transceiver. The transceiver is a component corresponding to thecommunication interface 170 ofFIG. 1 or thecommunication module 220 ofFIG. 2 . Thecontrol unit 420 may identify information on the location of theelectronic device 401 through the communication unit. Thecontrol unit 420 may acquire information on the GPS coordinate of theelectronic device 401 through the communication unit. Thecontrol unit 420 may utilize the information on map information that is acquired from a server (e.g.,server 106 ofFIG. 1 ) connected to the electronic device or that is stored in thestorage unit 440 of the electronic device. - After identifying the GPS coordinate of the
electronic device 401, thecontrol unit 420 may determine whether theelectronic device 401 is located in public place by proceeding tooperation 1003. For example, when a location corresponding to the GPS coordinate corresponds to a public place (e.g., bank), thecontrol unit 420 may determine that theelectronic device 401 is in a public place. In various embodiments of the present disclosure, thecontrol unit 420 may determine whether theelectronic device 401 is a public device based on whether the electronic device is located in a public place during a period longer than a reference time. For example, when theelectronic device 401 is located in a public place (e.g., bank) during a period longer than a reference time (e.g., a week), thecontrol unit 420 may determine that theelectronic device 401 is a public device. - When the
control unit 420 identifies that theelectronic device 401 is located in the public place, thecontrol unit 420 may determine that theelectronic device 401 is a public device by proceeding tooperation 1005. - When the
control unit 420 identifies that the location of the electronic device is indefinite or a residential area, thecontrol unit 420 may determine that theelectronic device 401 is a personal device by proceeding tooperation 1007. - When the
electronic device 401 is determined as the public device, thecontrol unit 420 may determine that the state where the fingerprint of the user is capable of being stolen. Thereafter, thecontrol unit 420 may perform a process for removing the fingerprint mark by proceeding tooperation 705 ofFIG. 7 . -
FIG. 11 illustrates an operation for determining whether a fingerprint is capable of being stolen from an electronic device according to an embodiment of the present disclosure. - Referring to
FIG. 11 , inoperation 1101, thecontrol unit 420 ofFIG. 4 may identify information regarding an access point (AP) that the electronic device accesses. When theelectronic device 401 is connected to the wireless communication network through the communication unit, the fingerprintmark removing unit 422 may determine whether theelectronic device 401 is a public device based on information regarding the AP or a base station that the electronic device accesses. Thecontrol unit 420 may acquire the information regarding the AP based on a signal associated with advertisement received from the AP before accessing the AP, or a signal received after accessing the AP. In another embodiment, theelectronic device 401 may be connected to a mobile communication network (e.g., LTE network) and in this case, theelectronic device 401 may identify information regarding the base station (e.g., eNodeB) that theelectronic device 401 accesses. - Thereafter, the
control unit 420 may identify whether the AP that theelectronic device 401 accesses is a public AP by proceeding tooperation 1103. For example, if the AP, that theelectronic device 401 accesses, is configured as a public AP or if the number of electronic devices that access the AP is greater than reference number (e.g., 10), thecontrol unit 420 may determine that the AP is a public AP. - In
operation 1103, if the AP is identified as a public AP, thecontrol unit 420 may determine that theelectronic device 401 is a public device by proceeding tooperation 1105. In various embodiments of the present disclosure, thecontrol unit 420 may determine whether theelectronic device 401 is a public device based on whether the electronic device accesses a public AP during a period longer than a reference time. For example, when theelectronic device 401 accesses a public AP during a period longer than a reference time (e.g., two hours), thecontrol unit 420 may determine that theelectronic device 401 is a public device. - In
operation 1103, in the case that thecontrol unit 420 cannot identify information regarding the AP or identifies the AP as a personal AP, thecontrol unit 420 may determine that theelectronic device 401 is a personal device by proceeding tooperation 1107. - If the
electronic device 401 is determined as the public device, thecontrol unit 420 may determine that the state of theelectronic device 401 is a state where the fingerprint of the user is capable of being stolen. Thereafter, thecontrol unit 420 may perform a process for removing the fingerprint mark by proceeding tooperation 705. -
FIG. 12 illustrates an operation for determining whether a fingerprint is capable of being stolen from an electronic device according to an embodiment of the present disclosure. - Referring to
FIG. 12 , inoperation 1201, thecontrol unit 420 ofFIG. 4 may identify an adjacent device of theelectronic device 401. In other words, thecontrol unit 420 may identify an electronic device located within a designated range from the location of theelectronic device 401. Thecontrol unit 420 may determine whether theelectronic device 401 is located in a public place based on the number of the identified adjacent devices. - For example, the
control unit 420 may identify one or more device around the electronic device as the adjacent device by using a discovery signal, which is received at theelectronic device 401, for BT communication. - Thereafter, in
operation 1203, thecontrol unit 420 determines whether the number of the adjacent devices is greater than a reference value. For example, thecontrol unit 420 may determine whether the number of the adjacent devices which are identified is greater than a reference number (e.g., 20). If the number of the adjacent devices is greater than the reference value, thecontrol unit 420 may determine that theelectronic device 401 is a public device by proceeding tooperation 1205. - In
operation 1203, if the number of the adjacent devices is less than or equal to the reference value, thecontrol unit 420 may determine that theelectronic device 401 is a personal device by proceeding tooperation 1207. - In various embodiments of the present disclosure, the
control unit 420 may determine whether theelectronic device 401 is a public device based on the type of the adjacent device. For example, if thecontrol unit 420 determines that the adjacent device is not a device that has previously communicated with theelectronic device 401 or that the adjacent is a public device, thecontrol unit 420 may determine that theelectronic device 401 is a public device. If the adjacent device is frequently changed, thecontrol unit 420 may determine that theelectronic device 401 is a public device. - If the
electronic device 401 is determined as the public device, thecontrol unit 420 may determine that the state of theelectronic device 401 is a state where the fingerprint of the user is capable of being stolen. Thereafter, thecontrol unit 420 may perform a process for removing the fingerprint mark by proceeding tooperation 705 ofFIG. 7 . -
FIG. 13 illustrates an operation for determining whether a fingerprint mark exists in an electronic device according to an embodiment of the present disclosure. - The operations to be described by
FIGS. 13 to 15 may be operations after determining that the state of theelectronic device 401 is a state where the fingerprint of the user is capable of being stolen. For example, the operations inFIG. 13 to 15 may be operations after determining that theelectronic device 401 is a public device. However, the operations inFIGS. 13 to 15 may be performed regardless of whether or not theelectronic device 401 is a public device. - Referring to
FIG. 13 , inoperation 1301, the fingerprintrecognition processing unit 421 of thecontrol unit 420 may determine whether fingerprint matching score is greater than a first reference value in order to identify whether a fingerprint mark is present on theelectronic device 401. The fingerprint matching score is a value for indicating how much the shape of the fingerprint mark on theelectronic device 401 is like (or resemble) the shape of the fingerprint of the user. The shape of the fingerprint mark on theelectronic device 401 can be detected through thefingerprint sensor 601. The fingerprintrecognition processing unit 421 may generate the fingerprint matching score by comparing the shape of the fingerprint mark detected by thefingerprint sensor 601 and the fingerprint information acquired for user authentication. Alternatively, the fingerprintrecognition processing unit 421 may generate the fingerprint matching score by comparing the shape of the fingerprint mark detected by thefingerprint sensor 601 and the fingerprint information stored in thestorage unit 440 ofFIG. 4 . The fingerprintrecognition processing unit 421 compares the generated fingerprint matching score with the first reference value for determining whether the fingerprint mark exists. The first reference value may be a value for determining whether the fingerprint mark is present on theelectronic device 401. According to embodiments, the first reference value may be a preset value stored in thestorage unit 440. - When the fingerprint matching score is less than or equal to the first reference value, the fingerprint
mark removing unit 422 may, by proceeding tooperation 1303, determine whether the number of touch inputs on theelectronic device 401 is greater than a second reference value in order to determine whether the fingerprint mark exists on the electronic device. Inoperation 1301, even if the presence of the fingerprint mark on theelectronic device 401 is not identified, there is a risk that the fingerprint mark remains, so thatoperation 1303 may be required as additional procedure. If the number of user's touch inputs on theelectronic device 401 for operating theelectronic device 401 is greater than a designated number, it may be practically impossible to steal the fingerprint mark because of smudging or blurring. For identifying the number of touch inputs, thefingerprint sensor 601 included in theinput unit 430 ofFIG. 4 may be utilized. Alternatively, for identifying the number of touch inputs, at least another sensor for detecting the touch input on theelectronic device 401 may be utilized. - Although
operation 1303 inFIG. 13 shows an example in which the number of touch inputs is compared with the second reference value, it is possible to utilize another metric for determining whether the fingerprint mark exists on the electronic device. For example, the fingerprintmark removing unit 422 may compare a value indicating an intensity of the touch input with a third reference value. The intensity of the touch input may be detected by a pressure sensor. In another embodiment, the comparing the number of touch inputs with the second reference value and the comparing the intensity of the touch input with the third reference value may be performed simultaneously or sequentially in order to determining whether the fingerprint mark exists on the electronic device. - In
operation 1303, when it is determined that the fingerprint mark does not exist on the electronic device (like the case that the number of touch inputs is greater than the second reference value), the fingerprintmark removing unit 422 may determine that the fingerprint mark is not nearly left on theelectronic device 401. Then, the fingerprintmark removing unit 422 may determine that the fingerprint mark does not exist on the electronic device by proceeding tooperation 1305. - In
operation 1301, when the fingerprint matching score is greater than the first reference value, the fingerprintmark removing unit 422 may determine that the fingerprint mark is left on theelectronic device 401, and display an interface for removing the fingerprint mark by proceeding tooperation 1307. Also, inoperation 1303, if the fingerprintmark removing unit 422 determines that the fingerprint mark exists on the electronic device (e.g., that the number of touch inputs is less than or equal to the second reference value), the fingerprintmark removing unit 422 may display a user interface for removing the fingerprint mark by proceeding tooperation 1307. - Although
operations electronic device 401 inFIG. 13 , the order ofoperations operations -
FIG. 14 illustrates an operation for determining whether a fingerprint mark exists in an electronic device according to an embodiment of the present disclosure. - The operation to be described by
FIG. 14 may be an operation of the electronic device utilizing a touch sensor for determining whether the fingerprint mark exists. The fingerprintmark removing unit 422 of thecontrol unit 420 may determine whether to display the user interface for removing the fingerprint mark based on a touch input through the touch sensor. - Referring to
FIG. 14 , inoperation 1401, the fingerprintmark removing unit 422 may detect the movement of the touch input. For example, the fingerprintmark removing unit 422 may trace, in an operation process of theelectronic device 401 such as fingerprint registration or recognition, the occurrence of a touch input (e.g., a touch by a finger) on theelectronic device 401 and the movement of the touch input. - In
operation 1403, the fingerprintmark removing unit 422 may determine whether the touch input is released. For example, the fingerprintmark removing unit 422 may determine that the touch input is released when the touch input through the touch sensor is no longer detected. - In
operation 1403, when the fingerprintmark removing unit 422 determines that the touch input is released, the fingerprintmark removing unit 422 may determine whether the moving distance of the touch input is greater than a reference distance by proceeding tooperation 1405. The moving distance of the touch input may be determined based on information on the movement of the touch input acquired through the touch sensor. The reference distance is used as a criterion for removing the fingerprint mark. The reference distance may be predetermined and stored in thestorage unit 440 ofFIG. 4 . The fingerprintmark removing unit 422 may compare the moving distance of the touch input with the reference distance to determine whether the fingerprint mark is removed by the movement of the touch input. In another embodiment, the fingerprintmark removing unit 422 may compare the speed of the touch input with a reference speed to determine whether the fingerprint mark is removed by the movement of the touch input. - The fingerprint
mark removing unit 422 may determine whether to display the user interface for removing the fingerprint mark based on a result of the comparison of the moving distance of the touch input with the reference distance or the comparison of the speed of the touch input with the reference speed. In other words, inoperation 1405, when the moving distance of the touch input (or the speed of the touch input) is greater than the reference distance (or the reference speed), the fingerprintmark removing unit 422 may detect the touch input on the electronic device, without displaying the interface for removing the fingerprint mark, by proceeding tooperation 1401. AlthoughFIG. 14 illustrates the embodiment that proceeds tooperation 1401 when the moving distance (or the speed) of the touch input is greater than the reference distance (or the reference speed), in another embodiment, the fingerprintmark removing unit 422 may determine that no additional operation is required and may terminate the operation ofFIG. 14 . - In
operation 1405, when the moving distance (or the speed) of the touch input is less than or equal to the reference distance (or the reference speed), the fingerprintmark removing unit 422 may displays the user interface for removing the fingerprint mark through thedisplay unit 410 ofFIG. 4 by proceeding tooperation 1407. - The fingerprint
mark removing unit 422 may determine a position to display the user interface for removing the fingerprint mark based on the touch input received through the touch sensor. For example, when registering or recognizing a fingerprint, the fingerprintmark removing unit 422 may determine a position at which the touch input occurs by using the touch sensor, and determine the position as a position to display the user interface for removing the fingerprint mark. - The fingerprint
mark removing unit 422 determines display characteristics of the user interface for removing the fingerprint mark based on the touch input received through the touch sensor. When registering or recognizing a fingerprint, the fingerprintmark removing unit 422 determines the width or height of the touch input and displays the user interface for removing the fingerprint mark in size corresponding to the width or height of the touch input. - In
operation 1407, when the user interface for removing the fingerprint mark is displayed, the fingerprintmark removing unit 422 may determine whether an appropriate (or suitable) touch input on the user interface is detected. For example, the fingerprintmark removing unit 422 may determine whether a touch input through the touch sensor is an appropriate touch input on the user interface for removing the fingerprint mark. The fingerprintmark removing unit 422 may determine whether to display the user interface again, based on whether the touch input is detected at appropriate location for removing the fingerprint mark. - In
operation 1409, when the appropriate touch corresponding to the interface for removing the fingerprint mark is not detected through the touch sensor, the fingerprintmark removing unit 422 may control thedisplay unit 410 to display the user interface for removing the fingerprint mark by returning tooperation 1407. - In
operation 1409, when the appropriate touch corresponding to the user interface for removing the fingerprint mark is detected through the touch sensor, the fingerprintmark removing unit 422 may determine that no fingerprint mark remains on theelectronic device 401 by proceeding tooperation 1411. - In another embodiment, when the position at which the touch input is received is different from the position at which the user interface is displayed, the fingerprint
mark removing unit 422 may determine an offset value based on a difference between the position at which the user interface is displayed and the position at which the touch input is actually received. Based on the offset value, the fingerprintmark removing unit 422 may correct the position to display the user interface and may control thedisplay unit 410 to display the user interface at the corrected position. -
FIG. 15 illustrates an operation for determining whether a fingerprint mark exists in an electronic device according to an embodiment of the present disclosure. - The operation to be described by
FIG. 15 may be an operation of the electronic device utilizing a pressure sensor for determining whether the fingerprint mark exists. The fingerprintmark removing unit 422 of thecontrol unit 420 may determine whether to display the user interface for removing the fingerprint mark based on information on the pressure of the touch input detected by the pressure sensor. - Referring to
FIG. 15 , inoperation 1501, the pressure sensor may detect a pressure of the touch input. The pressure sensor may generate a signal indicating a value corresponding to the pressure of the touch input, and provide the generated signal to thecontrol unit 420. - In
operation 1503, the fingerprintmark removing unit 422 may determine whether the value corresponding to the pressure of the touch input is within a reference range. The fingerprintmark removing unit 422 may identify the value corresponding to the pressure of the touch input based on a signal provided from the touch sensor. The reference range may be predetermined and stored in thestorage unit 440 to be used for determining whether the fingerprint mark is present on theelectronic device 401. For example, if the pressure is too weak or too high, the fingerprint mark is not maintained in a distinct form. Therefore, if the intensity of the pressure is smaller than the minimum value of the reference range or larger than the maximum value of the reference range, the fingerprintmark removing unit 422 may determine not to display the user interface for removing the fingerprint mark. - In
operation 1503, when the value corresponding to the pressure of the touch input is within the reference range, the fingerprintmark removing unit 422 may display the interface for removing the fingerprint mark by proceeding tooperation 1505. - In
operation 1503, when the value corresponding to the pressure of the touch input is out of the reference range, the fingerprintmark removing unit 422 may determine that that no fingerprint mark remains on theelectronic device 401 by proceeding tooperation 1507. -
FIG. 16 illustrates an example of an operation for removing a fingerprint mark generated from authentication means other than fingerprint recognition in the electronic device according to an embodiment of the present disclosure. - Although
FIG. 16 illustrates an example of fingerprint recognition for releasing the lock mode of theelectronic device 401, the operations shown inFIG. 16 can be performed in the case performing not only fingerprint recognition for releasing the lock mode but also user authentication (e.g., when running a financial service application). - Referring to
FIG. 16 , inoperation 1601, the fingerprintrecognition processing unit 421 may determine whether the fingerprint mark is left on theelectronic device 401. For example, before performing the authentication for switching (or changing) the operation mode of theelectronic device 401 from the lock mode to the unlock mode by using thefingerprint sensor 601, the fingerprintrecognition processing unit 421 determines whether the fingerprint mark is left on theelectronic device 401. The lock mode refers to an operation mode in which only some of the functions of theelectronic device 401 are available. The lock mode may be released by a preconfigured authentication means. By determining whether the fingerprint mark is left on theelectronic device 401 before the fingerprint recognition, it is possible to prevent a collision between the fingerprint for releasing the lock mode and another fingerprint mark that has been left on the electronic device. - In
operation 1601, when the fingerprint mark exists, thecontrol unit 420 may, by proceeding tooperation 1605, control thedisplay unit 410 to display the user interface for removing the fingerprint mark before the fingerprint recognition is performed. Operations for removing the fingerprint can be performed as the examples inFIGS. 13 to 15 . - In
operation 1601, when the fingerprint mark does not exist, the fingerprintrecognition processing unit 421 proceeds tooperation 1603 and tries fingerprint recognition. For example, the fingerprintrecognition processing unit 421 may control thedisplay unit 410 to display an interface for releasing the lock mode of theelectronic device 401. - Then, the fingerprint
recognition processing unit 421 may determine whether the fingerprint recognition is successful, by proceeding tooperation 1607. For example, when a fingerprint detected from the touch input corresponds to the fingerprint information stored in thestorage unit 440 inoperation 1603, the fingerprintrecognition processing unit 421 may determine that the fingerprint recognition is successful. - In
operation 1607, when the fingerprint recognition is successful, the fingerprintrecognition processing unit 421 may detect additional touch input. This means that a touch input in general operation of theelectronic device 401 in the unlock mode may be detected and that the procedure for removing fingerprint mark shown inFIG. 7 can be additionally performed. - In
operation 1607, when the fingerprint recognition fails, thecontrol unit 420 may perform a second authentication by proceeding tooperation 1609. The second authentication refers to the secondary authentication means for the case where the fingerprint recognition as the first authentication means has failed. For example, the second authentication means may include one or more of a password, iris recognition, pattern lock, voice, e-mail, or query response, other than the fingerprint recognition. The information on the second authentication means may be preconfigured and stored in thestorage unit 440 to release the lock mode of theelectronic device 401. - Then, the
control unit 420 may determine whether the second authentication means accompanies a touch input by a user, by proceeding tooperation 1611. For example, thecontrol unit 420 may determine whether the password or the pattern lock is used as the second authentication means. If so, thecontrol unit 420 may determine a region where the touch input is received and determine to display the user interface for removing the fingerprint mark according to the presence of the fingerprint mark. Thus, the electronic device can prevent a fingerprint stealing in the case that the fingerprint mark has remained on theelectronic device 401 even if the user did not intend to input the fingerprint. - In
operation 1611, when the second authentication means accompanies a touch input, the fingerprintmark removing unit 422 may perform the operation for removing a fingerprint mark generated from a touch input accompanied by the second authentication means, by proceeding tooperation 1613. Operations for removing the fingerprint mark may be performed as operations described byFIGS. 13 to 15 . - In
operation 1611, when the second authentication means does not accompany a touch input, thecontrol unit 420 may perform an additional operation such as detecting an additional touch input. -
FIG. 21 illustrates a fingerprint mark located on a camera of an electronic device according to various embodiments of the present disclosure. - Referring to
FIG. 21 , an example of fingerprint mark located on acamera 2101 of theelectronic device 401 is illustrated. The embodiment ofFIG. 21 shows a case of identifying thefingerprint mark 2111 through an image sensor located in thecamera 2101. Thecontrol unit 420 may identify the fingerprint mark which is left on a lens of thecamera 2101, based on data received through the image sensor of the camera and control thedisplay unit 410 to display the user interface that guides removing the fingerprint mark. In some embodiments, theelectronic device 401 may further include asupplementary camera 2102 other than thecamera 2101. In case of including thesupplementary camera 2102, the above embodiments of the present disclosure can be applied. - By removing the fingerprint mark on the
camera 2101, the electronic device can prevent not only the fingerprint being stolen but also degraded quality of the image through the camera on which the fingerprint mark is present. - Although the embodiments described above illustrate a process for preventing the fingerprint mark on the
electronic device 401 from being stolen, embodiments of the present disclosure may be used not only to prevent the fingerprint from being stolen but also to recognize foreign substances adhered to the surface of theelectronic device 401. - While a concrete example embodiment has been explained in the detailed description of the present disclosure, it is undoubted that various modifications are available without departing from the scope of the present disclosure.
- And, example embodiments disclosed in the specification and drawings only suggest specific examples so as to easily explain the content of the present disclosure and help the understanding thereof, and are not to limit the scope of the present disclosure.
Claims (13)
- An electronic device (401) comprising:a display (410);at least one sensor disposed under a region of the display (410); andat least one processor (420) configured to:detect (701), using the at least one sensor, a touch input on the region of the display (410),identify a size of the detected touch input by determining a width or height of the detected touch input, anddisplay (705), using the display (410), a user interface in a size corresponding to the width or height of the touch input, which guides to remove a mark caused by the touch input,wherein the mark includes biometric information in association with the touch input.
- The electronic device (401) of claim 1,wherein the at least one processor (420) is further configured to determine whether the mark is capable of being stolen from the electronic device (401) by determining whether the mark exists on the electronic device (401) based on touch input information,wherein the biometric information includes fingerprint information; andwherein the touch input information includes at least one of movement information of the touch input or pressure information associated with a pressure of the touch input.
- The electronic device (401) of claim 1,wherein the at least one processor (420) is further configured to determine whether the mark is capable of being stolen from the electronic device (401) based on a use of the electronic device (401), andwherein the use of the electronic device (401) comprises a public device or a personal device.
- The electronic device (401) of claim 1, wherein the at least one processor (420) is further configured to:identify a shape of the mark located where the touch input is received,determine that a value indicating degree of matching between the shape of the mark and another biometric information stored in the electronic device (401) is greater than a first reference value, andin response to the determining, display the user interface.
- The electronic device (401) of claim 1, wherein the at least one processor (420) is further configured to:display, through the display (410), a screen corresponding to a lock mode, andin response to determining that the mark is present on a surface of the display (410), display the user interface.
- The electronic device (401) of claim 1,wherein the user interface comprises a user interface for receiving a gesture on area where the mark is present on the display (410), andwherein the area is associated with the region of the display (410).
- The electronic device (401) of claim 6, wherein the user interface comprises at least one of a graphic user interface, GUI, including object changing according to the gesture, a user interface including a slide toggle performing a function according to the gesture, or a message indicating to remove the mark.
- A method of an electronic device (401) comprising:detecting (701), using at least one sensor disposed under a region of a display (410) of the electronic device (401), a touch input on the region of the display (410);identifying a size of the detected touch input by determining a width or height of the detected touch input; anddisplaying (705), using the display (410), a user interface in a size corresponding to the width or height of the touch input which guides to remove a mark caused by the touch input,wherein the mark includes biometric information in association with the touch input.
- The method of claim 8, further comprising:determining whether the mark is capable of being stolen from the electronic device (401) by determining whether the mark exists on the electronic device (401) based on touch input information;wherein the biometric information includes fingerprint information; andwherein the touch input information includes at least one of movement information of the touch input or pressure information associated with a pressure of the touch input.
- The method of claim 8, further comprising:determining whether the mark is capable of being stolen from the electronic device (401) based on a use of the electronic device (401), andwherein the use of the electronic device (401) comprises a public device or a personal device.
- The method of claim 8, wherein the displaying of the user interface comprises:identifying a shape of the mark located where the touch input is received;determining (1301) that a value indicating degree of matching between the shape of the mark and another biometric information stored in the electronic device (401) is greater than a first reference value; andin response to the determining, displaying (705, 1307) the user interface.
- The method of claim 8, further comprising:displaying, through the display (410), a screen corresponding to a lock mode; andin response to determining that the mark is present on a surface of the display (410), displaying the user interface.
- The method of claim 8,wherein the user interface comprises a user interface for receiving a gesture on area where the mark is present on the display (410), andwherein the area is associated with the region of the display (410).
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020160117150A KR102497477B1 (en) | 2016-09-12 | 2016-09-12 | Method for protecting personal information and electronic device thereof |
PCT/KR2017/009802 WO2018048212A1 (en) | 2016-09-12 | 2017-09-07 | Method for protecting personal information and electronic device thereof |
Publications (3)
Publication Number | Publication Date |
---|---|
EP3488372A1 EP3488372A1 (en) | 2019-05-29 |
EP3488372A4 EP3488372A4 (en) | 2019-07-17 |
EP3488372B1 true EP3488372B1 (en) | 2024-02-28 |
Family
ID=61560605
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP17849096.7A Active EP3488372B1 (en) | 2016-09-12 | 2017-09-07 | Method for protecting personal information and electronic device thereof |
Country Status (4)
Country | Link |
---|---|
US (1) | US10705645B2 (en) |
EP (1) | EP3488372B1 (en) |
KR (1) | KR102497477B1 (en) |
WO (1) | WO2018048212A1 (en) |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10325134B2 (en) * | 2015-11-13 | 2019-06-18 | Fingerprint Cards Ab | Method and system for calibration of an optical fingerprint sensing device |
KR101911747B1 (en) * | 2017-03-20 | 2018-10-25 | 주식회사 하이딥 | Touch type distinguishing method and touch input device performing the same |
CN107491681B (en) * | 2017-08-25 | 2020-09-08 | 北京小米移动软件有限公司 | Fingerprint information processing method and device |
CN111768566A (en) * | 2020-05-06 | 2020-10-13 | 安徽科技学院 | Block chain terminal equipment based on cryptography and control method thereof |
KR20210144356A (en) * | 2020-05-22 | 2021-11-30 | 삼성전자주식회사 | Wearagle device and, method for estimating bio-information |
US20220309782A1 (en) * | 2021-03-26 | 2022-09-29 | Sam Houston State University | Using smartphone camera and application to capture, analyze, and evaluate latent fingerprints in real-time |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20060003689A (en) | 2004-07-07 | 2006-01-11 | 엘지전자 주식회사 | Apparatus and method for selecting menu of fingerprint identification communication terminal |
KR100945489B1 (en) * | 2007-08-02 | 2010-03-09 | 삼성전자주식회사 | Method for performing a secure job using a touch screen and an office machine comprising the touch screen |
KR20110103598A (en) | 2010-03-15 | 2011-09-21 | 주식회사 엘지유플러스 | Terminal unlock system and terminal unlock method |
US8695152B2 (en) * | 2010-05-20 | 2014-04-15 | Marc Lemchen | Apparatus for cleaning a touch or display screen |
US8598981B2 (en) * | 2011-02-18 | 2013-12-03 | Tore Etholm Idsøe | Key fob with protected biometric sensor |
CN103186750B (en) | 2011-12-28 | 2017-04-12 | 富泰华工业(深圳)有限公司 | Anti-theft touch portable device and anti-theft method |
NO336008B1 (en) * | 2013-06-26 | 2015-04-20 | Steinar Pedersen | Easy and reliable authentication of fingerprints |
KR101576557B1 (en) * | 2013-10-10 | 2015-12-16 | 남기원 | Apparatus for anti-hacking fingerprint recognition means of cell-phone and surface means and method of the same |
US9531710B2 (en) | 2014-05-09 | 2016-12-27 | Behaviometrics Ab | Behavioral authentication system using a biometric fingerprint sensor and user behavior for authentication |
US9465930B2 (en) | 2014-08-29 | 2016-10-11 | Dropbox, Inc. | Fingerprint gestures |
KR102290892B1 (en) * | 2014-12-12 | 2021-08-19 | 엘지전자 주식회사 | Mobile terminal and method for controlling the same |
US9904799B2 (en) * | 2016-01-21 | 2018-02-27 | Ca, Inc. | Protection of confidential data being displayed or input in a mobile device |
-
2016
- 2016-09-12 KR KR1020160117150A patent/KR102497477B1/en active IP Right Grant
-
2017
- 2017-09-05 US US15/695,530 patent/US10705645B2/en active Active
- 2017-09-07 EP EP17849096.7A patent/EP3488372B1/en active Active
- 2017-09-07 WO PCT/KR2017/009802 patent/WO2018048212A1/en unknown
Also Published As
Publication number | Publication date |
---|---|
WO2018048212A1 (en) | 2018-03-15 |
US20180074643A1 (en) | 2018-03-15 |
US10705645B2 (en) | 2020-07-07 |
EP3488372A1 (en) | 2019-05-29 |
EP3488372A4 (en) | 2019-07-17 |
KR102497477B1 (en) | 2023-03-15 |
KR20180029365A (en) | 2018-03-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR102552312B1 (en) | Electronic device having multiple fingerprint sensing mode and method for controlling the same | |
US10425409B2 (en) | Method and apparatus for connecting between electronic devices using authentication based on biometric information | |
KR102578253B1 (en) | Electronic device and method for acquiring fingerprint information thereof | |
KR102501243B1 (en) | Electronic apparatus and operating method thereof | |
KR102582973B1 (en) | Apparatus for controlling fingerprint sensor and method for controlling the same | |
KR102402146B1 (en) | Method and apparatus for sensing fingerprints | |
KR102564267B1 (en) | Electronic apparatus and operating method thereof | |
KR102396514B1 (en) | Fingerprint information processing method and electronic device supporting the same | |
KR102316278B1 (en) | Electronic device and method for controlling fingerprint information | |
EP3488372B1 (en) | Method for protecting personal information and electronic device thereof | |
KR20180106527A (en) | Electronic device and method for identifying falsification of biometric information | |
US10949019B2 (en) | Electronic device and method for determining touch coordinate thereof | |
US10579870B2 (en) | Operating method for function of iris recognition and electronic device supporting the same | |
EP3584729B1 (en) | Electronic device for performing authentication by using multiple biometric sensors and operation method thereof | |
EP3089020A1 (en) | Electronic device for providing short-cut user interface and method therefor | |
US20190324640A1 (en) | Electronic device for providing user interface according to electronic device usage environment and method therefor | |
EP3101578A1 (en) | Electronic device for performing personal authentication and method thereof | |
KR102626304B1 (en) | Method for content output and electronic device supporting the same | |
US10296756B2 (en) | Apparatus and method for controlling security of electronic device | |
EP3343876B1 (en) | Method for managing contents and electronic device thereof | |
EP3293655B1 (en) | Below the lock user interface with mixed authentication settings | |
US11100206B2 (en) | Electronic device and method for controlling activation of camera module | |
KR20160124536A (en) | Method and electronic apparatus for providing user interface | |
KR20170081500A (en) | Electronic Device and Operating Method Thereof | |
KR102594847B1 (en) | Apparatus and method for providing payment information |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20190221 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
A4 | Supplementary search report drawn up and despatched |
Effective date: 20190617 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G06F 3/0488 20130101ALI20190611BHEP Ipc: G06F 21/62 20130101ALI20190611BHEP Ipc: G06F 21/32 20130101AFI20190611BHEP Ipc: G06F 21/45 20130101ALI20190611BHEP |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20210707 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20230719 |
|
GRAJ | Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted |
Free format text: ORIGINAL CODE: EPIDOSDIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTC | Intention to grant announced (deleted) | ||
INTG | Intention to grant announced |
Effective date: 20231206 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602017079611 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |