WO2022010268A1

WO2022010268A1 - User authentication method and electronic device supporting same

Info

Publication number: WO2022010268A1
Application number: PCT/KR2021/008674
Authority: WO
Inventors: 김태호; 이호상; 장문수; 이다솜
Original assignee: 삼성전자 주식회사
Priority date: 2020-07-10
Filing date: 2021-07-07
Publication date: 2022-01-13
Also published as: KR20220007381A

Abstract

An electronic device according to various embodiments disclosed herein comprises: a memory; a processor; a security module which is electrically connected to the processor; a biometric recognition sensor which can be controlled by means of the security module; and a camera. The processor is configured such that, when an authentication function of a designated application stored in the memory is executed, the processor: checks whether first bio-information has been acquired from the biometric recognition sensor by means of the security module; acquires second bio-information from the camera and checks whether the acquired second bio-information has been authenticated; and performs the authentication function on the basis of whether the first bio-information has been acquired and whether the second bio-information has been authenticated. Various other embodiments as understood from the specification are also possible.

Description

User authentication method and electronic device supporting the same

Various embodiments of the present document relate to a user authentication method and an electronic device supporting the same.

An electronic device such as a smart phone may process a user authentication function. For example, when executing an application related to remittance, the electronic device may recognize a user's iris or face through a camera and process a user authentication function for remittance operation.

The electronic device may process a simple user authentication function by using the user's biometric information (eg, an iris image and a face image), but may have a disadvantage in being vulnerable to external manipulation. For example, when an application related to user authentication is executed by a hacker in the background by a hacker and the user's iris or face is recognized through the camera, the electronic device processes the user authentication function for remittance operation regardless of the user's intention can do.

According to various embodiments disclosed in this document, when a user authentication function is to be processed using the user's biometric information (eg, iris image, face image), the user's intention related to the acquisition of the biometric information can be explicitly confirmed. An object of the present invention is to provide a user authentication method and an electronic device thereof.

An electronic device according to an embodiment disclosed in this document includes a memory, a processor, a security module electrically connected to the processor, a biometric sensor controllable through the security module, and a camera, wherein the processor includes the memory When the authentication function of the designated application stored in the .in is executed, it is checked whether the first biometric information is obtained from the biometric sensor through the security module, and the second biometric information is obtained from the camera, and the obtained second biometric information is obtained. may be configured to check whether or not to authenticate, and to process the authentication function based on whether the first biometric information is acquired and whether the second biometric information is authenticated.

In addition, in the user authentication method according to an embodiment disclosed in this document, when the authentication function of a specified application stored in the memory is executed, whether the first biometric information is obtained from the biometric sensor through the security module electrically connected to the processor Based on the operation of confirming, the operation of obtaining second biometric information from the camera and confirming whether the acquired second biometric information is authenticated, and whether the first biometric information is obtained and whether the second biometric information is authenticated , and processing the authentication function.

According to various embodiments disclosed in this document, when the electronic device intends to process a user authentication function using the user's biometric information, by explicitly confirming the user's intention related to the acquisition of the biometric information, It is possible to prevent a user authentication function requiring acquisition from being processed by an external operation.

In addition to this, various effects that are directly or indirectly identified through this document may be provided.

1 is a diagram illustrating an electronic device in a network environment according to an embodiment.

2 is a diagram illustrating components of an electronic device according to an exemplary embodiment.

3 is a diagram illustrating a mapping table for user authentication of an electronic device according to an exemplary embodiment.

4 is a diagram illustrating a user authentication method according to an embodiment.

5 is a diagram illustrating a user authentication method according to a data transmission/reception relationship between components according to an embodiment.

6 is a diagram illustrating a screen for user authentication according to an embodiment.

In connection with the description of the drawings, the same reference numerals may be assigned to the same or corresponding components.

Hereinafter, various embodiments of the present invention will be described with reference to the accompanying drawings. However, this is not intended to limit the present invention to specific embodiments, and should be understood to include various modifications, equivalents, and/or alternatives to the embodiments of the present invention.

1 is a diagram illustrating an electronic device in a network environment according to various embodiments of the present disclosure;

Referring to FIG. 1 , in a network environment 100 , an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 (eg, a second network 199 ). : It can communicate with the electronic device 104 or the server 108 through a long-distance wireless communication network. According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120 , a memory 130 , an input module 150 , a sound output module 155 , a display module 160 , an audio module 170 , and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or an antenna module 197 may be included. In some embodiments, at least one (eg, the connection terminal 178 ) of the electronic device 101 may be omitted or one or more other components may be added. In some embodiments, some of these components (eg, sensor module 176 , camera module 180 , or antenna module 197 ) are integrated into one component (eg, display module 160 ). can be

The processor 120, for example, executes software (eg, a program 140) to execute at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120 . It can control and perform various data processing or operations. According to an embodiment, as at least part of data processing or operation, the processor 120 stores a command or data received from another component (eg, the sensor module 176 or the communication module 190 ) into the volatile memory 132 . may be stored in the volatile memory 132 , and may process commands or data stored in the volatile memory 132 , and store the result data in the non-volatile memory 134 . According to an embodiment, the processor 120 is the main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit) a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, when the electronic device 101 includes the main processor 121 and the sub-processor 123 , the sub-processor 123 may use less power than the main processor 121 or may be set to be specialized for a specified function. can The auxiliary processor 123 may be implemented separately from or as a part of the main processor 121 .

The auxiliary processor 123 is, for example, on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg, executing an application). ), together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to an embodiment, the auxiliary processor 123 (eg, image signal processor or communication processor) may be implemented as a part of another functionally related component (eg, camera module 180 or communication module 190). have. According to an embodiment, the auxiliary processor 123 (eg, a neural network processing device) may include a hardware structure specialized for processing an artificial intelligence model. Artificial intelligence models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself on which artificial intelligence is performed, or may be performed through a separate server (eg, the server 108). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but in the above example not limited The artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the above example. The artificial intelligence model may include, in addition to, or alternatively, a software structure in addition to the hardware structure.

The memory 130 may store various data used by at least one component of the electronic device 101 (eg, the processor 120 or the sensor module 176 ). The data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input module 150 may receive a command or data to be used by a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 . The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).

The sound output module 155 may output a sound signal to the outside of the electronic device 101 . The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. The receiver may be used to receive an incoming call. According to an embodiment, the receiver may be implemented separately from or as a part of the speaker.

The display module 160 may visually provide information to the outside (eg, a user) of the electronic device 101 . The display module 160 may include, for example, a control circuit for controlling a display, a hologram device, or a projector and a corresponding device. According to an embodiment, the display module 160 may include a touch sensor configured to sense a touch or a pressure sensor configured to measure the intensity of a force generated by the touch.

The audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input module 150 or an external electronic device (eg, a sound output module 155 ) directly or wirelessly connected to the electronic device 101 . A sound may be output through the electronic device 102 (eg, a speaker or headphones).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 177 may support one or more designated protocols that may be used by the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ). According to an embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ). According to an embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101 . According to an embodiment, the battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication performance through the established communication channel. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to an embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : It may include a LAN (local area network) communication module, or a power line communication module). A corresponding communication module among these communication modules is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunication network such as a LAN or a WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other. The wireless communication module 192 uses the subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 . The electronic device 101 may be identified or authenticated.

The wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, a new radio access technology (NR). NR access technology includes high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency) -latency communications)). The wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example. The wireless communication module 192 includes various technologies for securing performance in a high-frequency band, for example, beamforming, massive multiple-input and multiple-output (MIMO), all-dimensional multiplexing. It may support technologies such as full dimensional MIMO (FD-MIMO), an array antenna, analog beam-forming, or a large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101 , an external electronic device (eg, the electronic device 104 ), or a network system (eg, the second network 199 ). According to an embodiment, the wireless communication module 192 may include a peak data rate (eg, 20 Gbps or more) for realizing eMBB, loss coverage (eg, 164 dB or less) for realizing mMTC, or U-plane latency for realizing URLLC ( Example: downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less).

The antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is selected from the plurality of antennas by, for example, the communication module 190 . can be A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) other than the radiator may be additionally formed as a part of the antenna module 197 .

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, the mmWave antenna module comprises a printed circuit board, an RFIC disposed on or adjacent to a first side (eg, bottom side) of the printed circuit board and capable of supporting a specified high frequency band (eg, mmWave band); and a plurality of antennas (eg, array antennas) disposed on or adjacent to the second surface (eg, upper surface or side surface) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. .

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and a signal ( eg commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external

electronic devices

102 or 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or part of the operations performed by the electronic device 101 may be executed by one or more of the external

electronic devices

102 , 104 , or 108 . For example, when the electronic device 101 is to perform a function or service automatically or in response to a request from a user or other device, the electronic device 101 may perform the function or service itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices may be requested to perform at least a part of the function or the service. One or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 101 . The electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to an embodiment, the external electronic device 104 or the server 108 may be included in the second network 199 . The electronic device 101 may be applied to an intelligent service (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.

The electronic device 200 (eg, the electronic device 101 of FIG. 1 ) may use the user's biometric information (eg, iris image and face image) (hereinafter, second biometric information) to process a user authentication function. In this case, the user's intention related to the acquisition of the biometric information may be explicitly confirmed. For example, when the electronic device 200 intends to process a user authentication function for a specified operation (eg, remittance operation) of an application (eg, remittance application) related to user authentication, the processor 250 and the security module 270 ), the user authentication function may be processed according to whether other biometric information (eg, fingerprint image and vein pattern) (hereinafter, first biometric information) is obtained. The first biometric information may be, for example, information obtainable by a user's dynamic action (eg, an action of touching an electronic device). The second biometric information may be, for example, information that may be obtained through a static action of the user (eg, an action of looking at the electronic device). Accordingly, the electronic device 200 may strengthen the integrity of the user authentication function that requires authentication of the second biometric information through the acquisition of the first biometric information.

Referring to FIG. 2 , the electronic device 200 for providing the above-described function includes a camera 210 , a memory 230 , a processor 250 , a security module 270 , a biometric sensor 290 , and security hardware ( 295) may be included. However, the components of the electronic device 200 are not limited thereto. In various embodiments, the electronic device 200 may omit at least one of the above-described components or further include at least one other component. For example, the electronic device 200 may further include a communication circuit (eg, the communication module 190 of FIG. 1 ).

According to an embodiment, the camera 210 (eg, the camera module 180 of FIG. 1 ) may acquire the second biometric information. For example, the camera 210 may receive light reflected from the user's iris or face through an image sensor. In various embodiments, the electronic device 200 may further include a light emitting unit (eg, an LED) capable of emitting light. In this case, the camera 210 receives the light reflected from the user's iris or face after being emitted from the light emitting unit in the direction where the user is located (eg, the front of the electronic device), and generates the iris image or face image of the user. 2 It can be obtained as biometric information. In various embodiments, the camera 210 may be a separate camera (eg, an iris recognition camera or a face recognition camera) for acquiring the second biometric information.

According to an embodiment, the camera 210 may be activated in an operating state for acquiring the second biometric information under the control of the processor 250 . For example, when an application related to user authentication is executed by the processor 250 , the operating state of the camera 210 may be switched to an active state or an inactive state according to whether the first biometric information is acquired. In an embodiment, when the operating state is switched to the active state, the camera 210 may acquire the second biometric information and transmit the obtained second biometric information to the processor 250 .

According to an embodiment, the memory 230 (eg, the memory 130 of FIG. 1 ) may store reference biometric information for confirming whether the second biometric information is authenticated. For example, when the registration of the reference biometric information is executed by the processor 250 , the memory 230 uses the iris image or face image obtained from the camera 210 as biometric information for comparing with the second biometric information. can be saved In an embodiment, the reference biometric information may be provided from the memory 230 to the processor 250 at the request of the processor 250 .

According to an embodiment, the memory 230 may store a designated application. For example, the memory 230 may store an application related to user authentication as a designated application. In an embodiment, the specified application may be executed under the control of the processor 250 . For example, the designated application may execute a user authentication function for a remittance operation under the control of the processor 250 .

According to an embodiment, the memory 230 may store a plurality of designated applications. For example, the memory 230 may store a plurality of applications related to user authentication as designated applications. In an embodiment, the memory 230 stores information (mapping) such that a different biometric sensor 290 (eg, a fingerprint sensor or a vein recognition sensor) corresponds to the camera 210 for each of a plurality of designated application types. Hereinafter, a mapping table) may be stored. For example, whether any one designated application mapped with the fingerprint recognition sensor and the camera 210 among the plurality of designated applications is whether the fingerprint image of the fingerprint recognition sensor is obtained and whether the second biometric information obtained from the camera 210 is authenticated Accordingly, the user authentication function may be performed. As another example, another designated application mapped with the vein recognition sensor and the camera 210 among the plurality of designated applications is whether the vein pattern of the vein recognition sensor is acquired and the authentication of the second biometric information acquired from the camera 210 Depending on whether or not, the user authentication function may be performed.

According to an embodiment, the processor 250 (eg, the processor 120 of FIG. 1 ) performs a user authentication function of a specified application based on whether the first biometric information is obtained and whether the second biometric information is authenticated. can be processed

According to an embodiment, when executing a user authentication function of a specified application, the processor 250 may execute a biometric recognition function for acquiring the second biometric information from the camera 210 . In one embodiment, the processor 250 receives the information from the biometric sensor 290 through the security module 270 from a designated section before processing the biometrics function to a designated section after processing the biometrics function. Based on whether the first biometric information is obtained, the user authentication function may be processed.

According to an embodiment, when executing a user authentication function of a specified application, the processor 250 may check whether the first biometric information is acquired in a specified section before processing the biometric function. For example, when the processor 250 wants to process the user authentication function, the processor 250 requests the security module 270 to obtain the first biometric information, and receives the first biometric information from the biometric sensor 290 through the security module 270 . A result related to whether the first biometric information is obtained may be received. In this case, the processor 250 may obtain the second biometric information from the camera 210 according to a result related to whether the first biometric information is obtained, and process the user authentication function.

According to an embodiment, when executing a user authentication function of a specified application, the processor 250 may check whether the first biometric information is acquired in a specified section after processing the biometric function. For example, when the processor 250 wants to process the user authentication function, after obtaining the second biometric information from the camera 210 , the processor 250 requests the security module 270 to obtain the first biometric information. , a result related to whether the first biometric information has been obtained may be received from the biometric sensor 290 through the security module 270 . In this case, the processor 250 may process the user authentication function according to a result related to whether the first biometric information is obtained.

According to an embodiment, when the user authentication function of the specified application is executed, the processor 250 may check whether the first biometric information is acquired until the time when the biometric function is processed. For example, when the processor 250 intends to process the user authentication function, it requests the security module 270 to obtain the first biometric information until the second biometric information is acquired from the camera 210 . Accordingly, a result related to whether the first biometric information is obtained may be received from the biometric sensor 29 through the security module 270 . In this case, the processor 250 may process the user authentication function according to a result related to whether the first biometric information is continuously (or repeatedly) acquired until the acquisition time of the second biometric information.

According to an embodiment, when the processor 250 executes a user authentication function of a specified application, the camera 210 is not used until the first biometric information is obtained from the biometric sensor 290 through the security module 270 . The operating state can be switched to a specified state. For example, the processor 250 disables the operating state of the camera 210 before the acquisition of the first biometric information from the biometric sensor 290 through the security module 270 (eg, the acquisition of biometric information). This state cannot be maintained) or the operating state of the camera 210 may be switched from an active state (eg, a state in which biometric information can be obtained) to an inactive state. In an embodiment, when the processor 250 obtains the first biometric information from the biometric sensor 290 through the security module 270 , the operating state of the camera 210 is switched from an inactive state to an active state. can

According to an embodiment, the processor 250 may include a security area 251 (eg, a trusted execution environment (TEE)). In an embodiment, the processor 250 may include the security module 270 in the security area 251 . In an embodiment, the processor 250 may use the security module 270 included in the security area 251 to perform the above-described security-related processing (eg, a function related to security of a specified application).

According to various embodiments, the processor 250 may execute a designated application in a background state by an external manipulation regardless of a user's intention. In this case, the processor 250 may provide an environment in which the second biometric information can be obtained from the camera 210 regardless of the user's intention.

According to an embodiment, the security module 270 may be electrically connected to the biometric sensor 290 . In an embodiment, when a request related to acquisition of the first biometric information is received from the processor 250 , the security module 270 may acquire the first biometric information from the biometric sensor 290 . In an embodiment, the security module 270 may transmit a result related to whether the first biometric information is obtained from the biometric sensor 290 to the processor 250 . In an embodiment, the security module 270 is configured to configure biometric information recognizable by the biometric sensor 290 (eg, designated biometric information) regardless of whether the first biometric information is the reference biometric information registered in the memory 230 . ) can be checked.

According to an embodiment, the biometric sensor 290 (eg, the sensor module 176 of FIG. 1 ) may be controlled through the security module 270 . For example, when a request related to the acquisition of the first biometric information is received from the processor 250 to the security module 270 , the biometric sensor 290 may control the first biometric information under the control of the security module 270 . information can be obtained. In various embodiments, the biometric sensor 290 transmits the first biometric information (or information related to the first biometric information) to the processor 270 through the security module 270 independent from the control of the processor 270 . can provide

According to an embodiment, the biometric sensor 290 may include a plurality of biometric sensors 290 (eg, a fingerprint recognition sensor, a vein recognition sensor, and a palm recognition sensor) controllable through the security module 270 . . In an embodiment, the plurality of biometric sensors 290 include at least one biometric sensor 290 for each of a plurality of designated application types to determine whether to obtain different first biometric information (eg, a fingerprint image or a vein pattern). can be matched. For example, the plurality of biometric sensors 290 may be stored as a mapping table in the memory 230 to correspond to each designated application type.

In an embodiment, the security hardware 295 may include the security module 270 to perform security-related processing (eg, a function related to security of a specified application). For example, the security module 270 may be a security processor included in the security hardware 295 . In one embodiment, secure hardware 295 may be physically (and/or logically) separate from processor 250 . In an embodiment, the security hardware 295 may be physically (and/or logically) separated from the processor 270 to provide a security environment stronger than that of the processor 270 .

Referring to FIG. 3 , the electronic device (eg, the electronic device 200 of FIG. 2 ) according to an embodiment performs different biometric recognition for each type of a specified application (eg, a first application 311 or an n-th application 319 ). A mapping table 300 corresponding to a sensor (eg, the first biometric sensor 331 or the nth biometric sensor 339 ) may be stored in a memory (eg, the memory 230 of FIG. 2 ).

According to an embodiment, in the mapping table 300 , a first application 311 (eg, a bank application) includes a first biometric sensor 331 (eg, a fingerprint sensor) and a camera 350 (eg, FIG. 2 ). may be stored to correspond to the camera 210 of the In an embodiment, when the electronic device 200 executes the remittance operation of the first application 311 , the electronic device 200 receives the fingerprint from the first biometric sensor 331 through a security module (eg, the security module 270 of FIG. 2 ). The remittance operation may be processed based on whether an image (eg, first biometric information) is acquired and whether an iris image or a face image (eg, second biometric information) acquired from the camera 350 is authenticated.

According to an embodiment, in the mapping table 300 , the n-th application 319 (eg, a shopping application) is stored to correspond to the n-th biometric sensor 339 (eg, a vein recognition sensor) and the camera 350 . can For example, when the electronic device 200 executes the payment operation of the n-th application 319 , the vein pattern (eg, first biometric information) is transmitted from the n-th biometric sensor 339 through the security module 270 . The payment operation may be processed based on whether or not the iris image or the face image (eg, second biometric information) acquired from the camera 350 is authenticated.

According to various embodiments, the electronic device (eg, the electronic device 200 of FIG. 2 ) includes a memory (eg, the memory 230 of FIG. 2 ), a processor (eg, the processor 250 of FIG. 2 ), and the processor ( 250) electrically connected to a security module (eg, the security module 270 of FIG. 2 ), a biometric sensor controllable through the security module 270 (eg, the biometric sensor 290 of FIG. 2 ), and a camera (eg, the camera 210 of FIG. 2 ), and the processor 250 , when an authentication function of a specified application stored in the memory 230 is executed, the biometric sensor through the security module 270 . (290) confirms whether the first biometric information is obtained, obtains the second biometric information from the camera 210, checks whether the acquired second biometric information is authenticated, and obtains the first biometric information Based on whether or not the second biometric information is authenticated, it may be set to process the authentication function.

According to various embodiments, the processor 250 is configured to obtain the first biometric information from the biometric sensor 290 through the security module 270 before acquiring the second biometric information from the camera 210 . It can be set to check whether the acquisition of

According to various embodiments, after obtaining the second biometric information from the camera 210 , the processor 250 receives the first biometric information from the biometric sensor 290 through the security module 270 . It may be set to check whether information is acquired.

According to various embodiments, the processor 250 receives the first biometric information from the biometric sensor 290 through the security module 270 at least until the second biometric information is acquired from the camera 210 . It may be set to check whether biometric information is acquired.

According to various embodiments, when the authentication function is executed, the processor 250 may be set to operate the camera 210 in an inactive state.

According to various embodiments, when the first biometric information is obtained from the biometric sensor 290 through the security module 270 , the processor 250 sets the operating state of the camera 210 to the inactive state. It can be set to switch to an active state in

According to various embodiments, when the first biometric information is obtained from the biometric sensor 290 , the security module 270 checks whether the first biometric information is specified biometric information, and the first biometric information It may be configured to transmit a result related to whether information is obtained to the processor 250 .

According to various embodiments, the biometric sensor 290 may include a plurality of biometric sensors controllable through the security module 270 (eg, the first biometric sensor 331 and the nth biometric sensor of FIG. 3 ). 339), wherein the processor 250 is configured to store a plurality of designated applications (eg, the first application 311 and the n-th application 319 of FIG. 3 ) in the memory 230, the According to a plurality of designated application types (first application 311 and n-th application 319), the plurality of biometric sensors (first biometric sensor 331 and n-th biometric sensor 331 and n-th biometric sensor 331 and n-th biometric sensor 331 and n-th biometric sensor 331 and n-th biometric recognition sensor 331 and n-th biometric recognition sensor 331) It may be set to check whether the first biometric information is obtained from at least one of the recognition sensors 339).

According to various embodiments, the electronic device 200 includes a display (eg, the display module 160 of FIG. 1 ), and the processor 250 performs the authentication function through the display 160 when the authentication function is executed. It may be set to display a screen related to the acquisition of the first biometric information.

According to various embodiments, the security module 270 is included in the security area of the processor 250 (eg, the security area 251 of FIG. 2 ) or is physically separated from the processor 250 . It may be included in hardware (eg, security hardware 295 of FIG. 2 ).

According to an embodiment, the electronic device (eg, the electronic device 200 of FIG. 2 ) processes a user authentication function of a specified application based on whether the first biometric information is acquired and whether the second biometric information is authenticated To this end, the user authentication method 400 of operations 410 to 490 may be performed.

Referring to operation 410 , the electronic device 200 according to an embodiment may execute a user authentication function of a specified application. For example, the processor (eg, the processor 250 of FIG. 2 ) may execute a user authentication function for the remittance operation of the remittance application. In an embodiment, when executing the user authentication function, the electronic device 200 maintains the operating state of the camera (eg, the camera 210 of FIG. 2 ) in an inactive state or activates the operating state of the camera 210 in an activated state. can be switched to inactive state.

Referring to operation 430 , the electronic device 200 according to an embodiment receives information from a biometric sensor (eg, the biometric sensor 290 of FIG. 2 ) through a security module (eg, the security module 270 of FIG. 2 ). Whether the first biometric information has been acquired may be checked. For example, when the processor 250 executes a user authentication function of a specified application, the processor 250 requests the acquisition of the first biometric information to the security module 270 separated from the processor 250 , and the security module 270 provides the A result related to whether the first biometric information is obtained may be received. For example, when receiving the first biometric information from the security module 270 , the electronic device 200 may perform operation 450 . As another example, when the electronic device 200 fails to receive the first biometric information under a specified condition (eg, a set time) from the security module 270 , the user authentication function may be terminated. In various embodiments, the electronic device 200 transmits the first biometric information from the biometric sensor 290 through the security module 270 until the time point at which operation 450 is performed (eg, the time point of acquiring the second biometric information). The user authentication function may be processed according to a result related to whether it is continuously (or repeatedly) obtained.

Referring to operation 450 , the electronic device 200 according to an embodiment receives the second biometric information from the camera 210 according to a result related to whether the first biometric information received from the security module 270 is obtained. can be obtained For example, when it is confirmed that the first biometric information has been obtained from the biometric sensor 290 through the security module 270 , the processor 250 changes the operating state of the camera 210 from an inactive state to an active state. By switching, it is possible to control the camera 210 to recognize the second biometric information.

Referring to operation 470 , the electronic device 200 according to an embodiment may check whether the second biometric information obtained from the camera 210 is authenticated. For example, the processor 250 compares the second biometric information obtained from the camera 210 with reference biometric information registered in a memory (eg, the memory 230 of FIG. 2 ) to determine whether they correspond to each other. can For example, when the second biometric information obtained from the camera 210 corresponds to the reference biometric information, the electronic device 200 may perform operation 480 or operation 490 . As another example, when the second biometric information obtained from the camera 210 does not correspond to the reference biometric information, the electronic device 200 may terminate the user authentication function.

Referring to operation 480 , the electronic device 200 according to an embodiment receives the biometric information from the biometric sensor 290 through the security module 270 according to whether the second biometric information acquired from the camera 210 is authenticated. Whether the first biometric information has been acquired may be checked. For example, when the second biometric information obtained from the camera 210 corresponds to the reference biometric information, the processor 250 requests the security module 270 to obtain the first biometric information, and the security module ( 270), a result related to whether the first biometric information has been acquired may be received. For example, when receiving the first biometric information from the security module 270 , the electronic device 200 may perform operation 490 . As another example, when the electronic device 200 does not receive the first biometric information under a specified condition (eg, a set time) from the security module 270 , the user authentication function may be terminated. In various embodiments, the electronic device 200 may omit operation 480 and perform operation 490 . In various embodiments, the electronic device 200 may omit operation 430 and perform operation 480 .

Referring to operation 490 , the electronic device 200 according to an embodiment may process a user authentication function of a specified application based on whether the first biometric information is acquired and whether the second biometric information is authenticated. For example, the processor 250 determines that the first biometric information has been acquired according to the result of operation 430 and/or operation 480, and it is determined that the second biometric information is authenticated according to the result of operation 470 In this case, the user authentication function may be processed.

Referring to FIG. 5 , the electronic device (eg, the electronic device 200 of FIG. 2 ) according to an exemplary embodiment determines whether the first biometric information is obtained and whether the second biometric information is authenticated. In order to process the user authentication function, operations 500a to 500o may be performed.

Referring to operation 500a, the processor 550 (eg, the processor 250 of FIG. 2 ) according to an embodiment may execute a user authentication function of a specified application. For example, the processor (eg, the processor 250 of FIG. 2 ) may execute the user authentication function for the remittance operation of the remittance application. In an embodiment, when executing the user authentication function, the electronic device 200 may maintain an operating state of the camera 510 in an inactive state or may convert an operating state of the camera 510 from an active state to an inactive state. .

Referring to operation 500b, the processor 550 according to an embodiment may request a user input (eg, biometric recognition) from the security module 570 as a user authentication function of a specified application is executed. The request related to the user input may be, for example, a request for the processor 550 to confirm whether the first biometric information is obtained from the biometric sensor 590 through the security module 570 .

Referring to operation 500c , the security module 570 (eg, the security module 270 of FIG. 2 ) according to an embodiment may activate a user input function (eg, a user input mode) for biometric recognition. For example, when receiving a user input request from the processor 550 , the security module 570 may control the biometric recognition sensor 590 to perform biometric recognition.

Referring to operation 500d , the security module 570 according to an embodiment may request a user input from the biometric sensor 590 . For example, when receiving a trigger related to a user input from the biometric sensor 590 according to a request related to a user input, the security module 570 causes the biometric sensor 590 to cause the first biometric information can be made to recognize

Referring to operation 500e, the biometric sensor 590 (eg, the biometric sensor 290 of FIG. 2 ) according to an embodiment may acquire first biometric information corresponding to a user input. For example, when receiving a request related to a user input from the security module 570 , the biometric sensor 590 receives the first biometric information according to the user's biometric (eg, finger and wrist) contact (or proximity). can be obtained.

Referring to operation 500f , the biometric sensor 590 according to an embodiment may transmit the first biometric information to the security module 570 . For example, the biometric sensor 590 may transmit the first biometric information to the security module 570 in response to a request related to a user input of the security module 570 .

Referring to operation 500g , the security module 570 according to an embodiment may receive the first biometric information from the biometric sensor 590 . In an embodiment, the security module 570 is configured to control the biometric information regardless of whether the first biometric information received from the biometric sensor 590 is reference biometric information registered in a memory (eg, the memory 230 of FIG. 2 ). It can be checked whether the biometric information is recognizable by the recognition sensor 590 .

Referring to operation 500h , the security module 570 according to an embodiment may transmit a result related to a user input to the processor 550 . For example, when the first biometric information obtained from the biometric sensor 590 is biometric information recognizable by the biometric sensor 590 , the security module 570 may determine whether to obtain the first biometric information from the user. A result related to the input may be transmitted to the processor 550 .

Referring to operation 500i , the processor 550 according to an embodiment may check a result related to a user input from the security module 570 . For example, when the processor 550 acquires the first biometric information from the biometric sensor 590 through the security module 570, a result related to whether or not the first biometric information is obtained is returned to the security module 570 can be received from

Referring to operation 500j , the processor 550 according to an embodiment may request biometric recognition from the camera 510 . For example, the processor 550 may change the operating state of the camera 510 from the inactive state to the active state, and control so that the second biometric information is acquired from the camera 510 in the active state.

Referring to operation 500k, the camera 510 (eg, the camera 210 of FIG. 2 ) according to an embodiment may acquire the second biometric information. For example, when receiving a request related to biometrics from the processor 550 , the camera 510 may acquire the second biometric information according to the recognition of the user's biometrics (eg, iris and face).

Referring to operation 500l , the camera 510 according to an embodiment may transmit the second biometric information to the processor 570 . For example, the camera 510 may transmit the second biometric information to the processor 550 in response to a biometric-related request from the processor 550 .

Referring to operation 500m , the processor 550 according to an embodiment may acquire the second biometric information from the camera 510 . In an embodiment, the processor 550 receives the second biometric information from the camera 510 to determine whether the second biometric information received from the camera 510 is the reference biometric information registered in the memory 230 . can be obtained

Referring to operation 500n , the processor 550 according to an embodiment may determine whether the second biometric information received from the camera 510 is reference biometric information registered in the memory 230 . For example, when the second biometric information received from the camera 510 corresponds to the reference biometric information, the processor 550 may perform operation 500o. As another example, when the second biometric information received from the camera 510 does not correspond to the reference biometric information, the processor 550 may terminate the user authentication function.

Referring to operation 500o, the processor 550 according to an embodiment may process a user authentication function of a specified application based on whether the first biometric information is acquired and whether the second biometric information is authenticated. For example, when it is confirmed that the first biometric information has been acquired according to the result of the operation 500g and the second biometric information is authenticated according to the result of the operation 500n, the processor 550 determines that the user It can handle authentication functions.

According to an embodiment, when the electronic device (eg, the electronic device 200 of FIG. 2 ) executes a user authentication function of a specified application, the electronic device (eg, the display module 160 of FIG. 1 ) receives the information through the display 601 (eg, the display module 160 of FIG. 1 ) The first screen 600a and the second screen 600b may be displayed.

Referring to the first screen 600a, the electronic device 200 according to an embodiment may execute a user authentication function of a specified application. In an embodiment, the electronic device 200 may display a first notification 601a related to the user authentication function on the display 601 according to the execution of the user authentication function. The first notification 601a may be, for example, an indication for notifying execution of a user authentication function for processing a remittance operation of the remittance application. In an embodiment, the electronic device 200 displays a second notification 601b related to a user input function for acquiring a fingerprint image from the fingerprint recognition sensor 690 (eg, the biometric sensor 290 of FIG. 2 ). (601) can be displayed. The second notification 601b may be, for example, a display for requesting acquisition of the first biometric information. In an embodiment, the electronic device 200 receives the fingerprint image (eg, the biometric sensor 290 of FIG. 2 ) from the fingerprint recognition sensor 690 (eg, the biometric sensor 290 of FIG. 2 ) through the security module (eg, the security module 270 of FIG. 2 ). For example, it may be checked whether the first biometric information) is obtained.

Referring to the second screen 600b , the electronic device 200 according to an embodiment may execute a biometric recognition function according to a result related to whether a fingerprint image received from the security module 270 is acquired. In an embodiment, the electronic device 200 may display a third notification 603b related to biometrics on the display 601 according to the execution of the biometrics function. The third notification 603a may be, for example, a display for requesting authentication of the second biometric information. In an embodiment, the electronic device 200 may display a fourth notification 603a related to the user authentication function on the display 601 . The fourth notification 603a may be, for example, a display corresponding to the first notification 603a on the first screen 600a. In an embodiment, the electronic device 200 may acquire an iris image (or a face image) from the camera 610 . In an embodiment, the electronic device 200 compares the iris image (or face image) obtained from the camera 610 with reference biometric information registered in a memory (eg, the memory 230 of FIG. 2 ) to correspond to each other. You can check whether or not In an embodiment, the electronic device 200 may process the user authentication function based on whether a fingerprint image is acquired and whether an iris image (or face image) is authenticated.

According to various embodiments, the user authentication method (eg, the user authentication method 400 of FIG. 4 ) performed in the electronic device (eg, the electronic device 200 of FIG. 2 ) may include a memory (eg, the memory 230 of FIG. 2 ). ))), when the authentication function of the specified application is executed, the biometric sensor (eg, the processor 250 of FIG. 2 ) through the security module (eg, the security module 270 of FIG. 2 ) electrically connected to the processor : Checking whether the first biometric information is obtained from the biometric sensor 290 of FIG. 2) (eg, operation 430 of FIG. 4)) an operation of acquiring information and confirming whether the acquired second biometric information is authenticated (eg, operation 470 in FIG. 4 )), and based on whether the first biometric information is acquired and whether the second biometric information is authenticated Thus, an operation of processing the authentication function (eg, operation 490 of FIG. 4 ) may be included.

According to various embodiments, the operation of determining whether the first biometric information is acquired (operation 430 ) may be performed before acquiring the second biometric information from the camera 210 .

According to various embodiments, the operation of determining whether the first biometric information is obtained (operation 430 ) may be performed after obtaining the second biometric information from the camera 210 .

According to various embodiments, the operation of determining whether the first biometric information has been acquired (operation 430 ) may operate at least until the point at which the second biometric information is acquired from the camera 210 .

According to various embodiments, when the authentication function is executed, an operation of operating the camera 210 in an inactive state may be included.

According to various embodiments, when the first biometric information is obtained from the biometric sensor 290 through the security module 270 , the operation of the camera 210 is switched from the inactive state to the active state may include

According to various embodiments, when the first biometric information is obtained from the biometric sensor 290 through the security module 270 , whether the first biometric information is designated biometric information through the security module 270 and receiving a result related to whether the first biometric information has been obtained by checking the .

According to various embodiments, the operation (operation 430) of confirming whether the first biometric information is obtained may include a plurality of biometric sensors (eg: The first biometric sensor 331 and the nth biometric sensor 339 of FIG. 3 are included, and a plurality of designated applications (eg, the first application 311 and the nth biometric sensor 339 of FIG. 3 ) are included in the memory 230 . When the application 319) is stored, according to the type of the plurality of designated applications (the first application 311 and the n-th application 319), the plurality of biometric sensors (first and checking whether the first biometric information is acquired from at least one of the biometric sensor 331 and the nth biometric sensor 339 .

According to various embodiments, when the authentication function is executed, an operation of displaying a screen related to the acquisition of the first biometric information through a display (eg, the display 601 of FIG. 6 ) may be included.

The electronic device according to various embodiments disclosed in this document may be a device of various types. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, “A or B”, “at least one of A and B”, “at least one of A or B,” “A, B or C,” “at least one of A, B and C,” and “A , B, or C" each may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as “first”, “second”, or “first” or “second” may simply be used to distinguish the component from other such components, and refer to the component in another aspect (e.g., importance or order) is not limited. When a (e.g., first) component is referred to as “coupled” or “connected” to another (e.g., second) component, with or without the terms “functionally” or “communicatively” When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

As used herein, the term “module” may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as, for example, logic, logic block, component, or circuit. A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of this document are software (storage medium) readable by a machine (machine) including one or more instructions stored in a storage medium (eg, the internal memory 136 or the external memory 138 of FIG. 1 ). Example: It can be implemented as the program 140 of FIG. 1 ). For example, the processor of the device (eg, the processor 120 of FIG. 1 ) may call at least one of one or more instructions stored from a storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the called at least one command. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain a signal (eg, electromagnetic wave), and this term is used in cases where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to an embodiment, the method according to various embodiments disclosed in this document may be provided by being included in a computer program product (computer pro memory product). Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)) or via an application store (eg Play Store ^TM ) or on two user devices (eg compact disc read only memory (CD-ROM)). : It can be distributed (eg, downloaded or uploaded) directly or online between smartphones). In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

According to various embodiments, each component (eg, a module or a program) of the above-described components may include a singular or a plurality of entities. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, omitted, or , or one or more other operations may be added.

Claims

In an electronic device,

Memory;

processor;

a security module electrically connected to the processor;

a biometric sensor controllable through the security module; and

including a camera;

The processor is

When the authentication function of the specified application stored in the memory is executed, it is confirmed whether the first biometric information is obtained from the biometric sensor through the security module,

Obtaining second biometric information from the camera, and confirming whether the obtained second biometric information is authenticated;

The electronic device is configured to process the authentication function based on whether the first biometric information is acquired and whether the second biometric information is authenticated.
In claim 1,

The processor is

Before acquiring the second biometric information from the camera, the electronic device is configured to check whether the first biometric information is acquired from the biometric sensor through the security module.
In claim 1,

The processor is

an electronic device configured to confirm whether the first biometric information is acquired from the biometric sensor through the security module after acquiring the second biometric information from the camera.
In claim 1,

The processor is

The electronic device is configured to check whether the first biometric information is obtained from the biometric sensor through the security module at least until the point at which the second biometric information is acquired from the camera.
In claim 1,

The processor is

When the authentication function is executed, the electronic device is configured to operate the camera in an inactive state.
In claim 5,

The processor is

and when the first biometric information is obtained from the biometric sensor through the security module, the operating state of the camera is set to change from the inactive state to the active state.
In claim 1,

The security module is

When the first biometric information is obtained from the biometric sensor, it is determined whether the first biometric information is designated biometric information, and a result related to whether the first biometric information is obtained is transmitted to the processor. .
In claim 1,

The biometric sensor includes a plurality of biometric sensors controllable through the security module,

The processor is

When a plurality of designated applications are stored in the memory, the electronic device is configured to confirm whether the first biometric information is obtained from at least one of the plurality of biometric sensors through the security module according to the types of the plurality of designated applications .
In claim 1,

including a display;

The processor is

an electronic device configured to display a screen related to the acquisition of the first biometric information through the display when the authentication function is executed.
In claim 1,

The security module is included in a security area of the processor or included in security hardware physically separated from the processor, the electronic device.
In the user authentication method,

when the authentication function of the specified application stored in the memory is executed, checking whether the first biometric information is obtained from the biometric sensor through the security module electrically connected to the processor;

obtaining second biometric information from a camera and confirming whether the acquired second biometric information is authenticated; and

and processing the authentication function based on whether the first biometric information is acquired and whether the second biometric information is authenticated.
In claim 11,

The operation of determining whether the first biometric information is acquired is performed before acquiring the second biometric information from the camera.
In claim 11,

The operation of determining whether the first biometric information is acquired is performed after acquiring the second biometric information from the camera.
In claim 11,

The operation of confirming whether the first biometric information is acquired is performed at least until a point in time when the second biometric information is acquired from the camera.
In claim 11,

and, when the authentication function is executed, operating the camera in an inactive state.