KR20210050651A - Mobile device and method for authenricating a user by using an audio signal - Google Patents

Abstract

Disclosed are a mobile device for authenticating a user using a sound signal, which enables the user to use the mobile device and functions executed thereby without performing a separate operation for user authentication, and a method thereof. According to one embodiment of the present invention, the mobile device comprises: an interface for connecting a sound output device and the mobile device; a sound circuit configured to transmit a sound signal to the sound output device connected to the mobile device through the interface; a memory including user authentication information for a registered user of the mobile device and instructions; and at least one processor electrically coupled to the memory. When the stored instructions are executed, the mobile device allows the at least one processor to: transmit a test signal to the sound output device through the sound circuit; receive a feedback signal corresponding to the test signal from the sound output device through the sound circuit; and unlock the mobile device in a locked state when it is indicated that the user wearing the sound output device is the registered user on the basis of the received feedback signal and the user authentication information.

Description

A mobile device that authenticates a user using a sound signal and its method {MOBILE DEVICE AND METHOD FOR AUTHENRICATING A USER BY USING AN AUDIO SIGNAL}

Embodiments disclosed in this document relate to a technology for authenticating a user using a sound output device connected to a mobile device.

The mobile device can lock the mobile device for security. The mobile device may perform user authentication to unlock the mobile device. The mobile device can confirm that the user who intends to operate the mobile device is a user with authority.

In addition, various services executed by the mobile device may require user authentication for security. For example, a payment function, a remittance function, etc. performed by a payment service, a banking service, or the like may be performed only after user authentication is completed. Before performing the functions, the mobile device may check whether a user who intends to perform the functions is a user who has the authority to perform the functions.

Embodiments disclosed in this document are intended to provide a mobile device for allowing a user to use a mobile device and functions executed by the mobile device without performing a separate operation for user authentication.

A method according to an embodiment disclosed in this document is to transmit a test signal to a sound output device connected to the mobile device through a wired interface for a predetermined time, and to transmit a feedback signal corresponding to the test signal from the sound output device. Receiving, and unlocking the mobile device in a locked state when the user wearing the sound output device indicates that the user wearing the sound output device is a registered user of the mobile device based on the received feedback signal and user authentication information. can do.

According to the embodiments disclosed in the present document, user authentication and authentication cancellation for a mobile device and other functions may be performed by wearing a sound output device by the user without a separate operation of the user.

In addition to this, various effects that are directly or indirectly identified through this document can be provided.

1A illustrates an operating environment of a mobile device according to an exemplary embodiment.
1B is a block diagram of a mobile device and a sound output device according to an exemplary embodiment.
1C illustrates a schematic structure of a speaker included in a sound output device according to an exemplary embodiment.
2 is a flowchart of a user authentication method according to an exemplary embodiment.
3 is a flowchart of a method of authenticating a user with respect to a specific program according to various embodiments of the present disclosure.
4A is a flowchart of a method of performing a function corresponding to a user input according to various embodiments of the present disclosure.
4B is an example of a feedback signal according to various embodiments of the present disclosure.
4C is an example of a screen according to various embodiments of the present disclosure.
5 is a flowchart of a user authentication method according to various embodiments of the present disclosure.
6 is a sequence diagram illustrating a user authentication method according to various embodiments of the present disclosure.
7 is a diagram of a press detection device according to various embodiments of the present disclosure.

Hereinafter, various embodiments of the present invention will be described with reference to the accompanying drawings. However, this is not intended to limit the present invention to a specific embodiment, it should be understood to include various modifications, equivalents, and/or alternatives of the embodiments of the present invention. In connection with the description of the drawings, similar reference numerals may be used for similar elements.

In this document, expressions such as "have", "may have", "include", or "may contain" are the presence of corresponding features (eg, elements such as numbers, functions, actions, or parts). And does not exclude the presence of additional features.

In this document, expressions such as "A or B", "at least one of A or/and B", or "one or more of A or/and B" may include all possible combinations of the items listed together. . For example, "A or B", "at least one of A and B", or "at least one of A or B" includes (1) at least one A, (2) at least one B, Or (3) it may refer to all cases including both at least one A and at least one B.

Expressions such as "first", "second", "first", or "second" used in this document can modify various elements, regardless of their order and/or importance, and It is used to distinguish it from the component, but does not limit the component. For example, a first user device and a second user device may represent different user devices regardless of order or importance. For example, without departing from the scope of the rights described in this document, a first component may be referred to as a second component, and similarly, a second component may be renamed to a first component.

Some component (eg, the first component) is “(functionally or communicatively) coupled with/to)” to another component (eg, the second component) or “ When referred to as "connected to", it should be understood that the certain component may be directly connected to the other component or may be connected through another component (eg, a third component). On the other hand, when a component (eg, a first component) is referred to as being “directly connected” or “directly connected” to another component (eg, a second component), the component and the It may be understood that no other component (eg, a third component) exists between the different components.

The expression "configured to" used in this document is, for example, "suitable for", "having the capacity to" depending on the situation. It can be used interchangeably with ", "designed to", "adapted to", "made to", or "capable of". The term "configured to (or set) to" may not necessarily mean only "specifically designed to" in terms of hardware. Instead, in some situations, the expression "a device configured to" may mean that the device "can" along with other devices or parts. For example, the phrase "a processor configured (or configured) to perform A, B, and C" means a dedicated processor (eg, an embedded processor) for performing the corresponding operation, or executing one or more software programs stored in a memory device. By doing so, it may mean a generic-purpose processor (eg, a CPU or an application processor) capable of performing corresponding operations.

Terms used in this document are only used to describe a specific embodiment, and may not be intended to limit the scope of other embodiments. Singular expressions may include plural expressions unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by one of ordinary skill in the technical field described in this document. Among the terms used in this document, terms defined in a general dictionary may be interpreted as having the same or similar meaning as the meaning in the context of the related technology, and unless explicitly defined in this document, they may be interpreted in an ideal or excessively formal meaning. It is not interpreted. In some cases, even terms defined in this document cannot be interpreted to exclude embodiments of this document.

Mobile devices according to various embodiments of the present document include, for example, a smartphone, a tablet personal computer, a mobile phone, a video phone, an e-book reader, Desktop PC, laptop PC, netbook computer, workstation, server, personal digital assistant (PDA), portable multimedia player (PMP), MP3 player, mobile medical device, It may include at least one of a camera or a wearable device. According to various embodiments, the wearable device is an accessory type (for example, a watch, a ring, a bracelet, an anklet, a necklace, glasses, contact lenses, or a head-mounted-device (HMD)), a fabric, or an integrated clothing type ( For example, it may include at least one of an electronic clothing), a body-attached type (eg, a skin pad or tattoo), or a living body implantable type (eg, an implantable circuit).

In some embodiments, the mobile device may be a home appliance. Home appliances include, for example, TV, DVD player (Digital Video Disk player), sound, refrigerator, air conditioner, vacuum cleaner, oven, microwave oven, washing machine, air cleaner, set-top box, and home automation. Home automation control panel, security control panel, TV box (eg Samsung HomeSync™, Apple TV™, or Google TV™), game console (eg Xbox™, PlayStation™), electronics It may include at least one of a dictionary, an electronic key, a camcorder, and an electronic frame.

In another embodiment, the mobile device includes various medical devices (e.g., various portable medical measuring devices (blood glucose meter, heart rate meter, blood pressure meter, or body temperature meter, etc.), magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), CT (computed tomography), camera, or ultrasound), navigation device, global navigation satellite system (GNSS), event data recorder (EDR), flight data recorder (FDR), car infotainment ) Devices, marine electronic equipment (e.g. marine navigation equipment, gyro compasses, etc.), avionics, security equipment, vehicle head units, industrial or domestic robots, automatic teller's machines (ATMs) for financial institutions , Point of sales (POS) in stores, or internet of things (e.g. light bulbs, sensors, electricity or gas meters, sprinkler devices, fire alarms, thermostats, street lights, toasters) , Exercise equipment, hot water tank, heater, boiler, etc.).

According to some embodiments, the mobile device is a furniture or part of a building/structure, an electronic board, an electronic signature receiving device, a projector, or various measurement devices (e.g., It may include at least one of water, electricity, gas, or radio wave measurement equipment. In various embodiments, the mobile device may be a combination of one or more of the various devices described above. The mobile device according to some embodiments may be a flexible mobile device. Further, the mobile device according to the exemplary embodiment of the present document is not limited to the above-described devices, and may include a new mobile device according to technological advances.

Hereinafter, a mobile device according to various embodiments will be described with reference to the accompanying drawings. In this document, the term user may refer to a person using a mobile device or a device (eg, an artificial intelligence mobile device) using a mobile device.

1A illustrates an operating environment of a mobile device according to an exemplary embodiment. 1B is a block diagram of a mobile device and a sound output device according to an exemplary embodiment. 1C illustrates a schematic structure of a speaker included in a sound output device according to an exemplary embodiment.

Referring to FIG. 1A, a mobile device 100 according to an embodiment may be referred to as a terminal of a user 50 such as a smart phone or a tablet PC. The sound output device 200 may be referred to as a sound device that the user 50 can wear, such as earphones. The user 50 may wear the sound output device 200 (eg, earphones). The user 50 may use the mobile device 100 (eg, a smartphone or a tablet PC) while wearing the sound output device 200. The mobile device 100 may determine whether the user 50 is authorized to use the mobile device 100 by using the sound output device 200. The user 50 may perform user authentication by wearing the sound output device 200 and use the mobile device 100.

Referring to FIG. 1B, the mobile device 100 according to an embodiment may include a processor 110, a memory 120, and a sound circuit 130.

In one embodiment, the processor 110 may be electrically connected to the memory 120 and the sound circuit 130. The processor 110 may directly or indirectly control the memory 120 and the sound circuit 130. The processor 110 may be referred to as, for example, an application processor. The operation of the mobile device 100 described below may be performed by the processor 110.

In an embodiment, the sound circuit 130 may be configured to transmit and receive sound signals between the mobile device 100 and the sound output device 200 connected to the mobile device 100. The sound output device 200 may be connected to the mobile device 100 through a wired or wireless interface 220. The wired interface 220 may be referred to as, for example, a wired cable. As another example, the wireless interface 220 may be referred to as a wireless communication channel (for example, Bluetooth) formed between the sound output device 200 and the mobile device 100. The sound circuit 130 is the interface 220. ) Through the sound output device 200 may transmit or receive a sound signal.

In an embodiment, the sound output device 200 may include a speaker 210. The sound output device 200 may output the received sound signal through the speaker 210.

In an embodiment, the memory 120 may include user authentication information for a registered user of the mobile device 110. The registered user has the right to use the mobile device 100 and may be referred to as a pre-registered user. The user authentication information may be referred to as data used when determining whether a user operating the mobile device 100 is a registered user.

In one embodiment, the memory 120 may include instructions. The processor 110 may execute instructions stored in the memory 120 and control the overall operation of the mobile device 100.

In an embodiment, the mobile device 100 may transmit a sound signal to the sound output device 200 through the sound circuit 130. The mobile device 100 may receive a feedback signal corresponding to the sound signal from the sound output device 200 through the sound circuit 120. For example, the sound signal may be reflected in the ear of a user wearing the sound output device 100 and may be input as a feedback signal. The feedback signal may have different characteristics (eg, waveforms) for each person.

Referring to FIG. 1C, when an audio signal is received by the speaker 210 from the mobile device 100, the sound signal may be transmitted to the ear of the user 50. The sound signal may be reflected in the ear of the user 50 and received by the mobile device 100 again through the speaker 210. For example, the sound signal may pass through the ear canal of the user 50 and be transmitted and reflected to the eardrum. The reflected and received sound signal may be referred to as the feedback signal. Hereinafter, among sound signals transmitted to the sound output device 200, a sound signal transmitted to obtain a feedback signal may be described as a test signal.

In one embodiment, based on the received feedback signal and user authentication information stored in the memory 120, the mobile device 100 indicates that the user wearing the sound output device 100 is the registered user, and locks The mobile device 100 in the state may be unlocked (unlock the electronic device in lock state). The mobile device 100 confirms that the user wearing the sound output device 100 is a user who has the authority to manipulate the mobile device 100 (user authentication), and unlocks the mobile device 100. have.

In an embodiment, the user authentication information stored in the memory 120 may include data on a feedback signal corresponding to a registered user. When there are a plurality of registered users, authentication data related to a feedback signal corresponding to each of the plurality of users may be included. The mobile device 100 may perform user authentication by referring to a feedback signal and authentication information of the user.

In various embodiments, the sound circuit 130 may further include an A/D converter 132. The A/D converter 132 may analyze a voltage value of the received feedback signal and extract a digital signal.

In various embodiments, the mobile device 100 may acquire pulse code modulation (PCM) data corresponding to the feedback signal through the A/D converter 132. For example, data on a feedback signal included in user authentication information may be referred to as the PCM data.

In various embodiments, the sound output device 200 may further include an input circuit 230. The sound output device 200 may receive a tap input, a touch input, and the like through the input circuit 230. The user may transmit a control command for the mobile device 100 through the input circuit 230. A related embodiment will be described later with reference to FIG. 4.

In another embodiment, the sound output device (eg, the digital type sound output device 200) may include a microphone and an A/D converter. In this case, the sound output device may directly analyze the feedback signal obtained from the microphone and perform user authentication. The mobile device 100 may receive a user's authentication result from the sound output device and perform a locking/unlocking operation on the mobile device accordingly.

2 is a flowchart of a user authentication method according to an exemplary embodiment.

Referring to FIG. 2, the user authentication method according to an embodiment may include operations 210 to 270. The operations 210 to 270 may be performed, for example, by the mobile device 100 shown in FIG. 1B. Each of the operations 210 to 270 may be implemented as instructions (commands) that can be executed (or executed) by the processor 110 of the mobile device 100. The instructions may be stored, for example, in a computer recording medium or in the memory 120 of the mobile device 100 shown in FIG. 1B. Hereinafter, in the description of operations 210 to 270, descriptions overlapping with those of FIG. 1B may be omitted.

In operation 210, the mobile device 100 (eg, the processor 110) may transmit a test signal to the sound output device 200. In operation 220, the mobile device 100 may receive a feedback signal corresponding to the test signal.

In an embodiment, the test signal may be transmitted to authenticate a user wearing the sound output device 200. For example, the test signal may be transmitted to the sound output device 200 for a predetermined time. The mobile device 100 may receive a feedback signal corresponding to the test signal during the specified time. The mobile device 100 may perform user authentication based on a feedback signal received for a predetermined time.

In various embodiments, the test signal may be transmitted to measure the impedance of the sound output device 200. In this case, the test signal may be transmitted for a time shorter than the designated time for authentication. The mobile device 100 may determine the impedance of the sound output device 200 through a feedback signal corresponding to the transmitted test signal. For example, the mobile device 100 may determine the impedance using the A/D converter 132. The mobile device 100 may determine a level of a sound signal to be transmitted to the sound output device 200 based on the determined impedance.

In various embodiments, the mobile device 100 (eg, the processor 110) may be referred to as, for example, a portable device such as a smart phone. The mobile device 100 may include an A/D converter 132 for compatibility with various types of sound output devices 200. For example, the mobile device 100 may determine impedance values of various sound output devices 200 using the A/D converter 132 of the sound circuit 130 and output sound signals corresponding thereto. The mobile device 100 may perform user authentication by dedicating the A/D converter 132 for impedance measurement without adding a separate component to the sound circuit 130.

In operation 230, the mobile device 100 (eg, the processor 110) may perform user authentication. If user authentication is successful, the mobile device 100 may unlock the mobile device 100 in operation 250, and if the user authentication fails, the mobile device 100 may set or maintain the locking of the mobile device 100 in operation 240.

In operation 230, the mobile device 100 (eg, the processor 110) may acquire PCM (pulse code modulation) data corresponding to the feedback signal received for a predetermined time. For example, the PCM data may include continuous digital signal values obtained by the A/D converter 132. Since the feedback signal acquired for each user has unique characteristics, PCM data corresponding to the feedback signal may have a unique value for each user. The mobile device 100 may perform user authentication by comparing PCM data and user authentication information.

In various embodiments, the user authentication information may include authentication data mapped for each user. The authentication data may be referred to as PCM data corresponding to a specific user. For example, PCM data converted from a feedback signal for each user may have a unique value. User authentication information is illustrated in Table 1 below. The authentication data 0011101011101 for the registered user A and the authentication data 1001101111100 for the registered user B are illustrated.

Registered user Authentication data (e.g. PCM data) A 0011101011101 B 1001101111100

For example, when the mobile device 100 acquires PCM data, it may compare it with pre-stored authentication data. If authentication data matching the obtained PCM data exists, the mobile device 100 may authenticate a user wearing the sound output device 200 as a registered user. The mobile device 100 is unlocked, and a user wearing the sound output device 200 can use the mobile device 100.

In operation 260, the mobile device 100 may check whether the sound output device 200 is continuously worn by the authenticated user. In operation 270, when the mobile device 100 detects that the sound output device 200 is not worn by the authenticated user, the mobile device 100 in the unlocked state may be changed to the locked state. The mobile device 100 may perform authentication and deauthentication by detecting the detachment of the sound output device 200.

For example, the mobile device 100 may detect a state in which the user is not wearing the sound output device 200 or a state in which the sound output device 200 is worn by another user who is not authenticated.

For example, the mobile device 100 may transmit a test signal to the sound output device 200 at a predetermined period. The predetermined period may be specified in advance. The mobile device 100 may determine a state in which the user is not wearing the sound output device 200 or a state worn by another user from the feedback signal corresponding to the test signal. For example, when the acquired PCM data is meaningless PCM data that does not include a certain pattern generated by the user's body, the mobile device 100 may determine that the acquired PCM data is not worn by the user. For example, when PCM data having a pattern different from that of the authenticated user is acquired, the mobile device 100 may determine the state as being worn by an unauthenticated user.

3 is a flowchart of a method of authenticating a user with respect to a specific program according to various embodiments of the present disclosure.

Referring to FIG. 3, a user authentication method according to an embodiment may include operations 310 to 360. The operations 310 to 360 may be performed or executed by, for example, the processor 110 of the mobile device 100 shown in FIG. 1B. Operation 320 may correspond to operations 210 to 230 of FIG. 2. Operations 350 to 360 may correspond to operations 260 to 270 of FIG. 2. Hereinafter, descriptions overlapped with those of FIGS. 1B and 2 may be omitted in the description of operations 310 to 360.

In operation 310, the mobile device 100 (eg, the processor 110 of FIG. 1B) may detect execution of a program requiring user authentication. In operation 320, the mobile device 100 may perform user authentication for the program based on the feedback signal and user authentication information. If user authentication is successful, the mobile device 100 may change the unauthenticated program to an authenticated state in operation 340. The mobile device 100 may enable a program requiring authentication information to be executed without requesting separate authentication information from the user.

For example, a program that requires user authentication may be referred to as a payment program, a social networking service (SNS) program, an online banking program, or the like. For example, when a user performs payment through a payment program, logs in to an SNS program, or transfers money through an online banking program, there is no need to input additional authentication information.

If user authentication fails, in operation 330, the mobile device 100 may request additional authentication information for the program. For example, the mobile device 100 may display a screen requesting login information or a screen requesting password input.

In operation 350, the mobile device 100 may check whether the sound output device 200 is continuously worn by the authenticated user. In operation 360, when the mobile device 100 detects a state in which the sound output device 200 is not worn by an authenticated user, the mobile device 100 may change the authenticated program to an unauthenticated state. The mobile device 100 may perform authentication and deauthorization for a specific program by detecting the detachment of the sound output device 200.

In another embodiment, when a program requiring user authentication is executed by the mobile device 100 from which the lock is released, the mobile device 100 may omit the user authentication procedure for the program. Since user authentication for the mobile device 100 has already been completed, the authentication procedure for the program may be omitted. When authentication for the mobile device 100 is completed, the user may execute various programs without additional authentication. At this time, when the mobile device 100 detects that the sound output device 200 is not worn by an authenticated user, it locks the mobile device in the unlocked state and changes the authenticated program to an unauthenticated state. have.

In various embodiments, operations 310 to 360 may be similarly performed when executing a file with restricted user access. The mobile device 100 may allow an authenticated user to access the file. For example, the file may include a media file such as a photo, music, or video, or a folder created by a user.

In various embodiments, the user authentication information may include user authority information for a plurality of programs. The user authentication information may include a list of programs that can be authenticated by the sound output device 200. For example, referring to Table 2, when authentication for the user A is completed, the user A may execute the payment program 1 and the voice command program 2 without an additional authentication procedure. When the authentication for user B is completed, user B can execute the voice command program 2 without additional authentication and can access the file 3. The user may pre-designate the list of programs to be allowed to be authenticated by the sound output device 200.

Registered user Authentication data Program entitlement information A 0011101011101 Payment Program (1)
Voice command program (2) B 0011101011101 Voice command program (2)
Files (3)

4A is a flowchart of a method of performing a function corresponding to a user input according to various embodiments of the present disclosure. 4B is an example of a feedback signal according to various embodiments of the present disclosure.

Referring to FIG. 4A, a method of performing a function according to an embodiment may include operations 410 to 440. The operations 410 to 440 may be performed or executed by, for example, the processor 110 of the mobile device 100 illustrated in FIG. 1B. Operations 410 to 420 may correspond to operations 210 to 230 of FIG. 2. Hereinafter, descriptions of operations 410 to 440 that are duplicated with those of FIGS. 1B and 2 may be omitted.

In operations 410 and 420, the mobile device 100 (eg, the processor 110 of FIG. 1B) transmits a test signal to the sound output device 200, and feedback corresponding to the test signal from the sound output device 200 Can receive signals. The mobile device 100 may perform user authentication using a feedback signal.

In various embodiments, the mobile device 100 may extract PCM data from the feedback signal using the A/D converter 132. First PCM data corresponding to the feedback signal and second PCM data corresponding to a specific user (eg, authentication data in Table 1) stored in advance may be compared. When the first PCM data and the second PCM data match, the mobile device 100 may complete authentication for a specific user corresponding to the second PCM data. The mobile device 100 may identify a user wearing the sound output device 200 (eg, earphone) through the authentication method.

In various embodiments, the second PCM data corresponding to a specific user may be stored in the memory 120 in advance. For example, the mobile device 100 may support a'training mode' that acquires authentication data for a specific user. In the training mode, the mobile device 100 may acquire a feedback signal for a specific user and store PCM data extracted from the acquired feedback signal in the memory 120. Thereafter, the mobile device 100 may perform authentication for the specific user using the stored PCM data. The mobile device 100 may compare the stored PCM data with the acquired PCM data, and complete the authentication when both match. Hereinafter, description will be made on the premise that user authentication is successful.

In operation 430, the mobile device 100 may receive the feedback signal modified according to an input acquired through the input circuit 230 included in the sound output device 100. In operation 440, the mobile device 100 may execute at least one function corresponding to the modified feedback signal.

For example, the input circuit 230 of the sound output device 100 may receive a user's input. The input circuit 230 may include a physical button, and may receive a tap input through the physical button. The input circuit 230 may include a touch pad, and may receive a touch input through the touch pad. For example, the mobile device 100 may receive different types of inputs, such as one tap input and a touch input for 2 seconds, through the input circuit 230.

In an embodiment, the input circuit 230 may be disposed on the interface 220 through which the feedback signal is received. The feedback signal may be transformed according to an input obtained by the input circuit 230. For example, the feedback signal may be transformed according to a touch input or a tap input through the input circuit 230.

For example, referring to FIG. 4B, an example of a feedback signal when a tap input occurs once is illustrated. The mobile device 100 may perform user authentication in operation 420 based on a feedback signal from t1 to t2. When the tap input through the input circuit 230 is input from t3 to t4, the feedback signal may be modified. The mobile device 100 may perform a function corresponding to the modified feedback signal from t3 to t4. Alternatively, the mobile device 100 may perform a function corresponding to the modified feedback signal after the input (after t3).

For example, when receiving a modified feedback signal, the mobile device 100 may extract third PCM data from the modified feedback signal. When the pre-stored fourth PCM data and the third PCM data match, the mobile device 100 may perform a function mapped to the pre-stored fourth PCM data. The mobile device 100 may store the fourth PCM data and mapping information of a function to be performed corresponding to the fourth PCM data in the memory 120 in advance.

In various embodiments, the mobile device 100 may learn various patterns of feedback signals modified by the user. For example, the user may perform a specific input and designate a function to be executed in response to the specific input. The mobile device 100 may receive a feedback signal modified according to the specific input and extract third PCM data from the modified feedback signal. The mobile device 100 may store a function to be executed in response to the specific input and mapping information of the third PCM data. A plurality of different patterns of feedback signals may be mapped to a plurality of different functions. After user authentication is performed, the processor 110 of the mobile device 100 may be configured to execute a specific function corresponding to the modified feedback signal when receiving a modified feedback signal according to a specific input.

5 is a flowchart of a user authentication method according to various embodiments of the present disclosure.

Referring to FIG. 5, a method of performing authentication according to an embodiment may include operations 510 to 550. The operations 510 to 550 may be performed or executed by, for example, the processor 110 of the mobile device 100 illustrated in FIG. 1B. Operations 520 to 540 may correspond to operations 210 to 230 of FIG. 2. Hereinafter, in the description of FIG. 5, descriptions overlapping with those of FIGS. 1B and 2 may be omitted.

In operation 510, the mobile device 100 (eg, the processor 110 of FIG. 1B) may receive a user input. For example, the user input may be an execution command for a function requiring user authentication. In various embodiments, a user may input a speech into the mobile device 100 to call a voice recognition service. The mobile device 100 may perform user authentication before executing a voice recognition service in response to a speech input.

In operation 520, the mobile device 100 may output a sound signal using an external device connected to the mobile device 100 in response to the user input. For example, the external device may be referred to as an earphone (eg, the sound output device 200 of FIG. 1B ). In various embodiments, the mobile device 100 may output a sound signal through an external device in order to authenticate a user wearing an external device.

In operation 530, the mobile device 100 may acquire a sound signal in which the output sound signal is reflected on a part of the user using an external device. For example, a sound signal output through the earphone may be reflected from the user's ear canal.

In operation 540, the mobile device 100 may perform user authentication using the reflected sound signal. The sound signal reflected from the user may have a unique pattern for each user. The mobile device 100 may perform user authentication by comparing a previously stored pattern with the obtained sound signal.

For example, the mobile device 100 may extract PCM data from the reflected sound signal using the A/D converter 132. The processor 110 of the mobile device 100 may compare the extracted PCM data with pre-stored PCM data (eg, authentication data in Table 1). If both match, authentication for a user corresponding to the previously stored PCM data may be completed.

In operation 550, when user authentication is completed, the mobile device 100 may execute a designated function in a state in which the mobile device 100 is unlocked. The designated function may be referred to as, for example, a function corresponding to a user input received in operation 510. In various embodiments, the mobile device 100 may execute a voice input service.

In operation 550 according to various embodiments of the present disclosure, the mobile device 100 may obtain a voice input for performing a specific function from a user. The mobile device 100 may transmit the voice input or text data corresponding to the voice input to an external device (eg, a server). For example, the mobile device 100 may include an automatic speech recognition (ASR) module. The mobile device 100 may convert voice input into text data using the ASR module. The external device may generate a command related to the specific function by using the received voice input or text data. The external device may transmit the generated command to the mobile device 100. The mobile device 100 may execute the specific function based on the command.

6 is a sequence diagram illustrating a user authentication method according to various embodiments of the present disclosure.

The mobile device 100 (eg, the mobile device 100 of FIG. 1B) may be referred to as, for example, a smart phone. The sound output device 200 does not have a separate microphone therein, and may be referred to as an earphone 200 in which a speaker is used as a microphone. For example, a scenario in which the user 50 wearing the earphone 200 executes a voice assistant program will be described as an example. The voice assistant program may be referred to as a program that processes a control command input by the user 50's utterance.

In an embodiment, the mobile device 100 may be in a locked state (601 ). The user 50 may connect the earphone 200 to the mobile device 100 and wear the earphone 200 (603). The mobile device 100 may transmit a test signal to the earphone 200 in the locked state 603 (605). The mobile device 100 may transmit a test signal to the earphone 200 every predetermined period. The mobile device 100 may receive a feedback signal from the earphone 200 (607 ).

In an embodiment, the mobile device 100 may determine whether the user 50 is a pre-registered user based on the received feedback signal (user authentication operation) 609. When the user 50 is a pre-registered user (authentication success), the mobile device 100 may be unlocked (611). The user 50 may use the mobile device 100 without additional authentication operations (eg, password input, fingerprint input, utterance input for security phrases, etc.). Through this authentication process, a program that provides an artificial intelligent service, such as a voice assistant program, can provide an intuitive and fast service.

In an embodiment, the user 50 may perform an input operation to execute a function of the earphone 200 (613). For example, the user 50 may perform a predetermined two tap operation to execute the voice assistant program. The input circuit 230 of the earphone 200 receives an input (615), and the mobile device 100 may receive a feedback signal modified by the input (617).

In an embodiment, the mobile device 100 may execute a function corresponding to the modified feedback (619 ). For example, the mobile device 100 may execute a voice assistant program mapped with the feedback signal transformed by the second tap operation.

In an embodiment, the mobile device 100 may perform user authentication for a function to be executed (621 ). For example, the function may require user authentication for execution. The mobile device 100 may perform user authentication in response to the request. The mobile device 100 may perform authentication for the function based on the already completed user authentication 609. Alternatively, the mobile device 100 may transmit a feedback signal again from the earphone 200 and perform authentication.

For example, a voice assistant program can be executed to request user authentication. When the authentication of the user 50 for the voice assistant program is completed, the user 50 can use the voice assistant program.

In various embodiments, a program requiring user authentication may include a first mode that is executed when there is no user authentication and a second mode that is executed when the user's authentication is completed. In the first mode, some functions of the program may be restricted for security.

For example, the voice assistant program may be executed first in a first mode (eg, a normal mode). When the voice assistant program is executed in the first mode, some of the commands of the user 50 may be restricted for security. When user authentication is completed, the voice assistant program may be switched to a second mode (eg, a master mode). The user 50 may use the mobile device 100 and other programs without limitation by wearing the earphone 200 without performing separate operations for authentication (eg, password input, fingerprint authentication, and security phrase utterance).

In one embodiment, the mobile device 100 may detect the detachment of the earphone 200. The mobile device 100 may periodically transmit a test signal to the earphone 200 (623) and receive a feedback signal corresponding to the test signal (625). The mobile device 100 may detect that the earphone 200 is not worn by the user 50 from the feedback signal (627 ). Alternatively, the mobile device 100 may receive a report of the user's non-wearing state from the earphones 200. When the mobile device 100 detects a state in which the earphone 200 is not worn by the authenticated user 50, the authentication for the different function is released and the mobile device 100 may be set to lock (628).

Meanwhile, the present invention may further include a press detection device 1100. The press detection device 1100 may include first plates 1110, second plates 1120, and third plates 1130 therein. The first plates 1110 are arranged at regular intervals and connected to each other at the ends and current flows, and the second plates 1120 are arranged at regular intervals, located between the first plates and connected to each other at the ends. Flows. The third plate 1130 is made of an elastic body through which a current flows, and is positioned above the first plates and the second plates. As the third plate 1130 is pressed and elastically deformed, the resistance between the first plates 1110 and the second plates 1120 is changed. Pressing can be detected by this resistance change.

A mobile device according to various embodiments disclosed in this document may be a device of various types. The mobile device may include at least one of, for example, a portable communication device (eg, a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The mobile device according to the embodiment of the present document is not limited to the above-described devices.

Various embodiments of the present document and terms used therein are not intended to limit the technology described in this document to a specific embodiment, and should be understood to include various modifications, equivalents, and/or substitutes of the corresponding embodiment. In connection with the description of the drawings, similar reference numerals may be used for similar elements. Singular expressions may include plural expressions unless the context clearly indicates otherwise. In this document, expressions such as "A or B", "at least one of A and/or B", "A, B or C" or "at least one of A, B and/or C" are all of the items listed together. It can include possible combinations. Expressions such as "first", "second", "first" or "second" can modify the corresponding elements regardless of their order or importance, and are only used to distinguish one element from another. The components are not limited. When any (eg, first) component is referred to as being “(functionally or communicatively) connected” or “connected” to another (eg, second) component, the component is It may be directly connected to the component, or may be connected through another component (eg, a third component).

The term "module" used in this document includes a unit composed of hardware, software, or firmware, and may be used interchangeably with terms such as, for example, logic, logic blocks, parts, or circuits. The module may be an integrally configured component or a minimum unit that performs one or more functions, or a part thereof. For example, the module may be configured as an application-specific integrated circuit (ASIC).

Various embodiments of the present document include instructions stored in a machine-readable storage media (eg, internal memory 736 or external memory 738). It may be implemented in software (for example, the program 740). The device is a device capable of calling a stored command from a storage medium and operating according to the called command, and may include a mobile device (eg, a mobile device 701) according to the disclosed embodiments. When the command is executed by a processor (for example, the processor 720), the processor may perform a function corresponding to the command directly or by using other components under the control of the processor. Instructions may include code generated or executed by a compiler or interpreter. A storage medium that can be read by a device may be provided in the form of a non-transitory storage medium. Here, "non-transitory" means that the storage medium does not contain signals and is tangible, but does not distinguish between semi-permanent or temporary storage of data in the storage medium.

According to an example, the method according to various embodiments disclosed in the present document may be provided by being included in a computer program product. Computer program products can be traded between sellers and buyers as commodities. The computer program product may be distributed online in the form of a device-readable storage medium (eg, compact disc read only memory (CD-ROM)) or through an application store (eg, Play Store ^{TM ).} In the case of online distribution, at least some of the computer program products may be temporarily stored or temporarily generated in a storage medium such as a server of a manufacturer, a server of an application store, or a memory of a relay server.

Each of the constituent elements (eg, a module or a program) according to various embodiments may be composed of a singular or a plurality of entities, and some sub-elements of the above-described sub-elements are omitted, or other sub-elements are It may be further included in various embodiments. Alternatively or additionally, some constituent elements (eg, a module or a program) may be integrated into a single entity, and functions performed by each corresponding constituent element prior to the consolidation may be performed identically or similarly. Operations performed by modules, programs, or other components according to various embodiments are sequentially, parallel, repetitively or heuristically executed, at least some operations are executed in a different order, omitted, or other operations are added. Can be.

Claims (5)

In the method performed by a mobile device,
Transmitting a test signal to a sound output device connected to the mobile device through a wired interface for a predetermined time, and receiving a feedback signal corresponding to the test signal from the sound output device;
Unlocking the mobile device in a locked state when the user wearing the sound output device indicates that the user wearing the sound output device is a registered user of the mobile device based on the received feedback signal and user authentication information; And
And if the user wearing the sound output device is not a registered user of the mobile device, based on the received feedback signal and user authentication information, photographing the user and transmitting an image to a predetermined terminal. Way. The method of claim 1,
When a program requiring user authentication is executed, and based on the received feedback signal and user authentication information, when the user wearing the sound output device indicates that the user is a registered user of the mobile device, the program in an unauthenticated state The method further comprising the step of changing to the authenticated state. The method of claim 2,
When the sound output device detects a state that is not worn by the authenticated user, locking the mobile device in the unlocking state, and changing the authenticated program to an unauthenticated state. How to characterize. The method of claim 1,
And obtaining PCM data corresponding to the received feedback signal, and comparing the PCM data with the user authentication information. The method of claim 4,
And locking the mobile device in the unlocked state when the sound output device detects a state in which the sound output device is not worn by the authenticated user.

Images