KR102228579B1 - Electronic device that authenticates the user of a drone based on biometric information and method for operation thereof - Google Patents

Abstract

The present invention relates to an electronic device for performing user authentication of a drone based on biometric information and to a method thereof. The biometric information of the user is stored only on the electronic device of the user. The drone makes a user authentication request to the user electronic device using data sensed by a part of the body of the user, and, when the user authentication is successful, the connection between the drone and the user electronic device is completed, a control command can be transmitted and received.

Description

An electronic device that authenticates the user of a drone based on biometric information and its operation method {ELECTRONIC DEVICE THAT AUTHENTICATES THE USER OF A DRONE BASED ON BIOMETRIC INFORMATION AND METHOD FOR OPERATION THEREOF}

It relates to an electronic device that performs user identification of a drone based on biometric information and its operation method, and more specifically, a user identification of the drone in the user electronic device using the user's body data value sensed by the drone. It relates to electronic devices.

Recently, drones have been widely used in various fields, from personal hobbies to industrial use and military use. For example, a delivery company can use a drone to deliver goods, a military official can use a drone to search a military area, and an individual can use a drone to shoot a user's image with a camera. Since drones for various purposes are developed and used for various purposes, it is not known by whom the drone in flight is controlled and for what purpose. In addition, there is a risk that the drone will be manipulated by other people, and it is necessary to identify the person who operated the drone in the event of an accident caused by the drone.

According to embodiments, a user for controlling a drone may perform user identification based on biometric information. Based on the biometric information, the user whose identity verification is completed controls the flight of the drone to prevent the operation of the drone by others, and can identify the actual user who controls the drone in an emergency.

According to one side, a user electronic device, comprising: a wireless communication circuit, at least one processor electrically connected to the wireless communication circuit, and a memory electrically connected to the at least one processor, wherein the memory is a first It includes biometric information and information about the drone, and the at least one processor checks whether the first data received from the drone and the first biometric information match using the wireless communication circuit, and the wireless communication circuit Authentication result data indicating whether the first data and the first biometric information match may be transmitted to the drone.

In one embodiment, the first biometric information is fingerprint information, gene (DNA) information, body skeleton information, hand shape information, retina information, iris information, facial information, vein information, electrocardiogram information, font information, gait information, It may include any one or more of signature information, blood vessel information, sweat gland structure information, voice information, and biomolecule information.

In an embodiment, the user electronic device includes a camera module or a sensor module, and the one or more processors may generate the first biometric information based on data sensed by the user's body using the camera module or the sensor module. Acquire, and the memory may store the first biometric information in a secure area.

In one embodiment, an input/output device may be further included, and a flight control value of the drone operated by the user may be acquired using the input/output device, and the control value may be transmitted to the drone using the wireless communication circuit. .

In one embodiment, one or more flight condition data related to the flight of the drone is received from the drone using the wireless communication circuit, and the one or more processors determine a flight control value of the drone based on the flight condition data. And transmits the control value to the drone using the wireless communication circuit.

In one embodiment, when the first data and the first biometric information match, in response to receiving a connection request from the drone using the wireless communication circuit, identification information of the drone and of the user electronic device The first identifier including at least some of the identification information may be shared with the drone.

In an embodiment, in response to receiving data including the first identifier using the wireless communication circuit, it may be confirmed that data has been received from the drone.

In an embodiment, user identification may be processed through a backup electronic device according to a battery state of the user electronic device.

In one embodiment, the battery state of the user electronic device is checked in real time, and personal information of the user is transmitted to the backup electronic device in response to the battery state being smaller than a predetermined reference value, and the battery of the user electronic device In response to a state equal to or greater than the predetermined reference value, a deletion request message for the user's personal information is transmitted to the backup electronic device, and the personal information may include at least part of the user's biometric information. .

In an embodiment, while the battery state of the user electronic device is less than the predetermined reference value, the backup electronic device may instead perform the identity authentication based on the personal information.

In an embodiment, the backup electronic device may permanently delete personal information in a memory according to a deletion request from the user electronic device.

According to another aspect, in the drone, the input/output device, a sensor module, a camera module, a wireless communication circuit, and the input/output device, the sensor module, the camera module, and one or more processors electrically connected to the wireless communication circuit, , The at least one processor acquires raw data by sensing the body of the first user by using the sensor module or the camera module, and acquires identification information on the user electronic device of the first user by using the input/output device. And, based on the identification information of the user electronic device of the first user, the user electronic device of the first user is specified, and the wireless communication circuit transmits the raw data to the user electronic device of the first user, The at least one processor sends a connection request for a wireless communication connection for transmitting and receiving a control command related to a flight based on the authentication success data received from the user electronic device of the first user using the wireless communication circuit. It can be transmitted to the user's electronic device.

In an embodiment, a connection request from another electronic device may be ignored while wireless communication for transmitting and receiving a control command related to the flight is connected to the user electronic device of the first user who has successfully authenticated the user.

In an embodiment, the raw data may be deleted after being transmitted to the user electronic device of the first user.

In an embodiment, a first identifier including at least some of the identification information of the drone and the identification information of the user electronic device of the first user may be shared with the user electronic device.

In an embodiment, in response to receiving data including the first identifier using the wireless communication circuit, it may be confirmed that data has been received from the user electronic device of the first user.

According to embodiments, the user who operates the drone can be clearly identified by authenticating the user based on the user's biometric information in order to control the drone, and it is practically impossible to control the drone by another person. The biometric information of the user who controls the drone is stored only on the user's electronic device to enhance personal information security, and the data related to the user's body acquired from the drone is not stored, but deleted, so that personal information can be doubled.

1 is a network environment including a drone and a user electronic device that authenticates a user of a drone using biometric information according to an embodiment.
FIG. 2 is a block diagram of a drone and a user electronic device that authenticates a pilot of a drone based on biometric information, according to an exemplary embodiment.
3 is a sequence diagram illustrating an operation of performing identity authentication in a user electronic device using a user's face image captured by a drone according to an embodiment.
4 is an example of a user manipulation of a drone connected to a user electronic device for which identity authentication has been completed using biometric information according to an embodiment.
5 is an example of a method of blocking a connection with another electronic device by a drone connected to a user electronic device for which identity authentication has been completed using biometric information, according to an exemplary embodiment.
6 is an example of a transmission data structure between a user electronic device and a connected drone for which identity authentication has been completed using biometric information according to an embodiment.
7 is a sequence diagram illustrating an operation of authenticating an identity through a backup electronic device according to an embodiment.
8 is a flowchart of a method of setting a backup electronic device in a user electronic device according to an exemplary embodiment.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. However, the scope of the rights is not limited or limited by these embodiments. The same reference numerals shown in each drawing indicate the same members.

The terms used in the description below have been selected as general and universal in the related technology field, but there may be other terms depending on the development and/or change of technology, preference of customary technicians, and the like. Therefore, terms used in the following description should not be understood as limiting the technical idea, but should be understood as illustrative terms for describing embodiments.

In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, detailed meanings will be described in the corresponding description. Therefore, terms used in the following description should be understood based on the meaning of the term and the contents throughout the specification, not just the name of the term.

1 is a network environment including a user electronic device 200 and a drone 100 that have performed user identification of the drone 100 using biometric information according to an embodiment. The drone 100 is also referred to as an unmanned aerial vehicle (UAV), and refers to an airplane or helicopter-shaped vehicle that is flying by induction of radio waves without humans. In one embodiment, a user (or referred to as a pilot) for controlling the drone 100 performs self-authentication prior to manipulating the drone 100, thereby preventing others from manipulating his or her drone 100, and It has the effect of being able to identify the pilot of the drone 100 in an emergency.

The drone 100 according to an embodiment transmits the sensed body data by using the data sensed by the body part of the user 1 to transmit the sensed body data to the user electronic device 200 of the user 1. You can request identity verification. The drone 100 may physically include or be electrically connected to one or more sensor modules, camera modules, and the like in order to sense a part of the sensor body of the user 1. In response to the request of the drone 100, the user electronic device 200 of the user 1 compares the body data received from the drone 100 with the biometric information of the user 1 stored in the memory to determine whether it is the person. I can. The user electronic device 200 may include the user's biometric information in a memory. In various embodiments, the user's biometric information is fingerprint information, gene (DNA) information, body skeleton information, hand shape information, retina information, iris information, facial information, vein information, electrocardiogram information, font information, gait information, signature It may include any one or more of information, blood vessel information, sweat gland structure information, voice information, and biomolecule information.

The user electronic device 200 may transmit an identity authentication result to the drone 100. In response to receiving the identity authentication success message, the drone 100 may execute a series of control commands for connection with the user electronic device 200. In various embodiments, the connection between the drone 100 and the user electronic device 200 according to user identification may represent a wireless communication connection capable of transmitting and receiving a series of commands for controlling the flight of the drone 100. . The drone 100 may ignore a connection request from another electronic device during connection with the user electronic device 200 for which identity authentication has been completed. In various embodiments, in order to establish a new one-to-one connection with another electronic device, the drone 100 may require identity authentication for a user of another electronic device. In response to receiving the identity authentication failure message, the drone 100 may output a warning sound indicating identity authentication failure or may additionally output a voice message for requesting re-authentication to the user 1.

The user electronic device 200 whose identity authentication has been completed may receive a wireless communication connection request from the drone 100 and establish a wireless communication connection capable of transmitting and receiving a series of commands for controlling the flight of the drone 100. In order to control the flight of the drone 100, the user electronic device 200 may transmit a control command according to the operation of the user 1 to the drone 100, and the current flight position and flight status from the drone 100 The same information data can be received. For example, the user electronic device 200 may transmit a control command related to a flight speed, a flight direction, a flight altitude, or a flight destination location to the drone 100. The drone 100 may transmit a current flight speed, a current location, or data related to the current location to the user electronic device 200.

FIG. 2 is a block diagram of a drone 100 and a user electronic device 200 that perform identification of a drone pilot based on biometric information according to an exemplary embodiment.

The drone 100 may include a wireless communication circuit 110, a processor 120, a memory 130, an input/output device 140, a camera module 150, and a sensor module 160, each of which is physically It may be included in the drone 100 to operate, or may be connected by wire or wirelessly to operate organically. For example, the sensor module 160 may be connected to the processor 120 by wire to transmit the sensed body data to the processor 120, and the processor 120 transmits a body data acquisition request to the sensor module 160. I can. Although the configuration related to the flight of the drone 100 is not shown in FIG. 2, it is obvious that detailed configurations related to the flight of the drone 100 may be included.

The wireless communication circuit 110 may establish communication between the drone 100 and an external device (eg, the user electronic device 200 or a server (not shown)). Wireless communication is, for example, LTE, LTE-A (LTE Advance), CDMA (code division multiple access), WCDMA (wideband CDMA), UMTS (universal mobile telecommunications system), WiBro (Wireless Broadband), or GSM (Global System for Mobile Communications) and the like may include cellular communication using at least one of. According to an embodiment, wireless communication is, for example, WiFi (wireless fidelity), Bluetooth, Bluetooth low power (BLE), Zigbee, near field communication (NFC), magnetic secure transmission, radio It may include at least one of a frequency (RF) and a body area network (BAN). According to one embodiment, wireless communication may include GNSS. The GNSS may be, for example, a Global Positioning System (GPS), a Global Navigation Satellite System (Glonass), a Beidou Navigation Satellite System, or Galileo, the European global satellite-based navigation system.

The processor 120 may include one or more of a central processing unit, an application processor, and a communication processor (CP). The processor 120 may control at least one other component of the drone 100 and/or perform an operation or data processing related to communication.

The memory 130 may include volatile and/or nonvolatile memory. The memory 130 may store commands or data related to at least one other component of the drone 100, for example. According to an embodiment, the memory 130 may store software and/or programs. The program may include, for example, a kernel, middleware, an application programming interface (API), and/or an application program (or "application"). The memory 130 may include, for example, an internal memory or an external memory. Built-in memory is, for example, volatile memory (e.g., DRAM, SRAM, or SDRAM), non-volatile memory (e.g., OTPROM (one time programmable ROM), PROM, EPROM, EEPROM, mask ROM, flash ROM, flash memory) , A hard drive, or a solid state drive (SSD) The external memory may include a flash drive, for example, compact flash (CF), secure digital (SD), micro-SD, It may include mini-SD, xD (extreme digital), MMC (multi-media card), memory stick, etc. The external memory may be functionally or physically connected to the drone 100 through various interfaces.

The input/output device 140 may include, for example, a touch panel, a (digital) pen sensor, a keyboard device, a mouse device, a key, an ultrasonic input device, a display, or an audio module. The touch panel may use at least one of, for example, a capacitive type, a pressure sensitive type, an infrared type, or an ultrasonic type. The (digital) pen sensor may be, for example, a part of a touch panel or may include a separate recognition sheet. The key may include, for example, a hardware button, an optical key, or a keypad. The keyboard device and the mouse device may operate by being connected to the processor 120 by wire or wirelessly. The ultrasonic input device may detect ultrasonic waves generated by an input tool through a microphone, and check data corresponding to the sensed ultrasonic waves. The display may include a panel, a holographic device, a projector, and/or a control circuit for controlling them. The panel may be implemented to be flexible, transparent, or wearable, for example. According to an embodiment, the panel may include a pressure sensor (or force sensor) capable of measuring the intensity of pressure for a user's touch. The hologram device can show a three-dimensional image in the air by using interference of light. The projector can display an image by projecting light onto the screen. The screen may be located inside or outside the drone 100, for example. The audio module may convert, for example, a sound and an electric signal bidirectionally. The audio module may process sound information input or output through, for example, a speaker, a receiver, an earphone, or a microphone.

The camera module 150 is, for example, a device capable of photographing still images and moving pictures, and according to an embodiment, one or more image sensors (eg, a front sensor or a rear sensor), a lens, an image signal processor (ISP) , Or a flash (eg, LED or xenon lamp). The camera module 150 may include a plurality of camera devices, and each camera device may be installed at a plurality of locations of the drone 100.

The sensor module 160 may measure a physical quantity or detect an operating state of the drone 100, for example, and convert the measured or sensed information into an electric signal. The sensor module 160 includes, for example, a speed sensor, a temperature sensor, a GPS, a gesture sensor, a biometric sensor, an e-nose sensor, an electromyography (EMG) sensor, and an electroncpalogram (EEG). ) Sensor, an electrocardiogram (ECG) sensor, an infrared (IR) sensor, an iris sensor, and/or a fingerprint sensor. The sensor module 160 may further include a control circuit for controlling at least one or more sensors included therein. In some embodiments, the drone 100 further includes a processor configured to control the sensor module 160 as part of the processor 120 or separately, while the processor 120 is in a sleep state, the sensor The module 160 can be controlled.

Referring to FIG. 2, a user electronic device 200 according to various embodiments includes a wireless communication circuit 210, a processor 220, a memory 230, an input/output device 240, a camera module 250, and a sensor module. It may include (260).

The wireless communication circuit 210 may establish communication between the user electronic device 200 and an external device (eg, the drone 100 or a server (not shown)). The wireless communication circuit 210 may be implemented in the same manner as the wireless communication circuit 210 of the drone 100.

The processor 220 may include one or more of a central processing unit, an application processor, and a communication processor (CP). The processor 120 may control at least one other component of the user electronic device 200 and/or perform an operation or data processing related to communication.

The memory 230 may include volatile and/or nonvolatile memory. The memory 230 may store, for example, a command or data related to at least one other component of the user electronic device 200. According to an embodiment, the memory 230 may store software and/or programs. The program may include, for example, a kernel, middleware, an application programming interface (API), and/or an application program (or "application"). The memory 230 may include, for example, an internal memory or an external memory. Built-in memory is, for example, volatile memory (e.g., DRAM, SRAM, or SDRAM), non-volatile memory (e.g., OTPROM (one time programmable ROM), PROM, EPROM, EEPROM, mask ROM, flash ROM, flash memory) , A hard drive, or a solid state drive (SSD) The external memory may include a flash drive, for example, compact flash (CF), secure digital (SD), micro-SD, It may include a mini-SD, xD (extreme digital), a multi-media card (MMC), a memory stick, etc. The external memory may be functionally or physically connected to the user electronic device 200 through various interfaces.

The input/output device 240 may include, for example, a touch panel, a (digital) pen sensor, a key, a keyboard device, a mouse device, an ultrasonic input device, a display, or an audio module. The touch panel may use at least one of, for example, a capacitive type, a pressure sensitive type, an infrared type, or an ultrasonic type. The (digital) pen sensor may be, for example, a part of a touch panel or may include a separate recognition sheet. The key may include, for example, a hardware button, an optical key, or a keypad. The keyboard device and the mouse device may be connected to the processor 220 by wire or wirelessly to operate. The ultrasonic input device may detect ultrasonic waves generated by an input tool through a microphone, and check data corresponding to the sensed ultrasonic waves. The display may include a panel, a holographic device, a projector, and/or a control circuit for controlling them. The panel may be implemented to be flexible, transparent, or wearable, for example. According to an embodiment, the panel may include a pressure sensor (or force sensor) capable of measuring the intensity of pressure for a user's touch. The hologram device can show a three-dimensional image in the air by using interference of light. The projector can display an image by projecting light onto the screen. The screen may be located inside or outside the user electronic device 200, for example. The audio module may convert, for example, a sound and an electric signal bidirectionally. The audio module may process sound information input or output through, for example, a speaker, a receiver, an earphone, or a microphone.

The camera module 250 is, for example, a device capable of photographing still images and moving pictures, and according to an embodiment, one or more image sensors (eg, a front sensor or a rear sensor), a lens, an image signal processor (ISP) , Or a flash (eg, LED or xenon lamp).

The sensor module 260 may measure a physical quantity or detect an operating state of the user electronic device 200, for example, and convert the measured or sensed information into an electric signal. The sensor module 260 includes, for example, a gesture sensor, a biometric sensor, an e-nose sensor, an electromyography (EMG) sensor, an electroncpalogram (EEG) sensor, and an electrocardiogram (ECG) sensor. , An infrared (IR) sensor, an iris sensor, and/or a fingerprint sensor. The sensor module 260 may further include a control circuit for controlling at least one or more sensors included therein. In some embodiments, the user electronic device 200 further includes a processor configured to control the sensor module 260 as part of the processor 220 or separately, while the processor 220 is in a sleep state. , It is possible to control the sensor module 260.

The user electronic device 200 includes first biometric information about the user and information about the drone in the memory 230, and the processor 220 receives the information received from the drone 100 using the wireless communication circuit 210. 1 Checks whether data and the first biometric information match, and the wireless communication circuit 210 transmits authentication result data on whether the first data and the first biometric information match to the drone 100 I can.

The first biometric information includes fingerprint information, gene (DNA) information, body skeleton information, hand shape information, retina information, iris information, facial information, vein information, electrocardiogram information, font information, gait information, signature information, blood vessel information , Sweat gland structure information, voice information, and biomolecule information.

The processor 220 acquires the first biometric information based on data sensed by the camera module 250 or the sensor module 260 of the user's body, and the memory 230 stores the first biometric information. It can be stored in a secure area.

The processor 220 acquires the flight control value of the drone 100 operated by the user using the input/output device 240 and transfers the control value to the drone 100 using the wireless communication circuit 210. Can be transferred to.

The processor 220 receives one or more flight status data related to the flight of the drone 100 from the drone 100 using the wireless communication circuit 210, and based on the flight status data, the A flight control value may be calculated, and the control value may be transmitted to the drone 100 using the wireless communication circuit 210.

When the first data and the first biometric information match, the processor 220 responds to receiving a connection request from the drone 100 using the wireless communication circuit 210, and the drone 100 A first identifier including at least some of the identification information of the user electronic device 200 and the identification information of the user electronic device 200 may be shared with the drone 100.

In response to receiving data including the first identifier by using the wireless communication circuit 210, the processor 220 may confirm that data has been received from the drone 100.

The processor 220 may process user identification through the backup electronic device according to the state of the battery of the user electronic device 200.

The processor 220 checks the battery state of the user electronic device 200 in real time, and transmits the user's personal information to the backup electronic device in response to the battery state becoming smaller than a predetermined reference value, and the user electronic device In response to the battery state of 200 being greater than or equal to the predetermined reference value, a deletion request message for the user's personal information is transmitted to the backup electronic device, and the personal information is at least part of the user's biometric information. It may include.

The processor 220 may allow the backup electronic device to perform the identity authentication on the basis of the personal information while the battery state of the user electronic device 200 is less than the predetermined reference value.

The backup electronic device may permanently delete personal information in the memory according to the deletion request of the user electronic device 200.

The processor 120 of the drone 100 acquires raw data by sensing the body of the first user using the sensor module 160 or the camera module 150, and uses the input/output device 140 to obtain the raw data. Acquiring identification information on the user electronic device 200 of the first user, and specifying the user electronic device 200 of the first user based on the identification information on the user electronic device 200 of the first user And, the wireless communication circuit 110 transmits the raw data to the user electronic device 200 of the first user, and the one or more processors 120 use the wireless communication circuit 110 to transmit the first data. Based on the authentication success data received from the user's electronic device 200, a connection request for a wireless communication connection for transmitting and receiving a control command related to a flight may be transmitted to the user electronic device 200 of the first user. .

The processor 120 may ignore a connection request from another electronic device while wireless communication for transmitting and receiving a control command related to the flight is connected to the user electronic device 200 of the first user who has successfully authenticated the user.

The processor 120 may delete the raw data without storing it in the memory 130 after transmitting the raw data to the user electronic device of the first user.

The processor 120 may share a first identifier including at least some of the identification information of the drone 100 and the identification information of the user electronic device 200 of the first user with the user electronic device 200. .

In response to receiving data including the first identifier using the wireless communication circuit 110, the processor 220 may determine that data has been received from the user electronic device 200 of the first user.

3 is a sequence diagram illustrating an operation of performing identity authentication in the user electronic device 200 using a user face image captured by the drone 100 according to an embodiment.

In step S301, the user electronic device 200 may generate the user's biometric information related to the body of the user who is a pilot using the camera module 250 or the sensor module 260 and include it in the memory 230. In various embodiments, the biometric information includes fingerprint information, gene (DNA) information, body skeleton information, hand shape information, retina information, iris information, facial information, vein information, electrocardiogram information, font information, gait information, signature information, It may include any one or more of blood vessel information, sweat gland structure information, voice information, and biomolecule information. The facial information may include, for example, a face image itself, and may include information obtained by extracting a specific vector value from the face image. The user electronic device 200 may encrypt the user's biometric information and store it in the secure area of the memory 230.

In step S302, the drone 100 may detect a user who is close to the drone 100, and determine that the close user is a person to control the drone 100. When the connection with the user's electronic device 200 for which identity authentication has been completed is not valid, the drone 100 may wait in a ready state to perform identity authentication for a user close to the drone 100. When the connection with the user electronic device 200 for which identity authentication has been completed is valid, the drone 100 may wait in a blocked state to reject identity authentication for a user close to the drone 100, and in the blocked state, the drone 100 When a person close to) is detected, a notification about the proximity of the person may be transmitted to the user electronic device 200 for which identity authentication has been completed.

In step S303, while the drone 100 is waiting in a ready state, the camera module 150 may use the camera module 150 to capture a face of a nearby user. The drone 100 may acquire data that senses a part of the user's body in order to request identity verification, but may delete it without storing it in the memory 130. By not storing the user's body data acquired by the drone 100 in the memory 130 of the drone 100, security for the user's biometric information may be enhanced. The biometric information of a user who wants to control the drone 100 may be stored only in the memory 230 of the user electronic device 200 directly managed and controlled by the user. For example, the camera module 150 of the drone 100 does not transfer an image of a close user's face to the memory 130, but the user through the wireless communication circuit 110 as the captured raw (RAW) data. It may be transmitted to the electronic device 200, and the raw data may be deleted by the camera module 150 after being transmitted to the user electronic device 200.

In step S304, the drone 100 may request identity authentication to determine whether the user is the user while transmitting the photographed user's face image to the user electronic device 200. The drone 100 may acquire information about the user electronic device 200 using the input/output device 140. For example, the drone 100 may specify the user electronic device 200 based on a mobile phone number input through the input/output device 140.

In step S305, the user electronic device 200 may determine whether the user is the person by comparing the received face image with biometric information stored in the memory 230. When it is confirmed that the received user's face image matches the stored biometric information, the user electronic device 200 may determine that identity authentication has been successful. When it is determined that the received user's face image does not match the stored biometric information, the user electronic device 200 may determine that identity authentication has failed.

In step S306, when the user electronic device 200 successfully authenticates the user, the user electronic device 200 may transmit an authentication success message to the drone 100.

In step S307, in response to receiving the identity authentication success message, the drone 100 may execute a series of control commands for connection with the user electronic device 200. For example, the drone 100 may request a wireless communication connection to the user electronic device 200 including drone information related to flight. In various embodiments, the drone information may include one or more of drone identification information, product information, flight detail information, flight control command information, and wireless communication connection information.

In step S308, when the user's electronic device 200 fails to authenticate itself, the user electronic device 200 may transmit an authentication failure message to the drone 100.

In step S309, the drone 100 may output a notification sound or a notification message for requesting re-authentication in response to receiving the authentication failure message.

4 is an example of a user manipulation of a drone 100 connected to a user electronic device 200 for which identity authentication has been completed using biometric information according to an embodiment.

After the drone 100 is connected to the user electronic device 200 for which identity authentication has been completed based on the biometric information, the drone 100 may maintain a connection state and receive a control command from the user electronic device 200 in real time. The user electronic device 200 may receive information such as a current location, a current altitude, a current speed, wind speed, and a wind direction necessary for flight control from the drone 100. The user electronic device 200 may provide an application for flight control of the drone 100 so that the user 1 can easily control the movement of the drone 100. The user electronic device 200 may control the flight position, speed, or direction of the drone 100 by transmitting a control value input by the user 1 to the drone 100. The drone 100 may transmit one or more data sensed on the flight situation to the user electronic device 200 in real time, and the user electronic device 200 analyzes the data received in time to ensure correct flight of the drone 100. A control value for inducing may be calculated, and the calculated control value may be transmitted to the drone 100 again.

5 is an example of a method of blocking a connection to another electronic device 300 by a drone 100 connected to a user electronic device 200 for which identity authentication has been completed using biometric information, according to an exemplary embodiment.

The drone 100 is connected to the user electronic device 200 for which identity authentication is completed, receives a flight control command from the user electronic device 200, and establishes connection with other electronic devices in a normal connection state that transmits a flight situation. Can be blocked. The drone 100 may ignore the connection request from the other electronic device 300 when the connection with the user electronic device 200 that is already connected is in a normal state. Even when the drone 100 receives a user authentication request from the other electronic device 300, if the connection state with the user electronic device 200 is in a normal state, the drone 100 ignores it and sends another electronic device to the user electronic device 200. A message about a device's connection request can be transmitted.

The drone 100 may respond to a connection request from another electronic device 300 when the connection with the user electronic device 200 is disconnected, but the user of the other electronic device 300 is required to control the flight of the drone 100. Identity authentication is essential, and the drone 100 may transmit an identity authentication process for a new user to the other electronic device 300.

6 is an example of a transmission data structure between a user electronic device 200 and a connected drone 100 for which identity authentication has been completed using biometric information according to an embodiment.

The drone 100 may connect with the user electronic device 200 for which identity authentication has been completed, receive a flight control command, and transmit data related to a flight situation. In order to receive a control command only from the user electronic device 200, the drone 100 may identify that data received through wireless communication is transmitted by the user electronic device 200. The drone 100 and the user electronic device 200 may connect to each other and set the identifiers of each other after identity authentication is completed. The identifier may include identification information of the drone 100 or the user electronic device 200 itself. In various embodiments, the identifier may be set in various ways, may be encrypted for security, and may be changed at regular intervals. Referring to FIG. 6, when the user electronic device 200 and the drone 100 include identifier information between a data header and a body, first check the identifier information from data received through wireless communication, and the identifier is confirmed. Data is only available.

7 is a sequence diagram illustrating an operation of authenticating an identity through a backup electronic device according to an embodiment.

In step S701, the user electronic device 200 may store biometric information related to the user's body in the memory 230. The above step may correspond to step S301 of FIG. 3, and detailed descriptions will be repeated and omitted.

In step S702, the drone 100 may acquire data related to the body of a user in proximity. For example, the drone 100 may acquire an image of a user's face by using a camera device installed in the drone 100.

In operation S703, the user electronic device 200 may check the remaining battery power and compare the real-time remaining battery power with a set reference value. The reference value may be set by the user, for example, when the remaining battery capacity is less than 5%.

In step S704, if the user electronic device 200 determines that the real-time battery level is less than the reference value, the user's personal information may be transmitted to the backup electronic device 400. The user's personal information may include at least some of the user's biometric information. For example, facial information of the user's facial information, iris information, and voice information, which are biometric information stored in the memory of the user's electronic device 200, may be selected as the user's personal information.

In step S705, the backup electronic device 400 may store the received personal information in a memory. The backup electronic device 400 may encrypt personal information and store it in a secure area in a memory.

In operation S706, the drone 100 may transmit a photographed user's face image and an identity authentication request to the backup electronic device 400 while the remaining battery level of the user's electronic device 200 is less than the reference value.

In step S707, the backup electronic device 400 may determine whether the received face image matches the user's personal information. The backup electronic device 400 cannot determine whether the user is authenticated during the period T1 that does not include the user's personal information. The backup electronic device 400 receives personal information from the user electronic device 200 and, on behalf of the user electronic device 200, based on the user's personal information until a request to delete the personal information is received (section T2). You can determine whether you are authenticated.

In step S708, if it is determined that the received face image matches the user's personal information, the backup electronic device 400 may determine that identity authentication has been successful, and may transmit an identity authentication success message to the drone 100.

In step S709, the drone 100 may administer the new drug A in response to receiving the identity authentication success message.

In step S710, when it is determined that the received face image does not match the user's personal information, the backup electronic device 400 may determine that identity authentication has failed, and transmit an identity authentication failure message to the drone 100.

In step S711, the drone 100 may output a re-authentication request message in response to receiving an identity authentication failure message.

In step S712, when the real-time battery level becomes greater than or equal to the reference value, the user electronic device 200 may transmit a personal information deletion request to the backup electronic device 400.

In step S713, the backup electronic device 400 may permanently delete the user's personal information stored in the memory according to the personal information deletion request from the user electronic device 200. The backup electronic device 400 may physically delete the personal information in the memory in which the personal information is stored in consideration of security of the user's personal information. The backup electronic device 400 does not perform an identity authentication process after receiving a request to delete personal information (section T3).

8 is a flowchart of a method of setting a backup electronic device in a user electronic device according to an exemplary embodiment.

In step 801, the user electronic device 200 may select backup data based on the user's biometric information stored in the memory 230. The user electronic device 200 may select personal information including at least part of the biometric information as backup data. For example, the user electronic device 200 may select information related to the user's face recognition among the biometric information as personal information. The user electronic device 200 may determine the range of the backup data through the input/output device by the user's selection.

In step 803, the user electronic device 200 may set a reference value for processing identity authentication by the backup electronic device 400. The user electronic device 200 may set a reference value for the remaining amount of the battery. For example, the user electronic device 200 may set a case in which the remaining amount of the battery is less than 5% as the reference value. The user electronic device 200 may allow the backup electronic device 400 to process identity authentication while the remaining battery power is less than 5%.

In step 805, the user electronic device 200 may select the backup electronic device 400. The backup electronic device 400 may be determined by a user's selection. The backup electronic device 400 may be any one of other electronic devices owned by the user (eg, notebook, tablet, desktop, wearable electronic device, etc.). In various embodiments, the backup electronic device 400 may select an electronic device of another user related to the user in consideration of security of personal information. For example, an electronic device of a spouse of a user, an electronic device of a parent of the user, and an electronic device of a child of the user may be selected as the backup electronic device 400.

In step 807, the user electronic device 200 may connect to the selected backup electronic device 400 by wireless or wire. The user electronic device 200 may pre-define a set value so that the backup electronic device 400 may process a data backup request, a data deletion request, and an identity authentication processing request. For example, the user electronic device 200 may install an application in the connected backup electronic device 400 and store an operation of processing the user's identity based on personal information according to the identity authentication request. The backup electronic device 400 may receive the user authentication request and transmit the processed log data to the user electronic device 200 when the backup section ends.

The embodiments described above may be implemented as a hardware component, a software component, and/or a combination of a hardware component and a software component. For example, the devices, methods, and components described in the embodiments include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate (FPGA). array), programmable logic unit (PLU), microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications executed on the operating system. Further, the processing device may access, store, manipulate, process, and generate data in response to the execution of software. For the convenience of understanding, although it is sometimes described that one processing device is used, one of ordinary skill in the art, the processing device is a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that it may include. For example, the processing device may include a plurality of processors or one processor and one controller. In addition, other processing configurations are possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of these, configuring the processing unit to operate as desired or processed independently or collectively. You can command the device. Software and/or data may be interpreted by a processing device or, to provide instructions or data to a processing device, of any type of machine, component, physical device, virtual equipment, computer storage medium or device. , Or may be permanently or temporarily embodyed in a transmitted signal wave. The software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -A hardware device specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as one or more software modules to perform the operation of the embodiment, and vice versa.

As described above, although the embodiments have been described by the limited embodiments and drawings, various modifications and variations are possible from the above description to those of ordinary skill in the art. For example, the described techniques are performed in a different order from the described method, and/or components such as systems, structures, devices, circuits, etc. described are combined or combined in a form different from the described method, or other components Alternatively, even if substituted or substituted by an equivalent, an appropriate result can be achieved. Therefore, other implementations, other embodiments, and those equivalent to the claims also fall within the scope of the claims to be described later.

100: drone
200: user electronics
300: other user electronics
400: backup electronics
1: user

Claims (16)

In the user electronic device,
Wireless communication circuit;
One or more processors electrically connected to the wireless communication circuit; And
A memory electrically connected to the one or more processors
Including,
The memory includes first biometric information about a user and information about a drone,
The at least one processor checks whether the first data received from the drone and the first biometric information match using the wireless communication circuit,
The wireless communication circuit transmits authentication result data on whether the first data and the first biometric information match to the drone,
To process user identification through a backup electronic device according to the battery state of the user electronic device,
Check the battery state of the user electronic device in real time, and transmit personal information of the user to the backup electronic device in response to the battery state becoming smaller than a predetermined reference value,
In response to a battery state of the user electronic device being greater than or equal to the predetermined reference value, a deletion request message for the user's personal information is transmitted to the backup electronic device, and
The user electronic device, wherein the personal information includes at least part of the user's biometric information. The method of claim 1,
The first biometric information includes fingerprint information, gene (DNA) information, body skeleton information, hand shape information, retina information, iris information, facial information, vein information, electrocardiogram information, font information, gait information, signature information, blood vessel information , User electronic device including any one or more of sweat gland structure information, voice information, and biomolecule information. The method of claim 1,
The user electronic device includes a camera module or a sensor module,
The at least one processor acquires the first biometric information based on data sensed of the user's body using the camera module or the sensor module,
The memory is a user electronic device that stores the first biometric information in a secure area. The method of claim 1,
Further comprising an input and output device,
A user electronic device that acquires a flight control value of the drone manipulated by the user using the input/output device and transmits the control value to the drone using the wireless communication circuit. The method of claim 1,
Receiving one or more flight status data related to the flight of the drone from the drone using the wireless communication circuit,
The at least one processor calculates a flight control value of the drone based on the flight condition data, and transmits the control value to the drone using the wireless communication circuit. The method of claim 1,
When the first data and the first biometric information match, in response to receiving a connection request from the drone using the wireless communication circuit, at least some of the identification information of the drone and the identification information of the user electronic device A user electronic device that shares the first identifier including the drone with the drone. The method of claim 6,
In response to receiving data including the first identifier by using the wireless communication circuit, the user electronic device confirms that data has been received from the drone. delete delete The method of claim 1,
While the battery state of the user electronic device is less than the predetermined reference value, the backup electronic device performs the identity authentication instead based on the personal information. The method of claim 1,
The backup electronic device permanently deletes personal information in a memory according to a deletion request from the user electronic device. For drones,
Input and output devices;
Sensor module;
Camera module;
Wireless communication circuit; And
At least one processor electrically connected to the input/output device, the sensor module, the camera module, and the wireless communication circuit
Including,
The at least one processor acquires raw data by sensing the body of the first user using the sensor module or the camera module, and acquires identification information on the user electronic device of the first user using the input/output device , Specifying the user electronic device of the first user based on the identification information on the user electronic device of the first user,
The wireless communication circuit transmits the raw data to a user electronic device of the first user,
The at least one processor sends a connection request for a wireless communication connection for transmitting and receiving a control command related to a flight based on the authentication success data received from the user electronic device of the first user using the wireless communication circuit. To the user's user electronic device,
The user electronic device processes user identification through a backup electronic device according to the battery state of the user electronic device, and checks the battery state of the user electronic device in real time, and the battery state is less than a predetermined reference value. In response to loss, the user's personal information is transmitted to the backup electronic device, and the user's personal information is deleted from the backup electronic device in response to the battery state of the user electronic device being greater than or equal to the predetermined reference value. That is to send a request message, a drone. The method of claim 12,
A drone that ignores a connection request from another electronic device while a wireless communication for transmitting and receiving a control command related to the flight is connected to the user electronic device of the first user who has successfully authenticated the user. The method of claim 12,
A drone that is deleted after transmitting the raw data to a user electronic device of the first user. The method of claim 12,
A drone that shares a first identifier including at least a part of identification information of the drone and identification information of a user electronic device of the first user with the user electronic device. The method of claim 15,
In response to receiving data including the first identifier using the wireless communication circuit, the drone confirms that data has been received from the user electronic device of the first user.

Images