KR101629758B1 - Method and program with the unlock system of wearable glass device - Google Patents

Method and program with the unlock system of wearable glass device Download PDF

Info

Publication number
KR101629758B1
KR101629758B1 KR1020150042548A KR20150042548A KR101629758B1 KR 101629758 B1 KR101629758 B1 KR 101629758B1 KR 1020150042548 A KR1020150042548 A KR 1020150042548A KR 20150042548 A KR20150042548 A KR 20150042548A KR 101629758 B1 KR101629758 B1 KR 101629758B1
Authority
KR
South Korea
Prior art keywords
wearable device
user
pattern information
wearable
glass
Prior art date
Application number
KR1020150042548A
Other languages
Korean (ko)
Other versions
KR20160007342A (en
Inventor
한성철
엄정한
김진영
이경현
김대중
김석기
유철현
Original Assignee
넥시스 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 넥시스 주식회사 filed Critical 넥시스 주식회사
Priority to PCT/KR2015/007132 priority Critical patent/WO2016006949A1/en
Publication of KR20160007342A publication Critical patent/KR20160007342A/en
Application granted granted Critical
Publication of KR101629758B1 publication Critical patent/KR101629758B1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31—User authentication
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31—User authentication
    • G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31—User authentication
    • G06F21/36—User authentication by graphic or iconic representation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/015—Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02—Services making use of location information

Abstract

The present invention relates to a method of unlocking a wearable wearable device and a program thereof.
A method of unlocking a wearable wearable type wearable device according to an embodiment of the present invention includes: receiving (S100) input pattern information by the wearable wearable device; And resetting the device lock state by comparing the input pattern information with the setting pattern information (S200).
INDUSTRIAL APPLICABILITY According to the present invention, it is possible to prevent the use of a wearable wearable device without the consent of the user. In addition, the user can easily unlock the wearable wearable device. In addition, since the usage right can be given differently according to the user authentication method, the security level can be set differently for each user authentication method. In addition, different usage rights can be assigned to different users, so that a plurality of users can easily use a single glass-like wearable device. In addition, upon failure of the unlocking, the registered user is notified of the failure of the unlocking by SMS or e-mail, and the position information of the glass-like wearable device can be also provided, thereby preventing the loss of the wearable wearable device.

Description

TECHNICAL FIELD [0001] The present invention relates to a method and an apparatus for unlocking a wearable wearable device,

The present invention relates to a method and apparatus for unlocking a wearable device of a glass type, and more particularly, to an unlocking system and a method for unlocking a user by using a user authentication for use of a wearable device of a glass type.

Recently wearable devices are emerging. It has appeared in the form of glasses that are linked to smart phones, and some forms that can operate independently without a smartphone are also emerging.

In the case of a smart phone, a lock pattern is drawn on the display unit or the user is authenticated using a fingerprint recognition method to unlock the device. In the case of a glass-type wearable device, an unlocking method suited to the characteristics of the device is required.

An object of the present invention is to provide a method and apparatus for unlocking a wearable device of a glass type that compares previously stored user authentication pattern information with inputted user authentication pattern information according to various types of user authentication methods, .

According to another aspect of the present invention, there is provided a method of unlocking a wearable wearable type wearable device, the method comprising: receiving input pattern information from the wearable wearable device; And a step of comparing the input pattern information with the setting pattern information to cancel the device lock state, wherein the input pattern information is acquired by the user from the user or acquired by the external device, And the setting pattern information is pattern information previously stored in the wearable device.

The pattern information may be a combination of at least one of a voice pattern, an iris pattern, a blinking eye pattern, a heartbeat pattern, a pulse pattern, a palm pattern, a hand gesture pattern, or a head movement pattern.

The method may further include the steps of: And

And selecting a specific user authentication method from the user.

Further, the method may further include granting a limited use right to a function provided in the glass-like wearable device according to the user authentication method.

If the user corresponding to the specific setting pattern information corresponds to a user whose usage right of the glass-like wearable device is limited, And a step of granting a limited use right.

The method may further include applying the setting state corresponding to the authenticated user if the number of users storing the setting pattern information is two or more and the setting state is different according to the user, The setting state may include at least one of a used application, a user interface type, logged in account information, and stored data.

Further, the method may further include the step of notifying the registered user via wireless communication when the authentication of the user authentication fails a predetermined number of times or more.

The notification step may include transmitting the current location information of the wearable device.

If the pattern information is a hand gesture pattern, acquiring a first contour from a specific input gesture in the input pattern information; Comparing the first contour with a second contour of the setting gesture in the setting pattern information to calculate a degree of similarity; And determining the input gesture as the setting gesture if the degree of similarity is greater than or equal to a specific value.

It is also possible to recognize the difference between the first input gesture obtained at a specific time point and the second input gesture obtained before a specific time from the specific time point and recognize the change of the hand gesture input from the user .

An unlocking program for a glass-like wearable device according to another embodiment of the present invention is combined with hardware to execute the above-mentioned unlocking method and stored in the medium.

The details of other embodiments are included in the detailed description and drawings.

INDUSTRIAL APPLICABILITY According to the present invention, it is possible to prevent the use of a wearable wearable device without the consent of the user. In addition, the user can easily unlock the wearable wearable device.

In addition, since the usage right can be given differently according to the user authentication method, the security level can be set differently for each user authentication method.

In addition, different usage rights can be assigned to different users, so that a plurality of users can easily use a single glass-like wearable device.

In addition, upon failure of the unlocking, the registered user is notified of the failure of the unlocking by SMS or e-mail, and the position information of the glass-like wearable device can be also provided, thereby preventing the loss of the wearable wearable device.

1 is an internal configuration diagram of a glass-type wearable device system.
2 is a flowchart illustrating a method of unlocking a wearable wearable device according to a preferred embodiment of the present invention.
3 is a perspective view of a wearable wearable device according to an embodiment of the present invention.
4 is a view illustrating an example of a glass-type wearable device of an unlocking type using speech recognition according to an embodiment of the present invention.
FIG. 5 is an exemplary illustration of a glass-type wearable device in which a hand operation pattern information of a user is recognized and unlocked by a first camera according to an embodiment of the present invention.
FIG. 6 is an illustration of a glass-type wearable device of a method of recognizing and unlocking a user's head movement pattern information according to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention, and the manner of achieving them, will be apparent from and elucidated with reference to the embodiments described hereinafter in conjunction with the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Is provided to fully convey the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims. It is to be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification. It is noted that the terms "comprises" and / or "comprising" used in the specification are intended to be inclusive in a manner similar to the components, steps, operations, and / Or additions. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail.

1 is an internal configuration diagram of a glass-type wearable device system. 2 is a flowchart illustrating a method of unlocking a wearable wearable device according to a preferred embodiment of the present invention. 3 is a perspective view of a wearable wearable device according to an embodiment of the present invention. 4 is a view illustrating an example of a glass-type wearable device of an unlocking type using speech recognition according to an embodiment of the present invention. FIG. 5 is an exemplary illustration of a glass-type wearable device in which a hand operation pattern information of a user is recognized and unlocked by a first camera according to an embodiment of the present invention. FIG. 6 is an illustration of a glass-type wearable device of a method of recognizing and unlocking a user's head movement pattern information according to an embodiment of the present invention.

1 to 6 show a system 100, a user input unit 110, an application 111, a keyboard 112, a voice input unit 113, a touch pad 114, a GPS signal unit 115, A camera 120, a first camera 121, a second camera 122, a third camera 123, a sensing unit 130, a gyro sensor 131, an acceleration sensor 132, a pressure sensor 133, an iris recognition sensor 134, a heartbeat detection sensor 135, an electromyogram sensor 136, an information processing unit 210, a voice recognition unit 220, a situation evaluation module 230, a voice- A wireless communication unit 250, a memory 260, an interface unit 270, an output unit 300, a display unit 310, an acoustic output unit 320, an alarm unit 330, and a haptic module 340 Respectively.

1 is an internal configuration diagram of a glass-type wearable device system according to an embodiment of the present invention.

The wearable device system 100 includes a user input unit 110, an application 111, a keyboard 112, a voice input unit 113, a touch pad 114, a GPS signal unit 115 A short distance communication 116, a camera 120, a first camera 121, a second camera 122, a third camera 123, a sensing unit 130, a gyro sensor 131, an acceleration sensor A heart rate detection sensor 135, an electromyogram sensor 136, an information processing unit 210, a voice recognition unit 220, a situation evaluation module 230, A text conversion module 240, a wireless communication unit 250, a memory 260, an interface unit 270, an output unit 300, a display unit 310, an audio output unit 320, an alarm unit 330, And a haptic module 340, all of which are shown in FIG. The glass-like wearable device system 100 may further include other additional configurations.

The camera 120 is for inputting video signals or image signals, and may be provided in accordance with a configuration of the device. The camera 120 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 310. [ The image frame processed by the camera 120 may be stored in the memory 260 or transmitted to the outside through the wireless communication unit 250. When an image signal or a video signal is used as an input for information processing, the image signal and the video signal are transmitted to the control unit 210.

The camera unit 120 may include one or more cameras according to the direction or purpose of the image to be photographed. The first camera 121 is provided at one side of the glass-like wearable device so as to take an image of the front side. The second camera 122 may be provided on one side of the glass-like wearable device to obtain an image or an image in the eyeball direction. The third camera 123 is disposed behind or on the side of the glass-type wearable device, and can acquire a rearward or lateral image or an image.

The voice input unit 113 is for inputting voice signals and may include a microphone and the like. The microphone receives an external acoustic signal by a microphone in a communication mode, a recording mode, a voice recognition mode, and the like and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication unit and output when the voice data is in the call mode. A variety of noise canceling algorithms may be used to remove the noise generated by the microphone in receiving an external acoustic signal.

The user input unit 110 generates key input data that the user inputs for controlling the operation of the device. The user input unit 110 may include a key pad, a keyboard, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, and a finger mouse. Particularly, when the touch pad has a mutual layer structure with the display unit 310 described later, it can be called a touch screen.

The sensing unit 130 senses the current state of the device such as the open / close state of the device, the position of the device, the presence or absence of the user, and generates a sensing signal for controlling the operation of the device. In addition, the sensing unit 130 may function as an input unit for receiving an input signal for information processing of a device, and may perform various sensing functions such as recognition of connection to an external device.

The sensing unit 130 may include a proximity sensor, a pressure sensor 133, a motion sensor, a fingerprint recognition sensor, an iris recognition sensor 134, a heartbeat detection sensor 135, a skin temperature sensor, And the like.

The proximity sensor makes it possible to detect the presence of an object to be approached or nearby, without mechanical contact. The proximity sensor can detect a nearby object by using the change of the alternating magnetic field or the change of the static magnetic field, or by using the change rate of the capacitance. The proximity sensor may be equipped with two or more sensors according to the configuration.

The pressure sensor 133 can detect whether or not pressure is applied to the device, the magnitude of the pressure, and the like. The pressure sensor 133 may be installed in a part of the device where the pressure needs to be detected depending on the use environment. When the pressure sensor 133 is installed on the display unit 310, a touch input through the display unit 310 and a pressure applied by the touch input The pressure touch input can be identified. In addition, the magnitude of the pressure applied to the display unit 310 at the time of the pressure touch input can be determined according to the signal output from the pressure sensor 133. [

The motion sensor includes at least one of an acceleration sensor 132, a gyro sensor 131, and a geomagnetic sensor, and detects the position and movement of the device using the sensor. The acceleration sensor 132, which can be used for a motion sensor, is a device that converts an acceleration change in one direction into an electric signal and is widely used along with the development of MEMS (micro-electromechanical systems) technology. Further, the gyro sensor 131 is a sensor for measuring the angular velocity, and can sense the direction of rotation with respect to the reference direction.

The heartbeat detection sensor 135 measures the change in the optical blood flow according to the change in the thickness of the blood vessel caused by the heartbeat. The skin temperature sensor measures the skin temperature as the resistance value changes in response to the temperature change. The skin resistance sensor measures the skin's electrical resistance.

The iris recognition sensor 134 performs a function of recognizing a person using iris information of an eye having characteristics unique to each person. The human iris is completed after 18 months of age, and the circular iris pattern, which is raised near the medial side of the iris, is almost unchanged once determined, and the shape of each person is different. Therefore, iris recognition is the application of information technology to security for information of different iris characteristics. That is, it is an authentication method developed to identify people by analyzing the shape and color of iris and the morphology of retinal capillaries.

The iris recognition sensor 134 encodes a pattern of the iris and converts it into a video signal to compare and determine. The general operation principle is as follows. First, when the user's eye is aligned with the mirror located at the center of the iris recognizer at a certain distance, the infrared camera adjusts the focus through the zoom lens. After the iris camera images the user's iris as a photo, the iris recognition algorithm analyzes the iris pattern of the iris region to generate iris codes unique to the user. Finally, a comparison search is performed at the same time that the iris code is registered in the database.

Distance sensors include two-point distance measurement, triangulation (infrared, natural light) and ultrasonic. As in the conventional triangulation principle, when the object to be measured from two paths is reflected by a rectangular prism and incident on two image sensors, the distance between two points is displayed when the relative positions are matched. In this case, there is a method of making natural light (manual type) and a method of emitting infrared rays. The ultrasonic method is a method of transmitting ultrasonic waves having sharp direction to the object to be measured and measuring the time until the reflected wave from the object is received to find the distance. A piezoelectric element is used as the receiving sensor.

The Doppler radar is a radar that uses a Doppler effect of a wave, that is, a phase change of a reflected wave. The Doppler radar includes a continuous wave radar that transmits and receives a sinusoidal wave that is not pulse-modulated, and a pulse radar that uses a pulse-modulated wave to a square wave as an electromagnetic wave signal waveform.

In the continuous wave radar, the modulation frequency is relatively high in order to obtain the performance of the Doppler frequency filter. Therefore, it is inappropriate for the radar for the long distance, but the motion of the human body and the vehicle is reproduced as a stable sound by adopting the Doppler frequency as the audible frequency band. There is a feature that can be. The pulse radar measures the distance to the target by the time from the pulse transmission to the reflection echo reception. There is a method referred to as a pulse compression laser that performs frequency modulation or phase modulation within the transmission pulse width.

The output unit 300 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 300 may include a display unit 310, an audio output module, an alarm unit 330, a haptic module 340, and the like.

The display unit 310 displays and outputs information processed in the device. For example, when the device is in the call mode, a UI (User Interface) or GUI (Graphic User Interface) associated with the call is displayed. When the device is in the video communication mode or the photographing mode, the captured or received image can be displayed individually or simultaneously, and the UI and the GUI are displayed.

Meanwhile, as described above, when the display unit 310 and the touch pad have a mutual layer structure to constitute a touch screen, the display unit 310 can be used as an input device in addition to the output device. If the display unit 310 is configured as a touch screen, it may include a touch screen panel, a touch screen panel controller, and the like.

In addition, the display unit 310 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display (3D display). There may be two or more display units 310 depending on the implementation type of the device. For example, the device may include an external display unit 310 and an internal display unit 310 at the same time.

The display unit 310 may be implemented as a head up display (HUD), a head mounted display (HMD), or the like. HMD (Head Mounted Display) is an image display device that allows you to enjoy large images on your head like glasses. A Head Up Display (HUD) is a video display device that projects a virtual image onto a glass in a visible region of a user.

The audio output unit 320 outputs audio data received from the wireless communication unit or stored in the memory 260 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the sound output module 320 outputs sound signals related to functions performed in the device, for example, call signal reception tones, message reception tones, and the like. The sound output module 320 may include a speaker, a buzzer, and the like.

The alarm unit 330 outputs a signal for notifying the occurrence of an event of the device. Examples of events that occur in a device include receiving a call signal, receiving a message, and inputting a key signal. The alarm unit 330 outputs a signal for notifying the occurrence of an event in a form other than an audio signal or a video signal. For example, it is possible to output a signal in a vibration mode. The alarm unit 330 may output a signal to notify when a call signal is received or a message is received. Also. When the key signal is input, the alarm unit 330 can output a signal as a feedback signal to the key signal input. The user can recognize the occurrence of an event through the signal output by the alarm unit 330. A signal for notifying the occurrence of an event in the device may also be output through the display unit 310 or the sound output unit.

The haptic module 340 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 340 is a vibration effect. When the haptic module 340 generates vibration with a haptic effect, the intensity and pattern of the vibration generated by the haptic module 340 can be converted, and the different vibrations may be synthesized and output or sequentially output.

The wireless communication unit 250 may include a broadcast receiving module, a mobile communication module, a wireless Internet module, a short distance communication module, and a GPS module.

The broadcast receiving module receives at least one of a broadcast signal and broadcast related information from an external broadcast management server through a broadcast channel. At this time, the broadcast channel may include a satellite channel, a terrestrial channel, and the like. The broadcast management server may refer to a server for generating and transmitting at least one of a broadcast signal and broadcast related information and a server for receiving at least one of the generated broadcast signal and broadcast related information and transmitting the broadcast signal to the terminal.

The broadcast-related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information can also be provided through a mobile communication network, in which case it can be received by the mobile communication module. Broadcast-related information can exist in various forms.

The broadcast receiving module receives a broadcast signal using various broadcast systems, and can receive a digital broadcast signal using a digital broadcast system. In addition, the broadcast receiving module may be configured to be suitable for all broadcasting systems that provide broadcast signals as well as the digital broadcasting system. The broadcast signal and / or broadcast related information received through the broadcast receiving module may be stored in the memory 260.

The mobile communication module transmits and receives radio signals to and from at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The wireless Internet module refers to a module for wireless Internet access, and the wireless Internet module can be embedded in a device or externally. Wireless Internet technologies include WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), LTE (Long Term Evolution-Advanced) or the like can be used.

The short-range communication module 116 is a module for short-range communication. Beacon, Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee and the like can be used as a short distance communication technology.

The GPS (Global Position System) module 115 receives position information from a plurality of GPS satellites.

The memory 260 may store a program for processing and controlling the control unit 210 and may perform a function for temporarily storing input or output data (e.g., a message, a still image, a moving image, etc.) It is possible.

The memory 260 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory), a RAM , And a ROM. ≪ / RTI > The device may also operate a web storage that performs storage functions of the memory on the Internet.

The memory 260 may be represented by a storage unit 260 as follows.

The interface unit 270 serves as an interface with all external devices connected to the device. Examples of external devices connected to the device include card sockets such as a wired / wireless headset, an external charger, a wired / wireless data port, a memory card, a Subscriber Identification Module (SIM) or a User Identity Module (UIM) Audio I / O (input / output) jacks, video I / O (input / output) jacks, and earphones. The interface unit 270 may receive data from the external device or supply power to the respective components in the device, and may transmit data in the device to the external device.

The control unit 210 typically controls the operation of each unit to control the overall operation of the device. For example, voice communication, data communication, video communication, and the like. In addition, the control unit 210 performs a function of processing data for multimedia reproduction. In addition, it performs a function of processing data input from the input unit or the sensing unit 130.

In addition, the control unit 210 performs face detection and face recognition for face recognition. That is, the control unit 210 may include a face detection module and a face recognition module for face recognition. The face detection module can extract only the face region from the camera image acquired by the camera unit 120. [ For example, the face detection module can extract face regions by recognizing feature elements in the face such as eyes, nose, mouth, and the like. The face recognition module extracts feature information from the extracted face region to generate a template, and the face information can be recognized by performing template comparison with the face information data in the face database.

In addition, the control unit 210 may perform a function of extracting and recognizing a character within an image or an image acquired by the camera unit 120. [ That is, the control unit 210 may include a character recognition module for character recognition. An optical character recognition (OCR) method can be applied to the character recognition method of the character recognition module. The OCR method is a method that can be implemented by software by converting a type image of a document written or printed by a person, which can be obtained by image scanning, into a form such as a character code that can be edited by a computer. For example, in the OCR method, a plurality of standard pattern characters prepared in advance and an input character are compared with each other to select the character most similar to the standard pattern character. If the character recognition module includes standard pattern characters of various languages, printed characters of various languages can be read. Such a method is referred to as a pattern matching method among the OCR methods, and the OCR method is not limited thereto and various methods can be applied. In addition, the character recognition method of the character recognition module is not limited to the OCR method, and various methods capable of recognizing already-printed offline characters can be applied.

In addition, the control unit 210 may perform a function of recognizing the gaze direction based on the ocular direction image or the image acquired by the second camera 122. That is, the control unit 210 may include a line of sight analysis module that performs line-of-sight direction recognition. The direction of sight of the user and the direction of the line of sight are measured and then synthesized to determine the direction the user is looking at. The gaze direction refers to the direction of the user's face and can be measured by the gyro sensor 131 or the acceleration sensor 132 of the sensing unit 130. The gaze direction can be grasped by the gaze analysis module in the direction in which the user's pupil looks. The eye-gaze analysis module can detect motion of a pupil through analysis of a real-time camera image and calculate a gaze direction based on a fixed position reflected on the cornea. For example, the location of the cornea reflection light by the center of the pupil and illumination can be extracted through the image processing method and the eye position can be calculated through the positional relationship between them.

The control unit 210 may be expressed as an information processing unit 210 hereinafter.

The power supply unit receives external power and internal power under the control of the controller 210, and supplies power necessary for operation of the respective components.

The speech recognition unit 220 performs a function of recognizing verbally meaningful contents from the speech by automatic means. Specifically, a speech waveform is input to identify a word or a word sequence, and a meaning is extracted. The process is largely divided into voice analysis, phoneme recognition, word recognition, sentence analysis, and semantic extraction. The voice recognition unit 220 may further include a voice evaluation module that compares the stored voice with the input voice. The voice recognition unit 220 may further include a voice-to-text conversion module 240 that converts the input voice to text or converts the voice to voice.

The EEG signal generator generates an EEG synchronized signal having a frequency and a waveform for synchronizing human brain waves. That is, the EEG coherent signal generator performs the function of synchronizing the EEG by transmitting the vibration of the EEG frequency to the skull. Electroencephalogram (EEG) refers to the flow of electricity that occurs when a cranial nerve signal is transmitted. These brain waves are very slow when sleeping Delta wave EEG, when the action is a fast EEG betapa, meditation when the middle rate of the alpha waves are increased. Therefore, the EEG signal generation part can induce the alpha wave and the seta wave, so that the effect of learning assistance and mental concentration can be demonstrated.

Hereinafter, an unlocking system, a method, and a program using a glass-like wearable device according to embodiments of the present invention will be described with reference to the drawings.

2 is a flowchart illustrating a method of unlocking a wearable wearable device according to a preferred embodiment of the present invention.

Referring to FIG. 2, a method of unlocking a wearable wearable device according to an embodiment of the present invention includes: (S100) receiving the input pattern information by the wearable wearable device; And resetting the device lock state by comparing the input pattern information with the setting pattern information (S200). A payment method according to an embodiment of the present invention will be described in order.

The glass wearable device receives the input pattern information (S100). The pattern information may include at least one of a voice pattern, an iris pattern, a flicker pattern, a heartbeat pattern, a pulse pattern, a palm pattern, a gesture pattern as shown in FIG. 5, Or more. The pattern information is not limited to the presented user authentication method but may include all the user authentication methods that can be implemented by the sensing unit 130 of the glass-like wearable device and various input information through the user input unit 110 have. The input pattern information is pattern information obtained by the glass wearable device from a user or acquired by an external device and transmitted to the glass wearable device.

The input pattern information is compared with the setting pattern information to release the device lock state (S200). The setting pattern information is pattern information previously stored in the wearable device. When the input pattern information matches the predetermined setting pattern information, the glass-like wearable device unlocks the user to use the glass-wearable device, and does not release the lock if the input pattern information does not match.

The method may further include the steps of: And selecting a specific user authentication method from the user. When one or more user authentication methods are stored in the wearable wearable device, the user can confirm and select a user authentication mode for using the wearable wearable wearable device through the display unit 310.

Further, the method may further include granting a limited use right to a function provided in the glass-like wearable device according to the user authentication method. Some user authentication methods can be easily recognized by others. Therefore, when unlocking by this user authentication method, it is necessary to restrict the use of some functions by granting only a limited use right. For example, since the blinking pattern information can be easily recognized and stolen by a person other than the registered user than the iris recognition information, the use of the function including the personal information can be restricted at the time of user authentication by the blinking pattern information have.

If the user corresponding to the specific setting pattern information corresponds to a user whose usage right of the glass-like wearable device is limited, And a step of granting a limited use right. That is, when unlocking is performed by the setting pattern information for user authentication of a specific user among the registered users, the available functions of the glass-like wearable device can be limited.

The method further includes the step of applying the setting state corresponding to the authenticated user when the number of users storing the setting pattern information is two or more and the setting state is different according to the user, , And the setting state may include at least one of a used application, a user interface type, logged in account information, and stored data. That is, when there are two or more users who have stored the setting pattern information for user authentication, the data stored in the wearable wearable device differs for each user, and the function of the wearable wearable wearable device may be different. In addition, stored data such as user-specific personal information should not be disclosed to other users. Therefore, the glass-like wearable device 100 loads data in the storage unit according to the user who stores the setting pattern information, and the user can apply the used function and the UI set by the user.

Further, the method may further include the step of notifying the registered user via wireless communication when the authentication of the user authentication fails a predetermined number of times or more. The notification method via wireless communication may include notification SMS, electronic mail, or the like. Accordingly, it is possible for the registered user to recognize the fact of unlocking another person, thereby preventing the device from being lost.

The notification step may include transmitting the current location information of the wearable device. When the wearable type wearable device is lost, the location information of the device may be transmitted to the registered user in response to the user authentication failure, which may help to find the lost device.

5, if the pattern information is a hand gesture pattern, obtaining a first contour from a specific input gesture in the input pattern information; Comparing the first contour with a second contour of the setting gesture in the setting pattern information to calculate a degree of similarity; And determining the input gesture as the setting gesture if the degree of similarity is greater than or equal to a specific value. That is, the glass-like wearable device 100 extracts the first contour and the second contour, which are contours of the input gesture and the setting gesture, calculates the similarity between the first contour and the second contour, and determines whether the input gesture and the setting gesture match It can be judged.

The input gesture recognition unit may recognize the change of the input gesture by calculating a difference between the first input gesture obtained at a specific time point and a second input gesture obtained before a specific time from the specific time point. That is, when a lock pattern is composed of a plurality of input gestures, it is necessary to be able to recognize a change in the hand gesture so that the pattern information can be sequentially inputted. Therefore, when the glass-like wearable device 100 compares the first input gesture obtained in real time with the second input gesture obtained before the specific time to determine a difference, and if the difference value is equal to or greater than a specific value, It can be recognized that the first input gesture has been changed. Thus, the glass-like wearable device 100 can sequentially receive the input gesture and release the lock pattern.

In addition, an embodiment of the present invention may further include displaying on the display unit 310 whether the user authentication is approved. That is, the user can confirm whether or not the user authentication is approved by the input pattern information through the display unit 310. Also, the user can try to authenticate the user again through the user authentication failure message displayed on the display unit 310.

The unlocking system of the glass-like wearable device according to another embodiment of the present invention includes an authentication information input unit and an information processing unit 210. [

The authentication information input unit receives the user authentication pattern information according to the user authentication method. The authentication information input unit includes the sensing unit 130, the user input unit 110, and the camera unit 120. That is, the authentication information input unit receives the authentication information from the audio input unit 113 of the user input unit 110, the first camera 121 and the second camera 122 of the camera unit 120, the motion of the sensing unit 130 Sensor and a heartbeat detection sensor 135. [0031] FIG.

The voice input unit 113 receives voice information of a user to be compared with voice information of a predetermined user. The motion sensor, such as the acceleration sensor 132 and the gyro sensor 131, receives a user's head movement pattern. The heartbeat detection sensor 135 receives the heartbeat pattern information of the user.

As shown in FIG. 5, the first camera 121 is coupled to one side of the front portion of the wearable wearable device, and receives a user's hand movement pattern. The second camera 122 is coupled to the wearable wearable device in the eye direction of the user and includes the iris recognition sensor 134 to receive iris pattern information and eye blinking pattern information of the user.

The information processing unit 210 determines whether the input user authentication pattern information matches the stored user authentication pattern information. For example, as shown in FIG. 6, the information processing unit 210 compares the head movement pattern information with the stored head movement pattern information to determine whether or not the head movement pattern information matches the stored head movement pattern information. The handwriting pattern information is compared with the stored handwriting pattern information to determine whether or not the handwriting pattern information matches.

As shown in FIG. 4, the information processing unit 210 may include a speech recognition unit 220 for comparing the inputted speech pattern information with the stored speech pattern information.

The information processing unit 210 commands the glass wearable device to function normally when the input user authentication pattern information matches the stored user authentication pattern information.

In addition, the information processing unit 210 may perform a function of granting a limited use right to a function provided in a glass-like wearable device according to a user authentication method. The information processing unit 210 may classify a user authentication method according to a setting of a user, and may restrict use of a part of the functions by limiting a use right of the glass-like wearable device at the time of user authentication according to a specific user authentication method.

For example, since the blinking pattern information can be easily recognized and stolen by a person other than the registered user, irrespective of the iris recognition information, the information processing unit 210 can recognize the blinking pattern information You can restrict the use of functions that contain information.

If the number of users storing the user authentication pattern information is more than two, the information processing unit 210 may be a function provided in the glass-like wearable device if it corresponds to a user whose usage right of the glass-like wearable device is limited The user can perform a function of granting a limited use right to the user. When the unlocking is performed by the user authentication pattern information of a specific user among the registered users, the information processing unit 210 can restrict the usable functions of the glass-like wearable device.

In addition, an embodiment of the present invention may further include a display unit 310 displaying a user authentication method, a user authentication process, and a user authentication result to be input to the user. The display unit 310 functions to display a screen. 4 to 6, the display unit 310 displays a user authentication method to be input. When the user authentication pattern information is input, the display unit 310 compares the user authentication pattern information with previously stored user authentication pattern information and displays whether or not the user authentication pattern information matches. When the wearable device receives the user's head movement pattern information or the hand movement pattern information, the display unit 310 displays the recognized pattern information to check whether the inputted pattern information is correctly recognized in the device Can be performed.

The mobile terminal may further include a touch unit 114 for providing a direction and a selection interface so that the user can select a specific user authentication method. The touch unit 114 refers to the touch pad 114 of the user input unit 110 that can input a signal to the device by a user's operation.

The touch unit 114 functions to allow a user to select a user authentication method when one or more user authentication methods are stored in the glass-like wearable device. The touch unit 114 may be combined with the display unit 310 to be implemented as a touch screen. When one or more user authentication methods are displayed on the display unit 310 of the glass-like wearable device, the user can select a portion of the user authentication scheme to be input and input pattern information of the user authentication scheme.

Further, the touch portion 114 can be implemented in a manner of operating a specific portion of the glass-like wearable device. The wearable device is provided with the touch unit 114 on one side thereof and is provided with a user authentication function according to the difference in the number of times the touch unit 114 is operated, It is possible to select a method. The touch portion 114 is not limited to the one provided on the side portion, but may be provided at various positions of the glass-like wearable device. In addition, the method of selecting one of the one or more user authentication methods is not limited to the proposed method, and various methods that can be implemented by the touch unit 114 may be applied.

In addition, in one embodiment of the present invention, the voice input unit 113 may receive a voice command of the user so that the user can select a specific user authentication method.

The mobile communication terminal may further include a wireless communication unit (250) for transmitting the SMS or e-mail to the registered user when the user authentication is not approved because the inputted user authentication pattern information does not match the stored user authentication pattern information.

Also, in one embodiment of the present invention, the information processing unit 210 may set the number of user authentication failures for transmitting the SMS or e-mail to the registered user. The registered user may fail to authenticate the user because the pattern information is not properly recognized. Therefore, the information processing unit 210 can set the number of continuous consecutive user authentication failures according to the user's designation.

In addition, the information processing unit 210 may limit the unlocking of the device for a predetermined period of time when the user authentication fails a predetermined number of times.

In addition, the mobile communication terminal 100 may further include a GPS signal unit 115 for providing location information of a glass-like wearable device to an SMS or e-mail transmitted to a registered user. The GPS signal unit 115 transmits the position information of the device to the registered user in response to the failure of unlocking the user when the wearable device is lost, thereby allowing the user to grasp the position of the device This helps to find the lost device.

The unlocking method using the glass-like wearable device according to an embodiment of the present invention described above is implemented as a program (or application) to be executed in combination with the glass-like wearable device 100, which is hardware, .

The above-described program is a program for causing a processor (CPU) of the glass-like wearable device 100 to read the program and execute the methods implemented by the program, C ++, JAVA, machine language, etc., which can be read through the device interface of the device 100. [ Such code may include a function code related to a function or the like that defines necessary functions for executing the above methods, and may execute the functions necessary to execute the functions of the processor of the glass-like wearable device 100 according to a predetermined procedure Procedure-related control codes. This code may also be used when the additional information or media necessary for the processor of the glass-like wearable device 100 to perform the above functions must be referred to at any position (address) of the internal or external memory of the glass-like wearable device 100 You can also include more memory reference related code. When the processor of the glass-like wearable device 100 needs to communicate with any other computer or server that is remote to execute the functions, the code is transmitted to the communication module of the glass-like wearable device 100 And may further include communication related codes such as how to communicate with any other remote computer or server, what information or media should be transmitted or received during communication, and the like.

The medium to be stored is not a medium for storing data for a short time such as a register, a cache, a memory, etc., but means a medium that semi-permanently stores data and is capable of being read by a device. Specifically, examples of the medium to be stored include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, but are not limited thereto. That is, the program may be stored in various recording media on various servers that the glass-like wearable device 100 can access, or on various recording media on the glass-wearable device 100 of the user. In addition, the medium may be distributed to a network-connected computer system so that computer-readable codes may be stored in a distributed manner.

INDUSTRIAL APPLICABILITY According to the present invention, it is possible to prevent the use of a wearable wearable device without the consent of the user. In addition, the user can easily unlock the wearable wearable device.

In addition, since the usage right can be given differently according to the user authentication method, the security level can be set differently for each user authentication method.

In addition, different usage rights can be assigned to different users, so that a plurality of users can easily use a single glass-like wearable device.

In addition, upon failure of the unlocking, the registered user is notified of the failure of the unlocking by SMS or e-mail, and the position information of the glass-like wearable device can be also provided, thereby preventing the loss of the wearable wearable device.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention.

100: system 110: user input
111: Application 112: Keyboard
113: voice input unit 114: touch pad
115: GPS signal unit 116: Local area communication
120: camera unit 121: first camera
122: second camera 123: third camera
130: sensing unit 131: gyro sensor
132: acceleration sensor 133: pressure sensor
134: iris recognition sensor 135: heart rate detection sensor
136: EMG sensor
210: information processing unit 220:
230: situation evaluation module 240: voice-to-text conversion module
250: wireless communication unit 260: memory
270:
300: output unit 310: display unit
320: Acoustic output unit 330:
340: Haptic module

Claims (11)

CLAIMS 1. A method of releasing a locked state in which use of a wearable device of a glass type is limited through user authentication,
An input pattern information receiving step in which the glass-like wearable device receives input pattern information;
An unlocking step of releasing the device lock state by comparing the input pattern information with setting pattern information; And
Wherein the usage right for one or more functions provided in the wearable device is different according to a user authentication method and the restriction level of the usage right is adjusted according to a level of easiness of a specific user authentication method. A granting step,
Wherein the input pattern information is pattern information obtained by the glass wearable device from a user or acquired by an external device and transmitted to the glass wearable device,
Wherein the setting pattern information is pattern information previously stored in the wearable type wearable device. The method according to claim 1,
Wherein,
Wherein the at least one combination is at least one of a voice pattern, an iris pattern, a blinking eye pattern, a heartbeat pattern, a pulse pattern, a palm pattern, a hand gesture pattern or a head movement pattern.
The method according to claim 1,
Arranging at least one user authentication method on the screen; And
And receiving a user authentication method selected from a user.
delete The method according to claim 1,
If there are two or more users storing the setting pattern information,
If the user corresponding to the specific setting pattern information corresponds to a user whose usage right of the glass-like wearable device is limited, granting a limited use right to the function provided by the glass-like wearable device , A method of unlocking a wearable wearable device.
The method according to claim 1,
Further comprising: generating and providing the user interface set in accordance with the input pattern information or the authenticated user by the glass-type wearable device.
The method according to claim 1,
And performing notification via wireless communication to the registered user when the authentication of the user authentication fails a predetermined number of times or more.
8. The method of claim 7,
In the notification step,
And transmits the information including the current position information of the wearable type wearable device.
3. The method of claim 2,
If the pattern information is a hand gesture pattern,
Obtaining a first contour from a particular input gesture in the input pattern information;
Comparing the first contour with a second contour of the setting gesture in the setting pattern information to calculate a degree of similarity; And
And determining the input gesture as the setting gesture if the degree of similarity is equal to or greater than a specific value.
10. The method of claim 9,
Recognizing a difference between the first input gesture acquired at a specific time point and a second input gesture acquired before a specific time from the specific time point to recognize a change in the hand gesture input from the user, How to unlock the device.
A computer-readable recording medium, which is combined with a glass-type wearable device which is hardware, and which is adapted to execute the method of any one of claims 1 to 3 and 5 to 10, .
KR1020150042548A 2014-07-11 2015-03-26 Method and program with the unlock system of wearable glass device KR101629758B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/KR2015/007132 WO2016006949A1 (en) 2014-07-11 2015-07-09 System and method for processing data using wearable device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020140087201 2014-07-11
KR20140087201 2014-07-11

Publications (2)

Publication Number Publication Date
KR20160007342A KR20160007342A (en) 2016-01-20
KR101629758B1 true KR101629758B1 (en) 2016-06-24

Family

ID=55308033

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150042548A KR101629758B1 (en) 2014-07-11 2015-03-26 Method and program with the unlock system of wearable glass device

Country Status (1)

Country Link
KR (1) KR101629758B1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10204265B2 (en) 2016-01-11 2019-02-12 Electronics And Telecommunications Research Institute System and method for authenticating user
KR101700569B1 (en) * 2016-03-23 2017-01-26 주식회사 다날 Hmd apparatus for gesture based user authentication and method for gesture based user authentication of the hmd apparatus

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130069787A1 (en) * 2011-09-21 2013-03-21 Google Inc. Locking Mechanism Based on Unnatural Movement of Head-Mounted Display
KR101286750B1 (en) * 2011-12-23 2013-08-23 심광호 Password estimation system using gesture.

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013049248A2 (en) * 2011-09-26 2013-04-04 Osterhout Group, Inc. Video display modification based on sensor input for a see-through near-to-eye display

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130069787A1 (en) * 2011-09-21 2013-03-21 Google Inc. Locking Mechanism Based on Unnatural Movement of Head-Mounted Display
KR101286750B1 (en) * 2011-12-23 2013-08-23 심광호 Password estimation system using gesture.

Also Published As

Publication number Publication date
KR20160007342A (en) 2016-01-20

Similar Documents

Publication Publication Date Title
US10936709B2 (en) Electronic device and method for controlling the same
KR102329765B1 (en) Method of recognition based on IRIS recognition and Electronic device supporting the same
KR101661555B1 (en) Method and program for restricting photography of built-in camera of wearable glass device
KR101684264B1 (en) Method and program for the alarm of bus arriving by wearable glass device
KR101688168B1 (en) Mobile terminal and method for controlling the same
US20140126782A1 (en) Image display apparatus, image display method, and computer program
US10984082B2 (en) Electronic device and method for providing user information
KR20160017593A (en) Method and program for notifying emergency exit by beacon and wearable glass device
KR101728707B1 (en) Method and program for controlling electronic device by wearable glass device
KR20160015142A (en) Method and program for emergency reporting by wearable glass device
KR20170031722A (en) System and method for processing information using wearable device
KR102251710B1 (en) System, method and computer readable medium for managing content of external device using wearable glass device
KR101629758B1 (en) Method and program with the unlock system of wearable glass device
KR20160011302A (en) System and method for digital image processing by wearable glass device
KR20160024140A (en) System and method for identifying shop information by wearable glass device
CN115857781A (en) Adaptive user registration for electronic devices
KR102224985B1 (en) System and method for recognition acquaintance by wearable glass device
KR20160025150A (en) System and method for social dating service by wearable glass device
KR101661556B1 (en) Method and program for confirmation of identity by wearable glass device
EP3255927B1 (en) Method and device for accessing wi-fi network
KR20160016216A (en) System and method for real-time forward-looking by wearable glass device
KR20160023226A (en) System and method for exploring external terminal linked with wearable glass device by wearable glass device
KR102308970B1 (en) System and method for inputting touch signal by wearable glass device
KR20160053472A (en) System, method and application for confirmation of identity by wearable glass device
KR20160016149A (en) System and method for preventing drowsiness by wearable glass device

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E701 Decision to grant or registration of patent right
GRNT Written decision to grant
FPAY Annual fee payment

Payment date: 20190625

Year of fee payment: 4