KR101661556B1

KR101661556B1 - Method and program for confirmation of identity by wearable glass device

Info

Publication number: KR101661556B1
Application number: KR1020150042552A
Authority: KR
Inventors: 한성철; 엄정한; 김진영; 이경현; 김대중; 김석기; 유철현
Original assignee: 넥시스 주식회사
Priority date: 2014-09-30
Filing date: 2015-03-26
Publication date: 2016-10-04
Also published as: KR20160038689A

Abstract

The present invention relates to a method and program for identification using a glass-like wearable device.
A method of authenticating a wearable device using a glass-like wearable device according to an embodiment of the present invention includes: receiving (S100) a wireless communication signal transmitted from the communication device or the wireless communication tag; (S110) the glass wearable device recognizing an identity identification code included in the wireless communication signal; (S120) searching for the identity information of the other party corresponding to the identity identification code; And a step (S 130) in which the glass wearable device informs the user of the searched identity information.
According to the present invention, the user can receive the identity identification code from the beacon tag or the other party with the communication device, thereby easily identifying the identity information. For example, when the user is a bodyguard or an infant, it is necessary to grasp the identity of the other party. Therefore, the effect that the glass wearable device can actively sense the beacon signal transmitted from the beacon tag held by the other party, have.

Description

METHOD AND PROGRAM FOR IDENTITY BY WEARABLE GLASS DEVICE USING GLASS TYPE Wearable Device

More particularly, the present invention relates to a method and a program for identifying a wearable wearable device using a glass type wearable device, and more particularly to a wearable wearable device for a wearable wearable device which receives a beacon signal transmitted from a communication device or a wireless communication tag, And more particularly, to a system and method for verifying the identity of a user.

Recently wearable devices are emerging. It has appeared in the form of glasses that are linked to smart phones, and some forms that can operate independently without a smartphone are also emerging. In addition, beacons using Bluetooth 4.0 are being used in various areas.

Korean Patent Publication No. 10-2013-0011913 (published on Jan. 30, 2013)

A wearable device of a glass type for receiving a wireless communication signal transmitted by a communication device or a wireless communication tag and recognizing a wireless communication signal to confirm the identity of the communication device or the other party holding the beacon tag Methods, and programs.

A method of authenticating a wearable device using a glass-like wearable device according to an embodiment of the present invention includes: receiving a wireless communication signal transmitted from the communication device or the wireless communication tag; The wearable wearable device recognizing an identification code included in the wireless communication signal; Searching for the identity information of the other party corresponding to the identity identification code; And the glass-wearable device performing a notification of the searched identity information to the user.

According to another aspect of the present invention, there is provided a method for identifying a wearable wearable device using a glass-like wearable device, the method comprising: receiving a wireless communication signal transmitted from the communication device or the wireless communication tag; The wearable wearable device recognizing an identification code included in the wireless communication signal; Obtaining a front image including the facial image of the other party by the glass type wearable device; Extracting the face image from the acquired image and setting the extracted face image as an inspection target; Searching for the identity information of the other party corresponding to the identity identification code; And comparing the image image included in the identity information with the extracted face image to determine whether the same person is the same person.

The method may further include, when a plurality of face images are extracted in the forward image, comparing each of the image images with the plurality of face images, and excluding the matching face image from the examination table.

The method may further include displaying the non-matching face image on the screen when the non-matching face image exists in the non-matching object image.

Also, the searching for the identity information may include searching for the identity information stored in the wearable device, or transmitting the identity identification code to the identity information database server to search for the identity information corresponding to the identity identification code The method of the present invention is characterized in that it is performed by any one of the following methods.

The identification information may include at least one of a name, an image, a rank or a position, and other personal information. The identification information may include at least one of a group number, an employee number, a resident registration number, and a user ID. .

According to another aspect of the present invention, there is provided a method for identifying a wearable wearable device using a glass-like wearable device, the method comprising: receiving a wireless communication signal transmitted by the wearable device from the communication device or the wireless communication tag; Measuring the transmission direction of the wireless communication signal by the glass-type wearable device; Wherein the glass wearable device acquires a forward image and recognizes a person in the forward image; And comparing the direction in which the person is located in the front image and the direction in which the wireless communication signal is transmitted to recognize the person corresponding to each wireless communication signal.

In addition, the glass wearable device may recognize the identification code included in the wireless communication signal. Searching for the identity information of the other party corresponding to the identity identification code; And displaying the identification information corresponding to the recognized person on a screen.

When the wireless communication signal corresponding to the direction in which the person is located in the front image is not transmitted, the glass wearable device informs the user that the recognized person does not hold the wireless communication tag And a step of informing the user.

An identification program for a glass-like wearable device according to another embodiment of the present invention is combined with hardware to execute the aforementioned identification method and stored in the medium.

According to the present invention as described above, the following various effects are obtained.

First, the user receives the identification code from the other party having the wireless communication tag or the communication device, thereby easily identifying the identification information. For example, when the user is a security guard or a second person, it is necessary to grasp the identity of the other party. Therefore, the glass wearable device 100 can actively sense the wireless communication signal transmitted from the wireless communication tag held by the other party, There is an effect that can be grasped.

Second, when a plurality of persons are located in front of the user, it is possible to compare the person location on the image acquired by the first camera 121 with the transmission direction of the wireless communication signal, There is an effect. Also, as a result of comparison, the user on the image where the wireless communication signal is not received can be identified and informed to the user, so that a person without a wireless communication tag can be easily recognized at the time of identifying the identity.

Thirdly, there is an effect that a face recognition process of comparing the face of the other party with the face image of the identity information of the user can be prevented, and the authentication of the wireless communication tag or the communication device of the other person can be prevented. In addition, when the faces do not coincide with each other, the glass-wearable device 100 notifies the user through the output unit that the user can easily notify the person whose face does not coincide.

1 is an internal configuration diagram of a glass-type wearable device system according to an embodiment of the present invention.
2 is a flowchart illustrating a method of identifying a wearable device of a glass type according to an embodiment of the present invention.
3 is a flowchart of a method of identifying a wearable wearable device using a face recognition method according to an exemplary embodiment of the present invention.
FIG. 4 is a flow chart of a method of identifying an ID using a wearable device of a glass type by the wireless communication signal transmission direction recognition according to an embodiment of the present invention.
[0001] The present invention relates to a wearable device, and more particularly, to a wearable device having a glass-like wearable device, Fig.
FIG. 7 is an exemplary diagram showing a person who does not match a face image in the identification information on the display unit of the glass-like wearable device according to an embodiment of the present invention.
8 is an internal configuration diagram of an identification system using a wearable device of a glass type according to an embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention, and the manner of achieving them, will be apparent from and elucidated with reference to the embodiments described hereinafter in conjunction with the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. To fully disclose the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout the specification.

Unless defined otherwise, all terms (including technical and scientific terms) used herein may be used in a sense commonly understood by one of ordinary skill in the art to which this invention belongs. Also, commonly used predefined terms are not ideally or excessively interpreted unless explicitly defined otherwise.

The terminology used herein is for the purpose of illustrating embodiments and is not intended to be limiting of the present invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification. The terms " comprises "and / or" comprising "used in the specification do not exclude the presence or addition of one or more other elements in addition to the stated element.

1 is an internal configuration diagram of a glass-type wearable device system according to an embodiment of the present invention. 2 is a flowchart illustrating a method of identifying a wearable device of a glass type according to an embodiment of the present invention. 3 is a flowchart of a method of identifying a wearable wearable device using a face recognition method according to an exemplary embodiment of the present invention. FIG. 4 is a flow chart of a method of identifying an ID using a wearable device of a glass type by the wireless communication signal transmission direction recognition according to an embodiment of the present invention. 5 is a perspective view of a wearable wearable device according to an embodiment of the present invention. 6 is an exemplary diagram showing a person who does not coincide with a beacon signal transmission direction on a display unit of a glass-type wearable device according to an embodiment of the present invention. FIG. 7 is an exemplary diagram showing a person who does not match a face image in the identification information on the display unit of the glass-like wearable device according to an embodiment of the present invention. 8 is an internal configuration diagram of an identification system using a wearable device of a glass type according to an embodiment of the present invention.

1 to 8 show a system 100, a user input unit 110, an application 111, a keyboard 112, a voice input unit 113, a touch pad 114, a GPS signal unit 115, A camera 120, a first camera 121, a second camera 122, a third camera 123, a sensing unit 130, a gyro sensor 131, an acceleration sensor 132, a pressure sensor 133, an iris recognition sensor 134, a heartbeat detection sensor 135, an electromyogram sensor 136, an information processing unit 210, a voice recognition unit 220, a situation evaluation module 230, a voice- A wireless communication unit 250, a memory 260, an interface unit 270, an output unit 300, a display unit 310, an acoustic output unit 320, an alarm unit 330, and a haptic module 340 Respectively.

1 is an internal configuration diagram of a glass-type wearable system according to an embodiment of the present invention.

The wearable device system 100 includes a user input unit 110, an application 111, a keyboard 112, a voice input unit 113, a touch pad 114, a GPS signal unit 115 A short distance communication 116, a camera 120, a first camera 121, a second camera 122, a third camera 123, a sensing unit 130, a gyro sensor 131, an acceleration sensor A heart rate detection sensor 135, an electromyogram sensor 136, an information processing unit 210, a voice recognition unit 220, a situation evaluation module 230, A text conversion module 240, a wireless communication unit 250, a memory 260, an interface unit 270, an output unit 300, a display unit 310, an audio output unit 320, an alarm unit 330, And a haptic module 340, all of which are shown in FIG. The glass-like wearable device system 100 may further include other additional configurations.

The camera 120 is for inputting video signals or image signals, and may be provided in accordance with a configuration of the device. The camera 120 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 310. [ The image frame processed by the camera 120 may be stored in the memory 260 or transmitted to the outside through the wireless communication unit 250. When an image signal or a video signal is used as an input for information processing, the image signal and the video signal are transmitted to the control unit 210.

The camera unit 120 may include one or more cameras according to the direction or purpose of the image to be photographed. The first camera 121 is provided at one side of the glass-like wearable device so as to take an image of the front side. The second camera 122 may be provided on one side of the glass-like wearable device to obtain an image or an image in the eyeball direction. The third camera 123 is disposed behind or on the side of the glass-type wearable device, and can acquire a rearward or lateral image or an image.

The voice input unit 113 is for inputting voice signals and may include a microphone and the like. The microphone receives an external acoustic signal by a microphone in a communication mode, a recording mode, a voice recognition mode, and the like and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication unit and output when the voice data is in the call mode. A variety of noise canceling algorithms may be used to remove the noise generated by the microphone in receiving an external acoustic signal.

The user input unit 110 generates key input data that the user inputs for controlling the operation of the device. The user input unit 110 may include a key pad, a keyboard, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, and a finger mouse. Particularly, when the touch pad has a mutual layer structure with the display unit 310 described later, it can be called a touch screen.

The sensing unit 130 senses the current state of the device such as the open / close state of the device, the position of the device, the presence or absence of the user, and generates a sensing signal for controlling the operation of the device. In addition, the sensing unit 130 may function as an input unit for receiving an input signal for information processing of a device, and may perform various sensing functions such as recognition of connection to an external device.

The sensing unit 130 may include a proximity sensor, a pressure sensor 133, a motion sensor, a fingerprint recognition sensor, an iris recognition sensor 134, a heartbeat detection sensor 135, a skin temperature sensor, And the like.

The proximity sensor makes it possible to detect the presence of an object to be approached or nearby, without mechanical contact. The proximity sensor can detect a nearby object by using the change of the alternating magnetic field or the change of the static magnetic field, or by using the change rate of the capacitance. The proximity sensor may be equipped with two or more sensors according to the configuration.

The pressure sensor 133 can detect whether or not pressure is applied to the device, the magnitude of the pressure, and the like. The pressure sensor 133 may be installed in a part of the device where the pressure needs to be detected depending on the use environment. When the pressure sensor 133 is installed on the display unit 310, a touch input through the display unit 310 and a pressure applied by the touch input The pressure touch input can be identified. In addition, the magnitude of the pressure applied to the display unit 310 at the time of the pressure touch input can be determined according to the signal output from the pressure sensor 133. [

The motion sensor includes at least one of an acceleration sensor 132, a gyro sensor 131, and a geomagnetic sensor, and detects the position and movement of the device using the sensor. The acceleration sensor 132, which can be used for a motion sensor, is a device that converts an acceleration change in one direction into an electric signal and is widely used along with the development of MEMS (micro-electromechanical systems) technology. Further, the gyro sensor 131 is a sensor for measuring the angular velocity, and can sense the direction of rotation with respect to the reference direction.

The heartbeat detection sensor 135 measures the change in the optical blood flow according to the change in the thickness of the blood vessel caused by the heartbeat. The skin temperature sensor measures the skin temperature as the resistance value changes in response to the temperature change. The skin resistance sensor measures the skin's electrical resistance.

The iris recognition sensor 134 performs a function of recognizing a person using iris information of an eye having characteristics unique to each person. The human iris is completed after 18 months of age, and the circular iris pattern, which is raised near the medial side of the iris, is almost unchanged once determined, and the shape of each person is different. Therefore, iris recognition is the application of information technology to security for information of different iris characteristics. That is, it is an authentication method developed to identify people by analyzing the shape and color of iris and the morphology of retinal capillaries.

The iris recognition sensor 134 encodes a pattern of the iris and converts it into a video signal to compare and determine. The general operation principle is as follows. First, when the user's eye is aligned with the mirror located at the center of the iris recognizer at a certain distance, the infrared camera adjusts the focus through the zoom lens. After the iris camera images the user's iris as a photo, the iris recognition algorithm analyzes the iris pattern of the iris region to generate iris codes unique to the user. Finally, a comparison search is performed at the same time that the iris code is registered in the database.

Distance sensors include two-point distance measurement, triangulation (infrared, natural light) and ultrasonic. As in the conventional triangulation principle, when the object to be measured from two paths is reflected by a rectangular prism and incident on two image sensors, the distance between two points is displayed when the relative positions are matched. In this case, there is a method of making natural light (manual type) and a method of emitting infrared rays. The ultrasonic method is a method of transmitting ultrasonic waves having sharp direction to the object to be measured and measuring the time until the reflected wave from the object is received to find the distance. A piezoelectric element is used as the receiving sensor.

The Doppler radar is a radar that uses a Doppler effect of a wave, that is, a phase change of a reflected wave. The Doppler radar includes a continuous wave radar that transmits and receives a sinusoidal wave that is not pulse-modulated, and a pulse radar that uses a pulse-modulated wave to a square wave as an electromagnetic wave signal waveform.

In the continuous wave radar, the modulation frequency is relatively high in order to obtain the performance of the Doppler frequency filter. Therefore, it is inappropriate for the radar for the long distance, but the motion of the human body or the vehicle is reproduced as a stable sound by selecting the Doppler frequency as the audible frequency band. There is a feature that can be. The pulse radar measures the distance to the target by the time from the pulse transmission to the reflection echo reception. There is a method referred to as a pulse compression laser that performs frequency modulation or phase modulation within the transmission pulse width.

The output unit 300 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 300 may include a display unit 310, an audio output module, an alarm unit 330, a haptic module 340, and the like.

The display unit 310 displays and outputs information processed in the device. For example, when the device is in the call mode, a UI (User Interface) or GUI (Graphic User Interface) associated with the call is displayed. When the device is in the video communication mode or the photographing mode, the captured or received image can be displayed individually or simultaneously, and the UI and the GUI are displayed.

Meanwhile, as described above, when the display unit 310 and the touch pad have a mutual layer structure to constitute a touch screen, the display unit 310 can be used as an input device in addition to the output device. If the display unit 310 is configured as a touch screen, it may include a touch screen panel, a touch screen panel controller, and the like.

In addition, the display unit 310 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display (3D display). There may be two or more display units 310 depending on the implementation type of the device. For example, the device may include an external display unit 310 and an internal display unit 310 at the same time.

The display unit 310 may be implemented as a head up display (HUD), a head mounted display (HMD), or the like. HMD (Head Mounted Display) is an image display device that allows you to enjoy large images on your head like glasses. A Head Up Display (HUD) is a video display device that projects a virtual image onto a glass in a visible region of a user.

The audio output unit 320 outputs audio data received from the wireless communication unit or stored in the memory 260 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the sound output module 320 outputs sound signals related to functions performed in the device, for example, call signal reception tones, message reception tones, and the like. The sound output module 320 may include a speaker, a buzzer, and the like.

The alarm unit 330 outputs a signal for notifying the occurrence of an event of the device. Examples of events that occur in a device include receiving a call signal, receiving a message, and inputting a key signal. The alarm unit 330 outputs a signal for notifying the occurrence of an event in a form other than an audio signal or a video signal. For example, it is possible to output a signal in a vibration mode. The alarm unit 330 may output a signal to notify when a call signal is received or a message is received. Also. When the key signal is input, the alarm unit 330 can output a signal as a feedback signal to the key signal input. The user can recognize the occurrence of an event through the signal output by the alarm unit 330. A signal for notifying the occurrence of an event in the device may also be output through the display unit 310 or the sound output unit.

The haptic module 340 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 340 is a vibration effect. When the haptic module 340 generates vibration with a haptic effect, the intensity and pattern of the vibration generated by the haptic module 340 can be converted, and the different vibrations may be synthesized and output or sequentially output.

The wireless communication unit 250 may include a broadcast receiving module, a mobile communication module, a wireless Internet module, a short distance communication module, and a GPS module.

The broadcast receiving module receives at least one of a broadcast signal and broadcast related information from an external broadcast management server through a broadcast channel. At this time, the broadcast channel may include a satellite channel, a terrestrial channel, and the like. The broadcast management server may refer to a server for generating and transmitting at least one of a broadcast signal and broadcast related information and a server for receiving at least one of the generated broadcast signal and broadcast related information and transmitting the broadcast signal to the terminal.

The broadcast-related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information can also be provided through a mobile communication network, in which case it can be received by the mobile communication module. Broadcast-related information can exist in various forms.

The broadcast receiving module receives a broadcast signal using various broadcast systems, and can receive a digital broadcast signal using a digital broadcast system. In addition, the broadcast receiving module may be configured to be suitable for all broadcasting systems that provide broadcast signals as well as the digital broadcasting system. The broadcast signal and / or broadcast related information received through the broadcast receiving module may be stored in the memory 260.

The mobile communication module transmits and receives radio signals to and from at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The wireless Internet module refers to a module for wireless Internet access, and the wireless Internet module can be embedded in a device or externally. Wireless Internet technologies include WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), LTE (Long Term Evolution-Advanced) or the like can be used.

The short-range communication module 116 is a module for short-range communication. Beacon, Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee and the like can be used as a short distance communication technology.

The GPS (Global Position System) module 115 receives position information from a plurality of GPS satellites.

The memory 260 may store a program for processing and controlling the control unit 210 and may perform a function for temporarily storing input or output data (e.g., a message, a still image, a moving image, etc.) It is possible.

The memory 260 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory), a RAM , And a ROM. &Lt; / RTI > The device may also operate a web storage that performs storage functions of the memory on the Internet.

The memory 260 may be represented by a storage unit 260 as follows.

The interface unit 270 serves as an interface with all external devices connected to the device. Examples of external devices connected to the device include card sockets such as a wired / wireless headset, an external charger, a wired / wireless data port, a memory card, a Subscriber Identification Module (SIM) or a User Identity Module (UIM) Audio I / O (input / output) jacks, video I / O (input / output) jacks, and earphones. The interface unit 270 may receive data from the external device or supply power to the respective components in the device, and may transmit data in the device to the external device.

The control unit 210 typically controls the operation of each unit to control the overall operation of the device. For example, voice communication, data communication, video communication, and the like. In addition, the control unit 210 performs a function of processing data for multimedia reproduction. In addition, it performs a function of processing data input from the input unit or the sensing unit 130.

In addition, the control unit 210 performs face detection and face recognition for face recognition. That is, the control unit 210 may include a face detection module and a face recognition module for face recognition. The face detection module can extract only the face region from the camera image acquired by the camera unit 120. [ For example, the face detection module can extract face regions by recognizing feature elements in the face such as eyes, nose, mouth, and the like. The face recognition module extracts feature information from the extracted face region to generate a template, and the face information can be recognized by performing template comparison with the face information data in the face database.

In addition, the control unit 210 may perform a function of extracting and recognizing a character within an image or an image acquired by the camera unit 120. [ That is, the control unit 210 may include a character recognition module for character recognition. An optical character recognition (OCR) method can be applied to the character recognition method of the character recognition module. The OCR method is a method that can be implemented by software by converting a type image of a document written or printed by a person, which can be obtained by image scanning, into a form such as a character code that can be edited by a computer. For example, in the OCR method, a plurality of standard pattern characters prepared in advance and an input character are compared with each other to select the character most similar to the standard pattern character. If the character recognition module includes standard pattern characters of various languages, printed characters of various languages can be read. Such a method is referred to as a pattern matching method among the OCR methods, and the OCR method is not limited thereto and various methods can be applied. In addition, the character recognition method of the character recognition module is not limited to the OCR method, and various methods capable of recognizing already-printed offline characters can be applied.

In addition, the control unit 210 may perform a function of recognizing the gaze direction based on the ocular direction image or the image acquired by the second camera 122. That is, the control unit 210 may include a line of sight analysis module that performs line-of-sight direction recognition. The direction of sight of the user and the direction of the line of sight are measured and then synthesized to determine the direction the user is looking at. The gaze direction refers to the direction of the user's face and can be measured by the gyro sensor 131 or the acceleration sensor 132 of the sensing unit 130. The gaze direction can be grasped by the gaze analysis module in the direction in which the user's pupil looks. The eye-gaze analysis module can detect motion of a pupil through analysis of a real-time camera image and calculate a gaze direction based on a fixed position reflected on the cornea. For example, the location of the cornea reflection light by the center of the pupil and illumination can be extracted through the image processing method and the eye position can be calculated through the positional relationship between them.

The control unit 210 may be expressed as an information processing unit 210 hereinafter.

The power supply unit receives external power and internal power under the control of the controller 210, and supplies power necessary for operation of the respective components.

The speech recognition unit 220 performs a function of recognizing verbally meaningful contents from the speech by automatic means. Specifically, a speech waveform is input to identify a word or a word sequence, and a meaning is extracted. The process is largely divided into voice analysis, phoneme recognition, word recognition, sentence analysis, and semantic extraction. The voice recognition unit 220 may further include a voice evaluation module that compares the stored voice with the input voice. The voice recognition unit 220 may further include a voice-to-text conversion module 240 that converts the input voice to text or converts the voice to voice.

The EEG signal generator generates an EEG synchronized signal having a frequency and a waveform for synchronizing human brain waves. That is, the EEG coherent signal generator performs the function of synchronizing the EEG by transmitting the vibration of the EEG frequency to the skull. Electroencephalogram (EEG) refers to the flow of electricity that occurs when a cranial nerve signal is transmitted. These brain waves are very slow when sleeping Delta wave EEG, when the action is a fast EEG betapa, meditation when the middle rate of the alpha waves are increased. Therefore, the EEG signal generation part can induce the alpha wave and the seta wave, so that the effect of learning assistance and mental concentration can be demonstrated.

DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an identification system, a method, and a program using a glass-like wearable device according to embodiments of the present invention will be described with reference to the drawings.

FIG. 2 is a flowchart illustrating a method for identifying a wearable wearable device 100 according to an exemplary embodiment of the present invention.

Referring to FIG. 2, a method of identifying a wearable wearable device using a glass wearable device according to an embodiment of the present invention includes the steps of: (a) receiving a wireless communication signal transmitted from the communication device or the wireless communication tag S100); (S110) the glass wearable device recognizing an identity identification code included in the wireless communication signal; (S120) searching for the identity information of the other party corresponding to the identity identification code; And a step (S 130) in which the glass wearable device informs the user of the searched identity information. An identification method using the glass-like wearable device 100 according to an embodiment of the present invention will be described in order.

The wearable wearable device receives a wireless communication signal transmitted from the communication device or the wireless communication tag (S100). The wearable wearable device 100 can actively sense and receive a wireless communication signal transmitted from an external communication device or a wireless communication tag. The wireless communication signal may be a Bluetooth signal such as a beacon signal, a zigbee signal, an RFID signal, an infrared ray (IR) signal, or the like. For example, if the beacon signal corresponds to the wireless communication signal, the wireless communication tag may be a beacon tag, and the glass-like wearable device 100 may actively sense a beacon signal transmitted from the beacon tag.

The wearable wearable device recognizes the identification code included in the wireless communication signal (S110). The wireless communication signal includes an identity identification code, and the glass-like wearable device 100 can receive the wireless communication signal and recognize the identity identification code in the wireless communication signal. That is, the controller 210 analyzes the wireless communication signal and recognizes the identification code included in the wireless communication signal. The identity code may correspond to a group number, an employee number, a resident registration number, a user ID, and the like.

And searches the other party's identity information corresponding to the identity code (S120). The identity information may include the name of the communication device or the wireless communication tag user, image image, rank or position, and other personal information. The wearable wearable device 100 searches for the identity information of the other party based on the identity identification code. The method of searching for the identity information of the other party based on the identity identification code may be such that the control unit 210 searches for the identity information stored in the storage unit 260 of the wearable device 100 can do. Also, as a method for searching for the identity information of the other party based on the identity identification code, the glass-like wearable device 100 transmits the identity identification code to the identity information database server through wireless communication, The database server may search for the identity information corresponding to the ID code and transmit the ID information to the wearable device 100 via wireless communication.

The wearable wearable device informs the user of the detected identity information (S130). The display unit 310 of the glass-like wearable device 100 can visually display and provide the identification information of the other party. In addition, the sound output unit 320 of the wearable type wearable device 100 can perform the notification in such a manner that the identification information of the other party is read aloud.

3 is a flowchart of a method of identifying a wearable wearable device using a face recognition method according to an exemplary embodiment of the present invention.

Referring to FIG. 3, a method of identifying a wearable wearable device using a glass wearable device according to another embodiment of the present invention includes: receiving a wireless communication signal transmitted from the communication device or the wireless communication tag; (S200); (S210) the glass wearable device recognizing an identity identification code included in the wireless communication signal; A step S220 of the glass wearable device acquiring a front image including a face image of the other party; Extracting the face image from the acquired image and setting it as an inspection target (S230); Searching for the other party's identity information corresponding to the identity code (S240); And comparing the image image included in the identification information with the extracted face image to determine whether the extracted face image is the same or not (S250). A method of confirming an identity using a wearable device of a glass type according to an embodiment of the present invention will be described in order. Hereinafter, a detailed description will be omitted.

The glass wearable device receives a wireless communication signal transmitted from the communication device or the wireless communication tag (S200; S100).

The wearable wearable device recognizes the identification code included in the wireless communication signal (S210; the same as S110).

The glass wearable device acquires a forward image including the face image of the other party (S220). The first camera 121 is provided at one side of the glass-like wearable device 100 to acquire a forward image or an image. The first camera 121 may acquire an image of a direction of the user of the glass-like wearable device 100 in order to acquire an image including the face of the other party.

The facial image is extracted from the acquired image and set as an inspection target (S230). That is, the face extraction module of the control unit 210 can extract the image of the face area included in the obtained image. Face extraction (or detection) refers to determining whether a human face exists in a given arbitrary image or image, and, if so, determining the position and range in which each person exists. The face extraction method includes a knowledge-based method for detecting a person using rules between human factors derived from a prior knowledge of human, a human pose, a person-type Feature invariant approach that extracts structural features (Facial Features, Texture, Skin, Multiple Features, etc.) in advance and detects faces by searching and classifying characteristic values in input image, (Template matching method) that extracts the correlation with the input image after describing the standard pattern to be formed and extracts the expression form of the face form from several human type learning images, Based face recognition method (Appearance-based method). These various techniques can be applied to perform facial region extraction. However, the face region extraction method is not limited to the proposed method, but can be implemented by mutually complementing various other techniques and various techniques.

And searches for the identity information of the other party corresponding to the identity identification code (S240; same as S120).

The glass-like wearable device 100 compares the image image included in the identification information with the extracted face image to determine whether the image is the same or not (S250). The face recognition is a process of extracting feature information of a face image or an image from the extracted face region to discriminate the face of the person. Various face recognition algorithms have been developed. Here, the feature information refers to information indicating a unique characteristic of a predetermined face included in a face image or an image. For example, Principal Component Analysis (PCA) and Linear Discriminate Analysis (LDA) can be selected and used for feature information extraction. As another example, a 2-Dimensional Principal Component Analysis (2D-PCA) technique capable of extracting feature information of a facial image based on a two-dimensional image matrix can be used. Since the 2D-PCA technique has a smaller size of the projection matrix than the conventional PCA technique, it can be easily applied to a portable device and a low-end embedded system because the computation amount and required memory can be relatively lowered. Therefore, face recognition can be performed in a short time, and face recognition can be performed in real time. However, the method of extracting the feature information of the face image is not limited to this, and various feature information extraction methods can be applied.

The extracted feature information may be compared with the feature information of the stored face information to determine whether the person corresponding to the identification information and the person corresponding to the extracted face image are the same person. If the distance difference between the extracted feature information and the stored feature information of the opposite face image is within the threshold value, it can be recognized as the same face.

In addition, the method may further include comparing the image image and the extracted face image among the identification information to display the comparison result on the display unit 310 or performing a voice notification if it is determined that the extracted image does not correspond to the same person can do. That is, the glass-type wearable device 100 compares the image image of the identity information with the extracted face image to determine that the matching type does not correspond to the same person. That is, as shown in FIG. 7, Or may be displayed visually on an unfamiliar image, or the sound output unit 320 may generate a notification sound to perform the notification. Accordingly, the user of the glass-like wearable device 100 can prevent the communication device or the non-user of the beacon tag from using the communication device or the beacon tag. For example, in a case where a person who is prohibited from accessing the outside party of a party wants to enter or leave the communication device using the communication device or the beacon tag of a user who is permitted to enter, the security guard or the security guard using the glass wearable device 100 The communication device or the beacon tag can be recognized as being stolen.

The method may further include, when a plurality of face images are extracted in the forward image, comparing each of the image images with the plurality of face images to exclude matching face images from the examination table. When a user wears a wearable wearable glass device and several persons are present in a direction in which they are looking, a plurality of face images can be extracted and a plurality of wireless communication signals can be received. Therefore, the glass-like wearable device 100 can compare each image image with a plurality of face images in order. The glass-like wearable device can exclude the face image matched to the image image on the examination table, and compare the remaining face image with another image image. As a result, compared with the existing method of comparing the extracted face image and the whole face database, the number of comparison operations is remarkably reduced, and the face recognition for identification can be performed quickly.

FIG. 4 is a flow chart of a method of identifying an ID using a wearable device of a glass type by the wireless communication signal transmission direction recognition according to an embodiment of the present invention.

Referring to FIG. 4, a method of identifying a wearable wearable device using a glass wearable device according to another embodiment of the present invention is characterized in that the wearable wearable device receives a wireless communication signal transmitted by the communication device or the wireless communication tag Step S300; (S310) the glass wearable device measures a transmission direction of the wireless communication signal; A step S320 of the glass wearable device acquiring a forward image and recognizing a person in the forward image; And comparing the direction in which the person is located in the forward image and the direction in which the wireless communication signal is transmitted, and recognizing the wireless communication signal corresponding to each person (S330). A method of confirming an identity using a wearable device of a glass type according to an embodiment of the present invention will be described in order. Hereinafter, a detailed description will be omitted.

The wearable wearable device receives a wireless communication signal transmitted by the communication device or the wireless communication tag (S300; S100).

The glass wearable device measures a transmission direction of the wireless communication signal (S310). The wearable wearable device 100 can recognize the direction in which the wireless communication signal is received based on the strength, direction, etc. of the beacon signal. In addition, when the wearable device of a glass type includes one or more wireless communication modules, it is possible to grasp the transmission direction of the wireless communication signal based on the intensity or the direction of the measured signal of each wireless communication module. Accordingly, it is possible to recognize the location of the communication device or the counterpart having the beacon tag, so that it is possible to recognize who is the counterpart of the recognized identity information.

The glass wearable device acquires a front image and recognizes the person in the front image (S320). The first camera 121 of the glass-like wearable device 100 may acquire an image or an image including a person located in front of the user of the glass-like wearable device 100, as shown in FIG. 5 . Then, the glass-like wearable device 100 can recognize a person from the acquired image or image. The control unit 210 may analyze the image or image based on the shape characteristics of a person and recognize a person in the image or image.

The direction in which the person is located in the front image is compared with the direction in which the wireless communication signal is transmitted, and the wireless communication signal corresponding to each person is recognized (S330). When the glass-like wearable device 100 measures the transmission direction of the wireless communication signal on the basis of the viewing direction, the transmission direction of the wireless communication signal and the position of the person in the forward image can be directly compared. The wearable wearable device 100 can determine whether there is a wireless communication signal corresponding to a person's position.

When the glass-like wearable device recognizes the transmission direction of the wireless communication signal as an azimuth angle, the direction in which the person in the front image is positioned should be expressed as an azimuth angle so as to be compared with the transmission direction of the wireless communication signal. For this purpose, a direction (azimuth angle information) obtained by the motion sensor (for example, a gyro sensor, a geomagnetic sensor) of the wearable device 100 can be recognized, May reflect the position of a person in the image or the image in the obtained azimuth information, and may represent the position of a person who has grasped the user as a reference. Thereafter, the glass-like wearable device 100 can compare the direction in which the person is located and the transmission direction of the wireless communication signal.

Accordingly, the glass-wearable device 100 can recognize which of the other party's identity information the identity information corresponds to. In addition, the identification information may be displayed on the display unit 310 together with the image of the other party so that the user of the wearable device 100 can easily identify the user. Particularly, when the display unit 310 displays the identity information by applying the augmented reality technology, the user can perform identification more quickly and accurately.

When the wireless communication signal corresponding to the direction in which the recognized person is located on the image or image is not transmitted, the glassware-type wearable device 100 does not hold the wireless communication tag or the communication device And notifying the user of the failure. When it is necessary to identify a person who does not transmit a beacon signal for identification among a plurality of people as shown in FIG. 6, the display unit 310 displays the beacon signal in the image captured by the first camera 121 A beacon signal is transmitted to the user in the direction of the beacon signal.

When the wireless communication signal corresponding to the direction in which the person is located in the front image is not transmitted, the glass-like wearable device transmits the wireless communication tag And notifying the user that the user does not hold the message.

8 is an internal configuration diagram of an identity verification system using a glass-like wearable device 100 according to an embodiment of the present invention. In FIG. 5, a detailed description of the configuration described above will be omitted.

Referring to FIG. 8, the identification system using the glass-like wearable device 100 according to another embodiment of the present invention includes a wireless communication unit 250; A control unit 210; A storage unit 260; And an output unit 300.

The wireless communication unit 250 performs a function of receiving a beacon signal transmitted from the communication device or the beacon tag. That is, the wireless communication unit 250 may receive a beacon signal including the identification code of the other party through wireless communication from the communication device or the beacon tag.

The control unit 210 performs a function of performing overall information processing in the system. The control unit 210 includes an identification code recognition module 211; And an identity information search module 212. The identification code recognition module 211 recognizes the identification code included in the beacon signal. The identity information search module 212 searches for the identity information of the persons corresponding to the identity identification code using the identity identification code.

The storage unit 260 stores data so that the identity identification code and the identity information correspond to each other.

The output unit 300 notifies the user of the detected identity information to the wearable device 100. The output unit 300 may include a display unit 310 for visually displaying the identification information captured by the controller 210 or an audio output unit 320 for reading the identification information by voice.

In addition, the first camera 121 may further include: The first camera 121 is provided on one side of the glass-like wearable device 100 to acquire a forward image or image, and acquires an image or an image including a person located in front of the wearable device.

In addition, the control unit 210 may include an image extraction module; And a face recognition module. The image extraction module extracts a person from the image or image acquired by the first camera 121 or extracts a face of a person included in the image or image. The face recognition module recognizes the face of the person in the image or the image to compare the extracted face image with the image of the user in the identity information.

The above-described identification method using the glass-like wearable device according to an embodiment of the present invention is implemented as a program (or application) in combination with the glass-like wearable device 100, which is hardware, .

The above-described program is a program for causing a processor (CPU) of the glass-like wearable device 100 to read the program and execute the methods implemented by the program, C ++, JAVA, machine language, etc., which can be read through the device interface of the device 100. [ Such code may include a function code related to a function or the like that defines necessary functions for executing the above methods, and may execute the functions necessary to execute the functions of the processor of the glass-like wearable device 100 according to a predetermined procedure Procedure-related control codes. This code may also be used when the additional information or media necessary for the processor of the glass-like wearable device 100 to perform the above functions must be referred to at any position (address) of the internal or external memory of the glass-like wearable device 100 You can also include more memory reference related code. When the processor of the glass-like wearable device 100 needs to communicate with any other computer or server that is remote to execute the functions, the code is transmitted to the communication module of the glass-like wearable device 100 And may further include communication related codes such as how to communicate with any other remote computer or server, what information or media should be transmitted or received during communication, and the like.

The medium to be stored is not a medium for storing data for a short time such as a register, a cache, a memory, etc., but means a medium that semi-permanently stores data and is capable of being read by a device. Specifically, examples of the medium to be stored include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, but are not limited thereto. That is, the program may be stored in various recording media on various servers that the glass-like wearable device 100 can access, or on various recording media on the glass-wearable device 100 of the user. In addition, the medium may be distributed to a network-connected computer system so that computer-readable codes may be stored in a distributed manner.

First, the user receives the identification code from the other party having the wireless communication tag or the communication device, thereby easily identifying the identification information. For example, when the user is a security guard or a second person, it is necessary to grasp the identity of the other party. Therefore, the glass-type wearable device 100 can actively sense the wireless communication signal transmitted from the wireless communication tag held by the other party, There is an effect that can be grasped.

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, You will understand. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive.

100: system 110: user input
111: Application 112: Keyboard
113: voice input unit 114: touch pad
115: GPS signal unit 116: Local area communication
120: camera unit 121: first camera
122: second camera 123: third camera
130: sensing unit 131: gyro sensor
132: acceleration sensor 133: pressure sensor
134: iris recognition sensor 135: heart rate detection sensor
136: EMG sensor
210: control unit 211: identification code recognition module
212: Identity information search module 220:
230: situation evaluation module 240: voice-to-text conversion module
250: wireless communication unit 260: memory
270:
300: output unit 310: display unit
320: Acoustic output unit 330:
340: Haptic module

Claims

CLAIMS 1. A method for verifying the identity of a wireless communication device that originates a wireless communication signal for identity identification or a party that has a wireless communication tag using a glass-like wearable device,
Receiving the wireless communication signal transmitted by the communication device or the wireless communication tag by the glass-like wearable device;
Measuring the transmission direction of the wireless communication signal by the glass-type wearable device;
Wherein the glass wearable device acquires a forward image and recognizes a person in the forward image; And
And comparing the direction in which the person is located in the forward image and the direction in which the wireless communication signal is transmitted to identify the person corresponding to each wireless communication signal. Way.

The method according to claim 1,
The wearable wearable device recognizing an identification code included in the wireless communication signal;
Searching for the identity information of the other party corresponding to the identity identification code; And
And displaying the identification information corresponding to the recognized person on a screen.

The method according to claim 1,
When the wireless communication signal corresponding to the direction in which the direction in which the person is located in the front image is not transmitted,
And a step of informing the user of the glass-like wearable device that the glass-wearable device does not hold the wireless communication tag by the recognized person.

The method according to claim 1,
The wearable wearable device recognizing an identification code included in the wireless communication signal;
Extracting a face image in the forward image and setting the extracted face image as an inspection target;
Searching for the identity information of the other party corresponding to the identity identification code; And
And comparing the image image included in the identification information with the extracted face image to determine whether the image is the same person or not.

5. The method of claim 4,
When a plurality of the face images are extracted in the front image,
Comparing each of the image images with the plurality of face images and excluding the matching face image from the examination table.

6. The method of claim 5,
If there is a face image within the inspection object that does not match the image image,
And displaying the non-matching face image on the screen with the glass-type wearable device.

5. The method of claim 4,
Wherein the step of searching for the identity information comprises:
A method of searching for the identity information stored in the wearable device of the glass type or a method of transmitting the identity identification code to the identity information database server and receiving the discovered identity information corresponding to the identity identification code The wearable device being a wearable device.

5. The method of claim 4,
Wherein the identity identification code comprises:
Employee number, employee number, resident registration number, and user ID,
Wherein the identification information comprises:
A name, an image image, a rank or a position, and other personal information.

delete

9. A program for identifying a glass-like wearable device stored in a medium for executing the method of any one of claims 1 to 8 in combination with a glass-like wearable device which is hardware.