KR101592398B1 - System and method for recognizing signal switch by wearable glass device - Google Patents

Abstract

The present invention relates to a signal change notification system and a notification method using a glass-type wearable device.
A method of notifying a signal using a wearable device of a glass type according to an embodiment of the present invention includes: a step S100 of a first camera of the glass-type wearable device searching for a traffic light; Recognizing a signal change of the searched traffic light (S200); And informing the user of the signal change (S300).
According to the present invention, the user of the glass-like wearable device can recognize the signal change even without gazing at the signal lamp. In addition, when the user has a color vision abnormality or a visual impairment, the user can recognize a signal change in a signal lamp that can not be notified of voice and walk using the signal change notification system and the notification method. This makes it possible to prevent a traffic accident from occurring because the visually impaired or the color blind person can not grasp the walking signal properly.

Description

TECHNICAL FIELD [0001] The present invention relates to a signal change notification system and a notification method using a wearable device of a glass type,

The present invention relates to a signal change notification system and a notification method using a glass wearable device, and more particularly, to a system and method for notifying a signal change by using a glass wearable device, And more particularly,

Recently wearable devices are emerging. It has appeared in the form of glasses that are linked to smart phones, and some forms that can operate independently without a smartphone are also emerging.

Generally, the traffic lights installed on the road are composed of a red light indicating stop of running, a green traffic light indicating permission of driving, and a yellow traffic light warning of signal change. Traffic lights. However, according to the relevant laws, a red-blind color blind person can not obtain a driver's license because it is difficult for a red-blind color blind person to distinguish between red and green traffic lights. Red color blindness is divided into red blind and green blind. Red blinds appear red and their complementary cyan color is colorless. Green blind looks green and its complementary red purple colorless.

In addition, a user of a smartphone or a wearable wearable device can not recognize that the user is looking for another task using a smartphone or a wearable wearable device while waiting for a signal on a pedestrian crossing where there are not many pedestrians, There is a case. In addition, drivers sometimes talk with passengers in the passenger seat during a stop signal, fail to recognize the signal change, and cause traffic congestion.

In addition, visually impaired or blind people may not be aware that the signal has changed if the traffic light does not provide a voice alert, and may enter the crosswalk while the signal is incorrect or the gait is blinking, May occur.

It is an object of the present invention to provide a signal change notification system and a notification method using a wearable device of a glass type that recognizes a change in signal to a visually impaired person, a color vision disorder person, or a person who does not watch a traffic light while driving or walking, .

According to another aspect of the present invention, there is provided a method of informing a user of a signal change using a wearable device of a glass type, comprising the steps of: a first camera of the wearable type device searches for a traffic light; Recognizing a signal change of the searched traffic light; And notifying the user of the signal change.

The step of recognizing a signal change of the searched signal may further include recognizing a color change of the traffic light or a change of a shape displayed in a traffic light.

The step of informing the user of the signal change may be performed by at least one of a notification by a sound output unit, a notification by a display unit, and a notification by vibration.

In addition, the notification displayed on the display unit may enlarge and display the signal scanned by the first camera, and may display the signal change information as a message.

In addition, the step of informing the user of the signal change may be characterized in that the notification method is changed according to the type of the signal.

The step of informing the user of the signal change may include: transmitting the signal change information to an external terminal connected through wireless communication; And informing the user of the signal change by the interfaced external terminal.

According to another embodiment of the present invention, there is provided a method of controlling a camera, Analyzing the image or image to grasp the use state of the glass-like wearable device; And determining a type of a signal light or a signal to be recognized by the first camera based on the usage state.

The method may further include selecting a situation in which the user uses the glass-like wearable device.

According to another aspect of the present invention, there is provided a signal change notification system using a wearable device of a glass type, the system comprising: a first camera for searching for a traffic light positioned in a direction of a user and receiving an image or an image including a traffic light; An information processing module for recognizing a signal change of the searched signal through an image or an image received by the first camera; A storage unit for storing a signal type to be recognized by the information processing module and a notification method according to the signal type; And an alarm unit for informing the user of the signal change.

In particular, the alarm unit may include at least one of an audio output unit, a haptic module, and a vibration notification unit.

The mobile terminal may further include a situation evaluation module for determining a usage state of the wearable device and determining a type of a signal or a signal to be recognized by the first camera based on the usage state.

The display unit may further include a display unit for enlarging and displaying the signal scanned by the first camera when the signal change is recognized by the information processing module, and displaying the signal change information in a message.

According to the present invention as described above, the following various effects are obtained.

According to the present invention, the user of the glass-like wearable device can recognize the signal change even without gazing at the signal lamp. It is possible to prevent the occurrence of traffic congestion due to the driver not being able to recognize the signal while talking with the occupant in the passenger seat during the stop signal.

In addition, when the user has a color vision abnormality or a visual impairment, the user can recognize a signal change in a signal lamp that can not be notified of voice and walk using the signal change notification system and the notification method. This makes it possible to prevent a traffic accident from occurring because the visually impaired or the color blind person can not grasp the walking signal properly.

In addition, the system can be set to suit the situation of each country, so that it can be usefully used in Japan, the United Kingdom, etc. where the running direction of the vehicle is opposite.

1 is a flow chart of a signal change notification method using a glass-type wearable device according to a preferred embodiment of the present invention
2 is an exemplary diagram showing a signal change of an operator signal lamp on the display unit;
3 is an exemplary diagram showing a signal change of a pedestrian signal lamp on the display unit;
4 is a perspective view of a wearable device of a glass type according to an embodiment of the present invention.
FIG. 5 is a block diagram of a signal change notification system using a glass-type wearable device according to an embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention, and the manner of achieving them, will be apparent from and elucidated with reference to the embodiments described hereinafter in conjunction with the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. To fully disclose the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout the specification.

Unless defined otherwise, all terms (including technical and scientific terms) used herein may be used in a sense commonly understood by one of ordinary skill in the art to which this invention belongs. Also, commonly used predefined terms are not ideally or excessively interpreted unless explicitly defined otherwise.

The terminology used herein is for the purpose of illustrating embodiments and is not intended to be limiting of the present invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification. The terms " comprises "and / or" comprising "used in the specification do not exclude the presence or addition of one or more other elements in addition to the stated element.

FIG. 1 is a flowchart illustrating a signal change notification method using a glass-type wearable device according to a preferred embodiment of the present invention, and FIG. 2 is an exemplary diagram showing a signal change of an operator signal lamp on a display unit. FIG. 3 is an exemplary view showing a signal change of a pedestrian signal lamp on a display unit, and FIG. 4 is a perspective view of a glass-type wearable device according to an embodiment of the present invention. 5 is a configuration diagram of a signal change notification system using a glass-type wearable device according to an embodiment of the present invention.

1 to 6 show a system 100, a user input unit 110, an application 111, a keyboard 112, a voice input unit 113, a touch pad 114, a GPS signal unit 115, A camera 120, a first camera 121, a second camera 122, a third camera 123, a sensing unit 130, a gyro sensor 131, an acceleration sensor 132, a pressure sensor 133, an iris recognition sensor 134, a heartbeat detection sensor 135, an electromyogram sensor 136, an information processing module 210, a voice recognition unit 220, a situation evaluation module 230, An output unit 300, a display unit 310, an audio output unit 320, an alarm unit 330, a haptic module 340, Lt; / RTI >

The system 100 of the wearable wearable device according to an embodiment of the present invention includes a camera unit 120, an audio input unit 113, a user input unit 110, a sensing unit 130, an output unit 300, A communication unit 250, a memory 260, an interface unit 270, a control unit 210, a situation evaluation module 230, a power supply unit, and a voice recognition unit 220.

The camera unit 120 is for inputting video signals or image signals, and may be provided in accordance with a configuration of the device. The camera unit 120 processes an image frame such as a still image or a moving image obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 310. [ The image frame processed by the camera unit 120 may be stored in the memory 260 or transmitted to the outside through the wireless communication unit 250. [ When an image signal or a video signal is used as an input for information processing, the image signal and the video signal are transmitted to the control unit 210.

The voice input unit 113 is for inputting voice signals and may include a microphone and the like. The microphone receives an external acoustic signal by a microphone in a communication mode, a recording mode, a voice recognition mode, and the like and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication unit and output when the voice data is in the call mode. A variety of noise canceling algorithms may be used to remove the noise generated by the microphone in receiving an external acoustic signal.

The user input unit 110 generates key input data that the user inputs for controlling the operation of the device. The user input unit 110 may include a key pad, a keyboard, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, and a finger mouse. Particularly, when the touch pad has a mutual layer structure with the display unit 310 described later, it can be called a touch screen.

The sensing unit 130 senses the current state of the device such as the open / close state of the device, the position of the device, the presence or absence of the user, and generates a sensing signal for controlling the operation of the device. In addition, the sensing unit 130 may function as an input unit for receiving an input signal for information processing of a device, and may perform various sensing functions such as recognition of connection to an external device.

The sensing unit 130 may include a proximity sensor, a pressure sensor 133, a motion sensor, a fingerprint recognition sensor, an iris recognition sensor 134, a heartbeat detection sensor 135, a skin temperature sensor, And the like.

The proximity sensor makes it possible to detect the presence of an object to be approached or nearby, without mechanical contact. The proximity sensor can detect a nearby object by using the change of the alternating magnetic field or the change of the static magnetic field, or by using the change rate of the capacitance. The proximity sensor may be equipped with two or more sensors according to the configuration.

The pressure sensor 133 can detect whether or not pressure is applied to the device, the magnitude of the pressure, and the like. The pressure sensor 133 may be installed in a part of the device where the pressure needs to be detected depending on the use environment. When the pressure sensor 133 is installed on the display unit 310, a touch input through the display unit 310 and a pressure applied by the touch input The pressure touch input can be identified. Also, according to the signal output from the pressure sensor 133, the magnitude of the pressure applied to the display unit 310 at the time of pressure touch input can be known.

The motion sensor includes at least one of an acceleration sensor 132, a gyro sensor 131, and a geomagnetic sensor, and detects the position and movement of the device using the sensor. The acceleration sensor 132, which can be used for a motion sensor, is a device that converts an acceleration change in one direction into an electric signal and is widely used along with the development of MEMS (micro-electromechanical systems) technology. The acceleration sensor 132 includes a gravity sensor that recognizes a change in gravitational acceleration. Further, the gyro sensor 131 is a sensor for measuring the angular velocity, and can sense the direction of rotation with respect to the reference direction.

The heartbeat detection sensor 135 measures changes in the optical blood flow due to changes in the thickness of the blood vessel caused by the heartbeat in order to collect emotion signals. The skin temperature sensor measures the skin temperature as the resistance value changes in response to the temperature change. The skin resistance sensor measures the skin's electrical resistance.

The iris recognition sensor 134 performs a function of recognizing a person using iris information of an eye having a characteristic unique to each person. The human iris is completed after 18 months of age, and the circular iris pattern, which is raised near the medial side of the iris, is almost unchanged once determined, and the shape of each person is different. Therefore, iris recognition is the application of information technology to security for information of different iris characteristics. That is, it is an authentication method developed to identify people by analyzing the shape and color of iris and the morphology of retinal capillaries.

The iris recognition sensor 134 encodes a pattern of iris and converts it into a video signal to compare and judge. The general operation principle is as follows. First, when the user's eye is aligned with the mirror located at the center of the iris recognizer at a certain distance, the infrared camera adjusts the focus through the zoom lens. After the iris camera images the user's iris as a photo, the iris recognition algorithm analyzes the iris pattern of the iris region to generate iris codes unique to the user. Finally, a comparison search is performed at the same time that the iris code is registered in the database.

The output unit 300 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 300 may include a display unit 310, an audio output module, an alarm unit 330, a haptic module 340, and the like.

The display unit 310 displays and outputs information processed in the device. For example, when the device is in the call mode, a UI (User Interface) or GUI (Graphic User Interface) associated with the call is displayed. When the device is in the video communication mode or the photographing mode, the captured or received image can be displayed individually or simultaneously, and the UI and the GUI are displayed.

Meanwhile, as described above, when the display unit 310 and the touch pad have a mutual layer structure to constitute a touch screen, the display unit 310 can be used as an input device in addition to the output device. If the display unit 310 is configured as a touch screen, it may include a touch screen panel, a touch screen panel controller, and the like.

In addition, the display unit 310 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display (3D display). There may be two or more display units 310 depending on the implementation type of the device. For example, the device may include an external display unit 310 and an internal display unit 310 at the same time.

The display unit 310 may be implemented as a head up display (HUD), a head mounted display (HMD), or the like. HMD (Head Mounted Display) is an image display device that allows you to enjoy large images on your head like glasses. A Head Up Display (HUD) is a video display device that projects a virtual image onto a glass in a visible region of a user.

The sound output module 320 outputs audio data received from the wireless communication unit or stored in the memory 260 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. Also, the sound output module 320 outputs sound signals related to functions performed in the device, for example, call signal reception tones, message reception tones, and the like. The sound output module 320 may include a speaker, a buzzer, and the like.

The alarm unit 330 outputs a signal for notifying the occurrence of an event of the device. Examples of events that occur in a device include receiving a call signal, receiving a message, and inputting a key signal. The alarm unit 330 outputs a signal for notifying the occurrence of an event in a form other than an audio signal or a video signal. For example, it is possible to output a signal in a vibration mode including a vibration alarm unit. The alarm unit 330 may output a signal to notify when a call signal is received or a message is received. Also. When the key signal is input, the alarm unit 330 can output a signal as a feedback signal to the key signal input. The user can recognize the occurrence of an event through the signal output by the alarm unit 330. A signal for notifying the occurrence of an event in the device may also be output through the display unit 310 or the sound output module.

The haptic module 340 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 340 is a vibration effect. When the haptic module 340 generates vibration with a haptic effect, the intensity and pattern of the vibration generated by the haptic module 340 can be converted, and the different vibrations may be synthesized and output or sequentially output.

The wireless communication unit 250 may include a broadcast receiving module, a mobile communication module, a wireless Internet module, a short distance communication module, and a GPS module.

The broadcast receiving module receives at least one of a broadcast signal and broadcast related information from an external broadcast management server through a broadcast channel. At this time, the broadcast channel may include a satellite channel, a terrestrial channel, and the like. The broadcast management server may refer to a server for generating and transmitting at least one of a broadcast signal and broadcast related information and a server for receiving at least one of the generated broadcast signal and broadcast related information and transmitting the broadcast signal to the terminal.

The broadcast-related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information can also be provided through a mobile communication network, in which case it can be received by the mobile communication module. Broadcast-related information can exist in various forms.

The broadcast receiving module receives a broadcast signal using various broadcast systems, and can receive a digital broadcast signal using a digital broadcast system. In addition, the broadcast receiving module may be configured to be suitable for all broadcasting systems that provide broadcast signals as well as the digital broadcasting system. The broadcast signal and / or broadcast related information received through the broadcast receiving module may be stored in the memory 260.

The mobile communication module transmits and receives radio signals to and from at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The wireless Internet module refers to a module for wireless Internet access, and the wireless Internet module can be embedded in a device or externally. Wireless Internet technologies include WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), LTE (Long Term Evolution-Advanced) or the like can be used.

The short-range communication module 116 is a module for short-range communication. Beacon, Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee and the like can be used as a short distance communication technology.

Beacon is a wireless communication device that transmits very small frequency signals around them using a protocol based on Bluetooth 4.0 (BLE-Bluetooth Low Energy). Bluetooth 4.0 allows devices to communicate with devices within approximately 5m to 70m, and is low power with minimal impact on battery life, so you can always turn on Bluetooth with minimal power wastage.

The GPS (Global Position System) module 115 receives position information from a plurality of GPS satellites.

The memory 260 may store a program for processing and controlling the control unit 210 and may perform a function for temporarily storing input or output data (e.g., a message, a still image, a moving image, etc.) It is possible.

The memory 260 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory 260 XD memory 260, etc.), RAM, ROM, and the like. The device may also operate web storage to perform storage functions of memory 260 on the Internet.

The memory 260 may be represented by a storage unit 260 as follows.

The interface unit 270 serves as an interface with all external devices connected to the device. Examples of external devices connected to the device include a wired / wireless headset, an external charger, a wired / wireless data port, a memory 260 card, a Subscriber Identification Module (SIM) or a User Identity Module A card socket, an audio I / O (input / output) terminal, a video I / O (input / output) terminal, and an earphone. The interface unit 270 may receive data from the external device or supply power to the respective components in the device, and may transmit data in the device to the external device.

The control unit 210 typically controls the operation of each unit to control the overall operation of the device. For example, voice communication, data communication, video communication, and the like. In addition, the control unit 210 performs a function of processing data for multimedia reproduction. In addition, it performs a function of processing data input from the input unit or the sensing unit 130.

The control unit 210 may be expressed as an information processing module 210 hereinafter.

The situation evaluation module 230 determines a situation in which the user uses the wearable wearable device based on the criteria stored in the memory 260 or the criteria received from the user. That is, the device usage status of the user is determined based on various criteria, and the system configuration of the device or the signal to be received is determined.

The power supply unit receives external power and internal power under the control of the controller 210, and supplies power necessary for operation of the respective components.

The speech recognition unit 220 performs a function of recognizing verbally meaningful contents from the speech by automatic means. Specifically, a speech waveform is input to identify a word or a word sequence, and a meaning is extracted. The process is largely divided into voice analysis, phoneme recognition, word recognition, sentence analysis, and semantic extraction. The voice recognition unit 220 may further include a voice evaluation module that compares the stored voice with the input voice. The voice recognition unit 220 may further include a voice-to-text conversion module 240 that converts the input voice to text or converts the voice to voice.

Hereinafter, a signal change notification system and a notification method using a glass-type wearable device according to embodiments of the present invention will be described with reference to the drawings.

1 is a flowchart illustrating a signal change notification method using a wearable device of a glass type according to a preferred embodiment of the present invention.

Referring to FIG. 1, a signal change notification method using a glass-like wearable device according to a preferred embodiment of the present invention includes a step S100 of a first camera 121 of the glass-like wearable device searching for a traffic light; Recognizing a signal change of the searched traffic light (S200); And informing the user of the signal change (S300). A signal change notification method using a glass wearable device according to an embodiment of the present invention will be described in order.

The first camera 121 of the glass-like wearable device searches for a traffic light (S100). The first camera 121 receives an image or an image in a direction in which the user views the image and searches for a traffic light in the image or image inputted by the information processing module 210. The shape of the signal lamp to be searched by the information processing module 210 is stored in the storage unit 260 so that the information processing module 210 receives the shape of the signal lamp from the storage unit 260, Or shapes in the image.

And recognizes the signal change of the searched traffic light (S200). That is, when the signal change of the searched signal occurs, the information processing module 210 recognizes the signal change. Recognition of the signal change can be performed by recognizing the color change of the traffic light or the change of the shape displayed on the traffic light.

For example, if the information processing module 210 recognizes the signal change according to the color of the signal, if the information processing module 210 recognizes the red light, it recognizes the signal as a stop signal and recognizes the green light as a straight signal . If the information processing module 210 recognizes that the signal change is considering the existing signal and the changed signal together, the information processing module 210 recognizes the signal as a straight line signal when changing from red light to green light, And when a red light (or yellow light) is recognized again after a red light (or yellow light) (that is, corresponding to a flashing traffic light), it is recognized as a caution signal. In addition, when the information processing module 210 recognizes the signal change according to the change of the shape displayed on the traffic light, the signal can be grasped by distinguishing the stop signal shape and the walking signal shape displayed on the pedestrian signal light. In addition, in order to recognize the straight-ahead signal and the rotation signal, the driver's signal can also recognize each signal shape separately. However, the method of recognizing the signal change of the searched signal lamp is not limited to the proposed method, and a method of recognizing a signal change of a traffic light, such as a method of changing the color of the traffic light and changing a signal shape displayed on the traffic light, Various methods can be applied.

The signal change is notified to the user (S300). That is, it indicates that the signal has changed to a pedestrian or driver who is not watching the signal, a visually impaired person who can not confirm the walking signal, or a pedestrian or driver who is not able to distinguish the color hue.

The notification of the signal change may be performed by at least one of a notification by the sound output unit 320, a notification by the display unit 310, and a notification by vibration.

The notification by the sound output unit 320 may be implemented such that a warning sound corresponding to a signal change is sounded through the sound output unit 320 or a user reads the signal change message by voice.

As shown in FIG. 2 or FIG. 3, the notification displayed on the display unit 310 may display the signal change information on the display unit 310 so that the user can recognize the signal change information. In addition, the image of the traffic signal scanned by the first camera 121 can be enlarged and displayed on the display unit 310.

The notification by the vibration generates a vibration alarm part of the wearable device of the glass type so that the user can recognize it.

However, the method of notifying the user of the signal change is not limited to the proposed method, but can be implemented in various ways through the output unit of the glass-like wearable device.

In addition, the step of informing the user of the signal change (S300) may be characterized in that the notification method is changed according to the type of the signal. For example, the stop signal may be informed to the user by vibration alert, and the straight signal may be informed by acoustic output. In addition, the pattern of the vibration signal may be determined differently for each signal, and the vibration pattern may be applied according to the recognized signal. The method of determining the notification method according to the type of signal is not limited to this, and can be determined in various combinations.

In addition, the step (S300) of informing the user of the signal change may include: transmitting the signal change information to an external terminal connected through wireless communication; And informing the user of the signal change by the interfaced external terminal.

First, the signal change information is transmitted to an external terminal connected through wireless communication. The interlocked external terminal includes a display unit 310 or an audio output unit 320 of a vehicle operated by a user, a communication device such as a smart phone, or an accompanying description of the glass-like wearable device. The wireless communication unit 250 transmits the signal change information to the interworking external terminal.

Thereafter, the interlocked external terminal notifies the user of the signal change. The user can recognize the signal change by the sound output unit 320, the display unit 310, and the vibration alarm unit of the interlocked external terminal.

According to an embodiment of the present invention, the first camera 121 receives an image or an image; Analyzing the image or image to grasp the use state of the glass-like wearable device; And determining a shape of a signal lamp or a signal to be recognized by the first camera 121 based on the usage state.

The user of the glass-type wearable device must recognize the use situation of using the device so that appropriate signal change recognition can be possible. For example, the user should know whether he is walking or driving. In addition, since the direction of the rotation signal may be different due to the direction of travel of the vehicle in each country, it is necessary to determine whether the vehicle is traveling on the right side or on the left side while driving.

Accordingly, when the first camera 121 receives an image or an image, recognizes the operation through the image or image, and recognizes the direction of the vehicle when the vehicle is operating. And determines the shape of the signal lamp or the shape of the signal to be recognized by the first camera 121 based on the detected operation and the traveling direction during operation. The method of recognizing the passing direction of the automobile can recognize and recognize whether the position of the opposite automobile is the left side or the right side of the user's vehicle and various methods of recognizing the passing direction of the automobile are applicable .

The method may further include the step of the user selecting the use mode of the glass-like wearable device. The user can select the driving mode or the walking mode, and can select the direction in which the vehicle is traveling in the driving mode. In addition, it is possible to select the type of the traffic lights that the first camera 121 should recognize according to the driving or walking country. The method for selecting the user using mode may include a method of selecting by using a touch operation using the touch unit 114, a method of selecting a user using a touch input unit 113, A method of recognizing the gesture of the user by the first camera 121 and receiving a command input, a method of recognizing the blink of the user by the second camera 122, Or < / RTI >

5 is a configuration diagram of a signal change notification system using a glass-type wearable device according to an embodiment of the present invention. In FIG. 5, a detailed description of the configuration described above will be omitted.

According to another embodiment of the present invention, a signal change notification system using a glass-like wearable device includes a first camera 121; An information processing module 210; A storage unit 260; And an alarm unit 330.

As shown in FIG. 4, the first camera 121 is attached to a front portion of the glass-like wearable device to search for a traffic light located in the user's traveling direction, and receives a video or image including a traffic light .

The information processing module 210 recognizes a signal change of the searched traffic light through the image or image received by the first camera 121. [ Recognition of the signal change can be performed by recognizing the color change of the traffic light or the change of the shape displayed on the traffic light. However, the method of recognizing the signal change of the searched signal lamp is not limited to the proposed method, and a method of recognizing a signal change of a traffic light, such as a method of changing the color of the traffic light and changing a signal shape displayed on the traffic light, Various methods can be applied.

The storage unit 260 stores a signal type to be recognized by the information processing module 210 and a notification method according to the signal type. For example, the signal type to be recognized by the information processing module 210 includes a stop signal, a straight signal, a left turn (or right turn) signal, a blink signal (attention signal) And a stop signal, a gait signal, and a flicker signal of a gait signal may be included in the case of walking. If the user is walking, the storage unit 260 stores a notification method based on the signal type, such as a notification by sound output when the user is walking, a notification by display on the display of a gait signal, and a vibration notification if the gait is a flickering signal Can be stored. The stored signal type and the notification type according to the signal type are not limited to this, and may be stored in the storage unit 260 in various types and schemes.

The alarm unit 330 informs the user of the signal change. In particular, the alarm unit 330 may include at least one of the sound output unit 320, the haptic module, and the vibration alarm unit.

In addition, an embodiment of the present invention may further include a situation evaluation module 230. The situation evaluation module 230 grasps the use situation of the glass-like wearable device and performs a function of determining the shape of a signal lamp or the shape of a signal to be recognized by the first camera 121 based on the utilization state .

In addition, the display unit 310 may further include: The display unit 310 enlarges and displays the signal scanned by the first camera 121 when the signal change is recognized by the information processing module 210 and displays the signal change information in a message .

Further, the touch unit 114 may further include: The touch unit 114 functions to provide an operation interface so that a user can select the glass wearable device use mode. The touch unit 114 may be provided on one side of the glass-type wearable device, and may be implemented as a touch screen when coupled to the display unit 310. When the touch unit 114 is provided on one side of the device, the user can select the touch unit 114 according to the number of times the touch unit 114 is operated. In addition, in the case of a touch screen, the user can touch a portion indicated by the corresponding mode on the display unit 310 to select a desired mode. However, the present invention is not limited to this, and various modes that can be implemented by the touch unit 114, such as selection of a mode according to a sliding direction of the touch unit 114, Method can be applied.

According to the present invention, the user of the glass-like wearable device can recognize the signal change even without gazing at the signal lamp. It is possible to prevent the occurrence of traffic congestion due to the driver not being able to recognize the signal while talking with the occupant in the passenger seat during the stop signal.

In addition, when the user has a color vision abnormality or a visual impairment, the user can recognize a signal change in a signal lamp that can not be notified of voice and walk using the signal change notification system and the notification method. This makes it possible to prevent a traffic accident from occurring because the visually impaired or the color blind person can not grasp the walking signal properly.

In addition, the system can be set to suit the situation of each country, so that it can be usefully used in Japan, the United Kingdom, etc. where the running direction of the vehicle is opposite.

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, You will understand. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive.

100: system 110: user input
111: Application 112: Keyboard
113: voice input unit 114: touch pad
115: GPS signal unit 116: Local area communication
120: camera unit 121: first camera
122: second camera 123: third camera
130: sensing unit 131: gyro sensor
132: acceleration sensor 133: pressure sensor
134: iris recognition sensor 135: heart rate detection sensor
136: EMG sensor
210: information processing module 220:
230: situation evaluation module 240: voice-to-text conversion module 240
250: wireless communication unit 260: memory
270:
300: output unit 310: display unit
320: Acoustic output unit 330:
340: Haptic module

Claims (12)

delete delete delete A method of providing a notification to a user by recognizing a signal change in a glass-like wearable device,
Receiving the user's country of use from the user in the use mode of the glass-like wearable device;
Setting a shape of a traffic light and a shape of a rotation signal based on the country of use;
Searching for the traffic light according to the set traffic light type;
Recognizing a signal change of the searched traffic light; And
And providing the user with the signal change notification. delete delete delete A system in which a glass-like wearable device recognizes a signal change and provides a notification to a user,
A first camera for acquiring a forward image or an image of the user;
A user input unit for selecting a country to be used by a user;
A signal lamp type and a rotation signal type are set based on the country of use, the image or image obtained by the first camera is analyzed, the signal lamp is searched according to the set signal type, A processor; And
And an output unit for providing the user with the signal change notification. delete delete delete delete

Images