KR20160007341A

KR20160007341A - Method and program for the alarm of bus arriving by wearable glass device

Info

Publication number: KR20160007341A
Application number: KR1020150042539A
Authority: KR
Inventors: 한성철; 엄정한; 김진영; 이경현; 김대중; 김석기; 유철현; 김주천; 김주원
Original assignee: 넥시스 주식회사
Priority date: 2014-07-10
Filing date: 2015-03-26
Publication date: 2016-01-20
Also published as: KR101684264B1

Abstract

The present invention relates to a bus arrival notification method of a wearable device of a glass type and a program for a wearable device using the same.
A bus arrival notification method using a glass-like wearable device according to an embodiment of the present invention includes: specifying a route number of a specific bus; Obtaining a front image or a front image of the glass-like wearable device; Recognizing a route number of the vehicle appearing in the forward image or the forward image; And providing a bus arrival notification to a user when the recognized route number is equal to the designated route number. According to the present invention, it is possible to prevent a situation where a user of a wearable device of a glass-like wearable device performs another task while waiting for a bus at a bus stop and then misses the bus. In addition, the user can solve the inconvenience of continuously checking the bus arrival confirmation system of the bus stop or continuously checking the route number of the incoming bus. Also, it is possible to reduce the inconvenience that the user has to continuously check the position of the bus through the application.

Description

TECHNICAL FIELD [0001] The present invention relates to a method of notifying arrival of a bus of a wearable device of a glass type, and a program of a wearable device using the same,

The present invention relates to a bus arrival notification method of a wearable device of a glass type and a program for a wearable device using the same. More particularly, the present invention relates to a bus type wearable device which recognizes a bus route number of a road, And a notification program and a notification program.

Recently wearable devices that can be worn by individuals are emerging. It appears in the form of a clock that works in conjunction with a smartphone, and it also appears in the form of glasses.

Many smartphone users often wait for a bus at a bus stop and perform other tasks with their smartphone, often failing to recognize the arrival of the bus and miss the bus.

In addition, users have the inconvenience of continuing to check the bus arrival notification system to confirm that the bus to be boarded is coming in. Even if the bus is notified that the bus will be coming in soon, It is inconvenient to keep track of the route number of the bus in order to confirm whether or not it is a desired bus.

Also, in a bus stop without a bus arrival notification system, there is an inconvenience that a smartphone user has to grasp the position of a bus which is to be continuously routed through an application. Even if the application confirms the position of the bus and the expected arrival time, There is an inconvenience to miss the bus.

A method of notifying arrival of a bus-shaped wearable device that can recognize a bus arrival even if the user does not continuously check the route number of a bus that is entering the bus stop using a glass-type wearable device, and a program for a glass- .

According to another aspect of the present invention, there is provided a method of notifying arrival of a bus using a glass-like wearable device, the method comprising: specifying a route number of a specific bus; Obtaining a front image or a front image of the glass-like wearable device; Recognizing a route number of the vehicle appearing in the forward image or the forward image; And providing a bus arrival notification to a user when the recognized route number is equal to the designated route number.

In addition, the route number designation may be performed by obtaining the forward image or the forward image including the route number attached to the stop, and designating the image through character recognition.

The route number designation may specify a route number corresponding to the hand gesture in the forward image or the forward image.

The route number designation may specify the route number by voice recognition of the user.

The method of claim 1, further comprising: receiving and providing travel information of the route number bus by wireless communication, wherein the travel information includes location information of the route number bus close to the current location, , And the previous bus stop announcement information of the route bus.

The method may further include providing the user with a direction of rotation for obtaining the road image through which the vehicle approaches the front image through analysis of the forward image.

The bus arrival notification step may include: real-time measurement of a distance from the current position of the bus when the recognized route number is equal to the designated route number; And performing voice guidance corresponding to the distance.

The route number recognizing step may include: measuring the elevation angle or azimuth angle of the glass-like wearable device; Calculating an expected placement range in the forward image of the route number by reflecting the elevation angle or the azimuth angle; And searching and recognizing the route number within the predicted placement range.

Further, the expected placement range calculating step may be configured to reflect the physical information of the user.

The route number recognizing step may include extracting the bus image through the shape or color of the vehicle; And recognizing the route number in the bus image. A bus arrival notification program for a glass-like wearable device according to another embodiment of the present invention may be combined with hardware to transmit the bus arrival Executes the notification method, and is stored in the medium.

The details of other embodiments are included in the detailed description and drawings.

According to the present invention, it is possible to prevent a situation where a user of a wearable device of a glass-like wearable device performs another task while waiting for a bus at a bus stop and then misses the bus.

In addition, the user can solve the inconvenience of continuously checking the bus arrival confirmation system of the bus stop or continuously checking the route number of the incoming bus. Also, it is possible to reduce the inconvenience that the user has to continuously check the position of the bus through the application.

In addition, the visually impaired, low vision, etc. can help the user to watch the direction of bus access, and can receive a bus arrival notice. This will help the visually impaired and low vision people to use public transportation.

1 is an internal configuration diagram of a glass-type wearable system according to an embodiment of the present invention.
2 is a perspective view of a wearable wearable device according to an embodiment of the present invention.
3 is a flowchart of a bus arrival notification method according to an embodiment of the present invention.
FIG. 4 is an exemplary diagram of a glass-wearable device recognizing the arrival of a route number bus designated by a user according to an embodiment of the present invention and displaying the arrival on the screen.
FIG. 5 is an exemplary diagram of a glass wearable device acquiring a forward image or a forward image including a route number according to an embodiment of the present invention, and designating a route number.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention, and the manner of achieving them, will be apparent from and elucidated with reference to the embodiments described hereinafter in conjunction with the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Is provided to fully convey the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims. It is to be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification. It is noted that the terms "comprises" and / or "comprising" used in the specification are intended to be inclusive in a manner similar to the components, steps, operations, and / Or additions. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail.

1 is an internal configuration diagram of a glass-type wearable system according to an embodiment of the present invention.

The wearable device system 100 includes a user input unit 110, an application 111, a keyboard 112, a voice input unit 113, a touch pad 114, a GPS signal unit 115 A short distance communication 116, a camera 120, a first camera 121, a second camera 122, a third camera 123, a sensing unit 130, a gyro sensor 131, an acceleration sensor A heart rate detection sensor 135, an electromyogram sensor 136, an information processing unit 210, a voice recognition unit 220, a situation evaluation module 230, A text conversion module 240, a wireless communication unit 250, a memory 260, an interface unit 270, an output unit 300, a display unit 310, an audio output unit 320, an alarm unit 330, And a haptic module 340, all of which are shown in FIG. The glass-like wearable device system 100 may further include other additional configurations.

The camera 120 is for inputting video signals or image signals, and may be provided in accordance with a configuration of the device. The camera 120 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 310. [ The image frame processed by the camera 120 may be stored in the memory 260 or transmitted to the outside through the wireless communication unit 250. [ When an image signal or a video signal is used as an input for information processing, the image signal and the video signal are transmitted to the control unit 210.

The camera unit 120 may include one or more cameras according to the direction or purpose of the image to be photographed. The first camera 121 is provided at one side of the glass-like wearable device so as to take an image of the front side. The second camera 122 may be provided on one side of the glass-like wearable device to obtain an image or an image in the eyeball direction. The third camera 123 is disposed behind or on the side of the glass-type wearable device, and can acquire a rearward or lateral image or an image.

The voice input unit 113 is for inputting voice signals and may include a microphone and the like. The microphone receives an external acoustic signal by a microphone in a communication mode, a recording mode, a voice recognition mode, and the like and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication unit and output when the voice data is in the call mode. A variety of noise canceling algorithms may be used to remove the noise generated by the microphone in receiving an external acoustic signal.

The user input unit 110 generates key input data that the user inputs for controlling the operation of the device. The user input unit 110 may include a key pad, a keyboard, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, and a finger mouse. Particularly, when the touch pad has a mutual layer structure with the display unit 310 described later, it can be called a touch screen.

The sensing unit 130 senses the current state of the device such as the open / close state of the device, the position of the device, the presence or absence of the user, and generates a sensing signal for controlling the operation of the device. In addition, the sensing unit 130 may function as an input unit for receiving an input signal for information processing of a device, and may perform various sensing functions such as recognition of connection to an external device.

The sensing unit 130 may include a proximity sensor, a pressure sensor 133, a motion sensor, a fingerprint recognition sensor, an iris recognition sensor 134, a heartbeat detection sensor 135, a skin temperature sensor, And the like.

The proximity sensor makes it possible to detect the presence of an object to be approached or nearby, without mechanical contact. The proximity sensor can detect a nearby object by using the change of the alternating magnetic field or the change of the static magnetic field, or by using the change rate of the capacitance. The proximity sensor may be equipped with two or more sensors according to the configuration.

The pressure sensor 133 can detect whether or not pressure is applied to the device, the magnitude of the pressure, and the like. The pressure sensor 133 may be installed in a part of the device where the pressure needs to be detected depending on the use environment. When the pressure sensor 133 is installed on the display unit 310, a touch input through the display unit 310 and a pressure applied by the touch input The pressure touch input can be identified. In addition, the magnitude of the pressure applied to the display unit 310 at the time of the pressure touch input can be determined according to the signal output from the pressure sensor 133. [

The motion sensor includes at least one of an acceleration sensor 132, a gyro sensor 131, and a geomagnetic sensor, and detects the position and movement of the device using the sensor. The acceleration sensor 132, which can be used for a motion sensor, is a device that converts an acceleration change in one direction into an electric signal and is widely used along with the development of MEMS (micro-electromechanical systems) technology. Further, the gyro sensor 131 is a sensor for measuring the angular velocity, and can sense the direction of rotation with respect to the reference direction.

The heartbeat detection sensor 135 measures the change in the optical blood flow according to the change in the thickness of the blood vessel caused by the heartbeat. The skin temperature sensor measures the skin temperature as the resistance value changes in response to the temperature change. The skin resistance sensor measures the skin's electrical resistance.

The iris recognition sensor 134 performs a function of recognizing a person using iris information of an eye having characteristics unique to each person. The human iris is completed after 18 months of age, and the circular iris pattern, which is raised near the medial side of the iris, is almost unchanged once determined, and the shape of each person is different. Therefore, iris recognition is the application of information technology to security for information of different iris characteristics. That is, it is an authentication method developed to identify people by analyzing the shape and color of iris and the morphology of retinal capillaries.

The iris recognition sensor 134 encodes a pattern of the iris and converts it into a video signal to compare and determine. The general operation principle is as follows. First, when the user's eye is aligned with the mirror located at the center of the iris recognizer at a certain distance, the infrared camera adjusts the focus through the zoom lens. After the iris camera images the user's iris as a photo, the iris recognition algorithm analyzes the iris pattern of the iris region to generate iris codes unique to the user. Finally, a comparison search is performed at the same time that the iris code is registered in the database.

Distance sensors include two-point distance measurement, triangulation (infrared, natural light) and ultrasonic. As in the conventional triangulation principle, when the object to be measured from two paths is reflected by a rectangular prism and incident on two image sensors, the distance between two points is displayed when the relative positions are matched. In this case, there is a method of making natural light (manual type) and a method of emitting infrared rays. The ultrasonic method is a method of transmitting ultrasonic waves having sharp direction to the object to be measured and measuring the time until the reflected wave from the object is received to find the distance. A piezoelectric element is used as the receiving sensor.

The Doppler radar is a radar that uses a Doppler effect of a wave, that is, a phase change of a reflected wave. The Doppler radar includes a continuous wave radar that transmits and receives a sinusoidal wave that is not pulse-modulated, and a pulse radar that uses a pulse-modulated wave to a square wave as an electromagnetic wave signal waveform.

In the continuous wave radar, the modulation frequency is relatively high in order to obtain the performance of the Doppler frequency filter. Therefore, it is inappropriate for the radar for the long distance, but the motion of the human body and the vehicle is reproduced as a stable sound by adopting the Doppler frequency as the audible frequency band. There is a feature that can be. The pulse radar measures the distance to the target by the time from the pulse transmission to the reflection echo reception. There is a method referred to as a pulse compression laser that performs frequency modulation or phase modulation within the transmission pulse width.

The output unit 300 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 300 may include a display unit 310, an audio output module, an alarm unit 330, a haptic module 340, and the like.

The display unit 310 displays and outputs information processed in the device. For example, when the device is in the call mode, a UI (User Interface) or GUI (Graphic User Interface) associated with the call is displayed. When the device is in the video communication mode or the photographing mode, the captured or received image can be displayed individually or simultaneously, and the UI and the GUI are displayed.

Meanwhile, as described above, when the display unit 310 and the touch pad have a mutual layer structure to constitute a touch screen, the display unit 310 can be used as an input device in addition to the output device. If the display unit 310 is configured as a touch screen, it may include a touch screen panel, a touch screen panel controller, and the like.

In addition, the display unit 310 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display (3D display). There may be two or more display units 310 depending on the implementation type of the device. For example, the device may include an external display unit 310 and an internal display unit 310 at the same time.

The display unit 310 may be implemented as a head up display (HUD), a head mounted display (HMD), or the like. HMD (Head Mounted Display) is an image display device that allows you to enjoy large images on your head like glasses. A Head Up Display (HUD) is a video display device that projects a virtual image onto a glass in a visible region of a user.

The audio output unit 320 outputs audio data received from the wireless communication unit or stored in the memory 260 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the sound output module 320 outputs sound signals related to functions performed in the device, for example, call signal reception tones, message reception tones, and the like. The sound output module 320 may include a speaker, a buzzer, and the like.

The alarm unit 330 outputs a signal for notifying the occurrence of an event of the device. Examples of events that occur in a device include receiving a call signal, receiving a message, and inputting a key signal. The alarm unit 330 outputs a signal for notifying the occurrence of an event in a form other than an audio signal or a video signal. For example, it is possible to output a signal in a vibration mode. The alarm unit 330 may output a signal to notify when a call signal is received or a message is received. Also. When the key signal is input, the alarm unit 330 can output a signal as a feedback signal to the key signal input. The user can recognize the occurrence of an event through the signal output by the alarm unit 330. A signal for notifying the occurrence of an event in the device may also be output through the display unit 310 or the sound output unit.

The haptic module 340 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 340 is a vibration effect. When the haptic module 340 generates vibration with a haptic effect, the intensity and pattern of the vibration generated by the haptic module 340 can be converted, and the different vibrations may be synthesized and output or sequentially output.

The wireless communication unit 250 may include a broadcast receiving module, a mobile communication module, a wireless Internet module, a short distance communication module, and a GPS module.

The broadcast receiving module receives at least one of a broadcast signal and broadcast related information from an external broadcast management server through a broadcast channel. At this time, the broadcast channel may include a satellite channel, a terrestrial channel, and the like. The broadcast management server may refer to a server for generating and transmitting at least one of a broadcast signal and broadcast related information and a server for receiving at least one of the generated broadcast signal and broadcast related information and transmitting the broadcast signal to the terminal.

The broadcast-related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information can also be provided through a mobile communication network, in which case it can be received by the mobile communication module. Broadcast-related information can exist in various forms.

The broadcast receiving module receives a broadcast signal using various broadcast systems, and can receive a digital broadcast signal using a digital broadcast system. In addition, the broadcast receiving module may be configured to be suitable for all broadcasting systems that provide broadcast signals as well as the digital broadcasting system. The broadcast signal and / or broadcast related information received through the broadcast receiving module may be stored in the memory 260.

The mobile communication module transmits and receives radio signals to and from at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The wireless Internet module refers to a module for wireless Internet access, and the wireless Internet module can be embedded in a device or externally. Wireless Internet technologies include WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), LTE (Long Term Evolution-Advanced) or the like can be used.

The short-range communication module 116 is a module for short-range communication. Beacon, Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee and the like can be used as a short distance communication technology.

The GPS (Global Position System) module 115 receives position information from a plurality of GPS satellites.

The memory 260 may store a program for processing and controlling the control unit 210 and may perform a function for temporarily storing input or output data (e.g., a message, a still image, a moving image, etc.) It is possible.

The memory 260 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory), a RAM , And a ROM. &Lt; / RTI > The device may also operate a web storage that performs storage functions of the memory on the Internet.

The memory 260 may be represented by a storage unit 260 as follows.

The interface unit 270 serves as an interface with all external devices connected to the device. Examples of external devices connected to the device include card sockets such as a wired / wireless headset, an external charger, a wired / wireless data port, a memory card, a Subscriber Identification Module (SIM) or a User Identity Module (UIM) Audio I / O (input / output) jacks, video I / O (input / output) jacks, and earphones. The interface unit 270 may receive data from the external device or supply power to the respective components in the device, and may transmit data in the device to the external device.

The control unit 210 typically controls the operation of each unit to control the overall operation of the device. For example, voice communication, data communication, video communication, and the like. In addition, the control unit 210 performs a function of processing data for multimedia reproduction. In addition, it performs a function of processing data input from the input unit or the sensing unit 130.

In addition, the control unit 210 performs face detection and face recognition for face recognition. That is, the control unit 210 may include a face detection module and a face recognition module for face recognition. The face detection module can extract only the face region from the camera image acquired by the camera unit 120. [ For example, the face detection module can extract face regions by recognizing feature elements in the face such as eyes, nose, mouth, and the like. The face recognition module extracts feature information from the extracted face region to generate a template, and the face information can be recognized by performing template comparison with the face information data in the face database.

In addition, the control unit 210 may perform a function of extracting and recognizing a character within an image or an image acquired by the camera unit 120. [ That is, the control unit 210 may include a character recognition module for character recognition. An optical character recognition (OCR) method can be applied to the character recognition method of the character recognition module. The OCR method is a method that can be implemented by software by converting a type image of a document written or printed by a person, which can be obtained by image scanning, into a form such as a character code that can be edited by a computer. For example, in the OCR method, a plurality of standard pattern characters prepared in advance and an input character are compared with each other to select the character most similar to the standard pattern character. If the character recognition module includes standard pattern characters of various languages, printed characters of various languages can be read. Such a method is referred to as a pattern matching method among the OCR methods, and the OCR method is not limited thereto and various methods can be applied. In addition, the character recognition method of the character recognition module is not limited to the OCR method, and various methods capable of recognizing already-printed offline characters can be applied.

In addition, the control unit 210 may perform a function of recognizing the gaze direction based on the ocular direction image or the image acquired by the second camera 122. That is, the control unit 210 may include a line of sight analysis module that performs line-of-sight direction recognition. The direction of sight of the user and the direction of the line of sight are measured and then synthesized to determine the direction the user is looking at. The gaze direction refers to the direction of the user's face and can be measured by the gyro sensor 131 or the acceleration sensor 132 of the sensing unit 130. The gaze direction can be grasped by the gaze analysis module in the direction in which the user's pupil looks. The eye-gaze analysis module can detect motion of a pupil through analysis of a real-time camera image and calculate a gaze direction based on a fixed position reflected on the cornea. For example, the location of the cornea reflection light by the center of the pupil and illumination can be extracted through the image processing method and the eye position can be calculated through the positional relationship between them.

The control unit 210 may be expressed as an information processing unit 210 hereinafter.

The power supply unit receives external power and internal power under the control of the controller 210, and supplies power necessary for operation of the respective components.

The speech recognition unit 220 performs a function of recognizing verbally meaningful contents from the speech by automatic means. Specifically, a speech waveform is input to identify a word or a word sequence, and a meaning is extracted. The process is largely divided into voice analysis, phoneme recognition, word recognition, sentence analysis, and semantic extraction. The voice recognition unit 220 may further include a voice evaluation module that compares the stored voice with the input voice. The voice recognition unit 220 may further include a voice-to-text conversion module 240 that converts the input voice to text or converts the voice to voice.

The EEG signal generator generates an EEG synchronized signal having a frequency and a waveform for synchronizing human brain waves. That is, the EEG coherent signal generator performs the function of synchronizing the EEG by transmitting the vibration of the EEG frequency to the skull. Electroencephalogram (EEG) refers to the flow of electricity that occurs when a cranial nerve signal is transmitted. These brain waves are very slow when sleeping Delta wave EEG, when the action is a fast EEG betapa, meditation when the middle rate of the alpha waves are increased. Therefore, the EEG signal generation part can induce the alpha wave and the seta wave, so that the effect of learning assistance and mental concentration can be demonstrated.

A bus arrival notification system, method and program using a glass wearable device according to embodiments of the present invention will now be described with reference to the drawings. Of the bus arrival notification method.

Referring to FIG. 3, a bus arrival notification method using a glass-like wearable device according to an embodiment of the present invention includes: specifying a route number of a specific bus; Obtaining a front image or a front image of the glass-like wearable device; Recognizing a route number of the vehicle appearing in the forward image or the forward image; And providing a bus arrival notification to a user when the recognized route number is equal to the designated route number. A bus arrival notification method using a glass wearable device according to an embodiment of the present invention will be described in order.

The route number of a specific bus is designated (S100). The wearable wearable device 100 can acquire a forward image or a front image including a route number attached to a stop, and specify a specific route number through character recognition. As shown in FIG. 5, the glass-type wearable device photographs an image or an image including a route number attached to a stop via the first camera, and recognizes the route number included in the forward image or the image through an OCR method or the like have.

The wearable wearable device 100 may designate a route number corresponding to the hand gesture in the forward image or the forward image. For example, one or more bus route numbers may be included in the forward image or the front image acquired by the glass-like wearable device through the first camera, so that the route number indicated by the user's finger or the route included in the user's specific hand gesture area The number can be recognized by the route number to be specified.

Further, the glass-like wearable device 100 can designate a route number to which the user desires to ride by voice recognition of the user. That is, the glass-like wearable device 100 receives the user's voice input for specifying the bus route number by the voice input unit 113, recognizes the voice input of the user by the voice recognition unit 220, You can specify the route number of the bus. If the user is a visually impaired person, a low visibility person or a senior citizen who can not find the route number attached to the bus stop, it is necessary to input the desired bus number by voice command.

The wearable device of the glass type acquires the forward image or the front image (S200). That is, the glass-like wearable device 100 acquires a forward image or image (i.e., an image or an image including cars passing through the road) including a road condition through the first camera 121. [

The route number of the vehicle appearing in the forward image or the forward image is recognized (S300). As shown in FIG. 4, the glass-like wearable device 100 extracts numbers included in the forward image or the forward image and recognizes the route number.

In one embodiment of the method of recognizing the route number, the glass-like wearable device 100 grasps the vehicle in the obtained front image or the front image, and recognizes the number attached to the vehicle. Since the number attached to the vehicle may be one or more of a car number, a bus route number, etc., the route number of the bus among the one or more recognized numbers is extracted using the position of the attached number or characters around the number. For example, if it is attached to the bottom part of the vehicle according to the position where the number is attached, it is the vehicle's registration number. In addition, if there is a Korean character before the four-digit number, it corresponds to the registration number of the vehicle, so it is automatically filtered.

Further, in one embodiment of the method of recognizing the route number, the glass-like wearable device 100 extracts the bus image through the shape of the vehicle, the outline of the vehicle, the color, etc., and recognizes the route number in the bus image have. Since the same number as the bus route number may be included in a general vehicle other than the bus, the possibility of an error can be reduced by extracting only the image corresponding to the bus and performing the route number search only in the bus image. Therefore, the glass-type wearable device can extract a bus image corresponding to the bus shape for route number recognition, excluding a vehicle such as a passenger car, not a bus based on the bus shape. In addition, it is possible to reduce the range of the bus image to be extracted for the route number search based on the color difference depending on the type of the bus route number (for example, a wide area bus, a trunk bus, a branch bus, a town bus, and a circulating bus). However, the method of recognizing the route number of the bus is not limited to this, and may be implemented by various methods such as a method of recognizing all the digits included in the image or the image and comparing with the designated route number.

If the recognized route number is equal to the designated route number, a bus arrival notification is provided to the user (S400). As a notification providing method, a method of displaying on the screen of the display unit, a method of providing a voice alarm, a method of providing a vibration alarm, and the like can be applied. That is, if the recognized route number is the same as the designated route number, the glass-like wearable device 100 may display the arrival information on the display unit 310, sound a voice alarm, deliver arrival information by voice, And the arrival of the bus of the designated route number can be notified.

The method may further include the step of receiving and providing travel information of the route number bus through wireless communication. The travel information may include location information of the route number bus close to the current position of the user, information of estimated arrival time of the route number in real time, previous stop notice of the route bus, and the like. For example, the glass-like wearable device 100 may receive position information such as a GPS signal of a nearby route number bus from the current location of the user. The wearable wearable device 100 can more accurately grasp the arrival of the designated route number bus through the periodically received GPS signal and the user can predict the arrival time of the bus.

In addition, when the GPS signal of the route bus arrives within a certain range from the user, the first camera 121 can acquire an image or an image. That is, when the wearable type glass-like device 100 continuously acquires the forward image or the forward image through the first camera, the power consumption is large. Therefore, if the bus enters the predetermined range based on the GPS signal, It is possible to reduce power consumption by performing route number recognition.

Further, the method may further include calculating a shortest time required for the adjacent route number bus to arrive from the location identified by the GPS to the location of the user. When the shortest time required to arrive at the position of the user is calculated by receiving the position information by the GPS, the glass wearable device performs the recognition of the route number of the car from a predetermined time before the shortest arrival scheduled time, Thereby reducing power consumption.

The method may further include providing the user with a direction of rotation for obtaining the road image through which the vehicle approaches the front image through analysis of the forward image. The vehicle can not be included in the front image or the front image unless the user wears the glass-like wearable device 100 and observes the road direction in which the vehicle approaches. In particular, when the user of the wearable wearable device 100 is a visually impaired person, the user may have difficulty in grasping the road direction in which the vehicle approaches. Accordingly, the glass-like wearable device 100 can analyze a forward image or an image to determine a direction that a user looks at. For example, the glass-like wearable device 100 can grasp the direction of the user's viewing based on the position of the road in the forward image, the position of the bus stop, the traveling direction of the vehicle, and the like. Thereafter, the glass-like wearable device 100 can calculate and provide the direction of rotation for the user to watch the direction in which the vehicle approaches. Further, the glass-like wearable device 100 can calculate and provide the degree of rotation (for example, the degree of rotation) for the user to look at the vehicle approaching direction.

In addition, the wearable wearable device 100 can recognize that the direction of sight has reached within a suitable range for taking the approach of the vehicle as a forward image through rotation, and provide a notification. For example, the glass-like wearable device 100 recognizes that a particular vehicle approaches and increases in size in a forward image, and recognizes that the vehicle has reached a proper viewing direction.

The bus arrival notification step may include: real-time measurement of a distance from the current position of the bus when the recognized route number is equal to the designated route number; And performing voice guidance corresponding to the distance. When the user of the glass-like wearable device 100 is a visually impaired person, it is necessary to recognize at which position the bus reaches the user based on the user in order to board the bus of the designated route number. Therefore, the glass-like wearable device 100 can measure the distance of the bus from the current position in real time. The distance may be measured in real time through a Doppler sensor, a distance sensor, or the like. Thereafter, the glass-like wearable device 100 may provide voice guidance corresponding to the real-time distance. For example, the glass-like wearable device 100 can read a distance away by voice, and can adjust a period of the notification sound according to the distance to provide a voice notification.

The route number recognizing step (S300) may include: measuring the elevation angle or azimuth angle of the glass-like wearable device; Calculating an expected placement range in the forward image of the route number by reflecting the elevation angle or the azimuth angle; And searching and recognizing the route number within the predicted placement range. When the wearable wearable device 100 performs route number search and extraction within the entire forward video, it may take a long time, and it is necessary to limit the area to search the route number. In addition, according to the direction in which the wearable wearable device 100 is worn by the user, the region where the route number is located in the forward image may be changed. For example, when the user wears the glass-like wearable device 100 and holds the head slightly, the route number may be located in the lower region of the forward image, as compared with the front view. Therefore, it is necessary for the glass-like wearable device 100 to measure the elevation angle or the azimuth corresponding to the user's gaze direction, and to determine the area to search for the bus route number in the forward image by reflecting this.

First, a glass-like wearable device can measure the elevation angle or the azimuth angle. Thereafter, the glass-like wearable device 100 may calculate the expected placement range of the route number in the forward image by reflecting the elevation angle or the azimuth angle. The wearable wearable device 100 can determine the range of the vertical direction to search for the route number through the measured elevation angle and determine the range of the horizontal direction to search for the route number through the measured azimuth angle. Thereafter, the glass-like wearable device 100 can search for and recognize the route number within the determined estimated placement range.

In addition, the expected placement range calculating step may be calculated by reflecting the body information of the user. The predicted placement range of the route number may vary depending on the user's key or eye level. Therefore, the predicted placement range can be calculated by applying the pre-stored user's body information. The bus arrival notification system includes a first camera 121, an information processing unit 210, and a display unit 310.

The first camera 121 receives an image or an image including a route number of a bus to which the user wishes to board and performs a function of scanning the road condition as an image or an image.

The information processing unit 210 recognizes a route number in the image or image.

The display unit 310 displays the arrival of the bus to the user when the route number recognized from the scanned image or image matches the designated route number.

Further, it may further include an alarm unit 330. The alarm unit 330 performs a function of informing the user of the arrival of the bus through voice, vibration, or the like.

In addition, an embodiment of the present invention may further include a voice input unit 113 and a voice recognition unit 220. [ The voice input unit 113 performs a function of receiving voice input of a user for specifying a bus route number. The voice recognition unit 220 recognizes the voice input of the user and designates the route number of the bus to be boarded.

In addition, it may further include a GPS signal unit 115. The GPS signal unit 115 functions to receive position information of a nearby route number bus from the user's location. The GPS signal unit 115 can grasp the position information of the route number bus closest to the user and grasp bus arrival information more accurately. When the glass wearable device receives the bus or the image through the GPS signal unit 115, the first camera 121 acquires the image or image and recognizes the bus route number , It is possible to reduce power consumption due to long-term bus line number recognition.

The bus arrival notification method using the glass wearable device according to an embodiment of the present invention described above is implemented as a program (or application) to be executed in combination with the glass-like wearable device 100, which is hardware, .

The above-described program is a program for causing a processor (CPU) of the glass-like wearable device 100 to read the program and execute the methods implemented by the program, C ++, JAVA, machine language, etc., which can be read through the device interface of the device 100. [ Such code may include a function code related to a function or the like that defines necessary functions for executing the above methods, and may execute the functions necessary to execute the functions of the processor of the glass-like wearable device 100 according to a predetermined procedure Procedure-related control codes. This code may also be used when the additional information or media necessary for the processor of the glass-like wearable device 100 to perform the above functions must be referred to at any position (address) of the internal or external memory of the glass-like wearable device 100 You can also include more memory reference related code. When the processor of the glass-like wearable device 100 needs to communicate with any other computer or server that is remote to execute the functions, the code is transmitted to the communication module of the glass-like wearable device 100 And may further include communication related codes such as how to communicate with any other remote computer or server, what information or media should be transmitted or received during communication, and the like.

The medium to be stored is not a medium for storing data for a short time such as a register, a cache, a memory, etc., but means a medium which semi-permanently stores data and is capable of being read by a device. Specifically, examples of the medium to be stored include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, but are not limited thereto. That is, the program may be stored in various recording media on various servers that the glass-like wearable device 100 can access, or on various recording media on the glass-wearable device 100 of the user. In addition, the medium may be distributed to a network-connected computer system so that computer-readable codes may be stored in a distributed manner.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention.

100: system 110: user input
111: Application 112: Keyboard
113: voice input unit 114: touch pad
115: GPS signal unit 116: Local area communication
120: camera 121: first camera
122: second camera 123: third camera
130: sensing unit 131: gyro sensor
132: acceleration sensor 133: pressure sensor
134: iris recognition sensor 135: heart rate detection sensor
136: EMG sensor
210: information processing unit 220:
230: situation evaluation module 240: voice-to-text conversion module 240
250: wireless communication unit 260: memory
270:
300: output unit 310: display unit
320: Acoustic output unit 330:
340: Haptic module

Claims

A method of providing an arrival notification of a bus on which a user wishes to board by using a glass-type wearable device,
Specifying a route number of a specific bus;
Obtaining a front image or a front image of the glass-like wearable device;
Recognizing a route number of the vehicle appearing in the forward image or the forward image; And
Providing a bus arrival notice to a user when the recognized route number is equal to the designated route number; and a bus arrival notification method using a glass-like wearable device

The method according to claim 1,
In the route number designation,
Wherein the forward image or the forward image including the route number attached to the stop is acquired and designated through character recognition.

3. The method of claim 2,
In the route number designation,
And the route number corresponding to the hand gesture in the forward image or the forward image is specified.

The method according to claim 1,
In the route number designation,
And the route number is designated by voice recognition of the user.

The method according to claim 1,
Further comprising: receiving and providing travel information of the route number bus by wireless communication,
Wherein the travel information includes at least one of position information of the route number bus close to the current position, information of expected arrival time of the route number bus in real time, and departure notice information of the previous stop of the route number bus, How to get notified.

6. The method according to any one of claims 1 to 5,
And providing the user with a direction of rotation for acquiring a road image on which the vehicle is approaching the front image through analysis of the forward image.

6. The method according to any one of claims 1 to 5,
The bus arrival notification step may include:
Measuring, in real time, the distance of the bus from its current position if the recognized route number is equal to the designated route number; And
And performing voice guidance corresponding to the distance between the user and the user.

6. The method according to any one of claims 1 to 5,
In the route number recognition step,
Measuring the elevation angle or the azimuth angle of the glass-like wearable device;
Calculating an expected placement range in the forward image of the route number by reflecting the elevation angle or the azimuth angle; And
And searching for and recognizing the route number within the predicted placement range.

9. The method of claim 8,
The estimated placement range calculating step may include:
Wherein the body shape information of the user is calculated by reflecting the body information of the user.

6. The method according to any one of claims 1 to 5,
In the route number recognition step,
Extracting the bus image through the shape or color of the vehicle; And
And recognizing the route number in the bus image.

A bus arrival notification program for a glass-like wearable device stored in a medium for executing the method according to any one of claims 1 to 10 in combination with a glass-type wearable device which is hardware.