WO2016006951A2 - System and method for processing information using wearable device - Google Patents

Abstract

Provided are a system and a method for processing information using a wearable device. The method for processing information using a wearable device according to the present invention comprises the steps of: (S100) designating a route number of a particular bus; (S110) a glasses-type wearable device acquiring a foreground video or image; (S120) recognizing the route number of a vehicle appearing in the foreground video or image; and (S130) if the recognized route number matches the designated route number, then providing a notice of the bus arrival to the user. According to the present invention, a situation in which a user, who is wearing a glasses-type wearable device and is waiting for a bus, misses a bus while engaged in other work via the glasses-type wearable device can be prevented from ocurring.

Description

Information processing system and method using wearable device

The present invention relates to an information processing system and method using a wearable device, and more particularly, to a system and method for information processing data acquired during an activity of a user having a wearable device.

As the information age evolves rapidly, the importance of a display device for realizing a realistic screen is emphasized. An example is a head mounted display (HMD). The head mounted display device is mainly made of a safety glasses or a helmet type device to see the screen in front of the eyes, and was developed to realize virtual reality.

Glass-type wearable devices generally have a small display such as a liquid crystal installed at a position close to both eyes (both eyes) to project an image. Currently, the wearable device is for use in space development, nuclear reactors, military institutions, and medical institutions. Various developments for games and the like are in progress. A glass type wearable device according to the prior art is also disclosed in US Pat. No. US8,427,396.

Although various types of glass wearable devices have been researched and emerged, methods or services that wearers can conveniently utilize in daily life are very limited, and UI (User Interface) or UX (User Experience) suitable for glass wearable devices is very limited. Neither is it being developed. In addition, recently, glass-type wearable devices that can perform most functions by themselves, as well as glass-type wearable devices used in conjunction with mobile terminals such as smartphones, have been developed. Different from the mobile terminal of the need for a service suitable for the characteristics of the glass-type wearable device.

In order to solve this problem, one object of the present invention is to provide a service suitable for a glass-type wearable device that can be utilized by the user or wearer of the glass-type wearable device.

Particularly, an object of the present invention is to provide a service that is specific to a user by acquiring an image or image in front of a glass type wearable device including a specific image (for example, a bus, a truck, a traffic light, a traffic violation, etc.). For example, the present invention provides a system and a method for providing a service such as a bus arrival notice, an arrangement notice, a traffic light change notice, or a traffic law violation vehicle notification.

An information processing method using a wearable device according to an embodiment of the present invention includes: specifying a route number of a specific bus; Acquiring a front image or a front image by the glass type wearable device; Recognizing a route number of the vehicle appearing in the front image or the front image; And providing a bus arrival notification to a user when the recognized route number is the same as the designated route number.

In addition, the route number designation may be characterized by acquiring the front image or the front image including the route number attached to the stop and specifying the character through text recognition.

In addition, the route number designation may be characterized by designating the route number corresponding to the hand gesture in the front image or the front image.

In addition, the route number designation may be characterized by designating the route number by voice recognition of the user.

The method may further include providing wireless communication by receiving driving information of the route number bus, wherein the driving information includes location information of the route number bus close to a current position and estimated time of arrival of the route number bus in real time. It may be at least one of the previous stop departure notification information of the line number bus.

The method may further include providing a user with a rotation direction for acquiring a road image approaching the vehicle through the analysis of the front image.

In addition, the bus arrival notification providing step, if the recognized route number is the same as the designated route number, the step of real-time measuring the distance away from the current location of the bus; And performing a voice guidance corresponding to the separated distance.

In addition, the route number recognition step, the glass-type wearable device for measuring a high or low angle or azimuth; Calculating an expected arrangement range in the forward image of the route number by reflecting the high or low angle; And searching and recognizing the route number within the expected arrangement range.

In addition, the expected placement range calculation step may be calculated by reflecting the body information of the user.

In addition, the route number recognition step, the step of extracting the bus image through the shape or color of the vehicle; And recognizing the route number in the bus image.

In accordance with another aspect of the present invention, an information processing method using a wearable device includes: acquiring, by a glass type wearable device, a front image or an image; Extracting a vehicle image of a target vehicle in the image or image; Acquiring target vehicle identification information from the extracted vehicle image; And comparing the target vehicle identification information with the wanted vehicle identification information and transmitting notification information to the outside through wireless communication, wherein the wanted vehicle identification information is received from an external server in real time or periodically. Type is stored in a wearable device.

The identification information may be at least one of a vehicle number, a vehicle model, color, and appearance characteristic information.

In addition, when the identification information is a vehicle number, the obtaining of the target vehicle identification information may include extracting the vehicle number through text recognition in the vehicle image.

The method may further include obtaining current location information by the glass type wearable device; And acquiring driving direction information of the arrangement vehicle by analyzing the image or the image based on the gazing direction at the time of capturing the image or the image. The transmitting of the notification information comprises: the location information and the It may be characterized by transmitting the driving direction information of the arrangement vehicle.

An information processing method using a wearable device according to another embodiment of the present invention includes the steps of: acquiring, by a glass type wearable device, a front image or an image; Extracting a vehicle image of a target vehicle in the image or image; Extracting a vehicle number of the target vehicle through character recognition in the vehicle image; Transmitting the vehicle number to an external server through wireless communication; And when the target vehicle is an arranging vehicle, the glass type wearable device receiving detailed information of the arranging vehicle from the external server and providing the same to the user.

The front image or the image acquiring step may include acquiring the front image when the license plate occupies a specific ratio or more of the photographed image.

The method may further include excluding a matched region from the search region of the front image or the image compared with the previous front image or the previous front image photographed before a specific time, wherein the search region is configured to extract the vehicle image. It may be an area in the front image or the image to be searched.

The extracting of the vehicle image may include recognizing and extracting a shape corresponding to a previously stored vehicle outline from the front image or the image.

The vehicle number extracting step may include extracting the vehicle number by recognizing the license plate on the basis of an attachment position of the license plate in the vehicle image or a ratio of the vehicle license plate in the vehicle image. It may be performed by at least one or more of the manner of extracting the vehicle number in the vehicle image through a format.

In accordance with another aspect of the present invention, an information processing method using a wearable device includes: acquiring an image or an image by the glass type wearable device; Analyzing the image or the image to recognize a usage state of the glass type wearable device; Determining a shape of a signal lamp or a shape of a signal to be recognized by the glass type wearable device based on the use situation; Searching for the traffic light by the glass type wearable device; Recognizing a signal change of the searched traffic light; And providing the signal change notification to a user.

In addition, the use situation recognition step, it may be characterized in that whether the user performs the driving through the analysis of the image or image.

In addition, the use situation recognition step, when the user is recognized as driving, it may be characterized by recognizing the traffic direction of the vehicle.

An information processing method using a wearable device according to another embodiment of the present invention may include: receiving, by the glass type wearable device, a user's selection of a usage mode; The glass type wearable device identifying and searching for a signal lamp corresponding to the usage mode; Recognizing a signal change of the searched traffic light; And providing the signal change notification to a user.

In addition, the use mode selection step may be characterized in that the user is selected at least one or more of the driving performance, the vehicle traffic direction, the country of use.

In addition, the use mode selection step, the method of being selected by the user's touch operation, the method of recognizing the voice command of the user, the method of receiving the selection by recognizing the user's gesture, the user's blink of the eye to select It may be characterized in that performed by at least one of the receiving manner.

In accordance with another aspect of the present invention, an information processing method using a wearable device includes: obtaining an image or an image including a traffic law violation vehicle with a first camera; Recognizing a current time and a current position and recording the image or image; And transmitting, by the glass type wearable device, the traffic law violation vehicle information to a external server of the report center by wireless communication.

The method may further include selecting a type of traffic law violation to be reported.

The method may further include transmitting and receiving the current location information to the external server, and receiving and providing information on whether the crackdown area or the crackdown time corresponds.

The method may further include receiving and providing the report processing result to a user.

The method may further include extracting a license plate portion of the traffic violation violation vehicle from the image or the image to generate an enlarged image.

The method may further include identifying a vehicle number through text recognition in the image or image.

According to embodiments of the present invention, it has various effects as follows.

First, while the user of the glass wearable device waits for the bus at the bus stop, a situation in which the user wears the glass wearable device while performing another task and misses the bus may be prevented from occurring.

Second, the user can eliminate the inconvenience of continuously checking the bus arrival confirmation system of the bus stop or checking the line number of the incoming bus. It also saves users the hassle of having to keep track of the location of the bus through the application.

Third, help the visually impaired, low vision users, such as the user to observe the bus approach direction, can receive a bus arrival notification. Through this, it is possible to assist the visually impaired, low vision, etc. to use public transportation.

Fourth, it is possible to unknowingly recognize theft and arranging vehicles using the glass type wearable device. In addition, the detection rate of the arranging vehicle can be increased by transmitting location information on which the arranging vehicle is found and detailed information of the arranging vehicle to a pre-registered user or a neighboring user as soon as the arranging vehicle is found.

Fifth, a user of the glass type wearable device may recognize a signal change even without staring at a traffic light. When the driver talks to the passenger seat occupant at the stop sign, the driver may not recognize the signal and may cause traffic jams.

Sixth, when the user has color vision abnormality or is visually impaired, the user may walk by recognizing a signal change in a signal that does not sound a voice by using the signal change notification system and a notification method. Through this, the visually impaired person or color vision impaired person does not properly grasp the walking signal, thereby preventing traffic accidents from occurring.

Seventh, the system can be set to suit the situation of each country, it can be usefully used in Japan, the United Kingdom, and the like, the driving direction of the car is reversed.

Eighth, the user can quickly and easily report when there is an inconvenience caused by a traffic violation violation vehicle. It is very easy because the report is performed to the external server of the report center only by photographing the image or image including the vehicle in violation of the traffic laws.

Ninth, citizens can easily report traffic violations, so that drivers can comply with traffic laws even when there are no police or cameras around. Citizens can act as watchers and report violations at any time, so they obey traffic laws in order to avoid getting drivers fines from citizen reports.

Tenth, it is possible to reduce the number of patrols for police to crack down on traffic laws, and to reduce the number of cameras installed for crackdowns, thereby reducing costs.

Eleventh, the user can determine whether the current location corresponds to the traffic violation enforcement section and decide whether to perform a report, thereby reducing the number of reports that do not correspond to the traffic violation.

1 is a block diagram of a glass type wearable device system according to an exemplary embodiment of the present invention.

2 is an exemplary view of a glass type wearable device related to one embodiment of the present invention.

3 is a diagram illustrating a connection relationship between a glass type wearable device, an external server, and an external device according to an exemplary embodiment of the present invention.

4 is a flowchart illustrating a bus arrival notification method using a glass type wearable device according to an embodiment of the present invention.

5 is an exemplary diagram in which a glass-type wearable device acquires a forward image or a forward image including a route number and specifies a route number according to an embodiment of the present invention.

FIG. 6 is an exemplary view in which a glass type wearable device recognizes the arrival of a route number bus designated by a user and displays it on a screen according to an embodiment of the present invention.

7 is a flowchart illustrating a method of providing a notification to an external device by recognizing an arrangement through a glass type wearable device according to an embodiment of the present invention.

8 is a flow chart of a method for providing detailed information of arrangements received from an external server using a glass type wearable device according to an embodiment of the present invention.

9 is an exemplary screen for providing arrangement notification information using a glass type wearable device according to an embodiment of the present invention.

10 is a flowchart illustrating a signal change notification method using a glass type wearable device according to an embodiment of the present invention.

FIG. 11 is an exemplary view of displaying a signal change of a driver traffic light on a display unit according to an embodiment of the present invention. FIG.

12 is an exemplary diagram showing a signal change of a pedestrian traffic light on a display unit according to an embodiment of the present invention.

13 is a flowchart illustrating a traffic law violation vehicle reporting method using a glass type wearable device according to an embodiment of the present invention.

14 is an exemplary diagram in which a glass type wearable device obtains an image or an image including a traffic violation violation vehicle according to an embodiment of the present invention.

15 is an exemplary diagram of a display unit displaying interruption interval and interruption time information received from an external server according to an embodiment of the present invention.

Advantages and features of the present invention and methods for achieving them will be apparent with reference to the embodiments described below in detail with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various forms. It is provided to fully convey the scope of the invention to those skilled in the art, the invention being defined only by the scope of the claims. Meanwhile, the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. In this specification, the singular also includes the plural unless specifically stated otherwise in the phrase. As used herein, “comprises” and / or “comprising” refers to the presence of one or more other components, steps, operations and / or elements. Or does not exclude additions. In addition, detailed descriptions of well-known functions and configurations that may unnecessarily obscure the subject matter of the present invention will be omitted.

1 is a block diagram of a glass type wearable device system 10 according to an embodiment of the present invention.

Referring to FIG. 1, the glass type wearable device system 10 according to an exemplary embodiment of the present invention may include an input unit 100, a user input unit 110, a keyboard 111, a touch pad 112, and a camera unit 120. ), The first camera 121, the second camera 122, the third camera 123, the sensing unit 130, the gyro sensor 131, the acceleration sensor 132, the pressure sensor 133, iris recognition sensor 134, heart rate detection sensor 135, EMG sensor 136, voice input unit 140, information processing unit 210, voice recognition unit 220, situation evaluation module 230, voice-to-text conversion module 240 ), A wireless communication unit 250, a memory 260, an interface unit 230, an output unit 300, a display unit 310, an audio output unit 320, an alarm unit 330, and a haptic module 340. It includes all or part of. The components shown in FIG. 1 are not essential, so a glassy wearable device with more or less components may be implemented.

2 is an exemplary view of a glass type wearable device related to one embodiment of the present invention.

The components may be provided inside or on one side of the glass type wearable device as shown in FIG. 2.

Hereinafter, the components will be described in order.

The input unit 100 is for inputting an audio signal, a video signal, a user's manipulation signal, a biosignal, and the like. The input unit 100 includes a user input unit 110, a camera unit 120, a sensing unit 130, and a voice input unit 140.

The user input unit 110 generates key input data input by the user for controlling the operation of the device. The user input unit 110 may include a keypad, a keyboard 111, a dome switch, a touch pad (static pressure / capacitance) 112, a jog wheel, a jog switch, a finger mouse, and the like. In particular, when the touch pad forms a mutual layer structure with the display unit 310 to be described later, this may be referred to as a touch screen.

The camera 120 is for inputting a video signal or an image signal, and two or more cameras 120 may be provided according to a configuration aspect of the device. The camera 120 processes image frames such as still images or moving images obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display 310. In addition, the image frame processed by the camera 120 may be stored in the memory 260 or transmitted to the outside through the wireless communication unit 250. In addition, when an image signal or a video signal is used as an input for information processing, the control unit 210 transmits the image signal and the video signal.

The camera unit 120 may include one or more cameras according to the direction or purpose of the captured image. The first camera 121 may be provided at one side of the glass type wearable device to capture an image of the front side. The second camera 122 may be provided at one side of the glass type wearable device to acquire an image or an image in an eyeball direction. The third camera 123 may be provided at the rear or side of the glass type wearable device 10 to acquire an image or an image of the rear or side.

The sensing unit 130 generates a sensing signal for controlling the operation of the device by detecting the current state of the device, such as whether the user wears the glass-shaped wearable device 10 or the position of the device. In addition, the sensing unit 130 may perform a function of an input unit receiving an input signal for information processing of the device, and may perform various sensing functions such as whether an external device is connected or not.

The sensing unit 130 includes a proximity sensor, a pressure sensor 133, a motion sensor, a fingerprint recognition sensor, an iris recognition sensor 134, a heart rate detection sensor 135, a skin temperature sensor, a skin resistance sensor and an electrocardiogram sensor. And various sensors.

The proximity sensor can detect the presence or absence of an approaching object or an object present in the vicinity without mechanical contact. The proximity sensor can detect a proximity object by using a change in an alternating magnetic field or a change in a static magnetic field, or by using a change rate of capacitance. Two or more proximity sensors may be provided according to the configuration aspect.

The pressure sensor 133 may detect whether pressure is applied to the device, the magnitude of the pressure, and the like. The pressure sensor 133 may be installed at a portion of the device requiring detection of pressure according to the use environment. If the pressure sensor 133 is installed in the display 310, a touch input through the display 310 and a greater pressure than the touch input are applied according to the signal output from the pressure sensor 133. The pressure touch input can be identified. In addition, according to the signal output from the pressure sensor 133, it is also possible to know the magnitude of the pressure applied to the display 310 when the pressure touch input.

The motion sensor includes one or more of sensors such as a gyro sensor 131, an acceleration sensor 132, and a geomagnetic sensor, and detects the position or movement of the device using the same. The acceleration sensor 132 that can be used for a motion sensor is a device that converts an acceleration signal in one direction into an electrical signal, and is widely used with the development of micro-electromechanical systems (MEMS) technology. In addition, the gyro sensor 131 is a sensor for measuring the angular velocity, and may sense a direction returned to the reference direction.

The heart rate detection sensor 135 measures the change in the light blood flow rate according to the change in blood vessel thickness due to the heartbeat. The skin temperature sensor measures the skin temperature as the resistance value changes in response to the temperature change. Skin resistance sensors measure the electrical resistance of the skin.

The iris recognition sensor 134 performs a function of recognizing a person using iris information of an eye having unique characteristics for each person. The human iris is completed after 18 months of age, and then the circular iris pattern, which is raised near the inner edge of the iris, is almost unchanged once determined. Therefore, iris recognition is the application of security authentication technology by informatizing the characteristics of different iris for each person. In other words, it is an authentication method developed as a means of identifying people by analyzing the shape and color of the iris and the morphology of the retinal capillaries.

The iris recognition sensor 134 codes and compares the iris pattern with an image signal, and determines the comparison. The general operation principle is as follows. First, when the user's eyes are focused on the mirror in the center of the iris recognizer at a certain distance, the infrared camera adjusts the focus through the zoom lens. Then, the iris camera images the user's iris into a photograph, and the iris recognition algorithm analyzes the iris contrast patterns by area to generate a unique iris code. Finally, a comparison search is performed as soon as the iris code is registered in the database. The iris recognition sensor 134 may be provided inside the second camera 122 disposed in the eye direction, and in this case, the second camera 122 may perform a function of the iris recognition sensor.

The distance sensor includes a distance measurement method between two points, a triangulation method (infrared ray type, natural light type), and ultrasonic type. As in the conventional triangulation principle, the distance between two points is displayed when the measured objects from the two paths are reflected by a right-angle prism and incident on the two image sensors so that the relative positions match. In this case, there are a method of generating natural light (passive type) and a method of emitting infrared rays. The ultrasonic method is a method in which the distance is measured by transmitting an ultrasonic wave having a sharp directivity to the object to be measured and receiving a reflected wave from the object to be measured. The receiving sensor uses a piezoelectric element.

The Doppler radar is a radar that utilizes a phase change of the reflected wave, that is, a Doppler effect of the wave. The doppler radar includes a continuous wave radar that transmits and receives a sine wave which is not pulse modulated, and a pulse radar that uses pulse modulated radio waves as an electromagnetic wave signal waveform.

Continuous wave radar is unsuitable for long range radar because modulating frequency is relatively high in order to obtain the performance of Doppler frequency filter. There are features that can be. The pulse radar measures the distance to the target by the time from pulse transmission to reflection echo reception. There is a method called pulse compression radar that applies frequency modulation or phase modulation within the transmission pulse width.

The voice input unit 140 is for inputting a voice signal and may include a microphone. The microphone receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes it into electrical voice data. The processed voice data may be converted into a form transmittable to the mobile communication base station through the wireless communication unit 250 and output in the call mode. As a microphone, various noise canceling algorithms may be used to remove noise generated while receiving an external sound signal.

The output unit 300 is for outputting an audio signal, an image signal, a video signal or an alarm signal. The output unit 300 may include a display unit 310, a sound output unit 320, an alarm unit 330, and a haptic module 340.

The display 310 displays and outputs information processed by the device. For example, when the device is in a call mode, the device displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the device is in a video call mode or a photographing mode, the captured or received images may be displayed at the same time or simultaneously, and the UI and the GUI may be displayed.

On the other hand, as described above, when the display unit 310 and the touch pad form a mutual layer structure to form a touch screen, the display unit 310 may be used as an input device in addition to the output device. If the display unit 310 is configured as a touch screen, the display unit 310 may include a touch screen panel and a touch screen panel controller.

In addition, the display unit 310 may include a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, and a three-dimensional display. It may include at least one of (3D display). In addition, two or more display units 310 may exist according to the implementation form of the device. For example, the external display unit 310 and the internal display unit 310 may be simultaneously provided in the device.

The display unit 310 may be implemented as a head up display (HUD), a head mounted display (HMD), or the like. HMD (Head mounted Display) is a video display device that you can wear on your head like glasses and enjoy large images. A head up display (HUD) is an image display device for projecting a virtual image onto glass in a user's visible area.

The sound output unit 320 outputs audio data received from the wireless communication unit or stored in the memory 260 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. In addition, the sound output module 320 outputs a sound signal related to a function performed in the device, for example, a call signal reception sound and a message reception sound. The sound output module 320 may include a speaker, a buzzer, and the like.

The alarm unit 330 outputs a signal for notifying occurrence of an event of the device. Examples of events occurring in the device include call signal reception, message reception, and key signal input. The alarm unit 330 outputs a signal for notifying occurrence of an event in a form other than an audio signal or a video signal. For example, the signal may be output in the form of vibration. The alarm unit 330 may output a signal to notify the call signal when the call signal is received or a message is received. Also. When the key signal is input, the alarm unit 330 may output the signal as a feedback to the key signal input. The user may recognize the occurrence of an event through the signal output from the alarm unit 330. The signal for notifying the event occurrence in the device may also be output through the display 310 or the sound output unit 320.

The haptic module 340 generates various haptic effects that a user can feel. A representative example of the haptic effect generated by the haptic module 340 is a vibration effect. When the haptic module 340 generates vibration by the tactile effect, the intensity and pattern of the vibration generated by the haptic module 340 may be converted, and may be output by combining different vibrations or sequentially.

The wireless communication unit 250 may include a broadcast receiving module, a mobile communication module, a wireless internet module, a short range communication module, and a location information module.

The broadcast receiving module receives at least one of a broadcast signal and broadcast related information from an external broadcast management server through a broadcast channel. In this case, the broadcast channel may include a satellite channel, a terrestrial channel, and the like. The broadcast management server may mean a server that generates and transmits at least one of a broadcast signal and broadcast related information, or a server that receives at least one of the pre-generated broadcast signal and broadcast related information and transmits the same to a terminal.

The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast related information may also be provided through a mobile communication network, and in this case, may be received by the mobile communication module. Broadcast related information may exist in various forms.

The broadcast receiving module may receive a broadcast signal using various broadcast systems, and receive a digital broadcast signal using a digital broadcast system. In addition, the broadcast receiving module may be configured to be suitable for all broadcast systems providing broadcast signals as well as such digital broadcast systems. The broadcast signal and / or broadcast related information received through the broadcast receiving module may be stored in the memory 260.

The mobile communication module transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to voice call signal, video call signal, or text / multimedia message transmission and reception.

The wireless internet module refers to a module for wireless internet access, and the wireless internet module may be embedded or external to the device. Wireless Internet technologies include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), long term evolution (LTE), LTE-A Long Term Evolution-Advanced and the like can be used.

The short range communication module refers to a module for short range communication. Beacon, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, etc. may be used as a short range communication technology.

The location information module refers to a module that receives the positioning signal and measures the position of the glass type wearable device. For example, the position information module may correspond to a Global Position System (GPS) module, and the positioning signal may correspond to a GPS signal. The Global Position System (GPS) module receives position information from a plurality of GPS satellites.

The memory 260 may store a program for processing and controlling the controller 210, and may perform a function for temporarily storing input or output data (eg, a message, a still image, a video, etc.). It may be.

The memory 260 may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), RAM The storage medium may include at least one type of storage medium. In addition, the device may operate a web storage that performs a storage function of a memory on the Internet. The memory 260 may be referred to as a storage 260 hereinafter.

The interface unit 230 serves as an interface with all external devices connected to the device. Examples of external devices that connect to the device include wired / wireless headsets, external chargers, wired / wireless data ports, memory cards, card sockets such as Subscriber Identification Module (SIM) or User Identity Module (UIM) cards, Audio I / O (Input / Output) terminals, video I / O (Input / Output) terminals, earphones, and the like. The interface unit 230 may receive data from such an external device or receive power and transfer the power to each component inside the device, and allow the data inside the device to be transmitted to the external device.

The controller 210 typically controls the operation of each unit to perform a function of controlling the overall operation of the device. For example, perform related control and processing for voice calls, data communications, and the like. In addition, the controller 210 performs a function of processing data for multimedia reproduction. In addition, it performs a function of processing the data received from the input unit or the sensing unit 130.

In addition, the controller 210 performs face detection and face recognition for face recognition. That is, the controller 210 may include a face detection module and a face recognition module for face recognition. The face detection module may extract only the face area from the camera image acquired by the camera unit 120. For example, the face detection module extracts a face region by recognizing feature elements in the face such as eyes, nose, and mouth. The face recognition module may generate a template by extracting feature information from the extracted face region, and recognize a face by comparing a template with face information data in a face database.

In addition, the controller 210 may perform a function of extracting and recognizing a character from an image or an image acquired by the camera unit 120. That is, the controller 210 may include a character recognition module for character recognition. Optical character recognition (OCR) may be applied as a character recognition method of the character recognition module. The OCR method converts a typeface image of a document written by a person who can be obtained by an image scan or printed by a machine into a format such as a computer code that can be edited by a computer, and can be implemented by software. For example, the OCR method may compare several standard pattern letters and input characters prepared in advance and select the most similar to the standard pattern letters as the corresponding letters. If the character recognition module includes standard pattern letters of various languages, it is possible to read printed characters of various languages. Such a method is called a pattern matching method among the OCR methods, and the OCR method is not limited thereto, and various methods may be applied. In addition, the character recognition method of the character recognition module is not limited to the OCR method, various methods for recognizing the character on the offline already printed may be applied.

In addition, the controller 210 may perform a function of recognizing a gaze direction based on an eyeball image or an image acquired by the second camera 122. That is, the controller 210 may include a gaze analysis module that performs gaze direction recognition. After measuring the gaze direction and the gaze direction of the user, it is possible to determine the direction that the user looks by calculating by synthesis. The gaze direction refers to a direction of the face of the user and may be measured by the gyro sensor 131 or the acceleration sensor 132 of the sensing unit 130. The gaze direction may be grasped by the gaze analysis module in a direction viewed by the user's pupil. The gaze analysis module may detect a movement of a pupil through analysis of a real-time camera image, and apply a method of calculating a direction of a gaze based on a fixed position reflected by the cornea. For example, through the image processing method, the position of the corneal reflected light by the center of the pupil and the illumination may be extracted and the gaze position may be calculated through the positional relationship thereof.

The controller 210 may be represented by the information processor 210.

The power supply unit receives an external power source and an internal power source under the control of the controller 210 to supply power for operation of each component.

The speech recognition unit 220 performs a function of identifying linguistic meaning content from the speech by automatic means. Specifically, the process of identifying a word or word sequence and extracting meaning by inputting a speech waveform is classified into five categories: speech analysis, phoneme recognition, word recognition, sentence interpretation, and meaning extraction. The voice recognition unit 220 may further include a voice evaluation module for comparing whether the stored voice and the input voice are the same. In addition, the voice recognition unit 220 may further include a voice-to-text conversion module 240 for converting an input voice into text or converting a text into voice.

The EEG signal generation unit generates an EEG signal having a frequency and a waveform for tuning human EEG. That is, the EEG signal generator transmits the vibration of the EEG frequency to the skull to perform the function of tuning the EEG. EEG is the flow of electricity that occurs when a cranial nerve signal is transmitted. These brain waves are delta waves, which are very slow when you sleep, beta waves, which are fast when you are active, and alpha waves, which are medium speeds when you meditate. Therefore, the EEG signal generator may induce alpha waves and theta waves to exert the effects of learning assistance and mental concentration.

3 is a diagram illustrating a connection relationship between the glass type wearable device 10, the external server 20, and the external device 30 according to an embodiment of the present invention.

The glass type wearable device 10 may perform all the processing for information processing therein, but the external server 20 may perform some of the information processing. Accordingly, the glass type wearable device 10 may transmit the data acquired through the input unit 100 or data on which some information processing is performed to the external server 20 as information processing request data. The glass type wearable device 10 may receive information processing result data performed by the external server 20 through wireless communication. The glass type wearable device 10 may provide the received information processing result data to the user through the output unit 300 in various ways. The external server 20 may be different according to a service performed by the glass type wearable device 10.

The glass type wearable device 10 may provide the information processing result data to the user through its output unit 300, or may provide the information processing result data using the external device 30. That is, when the glass type wearable device 10 performs the entire information processing process, the external device 30 may output information processing result data received from the glass type wearable device 10. In addition, when the external server 20 receives the information processing request data from the glass type wearable device 10 to perform some information processing, the external device 30 receives the information processing result data received from the external server 20. You can output The external device 30 may include various devices such as a smartphone, a tablet PC, a smart TV, and an output unit (for example, a display unit provided in the vehicle glass or an internal vehicle sound output unit) provided in the vehicle. .

Hereinafter, a bus arrival notification system, method, and program using a glass type wearable device according to embodiments of the present invention will be described with reference to the accompanying drawings.

4 is a flowchart illustrating a bus arrival notification method of the glass type wearable device according to an exemplary embodiment of the present invention.

4, the bus arrival notification method using the glass-type wearable device according to an embodiment of the present invention, the step of specifying the route number of the particular bus (S100); Acquiring a front image or a front image by the glass type wearable device (S110); Recognizing a route number of the vehicle appearing in the front image or the front image (S120); And providing a bus arrival notification to the user when the recognized route number is the same as the designated route number (S130). A bus arrival notification method using a glass type wearable device according to an embodiment of the present invention will be described in order.

Specify the route number of the specific bus (S100). The glass type wearable device 10 may acquire a front image or a front image including a route number attached to a stop and designate a specific route number through character recognition. As shown in FIG. 5, the glass type wearable device may capture an image or an image including a route number attached to a stop through a first camera, and recognize the route number included in the front image or the image through an OCR method. have.

In addition, the glass type wearable device 10 may designate a route number corresponding to the hand gesture in the front image or the front image. For example, the front image or the front image acquired by the glass type wearable device through the first camera may include one or more bus route numbers, and thus, the route number indicated by the user's finger or the route included in the user's specific hand gesture area. It can be recognized as a route number to designate a number.

In addition, the glass type wearable device 10 may designate a route number to be boarded by voice recognition of the user. That is, the glass type wearable device 10 receives a user's voice input for specifying the bus route number by the voice input unit 140, and recognizes the user's voice input by the voice recognition unit 220 to board the vehicle. You can specify the bus route number. If the user is visually impaired, low vision or elderly person who is difficult to find the route number attached to the bus stop, the user needs to input the desired bus number by voice command.

The glass type wearable device acquires a front image or a front image (S110). That is, the glass type wearable device 10 obtains a front image or image (ie, an image or image including cars passing through the road) including the road situation through the first camera 121.

The glass type wearable device 10 recognizes a route number of a vehicle appearing in the front image or the front image (S120). As shown in FIG. 6, the glass type wearable device 10 recognizes a route number by extracting a number included in a front image or a front image.

In one embodiment of the route number recognition method, the glass type wearable device 10 recognizes the vehicle from the acquired front image or the front image, and recognizes the number attached to the vehicle. Since the vehicle may include a number such as a vehicle number, a bus route number, and the like, the route number of the bus is extracted from one or more recognized numbers using the position of the attached number or letters around the number. For example, if the number is attached to the lower end of the vehicle is attached to the registration number of the vehicle, except that, if attached to the front glass of the vehicle is the route number of the bus is extracted. In addition, if one Hangul syllable is attached in front of the four digit number, it may correspond to the registration number of the vehicle, and the glass type wearable device 10 may automatically exclude the number.

In addition, as an embodiment of the route number recognition method, the glass type wearable device 10 may extract the bus image through the shape of the vehicle, the outline of the vehicle, the color, and the like, and recognize the route number in the bus image. Since a general vehicle other than a bus may include the same number as a bus route number, if only the image corresponding to the bus is extracted and the route number search is performed only within the bus image, the possibility of an error may be reduced. Accordingly, the glass type wearable device 10 may extract a bus image corresponding to the bus shape for line number recognition without excluding a vehicle such as a passenger car based on the bus shape from the search range.

In addition, it is possible to reduce the range of the bus image to be extracted for the route number search based on the color difference according to the type of bus route number (for example, wide area bus, trunk bus, branch bus, village bus, loop bus). However, the method of recognizing the route number of the bus is not limited thereto, and may be implemented by various methods such as a method of recognizing all numbers included in an image or an image and comparing the number with a designated route number.

If the recognized line number and the designated line number match, the glass type wearable device 10 provides a bus arrival notification to the user (S130). As a notification providing method, a method of displaying on the screen of the display 310, a method of providing a voice alarm, a method of providing a vibration alarm, and the like may be applied. That is, when the recognized line number and the designated line number are the same, the glass type wearable device 10 displays the arrival information on the display 310, sounds an alarm, transmits the arrival information by voice, or vibrates. Can be issued to notify the arrival of the bus of the designated route number.

The method may further include receiving and providing driving information of the route number bus through wireless communication. The driving information may include location information of the route number bus close to the current location of the user, real-time arrival time information of the route number, departure stop notification information of the route bus, and the like. For example, the glass type wearable device 10 may receive location information such as a GPS signal of a route number bus that is close to the current location of the user. The glass type wearable device 10 may more accurately grasp the arrival of the designated route number bus through the GPS signal periodically received, and the user may anticipate the arrival of the bus.

In addition, when the GPS signal of the corresponding route bus enters a specific range from the user, the glass type wearable device 10 may allow the first camera 121 to acquire an image or an image. That is, when the glass type wearable device 10 continuously acquires the front image or the front image through the first camera, the power consumption is large, so that the bus is within a certain range based on the GPS signal (for example, the current position of the user). Within a certain radius), it is possible to reduce the power consumption by performing the route number recognition through forward image or image acquisition.

The method may further include calculating the shortest time it takes for the adjacent line number bus to arrive from the position identified by the GPS to the user's position. When receiving the location information by GPS and calculating the shortest time to reach the user's location, the glass-type wearable device 10 performs the GPS signal by detecting the vehicle's route number from a certain time before the shortest arrival time. It can reduce power consumption caused by continuous reception.

The method may further include providing a user with a rotation direction for acquiring a road image approaching the vehicle through the analysis of the front image. The vehicle may not be included in the front image or the front image unless the user wears the glass type wearable device 10 and observes the road direction in which the vehicle approaches. In particular, when the user of the glass type wearable device 10 is visually impaired, the user may have difficulty in identifying a road direction in which the vehicle approaches. Therefore, the glass type wearable device 10 may determine the direction in which the user looks by analyzing the front image or the front image. For example, the glass type wearable device 10 may determine the user's gaze direction based on the position of the road in the front image, the position of the bus stop, the moving direction of the vehicle, and the like. Thereafter, the glass type wearable device 10 may calculate and provide a direction in which the user rotates to observe the direction in which the vehicle approaches. In addition, the glass type wearable device 10 may calculate and provide a degree of rotation (eg, a rotation angle) for the user to observe the vehicle approach direction.

In addition, the glass type wearable device 10 may recognize that the gaze direction has reached within an appropriate range for capturing the approach of the vehicle as a front image through rotation and provide a notification. For example, the glass type wearable device 10 may recognize that a specific vehicle approaches and increases in size in the front image to reach an appropriate viewing direction.

In addition, the bus arrival notification providing step (S130), if the recognized route number is the same as the designated route number, the step of real-time measuring the distance away from the current location of the bus; And performing a voice guidance corresponding to the separated distance. When the user of the glass type wearable device 10 is visually impaired, in order to board a bus having a designated route number, it is necessary to recognize which location the bus has reached based on the user. Therefore, the glass type wearable device 10 may measure a distance in which the bus is away from the current location in real time. The distance may be measured in real time through a Doppler sensor or a distance sensor. Thereafter, the glass type wearable device 10 may provide voice guidance corresponding to a distance separated in real time. For example, the glass type wearable device 10 may read a distance away by voice and may provide a voice notification by adjusting a period of generating a notification sound according to the distance.

In addition, the route number recognition step (S120), the glass-type wearable device for measuring a high or low angle or azimuth; Calculating an expected arrangement range in the forward image of the route number by reflecting the high or low angle; And searching and recognizing the route number within the expected arrangement range. When the glass type wearable device 10 performs the route number search and extraction in the entire front image, it may take a long time, and thus the area to search for the route number needs to be limited. In addition, the area where the route number is located in the front image may vary according to a direction in which the user wears and watches the glass type wearable device 10. For example, the user may hold his / her head slightly while wearing the glass wearable device 10, and the route number may be located in the lower region of the front image as compared to the front view. Therefore, the glass type wearable device 10 needs to measure a high or low angle or azimuth corresponding to the user's gaze direction, and determine an area to search for a bus route number in the front image by reflecting this.

First, the glass wearable device may measure a high or low angle. Thereafter, the glass type wearable device 10 may calculate an expected range of placement in the front image of the route number by reflecting a high or low angle or the azimuth. The glass type wearable device 10 may determine a vertical range to search for a route number through the measured high and low angles, and determine a horizontal range to search for a route number through the measured azimuth angle. Thereafter, the glass type wearable device 10 may search for and recognize the route number within the determined expected arrangement range.

In addition, the step of calculating the expected placement range may be calculated by reflecting the body information of the user. Since the estimated range of the route number may vary according to the height or eye level of the user, the estimated range of the range may be calculated by applying previously stored user's body information.

Bus arrival notification system using a glass-type wearable device according to another embodiment of the present invention includes a first camera 121, the control unit 210, the display unit 310.

The first camera 121 may receive an image or an image including a route number of a bus to be boarded by the user, and perform a function of scanning road conditions as an image or an image. The controller 210 may perform a function of recognizing a route number in the image or image. If the line number recognized from the scanned image or image matches the designated line number, the display 310 may perform a function of indicating the bus arrival to the user.

In addition, the alarm unit 330 may further include. The alarm unit 330 may perform a function of notifying the user of the bus arrival through voice or vibration.

In addition, one embodiment of the present invention may further include a voice input unit 140 and a voice recognition unit 220. The voice input unit 140 performs a function of receiving a voice input of a user for specifying a bus route number. The voice recognition unit 220 may perform a function of recognizing the voice input of the user and designating the route number of the bus to be boarded.

In addition, it may further include a GPS module. The GPS module performs a function of receiving location information of a route number bus close to the user's location. The GPS module can identify the bus arrival information more accurately by grasping the location information of the corresponding route number bus which is the closest from the user. In addition, when the position of the bus enters a predetermined range from the user's position through the GPS module, the first camera 121 acquires an image or an image and recognizes the bus route number through a GPS module. Power consumption due to bus line number recognition can be reduced.

According to the present invention, a situation in which the user of the glass wearable device misses the bus while performing another task with the glass wearable device while waiting for the bus at the bus stop may occur.

In addition, the user can eliminate the inconvenience of continuously checking the bus arrival confirmation system of the bus stop or checking the line number of the incoming bus. It also saves users the hassle of having to keep track of the location of the bus through the application.

In addition, the visually impaired, low vision users, such as to help the user to observe the direction of the bus, the bus arrival notification can be provided. Through this, it is possible to assist the visually impaired, low vision, etc. to use public transportation.

Hereinafter, a vehicle arrangement notification system and method using a glass type wearable device according to embodiments of the present invention will be described with reference to the accompanying drawings.

FIG. 7 is a flowchart illustrating a method of providing a notification to an external device 30 by recognizing an arrangement through a glass type wearable device according to another embodiment of the present invention.

Referring to FIG. 7, a method for notifying a vehicle using a glass type wearable device according to an embodiment of the present invention may include: acquiring, by the glass type wearable device, a front image or a front image (S200); Extracting a vehicle image of a target vehicle in the image or image (S210); Acquiring target vehicle identification information from the extracted vehicle image (S220); And comparing the target vehicle identification information with the arrangement vehicle identification information and transmitting notification information to the outside through wireless communication (S230). Hereinafter, an arrangement notice method using a glass type wearable device according to an embodiment of the present invention will be described in order.

The glass type wearable device acquires a front image or an image (S200). The front image or image is an image or image including a road situation, and is obtained by the first camera 121 of the glass type wearable device 10. The first camera 121 acquires image data or image data including a road situation and stores the image data in the memory 260. The data may be automatically deleted from the memory 260 after a certain time, thereby preventing unnecessary waste of the memory 260.

In addition, when the glass type wearable device 10 acquires the front image, it is necessary to determine timing of acquiring the front image. Therefore, when the license plate occupies a specific ratio or more of the photographed image, the glass type wearable device 10 may acquire the front image by recognizing it as a timing to acquire the front image. For example, the glass type wearable device 10 may recognize the license plate based on the color, the attachment position, or the shape of the license plate, and if the recognized license plate area occupies a specific ratio or more in the photographed image, the front image You can shoot.

The glass type wearable device 10 extracts a vehicle image of a target vehicle by analyzing an image or an image (S210). For example, the glass type wearable device 10 may recognize and extract a shape corresponding to a previously stored vehicle outline from the front image or the image. The glass type wearable device 10 may include contour information corresponding to various vehicles.

Target vehicle identification information is obtained from the extracted vehicle image (S220). The identification information may be one or more of a vehicle number, a vehicle model, color, or appearance characteristic information (for example, tuning and scratching). For example, the vehicle model may be identified through a mark attached to the vehicle, a shape of a light, and the like.

The glass type wearable device 10 compares the target vehicle identification information with the arrangement information and transmits notification information to the outside through wireless communication (S230). The arrangement information may be received from the external server 20 in real time or periodically and stored in the glass type wearable device. That is, the wireless communication unit 250 of the glass type wearable device 10 may periodically receive the arrangement identification information from the server and update the arrangement identification information in the memory 260. Through this, it is possible to prevent the wagon vehicle identification information that the glass type wearable device 10 needs to recognize is missing.

The user receiving the notification information may correspond to a person previously stored by the user of the glass type wearable device in order to transmit the arrangement position information. For example, when the user of the glass type wearable device 10 is a police officer, the counterpart may be a fellow police officer.

In addition, when the identification information is a vehicle number, the obtaining of the target vehicle identification information may include extracting the vehicle number through text recognition in the vehicle image. The glass type wearable device 10 recognizes the license plate and extracts the license plate number based on the attachment position of the license plate in the vehicle image or the ratio of the license plate in the vehicle image, the vehicle number format. The vehicle number may be extracted through a method of extracting the vehicle number from the vehicle image.

The method may further include obtaining current location information by the glass type wearable device; And acquiring driving direction information of the arrangement by analyzing the image or the image based on the gazing direction at the time of capturing the image or the image. The transmitting of the notification information (S230) may include: Information and the driving direction information of the arrangement vehicle. That is, the notification information may include location information of the glass type wearable device having found the arrangement vehicle or driving direction information of the arrangement vehicle. The glass type wearable device 10 may obtain current location information through a GPS module. In addition, the glass type wearable device 10 may obtain driving direction information of the arrangement by analyzing the image or the image based on the gaze direction when the image or the image is captured. For example, when the vehicle included in the front image or the front image approaches the user, the glass type wearable device 10 measures the azimuth angle and recognizes the gazing direction, and the vehicle is traveling in the opposite direction of the gazing direction. Can be identified. The azimuth angle may be measured by a motion sensor such as an acceleration sensor 132 or a gyro sensor 131 of the glass type wearable device 10. In addition, the glass type wearable device 10 compares the position of the vehicle in the previous image with the position of the vehicle in the current image, calculates the moving direction of the vehicle in the image, and reflects the driving direction information of the arrangement vehicle by reflecting the user's gaze direction. Can be calculated.

In addition, a method of acquiring driving direction information of the arranging vehicle, and a method of combining the real-time distance value, the gaze direction, and the current location information with the subject (ie, the arranging vehicle) measured by the glass type wearable device 10. Can be applied. That is, the glass type wearable device 10 may determine the driving direction by determining whether the vehicle is approaching based on the current location of the user.

Through this, the glass type wearable device 10 may provide the other party with the position and the movement path of the wanted vehicle in association with the GPS information.

The method may include a step of excluding a matched region from the search region of the front image or the image compared with the previous front image or the previous front image photographed before a specific time. When the glass type wearable device performs image search and target vehicle identification information corresponding to the target vehicle for the entire image, the time required is long and the amount of analysis data increases, so that the search of some vehicles may be missed. Therefore, the glass type wearable device 10 may set the specific area within the image or the image as the search area to search the target vehicle image and search the target vehicle identification information. That is, the search area may be a specific area within the front image or the image searched to extract the vehicle image. To this end, the glass type wearable device 10 may exclude the matching area from the search area by comparing the previous front image or the previous front image and the previous front image or the current front image photographed before a specific time.

8 is a flow chart of a method for providing detailed information on arrangements received from an external server 20 using a glass type wearable device according to an embodiment of the present invention.

Referring to FIG. 8, a method for notifying a vehicle using a glass type wearable device according to another embodiment of the present invention may include: obtaining, by the glass type wearable device, a front image or an image (S300); Extracting a vehicle image of a target vehicle in the image or image (S310); Extracting a vehicle number of the target vehicle through character recognition in the vehicle image (S320); Transmitting the vehicle number to an external server 20 through wireless communication (S330); And when the target vehicle is an arranging vehicle, receiving the detailed information of the arranging vehicle from the external server 20 by the glass type wearable device (S340). The arrangement of the vehicle notification method using the glass-type wearable device according to an embodiment of the present invention will be described in order. Hereinafter, detailed description of the above-described steps will be omitted.

The glass type wearable device acquires a front image or an image (S300; coincides with S200).

The vehicle image of the target vehicle in the image or image is extracted (S310). For example, the glass type wearable device 10 may extract a vehicle image by recognizing a shape corresponding to a previously stored vehicle outline in the front image or the image.

The glass type wearable device 10 extracts a vehicle number of the target vehicle through character recognition in the vehicle image (S320). The glass type wearable device 10 recognizes the license plate and extracts the license plate number based on the attachment position of the license plate in the vehicle image or the ratio of the license plate in the vehicle image, the vehicle number format. The vehicle number may be extracted by a method of extracting the vehicle number from the vehicle image.

The glass type wearable device 10 transmits the vehicle number to the external server 20 through wireless communication (S330).

When the target vehicle is an arranging vehicle, the glass type wearable device 10 receives detailed information of the arranging vehicle from the external server 20 and provides it to the user (S340). As a method of providing detailed information of the arrangement vehicle, a method of providing a voice notification, a method of displaying on the screen of the display unit, and the like may be applied. For example, as shown in FIG. 9, the glass type wearable device 10 may provide a display screen by enlarging a license plate of a vehicle. In this case, a warning sound or vibration may be provided to attract the user's attention.

The method may further include excluding a matched region from the search region of the front image or the image by comparing the previous front image or the previous front image photographed before a specific time, wherein the search region extracts the vehicle image. May be an area in the front image or the image searched for.

The arrangement notice system using the glass-shaped wearable device 10 according to another embodiment of the present invention, the wireless communication unit 250, the camera 120, the control unit 210, the output unit 300. Hereinafter, the components of the arrangement notice system according to another embodiment of the present invention will be described.

The wireless communication unit 250 may perform a function of receiving the identification information of the arrangement. In addition, the wireless communication unit 250 pre-registers the position information of the glass-shaped wearable device 10 and the detailed information of the arrangement, if the analyzed vehicle identification information corresponds to the identification information of the arrangement. You can send it to a user or an adjacent user.

The camera 120 performs a function of scanning road conditions as an image or an image. The camera 120 may be one or more of a plurality of cameras attached to the glass type wearable device 10.

The controller 210 analyzes identification information of the vehicle captured in the scanned image or the image.

If the analyzed vehicle identification information corresponds to the identification information of the arrangement vehicle, the output unit 300 performs a function of notifying whether the user of the glass type wearable device corresponds. The output unit 300 may be one or more of the display unit 310, the voice output module 320, or the haptic module 340.

According to the present invention, it is possible to unknowingly recognize theft and arranging vehicles using a glass type wearable device. In addition, the detection rate of the arranging vehicle can be increased by transmitting location information on which the arranging vehicle is found and detailed information of the arranging vehicle to a pre-registered user or a neighboring user as soon as the arranging vehicle is found.

Hereinafter, a signal change notification system and method using a glass type wearable device according to embodiments of the present invention will be described with reference to the accompanying drawings.

10 is a flowchart illustrating a signal change notification method using a glass type wearable device according to an exemplary embodiment of the present invention.

Referring to FIG. 10, the signal change notification method using the glass type wearable device according to an exemplary embodiment of the present invention may include: searching for a traffic light by the first camera 121 of the glass type wearable device (S400); Recognizing a signal change of the found traffic light (S410); And notifying the user of the signal change (S420). A signal change notification method using a glass type wearable device according to an embodiment of the present invention will be described in order.

The first camera 121 of the glass wearable device searches for a traffic light (S400). The first camera 121 receives an image or an image in a direction viewed by the user, and the controller 210 searches for a traffic light in the input image or image. The shape of the traffic light to be searched by the control unit 210 is stored in the storage unit 260, so that the control unit 210 receives the shape of the traffic light from the storage unit 260 and compares it with the shapes in the image or images. Find out.

The glass type wearable device 10 recognizes a signal change of the searched traffic light (S410). That is, when a signal change of the searched signal lamp occurs, the control unit 210 of the glass type wearable device 10 recognizes the signal change. The recognition of the signal change may be performed by recognizing the color change of the traffic light or the change of the shape displayed on the traffic light.

For example, if the controller 210 recognizes the signal change according to the color of the signal, the controller 210 recognizes the red light as a stop signal and recognizes the green light as the straight signal. In addition, if the control unit 210 recognizes the signal change considering the existing signal and the changed signal together, if it is changed from the red light to the green light is recognized as a straight signal, if it is changed from the green light to the red light, it is recognized as a stop signal, and red light If the red light (or yellow light) is recognized again (or yellow light) after the (or yellow light), it can be recognized as a caution progress signal.

For example, when the control unit 210 recognizes the signal change according to the change of the shape displayed on the traffic light, the glass type wearable device 10 distinguishes the stop signal shape and the walking signal shape displayed on the pedestrian traffic light and signals the signal. Can be identified. In addition, in order to recognize the straight signal and the rotation signal in the driver signal, the glass type wearable device 10 may recognize each signal shape separately. However, the method of recognizing the signal change of the searched traffic light is not limited to the previously presented method, and the signal change of the traffic light may be recognized, such as a method of applying the color change of the traffic light and the change of the signal shape displayed on the traffic light together. Various methods can be applied.

The glass type wearable device 10 notifies the user of the signal change (S420). That is, the signal is changed to the pedestrian or driver who is not watching the signal, the visually impaired person who cannot confirm the walking signal, or the pedestrian or driver who has difficulty in distinguishing the color of the signal. The notification of the signal change may be performed by a notification by the sound output unit 320, a notification displayed on the display 310, a notification by vibration, or the like.

The notification by the sound output unit 320 may be implemented so that the user recognizes the sound by a warning sound corresponding to a signal change through the sound output unit 320 or reads a signal change message by voice.

The notification displayed on the display 310 displays the signal change information as a message on the display 310 as shown in FIG. 11 or 12 so that the user can recognize it. In addition, an image of a traffic light scanned by the first camera 121 may be enlarged and displayed on the display 310.

The notification by the vibration causes the vibration alarm unit of the glass type wearable device to generate a vibration so that the user can recognize the vibration.

However, the method of notifying the user of the signal change is not limited to the previously presented method, and may be implemented in various ways through the output unit of the glass type wearable device.

In addition, the signal change notification step (S420), it may be characterized in that the notification method is different depending on the type of the signal. For example, the stop signal may be notified to the user by the vibration notification, and the straight signal may be notified by the sound output. In addition, the pattern of the vibration signal may be determined differently for each signal, and the vibration pattern may be applied according to the recognized signal. The method of determining the notification method according to the type of signal is not limited thereto, and may be determined in various combinations.

In addition, the signal change notification step (S420), the step of transmitting the signal change information to the external device (30) linked via wireless communication; And informing the user of the signal change by the interworking external device 30.

First, the glass type wearable device 10 may transmit the signal change information to the external device 30 interworking through wireless communication. The interlocked external device 30 may correspond to a display unit or an audio output unit of a vehicle in which a user operates, a communication device such as a smartphone, or an accessory material of the glass type wearable device.

Thereafter, the glass type wearable device 10 may notify the user of a signal change by the interworking external device 30. That is, the glass type wearable device 10 may allow a user to recognize a signal change through the sound output unit, the display unit, and the vibration alarm unit of the interworking external device 30.

In addition, an embodiment of the present invention, the first camera 121, the step of receiving an image or an image; Analyzing the image or the image to determine a usage state of the glass type wearable device; And determining a shape of a signal lamp or a shape of a signal to be recognized by the first camera 121 based on the use situation.

Appropriate signal change recognition may be possible only when the user of the glass type wearable device recognizes the use situation of using the device. For example, it is necessary to know whether the user is walking or driving. In addition, since the direction of rotation of the vehicle may be different because the traffic direction of the vehicle is different for each country, it is necessary to determine whether the vehicle is on the right side or the left side when driving.

Accordingly, the first camera 121 receives an image or an image, and the controller 210 may recognize whether the driver is driving through the analysis of the image or the image and, if applicable, the driving direction of the vehicle. The glass type wearable device 10 may determine a shape of a signal lamp or a shape of a signal to be recognized based on the recognized driving status and a driving direction during driving. Through this, the glass type wearable device 10 may perform a setting suitable for a user's usage situation as the first image or image including a traffic light is acquired.

In one embodiment, the method of recognizing whether the driving is performed may be recognized based on whether the internal configuration of the vehicle is included in the image or image acquired by the first camera 121 or whether the rear image of the other vehicle is included. .

In one embodiment, the method of recognizing the traffic direction of the vehicle may recognize by detecting whether the position of the vehicle coming to the left or the right of the user's vehicle, and is not limited thereto, and may recognize the traffic direction of the vehicle. Various methods may be applied.

In another embodiment, the glass type wearable device 10 may automatically recognize a country being used by recognizing a shape of a signal lamp or a signal shape included in an image or an image. That is, since the rotation direction, the shape of the traffic light, the shape of the signal, the position where the signal light is attached, etc. may be different for each country, the glass type wearable device 10 may extract feature information from an image or an image including a traffic light and use the country. Can be recognized automatically.

The method may further include selecting a usage mode of the glass type wearable device. The user may select a driving mode or a walking mode, and may select a driving direction of the vehicle from the driving mode. In addition, since the shape of the traffic light, the signal shape in the traffic light, the position of the traffic light, etc. may be different depending on the country of use, the user can select a country for driving or walking. Accordingly, the glass type wearable device 10 may set the shape of the signal lamp, the signal shape, the location of the signal lamp, etc. to be searched in the image acquired by the first camera 121 based on the country selected by the user.

The usage mode selection method includes a method of selecting a touch operation using the user input unit 110, receiving a user's voice by the voice input unit 140, and receiving a voice command of the user from the voice recognition unit 220. Recognizing method, a method of receiving a command input by recognizing the gesture of the user by the first camera 121, a method of receiving a command input by recognizing the blink of the user by the second camera 122 It may be implemented by at least one or more.

Signal change notification system using the glass-type wearable device according to another embodiment of the present invention, the first camera 121; Control unit 210; Storage unit 260; And an alarm unit 330.

The first camera 121 may be attached to a front surface of the glass type wearable device 10 to search for a traffic light located in a moving direction of the user and to receive an image or an image including the traffic light.

The controller 210 may recognize a signal change of the searched signal lamp by analyzing an image or an image acquired by the first camera 121. The signal change recognition may be performed by recognizing a color change of a traffic light or a shape change displayed on the traffic light. However, the method of recognizing the signal change of the searched traffic light is not limited to the method described, and various methods of recognizing the signal change of the traffic light, such as a method of applying the color change of the traffic light and the change of the signal shape displayed on the traffic light together. This can be applied.

The storage unit 260 may store a signal type that the control unit 210 should recognize and a notification method according to the signal type. For example, the signal type to be recognized by the controller 210 may include a stop signal, a straight signal, a left turn (or a right turn) signal, a blink signal (attention signal), a driving signal other than the straight and the turn signal while driving. When walking, a stop signal, a walking signal, and a blinking signal of the walking signal may be included. In addition, the storage unit 260 provides a notification method according to the signal type, such as a notification by an audio output when the user is a stop signal, a notification by a display indication when a walking signal, and a vibration notification by a blinking signal of the walking signal. Can be stored. The stored signal type and the notification method according to the signal type are not limited thereto, and may be determined in various types and methods and stored in the storage unit 260.

The alarm unit 330 notifies the user of the signal change. In particular, the alarm unit 330 may include at least one of the sound output unit 320, the haptic module, and the vibration alarm unit.

In addition, an embodiment of the present invention may further include a situation evaluation module 230. The situation evaluation module 230 determines a use situation of the glass type wearable device and determines a shape of a signal lamp or a shape of a signal to be recognized by the first camera 121 based on the use situation. .

In addition, the display unit 310 may further include a. When the signal change is recognized by the control unit 210, the display unit 310 enlarges and displays the signal lamp scanned by the first camera 121 and displays the signal change information as a message. can do.

In addition, the user input unit 110 may further include a. The user input unit 110 performs a function of providing an operation interface so that a user can select the glass type wearable device use mode. The user input unit 110 may be provided at one side of the glass type wearable device and may be implemented as a touch screen when combined with the display unit 310. When the user input unit 110 is provided at one side of the device, the user may select the user input unit 110 according to the number of times the user input unit 110 is operated. In addition, in the form of a touch screen, a user may select a desired mode by touching a portion in which the corresponding mode is displayed on the display 310. However, the method of selecting the use mode by the user input unit 110 is not limited thereto, and various types that can be implemented by the user input unit 110 such as allowing the user input unit 110 to select a mode according to the direction in which the user input unit 110 slides. Manner may be applied.

According to the present invention, a user of the glass type wearable device can recognize a signal change even without staring at a traffic light. When the driver talks to the passenger seat occupant at the stop sign, the driver may not recognize the signal and may cause traffic jams.

In addition, when the user has color vision abnormality or is visually impaired, the signal change notification system and the notification method may be used to recognize and walk the signal change in a signal that does not sound voice. Through this, the visually impaired person or color vision impaired person does not properly grasp the walking signal, thereby preventing traffic accidents from occurring.

In addition, the system can be set to suit the situation of each country, it can be usefully used in Japan, the United Kingdom, and the like in which the driving direction of the car is reversed.

Hereinafter, a traffic notification violation vehicle reporting system and method using a glass type wearable device according to embodiments of the present invention will be described with reference to the accompanying drawings.

Recently, there are many drivers who drive vehicles in violation of traffic laws. In the absence of police or enforcement cameras, violations of traffic laws can lead to serious traffic jams or increased traffic accidents. For example, at an intersection, drivers will sniff with the idea of going fast, resulting in serious traffic jams.

Many local governments have introduced citizen notification systems to prevent such traffic violations. Citizens' report for violation of traffic laws is a system that imposes a penalty if the evidence reported by citizens proves a violation of traffic laws. However, because the reporter must make a report by completing a traffic violation report or report the information such as the shooting location together with the photo file taken by the camera through the smartphone application, it is inconvenient for citizens to make a public report. have. In order to overcome this problem, there is a need for a system and method that allows users to wear the glass-shaped wearable device 10 to report a traffic violation violation vehicle quickly and easily.

13 is a flowchart illustrating a traffic law violation vehicle reporting method using a glass type wearable device according to an embodiment of the present invention.

Referring to FIG. 13, a traffic law violation vehicle reporting method using a glass-type wearable device according to an embodiment of the present invention may include obtaining an image or an image including a traffic law violation vehicle by using a first camera 121 ( S500); Recognizing a current time and a current position and recording the image or image on the image (S510); And transmitting, by the glass type wearable device, the traffic law violation vehicle information to the external server 20 through wireless communication (S520). A traffic notification violation vehicle reporting method using a glass type wearable device according to an embodiment of the present invention will be described in order.

The glass type wearable device 10 acquires an image or an image including a traffic law violation vehicle with a first camera (S500). As shown in FIG. 14, the first camera may acquire an image or image including the traffic law violation vehicle (for example, a bus-only lane violation vehicle as shown in FIG. 14) in a direction that the user observes.

In addition, depending on the traffic law violation type, two or more pictures with a parallax of shooting may be required to confirm the stop condition. For example, when the traffic law violation to be reported is an illegal parking violation, the first camera should acquire two or more pictures having a time difference since the vehicle must be able to confirm that the vehicle is stopped. Therefore, the first camera acquires two or more images at a time difference by a user by operating the user input unit, recognizing a user's motion input by the motion sensor, recognizing a user's blink input, and a voice command. Can be. However, the method of acquiring two or more photographs having the shooting parallax is not limited thereto, and various methods may be applied, such as a method of acquiring an image corresponding to the set parallax automatically by setting the shooting parallax of the first camera. .

In addition, when the first camera 121 photographs an image including the traffic law violation vehicle, when the glass type wearable device 10 reports the traffic law violation such as whether the vehicle is in a stopped state through the image. Identify the information needed for

The glass type wearable device 10 recognizes a current time and a current position and records the image or image in the image or an image (S510). The obtained image or image can be used as evidence of traffic violations only when the current time and current location of the traffic violations vehicle can be accurately recognized. The current location and the current time of acquiring the image or image are information used to notify the driver and the driver of the traffic offense of the traffic location and time. In addition, the current position obtained the image or image is information to determine whether it corresponds to the traffic offense enforcement area, and the current time corresponds to the traffic law enforcement enforcement time zone of the area. It can be information to determine whether or not to. Therefore, the glass type wearable device 10 may add current location and current time information to the image or image acquired by the first camera.

The GPS module of the glass type wearable device receives a satellite signal to recognize a current location of a user, and recognizes a current time through the satellite signal. Thereafter, the controller records the current time and the current position in the video or image through signal processing.

The glass type wearable device 10 transmits traffic law violation vehicle information to wireless communication to an external server 20 of a report center (S520). The wireless communication unit 250 may transmit an image or an image including the traffic law violation vehicle processed by the controller 210 to the external server 20 through wireless communication. The external server 20 may include a report center server of the police station. The traffic law violation vehicle information may include an image or image including the vehicle, an enlarged image of the license plate of the vehicle, the vehicle number, time information and location information obtained from the image or image of the vehicle, and the like.

In addition, the step of receiving the traffic law violation type to be reported; may further include. The traffic violation type is a stop vehicle violation (stop vehicles such as sidewalks, intersections, sidewalks, etc.), bus lane violations, signal violations, crossroad trailing, stop line violations, use of mobile phones while driving, DMB viewing while driving, or driving Heavy smoking may be included. The glass type wearable device 10 may display a traffic law violation type list on the display 310 and select a violation type corresponding to the traffic law violation vehicle from a user. The way of selecting the violation type is a method of operating the user input unit 110 (for example, the touch unit 112) and selecting, a method of the motion sensor recognizes and selects the user's moving pattern, glass type The second camera 122 provided on one side of the wearable device 10 to acquire an image or image in the pupil direction recognizes and selects a user's blink pattern, and a method of recognizing and inputting a user's voice command. Can be applied.

The method may further include transmitting the current location information to the external server 20 and receiving information on whether the crackdown area or the crackdown time corresponds to the user. Depending on the type of traffic law violations, violations may be enforced only within the scope of the enforcement area, and in some cases, violations may only be performed at specific times. For example, in the case of a bus-only lane violation, it is only enforced at a specific operating time within a specific operating section, and thus is only subject to enforcement if the violation is made within the operating time within the operating section. For example, the Southern Loop Road (Yangjae Station Intersection ~ Hakyeooul Station Intersection) is a bus-only hour-time section, and operates only from 7:00 to 10:00 and 17:00 to 21:00 except Saturdays and public holidays. Bus lanes are not a violation. Therefore, the glass type wearable device 10 may provide information on whether the crackdown area or the crackdown time is applicable based on the current location so that the user may determine whether a specific vehicle corresponds to a traffic law violation and decide to perform a report. have.

The glass type wearable device 10 may transmit current location information measured by the GPS module to the external server 20 through wireless communication. The external server 20 may determine whether the traffic law violation is an enforcement section and / or an enforcement time based on the current location information and transmit the same to the glass type wearable device 10 through wireless communication. The glass type wearable device 10 provides the user with the received interruption duration and / or interruption time information. As a method of providing the user, a method of visually displaying the information on the display 310 and providing a voice through the sound output unit 320 may be applied as shown in FIG. 15.

In addition, a user may input and select a traffic violation law type through which a user wants to grasp crackdown section and / or crackdown time information through a voice command. For example, a voice command of “Here's no parking enforcement zone” is input to the glass type wearable device, and the voice recognition unit recognizes a keyword of “parking enforcement” to determine a traffic violation law type. Through this, the identified traffic violation law type and the current location information may be transmitted to the external server 20 to receive and provide only the control section and / or the interruption time information for the traffic violation law type desired by the user. have.

The method may further include receiving and providing the report processing result to a user. When the user reports the traffic law violation vehicle information through wireless communication and the notification processing is properly performed, the external server 20 transmits the report processing result to the glass type wearable device, and the glass type wearable device 10. The report processing result information received by the information processing may be provided to the user. Through this, the user can check whether the report is made to the external server 20 properly.

The method may further include extracting a license plate portion of the traffic violation violation vehicle from the image or the image to generate an enlarged image. In order to identify the traffic law violation vehicle included in the image or image, the vehicle number of the vehicle must be checked. Therefore, the controller 210 may extract the license plate portion of the vehicle from the image or the image. Thereafter, the control unit 210 may generate an enlarged image of the license plate by performing signal processing to identify the vehicle by clearly displaying the extracted license plate portion of the vehicle. Thereafter, the glass type wearable device 10 may include the license plate enlarged image in the traffic law violation vehicle information and transmit it to the external server 20 through wireless communication.

The method may further include identifying a vehicle number through text recognition in the image or image. That is, in order to recognize the vehicle number of the traffic law violation vehicle included in the image or image obtained by the first camera 121, the character recognition module of the controller 210 may identify the vehicle number in the image or image. Can be extracted and recognized.

According to another embodiment of the present invention, a traffic law violation vehicle reporting system using a glass type wearable device includes: a first camera 121; Control unit 210; It includes; a wireless communication unit 250.

The first camera 121 is a camera provided at one side of the glass type wearable device to acquire an image or image of the front, and may perform a function of acquiring an image or image including the traffic law violation vehicle.

The control unit 210 performs information processing to include time information and location information in the image or image, and performs information processing for transmitting to the external server 20 of the report center through wireless communication.

The wireless communication unit 250 transmits the image or the image to the external server 20 to report. The wireless communication unit 250 may include a GPS module, and the GPS module may perform a function of receiving a satellite signal for recognizing current time information and current location information.

According to the present invention as described above, has the following various effects.

First, a user can quickly and easily report when there is an inconvenience caused by a traffic offense. It is very easy because the user is reported to the external server 20 of the report center only by taking a picture or image including the vehicle in violation of the traffic laws.

Second, citizens can easily report traffic violations, so that drivers can obey traffic laws even when there are no police or cameras around. Citizens can act as watchers and report violations at any time, so they obey traffic laws in order to avoid getting drivers fines from citizen reports.

Third, it is possible to reduce the number of patrols for police officers to crack down on traffic laws, and to reduce the number of cameras installed for crackdowns, thereby reducing costs.

Fourth, the user can determine whether the current location corresponds to the traffic violation enforcement section and decide whether to perform a report, thereby reducing the number of reports that do not correspond to the traffic violation.

The information processing method using the glass type wearable device according to the embodiments of the present invention described above is implemented as a program (or an application) to be executed in combination with the glass type wearable device 10 which is hardware, and stored in a medium. Can be.

In the above-described program, in order for the glassy wearable device 10 to read the program and execute the methods implemented as a program, the processor CPU of the glassy wearable device 10 may execute the glassy wearable device ( 10) may include code coded in a computer language such as C, C ++, JAVA, or machine language that can be read through the device interface. Such code may include functional code associated with a function or the like that defines the necessary functions for executing the methods, the execution of which is required for the processor of the glassy wearable device 10 to execute according to a predetermined procedure. Procedure-related control codes. In addition, such code requires that additional information or media required to execute the functions by the processor of the glassy wearable device 10 is referred to at any position (address address) of the internal or external memory of the glassy wearable device 10. It may further include a memory reference code for whether or not. In addition, when the processor of the glass type wearable device 10 needs to communicate with any other computer or server that is remote in order to execute the functions, the code may be configured to communicate with the communication module of the glass type wearable device 10. It may further include communication-related code, such as how to communicate with any other computer or server in the remote, what information or media should be transmitted and received during communication.

The stored medium is not a medium for storing data for a short time such as a register, a cache, a memory, but semi-permanently, and means a medium that can be read by the device. Specifically, examples of the storage medium include, but are not limited to, a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like. That is, the program may be stored in various recording media on various servers accessible by the glass type wearable device 10 or various recording media on the glass type wearable device 10 of the user. The media may also be distributed over network coupled computer systems so that the computer readable code is stored in a distributed fashion.

While the above has been shown and described with respect to preferred embodiments and applications of the present invention, the present invention is not limited to the specific embodiments and applications described above, the invention without departing from the gist of the invention claimed in the claims Various modifications can be made by those skilled in the art, and these modifications should not be individually understood from the technical spirit or the prospect of the present invention.

Claims (31)

1. In the method for providing the arrival notification of the bus the user wants to board using the glass wearable device,

   Designating a line number of a particular bus;

   Acquiring a front image or a front image by the glass type wearable device;

   Recognizing a route number of the vehicle appearing in the front image or the front image; And

   And providing a bus arrival notification to a user if the recognized route number is the same as the designated route number.
2. The method of claim 1,

   The route number designation,

   And acquiring the front image or the front image including the route number attached to the stop and specifying the image through character recognition.
3. The method of claim 2,

   The route number designation,

   And specifying the route number corresponding to the front image or the hand gesture in the front image.
4. The method of claim 1,

   The route number designation,

   And designating the route number by voice recognition of the user.
5. The method of claim 1,

   And receiving and providing driving information of the route number bus for wireless communication.

   The driving information is at least one or more of the location information of the route number bus close to the current position, the real-time arrival time information of the route number bus, the departure stop notification information of the previous route number bus, information processing method using a wearable device. .
6. The method according to any one of claims 1 to 5,

   And providing a user with a rotation direction for acquiring a road image approaching the vehicle through analysis of the front image to the user.
7. The method according to any one of claims 1 to 5,

   The bus arrival notification providing step,

   If the recognized route number is the same as the designated route number, real-time measurement of a distance from the bus from the current location; And

   And performing voice guidance corresponding to the separated distance.
8. The method according to any one of claims 1 to 5,

   The route number recognition step,

   Measuring the high or low azimuth angle of the glass type wearable device;

   Calculating an expected arrangement range in the forward image of the route number by reflecting the high or low angle; And

   And retrieving and recognizing the route number within the expected arrangement range.
9. The method of claim 8,

   The expected placement range calculation step,

   The information processing method using the wearable device, characterized in that calculated by reflecting the body information of the user.
10. The method according to any one of claims 1 to 5,

    The route number recognition step,

    Extracting the bus image through a shape or color of the vehicle; And

    Recognizing the route number in the bus image; information processing method using a wearable device.
11. Obtaining a front image or an image by the glass type wearable device;

    Extracting a vehicle image of a target vehicle in the image or image;

    Acquiring target vehicle identification information from the extracted vehicle image; And

    And comparing the target vehicle identification information with the arrangement vehicle identification information and transmitting notification information to the outside through wireless communication.

    The arrangement information is received in real time or periodically from an external server and stored in the glass-type wearable device, information processing method using a wearable device.
12. The method of claim 11,

    The identification information,

    An information processing method using a wearable device, characterized in that at least one of vehicle number, vehicle type, color or appearance characteristic information.
13. The method of claim 12,

    If the identification information is a vehicle number,

    The target vehicle identification information obtaining step,

    And extracting the vehicle number through text recognition in the vehicle image.
14. The method of claim 11,

    Acquiring current location information by the glass type wearable device; And

    Acquiring driving direction information of the arrangement vehicle by analyzing the image or the image based on the gazing direction at the time of photographing the image or the image;

    The notification information transmitting step,

    And transmitting the position information and the driving direction information of the arrangement vehicle.
15. Obtaining a front image or an image by the glass type wearable device;

    Extracting a vehicle image of a target vehicle in the image or image;

    Extracting a vehicle number of the target vehicle through character recognition in the vehicle image;

    Transmitting the vehicle number to an external server through wireless communication; And

    And receiving, by the glass type wearable device, detailed information of the wanted vehicle from the external server and providing the same to the user when the target vehicle is a wanted vehicle.
16. The method according to any one of claims 11 to 15,

    The front image or image acquisition step,

    And obtaining the front image when the license plate occupies a specific ratio or more of the photographed image.
17. The method according to any one of claims 11 to 15,

    And excluding a matched region from the search region of the front image or the image compared with the previous front image or the previous front image photographed before a specific time.

    The search area is an information processing method using a wearable device, the area of the front image or the image searched to extract the vehicle image.
18. The method according to any one of claims 11 to 15,

    The vehicle image extraction step,

    And recognizing and extracting a shape corresponding to a previously stored vehicle outline from the front image or the image.
19. The method according to claim 13 or 15,

    The vehicle number extraction step,

    A method of extracting the vehicle number by recognizing the license plate based on the attachment position of the license plate in the vehicle image or the ratio of the vehicle license plate in the vehicle image; An information processing method using a wearable device, characterized in that performed by at least one or more of the method of extracting a vehicle number.
20. In the glass wearable device to recognize a signal change to provide a notification to the user,

    Acquiring an image or an image by the glassy wearable device;

    Analyzing the image or the image to recognize a usage state of the glass type wearable device;

    Determining a shape of a signal lamp or a shape of a signal to be recognized by the glass type wearable device based on the use situation;

    Searching for the traffic light by the glass type wearable device;

    Recognizing a signal change of the searched traffic light; And

    Providing the signal change notification to a user; Information processing method comprising a, wearable device.
21. The method of claim 20,

    The use situation recognition step,

    Recognizing whether or not the user performs the driving through the analysis of the image or image, Information processing method using a wearable device.
22. The method of claim 21,

    The use situation recognition step,

    And when the user is recognized as driving, recognizing a traffic direction of the vehicle.
23. In the glass wearable device to recognize a signal change to provide a notification to the user,

    The glass type wearable device receiving a selection of a usage mode from a user;

    The glass type wearable device identifying and searching for a signal lamp corresponding to the usage mode;

    Recognizing a signal change of the searched traffic light; And

    Providing the signal change notification to a user; Information processing method comprising a, wearable device.
24. The method of claim 23,

    The use mode selection step,

    And at least one of a driving performance, a vehicle traffic direction, and a country of use are selected by the user.
25. The method of claim 23 or 24,

    The use mode selection step,

    Performed by at least one of a method of being selected through a touch operation of the user, a method of recognizing a voice command of the user, a method of receiving a selection by recognizing the user's gesture, and a method of receiving a selection by recognizing the blinking of the user Information processing method using a wearable device, characterized in that the.
26. In the method of recognizing and reporting traffic violations using a glass wearable device,

    Acquiring an image or an image including a traffic violation violation vehicle with a first camera;

    Recognizing a current time and a current position and recording the image or image; And

    And transmitting, by the glass-type wearable device, the traffic law violation vehicle information to an external server of the report center by wireless communication, and reporting the information.
27. The method of claim 26,

    Selecting a traffic law violation type to be reported; further comprising, information processing method using a wearable device.
28. The method of claim 26,

    And transmitting and receiving the current location information to the external server, and receiving and providing information on whether the crackdown area or the crackdown time corresponds to the current location information. The information processing method using the wearable device.
29. The method of claim 26,

    And receiving the report processing result and providing the result to the user. The information processing method using the wearable device.
30. The method of claim 26,

    And extracting a license plate portion of the traffic offense from the image or the image to generate an enlarged image. The information processing method using the wearable device.
31. The method of claim 26,

    Identifying a vehicle number through text recognition in the image or image; and using the wearable device.

Images