KR20100083649A - Method for providing position information of mobile terminal and apparatus thereof - Google Patents

Abstract

PURPOSE: A location information providing method of a mobile terminal and a device thereof are provided to generate location information of a vehicle based on speed and movement direction of a vehicle. CONSTITUTION: A speed calculating unit(402-1) calculates speed of a vehicle based on a movement distance of a matching area between a previous image photographed by a photographing unit and a current image and speed of an image frame. An angle calculating unit(402-2) calculates a heading angle of a vehicle based on the movement distance and a distance from the photographing unit to the matching area of the previous image. A location generating unit(402-3) generates location information of a vehicle based on the speed of the vehicle and the heading angle.

Description

METHOD FOR PROVIDING POSITION INFORMATION OF MOBILE TERMINAL AND APPARATUS THEREOF}

The present invention relates to a method and apparatus for providing location information of a mobile terminal.

In general, a mobile terminal, such as a telematics terminal or a navigation apparatus, generates road guidance information based on a global positioning system (GPS) signal and map information, and provides the road guidance information to a user. In addition, a telematics terminal mounted on a vehicle uses a dead-reckoning (DR) sensor to predict a location in a place where a GPS satellite signal cannot be received (for example, a tunnel or a tall building).

SUMMARY OF THE INVENTION An object of the present invention is to provide a method and apparatus for providing location information of a mobile terminal capable of accurately predicting a location of a vehicle in a place (for example, a tunnel or a tall building) where GPS (Global Positioning System) satellite signals cannot be received. To provide.

An apparatus for providing location information of a mobile terminal according to an embodiment of the present invention for achieving the above object, the speed and movement of the vehicle based on the moving distance and direction of the matching area between the previous image frame and the current image frame, and the image frame speed A calculation unit for calculating a direction; And generating a location information of the vehicle based on the speed of the vehicle and the moving direction.

An apparatus for providing location information of a mobile terminal according to an embodiment of the present invention for achieving the above object, calculates the speed of the vehicle based on the moving distance and the image frame speed of the matching area between the previous image frame and the current image frame, The moving direction of the vehicle may be calculated based on the moving distance and the distance from the photographing unit to the matching area of the previous image.

In accordance with an aspect of the present invention, an apparatus for providing location information of a mobile terminal calculates a vehicle speed based on a moving distance and an image frame rate of a matching area between a previous image and a current image captured by a photographing unit. A speed calculator; An angle calculator configured to calculate a heading angle of the vehicle based on the moving distance and the distance from the photographing unit to the matching area of the previous image; It is composed of a position generator for generating position information of the vehicle based on the speed and the heading angle of the vehicle.

The navigation device according to an embodiment of the present invention for achieving the above object, receives a global positioning system (GPS) signal received from the satellite, and generates the first vehicle position data of the mobile terminal based on the received GPS signal A GPS module; The vehicle speed is calculated based on the moving distance and the image frame speed of the matching area between the previous image frame and the current image frame photographed by the photographing unit, and the moving distance and the distance from the photographing unit to the matching area of the previous image frame. A position information providing unit configured to calculate a heading angle of the vehicle based on the first position, and to generate second vehicle position data based on the speed and the heading angle of the vehicle; A storage unit for storing map data; A map matching unit generating a vehicle estimation position based on the first vehicle position data and the second vehicle position data, and matching the generated vehicle estimation position with map data stored in the storage unit; And a controller for generating road guidance information based on the matched map information.

According to an aspect of the present invention, there is provided a method of providing location information of a mobile terminal, the speed and movement of a vehicle based on a moving distance and a direction of a matching area between a previous image frame and a current image frame, and an image frame speed. Calculating a direction; And generating location information of the vehicle based on the speed of the vehicle and the moving direction.

According to an aspect of the present invention, there is provided a method of providing location information of a mobile terminal, the speed of the vehicle being calculated based on a moving distance and an image frame rate of a matching area between a previous image frame and a current image frame. Steps; Calculating a moving direction of the vehicle based on the moving distance and the distance from the photographing unit to the matching area of the previous image.

According to an aspect of the present invention, there is provided a method of providing location information of a mobile terminal, the speed of a vehicle being calculated based on a moving distance and an image frame rate of a matching area between a previous image and a current image photographed through a photographing unit. Making a step; Calculating a heading angle of the vehicle based on the moving distance and the distance from the photographing unit to the matching area of the previous image; And generating location information of the vehicle based on the speed and the heading angle of the vehicle.

The navigation method according to an embodiment of the present invention for achieving the above object, receives a global positioning system (GPS) signal received from the satellite, and generates the first vehicle position data of the mobile terminal based on the received GPS signal Making a step; The vehicle speed is calculated based on the moving distance and the image frame speed of the matching area between the previous image frame and the current image frame photographed by the photographing unit, and the moving distance and the distance from the photographing unit to the matching area of the previous image frame. Calculating a heading angle of the vehicle based on the second and generating second vehicle position data based on the speed and the heading angle of the vehicle; Generating a vehicle estimation position based on the first vehicle position data and the second vehicle position data, and matching the generated vehicle estimation position with map data stored in the storage; And generating road guidance information based on the matched map information.

The method and apparatus for providing location information of a mobile terminal according to an embodiment of the present invention calculate a speed and a moving direction of a vehicle based on a moving distance and a direction of a matching area between a previous video frame and a current video frame, and an image frame speed. And generating location information of the vehicle based on the speed and the moving direction of the vehicle, thereby accurately predicting the location of the vehicle in a place where a GPS satellite signal cannot be received (for example, a tunnel or a tall building). There is.

Hereinafter, an embodiment of a method and apparatus for providing location information of a mobile terminal capable of accurately predicting a location of a vehicle in a place (for example, a tunnel or a tall building) where GPS (Global Positioning System) satellite signals cannot be received will be described. A detailed description will be given with reference to FIGS. 1 to 8.

1 is a block diagram illustrating a configuration of a mobile communication terminal 100 to which an apparatus for providing location information according to an embodiment of the present invention is applied. The mobile communication terminal (mobile phone) 100 may be implemented in various forms. For example, the mobile communication terminal 100 includes a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), and the like.

As shown in FIG. 1, the mobile communication terminal 100 includes a wireless communication unit 110, an A / V (Audio / Video) input unit 120, a user input unit 130, a sensing unit 140, and an output unit 150. ), A memory 160, an interface unit 170, a controller 180, a power supply unit 190, and the like. Not all components of the mobile communication terminal 100 shown in FIG. 1 are essential components, and the mobile communication terminal 100 may be implemented by more components than those shown in FIG. The mobile communication terminal 100 may also be implemented by components.

The wireless communication unit 110 includes one or more components for performing wireless communication between the mobile communication terminal 100 and a wireless communication system or wireless communication between the mobile communication terminal 100 and a network in which the mobile communication terminal 100 is located. It may include. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short range communication module 114, a location information module 115, and the like. .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a pre-generated broadcast signal and / or broadcast related information and transmits the same to the mobile communication terminal 100. . The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast related information may be provided through a mobile communication network, and in this case, may be received by the mobile communication module 112. The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems, and in particular, digital multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), and media forward link (MediaFLO). Digital broadcast signals can be received using digital broadcasting systems such as only), digital video broadcast-handheld (DVB-H), integrated services digital broadcast-terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 is configured to be suitable for all broadcasting systems that provide broadcasting signals as well as the digital broadcasting system described above. The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission and reception of voice call signals, video call signals, and / or text / multimedia messages.

The wireless internet module 113 refers to a module for wireless internet access, and the wireless internet module 113 may be built in or external to the mobile communication terminal 100. Here, wireless Internet technologies include WLAN (Wireless LAN), Wi-Fi, WiBro, WiMAX, World Interoperability for Microwave Access (Wimax), HSDPA (High Speed Downlink Packet Access), and the like. Can be used.

The short range communication module 114 means a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

The location information module 115 is a module for checking or obtaining the location of the mobile terminal. One example is the Global Position System (GPS) module. The GPS module receives position information from a plurality of satellites. Here, the location information may include coordinate information represented by latitude and longitude. For example, the GPS module can measure the exact time and distance from three or more satellites and accurately calculate the current position by triangulating three different distances. A method of obtaining distance and time information from three satellites and correcting the error with one satellite may be used. In particular, the GPS module can obtain not only the location of latitude, longitude, and altitude but also accurate time together with three-dimensional speed information from the location information received from the satellite. As the location information module 115, a Wi-Fi Positioning System and / or a Hybrid Positioning System may be applied.

The A / V input unit 120 is for inputting an audio signal or a video signal, and the A / V input unit 120 includes a camera 121 and a microphone 122. May be included. The camera 121 processes an image frame such as a still image or a video obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be configured according to the configuration of the mobile terminal.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data. In the call mode, the processed voice data may be converted into a form transmittable to the mobile communication base station through the mobile communication module 112 and output. The microphone 122 may implement various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for the user to control the operation of the mobile terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like. In particular, when the touch pad forms a mutual layer structure with the display unit 151, this may be referred to as a touch screen.

The sensing unit 140 may be an open / closed state of the mobile communication terminal 100, a location of the mobile communication terminal 100, a user contact presence, a bearing of the mobile communication terminal 100, an acceleration / deceleration of the mobile communication terminal 100, and the like. As described above, the current state of the mobile communication terminal 100 is sensed to generate a sensing signal for controlling the operation of the mobile communication terminal 100. For example, when the mobile communication terminal 100 is in the form of a slide phone, whether the slide phone is opened or closed may be sensed. In addition, the sensing unit 140 is responsible for sensing functions related to whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled to an external device, and the like.

The interface unit 170 serves as an interface with all external devices connected to the mobile communication terminal 100. For example, the interface unit 170 may include a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device equipped with an identification module, An audio input / output (I / O) port, a video input / output (I / O) port, and an earphone port may be configured. Here, the identification module is a chip that stores a variety of information for authenticating the usage rights of the mobile communication terminal 100, and includes a user identification module (UIM) and a subscriber identify module (SIM). ), A Universal Subscriber Identity Module (“USIM”), and the like. In addition, the device equipped with the identification module (hereinafter, 'identification device') may be manufactured in the form of a smart card. Therefore, the identification module may be connected to the mobile communication terminal 100 through a port. The interface unit 170 receives data from an external device or receives power to transmit the data to each component inside the mobile communication terminal 100 or transmit data within the mobile communication terminal 100 to an external device.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 includes a display unit 151, an audio output module 152, an alarm unit 153, and the like. This may be included.

The display unit 151 displays and outputs information processed by the mobile communication terminal 100. For example, when the mobile communication terminal 100 is in a call mode, the mobile terminal 100 displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the mobile communication terminal 100 is in a video call mode or a photographing mode, the mobile communication terminal 100 displays a photographed and / or received image, a UI, or a GUI.

The display unit 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, or a three-dimensional display. It may include at least one of (3D display). In addition, two or more display units 151 may exist according to an implementation form of the mobile communication terminal 100. For example, an external display unit (not shown) and an internal display unit (not shown) may be simultaneously provided in the mobile communication terminal 100.

When the display unit 151 and a sensor for detecting a touch operation (hereinafter referred to as a touch sensor) form a mutual layer structure (hereinafter referred to as a touch screen), the display unit 151 outputs the touch screen. In addition to the device can also be used as an input device. The touch sensor may have, for example, a form of a touch film, a touch sheet, a touch pad, or the like.

In addition, the touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 151 or capacitance generated at a specific portion of the display unit 151 into an electrical input signal. The touch sensor may be configured to detect not only the position and area of the touch but also the pressure at the touch. When there is a touch input to the touch sensor, the corresponding signal (s) is sent to a touch controller (not shown). The touch controller processes the signal (s) and then transmits the corresponding data to the controller 180. As a result, the controller 180 can determine which area of the display unit 151 is touched.

The act of bringing the pointer closer to the touch screen without being touched to recognize that the pointer is located on the touch screen is called "Proximity Touch", and the pointer is actually touched on the touch screen. The behavior is called "Contact Touch". The position of the proximity touch with the pointer on the touch screen means a position where the pointer is perpendicular to the touch screen when the pointer is in proximity touch.

In addition, the proximity sensor 141 detects a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, and a proximity touch movement state). do. Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

The sound output module 152 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. In addition, the sound output module 152 outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed in the mobile communication terminal 100. The sound output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying occurrence of an event of the mobile communication terminal 100. Examples of events occurring in the mobile terminal include call signal reception, message reception, and key signal input. The alarm unit 153 may output a signal for notifying occurrence of an event in a form other than an audio signal or a video signal. For example, the signal may be output in the form of vibration. When a call signal is received or a message is received, the alarm unit 153 may vibrate the mobile terminal through a vibration means. Alternatively, when the key signal is input, the alarm unit 153 may vibrate the mobile communication terminal 100 through the vibration means in response to the key signal input. The user can recognize the occurrence of the event through the vibration as described above. Of course, the signal for notification of event occurrence may be output through the display unit 151 or the voice output module 152.

The haptic module 154 generates various tactile effects that the user can feel. Vibration is a representative example of the haptic effect generated by the haptic module 154. The intensity and pattern of vibration generated by the haptic module 154 can be controlled. For example, different vibrations may be synthesized and output or may be sequentially output.

In addition to vibration, the haptic module 154 may further include a pin array vertically moving with respect to the contact skin surface, a jetting force or suction force of air through the jetting or suction port, grazing to the skin surface, contact of the electrode, electrostatic force, and the like. Various tactile effects can be produced, such as the effects of the heat-absorbing effect and the effect of reproducing a sense of cold using the elements capable of absorbing heat or heat.

The haptic module 154 may not only deliver the haptic effect through direct contact, but also may implement the user to feel the haptic effect through a muscle sense such as a finger or an arm. The haptic module 154 may be provided with two or more according to the configuration aspect of the telematics terminal. The haptic module 154 may be provided where the contact with the user is frequent in the vehicle. For example, it may be provided in a steering wheel, a shift gear lever, a seat seat, and the like.

The memory 160 may store a program for processing and controlling the controller 180, and a function for temporarily storing input / output data (for example, a phone book, a message, a still image, a video, etc.). You can also do

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory). Random Access Memory (RAM) Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM) magnetic memory, Magnetic It may include a storage medium of at least one type of disk, optical disk. In addition, the mobile communication terminal 100 may operate a web storage that performs a storage function of the memory 150 on the Internet.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. For example, the interface unit 170 may include a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device equipped with an identification module, An audio input / output (I / O) port, a video input / output (I / O) port, and an earphone port may be configured. Here, the identification module is a chip that stores various information for authenticating the use right of the mobile terminal 100, and includes a user identification module (UIM), a subscriber identify module (SIM), and universal user authentication. It may include a module (Universal Subscriber Identity Module (USIM)). In addition, the device equipped with the identification module (hereinafter referred to as an identification device) may be manufactured in the form of a smart card. Therefore, the identification module may be connected to the mobile terminal 100 through a port. The interface unit 170 may receive data from an external device or receive power and transmit the data to each component inside the mobile terminal 100 or transmit data within the mobile terminal 100 to an external device.

The interface unit 170 may be a passage through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, or various commands input by the user from the cradle. It may be a passage through which a signal is transmitted to the mobile terminal 100. Various command signals or power input from the cradle may be operated as signals for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile communication terminal 100. For example, the controller 180 performs related control and processing for voice call, data communication, video call, and the like. In addition, the controller 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the controller 180 or may be implemented separately from the controller 180.

The controller 180 may perform a pattern recognition process for recognizing a writing input or a drawing input performed on a touch screen as text and an image, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

The functions of the components applied to the mobile communication terminal 100 may be implemented in a computer-readable recording medium using software, hardware, or a combination thereof. Hardware implementations include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPCs), and controllers (FPGAs). It may be implemented using at least one of controllers, micro-controllers, microprocessors, electrical units for performing functions, etc. In some cases such embodiments are implemented by the controller 180. By software implementation, embodiments such as procedures or functions may be implemented with separate software modules that allow at least one function or operation to be performed.The software code may be a software application written in an appropriate programming language. In addition, the software code is stored in the memory 160, and And executed by a unit 180.

The navigation session 300 applied to the mobile communication terminal 100 generates road guidance information based on the map data and the location information of the mobile communication terminal 100 and transmits the generated road guidance information to the user. Notify.

The voice recognition module 182 recognizes the voice spoken by the user and performs a corresponding function according to the recognized voice signal.

Meanwhile, the location information module (or location information providing device) 115 applied to the mobile communication terminal 100 according to an embodiment of the present invention may include a moving distance and a direction of a matching area between a previous image frame and a current image frame, and an image. The speed and the moving direction of the vehicle are calculated based on the frame speed, and the position information of the vehicle is generated based on the speed and the moving direction of the vehicle. For example, the location information module (or location information providing device) 115 applied to the mobile communication terminal 100 according to an embodiment of the present invention may be provided between the previous image frame and the current image frame photographed through the camera 121. The vehicle speed is calculated based on the moving distance of the matching area and the image frame rate, the heading angle of the vehicle is calculated based on the moving distance and the distance from the camera to the specific area, and the speed and heading angle of the vehicle. Based on the location information of the vehicle is generated. In this case, the navigation session 300 provides road guidance information by matching the generated vehicle location information and the digital map.

2 is a block diagram illustrating a vehicle navigation system for describing a telematics terminal to which a location information providing apparatus according to an exemplary embodiment of the present invention is applied.

As shown in Fig. 2, the vehicle navigation system includes an information providing center 30 which provides traffic information and various data (e.g., a program, an executable file, etc.); And a telematics terminal 200 mounted in a vehicle and receiving traffic information through a wireless communication network 20 and providing a road guidance service based on the GPS signal and the traffic information received through the satellite 10. .

Hereinafter, the configuration of the telematics terminal 200 to which the location information providing apparatus according to an embodiment of the present invention is applied will be described with reference to FIG. 3.

3 is a block diagram showing the configuration of a telematics terminal 200 to which a data update apparatus according to an embodiment of the present invention is applied.

As shown in FIG. 3, the telematics terminal 200 controls a central processing unit (CPU) 212 for controlling the telematics terminal 200 as a whole, a memory 213 for storing various kinds of information, and various key signals. The main board 210 includes a key control unit 211 and an LCD control unit 214 for controlling the LCD.

The memory 213 stores map information (map data) for displaying road guidance information on a digital map. In addition, the memory 213 stores a traffic information collection control algorithm for inputting traffic information according to a road situation in which the vehicle is currently driving, and information for controlling the algorithm.

The main board 210 is assigned a unique device number and receives a GPS signal for a CDMA module 206, which is a mobile communication terminal embedded in a vehicle, a vehicle location guide, a driving route tracking from a starting point to a destination, or a user. GPS module 207 for transmitting traffic information collected by GPS signal, CD deck 208 for reproducing signals recorded on compact disk (CD), gyro sensor 209, etc. . The CDMA module 206 and the GPS module 207 transmit / receive signals through the antennas 204 and 205.

In addition, the TV module 222 is connected to the main board 210 and receives a TV signal through the TV antenna 223. The main board 210 includes a display unit (201) under the control of the LCD control unit 214 through the interface board 203, a front board 202 under the control of the key control unit 211, and a vehicle. The camera 227 for capturing the inside and / or the outside is connected. The display unit 201 displays various video signals and text signals, and the front board 202 is provided with buttons for inputting various key signals, and the main board 210 provides a key signal corresponding to a user-selected button. To provide. In addition, the display unit 201 includes a proximity sensor and a touch sensor (touch screen) of FIG. 2.

The front board 202 may include a menu key for directly inputting traffic information, and the menu key may be configured to be controlled by the key controller 211.

The audio board 217 is connected to the main board 210 and processes various audio signals. The audio board 217 includes a microcomputer 219 for controlling the audio board 217, a tuner 218 for receiving a radio signal, a power supply unit 216 for supplying power to the microcomputer 219, and various voices. It is composed of a signal processor 215 for processing a signal.

In addition, the audio board 217 is composed of a radio antenna 220 for receiving a radio signal, and a tape deck 221 for reproducing an audio tape. The audio board 217 may further configure a voice output unit (for example, an amplifier) 226 for outputting a voice signal processed by the audio board 217.

The voice output unit (amplifier) 226 is connected to the vehicle interface 224. That is, the audio board 217 and the main board 210 are connected to the vehicle interface 224. The vehicle interface 224 may be connected to a hands-free 225a for inputting a voice signal, an airbag 225b for occupant safety, a speed sensor 225c for detecting the speed of the vehicle, and the like. The speed sensor 225c calculates a vehicle speed and provides the calculated vehicle speed information to the central processing unit 212.

The navigation session 300 applied to the telematics terminal 200 generates road guide information based on map data and vehicle current location information, and notifies the user of the generated road guide information.

The display unit 201 detects a proximity touch in the display window through a proximity sensor. For example, the display unit 201 detects the position of the proximity touch when the pointer (for example, a finger or a stylus pen) is in close proximity, and displays the position information corresponding to the detected position. Output to the control unit 212.

The voice recognition device (or voice recognition module) 301 recognizes a voice spoken by the user and performs a corresponding function according to the recognized voice signal.

Meanwhile, according to an embodiment of the present invention, the location information module (or location information providing device) 302 applied to the telematics terminal 200 may determine a matching area between the previous image frame and the current image frame photographed by the camera 227. The speed and the moving direction of the vehicle are calculated based on the moving distance and the direction and the image frame speed, and the position information of the vehicle is generated based on the speed and the moving direction of the vehicle. For example, the position information module 302 applied to the telematics terminal 200 according to an exemplary embodiment of the present invention may include a moving distance and an image frame of a matching area between a previous image frame and a current image frame captured by the camera 227. Calculate the vehicle speed based on the speed, calculate the heading angle of the vehicle based on the moving distance and the distance from the camera to the specific area, and calculate the position information of the vehicle based on the speed and the heading angle of the vehicle. Occurs. In this case, the navigation session 300 provides road guidance information by matching the generated vehicle location information and the digital map.

Hereinafter, a navigation apparatus to which a location information providing apparatus according to an embodiment of the present invention is applied will be described with reference to FIG. 4.

4 is a block diagram illustrating a configuration of a navigation device 400 to which a location information providing device according to an embodiment of the present invention is applied.

As shown in FIG. 4, the navigation device 400 to which the location information providing apparatus according to the embodiment of the present invention is applied receives a global positioning system (GPS) signal received from a satellite and based on the received GPS signal. A GPS module 401 for generating first vehicle position data of a low navigation device (referred to be the same position as the telematics terminal 200 or the mobile communication terminal 100); The speed and movement direction of the vehicle are calculated based on the moving distance and direction of the matching area between the previous image frame and the current image frame photographed by the photographing unit (for example, the camera) 409 and the image frame speed. A location information providing unit (402) for generating second vehicle location data (or vehicle location information) based on the speed of the vehicle and the moving direction; A storage unit (or memory) 404 for storing map data and various information; A vehicle estimation position is generated based on the first vehicle position data and the second vehicle position data, and the generated vehicle estimation position and a link in the map data stored in the storage unit 404 (map matching link or map matching road). Map matching unit (403) for matching and outputting the matched map information (map matching result); A communication unit 408 for receiving real-time traffic information from the information providing center and performing telephone communication through the wireless communication network 500; A controller 407 for generating road guidance information based on the matched map information (map matching result); A display unit 405 for displaying a road guidance map (including POI information) included in the road guidance information; And a voice output unit 406 for outputting road guide voice information (road guide voice message) included in the road guide information. Here, the communication unit 408 may further include a handsfree having a Bluetooth module. The navigation device 400 to which the location information providing device according to an embodiment of the present invention is applied may further include a dead-reckoning (DR) sensor that generates vehicle location data based on the driving direction of the vehicle and the speed of the vehicle. .

The road guidance information may include not only map data but also various information related to driving such as lane information, driving speed limit information, turn-by-turn information, traffic safety information, traffic guidance information, vehicle information, and route finding information. .

Signals received through the GPS module 401 are 802.11, Bluetooth, UWB, which is a standard of a wireless network for a wireless LAN, including a wireless LAN and some infrared communication proposed by the Institute of Electrical and Electronics Engineers (IEEE). 802.15, a standard for wireless personal area networks (PANs) including Zigbee, and wireless metro area networks (BWAs) including fixed wireless access (FWA), etc. The wireless communication method such as 802.16, which is a standard standard for mobile communication, and 802.20, which is a standard for mobile Internet for mobile broadband (MBWA: Mobile Broadband Wireless Access) including Wibro, WiMAX, etc. Location information may be provided to the navigation device 400.

An input unit may be further configured in the navigation device 400. The input unit may select a function desired by a user or receive information, and various devices such as a keypad, a touch screen, a jog shuttle, and a microphone may be used.

The map matching unit 403 generates a vehicle estimation position based on the first position data and the second position data, and reads map data corresponding to a driving route from the storage unit 404.

The map matching unit 403 matches the estimated vehicle position with a link (road) included in the map data, and outputs the matched map information (map matching result) to the controller 407. . For example, the map matching unit 403 generates a vehicle estimation position based on the first position data and the second position data, and generates the estimated vehicle position and the map data stored in the storage unit 404. The links within the link are matched according to the link order, and the matched map information (map matching result) is output to the controller 407. The map matching unit 403 may output road attribute information, such as a tomographic road or a double layer road, included in the matched map information (map matching result) to the controller 407. In addition, the function of the map matching unit 403 may be implemented in the controller 407.

The storage unit 404 stores map data and execution programs. At this time, the stored map data includes geographic coordinates (Geographic Coordinate or longitude coordinates) for displaying latitude and longitude in degrees and seconds (DMS unit: Degree / Minute / Second). Here, the stored map data may use Universal Transverse Mercator (UTM) coordinates, Universal Polar System (UPS) coordinates, Transverse Mercator (TM) coordinates, etc. in addition to the geographic coordinates.

The storage unit 404 stores various kinds of information such as various menu screens, point of interest (POI), function characteristic information according to a specific position of map data, and the like.

The storage unit 404 stores various user interfaces (UIs) and / or graphical user interfaces (GUIs).

The storage unit 404 stores data, a program, and the like necessary for the navigation device 400 to operate.

The storage unit 404 stores destination information input from a user through the input unit. In this case, the destination information may be any one of a destination or a departure point and a destination.

The display unit 405 displays image information (or road guidance map) included in the road guide information generated by the control unit 407. Here, the display unit 405 includes a touch sensor (touch screen) and a proximity sensor. The road guidance information may include not only map data but also various information related to driving such as lane information, driving speed limit information, turn-by-turn information, traffic safety information, traffic guidance information, vehicle information, and route finding information. have.

When displaying the image information, the display unit 405 may display various contents such as various menu screens and road guide information by using a user interface and / or a graphic user interface included in the storage unit 404. have. Here, the content displayed on the display unit 405 includes a menu screen including various text or image data (including map data and various information data) and data such as icons, list menus, combo boxes, and the like.

The voice output unit 406 outputs voice information (or a voice message for the road guide information) included in the road guide information generated by the controller 407. Here, the voice output unit 406 may be an amplifier or a speaker.

The controller 407 generates road guide information based on the matched map information, and outputs the generated road guide information to the display unit 405 and the voice output unit 406. In this case, the display unit 405 displays the road guide information.

The controller 407 receives real-time traffic information from the information providing center to generate road guidance information.

The controller 407 may be connected through a call center and a communication unit 408 to perform a telephone call or to transmit / receive information between the navigation device 400 and the call center. Here, the communication unit 408 includes a hands-free module having a Bluetooth function using a short range wireless communication method.

The controller 407 senses a proximity touch within the display window of the display unit 405 through a proximity sensor. For example, the display unit 405 detects the position of the proximity touch when the pointer (for example, a finger or a stylus pen) is in close proximity, and detects the position information corresponding to the detected position. It outputs to the control part 407.

On the other hand, the position information providing unit 402 applied to the navigation device 400 according to an embodiment of the present invention, the moving distance and the image frame rate of the matching area between the previous image frame and the current image frame photographed by the photographing unit 409 Compute a vehicle speed based on the vehicle, calculate a heading angle of the vehicle based on the moving distance and the distance from the camera to the specific region, and generate position information of the vehicle based on the vehicle speed and heading angle. The generated vehicle location information is provided to the map matching unit 403.

Hereinafter, not only the mobile communication terminal 100, the telematics terminal 200, the navigation device 400, but also a desktop computer, a notebook computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP) A method and apparatus for providing location information according to an embodiment of the present invention, which can be applied to the above), will be described in detail with reference to FIG. 5.

5 is a diagram showing the configuration of a location information providing apparatus according to an embodiment of the present invention.

As shown in FIG. 5, the apparatus for providing location information according to an exemplary embodiment of the present invention is based on the moving distance and the image frame speed of the matching area between the previous image frame and the current image frame photographed by the photographing unit 409. A speed calculator 402-1 for calculating the speed of the vehicle; An angle calculator (402-2) for calculating a heading angle of the vehicle based on the moving distance and the distance from the camera to the specific area; And a position generator 402-3 for generating position information of the vehicle based on the speed and the heading angle of the vehicle.

First, the photographing unit 409 includes two stereo imaging cameras. The photographing unit 409 photographs a pair of stereoscopic images including a current reference image and a current comparison image through the two stereo imaging cameras.

The speed calculator 402-1 may perform a parallax between a pixel or a block of a current reference image and a pixel or block of a current comparison image based on stereo imaging technology. The distance from the camera to the matching pixel or block of the image is calculated based on the. Here, the technique for calculating the distance from the camera to the matching area (matching pixel or block) of the image based on the stereo imaging technique is a known technique, which is also disclosed in US Pat. No. 6,985,619.

The speed calculator 402-1 compares a current reference image with a previous reference image to calculate a moving distance of the matching pixel or block, and calculates the calculated moving distance and the image frame rate (eg, 24 frames / Calculate the moving speed of the vehicle on the basis of seconds). For example, it is calculated as "vehicle movement speed = movement distance / time between image frames (1 second / 24 frames)".

The angle calculator 402-2 calculates a heading angle of the vehicle based on a distance value from the camera to a matching pixel or block of the image and the moving distance. For example, a stereo imaging technique is used to obtain a distance (first distance) from a camera to a matching pixel or block of an image, and compares a previous image frame with a current image frame to move a matching pixel or block. (2nd distance) is calculated and an angle (heading angle of a vehicle) is calculated based on a 1st distance and a 2nd distance. Here, the heading angle of the vehicle can be obtained by applying the first distance and the second distance to the triangulation method.

The location generator 402-3 generates location information of the vehicle based on the moving speed of the vehicle and the heading angle of the vehicle, and outputs the generated vehicle location information to the map matching unit 403.

The map matching unit 403 matches the generated vehicle location information and the digital map, and outputs the matched map information (map matching result) to the controller 407.

Therefore, when successive images are obtained through two cameras fixed to a vehicle, specific pixels or blocks of the previous image are compared by comparing the difference between the previous image frame and the current image frame through image processing. The moving direction and the moving distance of the matching pixel or the matching block are detected, and the moving speed and the heading angle of the vehicle are detected based on the moving direction and the moving distance. For example, the position of the vehicle is detected based on the detected moving speed and the heading angle of the vehicle in the shaded area. That is, when the A pixel at the A position of the previous image frame moves to the B position of the current image frame, the moving speed of the vehicle is calculated based on the moving distance of the A pixel and the image frame time information, and the moving distance of the A pixel. And calculate a heading angle of the vehicle based on the distance from the camera to the A pixel of the previous image frame.

Hereinafter, a method of providing location information according to an embodiment of the present invention will be described with reference to FIGS. 5 to 8.

6 is a flowchart illustrating a method of providing location information according to an embodiment of the present invention.

First, the photographing unit 409 captures a pair of stereoscopic images including a current reference image and a current comparison image through the two stereo imaging cameras (S11). Here, the previous image frame is stored in the storage unit 404.

The speed calculator 402-1 is a matching area of an image in a camera based on a parallax between a pixel or a block of the current reference image and a pixel or a block of the current reference image based on a stereo imaging technique. For example, the distance to the matching pixel or block is calculated (S12). Here, a method of calculating a distance from a camera to a matching area of an image based on the parallax of a pixel or a block of the current reference image and a pixel or a block of the current comparison image based on the stereo imaging technique is known. Therefore, detailed description thereof will be omitted.

The speed calculator 402-1 compares the current reference image with the previous reference image to calculate a moving distance of the matching area (S13), and calculates the calculated moving distance and the image frame rate (eg, 24 frames). / Second) to calculate the moving speed of the vehicle (S14). For example, it is calculated as "vehicle movement speed = movement distance / time between image frames (1 second / 24 frames)".

The angle calculator 402-2 calculates a heading angle of the vehicle based on the distance value from the camera to the matching area of the image and the moving distance (S15). For example, a stereo imaging technique is used to obtain a distance (first distance) from a camera to a matching pixel or block of an image, and compares a previous image frame with a current image frame to move a matching pixel or block. (2nd distance) is calculated and an angle (heading angle of a vehicle) is calculated based on a 1st distance and a 2nd distance. Here, the heading angle of the vehicle can be obtained by applying the first distance and the second distance to the triangulation method.

The position generator 402-3 generates position information of the vehicle based on the moving speed of the vehicle and the heading angle of the vehicle, and outputs the generated vehicle position information to the map matching unit 403 (S16). .

The map matching unit 403 matches the generated vehicle location information and the digital map, and outputs the matched map information (map matching result) to the control unit 407 (S17).

7 and 8 illustrate a matching area (pixel) between a previous image frame and a current image frame according to an exemplary embodiment of the present invention.

As shown in FIG. 7 and FIG. 8, the moving direction and the moving distance of a specific pixel A of the previous image are detected by comparing the difference between the previous image frame and the current image frame photographed by two cameras fixed to the vehicle. The vehicle detects the moving speed and the heading angle of the vehicle based on the moving direction and the moving distance. For example, when the A pixel at the A position of the previous image frame moves to the B position of the current image frame, the moving speed of the vehicle is calculated based on the moving distance and the image frame time information of the A pixel, and the The heading angle of the vehicle is calculated based on the moving distance and the distance from the camera to the A pixel of the previous image frame.

As described in detail above, the method and apparatus for providing location information of a mobile terminal according to an embodiment of the present invention are based on a moving distance and a direction of a matching area between a previous image frame and a current image frame, and a vehicle based on an image frame rate. By calculating the speed and the direction of movement of the vehicle and generating location information of the vehicle based on the speed and the direction of movement of the vehicle, the vehicle may not be able to receive GPS satellite signals (e.g., tunnels, high-rise buildings). Accurately predict location.

It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Accordingly, the embodiments disclosed in the present invention are not intended to limit the technical spirit of the present invention but to describe the present invention, and the scope of the technical spirit of the present invention is not limited by these embodiments. The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of the present invention.

1 is a block diagram showing the configuration of a mobile communication terminal to which the location information providing apparatus according to an embodiment of the present invention is applied.

2 is a block diagram illustrating a vehicle navigation system for describing a telematics terminal to which a location information providing apparatus according to an exemplary embodiment of the present invention is applied.

3 is a block diagram showing the configuration of a telematics terminal to which a data update apparatus according to an embodiment of the present invention is applied.

4 is a block diagram illustrating a configuration of a navigation device to which a location information providing device according to an embodiment of the present invention is applied.

5 is a diagram showing the configuration of a location information providing apparatus according to an embodiment of the present invention.

6 is a flowchart illustrating a method of providing location information according to an embodiment of the present invention.

7 and 8 illustrate a matching area (pixel) between a previous image frame and a current image frame according to an exemplary embodiment of the present invention.

* Explanation of symbols on the main parts of the drawings

401: GPS module 402: location information provider

403: map matching unit 404: storage unit

405: display unit 406: audio output unit

407: control unit 408: communication unit

409: data update unit 500: wireless communication network

Claims (17)

A calculation unit for calculating a speed and a moving direction of the vehicle based on the moving distance and the direction of the matching area between the previous image frame and the current video frame and the image frame speed; And a location generator for generating location information of the vehicle based on the speed of the vehicle and the moving direction. The method of claim 1, wherein the calculation unit, The mobile terminal is calculated based on the moving distance and the image frame rate, and the moving direction of the vehicle is calculated based on the moving distance and the distance from the photographing unit to the matching area of the previous image. Location information providing device. A speed calculator configured to calculate a speed of the vehicle based on a moving frame distance and an image frame rate of the matching area between the previous image and the current image captured by the photographing unit; An angle calculator configured to calculate a heading angle of the vehicle based on the moving distance and the distance from the photographing unit to the matching area of the previous image; And a location generator for generating location information of the vehicle based on the speed and the heading angle of the vehicle. The apparatus of claim 3, further comprising a map matching unit configured to match the generated vehicle position information and the digital map. The method of claim 3, wherein the photographing unit, Device for providing location information of a mobile terminal, characterized in that it comprises a camera for taking a current reference image and the current comparison image. The method of claim 5, wherein the speed calculation unit, And calculating a distance from the photographing unit to a matching area of the previous image based on the parallax between the current reference image and the current comparison image. The method of claim 5, wherein the speed calculation unit, Comparing the current image and the previous image with each other to calculate the moving distance of the matching area, and calculates the moving speed of the vehicle based on the calculated moving distance and the image frame rate . The method of claim 7, wherein the angle calculator, And a heading angle of the vehicle based on the distance from the photographing unit to the matching area of the previous image and the moving distance. A GPS module that receives a global positioning system (GPS) signal from a satellite and generates first vehicle position data of the mobile terminal based on the received GPS signal; The vehicle speed is calculated based on the moving distance and the image frame speed of the matching area between the previous image frame and the current image frame photographed by the photographing unit, and the moving distance and the distance from the photographing unit to the matching area of the previous image frame. A position information providing unit configured to calculate a heading angle of the vehicle based on the first position, and to generate second vehicle position data based on the speed and the heading angle of the vehicle; A storage unit for storing map data; A map matching unit generating a vehicle estimation position based on the first vehicle position data and the second vehicle position data, and matching the generated vehicle estimation position with map data stored in the storage unit; And a controller for generating road guidance information based on the matched map information. Calculating a speed and a moving direction of the vehicle based on the moving distance and the direction of the matching area between the previous video frame and the current video frame and the video frame speed; Generating location information of the vehicle based on the speed of the vehicle and the direction of movement; and providing the location information of the mobile terminal. The method of claim 10, wherein calculating the speed and the moving direction of the vehicle comprises: Calculating a speed of the vehicle based on the moving distance and the image frame rate; And calculating a moving direction of the vehicle based on the moving distance and the distance from the photographing unit to the matching area of the previous image. Calculating a speed of the vehicle based on a moving frame distance and an image frame rate of a matching area between the previous image and the current image captured by the photographing unit; Calculating a heading angle of the vehicle based on the moving distance and the distance from the photographing unit to the matching area of the previous image; Generating location information of the vehicle based on the speed and the heading angle of the vehicle. 12. The method of claim 11, further comprising matching the generated vehicle location information with a digital map. The method of claim 12, wherein the calculating of the distance from the photographing unit to the matching area of the previous image comprises: And calculating a distance from the photographing unit to a matching area of the previous image based on a parallax between a current reference image and a current comparison image. The method of claim 14, wherein calculating the moving speed of the vehicle comprises: Computing the moving distance of the matching area by comparing the current image and the previous image, and calculates the moving speed of the vehicle based on the calculated moving distance and the image frame rate. Way. The method of claim 12, wherein calculating the heading angle of the vehicle comprises: And calculating a heading angle of the vehicle by applying the distance from the photographing unit to the matching area of the previous image and the moving distance to a triangulation method. Receiving a global positioning system (GPS) signal received from a satellite and generating first vehicle position data of the mobile terminal based on the received GPS signal; The vehicle speed is calculated based on the moving distance and the image frame speed of the matching area between the previous image frame and the current image frame photographed by the photographing unit. Calculating a heading angle of the vehicle based on the second and generating second vehicle position data based on the speed and the heading angle of the vehicle; Generating a vehicle estimation position based on the first vehicle position data and the second vehicle position data, and matching the generated vehicle estimation position with map data stored in the storage; And generating road guidance information based on the matched map information.

Images