KR20110001093A - Method for displaying image for mobile terminal and apparatus thereof - Google Patents

Abstract

PURPOSE: An image display method of a mobile terminal for reducing the capacity of data loaded within the mobile terminal by displaying information of an interest point is provided to intuitively confirm information of the interest point through a real image. CONSTITUTION: A camera module(408) receives a photographed real-time image. The camera module detects the information of a camera direction. A display unit(404) displays the photographed image. A controller(407) detects location information of a POI corresponding to a keyword. The controller displays the final location of the interest point in the displayed image based on location information of the mobile terminal.

Description

TECHNICAL FOR DISPLAYING IMAGE FOR MOBILE TERMINAL AND APPARATUS THEREOF

The present invention relates to an image display method and a device thereof of a mobile terminal.

In general, the image display apparatus of the mobile terminal according to the related art displays only an image of a subject.

SUMMARY OF THE INVENTION An object of the present invention is to provide an image display method and a device of a mobile terminal which can intuitively check information of a surrounding area (point of interest) on a map, rather than an actual image captured by a camera.

Another object of the present invention is to provide an image display method and apparatus for a mobile terminal, which can reduce the capacity of data mounted on a mobile terminal because the user can display information of a surrounding area (point of interest) without map data. have.

Another object of the present invention, when the image display device according to an embodiment of the present invention is applied to the navigation terminal, the point of interest information having the location information when the surrounding area (point of interest) information is searched by the camera is taken by the camera Disclosed is a video display method and apparatus for displaying a mobile terminal that can be displayed through an image.

It is still another object of the present invention to provide a video display method and apparatus for a mobile terminal in which a user can enjoy a game through a real-time video by executing a game by superimposing a real-time video on which the location of the mobile terminal is displayed and game information. have.

An image display apparatus of a mobile terminal according to embodiments of the present invention includes a camera module for receiving a real-time image photographed through a camera and detecting direction information to which the camera is directed; A display unit which displays the captured image; Detecting the altitude and location information of the point of interest corresponding to the keyword, the last point of the point of interest in the displayed image based on the direction information facing the camera, the current position of the mobile terminal, the location and altitude information of the detected point of interest It is composed of a control unit for indicating the position.

According to embodiments of the present invention, an image display apparatus of a mobile terminal includes: a display unit configured to display an image captured by a camera in real time; A GPS module that detects a current position based on global positioning system (GPS) information received from a satellite; An altitude detector for detecting an altitude of the current location; A geomagnetic field module for detecting a first absolute azimuth in a direction that the camera faces; A camera module detecting angle of view information of the displayed image based on angle of view information of a camera lens; A communication unit which receives Point of Interest (POI) information including altitude information and location information through a wireless communication network; Detect a second absolute azimuth between the current position and the position of the point of interest based on the detected current position and the point of interest information; Detecting an absolute azimuth range of the real-time image of the camera based on a first absolute azimuth in the direction the camera is facing and angle of view information of the displayed image; And a controller configured to display the distance from the current location to the point of interest and the height of the point of interest on the point of interest in the real-time image of the camera based on the second absolute azimuth and the absolute azimuth range.

An image display method of a mobile terminal according to embodiments of the present invention includes: receiving a real-time image photographed through a camera and detecting direction information to which the camera is directed; Displaying the captured image; Detect the altitude and location information of the point of interest corresponding to the keyword, and based on the direction information facing the camera, the current position of the mobile terminal, the position and altitude information of the detected point of interest on the displayed image Indicated the final position.

An image display method of a mobile terminal according to embodiments of the present invention includes the steps of: displaying an image captured by a camera in real time on a display unit; Detecting a current position based on global positioning system (GPS) information received from the satellite; Detecting an altitude of the current location; Detecting a first absolute azimuth angle in the direction that the camera is directed; Detecting angle of view information of the displayed image based on angle of view information of a camera lens; Receiving Point of Interest (POI) information including altitude information and location information via a wireless communication network; Detecting a second absolute azimuth angle between the current position and the position of the point of interest based on the detected current position and the point of interest information; Detecting an absolute azimuth range of the real-time image of the camera based on the first absolute azimuth in the direction the camera is facing and the angle of view information of the displayed image; And displaying the distance from the current location to the point of interest and the height of the point of interest on the point of interest in the real-time image of the camera based on the second absolute azimuth and the absolute azimuth range.

The image display apparatus of the mobile terminal according to the embodiments of the present invention has an effect of intuitively confirming the information of the surrounding area (point of interest) on a map instead of understanding the information on the map.

The video display device of the mobile terminal according to the embodiments of the present invention can reduce the capacity of data mounted on the mobile terminal because the user can show information of the surrounding area (point of interest) even without map data. .

When the image display device according to an embodiment of the present invention is applied to a navigation terminal, the point of interest information having the location information can be displayed through the image photographed by the camera when the surrounding area (point of interest) information is searched in the vehicle. There is also.

The video display device of the mobile terminal according to the embodiments of the present invention is useful to a user who lacks a sense of direction by notifying a direction of a mobile terminal of an acquaintance such as a point of interest or a friend, and confirms the direction of a friend or checks the bus. There are also effects that can be useful when you do not know in which direction to ride.

The video display device of a mobile terminal according to the embodiments of the present invention has an effect of allowing a user to enjoy a game through a real-time video by executing a game by superimposing a real-time video on which the location of the mobile terminal and game information are displayed.

Hereinafter, the information of the surrounding area (point of interest) can be intuitively confirmed through the actual image captured by the camera, and the video display of the mobile terminal can inform the location and direction of the mobile terminal of an acquaintance such as a point of interest or a friend. Preferred embodiments of the method and apparatus thereof are described in detail with reference to FIGS.

1 is a block diagram illustrating a configuration of a mobile communication terminal 100 to which an image display device according to an embodiment of the present invention is applied. The mobile communication terminal (mobile phone) 100 may be implemented in various forms. For example, the mobile communication terminal 100 includes a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), and the like.

As shown in FIG. 1, the mobile communication terminal 100 includes a wireless communication unit 110, an A / V (Audio / Video) input unit 120, a user input unit 130, a sensing unit 140, and an output unit 150. ), A memory 160, an interface unit 170, a controller 180, a power supply unit 190, and the like. Not all components of the mobile communication terminal 100 shown in FIG. 1 are essential components, and the mobile communication terminal 100 may be implemented by more components than those shown in FIG. The mobile communication terminal 100 may also be implemented by components.

The wireless communication unit 110 includes one or more components for performing wireless communication between the mobile communication terminal 100 and a wireless communication system or wireless communication between the mobile communication terminal 100 and a network in which the mobile communication terminal 100 is located. It may include. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short range communication module 114, a location information module 115, and the like. .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a pre-generated broadcast signal and / or broadcast related information and transmits the same to the mobile communication terminal 100. . The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast related information may be provided through a mobile communication network, and in this case, may be received by the mobile communication module 112. The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems, and in particular, digital multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), and media forward link (MediaFLO). Digital broadcast signals can be received using digital broadcasting systems such as only), digital video broadcast-handheld (DVB-H), integrated services digital broadcast-terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 is configured to be suitable for all broadcasting systems that provide broadcasting signals as well as the digital broadcasting system described above. The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission and reception of voice call signals, video call signals, and / or text / multimedia messages.

The wireless internet module 113 refers to a module for wireless internet access, and the wireless internet module 113 may be built in or external to the mobile communication terminal 100. Here, wireless Internet technologies include wireless LAN (WLAN), Wi-Fi, WiBro, WiMAX, World Interoperability for Microwave Access (WMAX), HSDPA (High Speed Downlink Packet Access), and the like. Can be used.

The short range communication module 114 means a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

The position information module 115 is a module for checking or obtaining the position of the mobile terminal (it is possible to check the position of the vehicle when the mobile terminal is mounted on the vehicle). One example is the Global Position System (GPS) module. The GPS module receives position information from a plurality of satellites. Here, the location information may include coordinate information represented by latitude and longitude. For example, the GPS module can measure the exact time and distance from three or more satellites and accurately calculate the current position by triangulating three different distances. A method of obtaining distance and time information from three satellites and correcting the error with one satellite may be used. In particular, the GPS module can obtain not only the location of latitude, longitude, and altitude but also accurate time together with three-dimensional speed information from the location information received from the satellite. As the location information module 115, a Wi-Fi Positioning System and / or a Hybrid Positioning System may be applied.

The A / V input unit 120 is for inputting an audio signal or a video signal, and the A / V input unit 120 includes a camera 121 and a microphone 122. May be included. The camera 121 processes an image frame such as a still image or a video obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be configured according to the configuration of the mobile terminal.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data. In the call mode, the processed voice data may be converted into a form transmittable to the mobile communication base station through the mobile communication module 112 and output. The microphone 122 may be implemented with various noise removal algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for the user to control the operation of the mobile terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like. In particular, when the touch pad forms a mutual layer structure with the display unit 151, this may be referred to as a touch screen.

The sensing unit 140 may be an open / closed state of the mobile communication terminal 100, a location of the mobile communication terminal 100, a user contact presence, a bearing of the mobile communication terminal 100, an acceleration / deceleration of the mobile communication terminal 100, and the like. As described above, the current state of the mobile communication terminal 100 is sensed to generate a sensing signal for controlling the operation of the mobile communication terminal 100. For example, when the mobile communication terminal 100 is in the form of a slide phone, whether the slide phone is opened or closed may be sensed. In addition, the sensing unit 140 is responsible for sensing functions related to whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled to an external device, and the like.

The interface unit 170 serves as an interface with all external devices connected to the mobile communication terminal 100. For example, the interface unit 170 may include a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device equipped with an identification module, An audio input / output (I / O) port, a video input / output (I / O) port, and an earphone port may be configured. Here, the identification module is a chip that stores a variety of information for authenticating the usage rights of the mobile communication terminal 100, and includes a user identification module (UIM) and a subscriber identify module (SIM). ), A Universal Subscriber Identity Module (“USIM”), and the like. In addition, the device equipped with the identification module (hereinafter, 'identification device') may be manufactured in the form of a smart card. Therefore, the identification module may be connected to the mobile communication terminal 100 through a port. The interface unit 170 receives data from an external device or receives power to transmit the data to each component inside the mobile communication terminal 100 or transmit data within the mobile communication terminal 100 to an external device.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 includes a display unit 151, an audio output module 152, an alarm unit 153, and the like. This may be included.

The display unit 151 displays and outputs information processed by the mobile communication terminal 100. For example, when the mobile communication terminal 100 is in a call mode, the mobile terminal 100 displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the mobile communication terminal 100 is in a video call mode or a photographing mode, the mobile communication terminal 100 displays a photographed and / or received image, a UI, or a GUI.

The display unit 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, or a three-dimensional display. It may include at least one of (3D display). In addition, two or more display units 151 may exist according to an implementation form of the mobile communication terminal 100. For example, an external display unit (not shown) and an internal display unit (not shown) may be simultaneously provided in the mobile communication terminal 100.

When the display unit 151 and a sensor for detecting a touch operation (hereinafter referred to as a touch sensor) form a mutual layer structure (hereinafter referred to as a touch screen), the display unit 151 outputs the touch screen. In addition to the device can also be used as an input device. The touch sensor may have, for example, a form of a touch film, a touch sheet, a touch pad, or the like.

In addition, the touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 151 or capacitance generated at a specific portion of the display unit 151 into an electrical input signal. The touch sensor may be configured to detect not only the position and area of the touch but also the pressure at the touch. When there is a touch input to the touch sensor, the corresponding signal (s) is sent to a touch controller (not shown). The touch controller processes the signal (s) and then transmits the corresponding data to the controller 180. As a result, the controller 180 can determine which area of the display unit 151 is touched.

The act of bringing the pointer closer to the touch screen without being touched to recognize that the pointer is located on the touch screen is called "Proximity Touch", and the pointer is actually touched on the touch screen. The behavior is called "Contact Touch". The position of the proximity touch with the pointer on the touch screen means a position where the pointer is perpendicular to the touch screen when the pointer is in proximity touch.

In addition, the proximity sensor 141 detects a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, and a proximity touch movement state). do. Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

The sound output module 152 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. In addition, the sound output module 152 outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed in the mobile communication terminal 100. The sound output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying occurrence of an event of the mobile communication terminal 100. Examples of events occurring in the mobile terminal include call signal reception, message reception, and key signal input. The alarm unit 153 may output a signal for notifying occurrence of an event in a form other than an audio signal or a video signal. For example, the signal may be output in the form of vibration. When a call signal is received or a message is received, the alarm unit 153 may vibrate the mobile terminal through a vibration means. Alternatively, when the key signal is input, the alarm unit 153 may vibrate the mobile communication terminal 100 through the vibration means in response to the key signal input. The user can recognize the occurrence of the event through the vibration as described above. Of course, the signal for notification of event occurrence may be output through the display unit 151 or the voice output module 152.

The haptic module 154 generates various tactile effects that the user can feel. Vibration is a representative example of the haptic effect generated by the haptic module 154. The intensity and pattern of vibration generated by the haptic module 154 can be controlled. For example, different vibrations may be synthesized and output or may be sequentially output.

The haptic module 154, in addition to the vibration, the pin arrangement to move vertically with respect to the contact skin surface, the blowing force or suction force of the air through the injection or inlet, the grazing to the skin surface, the contact of the electrode (eletrode), the stimulation such as electrostatic force Various tactile effects can be produced, such as the effects of the heat-absorbing effect and the effect of reproducing a sense of cold using the elements capable of absorbing heat or heat.

The haptic module 154 may not only deliver the haptic effect through direct contact, but may also be implemented to allow the user to feel the haptic effect through a muscle sense such as a finger or an arm. The haptic module 154 may be provided with two or more according to the configuration aspect of the telematics terminal. The haptic module 154 may be provided where the contact with the user is frequent in the vehicle. For example, it may be provided in a steering wheel, a shift gear lever, a seat seat, and the like.

The memory 160 may store a program for processing and controlling the controller 180 and temporarily stores input / output data (for example, map data, phonebook, message, still image, video, etc.). It can also perform a function for.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory). Random Access Memory (RAM) Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM) magnetic memory, Magnetic It may include a storage medium of at least one type of disk, optical disk. In addition, the mobile communication terminal 100 may operate a web storage that performs a storage function of the memory 150 on the Internet.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. For example, the interface unit 170 may include a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device equipped with an identification module, An audio input / output (I / O) port, a video input / output (I / O) port, and an earphone port may be configured. Here, the identification module is a chip that stores various information for authenticating the use right of the mobile terminal 100, and includes a user identification module (UIM), a subscriber identify module (SIM), and universal user authentication. It may include a module (Universal Subscriber Identity Module (USIM)). In addition, the device equipped with the identification module (hereinafter referred to as an identification device) may be manufactured in the form of a smart card. Therefore, the identification module may be connected to the mobile terminal 100 through a port. The interface unit 170 may receive data from an external device or receive power and transmit the data to each component inside the mobile terminal 100 or transmit data within the mobile terminal 100 to an external device.

The interface unit 170 may be a passage through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, or various commands input by the user from the cradle. It may be a passage through which a signal is transmitted to the mobile terminal 100. Various command signals or power input from the cradle may be operated as signals for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile communication terminal 100. For example, the controller 180 performs related control and processing for voice call, data communication, video call, and the like. In addition, the controller 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the controller 180 or may be implemented separately from the controller 180.

The controller 180 may perform a pattern recognition process for recognizing a writing input or a drawing input performed on a touch screen as text and an image, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

The functions of the components applied to the mobile communication terminal 100 may be implemented in a computer-readable recording medium using software, hardware, or a combination thereof. Hardware implementations include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPCs), and controllers (FPGAs). It may be implemented using at least one of controllers, micro-controllers, microprocessors, electrical units for performing functions, etc. In some cases such embodiments are implemented by the controller 180. In a software implementation, embodiments such as a procedure or function may be implemented with a separate software module that performs at least one function or operation Software code may be written in a software application written in a suitable programming language. In addition, the software code is stored in the memory 160, and And executed by a unit 180.

The voice recognition module 182 recognizes the voice spoken by the user and performs a corresponding function according to the recognized voice signal.

On the other hand, the image display device applied to the mobile communication terminal 100 according to embodiments of the present invention, the camera 121 for real-time shooting a specific image; A display unit (display unit) 151 for displaying the captured specific image; The controller 180 is configured to display the point of interest information on the point of interest located in the displayed image.

2 is a block diagram illustrating a vehicle navigation system for explaining a telematics terminal to which an image display device according to an exemplary embodiment of the present invention is applied.

As shown in Fig. 2, the vehicle navigation system includes an information providing center 30 for providing traffic information and various data (e.g., a program, an executable file, etc.); Telematics, which is mounted in a vehicle, receives traffic information through a long range wireless communication network 20 and / or a short range wireless communication network, and provides a road guidance service based on the GPS signal received through the satellite 10 and the traffic information. It consists of a terminal 200.

Hereinafter, the configuration of the telematics terminal 200 to which the video display device according to the embodiments of the present invention is applied will be described with reference to FIG. 3.

3 is a block diagram illustrating a configuration of a telematics terminal 200 to which an image display device according to embodiments of the present invention is applied.

As shown in FIG. 3, the telematics terminal 200 includes a control unit (for example, a central processing unit, a CPU) 212 for controlling the telematics terminal 200 as a whole, a memory 213 for storing various kinds of information, and The main board 210 includes a key controller 211 for controlling various key signals and an LCD controller 214 for controlling a liquid crystal display (LCD).

The memory 213 stores map information (map data) for displaying road guidance information on a digital map. In addition, the memory 213 stores a traffic information collection control algorithm for inputting traffic information according to a road situation in which the vehicle is currently driving, and information for controlling the algorithm.

The main board 210 is assigned with a unique device number for a code division multiple access (CDMA) module 206, which is a mobile communication terminal embedded in a vehicle, for locating a vehicle, tracking a driving route from a starting point to a destination, and the like. GPS module 207 for receiving a GPS signal or transmitting traffic information collected by a user as a GPS (Global Positioning System) signal, a CD deck (CD Deck) 208 for reproducing a signal recorded on a compact disk (CD) ), A gyro sensor 209 and the like. The CDMA module 206 and the GPS module 207 transmit / receive signals through the antennas 204 and 205.

In addition, the broadcast receiving module 222 is connected to the main board 210 and receives a broadcast signal through the antenna 223. The main board 210 includes a display unit (201) under the control of the LCD control unit 214 through the interface board 203, a front board 202 under the control of the key control unit 211, and a vehicle. The camera 227 for capturing the inside and / or the outside is connected. The display unit 201 displays various video signals and text signals, and the front board 202 is provided with buttons for inputting various key signals, and the main board 210 provides a key signal corresponding to a user-selected button. To provide. In addition, the display unit 201 includes a proximity sensor and a touch sensor (touch screen) of FIG. 2.

The front board 202 may include a menu key for directly inputting traffic information, and the menu key may be configured to be controlled by the key controller 211.

The audio board 217 is connected to the main board 210 and processes various audio signals. The audio board 217 includes a microcomputer 219 for controlling the audio board 217, a tuner 218 for receiving a radio signal, a power supply unit 216 for supplying power to the microcomputer 219, and various voices. It consists of a signal processor 215 for processing a signal.

In addition, the audio board 217 is composed of a radio antenna 220 for receiving a radio signal, and a tape deck 221 for reproducing an audio tape. The audio board 217 may further configure a voice output unit (for example, an amplifier) 226 for outputting a voice signal processed by the audio board 217.

The voice output unit (amplifier) 226 is connected to the vehicle interface 224. That is, the audio board 217 and the main board 210 are connected to the vehicle interface 224. The vehicle interface 224 may be connected to a hands-free 225a for inputting a voice signal, an airbag 225b for occupant safety, a speed sensor 225c for detecting the speed of the vehicle, and the like. The speed sensor 225c calculates a vehicle speed and provides the calculated vehicle speed information to the central processing unit 212.

The navigation session 300 applied to the telematics terminal 200 generates road guide information based on map data and vehicle current location information, and notifies the user of the generated road guide information.

The display unit 201 detects a proximity touch in the display window through a proximity sensor. For example, the display unit 201 detects the position of the proximity touch when the pointer (for example, a finger or a stylus pen) is in close proximity, and displays the position information corresponding to the detected position. Output to the control unit 212.

The voice recognition device (or voice recognition module) 301 recognizes a voice spoken by the user and performs a corresponding function according to the recognized voice signal.

The GPS module 207 receives a global positioning system (GPS) signal received from a satellite, and is considered to be in the same position as the navigation device (telematic terminal 200 or the mobile communication terminal 100) based on the received GPS signal. First vehicle position data.

The signal received through the GPS module 207 is 802.11, Bluetooth, UWB, which is a standard of a wireless network for a wireless LAN including a wireless LAN and some infrared communication proposed by the Institute of Electrical and Electronics Engineers (IEEE). 802.15, a standard for wireless personal area networks (PANs) including Zigbee, and wireless metro area networks (BWAs) including fixed wireless access (FWA), etc. The wireless communication method such as 802.16, which is a standard standard for mobile communication, and 802.20, which is a standard for mobile Internet for mobile broadband (MBWA: Mobile Broadband Wireless Access) including Wibro, WiMAX, etc. Location information may be provided to the navigation device 400.

The memory 213 stores map data. At this time, the stored map data includes geographic coordinates (Geographic Coordinate or longitude coordinates) for displaying latitude and longitude in degrees and seconds (DMS unit: Degree / Minute / Second). Here, the stored map data may use Universal Transverse Mercator (UTM) coordinates, Universal Polar System (UPS) coordinates, Transverse Mercator (TM) coordinates, etc. in addition to the geographic coordinates.

The memory 213 stores various types of information such as various menu screens, point of interest (POI), function characteristic information according to a specific position of map data, and the like.

The memory 213 stores various user interfaces (UIs) and / or graphical user interfaces (GUIs).

The memory 213 stores data, a program, and the like necessary for the telematics terminal 200 to operate.

The memory 213 stores destination information input from a user through an input unit. In this case, the destination information may be a destination, or one of a departure point and a destination.

The display unit 201 displays image information (or road guidance map) included in the road guide information generated by the control unit 212. Here, the display unit 201 includes a touch sensor (touch screen) and a proximity sensor. The road guidance information may include not only map data but also various information related to driving such as lane information, driving speed limit information, turn-by-turn information, traffic safety information, traffic guidance information, vehicle information, and route finding information. have.

When displaying the image information, the display unit 201 may display various contents such as various menu screens and road guide information by using a user interface and / or a graphic user interface included in the memory 213. . Here, the content displayed on the display unit 201 includes a menu screen including various text or image data (including map data and various information data) and data such as icons, list menus, combo boxes, and the like.

The voice output unit 226 outputs voice information (or voice message for the road guide information) included in the road guide information generated by the controller 212. Here, the audio output unit 226 may be an amplifier or a speaker.

The controller 212 generates road guide information based on map information, and outputs the generated road guide information to the display unit 201 and the audio output unit 226. In this case, the display unit 201 displays the road guide information.

Receive real-time traffic information from the control unit 212, the information providing center and / or a terminal (vehicle navigation device) mounted on the surrounding vehicle to generate road guidance information.

The control unit 212 may be connected through a call center and a communication unit (for example, the CDMA module 206) to perform a telephone call or to transmit / receive information between the telematics terminal 200 and the call center. . Here, the communication unit may further include a hands-free module having a Bluetooth function using a short range wireless communication method.

On the other hand, the image display device applied to the telematics terminal 200 according to the embodiments of the present invention, the camera 227 for real-time shooting a specific image; A display unit (display unit) 201 for displaying the captured specific image; And a controller 212 indicating the point of interest information on the point of interest located in the displayed image.

Hereinafter, a configuration of an image display device according to embodiments of the present invention will be described with reference to FIG. 4. Here, the video display device according to the embodiments of the present invention is not only a mobile communication terminal 100 and a telematics terminal 200 but also a smart phone, a notebook computer, a personal digital assistant (PDA), a PMP. It can be applied to various terminals such as (Portable Multimedia Player).

4 is a block diagram showing the configuration of a video display device according to a first embodiment of the present invention.

As shown in Fig. 4, the video display device 400 according to the first embodiment of the present invention includes: a display unit 404 for displaying in real time an image captured by a camera; A GPS module 401 for detecting a current position based on global positioning system (GPS) information received from a satellite; A digital compass module 402 for detecting a first absolute azimuth in the direction the camera is directed; A camera module 408 for detecting angle of view information of the displayed image based on angle of view information of a camera lens; Based on the current location, the surrounding area information (main feature information) of the current location through an external communication network such as an internet network or a wireless communication network 410 (for example, a building name, a representative telephone number of a building, a building address, A communication unit 406 for receiving a region name, region location coordinates, region address, region photo including a building, and classification of the region; A second absolute between the current location and the particular point of interest location based on the detected current location and a point of interest (POI) location (eg, a specific building location coordinate) included in the area information; Detecting an azimuth angle; Detecting an absolute azimuth range of the real-time image of the camera based on a first absolute azimuth in the direction the camera is facing and angle of view information of the displayed image; Point-of-interest information (eg, detailed information corresponding to a building) in a corresponding point of interest (eg, a building) in the real-time image of the camera based on the second absolute azimuth and an absolute azimuth range of the real-time image of the camera. The control unit 407 for displaying a.

Hereinafter, an image display method according to a first embodiment of the present invention will be described with reference to FIGS. 4 and 5.

5 is a flowchart illustrating an image display method according to a first embodiment of the present invention.

First, the display unit 404 displays an image captured by the camera on a real-time screen (S11).

The GPS module 401 detects a current position based on global positioning system (GPS) information received from a satellite, and outputs the detected current position to the controller 407 (S12).

The digital compass module 402 detects a first absolute azimuth in a direction that the camera faces, and outputs the detected first absolute azimuth to the controller 407 (S13). Here, instead of the geomagnetic field module 402, the first absolute azimuth angle of the direction of the camera may be detected through the GPS information and the moving direction of the mobile terminal (for example, the vehicle traveling direction of the navigation device). Since the method for detecting the absolute azimuth angle is also described in Korean Patent No. 10-0831355, a detailed description thereof will be omitted.

The camera module 408 detects the angle of view information of the displayed image based on the angle of view information of the camera lens, and outputs the detected angle of view information to the controller 407 (S14).

The communication unit 406 is based on the current location through the external network, such as the Internet network, wireless communication network 410 surrounding area information (main feature information) of the current location (for example, building name, building of Receiving a representative phone number, a building address, an area name, an area location coordinate, an area address, an area picture including a building picture, and a classification of a corresponding area), and outputs the received surrounding area information to the controller 407 (S15). ). Here, map data including surrounding area information of the current location may be stored in advance in the storage unit 403. The classification of the corresponding area refers to a classification such as a restaurant, a gas station, a mart, a bank, etc. in the corresponding area, and the classified information may be displayed as an icon.

The controller 407 may determine a second absolute azimuth angle between the current location and the specific location of interest based on the detected current location and the specific location of interest (eg, specific building location coordinates) included in the surrounding area information. Detect an absolute azimuth range of the real-time image of the camera based on the first absolute azimuth in the direction that the camera is facing and the angle of view information of the displayed image (S17), and the second absolute azimuth and the absolute Point-of-interest information (eg, detailed information corresponding to a building) is displayed on a specific point of interest (eg, a building) in the real-time image of the camera based on the azimuth range (S18). That is, the image display apparatus according to an exemplary embodiment of the present invention may implement augmented reality by displaying information about a surrounding area (point of interest) on a location of a point of interest in a real-time image through a camera.

In addition, the controller 407 further displays the distance from the current location to the specific point of interest based on the current location and the specific point of interest included in the surrounding area information (eg, specific building location coordinates) on the image. You may. When the controller 407 displays the point of interest information on a corresponding point of interest (for example, a building) in the real-time image of the camera, the controller 407 may display the point of interest information of one point of interest or a plurality of points of interest according to a user's selection. Point of interest information for the points may be indicated. On the other hand, the controller 407 displays a predetermined distance from the current position when the user does not select a specific point of interest when displaying information of the point of interest in the point of interest (for example, a building) in the real-time image of the camera. For example, point-of-interest information about all the features (all points of interest) included in the region within 10 meters to 50 meters) may be displayed on the image.

The controller 407 may further display the location and direction of the destination on the displayed image based on the current location and destination location information.

The controller 407 may be a symbol such as an arrow indicating a direction in which the specific point of interest is located when a specific point of interest (for example, a specific building) deviates from the absolute azimuth range of the real-time image of the camera. May be displayed on the real-time image.

The controller 407 displays the point of interest information on a specific point of interest (eg, a building) in the real time image of the camera based on the second absolute azimuth angle and the absolute azimuth range of the real time image of the camera. Point of interest information may be output as a voice through the voice output unit 405.

Hereinafter, the point of interest information is displayed on a point of interest (eg, a building) in the real time image of the camera based on the second absolute azimuth angle and the absolute azimuth range of the real time image of the camera according to embodiments of the present invention. An example will be described with reference to FIGS. 4 and 6.

6 is a diagram illustrating an example of displaying point of interest information on a real-time image of a camera according to the first embodiment of the present invention.

As illustrated in FIG. 6, the controller 407 may be configured to display the current location and the current location based on the detected current location and the location of a specific point of interest included in the surrounding area information (for example, location coordinates of a specific building). Detects a second absolute azimuth angle (eg, 55 degrees) between specific point of interest locations and determines the absolute azimuth range of the real-time image of the camera based on the first absolute azimuth angle in the direction the camera is facing and the angle of view information of the displayed image. Point of interest information (e.g., building details) to the point of interest (e.g., building) in the real-time image of the camera based on the second absolute azimuth and the absolute azimuth range of the real-time image of the camera. Information) as a result on the image.

Accordingly, the image display apparatus according to the first embodiment of the present invention may implement augmented reality by displaying information on the feature at the location of the feature in the real-time image through the camera. That is, according to the present invention, the user may intuitively check the information of the surrounding area (point of interest) on the map instead of understanding the information on the map.

Since the image display apparatus of the mobile terminal according to the embodiment of the present invention can show the information of the surrounding area (point of interest) to the user even without the map data, the capacity of the data mounted in the mobile terminal can be reduced.

When the image display device according to an exemplary embodiment of the present invention is applied to a navigation terminal, information of a point of interest having position information may be displayed through an image photographed by a camera when searching for surrounding area (point of interest) information in a vehicle.

Hereinafter, an image display device according to a second exemplary embodiment of the present invention will be described with reference to FIG.

7 is a block diagram showing the configuration of a video display device according to a second embodiment of the present invention.

As shown in FIG. 7, the video display device according to the second embodiment of the present invention includes a display unit 504 for displaying in real time an image captured by a camera; A GPS module 501 for detecting a current position based on global positioning system (GPS) information received from a satellite; A digital compass module 502 for detecting a first absolute azimuth in a direction the camera faces; A camera module 508 for detecting field of view information of the displayed image based on field of view information of a camera lens; Based on the current location, the surrounding area information (main feature information) of the current location through an external communication network such as an internet network or a wireless communication network (for example, a building name, a representative telephone number of a building, a building address, a local name, A communication unit 506 for receiving a local location coordinate, an area address, an area picture including a building, and a classification of a corresponding area; A second absolute between the current location and the particular point of interest location based on the detected current location and a point of interest (POI) location (eg, a specific building location coordinate) included in the area information; Detecting an azimuth angle; Detecting an absolute azimuth range of the real-time image of the camera based on a first absolute azimuth in the direction the camera is facing and angle of view information of the displayed image; Point-of-interest information (eg, detailed information corresponding to a building) in a corresponding point of interest (eg, a building) in the real-time image of the camera based on the second absolute azimuth and an absolute azimuth range of the real-time image of the camera. The control unit 507 for displaying a.

The controller 507 of the image display apparatus according to the second exemplary embodiment of the present invention receives a keyword input by a user through the input unit 509, detects a location of an interest point corresponding to the keyword, and detects the detected location. Determine whether the point of interest deviates from the absolute azimuth range of the real-time image of the camera based on the location of the point of interest, and determine the direction of the point of interest when the point of interest deviates from the absolute azimuth range of the real-time image of the camera. Display on the video. For example, the controller 507 may display a symbol such as an arrow indicating the direction of the point of interest when the point of interest deviates from the absolute azimuth range of the real-time image of the camera, on the real-time image.

Also, the controller 507 may output the direction of the point of interest as a voice through the voice output unit 505 when the point of interest deviates from the absolute azimuth range of the real-time image of the camera.

Hereinafter, a description overlapping with the first embodiment of the present invention will be omitted, and the image display method according to the second embodiment of the present invention will be described with reference to FIGS. 7 and 8.

8 is a flowchart illustrating an image display method according to a second embodiment of the present invention.

First, the input unit 509 receives a keyword input by a user, and outputs the received keyword to the controller 507 (S21). Here, the keyword may be a variety of keywords such as coffee shop (Starbucks), restaurants (chicken shop, fast food, Burger King), park name, building name. For example, a user may input a keyword corresponding to a point of interest through the input unit 509 through a keypad displayed on the display unit 504.

9 is a diagram showing a keypad displayed on the display unit 504 according to the second embodiment of the present invention.

The controller 507 receives a keyword (eg, fast food) input by the user from the input unit 509, and stores information about a neighboring point of interest corresponding to the received keyword, in the storage unit 503 or the Internet. Received from the server through the network / wireless communication network 510, and outputs the information on the surrounding points of interest to the display unit 504 (S22).

FIG. 10 is a diagram illustrating information about a peripheral point of interest displayed on the display unit 504 according to the second embodiment of the present invention.

As illustrated in FIG. 10, the controller 507 receives a keyword input by the user from the input unit 509, and stores information about a neighboring point of interest corresponding to the received keyword. Received from the server through the Internet network / wireless communication network 510, and outputs information on the surrounding point of interest to the display unit 504. In this case, the display unit 504 displays information about the surrounding point of interest (S23). The information on the neighboring point of interest means information on a point of interest corresponding to a preset distance (for example, within 1 mile) from the current position. The preset distance may be changed by a designer or a user.

For example, the controller 507 detects fast food restaurants corresponding to a predetermined distance (for example, within 1 mile) from the current location when the keyword input by the user from the input unit 509 is fast food, The detected fast food restaurants are displayed on the display unit 504. At this time, the controller 507 displays the distance from the current position to each fast food restaurant on the display unit 504.

The controller 507 determines whether the point of interest deviates from the absolute azimuth range of the real-time image of the camera based on the position of a specific point of interest selected by the user among information about the point of interest corresponding to the keyword. In operation S24, the location of the point of interest is displayed on the image when the point of interest does not deviate from the absolute azimuth range of the real-time image of the camera. For example, the controller 507 displays an icon or various symbols indicating the location of the point of interest in the real-time image when the point of interest is in the absolute azimuth range of the real-time image of the camera (S25).

11 is a diagram showing information on a point of interest displayed on the display unit 504 according to the second embodiment of the present invention.

As shown in Fig. 11, the control unit 507 may determine the location of the point of interest when the point of interest (e.g., burger king, May wah fast food) (s) is in the absolute azimuth range of the real-time image of the camera. An icon or various symbols indicating are displayed on the real time image. In addition, the controller 507 displays the distance from the current position to the point of interest along with the icon or various symbols on the real time image.

On the other hand, the controller 507 displays the direction of the point of interest on the image when the point of interest deviates from the absolute azimuth range (range of the image photographed by the camera) of the real-time image of the camera.

12 is a view showing the direction of the point of interest displayed on the display unit 504 according to the second embodiment of the present invention.

As shown in Fig. 12, the controller 507 is a symbol such as an arrow indicating the direction of the point of interest when the point of interest (for example, Bonbon Chicken) deviates from the absolute azimuth range of the real-time image of the camera. May be displayed on the real-time image. For example, the controller 507 may determine an absolute azimuth range of the real-time image of the camera based on the location information of the point of interest (for example, Bonbon Chicken), the current location, and the direction information toward the camera. When departure, a symbol such as an arrow indicating the direction of the point of interest may be displayed on the real time image (S26). Here, the method of detecting the direction information, the current location, and the location of the point of interest that the camera is facing is known, and thus a detailed description thereof will be omitted.

Hereinafter, a video display device according to a third embodiment of the present invention will be described with reference to FIG.

13 is a block diagram showing the configuration of a video display device according to a third embodiment of the present invention.

As shown in Fig. 13, the video display device 600 according to the third embodiment of the present invention includes: an input unit 609 for receiving a keyword (for example, a point of interest name) input by a user; A display unit 604 for displaying an image captured by the camera in real time; A GPS module 601 for detecting a current position based on global positioning system (GPS) information received from a satellite; A digital compass module 602 for detecting a first absolute azimuth in the direction the camera is directed; A camera module 608 for detecting angle of view information of the displayed image based on angle of view information of a camera lens; Based on the current location, the surrounding area information (main feature information) of the current location through an external communication network such as an internet network or a wireless communication network (for example, a building name, elevation information of each floor of a building, a representative telephone number of a building, A communication unit 606 for receiving a building address, an area name, an area location coordinate, an area address, an area picture including a building, and a classification of the area; ; An altitude detector 610 for detecting an altitude; A second absolute between the current location and the particular point of interest location based on the detected current location and a point of interest (POI) location (eg, a specific building location coordinate) included in the area information; Detecting an azimuth angle; Detecting an absolute azimuth range of the real-time image of the camera based on a first absolute azimuth in the direction the camera is facing and angle of view information of the displayed image; Point of interest information (e.g., building) corresponding to a point of interest (e.g., building) in the real-time image of the camera based on the altitude information, the second absolute azimuth and the absolute azimuth range of the real-time image of the camera. And detailed control information).

The controller 607 of the image display apparatus according to the third embodiment of the present invention receives a keyword input by a user through the input unit 609, detects a location of the point of interest corresponding to the keyword, and detects the detected point. Determining whether the point of interest deviates from the absolute azimuth range of the real-time image of the camera based on the location of the point of interest, and the direction of the point of interest when the point of interest deviates from the absolute azimuth range of the live image of the camera. Is displayed on the image.

In addition, the controller 607 may output the direction of the point of interest as a voice through the voice output unit 605 when the point of interest deviates from the absolute azimuth range of the real-time image of the camera.

The controller 607 displays the distance from the current position to the point of interest on the display unit 604 when the point of interest exists within the absolute azimuth range of the real-time image of the camera. In this case, the controller 607 displays the height of the point of interest on the display unit 604 based on the altitude information of the current position and the altitude information of the point of interest. For example, the controller 607 may subtract the altitude value of the current position and the altitude value of the point of interest when the altitude of the current position is 5 meters from the ground surface and the altitude of the point of interest is 10 meters from the ground surface. The distance and height of the point of interest may be accurately displayed on the display unit 604. That is, by displaying the height of the point of interest rather than only displaying the distance and direction from the current position to the point of interest, the user can more accurately recognize the position of the point of interest.

Hereinafter, an image display method according to a third embodiment of the present invention will be described with reference to FIGS. 13 and 14.

14 is a flowchart illustrating an image display method according to a third embodiment of the present invention.

First, the input unit 609 receives a keyword (for example, Starbucks) input by a user and outputs the received keyword to the controller 607 (S31). Here, the keyword may be a variety of keywords such as coffee shop (Starbucks), restaurants (chicken shop, fast food, Burger King), park name, building name. For example, a user may input a keyword corresponding to a point of interest through the input unit 609 through a keypad displayed on the display unit 604.

The controller 607 receives a keyword (eg, Starbucks) input by the user from the input unit 609, and stores information about a point of interest corresponding to the received keyword in the storage unit 603 or the Internet network. Received from the server via the / wireless communication network 610, and outputs the information on the surrounding points of interest to the display unit 604 (S32).

In this case, the display unit 604 displays information about the surrounding point of interest (S33). The information on the neighboring point of interest means information on a point of interest corresponding to a preset distance (for example, within 1 mile) from the current position. The preset distance may be changed by a designer or a user.

For example, the controller 607 detects a Starbucks point corresponding to a predetermined distance (for example, within 1 mile) from the current position when the keyword input by the user from the input unit 609 is Starbucks. The detected Starbucks point is displayed on the display unit 604. At this time, the controller 607 displays the distance from the current position to the Starbucks point on the display unit 604.

The controller 607 determines whether the point of interest deviates from the absolute azimuth range of the real-time image of the camera based on the position of the point of interest (eg, Starbucks) corresponding to the keyword (S34). When the point of interest deviates from the absolute azimuth range of the real-time image of the camera, the direction of the point of interest is displayed on the image (S35).

On the other hand, the controller 607 displays the location of the point of interest in the image when the point of interest does not deviate from the absolute azimuth range of the real-time image of the camera. For example, the controller 507 displays an icon or various symbols representing the location of the point of interest when the point of interest is in the absolute azimuth range of the real-time image of the camera, on the real-time image.

Meanwhile, the controller 607 determines whether altitude information is included in the information on the point of interest before displaying an icon or various symbols indicating the position of the point of interest on the real-time image (S36).

The controller 607 extracts the altitude information from the information on the point of interest when the altitude information is included in the information on the point of interest (S37). At this time, the altitude detector 610 detects the altitude of the current position under the control of the controller 607 and outputs the detected altitude information to the controller 607 (S38). Here, the altitude detector may be a satellite altimeter or barometric altimeter indicating the current altitude by the satellite signal.

The controller 607 displays the height of the point of interest on the display unit 604 based on the altitude information of the current location and the altitude information of the point of interest. For example, when the altitude of the current location is 5 meters from the earth's surface and the altitude of the point of interest is 10 meters from the earth's surface, the controller 607 may determine the current position based on the distance from the current location to the point of interest. The height of the point of interest is displayed on the display unit 604 based on the difference between the altitude value and the altitude value of the point of interest (S39).

15 is a diagram showing the positions of points of interest displayed on the display unit 604 according to the third embodiment of the present invention.

As shown in FIG. 15, the controller 507 may determine a distance from the current position to the point of interest when the point of interest (eg, Starbucks) is within an absolute azimuth range of the real-time image of the camera. Indicated by an identifier (e.g., solid arrow) 15-1, the height of the point of interest is indicated by a second identifier (e.g., dashed arrow) 15-2, and the final position of the point of interest Is displayed on the real time video as a third identifier (for example, an icon 15-3 or various symbols).

16 is a diagram showing the positions of other points of interest displayed on the display portion 604 according to the third embodiment of the present invention.

As shown in Fig. 16, the controller 507 controls the department store information (altitude of each floor) from a server through a wireless communication network when the point of interest (e.g., department store) is in the absolute azimuth range of the real-time image of the camera. Information), information of each floor is read from the department store information, and the read information is matched with each floor and displayed. For example, the controller 607 may store the department store based on a difference value between an altitude value (height) of the current position and an altitude value (height) of each floor of the department store based on a distance from the current position to the department store. Recognize each layer of and display the corresponding information on each recognized layer. That is, the controller 607 reads the third floor information from the department store information and displays the third floor information (for example, 3F home appliance) at the location of the third floor. In addition, the controller 607 reads the parking lot information from the department store information, and transmits the parking lot information (for example, parking or non-parking) to the corresponding floor (for example, B2 and B3 floors) where the parking lot exists. Display.

Hereinafter, a fourth embodiment of displaying the position of a mobile terminal (for example, a friend's mobile terminal) on a real time image of the camera will be described with reference to FIGS. 13 and 17. For example, the image display method according to the fourth embodiment of the present invention can accurately identify the position (distance and height) of the mobile terminal corresponding to the telephone number recorded in the telephone book.

17 is a flowchart illustrating a method of displaying a location of a mobile terminal on a real time image of a camera according to a fourth embodiment of the present invention.

First, when the friend search menu is selected by the user, the controller 507 receives a mobile terminal telephone number input by the user through the input unit 509.

The controller 507 receives the location information of the mobile terminal from the call center through the wireless communication network 500 based on the mobile terminal telephone number (S41).

The controller 507 receives the current location information through the GPS module 401 (S42), and displays the real-time image captured by the camera on the display unit 504 (S43).

The camera module 408 detects a direction in which the camera is directed (camera direction information), and outputs the detected camera direction information to the controller 507 (S44).

The controller 507 detects the direction of the mobile terminal based on the current location information, the location information of the mobile terminal, and the camera direction information (S45).

The controller 607 determines whether the mobile terminal deviates from the absolute azimuth range of the real-time image of the camera (S46), and the mobile terminal (mobile terminal position) does not deviate from the absolute azimuth range of the real-time image of the camera. If not, the position of the mobile terminal is displayed on the image (S47). For example, the controller 507 displays an icon or various symbols indicating the position of the mobile terminal in the real time image when the mobile terminal is in the absolute azimuth range of the real time image of the camera.

Thereafter, the controller 607 determines whether altitude information is included in the location information of the mobile terminal before displaying an icon or various symbols indicating the location of the mobile terminal in the real-time image.

When the altitude information is included in the position information of the mobile terminal, the controller 607 extracts the altitude information from the position information of the mobile terminal (S49). At this time, the altitude detector 610 detects the altitude of the current position under the control of the controller 607 and outputs the detected altitude information to the controller 607 (S50). Here, the altitude detector may be a satellite altimeter or barometric altimeter indicating the current altitude by the satellite signal.

The controller 607 displays the height of the mobile terminal on the display unit 604 based on the altitude information of the current location and the altitude information of the mobile terminal. For example, when the altitude of the current position is 5 meters from the ground surface and the altitude of the mobile terminal is 10 meters from the ground surface, the controller 607 is based on the distance from the current position to the mobile terminal. The height of the mobile terminal is displayed on the display unit 604 based on the difference between the altitude value and the altitude value of the mobile terminal (S51).

18 is a diagram showing the position of a mobile terminal (for example, friend mobile terminal) displayed on the display unit 604 according to the fourth embodiment of the present invention.

As shown in FIG. 18, the controller 507 is configured to determine a distance from the current position to the mobile terminal when the mobile terminal (eg, a friend's location) is within an absolute azimuth range of the real-time image of the camera. Displayed by an identifier (e.g., solid arrow) 17-1, the height of the mobile terminal is represented by a second identifier (e.g., dashed arrow) 17-2, and the final position of the mobile terminal. Is displayed on the real time video as a third identifier (for example, icon 17-3 or various symbols).

Hereinafter, a fifth embodiment of displaying a location of a mobile terminal (for example, a friend's mobile terminal) on a real time image of the camera will be described with reference to FIGS. 13 and 19 to 20. For example, the image display method according to the fifth embodiment of the present invention displays the current position and the opponent's position on the real-time image of the camera and then executes a game program so that the user can play the opponent through the real-time image captured by the camera. And play the game.

19 is a flowchart illustrating a method of displaying a location of a mobile terminal on a real time image of a camera according to a fifth embodiment of the present invention.

First, when the friend search menu is selected by the user, the controller 507 receives a mobile terminal telephone number input by the user through the input unit 509.

The controller 507 receives the location information of the mobile terminal from the call center through the wireless communication network 500 based on the mobile terminal telephone number (S61).

The controller 507 receives the current location information through the GPS module 401, transmits the received current location information to the friend's mobile communication terminal through a wireless communication network (S62), and is photographed by a camera. The real time image is displayed on the display unit 504 (S63). Here, the description of the absolute azimuth range of the camera direction information and the real-time image of the camera is the same as in the first to fourth embodiments will be omitted.

The controller 607 displays an icon indicating the location of the mobile terminal on the real time image (S64). Here, the position of the mobile terminal means the position (distance and height) of the mobile terminal described in the first to fourth embodiments.

The controller 607 determines whether a game program (eg, fortress or shooting game) is selected by the user after displaying an icon indicating the location of the mobile terminal on the real-time image (S65).

When a game program (for example, fortress or shooting game) is selected by the user, the controller 607 converts gamers information (for example, character information appearing in the game) corresponding to the selected game program to a wireless communication network. Send to the other party's mobile terminal. In this case, the controller 607 receives gamer information selected by the counterpart from the counterpart mobile terminal through a wireless communication network such as Bluetooth, and sets each other's gamer information in the game program. For example, the controller 607 receives gamer information selected by the counterpart from the counterpart mobile terminal and displays the received gamer information at the location of the mobile terminal displayed on the real-time image. That is, the controller 607 overlaps the gamer information and the counterpart gamer information on the real-time video (S66).

The controller 607 superimposes its own gamer information and the counterpart gamer information on a real-time image, and then executes the game on the real-time image captured by the camera (S67). Here, the controller 607 displays the real-time image captured by the camera on the display unit 604 instead of the background of the game program.

20 is a diagram showing the location and game program of a mobile terminal (eg, a friend) displayed on the display unit 604 according to the fifth embodiment of the present invention.

As shown in FIG. 20, the control unit 507 connects wireless communication with the counterpart mobile terminal through a wireless communication network, and provides game information such as its own gamer information (game character) and counterpart gamer information (relative game character). The game is executed on the real-time image captured by the camera after being superimposed on the real-time image captured by the camera. Here, the controller 607 may play a multi game with a plurality of mobile terminals.

As described above in detail, the image display apparatus of the mobile terminal according to the embodiments of the present invention may intuitively check the information of the point of interest on the map through the actual image photographed by the camera rather than understanding the information on the map.

Since the image display apparatus of the mobile terminal according to the embodiments of the present invention can show the information of the surrounding area (point of interest) to the user even without the map data, the capacity of the data mounted in the mobile terminal can be reduced.

When the image display device according to an exemplary embodiment of the present invention is applied to a navigation terminal, information of a point of interest having position information may be displayed through an image photographed by a camera when searching for surrounding area (point of interest) information in a vehicle.

The video display device according to an embodiment of the present invention allows the user to enjoy a game through a real-time image by executing the game by superimposing the real-time image and the game information indicating the location of the mobile terminal.

It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of the present invention.

1 is a block diagram illustrating a configuration of a mobile communication terminal to which a video display device according to an embodiment of the present invention is applied.

2 is a block diagram illustrating a vehicle navigation system for explaining a telematics terminal to which an image display device according to an exemplary embodiment of the present invention is applied.

3 is a block diagram illustrating a configuration of a telematics terminal to which a video display device according to embodiments of the present invention is applied.

4 is a block diagram showing the configuration of a video display device according to a first embodiment of the present invention.

5 is a flowchart illustrating an image display method according to a first embodiment of the present invention.

6 is a diagram illustrating an example of displaying point of interest information on a real-time image of a camera according to the first embodiment of the present invention.

7 is a block diagram showing the configuration of a video display device according to a second embodiment of the present invention.

8 is a flowchart illustrating an image display method according to a second embodiment of the present invention.

9 is a diagram showing a keypad displayed on the display unit according to the second embodiment of the present invention.

FIG. 10 is a diagram illustrating information about a peripheral point of interest displayed on a display unit according to a second exemplary embodiment of the present invention.

11 is a diagram showing information on a point of interest displayed on a display unit according to the second embodiment of the present invention.

12 is a view showing the direction of the point of interest displayed on the display unit according to the second embodiment of the present invention.

13 is a block diagram showing the configuration of a video display device according to a third embodiment of the present invention.

14 is a flowchart illustrating an image display method according to a third embodiment of the present invention.

15 is a diagram showing the position of the point of interest displayed on the display unit according to the third embodiment of the present invention.

16 is a diagram showing the positions of other points of interest displayed on the display section according to the third embodiment of the present invention.

17 is a flowchart illustrating a method of displaying a location of a mobile terminal on a real time image of a camera according to a fourth embodiment of the present invention.

18 is a diagram showing the position of a mobile terminal (eg, a friend mobile terminal) displayed on the display unit according to the fourth embodiment of the present invention.

19 is a flowchart illustrating a method of displaying a location of a mobile terminal on a real time image of a camera according to a fifth embodiment of the present invention.

20 is a diagram showing the location and game program of a mobile terminal (e.g., friend) displayed on the display unit according to the fifth embodiment of the present invention.

* Explanation of symbols on the main parts of the drawings

401: GPS module 402: geomagnetic module

403: storage unit 404: display unit

405: audio output unit 406: communication unit

407: control unit 408: camera module

Claims (22)

A camera module for receiving a real-time image photographed through a camera and detecting direction information to which the camera is directed; A display unit which displays the captured image; Detecting the altitude and location information of the point of interest corresponding to the keyword, the last point of the point of interest in the displayed image based on the direction information facing the camera, the current position of the mobile terminal, the location and altitude information of the detected point of interest And a control unit for indicating a position. The method of claim 1, wherein the control unit, And a distance from the current location to the point of interest and the height of the point of interest are displayed on the image. The method of claim 2, wherein the control unit, And displaying the height of the point of interest on the display unit based on the altitude information of the current location and the altitude information of the point of interest. The method of claim 3, And an altitude detector for detecting an altitude of the current location, wherein the controller is configured to calculate a difference value between an altitude value of the current location and an altitude value of the point of interest based on a distance from the current position to the point of interest. And displaying the height of the point of interest on the display unit as a basis. The method of claim 4, wherein the control unit, A distance from the current location to the point of interest is indicated by a first identifier, a height of the point of interest is indicated by a second identifier, and a final position of the point of interest is indicated by a third identifier Video display device. The method of claim 1, wherein the control unit, And displaying the direction of the point of interest on the image when the point of interest deviates from the range of the real-time image of the camera. The method of claim 1, wherein the control unit, Receives the current altitude information and location information of the mobile terminal through a wireless communication network, and displays the distance from the current location to the mobile terminal and the height of the mobile terminal on the real-time image based on the current altitude information and location information The video display device of a mobile terminal, characterized in that. The method of claim 7, wherein the control unit, And when a game program is selected, executing the game by superimposing game information with a real-time image indicating the location of the mobile terminal. The method of claim 8, wherein the control unit, And displaying gamer information of the game program at a location of the mobile terminal. A display unit for displaying an image captured by the camera in real time; A GPS module that detects a current position based on global positioning system (GPS) information received from a satellite; An altitude detector for detecting an altitude of the current location; A geomagnetic field module for detecting a first absolute azimuth in a direction that the camera faces; A camera module detecting angle of view information of the displayed image based on angle of view information of a camera lens; A communication unit which receives Point of Interest (POI) information including altitude information and location information through a wireless communication network; Detect a second absolute azimuth between the current position and the position of the point of interest based on the detected current position and the point of interest information; Detecting an absolute azimuth range of the real-time image of the camera based on a first absolute azimuth in the direction the camera is facing and angle of view information of the displayed image; And a controller configured to display a distance from the current location to the point of interest and a height of the point of interest on the point of interest in the real-time image of the camera based on the second absolute azimuth angle and the absolute azimuth range. Video display device of a mobile terminal. The method of claim 10, wherein the control unit, The display unit displays the height of the point of interest on the display unit based on a difference value between the altitude value of the current position and the point of interest based on the distance from the current position to the point of interest. Video display device. Receiving a real-time image photographed through a camera and detecting direction information facing the camera; Displaying the captured image; Detecting the altitude and location information of the point of interest corresponding to the keyword, the last point of the point of interest in the displayed image based on the direction information facing the camera, the current position of the mobile terminal, the location and altitude information of the detected point of interest And displaying the location. The method of claim 12, wherein indicating the final position of the point of interest comprises: And displaying the distance from the current location to the point of interest and the height of the point of interest on the image. The method of claim 13, wherein displaying the height of the point of interest on the image comprises: And displaying the height of the point of interest on the display unit based on the altitude information of the current location and the altitude information of the point of interest. The method of claim 14, wherein displaying the height of the point of interest on the image comprises: Displaying the height of the point of interest on the display unit based on a difference value between the altitude value of the current position and the point of interest based on the distance from the current position to the point of interest. Image display method of mobile terminal. The method of claim 15, Displaying a distance from the current location to the point of interest as a first identifier, indicating a height of the point of interest as a second identifier, and indicating a final position of the point of interest as a third identifier An image display method of a mobile terminal. The method of claim 12, And displaying the direction of the point of interest on the image when the point of interest deviates from the range of the real-time image of the camera. The method of claim 12, Receives the current altitude information and location information of the mobile terminal through a wireless communication network, and displays the distance from the current location to the mobile terminal and the height of the mobile terminal on the real-time image based on the current altitude information and location information The image display method of the mobile terminal further comprising the step of. The method of claim 18, And when the game program is selected, executing the game by superimposing game information with a real-time image indicating the location of the mobile terminal. The method of claim 19, And displaying gamer information of the game program at a location of the mobile terminal. Displaying the image captured by the camera on a display unit in real time; Detecting a current position based on global positioning system (GPS) information received from the satellite; Detecting an altitude of the current location; Detecting a first absolute azimuth angle in the direction that the camera is directed; Detecting angle of view information of the displayed image based on angle of view information of a camera lens; Receiving Point of Interest (POI) information including altitude information and location information via a wireless communication network; Detecting a second absolute azimuth angle between the current position and the position of the point of interest based on the detected current position and the point of interest information; Detecting an absolute azimuth range of the real-time image of the camera based on the first absolute azimuth in the direction the camera is facing and the angle of view information of the displayed image; Displaying the distance from the current location to the point of interest and the height of the point of interest on the point of interest in the real-time image of the camera based on the second absolute azimuth and the absolute azimuth range. Image display method of mobile terminal. The method of claim 21, wherein displaying the height of the point of interest comprises: Displaying the height of the point of interest on the display unit based on a difference value between the altitude value of the current position and the point of interest based on the distance from the current position to the point of interest. Image display method of mobile terminal.

Images