KR101677637B1 - Method for providing route guide using image projection and mobile terminal using this method - Google Patents

Abstract

The present invention relates to a terminal, and more particularly, to a route guidance method and a mobile terminal using the route guidance method. According to another aspect of the present invention, there is provided a route guidance method including: acquiring location information of a mobile terminal; sensing a direction and a tilt of the mobile terminal; and displaying the route guidance according to the detected tilt. And projecting a path guide image corresponding to the position, direction, and destination of the mobile terminal on an outer surface according to the determined display method.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a route guidance method using image projection and a mobile terminal using the route guidance method.

The present invention relates to a terminal, and more particularly, to a route guidance method and a mobile terminal using the route guidance method.

A terminal can be divided into a mobile / portable terminal and a stationary terminal depending on whether the terminal is movable. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

As the functions of such terminals are diversified, they are implemented in the form of a multimedia player having complex functions such as photographing and photographing of movies, reproduction of music and video files, games, and broadcasting reception . In order to support and enhance the functionality of such terminals, it may be considered to improve the structural and / or software parts of the terminal.

In general, a conventional terminal providing a route guidance function provides route guidance to a destination based on a terrain or object modeled on the basis of geographical information (map information) stored in the terminal.

However, since the conventional terminal displays the route information on a relatively small screen due to the size limitation of the display, the terminal user is inconvenient to easily grasp such route information.

It is an object of the present invention to provide a route guiding method and a mobile terminal using the route guiding method which provide a more convenient route guidance to a user by using a display device.

According to another aspect of the present invention, there is provided a route guidance method including: acquiring location information of a mobile terminal; sensing a direction and a tilt of the mobile terminal; And a step of projecting a path guide image corresponding to the position, direction and destination of the mobile terminal on an outer surface according to the determined display method.

According to another aspect of the present invention, there is provided a mobile terminal including a location information module for obtaining location information of a mobile terminal, a sensing unit for sensing a direction and a slope of the mobile terminal, And an image projection unit for projecting a path guide image corresponding to the position, direction, and destination of the mobile terminal onto an outer surface according to the determined display method.

The route guidance method according to at least one embodiment disclosed in the present specification and the mobile terminal using the same provide route guidance in a form that the user can understand more easily according to the image projection direction of the mobile terminal, We will be able to proceed to the destination with the sense of space in the world.

1 is a block diagram illustrating a mobile terminal according to one embodiment disclosed herein.
FIG. 2 is a diagram illustrating an example in which a mobile terminal according to an embodiment of the present invention projects a path guide image onto an outer surface. FIG.
FIG. 3 is a diagram illustrating an example in which a mobile terminal constructs a route guidance image in a three-dimensional display manner according to an embodiment disclosed herein.
FIG. 4 is a first example of a configuration in which a mobile terminal according to an embodiment disclosed herein constructs a route guidance image by a two-dimensional display method.
FIG. 5 is a second exemplary diagram illustrating a configuration of a route guidance image in a two-dimensional display system according to an embodiment of the present invention.
FIG. 6 is a diagram illustrating an example in which a mobile terminal displays object information together with a route guidance image according to an embodiment disclosed herein.
FIG. 7 is a diagram illustrating an example of a display of an internal structure of a mobile terminal according to an exemplary embodiment of the present invention; FIG.
FIG. 8 is a flow chart illustrating a route guidance method in an embodiment disclosed herein.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals are used to designate identical or similar elements, and redundant description thereof will be omitted. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. In addition, it should be noted that the attached drawings are only for easy understanding of the embodiments disclosed in the present specification, and should not be construed as limiting the technical idea disclosed in the present specification by the attached drawings.

Overall configuration of mobile terminal

The mobile terminal described in this specification may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), navigation and the like. However, it will be understood by those skilled in the art that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless the configuration is applicable only to a mobile terminal.

1 is a block diagram illustrating a mobile terminal according to one embodiment disclosed herein.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. The components shown in FIG. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112. The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The position information module 115 is a module for obtaining the position of the mobile terminal, and a representative example thereof is a Global Position System (GPS) module.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ Two or more cameras 121 may be provided depending on the use environment.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. It is also possible to sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141.

The output unit 150 may include a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154, for example, for generating output related to visual, auditory, have.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, a 3D display, and an e-ink display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces.

(Hereinafter, referred to as a 'touch screen') in which a display unit 151 and a sensor for sensing a touch operation (hereinafter, referred to as 'touch sensor') form a mutual layer structure, It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

Referring to FIG. 1, a proximity sensor 141 may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is surrounded by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. The video signal or the audio signal may be output through the display unit 151 or the audio output module 152 so that they may be classified as a part of the alarm unit 153.

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the hit module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or a suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. At least two haptic modules 154 may be provided according to the configuration of the mobile terminal 100.

The memory 160 may store a program for the operation of the controller 180 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 160 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read- A disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data to the external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the usage right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module a universal subscriber identity module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

When the mobile terminal 100 is connected to an external cradle, the interface unit may be a path through which power from the cradle is supplied to the mobile terminal 100, or various command signals input by the user to the cradle may be transmitted It can be a passage to be transmitted to the terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays , Microprocessors, microprocessors, microprocessors, and other electronic units for carrying out other functions. In some cases, the embodiments described herein may be implemented by the controller 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in the memory 160 and can be executed by the control unit 180. [

Method of processing user input to a mobile terminal

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100, and may include a plurality of operation units. The operating units may also be referred to as manipulating portions and may be employed in any manner as long as the user is operating in a tactile manner with a tactile impression.

Various types of time information can be displayed on the display unit 151. [ These pieces of information can be displayed in the form of letters, numbers, symbols, graphics, or icons.

At least one of the letters, numbers, symbols, graphics, or icons may be displayed in a predetermined arrangement for inputting such information, thereby being implemented as a keypad. Such a keypad may be called a so-called " soft key ".

The display unit 151 may operate as an entire area or may be divided into a plurality of areas and operated. In the latter case, the plurality of areas can be configured to operate in association with each other.

For example, an output window and an input window may be displayed on the upper and lower portions of the display unit 151, respectively. The output window and the input window are areas allocated for outputting or inputting information, respectively. In the input window, a soft key with a number for entering a telephone number or the like may be output. When the soft key is touched, the number corresponding to the touched soft key is displayed on the output window. When the operating unit is operated, a call connection to the telephone number displayed in the output window may be attempted, or the text displayed in the output window may be entered into the application.

The display unit 151 or the touch pad may be configured to receive a touch input by scrolling. The user can move a cursor or a pointer located on an object displayed on the display unit 151, for example, an icon or the like, by scrolling the display unit 151 or the touch pad. Further, when the finger is moved on the display unit 151 or the touch pad, the path along which the finger moves may be visually displayed on the display unit 151. [ This will be useful for editing the image displayed on the display unit 151. [

One function of the terminal may be executed in response to a case where the display unit 151 (touch screen) and the touch pad are touched together within a predetermined time range. In the case of being touched together, there may be a case where the user clamps the terminal body using the thumb and index finger. The one function may be, for example, activation or deactivation of the display unit 151 or the touch pad.

Hereinafter, embodiments related to a control method that can be implemented in a terminal configured as above will be described with reference to the accompanying drawings. The following embodiments can be used alone or in combination with each other. In addition, the embodiments described below may be used in combination with the above-described user interface (UI).

First, concepts or terms to be referred to in describing the embodiments disclosed herein will be described.

Augmented reality information

In general, augmented reality (AR) is a field of virtual reality, in which a virtual object or information is synthesized on a real environment or on a real object to make it look like an object or information in the original environment. .

The augmented reality information (AR information) means guide information about a target object, and can be acquired by a location based (GPS based) method, a marker recognition based method, or the like. The object to which such augmented reality information is displayed includes all objects to which guide information such as an article, a product, a building, a product, a route map, and a public transportation can be provided.

Specifically, in the case of the location-based method, the mobile terminal uses the GPS information and the geomagnetic sensor information (direction, tilt information) to determine the location of the object viewed by the mobile terminal (for example, The augmented reality information is acquired, and the obtained augmented reality information is overlaid on the actual image to provide guide information on the object.

On the other hand, in the case of the marker recognition based method, the mobile terminal finds a marker displayed on the image, recognizes the size of the marker and the distance between the marker and the mobile terminal, and determines the three-dimensional position and / . The mobile terminal can obtain the augmented reality information directly from the augmented reality marker or obtain the augmented reality information associated with the augmented reality marker from the server and display the obtained augmented reality information on the image or at the marker position.

For example, the augmented reality marker may include augmented reality information in the form of an image, a two-dimensional code, or the like, and may include various data such as letters, numbers, symbols, and control codes. In this case, the mobile terminal can acquire the augmented reality information by decoding the image of the augmented reality marker encoded with the augmented reality information, the two-dimensional code, and the like. The concrete method for constructing the augmented reality markers with the two-dimensional code can be understood in a similar manner to the known two-dimensional codes (e.g., QR code, PDF417, DataMatrix, MaxiCode, etc.), and therefore detailed description thereof will be omitted.

Alternatively, the augmented reality marker may include or provide information used to acquire or access the augmented reality information (i.e., augmented reality generation information to be described later). For example, the information may be a unique number given by a different number or a combination of characters for each augmented reality information, URL information capable of accessing the augmented reality information, and the like. In this case, the mobile terminal can decode the image of the augmented reality marker in which the information is encoded, a two-dimensional code, and the like to obtain the information. The mobile terminal can inquire the information on the server and acquire corresponding augmented reality information.

A route guidance method using image projection and a mobile terminal using the method

The route guidance method according to an embodiment disclosed herein provides a route guidance in a form that the user can understand more easily according to the image projection direction of the mobile terminal, thereby allowing the user to navigate the route to the destination with a sense of space in the real world To provide a way to make it possible.

As described above, the conventional terminal displays the route information on a relatively small screen due to the limitation of the display size, so that it is inconvenient for the terminal user to easily grasp such route information.

The mobile terminal 100 according to an exemplary embodiment of the present invention includes an image projecting unit and can project a path guide image indicating a map, a direction, and the like on an outer surface using the image projecting unit. In this case, the image projecting unit may include a projector module, and the direction information may be provided in the form of an arrow according to the user's point of view in the real space.

FIG. 2 is a diagram illustrating an example in which a mobile terminal according to an embodiment of the present invention projects a path guide image onto an outer surface. FIG.

As shown in FIG. 2, the mobile terminal 100 can project a route guidance image on an outer wall surface (upper end in FIG. 2) or on a ground surface (lower end in FIG. 2). In this case, the route guidance image may include a traveling direction, a distance, a map, and the like to the destination input by the user.

Although not shown in FIG. 2, the mobile terminal 100 can determine whether it is currently being projected on the ground, or projecting on a wall, in consideration of its inclination. The mobile terminal 100 displays a two-dimensional map image when it is judged that the ground surface is being projected, and displays a three-dimensional map image when it is judged that the wall surface is being projected, thereby providing a route guidance image . The three-dimensional map image may include an object such as a building modeled in the form of a three-dimensional wire frame.

The mobile terminal 100 according to one embodiment disclosed herein will be described in more detail as follows.

The location information module 115 obtains location information of the mobile terminal 100. At this time, the position information module 115 may be a global positioning system (GPS) module.

The sensing unit 140 senses the direction and tilt of the mobile terminal 100. For this, the sensing unit 140 may include a geomagnetic sensor, a compass, a gyroscope, and the like.

The control unit 180 determines the display mode of the route guidance according to the detected inclination. At this time, the control unit 180 can determine the display mode by a three-dimensional display system or a two-dimensional display system. In particular, when the detected inclination is lower than the critical angle, the controller 180 determines the display mode to be a three-dimensional display mode, and when the detected inclination is greater than or equal to the threshold angle, It can be determined by the dimension display method.

For example, when the sensing unit 140 detects that the angle between the beam projecting direction and the ground is less than 45 degrees, the controller 180 determines that the beam projection is made on the vertical wall surface, Images can be configured. On the other hand, when the sensing unit 140 senses that the angle between the beam projecting direction and the ground is more than 45 degrees, the controller 180 determines that the beam projection is performed on the ground, . ≪ / RTI >

FIG. 3 is a diagram illustrating an example in which a mobile terminal constructs a route guidance image in a three-dimensional display manner according to an embodiment disclosed herein. 3 shows a case in which a beam projection direction is set to a wall surface direction after a user inputs a destination.

As shown in FIG. 3, the mobile terminal 100 can construct a route guidance image in the form of a three-dimensional building object on a three-dimensional map. At this time, the mobile terminal 100 displays the current position and the destination of the mobile terminal 100 or the user as an icon, an image, and the like, and can display a path to be traveled by an arrow or the like. 3, the mobile terminal 100 displays a path ("Walk 100m") to be proceeded at the present time point and a path ("And then Turn left") to be executed at the next point in the form of arrows and text.

FIG. 4 is a first example of a configuration in which a mobile terminal according to an embodiment disclosed herein constructs a route guidance image by a two-dimensional display method. FIG. 4 shows a case in which a route guidance image is constructed on the basis of a relative orientation (that is, a direction based on the user's traveling direction) when the user inputs the destination and the beam projection direction is set to the ground direction.

As shown in FIG. 4, the mobile terminal 100 can construct a route guidance image in the form of a two-dimensional building object on a two-dimensional map. At this time, the mobile terminal 100 displays the current position and the destination of the mobile terminal 100 or the user as an icon, an image, and the like, and can display a path to be traveled by an arrow or the like. 4, the mobile terminal 100 displays a path ("Walk 100m") to be proceeded at the current time point and a path ("And then Turn left") to be executed at the next point in the form of arrows and text.

As shown in FIG. 4, the mobile terminal 100 can construct a route guidance image from a user's point of view, rather than an absolute orientation reference, so that the user can more intuitively grasp the progress route.

FIG. 5 is a second exemplary diagram illustrating a configuration of a route guidance image in a two-dimensional display system according to an embodiment of the present invention. 5 shows a case in which a path guide image is constructed on the basis of an absolute azimuth (that is, an azimuth whose upper side of the route guidance image is the north) when the user inputs the destination and the beam projection direction is set to the ground direction.

As shown in FIG. 5, the mobile terminal 100 can construct a route guidance image in the form of a two-dimensional building object on a two-dimensional map. At this time, the mobile terminal 100 displays the current position and the destination of the mobile terminal 100 or the user as an icon, an image, and the like, and can display a path to be traveled by an arrow or the like. 5, the mobile terminal 100 displays a path ("Walk 100m") to be proceeded at the current point of time and a path ("And then Turn left") to be executed at the next point in the form of arrows and text.

Unlike the example described with reference to FIG. 4, a method in which the upper part of the map is always displayed to the north depending on the user may be preferred. For this, as shown in FIG. 5, the mobile terminal 100 may configure the route guidance image such that the upper side of the route guidance image is always at the north, so that the user can grasp the travel route in a manner preferred by the user.

The controller 180 may switch between a three-dimensional display mode and a two-dimensional display mode according to a user input signal (for example, a touch input, a button input, a gesture input, It is possible to switch between the absolute azimuth display mode.

The image projection unit projects a path guide image corresponding to the position, direction, and destination of the mobile terminal 100 on the outer surface according to the determined display method. As described above, the image projection unit may include a projector module. The image projecting unit may be built in the mobile terminal 100 or may be an external unit connected through the interface unit 170. [

When the display system determined by the controller 180 is a three-dimensional display system, the path guide image projected by the image projection unit may include three-dimensionally modeled map information (object), building information (object) .

Meanwhile, the control unit 180 may acquire object information corresponding to the position or direction of the mobile terminal 100, and the image projecting unit may project the acquired object information together with the path guide image on the outer surface. Here, the position and direction of the mobile terminal 100 may be acquired or processed in the form of GPS information and azimuth information, respectively, and the object information may be augmented reality information.

For example, the object information may be news information or driving information on which the mobile terminal 100 is located. Alternatively, the object information may be building information corresponding to the position and the direction of the mobile terminal 100. Alternatively, the object information may be information on a building where the outer surface on which the path guide image is projected is located. Alternatively, the object information may be augmented reality information for an object corresponding to the position and direction of the mobile terminal 100. [

FIG. 6 is a diagram illustrating an example in which a mobile terminal displays object information together with a route guidance image according to an embodiment disclosed herein.

6, the mobile terminal 100 transmits information ("Palace Hotel "," Apple Tree lane, 27 ") about the building where the exterior surface on which the route guidance image is currently projected, The beam can be projected together. The mobile terminal 100 can identify the building based on the location and direction of the mobile terminal 100. [

Meanwhile, the controller 180 may construct an image (for example, a building plan view image) showing the internal structure of the building where the mobile terminal 100 is located, and may project the image onto the external surface. For this, when the location information module 115 obtains the location information of the mobile terminal 100 and the wireless communication unit 110 transmits the location information to the server, the server obtains the building information corresponding to the location information A building name, a building address, a floor plan showing an internal structure of the building by floor, and the like) to the mobile terminal 100.

FIG. 7 is a diagram illustrating an example of a display of an internal structure of a mobile terminal according to an exemplary embodiment of the present invention; FIG.

As shown in FIG. 7, the mobile terminal 100 can project a plan view image showing the internal structure of the building onto the outer surface. At this time, the mobile terminal 100 displays the current location of the mobile terminal 100 or the user as an icon, an image, and the like, and displays the location and name of each room in the building as an image, text, or the like.

FIG. 8 is a flow chart illustrating a route guidance method in an embodiment disclosed herein.

Referring to FIG. 8, the mobile terminal 100 acquires location information of the mobile terminal 100 (S810). In addition, the mobile terminal 100 senses the direction and the inclination of the mobile terminal 100 itself (S830).

The mobile terminal 100 determines the display mode of the route guidance according to the detected inclination (S850). At this time, the mobile terminal 100 can determine the display method by a three-dimensional display method or a two-dimensional display method. In particular, if the detected inclination is lower than the critical angle, the mobile terminal 100 determines the display mode to be a three-dimensional display mode, and if the detected inclination is greater than or equal to the threshold angle, It can be determined by the dimension display method.

In step S870, the mobile terminal 100 projects a path guide image corresponding to the position, direction, and destination of the mobile terminal on the outer surface according to the determined display mode. When the display method is determined by the three-dimensional display method, the mobile terminal 100 can beam-project an image modeled in three dimensions of the map information and the building information.

Meanwhile, the mobile terminal 100 may acquire object information corresponding to the position or direction of the mobile terminal (S880). Here, the position and direction of the mobile terminal may be acquired or processed in the form of GPS information and azimuth information, respectively.

Then, the mobile terminal 100 can project the acquired object information together with the path guide image on the outer surface (S890). Here, the object information may be news information or roadway information on which the mobile terminal is located. Alternatively, the object information may be building information corresponding to the location and direction of the mobile terminal. Alternatively, the object information may be information on a building where the outer surface on which the path guide image is projected is located. Alternatively, the object information may be augmented reality information on an object corresponding to the position and direction of the mobile terminal.

The mobile terminal 100 may beam-project a path guide image representing the inner structure of the building where the mobile terminal is located on the outer surface.

The method according to the embodiments disclosed herein may be understood as similar to that described with reference to Figs. 1 to 7 with respect to the mobile terminal according to the embodiments disclosed in the above description, and thus the detailed description will be omitted.

Further, according to the embodiment disclosed herein, the above-described method can be implemented as a code that can be read by a processor on a medium on which the program is recorded. Examples of the medium that can be read by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, etc., and may be implemented in the form of a carrier wave (e.g., transmission over the Internet) .

The mobile terminal described above can be applied to not only the configuration and method of the embodiments described above but also all or some of the embodiments may be selectively combined so that various modifications may be made to the embodiments It is possible.

The embodiments disclosed herein have been described with reference to the accompanying drawings.

Here, terms and words used in the present specification and claims should not be construed as limited to ordinary or dictionary meanings, but should be construed as meaning and concept consistent with the technical idea disclosed in the present specification.

Therefore, the embodiments described in the present specification and the configurations shown in the drawings are only examples described in this specification, and not all of the technical ideas disclosed in this specification are described. Therefore, It is to be understood that equivalents and modifications are possible.

100: mobile terminal 110: wireless communication unit
120: A / V input unit 130: user input unit
140: sensing unit 150: output unit
160: memory 170: interface section
180: control unit 190: power supply unit

Claims (22)

Obtaining location information of the mobile terminal;
Sensing a direction and a slope of the mobile terminal;
Determining a display mode of route guidance according to the detected slope; And
And projecting a path guide image corresponding to the position, direction, and destination of the mobile terminal onto an outer surface according to the determined display method,
The step of determining the display mode of the route guide
Dimensional display method when the detected inclination is lower than the critical angle, and determines the two-dimensional display method when the detected inclination is greater than or equal to the critical angle. . delete delete The method of claim 1, wherein projecting the path guide image onto an outer surface comprises:
When the display mode is determined by the three-dimensional display mode, a route guidance image modeled with three-dimensional map information and building information is projected on a wall surface,
Wherein when the display method is determined by the two-dimensional display method, the route guidance image in which the map information and the building information are modeled in two dimensions is projected on the ground. The method of claim 1, further comprising: obtaining object information corresponding to a position or a direction of the mobile terminal; And
And projecting the object information together with the path guide image onto an outer surface of the path guide image. 6. The method according to claim 5,
News information or traffic information on which the mobile terminal is located;
Building information corresponding to the location and direction of the mobile terminal;
Information about a building where an external surface on which a path guide image is projected is located; And
The augmented reality information on an object corresponding to the position and direction of the mobile terminal; The method of claim 1, further comprising: delete delete delete The method of claim 1, wherein the location and orientation of the mobile terminal
Wherein the information is processed in the form of global positioning system (GPS) information and azimuth information, respectively. The method according to claim 1,
Wherein the image is a video image showing a structure inside the building where the mobile terminal is located. A location information module for obtaining location information of the mobile terminal;
A sensing unit sensing a direction and a tilt of the mobile terminal;
A controller for determining a display mode of the route guidance according to the detected inclination; And
And an image projecting unit for projecting a path guide image corresponding to the position, direction and destination of the mobile terminal to an outer surface according to the determined display mode,
The control unit
Dimensional display method when the detected inclination is lower than the critical angle, and determines the two-dimensional display method when the sensed inclination is greater than or equal to the critical angle. delete delete 13. The apparatus according to claim 12, wherein the image projecting unit
When the display mode is determined by the three-dimensional display mode, a route guidance image modeled with three-dimensional map information and building information is projected on a wall surface,
Wherein when the display method is determined by the two-dimensional display method, the route guidance image modeling the map information and the building information in two dimensions is projected on the ground. 13. The apparatus of claim 12, wherein the control unit
Wherein the object information acquiring unit acquires object information corresponding to the position or direction of the mobile terminal, and the image projecting unit projects the object information together with the path guide image on the outer surface. 17. The method according to claim 16, wherein the object information
Wherein the mobile terminal is the news information or the road information in which the mobile terminal is located. 17. The method according to claim 16, wherein the object information
And the building information corresponding to the location and direction of the mobile terminal. 17. The method according to claim 16, wherein the object information
Wherein the path guide image is information on a building where the outer surface on which the beam is projected is located. 17. The method according to claim 16, wherein the object information
Wherein the mobile terminal is an augmented reality information about an object corresponding to a position and a direction of the mobile terminal. 13. The method of claim 12, wherein the location and orientation of the mobile terminal
Are processed in the form of global positioning system (GPS) information and azimuth information, respectively. 13. The method according to claim 12,
Wherein the mobile terminal is a video image showing a structure inside the building where the mobile terminal is located.

Images