KR20110133714A - Mobile terminal and image display method - Google Patents

Abstract

PURPOSE: A portable terminal and image display method thereof are provided to enable a user to effectively receive location information by displaying a location video. CONSTITUTION: A sensing unit(140) acquires the direction information of a terminal. A control unit(180) acquires a second video matched with a first video using the location information of the terminal and the acquired direction information. The control unit compares the first video with the second video. A display unit(151) displays the comparing result according to the control of the control unit. The display unit displays the first video and the second video.

Description

Mobile terminal and video display method {MOBILE TERMINAL AND IMAGE DISPLAY METHOD}

The present invention relates to an image display method associated with a specific place and a mobile terminal thereof.

The terminal can move And can be divided into a mobile / portable terminal and a stationary terminal depending on whether the mobile terminal is a mobile terminal or a mobile terminal. The mobile terminal may be further classified into a handheld terminal and a vehicle mount terminal according to whether a user can directly carry it.

Such a terminal has various functions, for example, in the form of a multimedia device having multiple functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, etc. .

In order to support and increase the function of such a terminal, it may be considered to improve the structural part and / or the software part of the terminal.

A terminal having a camera function may receive a corresponding image from the outside.

However, there is a problem that the conventional terminal can not only see the image of the corresponding place at the time of capturing, but also cannot grasp another image of another time zone of the corresponding place.

It is an object of the present invention to provide a video display method and a mobile terminal capable of identifying a specific place through a video of another time zone or a different season when a specific place is visited.

In addition, another object of the present invention is to provide a method and a mobile terminal capable of acquiring an image of a specific place from a corresponding terminal or through a network and displaying the corresponding images in various ways.

A mobile terminal according to an embodiment of the present invention for realizing the above object is a camera module for receiving a first image from the outside of the terminal, a location information module for obtaining terminal location information, a sensing unit for obtaining direction information of the terminal, A control unit which acquires a second image matching the input first image by using the obtained terminal position information and direction information, and compares the first and second images according to a prescribed criterion; The display unit may include a display unit configured to display at least one of the first and second images by reflecting the comparison result.

The terminal further includes a wireless communication unit for transmitting an image request signal including the obtained terminal position information and direction information, and receives a second image matching the first image as a result of the transmission, wherein the control unit Acquired according to the reception of the second image.

The terminal further includes a memory for storing a plurality of images, and the controller searches for a second image matching the first image from the plurality of images stored in the memory.

According to an aspect of the present invention, there is provided a method of displaying an image, the method comprising: receiving a first image from an outside of a terminal, acquiring position information of the terminal, acquiring direction information of the terminal, Acquiring a plurality of second images matching the first image by using position information and direction information, comparing the first image and the second image according to a prescribed criterion, and the first image and And displaying the second images by reflecting the comparison result.

The mobile terminal according to at least one embodiment of the present invention configured as described above can easily grasp images of different time zones or different seasons when it is impossible to stay in one place for a long time when traveling. Therefore, it is possible to grasp the appearance of the place in different time zones or different seasons.

In addition, the mobile terminal and the display method according to at least one embodiment of the present invention configured as described above compares the current image and the loaded images of the corresponding place and displays them differently according to the degree of similarity. There is an effect that can be identified more easily.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
Figure 2a is a front perspective view of a mobile terminal according to an embodiment of the present invention.
2b is a rear perspective view of a mobile terminal according to one embodiment of the present invention;
Figure 3 is a flow chart schematically showing the flow of the image display method related to the present invention.
4 is a view schematically illustrating a method of determining location information and direction information of a terminal in accordance with the present invention.
5a to 5d illustrate a first image and a second image of a corresponding place according to different criteria in accordance with the present invention.
6A and 6B are diagrams for displaying a first image or a second image according to a degree of similarity between a first image and a second image in accordance with the present invention;

Hereinafter, a mobile terminal according to the present invention will be described in more detail with reference to the accompanying drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described herein may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), navigation, and the like.

However, it will be readily apparent to those skilled in the art that the configuration according to the embodiments described herein may also be applied to fixed terminals such as digital TVs, desktop computers, etc., except when applicable only to mobile terminals.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, and an interface. The unit 170, the controller 180, and the power supply unit 190 may be included. The components shown in FIG. 1 are not essential, so that a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and a network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The mobile communication module 112 transmits and receives a wireless signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call call signal, or a text / multimedia message.

The wireless internet module 113 refers to a module for wireless internet access and may be embedded or external to the mobile terminal 100. Wireless Internet technologies may include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), and the like.

The short range communication module 114 refers to a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

The location information module 115 is a module for obtaining a location of a mobile terminal, and a representative example thereof is a GPS (Global Position System) module.

Referring to FIG. 1, the A / V input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video call mode or the photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be provided according to the use environment.

The sensing unit 140 detects a current state of the mobile terminal 100 such as an open / closed state of the mobile terminal 100, a location of the mobile terminal 100, presence or absence of a user contact, orientation of the mobile terminal, acceleration / deceleration of the mobile terminal, and the like. To generate a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. In addition, whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled to the external device may be sensed. The sensing unit 140 may include a proximity sensor 141.

The output unit 150 is used to generate an output related to visual, auditory or tactile senses, which includes a display unit 151, an audio output module 152, an alarm unit 153, a haptic module 154, and a projector module ( 155) may be included.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in a call mode, the mobile terminal displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the mobile terminal 100 is in a video call mode or a photographing mode, the mobile terminal 100 displays photographed and / or received images, a UI, and a GUI.

The display unit 151 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display (flexible). and at least one of a 3D display.

Some of these displays can be configured to be transparent or light transmissive so that they can be seen from the outside. This may be referred to as a transparent display. A representative example of the transparent display is TOLED (Transparant OLED). The rear structure of the display unit 151 may also be configured as a light transmissive structure. With this structure, the user can see the object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the implementation form of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another, or may be disposed integrally with one another, and may be disposed on different surfaces, respectively.

When the display unit 151 and a sensor for detecting a touch operation (hereinafter, referred to as a touch sensor) form a mutual layer structure (hereinafter referred to as a touch screen), the display unit 151 may be configured in addition to an output device. Can also be used as an input device. The touch sensor may have, for example, a form of a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 151 or capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor may be configured to detect not only the position and area of the touch but also the pressure at the touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and then transmits the corresponding data to the controller 180. As a result, the controller 180 can know which area of the display unit 151 is touched.

Referring to FIG. 1, a proximity sensor 141 may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is surrounded by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object present in the vicinity without using a mechanical contact by using an electromagnetic force or infrared rays. Proximity sensors have a longer life and higher utilization than touch sensors.

Examples of the proximity sensor include a transmission photoelectric sensor, a direct reflection photoelectric sensor, a mirror reflection photoelectric sensor, a high frequency oscillation proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. When the touch screen is capacitive, the touch screen is configured to detect the proximity of the pointer by the change of the electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of allowing the pointer to be recognized without being in contact with the touch screen so that the pointer is located on the touch screen is referred to as a "proximity touch", and the touch The act of actually touching the pointer on the screen is called "contact touch." The position where the proximity touch is performed by the pointer on the touch screen refers to a position where the pointer is perpendicular to the touch screen when the pointer is in proximity proximity.

The proximity sensor detects a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, and a proximity touch movement state). Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

The memory unit 160 may store a program for processing and controlling the controller 180, and temporarily stores input / output data (for example, a phone book, a message, an audio, a still image, a video, etc.). It can also perform a function for. The memory unit 160 may also store the frequency of use of each of the data (for example, each telephone number, each message, and frequency of use for each multimedia). In addition, the memory unit 160 may store data regarding vibration and sound of various patterns output when a touch input on the touch screen is performed.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), RAM (Random Access Memory, RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), Magnetic Memory, Magnetic It may include a storage medium of at least one type of disk, optical disk. The mobile terminal 100 may operate in connection with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device, receives power, transfers the power to each component inside the mobile terminal 100, or transmits data inside the mobile terminal 100 to an external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The interface unit may be a passage through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, or various command signals input from the cradle by a user may be transferred. It may be a passage that is delivered to the terminal. Various command signals or power input from the cradle may be operated as signals for recognizing that the mobile terminal is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal. For example, perform related control and processing for voice calls, data communications, video calls, and the like. The controller 180 may include a multimedia module 181 for playing multimedia. The multimedia module 181 may be implemented in the controller 180 or may be implemented separately from the controller 180.

The controller 180 may perform a pattern recognition process for recognizing a writing input or a drawing input performed on the touch screen as text and an image, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

Various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using, for example, software, hardware or a combination thereof.

According to a hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and the like. It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions. The described embodiments may be implemented by the controller 180 itself.

According to the software implementation, embodiments such as the procedures and functions described herein may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code may be stored in the memory 160 and executed by the controller 180.

2A is a front perspective view of an example of a mobile terminal or a portable terminal according to the present invention.

The disclosed portable terminal 100 has a terminal body in the form of a bar. However, the present invention is not limited thereto and may be applied to various structures such as a slide type, a folder type, a swing type, a swivel type, and two or more bodies are coupled to be relatively movable.

The body includes a casing (casing, housing, cover, etc.) that forms an exterior. In this embodiment, the case may be divided into a front case 101 and a rear case 102. Various electronic components are built in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be further disposed between the front case 101 and the rear case 102.

The cases may be formed by injecting synthetic resin or may be formed of a metal material, for example, a metal material such as stainless steel (STS) or titanium (Ti).

The display unit 151, the audio output unit 152, the camera 121, the user input units 130/131 and 132, the microphone 122, and the interface 170 may be disposed in the terminal body, mainly the front case 101. have.

The display unit 151 occupies most of the main surface of the front case 101. A sound output unit 151 and a camera 121 are disposed in an area adjacent to one end of both ends of the display unit 151 and a user input unit 131 and a microphone 122 are disposed in an area adjacent to the other end. The user input unit 132 and the interface 170 may be disposed on side surfaces of the front case 101 and the rear case 102.

The user input unit 130 is manipulated to receive a command for controlling the operation of the portable terminal 100 and may include a plurality of operation units 131 and 132. The manipulation units 131 and 132 may also be collectively referred to as manipulating portions, and may be employed in any manner as long as the user operates the tactile manner with a tactile feeling.

Content input by the first or second manipulation units 131 and 132 may be variously set. For example, the first operation unit 131 receives commands such as start, end, scroll, and the like, and the second operation unit 132 controls the size of the sound output from the sound output unit 152 or the size of the sound output from the display unit 151 To the touch recognition mode of the touch screen.

FIG. 2B is a rear perspective view of the portable terminal shown in FIG. 2A.

Referring to FIG. 2B, a camera 121 ′ may be additionally mounted on the rear of the terminal body, that is, the rear case 102. The camera 121 'may have a photographing direction substantially opposite to the camera 121 (see FIG. 2A), and may be a camera having different pixels from the camera 121.

For example, the camera 121 has a low pixel so that the user's face is photographed and transmitted to the counterpart in case of a video call, and the camera 121 'photographs a general subject and does not transmit it immediately. It is desirable to have a high pixel because there are many. The cameras 121 and 121 'may be installed in the terminal body so as to be rotatable or pop-upable.

A flash 123 and a mirror 124 are further disposed adjacent to the camera 121 '. The flash 123 shines light toward the subject when the subject is photographed by the camera 121 '. The mirror 124 allows the user to see his / her own face or the like when photographing (self-photographing) the user using the camera 121 '.

The sound output unit 152 'may be further disposed on the rear surface of the terminal body. The sound output unit 152 ′ may implement a stereo function together with the sound output unit 152 (see FIG. 2A), and may be used to implement a speakerphone mode during a call.

In addition to the antenna for talking and the like, a broadcast signal receiving antenna 116 may be further disposed on the side of the terminal body. The antenna 116, which forms part of the broadcast receiving module 111 (see FIG. 1), can be installed to be able to be drawn out from the terminal body.

A power supply unit 190 for supplying power to the portable terminal 100 is mounted on the terminal body. The power supply unit 190 may be embedded in the terminal body or may be directly detachable from the outside of the terminal body.

The rear case 102 may be further equipped with a touch pad 135 for sensing a touch. Like the display unit 151, the touch pad 135 may also be configured to have a light transmission type. In this case, if the display unit 151 is configured to output visual information from both sides, the visual information may be recognized through the touch pad 135. The information output on both surfaces may be controlled by the touch pad 135. Alternatively, a display may be additionally mounted on the touch pad 135, and a touch screen may be disposed on the rear case 102 as well.

3 is a flowchart schematically illustrating a flow of an image display method according to the present invention.

First, the first image is received from the outside of the mobile terminal through the camera 121 (S310). The location information module 115 of the mobile terminal receives the location information of the terminal (S320). The direction information of the terminal is received through the sensing unit 140 of the mobile terminal (S330). A plurality of second images matching the first image are received using location information and direction information of the terminal (S340). The controller 180 of the terminal compares the received first image with the second image (S350). According to the comparison result, the display unit 151 displays the second images (S360).

In the following, the present invention is explained according to the flow shown in FIG.

The camera 121 of the mobile terminal 100 receives a first image of a specific place from the outside of the terminal (S310).

When the mobile terminal 100 enters the camera photographing mode, the mobile terminal 100 may activate the camera 121 and receive an external image, that is, the first image, by using the same. In addition, the input image may be zoomed in or zoomed out according to a user setting.

The input image may be an image of a specific place and may include an artifact such as a building or a car, or may include natural objects such as an ocean, a river, and a mountain.

The mobile terminal 100 obtains location information of the mobile terminal 100 using the location information module 115 (S320).

4A is a diagram schematically illustrating that the mobile terminal acquires location information using the location information module 115.

The mobile terminal 100 may obtain its current location information from the satellite 401 using a global positioning system (GPS). For example, the location information may include the longitude, latitude, coordinate values, etc. of the point where the mobile terminal 100 is currently located. Alternatively, the mobile terminal 100 may also obtain current location information using the neighboring base station 402.

Using such location information, the controller 180 of the mobile terminal 100 can accurately determine its current location.

The mobile terminal 100 obtains direction information of the mobile terminal 100 using the sensing unit 140.

4B is a diagram schematically illustrating that the mobile terminal obtains direction information by using the sensing unit 140.

The direction information of the mobile terminal 100 is information on the direction toward which the camera 121 of the mobile terminal 100 faces at the point where the mobile terminal 100 is currently located. The mobile terminal 100 may include a motion sensor (not shown), and may sense a direction in which the camera 121 faces by using the motion sensor. For example, the direction in which the camera 121 faces may be expressed by at least one of east, west, south, and north.

In FIG. 4B, the mobile terminal 100 faces the north-east direction in a specific direction. Using this direction information, a specific range 410 viewed through the camera 121 is determined. Accordingly, an image of a tree 410 and a building 420 belonging to a specific range 410 covered by a specific direction of the camera may be acquired through the camera 121.

The controller 180 may recognize a location at which the mobile terminal 100 is currently located by using coordinate information among the obtained location information, and use a direction toward which the camera 121 faces through the acquired direction information. It can recognize the front of the mobile terminal 100 at the current location. Therefore, the controller 180 can accurately grasp the location of the place included in the image acquired through the camera 121.

In a next step, the mobile terminal 100 receives a plurality of second images that match the first image (S340).

After the location information and the direction information of the place included in the first image are grasped, the second images matching the first image are acquired by various methods. The second image is matched with the first image and may be obtained using corresponding location information and direction information.

First, a method of obtaining a second image from an external server will be described.

The wireless communication unit 110 of the mobile terminal 100 transmits an image request signal including location information and direction information of the terminal 100 to a plurality of external servers. The plurality of external servers receiving the image request signal search for the second image that is similar or identical to the corresponding place by using the location information and the direction information. Such an image may be a still image or a moving image.

The external server transmits the searched second image to the mobile terminal 100. The wireless communication unit 110 of the mobile terminal 100 receives the transmitted second image. The received second image is stored in the memory 160.

Alternatively, a method of obtaining a second image from images stored in the memory 160 of the mobile terminal will be described.

The controller 180 searches for images previously stored in the memory 160 by using the location information and the direction information of the mobile terminal determined from the steps S320 and S330. The controller 180 first searches for pre-stored images based on the location information. Among the images searched based on a predetermined criterion, a second image matching a first level with a predetermined level is searched and obtained based on the direction information of the mobile terminal.

In a next step, the controller 180 compares the obtained first image and the second image according to a predetermined criterion (S350).

5A to 5D are diagrams illustrating first and second images according to a predetermined criterion.

The controller 180 compares the degree of similarity between the first image and the second image according to a predetermined criterion.

There are various criteria for determining whether similar images are similar. When a specific image is for a specific place, whether the objects included in the image such as a building or a mountain belonging to the place match, whether or not the direction in which the object is taken is matched, the recording time of the images, the season of shooting the images, The photographing year of the corresponding images may be variously classified.

In the case of an image of a person, a criterion of similarity may be determined in various ways, such as the number of people, appearance, or uniformity of clothes, and whether or not the person matches a place.

Similarity of the images may be variously set according to a user's or manufacturer's setting, and the criteria for the degree of similarity in the present invention are not limited to specific criteria.

FIG. 5A is a diagram of comparing a first image and a second image using a photographing time as a criterion of similarity.

5A (a) illustrates a first image, which is an external image obtained through the camera 121. In the place included in the first image, there is one tree and one building. The current shooting time for shooting the first image is shown at 12:00.

(B) and (c) of FIG. 5A show the obtained second image. FIG. 5A (b) shows that the photographing time is different for the same place as the first image, and is photographed at 16:00. FIG. 5A (c) shows that the photographing time is different and photographed at 20:00 for the same place as the first image.

Even when the photographing time is a similar degree of reference, various detailed criteria may be set. For example, the closer the photographing time is to the photographing time of the first image, the higher the similarity may be set or vice versa. When the photographing time is set closer to the photographing time, the control unit 180 determines that the second image of FIG. 5A (b) has a higher degree of similarity than the second image of FIG. 5A (c).

FIG. 5B is a diagram comparing a first image and a second image by using a season difference including a photographing date based on a similarity level.

Even if the same place is photographed according to the season, there is a difference in the image of the place. For example, in winter, snow may be photographed mainly in white, and in spring, green may be photographed. Therefore, the traveler who travels to the place may only see the place in a particular season, and thus may want to obtain an image of another season. In this case, when the photographing date and season of the image are set based on the degree of similarity, there is an effect of clearly showing the difference according to the season.

FIG. 5B (a) illustrates a first image that is an external image of a photographing current acquired through the camera 121. FIG. The date and season taken in the first image are May 10, which corresponds to spring.

(B) and (c) of FIG. 5A show the obtained second image. FIG. 5A (b) shows that the photographing dates and seasons are different in the same place as the first image, and the photographs are photographed in autumn as November 2. FIG. 5A (c) shows that the photographing date and season are different for the same place as the first image, and that the photographing is taken in winter as February 2. FIG.

Various detailed criteria may be set even when the photographing date and the season are similar criteria. For example, the season having the largest difference from the season of the first image may be set as the lowest similarity, and accordingly, the controller 180 determines that the second image in autumn has the lowest similarity with respect to the spring first image. To judge.

5C is a diagram comparing a first image and a second image by using a difference in a direction and a configuration in which an image is taken based on a similarity level.

In the case of a famous tourist destination, cameras are often photographed in the same direction at the same place, so that the location information and the direction information may be almost the same. However, in the general case, the location information and the direction information of the terminal are not exactly matched. In this case, by using the difference in the direction and configuration between the first image and the second image, it is possible to more clearly grasp the degree of similarity of the images for the corresponding place.

5C (a) is a first image of photographing a specific place through the camera 121. (B) and (c) of FIG. 5C show the obtained second image.

As shown in FIG. 5C (a), the place included in the first image includes a tree 510 and a building 512. The second image illustrated in FIG. 5C (b) is an image captured in different directions with respect to the same place. In the second image of FIG. 5C (b), one building 512 of the first image is shown but there are no trees and instead there are different constructions, a bus stop sign 522 and a car 524. Also, the second image shown in FIG. 5C (c) is also an image captured in a different direction from the first image in the same place. In the second image of FIG. 5C (c), the tree 510 of the first image is visible, the building 512 is visible, and the bus stop sign 522 is visible.

When the difference between the camera photographing direction and the composition of the image is set based on the degree of similarity, the controller 180 selects the second image of FIG. 5C (c) as the second image most similar to the first image of FIG. 5C (a). .

5D is a diagram for comparing a first image and a second image using brightness of an image based on a similarity degree.

The brightness of the image can be changed by various factors. For example, the image taken in the morning and the image taken in the night may have a difference in brightness of each image according to the difference in sunlight. In addition, the brightness of the photographed images may vary depending on the performance or the setting of the camera photographing the image. Therefore, even if the image is taken in the same time zone for the same place, a difference in brightness of the image may occur. Therefore, the difference in brightness due to the difference in the image of the place may be a useful criterion.

5D (a) illustrates a first image captured by the camera 121 of the terminal 100. (B) and (c) of FIG. 5D are second images taken in the same direction with respect to the same place. As shown in the drawing, the first image and the second image have a difference in brightness of the image. As described above, such a difference may occur depending on a difference in shooting time or the performance of a camera.

If the difference in brightness of the image is set based on a similarity level, the controller 180 may determine that the second image of FIG. 5D (b) is more similar to the first image than the second image of FIG. 5D (c). .

In operation S360, second images are displayed on the display unit 151 according to the comparison result between the first image and the second image.

In operation S350, the controller 180 compares the similarity between the first image and the acquired second images according to various prescribed criteria. In operation S360, the second images are displayed on the display unit 151 based on the comparison result.

The present invention provides a function for identifying other images similar to a specific place through a mobile terminal. Accordingly, there is a need to identify a plurality of second images matched with the first image according to various criteria and then show the degree of similarity to the user of the terminal.

6A is a diagram of displaying second images on the display unit 151 according to a degree of similarity.

In FIG. 6A (a), a plurality of second images 602, 604, and 608 are displayed in the display unit 151. The sizes of the second images are displayed in the order of the highest similarity with the first image. The second image 604, the second image 602, and the second image 608 are displayed by size in the order of highest similarity. As a result, the user may specifically identify a second image most similar to the first image.

6A (b), a plurality of second images 622, 624, and 626 are displayed in the display unit 151. The images are displayed in order from the left in order of highest similarity to the first image. In addition, the degree of similarity can be converted into a score so that it can be clearly displayed in each image. The second image 622 having the highest degree of similarity may be positioned on the leftmost side of the display unit 151 and may be displayed together with a degree of similarity of "85% similarity".

Although not shown in the drawing, the user may select the displayed second images by a user operation such as a touch operation and directly compare the first images.

Various methods of displaying the second images according to the degree of similarity with the first image may exist, and the present invention is not limited to the above-described embodiments.

6B is a diagram of simultaneously displaying a first image and a plurality of second images.

6B (a) may simultaneously display one first image and a plurality of second images. The first image 632 may be displayed on the left side of the display unit 151 and the plurality of second images may be displayed on the right side of the display unit 151. The second images 635, 636, 637 displayed in the region 634 may be displayed such that the size of the image differs according to the degree of similarity as shown in FIG. 6A (a). However, a plurality of second images may be displayed in the same size, and the second image may be converted into a score as shown in FIG. 6A (b) and displayed.

6B (b) may simultaneously display one first image and one second image. The first image 642 may be displayed on the left side of the display unit 151, and one second image 644 may be displayed on the right side of the display unit 151. When the controller 181 selects the second image having the highest similarity or the lowest similarity among the plurality of second images, only the selected second image may be displayed. Accordingly, the user may clearly compare and display the first image and the second image.

6B (c) illustrates another method of simultaneously displaying one first image and one second image. The first image is displayed on the display unit 151. One second image is displayed on the partial region 652 of the display unit 151 on which the first image is displayed. The second image displayed is an image having the highest similarity or the least similarity. The second image may be superimposed on the displayed first image to conceal the first image of the corresponding region, but may be semi-transparently displayed to display contents of the first image.

In addition, according to an embodiment of the present invention, the above-described image display method may be implemented as code that can be read by a processor in a medium in which a program is recorded. Examples of processor-readable media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and may be implemented in the form of a carrier wave (for example, transmission over the Internet). Include.

The above-described mobile terminal and the image display method are not limited to the configuration and method of the above-described embodiments, but the embodiments may be selectively or partially all of the embodiments so that various modifications can be made. It may be configured in combination.

100 mobile terminal 110 wireless communication unit
121 Camera 140 Sensing
160 memory 180 controller

Claims (6)

A camera module for receiving a first image from an outside of the terminal;
A location information module for obtaining terminal location information;
A sensing unit obtaining direction information of the terminal;
A controller which acquires a second image matching the input first image by using the obtained terminal position information and direction information, and compares the first and second images according to a prescribed criterion; And
And a display configured to display at least one of the first and second images by reflecting the comparison result under the control of the controller. The method of claim 1,
And a wireless communication unit which transmits an image request signal including the obtained terminal location information and direction information, and receives a second image matching the input first image as a result of the transmission.
The control unit obtains in response to receiving the second image. The method of claim 1,
Further comprising a memory for storing a plurality of images,
The control unit searches for a second image matching the first image from a plurality of images stored in the memory. The method according to any one of claims 1 to 3,
The prescribed criterion may include at least one of a shooting season, a date and a time of the first and second images, a difference in image components of the first and second images, and a difference in image brightness of the first and second images. Including, mobile terminal. The method according to any one of claims 1 to 3,
When the second image is plural,
The control unit controls the display unit to display each of the plurality of second images according to the degree of similarity according to the comparison result. Receiving a first image from an outside of the terminal;
Obtaining location information of the terminal;
Obtaining direction information of the terminal;
Obtaining a plurality of second images matching the first image by using the acquired position information and direction information;
Comparing the first image and the second image according to a prescribed criterion; And
And displaying the second images by reflecting the first image and the comparison result.

Images