WO2009101679A1

WO2009101679A1 - Picture display device, picture display method and picture display program

Info

Publication number: WO2009101679A1
Application number: PCT/JP2008/052351
Authority: WO
Inventors: Kohei Ito; Ryujiro Fujita
Original assignee: Pioneer Corporation
Priority date: 2008-02-13
Filing date: 2008-02-13
Publication date: 2009-08-20

Abstract

A picture display device is provided with a photographing angle variable part which can change a photographing angle to an object, a picture information acquiring means acquiring picture information on the photographed object from a photographing means, a photographing angle information acquiring means acquiring photographing angle information from the photographing angle variable part and a position information acquiring means acquiring position information on a position where the object is photographed. A photographing place and a photographing direction are specified based on acquired information and an approximate position of the object is specified. A picture output means displaying a map on a picture display part and displaying picture information on a prescribed position of the object on the map is arranged. Thus, a simpler picture display method can be supplied to a user.

Description

Image display device, image display method, and image display program

The present invention relates to an image display method.

In an image display device, a method of arranging a photograph taken by a user on a map displayed on a screen is known. Recently, a method is also known in which a photograph taken by a camera device incorporating a GPS and a compass is displayed on a map by displaying a photographing position and a photographing direction. In the former method, the shooting position and shooting direction are not considered, and in the latter method, only the shooting position and shooting direction are displayed, and the photograph itself cannot be referred to without clicking the display. . In these methods, the distance from the shooting position to the subject is not considered.

Patent Document 1 discloses a position where a three-dimensional position of a photographed map object can be easily obtained based on the three-dimensional position and photographing direction of the stereo camera and the stereo image information of the map object photographed by the stereo camera. An acquisition device is described.

JP 2004-54580 A

Examples of problems to be solved by the present invention include the above. An object of the present invention is to provide an image display method that is easier for the user to understand by arranging and displaying a photograph at a subject position on a map in consideration of a photographing position, a photographing direction, and a distance to the subject. To do.

The invention according to claim 1 is an image display device, a photographing angle variable unit capable of changing a photographing angle to a subject, an image information obtaining unit that obtains image information of the photographed subject from a photographing unit, Shooting angle information acquisition means for acquiring shooting angle information from the shooting angle variable unit, position information acquisition means for acquiring position information relating to the position where the subject was shot, and shooting for shooting the subject based on the position information A shooting point specifying unit for specifying a point; a shooting direction specifying unit for specifying a shooting direction based on the shooting angle information; a shooting point specified by the shooting point specifying unit; and a shooting point specified by the shooting direction specifying unit. Subject position specifying means for specifying the approximate position of the subject based on the direction, the shooting point specified by the shooting point specifying means, and the shooting direction specifying means Information storage means for storing the shooting direction and the approximate position of the subject specified by the subject position specifying means in association with the image information, a map output means for displaying a map on an image display unit, and the map output means Comprises image output means for displaying the image information at the approximate position of the subject specified by the subject position specifying means on the map displayed on the image display section.

The invention according to claim 9 is an image display method, an image information obtaining step for obtaining image information of the photographed subject from a photographing means, a photographing angle information obtaining step for obtaining photographing angle information, and the subject. A position information acquisition step for acquiring position information relating to the position where the object was shot, a shooting point specifying step for specifying a shooting point for shooting the subject based on the position information, and a shooting direction based on the shooting angle information. A shooting direction specifying step for specifying, a shooting position specified by the shooting point specifying step, a shooting position specified by the shooting direction specifying step, a subject position specifying step for specifying an approximate position of the subject, and the shooting The shooting point specified by the point specifying step, the shooting direction specified by the shooting direction specifying step, and the approximate position of the subject specified by the subject position specifying step, An information storage step for storing the image information in association with the image, a map output step for displaying a map on the image display unit, and a subject position specifying step on the map displayed by the map output step on the image display unit And an image output step of displaying the image information at an approximate position of the subject.

According to a tenth aspect of the present invention, there is provided an image display program executed in a terminal device including a computer, the image information acquiring unit acquiring image information of the photographed subject from the photographing unit, and photographing from the photographing angle variable unit. Shooting angle information acquisition means for acquiring angle information, position information acquisition means for acquiring position information relating to the position where the subject was shot, shooting point specifying means for specifying a shooting point where the subject was shot based on the position information, Based on the shooting angle information, the shooting direction specifying means for specifying the shooting direction, the shooting point specified by the shooting point specifying means, and the approximate position of the subject based on the shooting direction specified by the shooting direction specifying means. The subject position specifying means to be specified, the shooting spot specified by the shooting spot specifying means, and the shooting specified by the shooting direction specifying means Information storage means for storing the direction and the approximate position of the subject specified by the subject position specifying means in association with the image information, a map output means for displaying a map on an image display section, and the map output means The computer is caused to function as image output means for displaying the image information at an approximate position of a subject specified by the subject position specifying means on a map displayed on a display unit.

It is a block diagram which shows the structure of the navigation apparatus of an Example. It is a block diagram which shows the structure of the image acquisition apparatus of an Example. It is a block diagram which shows the function structure of the image display apparatus of an Example. The example of the display screen of an Example is shown. The example of the imaging | photography information of an Example is shown. It is a flowchart of the image display process of an Example. It is a flowchart of the image processing of an Example.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Autonomous positioning apparatus 20 System controller 40 Display unit 80 Image acquisition apparatus 101 Shooting angle variable part 102 Information acquisition part 103 Point specification part 104 Distance calculation part 105 Direction specification part 106 Position specification part 107 Information storage part 108 Judgment part 109 Output part 110 Image display

In a preferred embodiment of the present invention, the image display device includes a photographing angle variable unit capable of changing a photographing angle to the subject, an image information obtaining unit that obtains image information of the photographed subject from the photographing unit, and the photographing Shooting angle information acquisition means for acquiring shooting angle information from the angle variable unit, position information acquisition means for acquiring position information regarding the position where the subject is shot, and a shooting point where the subject is shot based on the position information. An imaging point specifying unit for specifying, an imaging direction specifying unit for specifying an imaging direction based on the imaging angle information, an imaging point specified by the imaging point specifying unit, and an imaging direction specified by the imaging direction specifying unit, Based on the subject position specifying means for specifying the approximate position of the subject, the shooting point specified by the shooting point specifying means, and the shooting direction specifying means specified Information storage means for storing the shadow direction and the approximate position of the subject specified by the subject position specifying means in association with the image information, map output means for displaying a map on an image display unit, and the map output means Comprises image output means for displaying the image information at the approximate position of the subject specified by the subject position specifying means on the map displayed on the image display section.

The above image display device specifies the approximate position of the subject by specifying the shooting point and the shooting direction. The approximate position of the subject is an approximate position of the subject specified based on information acquired at the time of shooting, and is not a point but a concept having a certain extent. Then, the photograph taken at the approximate position of the subject on the map is displayed. Therefore, it is possible to provide an image display method that is easier for the user to understand.

In one aspect of the above image display device, the image display device further includes a subject distance calculation unit that calculates a distance from the shooting point specified by the shooting point specifying unit to the subject based on the image information, and the subject position specifying unit includes: Based on the shooting point specified by the shooting point specifying unit, the shooting direction specified by the shooting direction specifying unit, and the distance to the subject calculated by the subject distance calculating unit, the approximate position of the subject is specified, and the information The storage means stores the approximate position of the subject specified by the subject position specifying means in further association with the image information. In this way, by considering not only the shooting direction and shooting point but also the distance to the subject, a more accurate approximate position of the subject can be specified. In one aspect of the above image display device, the image display device further includes traveling direction information acquisition means for acquiring traveling direction information, and the photographing direction specifying means specifies the photographing direction based on the photographing angle information and the traveling direction information. In this way, by adding not only the shooting angle information but also the traveling direction information, a more accurate shooting direction can be specified. Such an aspect is suitable when the image display device is mounted on a vehicle or the like.

In another aspect of the image display device, the information storage unit further stores the traveling direction information in association with the image information, and the image output unit stores the image in accordance with the traveling direction information. The image information to be displayed on the display unit is switched and displayed. For example, when the image display device is mounted in front of a vehicle and a camera is installed, when traveling on the road, the photograph taken at the same photographing point and the viewable scenery are different when traveling on the road. In view of this, it is possible to provide an image display method that is easier for the user to understand by switching the image information to be displayed on the image display unit on the way to and from the way back.

In another aspect of the above image display device, the image output means changes the size of the image information in accordance with the distance from the shooting point to the subject and displays the image information on the image display unit. Thereby, a sense of perspective can be obtained visually, and an image display method that is easier for the user to understand can be provided.

In another aspect of the image display device, route output means for displaying a guide route and a travel history on the map displayed on the image display unit by the map output means, and display of the image information is the route. And a first determination unit that determines whether or not the guidance route displayed on the output unit and the display of the travel history overlap, and the image output unit includes the first determination unit configured to display the guidance route and the travel history. When it is determined that the image is superimposed on the display, the image information is not displayed on the image display unit. Thus, it is possible to provide an image display method that is easier for the user to view without hindering the display of the guide route and the travel history.

Another aspect of the above image display device further includes second determination means for determining whether or not the display of the image information overlaps the display of the other image information, and the image output means includes the first 2 When the determination unit determines that the display of the image information overlaps, the image information having a shorter distance from the shooting point to the subject is preferentially displayed on the image display unit. Thereby, the display of image information is not complicated, and an image display method that is easier to see for the user can be provided.

In another aspect of the above image display device, the image display device further includes third determining means for determining whether or not the subject of the image information is a road, and the image output means is configured such that the third determining means is that the subject is a road. If determined, the image information is not displayed on the image display unit. There is a high possibility that the photograph showing only the road is not necessary for the user. Therefore, when it is determined that the subject is a road, unnecessary images can be reduced by not displaying the image information.

In another preferred embodiment of the present invention, the image display method includes an image information acquisition step of acquiring image information of the photographed subject from a photographing unit, a photographing angle information acquisition step of obtaining photographing angle information, and the subject. A position information acquisition step for acquiring position information relating to the position where the object was shot, a shooting point specifying step for specifying a shooting point for shooting the subject based on the position information, and a shooting direction based on the shooting angle information. A shooting direction specifying step for specifying, a shooting position specified by the shooting point specifying step, a shooting position specified by the shooting direction specifying step, a subject position specifying step for specifying an approximate position of the subject, and the shooting The shooting point specified by the point specifying step, the shooting direction specified by the shooting direction specifying step, and the approximate position of the subject specified by the subject position specifying step are An information storing step for storing in association with image information, a map output step for displaying a map on an image display unit, and the subject position specifying step on the map displayed on the image display unit by the map output step are specified An image output step of displaying the image information at an approximate position of the subject. This method can also provide a user-friendly image display method.

In another preferred embodiment of the present invention, an image display program executed in a terminal device including a computer is an image information acquisition unit that acquires image information of the photographed subject from a photographing unit, and is photographed from the photographing angle variable unit. Shooting angle information acquisition means for acquiring angle information, position information acquisition means for acquiring position information relating to the position where the subject was shot, shooting point specifying means for specifying a shooting point where the subject was shot based on the position information, Based on the shooting angle information, the shooting direction specifying means for specifying the shooting direction, the shooting point specified by the shooting point specifying means, and the approximate position of the subject based on the shooting direction specified by the shooting direction specifying means. The subject position specifying means to be specified, the shooting spot specified by the shooting spot specifying means, and the shooting specified by the shooting direction specifying means Information storage means for storing the direction and the approximate position of the subject specified by the subject position specifying means in association with the image information, a map output means for displaying a map on an image display section, and the map output means The computer is caused to function as image output means for displaying the image information at an approximate position of the subject specified by the subject position specifying means on the map displayed on the display unit. The above image display apparatus can be realized by executing this program by a computer.

Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. The following description shows an example in which the present invention is applied to a navigation device mounted on a vehicle.

[Configuration of navigation device]
FIG. 1 shows a configuration of a navigation apparatus 1 according to an embodiment of the present invention. As shown in FIG. 1, the navigation device 1 includes a self-supporting positioning device 10, a GPS receiver 18, a system controller 20, a disk drive 31, a data storage unit 36, a communication interface 37, a communication device 38, a display unit 40, an audio output. A unit 50, an input device 60, and an image acquisition device 80 are provided.

The self-supporting positioning device 10 includes an acceleration sensor 11, an angular velocity sensor 12, and a distance sensor 13. The acceleration sensor 11 is made of, for example, a piezoelectric element, detects vehicle acceleration, and outputs acceleration data. The angular velocity sensor 12 is composed of, for example, a vibrating gyroscope, detects the angular velocity of the vehicle when the direction of the vehicle is changed, and outputs angular velocity data and relative azimuth data. The distance sensor 13 measures a vehicle speed pulse composed of a pulse signal generated with the rotation of the vehicle wheel.

The GPS receiver 18 receives radio waves 19 carrying downlink data including positioning data from a plurality of GPS satellites. The positioning data is used to detect the absolute position of the vehicle from latitude and longitude information.

The system controller 20 includes an interface 21, a CPU 22, a ROM 23, and a RAM 24, and controls the navigation device 1 as a whole.

The interface 21 performs an interface operation with the acceleration sensor 11, the angular velocity sensor 12, the distance sensor 13, and the GPS receiver 18. From these, vehicle speed pulses, acceleration data, relative azimuth data, angular velocity data, GPS positioning data, absolute azimuth data, and the like are input to the system controller 20. The CPU 22 controls the entire system controller 20. The ROM 23 includes a nonvolatile memory (not shown) in which a control program for controlling the system controller 20 is stored. The RAM 24 stores various data such as route data preset by the user via the input device 60 so as to be readable, and provides a working area to the CPU 22.

A system controller 20, a disk drive 31 such as a CD-ROM drive or a DVD-ROM drive, a data storage unit 36, a communication interface 37, a display unit 40, an audio output unit 50 and an input device 60 are mutually connected via a bus line 30. It is connected to the.

The disk drive 31 reads and outputs content data such as music data and video data from a disk 33 such as a CD or DVD under the control of the system controller 20. The disk drive 31 may be either a CD-ROM drive or a DVD-ROM drive, or may be a CD and DVD compatible drive.

The data storage unit 36 includes, for example, an HDD and stores various data used for image display processing such as map data and image data.

The communication device 38 includes, for example, an FM tuner, a beacon receiver, a mobile phone, a dedicated communication card, and the like, and traffic congestion and traffic information distributed from a VICS (Vehicle Information Communication System) center via the communication interface 37, etc. Receive road traffic information and other information.

The display unit 40 displays various display data on a display device such as a display under the control of the system controller 20. Specifically, the system controller 20 reads map data and image data from the data storage unit 36. The display unit 40 displays the map data and image data read from the data storage unit 36 by the system controller 20 on a display screen such as a display. The display unit 40 includes a graphic controller 41 that controls the entire display unit 40 based on control data sent from the CPU 22 via the bus line 30 and a memory such as a VRAM (Video RAM), and can display image information that can be displayed immediately. A buffer memory 42 that temporarily stores, a display control unit 43 that controls display of a display 44 such as a liquid crystal or a CRT (Cathode Ray Tube) based on image data output from the graphic controller 41, and a display 44 are provided. . The display 44 is composed of, for example, a liquid crystal display device having a diagonal of about 5 to 10 inches, and is mounted near the front panel in the vehicle.

The audio output unit 50 includes a D / A converter 51 that performs D / A conversion of audio digital data sent via the bus line 30 from the disk drive 31 or the RAM 24 under the control of the system controller 20, and a D / A An amplifier (AMP) 52 that amplifies the audio analog signal output from the converter 51 and a speaker 53 that converts the amplified audio analog signal into audio and outputs the audio to the vehicle are configured.

The input device 60 includes keys, switches, buttons, a remote controller, a voice input device, and the like for inputting various commands and data. The input device 60 is arranged around the front panel and the display 44 of the main body of the in-vehicle electronic system mounted in the vehicle. When the display 44 is a touch panel system, the touch panel provided on the display screen of the display 44 also functions as the input device 60.

The image acquisition device 80 has a free pan head and can be equipped with a photographing device such as a camera. FIG. 2 shows a schematic configuration of the image acquisition device 80. The image acquisition device 80 includes a free pan head 82 and a controller 83, and a camera 81 is installed on the free pan head 82. The free pan head 82 is movable, and the shooting angle of the camera 81 can be freely changed. The controller 83 controls the free pan head 82 and the camera 81. For example, the controller 83 can change the shooting angle by moving the free pan 82 and can operate the camera 81 to release the shutter. The camera 81, the free pan head 82, and the controller 83 are connected, and the controller 83 acquires image information taken from the camera 81.

Note that the CPU 22 and the like in FIG. 1 correspond to the image display device in the present invention. Specifically, the CPU 22 and the like correspond to shooting point specifying means, subject distance calculating means, shooting direction specifying means, subject position specifying means, map output means, and image output means.

FIG. 3 shows a functional configuration of the image display apparatus 100 of the present embodiment. These functions are realized by the components shown in FIG.

The image display apparatus 100 includes a shooting angle variable unit 101, an information acquisition unit 102, a point specifying unit 103, a distance calculating unit 104, a direction specifying unit 105, a position specifying unit 106, an information storage unit 107, and a determination. Unit 108 and an output unit 109.

The photographing angle variable unit 101 includes a free pan head 82 and a controller 83 of the image acquisition device 80. The camera 81 is installed on the free pan head 82, and the free pan head 82 is moved to freely change the photographing angle. be able to.

The information acquisition unit 102 acquires image information from the camera 81 installed in the shooting angle variable unit 101, acquires shooting angle information from the shooting angle variable unit 101, and acquires position information from the GPS receiver 18. In addition, the information acquisition unit 102 acquires traveling direction information from the autonomous positioning device 10. That is, the information acquisition unit 102 functions as an image information acquisition unit, a shooting angle information acquisition unit, a position information acquisition unit, and a traveling direction information acquisition unit in the present invention.

The point specifying unit 103 specifies a shooting point based on the position information acquired by the information acquiring unit 102.

The distance calculation unit 104 calculates the distance from the shooting point specified by the point specifying unit 103 to the subject based on the image information acquired by the information acquisition unit 102. Specifically, the distance from the shooting point to the subject is calculated from the moving speed of the subject, the focal length of the camera 81, and the like.

The direction specifying unit 105 specifies the shooting direction based on the shooting angle information and the traveling direction information acquired by the information acquisition unit 102.

The position specifying unit 106 determines the outline of the subject based on the shooting point specified by the point specifying unit 103, the distance from the shooting point calculated by the distance calculating unit 104 to the subject, and the shooting direction specified by the direction specifying unit 105. Identify the location. Specifically, the latitude and longitude are calculated based on the shooting point, the distance from the shooting point to the subject, and the shooting direction, and the position on the map is specified.

The information storage unit 107 includes the shooting point specified by the point specifying unit, the distance to the subject calculated by the subject distance calculating unit, the shooting direction specified by the direction specifying unit, and the approximate position of the subject specified by the position specifying unit. The traveling direction information acquired by the information acquisition unit 102 is stored in association with the image information.

The determination unit 108 determines whether or not the display of the image information overlaps the display of the guidance route and the travel history displayed by the output unit 109. Further, the determination unit 108 determines whether or not the display of the image information overlaps with the display of other image information. Further, the determination unit 108 determines whether or not the subject of the image information is a road. That is, the determination unit 108 functions as a first determination unit, a second determination unit, and a third determination unit in the present invention.

The image display device 100 can be connected to an image display unit configured by a display or the like, and the output unit 109 displays a map on the image display unit. Further, the output unit 109 displays image information at the approximate position of the subject specified by the position specifying unit 106 on the map displayed on the image display unit. Further, the output unit 109 displays the guide route and the travel history on the map displayed on the image display unit. That is, the output unit 109 functions as a map output unit, an image output unit, and a route output unit in the present invention. The output unit 109 performs the following five processes.

(Process 1) The image information to be displayed on the image display unit is switched according to the traveling direction information, and is displayed on the image display unit.

(Process 2) The size of the image information is changed according to the distance from the shooting point to the subject and displayed on the image display unit.

(Process 3) If the determination unit 108 determines that the display of the image information overlaps the display of the guide route and the travel history displayed by the route output means, the image information is not displayed on the image display unit.

(Processing 4) When the determination unit 108 determines that the display of the image information overlaps the display of other image information, the image information with the shorter distance from the shooting point to the subject is preferentially displayed on the image display unit. .

(Process 5) When the determination unit 108 determines that the subject of the image information is a road, the image information is not displayed on the image display unit.

Specifically, in the processing 1, the output unit 109 refers to the traveling direction information associated with the image information, and displays only the image information that matches the current traveling direction information. For example, when the camera 81 is installed in front of the vehicle and the vehicle travels on the road, the image information displayed on the image display unit on the going and the returning is different because the photograph taken and the view taken at the same shooting point are different. By switching, the confusion caused by the difference in how it appears and how it looks is eliminated.

Specifically, the processing 2 refers to the distance to the subject associated with the image information by the output unit 109, and displays the size of the image information in order to display a larger one closer to the shooting point and a smaller one farther away. change. By processing 2, the perspective of the subject can be visually recognized, and the display screen is easier to understand for the user.

Processing 3 is specifically determined by the determination unit 108 based on the approximate position of the subject associated with the image information. By the process 3, the display of image information does not prevent the display of the guidance route and the travel history, and does not prevent the user from driving the vehicle.

In the process 4, specifically, the output unit 109 compares the distance to the subject associated with the image information, and preferentially displays the image information with a small numerical value of the distance to the subject. By displaying the closer one in front, the contradiction of perspective is resolved, and the complexity of overlapping display of image information is eliminated.

In the process 5, specifically, the determination unit 108 recognizes the center line of the road in the image information and determines whether the road is a road. Photographs showing only roads are determined as unnecessary photographs and are not displayed, thereby reducing unnecessary images and making other images easier to see.

FIG. 4 is an example of the display screen of the image display unit. As described above, the photograph is displayed at the approximate position of the subject specified by the position specifying unit 106 on the map displayed on the screen. The arrow A1 represents the distance from the shooting point to the subject and the shooting direction, and the arrow A2 represents the traveling direction of the vehicle. A broken line 90 in the screen represents a travel history. The display screen of the image display unit is not limited to the example of FIG. 4 and can be set arbitrarily.

Next, the photographing information 200 will be described in detail with reference to FIG. In this embodiment, the shooting information 200 includes an image ID 201, image information 202, a shooting point 203, a distance 204 to the subject, a shooting direction 205, an approximate position 206 of the subject, and traveling direction information 207.

The image ID 201 is assigned when stored in the information storage unit 107 as the shooting information 200. The image information 202 is information on a photograph taken by the camera 81. Specifically, it is image data such as scenery from a car window. The shooting point 203 is the position of the shooting point specified by the point specifying unit 103 based on the position information. Specifically, the shooting point 203 is represented by latitude and longitude.

The distance 204 to the subject is the distance from the shooting point to the subject calculated by the distance calculation unit 104 based on the image information. The shooting direction 205 is a shooting direction specified by the direction specifying unit 105 based on the shooting angle information and the traveling direction information. The approximate position 206 of the subject is the approximate position of the subject specified by the position specifying unit 106 based on the distance from the shooting point to the subject and the shooting direction. Specifically, the approximate position 206 of the subject is represented by latitude and longitude. The traveling direction information 207 is traveling direction information acquired by the information acquisition unit 102 and represents the traveling direction of the vehicle on which the image display device 100 is mounted.

Here, the image display processing according to the present embodiment will be described with reference to FIG. The following processing is realized by the CPU 22 executing a program prepared in advance. FIG. 6 is a flowchart of the image display process.

The information acquisition unit 102 acquires image information captured by the camera 81 (step S1). The information acquisition unit 102 acquires shooting angle information from the shooting angle variable unit 101 (step S2). The information acquisition unit 102 acquires position information (step S3). The information acquisition unit 102 acquires traveling direction information (step S4).

Next, the point specifying unit 103 specifies a shooting point based on the acquired position information (step S5). The distance calculation unit 104 calculates the distance from the shooting point to the subject based on the acquired image information (step S6). The direction specifying unit 105 specifies the shooting direction based on the acquired shooting angle information and traveling direction information (step S7). The position specifying unit 106 specifies the approximate position of the subject based on the shooting point specified by the point specifying unit 103, the distance to the subject calculated by the distance calculating unit 104, and the shooting direction specified by the direction specifying unit 105. (Step S8). The information storage unit 107 stores the shooting point, the distance to the subject, the shooting direction, the approximate position of the subject, and the traveling direction information as the shooting information in association with the image information (step S9). Then, the output unit 109 displays a map on the image display unit (step S10). Further, the output unit 109 displays other image information existing on the displayed map (step S11).

Next, the image display device 100 executes image processing (step S12). If it is displayed as a result of the image processing (step S12; display), the image information is displayed at the approximate position of the subject specified by the position specifying unit 106 on the map displayed by the output unit 109 on the image display unit ( Step S13), the image display process is terminated. If the result of the image processing is non-display (step S12; non-display), the image display processing is terminated.

Next, image processing according to this embodiment will be described with reference to FIG. FIG. 7 is a flowchart of image processing.

The output unit 109 switches other image information to be displayed in accordance with the traveling direction information (step S21). Step S21 corresponds to process 1 described above. The output unit 109 changes the size of the image information in accordance with the distance from the shooting point to the subject (step S22). Step S22 corresponds to the above process 2. When the image information is displayed, the determination unit 108 determines whether or not it overlaps the already displayed guide route and travel history (step S23). If it is determined that they overlap (step S23; Yes), the image information is not displayed. When step S23 is Yes, it corresponds to the above process 3.

When it is determined that the image information is displayed and does not overlap the already displayed guide route and travel history (step S23; No), the determination unit 108 has already displayed the image information. It is determined whether or not it overlaps with the display of other image information (step S24). When it is determined that they overlap (step S24; Yes), the distance 204 to the subject of the shooting information 200 between the overlapping image information is compared, and the one closer to the subject is prioritized (step S25), and the process of step S26 is performed. Execute. Step S25 corresponds to the process 4 described above. When it is determined that they do not overlap (step S24; No), the determination unit 108 determines whether or not the subject is a road (step S26). When it is determined that the road is a road (step S26; Yes), the image information is not displayed. When step S26 is Yes, it corresponds to the above process 5. When it is determined that the road is not a road (step S26; No), the image information is displayed. Thus, the image processing is finished.

As described above, according to the image display apparatus of the present embodiment, a photograph can be arranged and displayed at the position of the subject on the map in consideration of the photographing position, the photographing direction, and the distance to the subject. This makes it possible to provide a more easily understandable image display method. Furthermore, by displaying an image at an appropriate place, it is possible to compare the actual scenery with the photograph on the display screen and use it for vehicle driving, such as referring to the route for searching. In addition, since the compass required in the conventional technique is not necessary, the structure of the image display apparatus can be simplified.

[Modification]
In the image display processing in the above-described embodiment, the approximate position of the subject is specified based on the photographing point, the photographing direction, and the distance to the subject. However, the present invention is not limited to this, and the photographing point and the photographing direction are determined. Based on this, the approximate position of the subject may be specified.

In the image display processing in the above-described embodiment, the shooting direction is specified based on the shooting angle information and the traveling direction information, but the present invention is not limited to this, and the shooting direction is specified based only on the shooting angle information. May be.

In the image processing in the above-described embodiment, a process of switching other image information to be displayed in accordance with the traveling direction information, a process of changing the size of the image information in accordance with the distance to the subject, and the display of the image information are guided routes. And when it overlaps with the display of the driving history, when it overlaps with the display of other image information, when it overlaps with the display of the image information that is closer to the subject, it is displayed preferentially, and when the subject is a road However, the application of the present invention is not limited to this form. That is, image processing may be performed by arbitrarily combining one to five of these processes.

Furthermore, image display processing that does not include image processing is also possible.

In the above-described embodiment, the output unit 109 switches other image information to be displayed in accordance with the traveling direction information. However, the image information that is considered to be invisible in the current traveling direction is indicated by hatching. You may indicate that it is not visible by displaying it.

Further, in the above-described embodiment, it is assumed that an image acquisition device is mounted in front of the vehicle and a camera is installed. However, a rear-facing image information obtained by installing a camera behind and taking a picture is reversed. It may be stored in association with the traveling direction information. According to this, it is possible to display and refer to the image information captured by the rear camera on the way home.

In the above-described embodiment, the present invention is applied to a navigation apparatus mounted on a vehicle, but the present invention is not limited to this. You may apply to PND (Personal Navigation Device) and a mobile telephone.

The present invention can be used for a terminal device such as a PND (Personal Navigation Device) or a mobile phone in addition to a navigation device mounted on a vehicle.

Claims

A shooting angle variable unit capable of changing the shooting angle to the subject;
Image information acquisition means for acquiring image information of the photographed subject from the imaging means;
Shooting angle information acquisition means for acquiring shooting angle information from the shooting angle variable unit;
Position information acquisition means for acquiring position information relating to a position where the subject is photographed;
Based on the position information, shooting point specifying means for specifying a shooting point where the subject is shot;
A shooting direction specifying means for specifying a shooting direction based on the shooting angle information;
Subject position specifying means for specifying the approximate position of the subject based on the shooting point specified by the shooting point specifying means and the shooting direction specified by the shooting direction specifying means;
Information that stores the shooting point specified by the shooting point specifying unit, the shooting direction specified by the shooting direction specifying unit, and the approximate position of the subject specified by the subject position specifying unit in association with the image information. Storage means;
Map output means for displaying a map on the image display unit;
An image output means for displaying the image information at an approximate position of the subject specified by the subject position specifying means on the map displayed by the map output means on the image display unit. apparatus.
Subject distance calculating means for calculating the distance from the shooting point specified by the shooting point specifying means to the subject based on the image information;
The subject position specifying means determines the approximate position of the subject based on the shooting point specified by the shooting point specifying means, the shooting direction specified by the shooting direction specifying means, and the subject distance calculated by the subject distance calculating means. Identify,
The image display apparatus according to claim 1, wherein the information storage unit further stores the approximate position of the subject specified by the subject position specifying unit in association with the image information.
It further comprises traveling direction information acquisition means for acquiring traveling direction information,
The image display device according to claim 1, wherein the shooting direction specifying unit specifies a shooting direction based on the shooting angle information and the traveling direction information.
The information storage means further stores the traveling direction information in association with the image information,
The image display device according to claim 3, wherein the image output unit switches and displays image information to be displayed on the image display unit according to the traveling direction information.
The said image output means changes the size of the said image information according to the distance from an imaging | photography point to a to-be-photographed object, and makes it display on the said image display part. Image display device.
Route output means for displaying a guide route and a travel history on the map displayed by the map output means on the image display unit;
First determination means for determining whether or not the display of the image information overlaps the display of the guide route and the travel history displayed by the route output means;
6. The image output unit according to claim 1, wherein the image information is not displayed on the image display unit when the first determination unit determines that it overlaps the display of the guide route and the travel history. The image display apparatus as described in any one.
A second determination means for determining whether the display of the image information overlaps with the display of the other image information;
When the second determination unit determines that the display of the image information overlaps, the image output unit causes the image display unit to preferentially display the image information having a shorter distance from the shooting point to the subject. The image display device according to claim 1, wherein:
And further comprising third determination means for determining whether or not the subject of the image information is a road,
The said image output means does not display the said image information on the said image display part, when the said 3rd determination means determines that a to-be-photographed object is a road, The image display part is characterized by the above-mentioned. Image display device.
An image information acquisition step of acquiring image information of the photographed subject from the imaging means;
A shooting angle information acquisition step for acquiring shooting angle information;
A position information acquisition step of acquiring position information related to a position where the subject is photographed;
Based on the position information, a shooting point specifying step for specifying a shooting point where the subject is shot;
A shooting direction specifying step of specifying a shooting direction based on the shooting angle information;
A subject position specifying step for specifying an approximate position of the subject based on the shooting point specified by the shooting point specifying step and the shooting direction specified by the shooting direction specifying step;
Information that stores the shooting point specified by the shooting point specifying step, the shooting direction specified by the shooting direction specifying step, and the approximate position of the subject specified by the subject position specifying step in association with the image information. Memory process;
A map output step for displaying a map on the image display unit;
An image output step of displaying the image information at an approximate position of the subject specified by the subject position specifying step on the map displayed by the map output step on the image display unit. Method.
A program executed in a terminal device including a shooting angle variable unit capable of changing a shooting angle to a subject and a computer,
Image information acquisition means for acquiring image information of the photographed subject from the imaging means;
Shooting angle information acquisition means for acquiring shooting angle information from the shooting angle variable unit,
Position information acquisition means for acquiring position information relating to a position where the subject is photographed;
A shooting point specifying means for specifying a shooting point at which the subject is shot based on the position information;
A shooting direction specifying means for specifying a shooting direction based on the shooting angle information;
Subject position specifying means for specifying the approximate position of the subject based on the shooting point specified by the shooting point specifying means and the shooting direction specified by the shooting direction specifying means;
Information that stores the shooting point specified by the shooting point specifying unit, the shooting direction specified by the shooting direction specifying unit, and the approximate position of the subject specified by the subject position specifying unit in association with the image information. Storage means,
Map output means for displaying a map on the image display unit;
The computer is caused to function as image output means for displaying the image information at an approximate position of a subject specified by the subject position specifying means on a map displayed by the map output means on the image display unit. Image display program.
A storage medium storing the image display program according to claim 10.