JP2002091753A - System and method for line of sight and cursor link display for map and photograph, and program recording medium therefor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To make easily searchable a target such as building or mountain by considering the line of sight as a cursor and displaying the cursor on both a map and a photograph. SOLUTION: The map display device capable of displaying a photographed picture corresponding to a photographing spot on an electronic map, is provided with map display and photograph display control parts 7c and 7d for displaying the line of sight as a cursor on both the map and the photograph, a map mouse input control part 7a and a photograph mouse input control part 7b for simultaneously changing the cursor of the line of sight on the both when it is detected a click is performed on the map or on the photograph, photograph managing and cursor information tables 4a and 4b for storing information to be referred to when displaying the cursor of the line of sight by managing the map and photograph display control parts 7c and 7d and the information of the line of sight at present.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a map display device capable of displaying a photograph taken in association with a photographing point of an electronic map. As you can see and where the buildings and mountains in the photo correspond to on the map,
Equipped with a table that can manage the current line of sight information, a function to display the line of sight as a cursor on both the map and the photo, and when clicking on the map or on the photo, both the map and the photo can be changed simultaneously. The present invention relates to an eye-gaze cursor interlocking display system and method, and a recording medium for recording the program.

[0002]

2. Description of the Related Art Heretofore, it has been widely practiced to display a photograph taken by a map display device in association with a photographing location of an electronic map. In this case, a symbol or a character is displayed at the photographing point on the map, so that the operator can know that there is a photograph. In addition, there is also a method in which when the operator clicks on the photographing point, the corresponding photograph is displayed on another screen, so that the operator can easily see the photograph. As a proposal of a correspondence relationship between a map and a photograph, for example, Japanese Patent Application Laid-Open No. 5-313567
In the "Electronic Guide System, Electronic Guideway System, and Vehicles such as Automobiles" (hereinafter referred to as "A system") described in Japanese Patent Publication No. It is an object of the present invention to enhance the guidance effect by displaying not only a map but also a landscape still image at an arbitrary point on the map.

[0003] In the "still camera capable of recording azimuth information and a reproducing method" (hereinafter referred to as "B method") described in Japanese Patent Application Laid-Open No. H11-69280, azimuth information is input simultaneously with photographing, and the azimuth information from an artificial satellite Receiving the position data, it is converted into longitude, latitude, and altitude by a calculation circuit, recorded on a memory card, and this position information and azimuth information are also reproduced at the time of image reproduction.
The "vehicle navigation device" (hereinafter referred to as "C system") described in Japanese Patent Application Laid-Open No. 4-62417 is not associated with a photograph, but is provided with a fan so that the visual field (azimuth) and distance of an object can be known. It describes how to display by type.

[0004]

As described above, many of the conventional methods display a photograph or the like taken at an arbitrary point on a map so that the scenery at that point can be seen. Conversely, you may want to find out where the landmarks, such as buildings and mountains, are located on the map. In that case, in both the A method and the B method, although there is azimuth information, since there is no shooting range (information on the angle of view), it is difficult to search for buildings and mountains as the distance from the center of the photograph increases. There is a problem that
The operator may feel inconvenient. In the C method, the problem of the field of view is solved, but there is no target such as a building or a mountain to be specified first because it is not associated with a photograph.

Therefore, an object of the present invention is to solve such a conventional problem and to easily display a target such as a building or a mountain by displaying a cursor on both a map and a photograph using a line of sight as a cursor. It is an object of the present invention to provide a system and method for displaying a searchable map and a photograph linked with a visual line cursor, and a medium recording the program.

[0006]

In order to achieve the above object, a display system for interlocking a line of sight with a map and a photograph according to the present invention provides a map display capable of displaying a photographed photograph in association with a photographing point of an electronic map. A device for displaying a line of sight as a cursor on both a map and a photograph, a unit for simultaneously changing the line of sight cursor when a click on the map or on a photograph is detected, and a current line of sight. And a table for storing information to be referred to when displaying a line-of-sight cursor. Further, the method of displaying a map and a photograph in conjunction with a line-of-sight cursor according to the present invention displays information on the angle at which the photograph appears at the photographing point on the electronic map in a fan shape,
When the operator clicks on an arbitrary position in the sector, a half-line cursor is displayed on the electronic map, the line of sight being a straight line connecting the clicked point and the center of a circle partially having the sector, On the displayed photo, a vertical cursor corresponding to the line of sight is displayed. Conversely, when the operator clicks an arbitrary position in the photo, a vertical cursor with the clicked position as the line of sight is displayed on the photo. A feature is that a half-line cursor corresponding to the line of sight is displayed on the map display. Further, the program recording medium according to the present invention converts the processing operation of the method of displaying a map and a photograph in conjunction with a line-of-sight cursor into a program, stores the program in the recording medium,
The recording medium is mounted on an arbitrary computer.

[0007]

Embodiments of the present invention will be described below in detail with reference to the drawings. FIG. 1 is a block diagram of a gaze cursor interlocking system showing one embodiment of the present invention. In FIG. 1, reference numeral 1 denotes a display device such as a CRT (Cathode Ray Tube) or the like; 2 a mouse as a pointing device (input device); 3 a CPU (Central Processing Unit) or a main memory for processing by a storage program method. 4 is an external storage device such as an HDD (Hard Disk Driver), 5 is a recording medium storing photo file and map information, and a map and photo input control program, and 6 is a recording medium 5 It is a driving device that reads data and programs from the computer.

The information processing device 3 reads the program and data of the recording medium 5 into the main memory and the external storage device 4 via the activation device 6, and thereby the map mouse input control unit 7a, the photograph mouse input control unit 7b and the map mouse input control unit 7b. Display control unit 7c
And a photo display controller 7d, and generates a photo management table 4a and a cursor information table 4b in the external storage device 4. In the control unit 7, when the user clicks the inside of the fan shape in the map displayed on the display device 1 with the mouse 2, a half of the clicked fan shape is formed by connecting the click point and the center of the circle. Displays a straight cursor. Further, the photo corresponding to the fan shape is displayed side by side with the map, and a vertical cursor corresponding to the line of sight is also displayed on the photo. When the user clicks the inside of the photo displayed on the display device 1 with the mouse 2, a vertical cursor is displayed so as to pass through the clicked point, and on the map, a fan shape on the map corresponding to the photo is displayed. , A half-line cursor indicating the direction of the click is displayed. As described above, the map mouse input control unit 7a, the photo mouse input control unit 7b, the map display control unit 7c, and the photo display control unit 7d of the control unit 7 are programs that operate in conjunction with each other, and When one of the is clicked by the user, the gaze cursor is displayed on the clicked map or photograph, and at the same time, the gaze cursor is displayed on the other photograph or map.

The operation of the eye-gaze cursor interlocking system for a map and a photograph having such a configuration will be described below with reference to FIGS. FIG. 2 is an explanatory diagram showing a configuration example of the photo management table 4a in FIG. 1, and FIG.
FIG. 4 is an explanatory diagram showing a configuration example of a cursor information table 4b in FIG. As shown in FIG. 2, the information of the photographs linked to the map is stored in the photograph management table 4a in an array format for the number of photographs. Information about one photo is stored for each row of the array. Id21 for identifying the photo,
A photograph file name 22 representing the storage location of the image data of the photograph, and viewpoint coordinates 2 representing the point on the map where the photograph was taken
3, a start angle 24 indicating the direction of the right end of the picture, an end angle 25 indicating the direction of the left end of the picture, a sector radius 26 referred to when displaying a sector on the map, and a picture width 27 indicating the lateral width of the picture. As described above, the photograph file is recorded on the recording medium 5, and the photograph file name 22 describes the address where the recording medium 5 is recorded. The azimuth represented by the start angle 24 and the end angle 25 means an angle that starts from the east and rotates horizontally in the north direction. For example, if the azimuth is east 0 °, north 90 °, west 180 °, south 27
0 °. Further, the fan-shaped radius 26 stores an appropriate size that can be easily clicked with a mouse on the map and does not cover the base map.

The cursor information table 4b in FIG. 3 stores information on the currently displayed cursor. Since one screen is normally displayed on the display device 1, only one piece of cursor information is stored in that case. The cursor information table 4b includes an id 31 representing an id value 21 of a row in which a photograph is displayed, a mouse coordinate 32 representing a click coordinate of a mouse on a map, a cursor direction 33 representing an orientation of a half-line cursor on a map, It consists of cursor relative coordinates 34 representing the position of the vertical cursor on the photograph.
In FIG. 3, the cursor direction of 45 ° indicates a direction between 0 ° in the east and 90 ° in the north, that is, a direction in the northeast. The cursor relative position 34 is represented by a% value from the right end of the photograph. For example, 0% when the cursor is at the right edge of the photo, 50% at the center, and 100% at the left edge. The control unit 7 in FIG. 1 refers to or updates the information stored in these tables (the photo management table 4a and the cursor information table 4b), and performs processing according to the present invention in accordance with the flows shown in FIGS. Perform the operation.

FIG. 4 is a flowchart of the processing operation of the map mouse input control unit in FIG. 1, that is, the operation flow when the mouse is clicked on the map. First, the click position is converted from screen coordinates to map coordinates and stored in the mouse coordinates 32 of the cursor information table 4b (step 40).
1). Next, the search process is repeatedly performed until a fan shape including the click point is found in the photo management table 4a (steps 402 and 403). Whether or not the click point is included in the fan shape may be determined as follows. That is, the distance between the viewpoint coordinates (center coordinates of the sector) 23 and the mouse coordinates (the coordinates of the clicked point) 32 is smaller than the sector radius 26, and the viewpoint coordinates 23 and the mouse coordinates 3
It is determined whether or not the azimuth formed by connecting 2 is between the start angle 24 and the end angle 25. If the mouse coordinates are included in the fan shape, the id21 of that row is stored in the id31 (step 404), the direction is determined from the viewpoint coordinates 23 and the mouse coordinates 32, and stored in the cursor direction 33 (step 40).
5) From the start angle 24, the end angle 25, and the cursor direction 33, what percentage of the photograph is left from the right end of the photograph is calculated and stored in the cursor relative position 34 (step 40).
6). Finally, the map display control unit 7c and the photo display control unit 7
Call d (step 407, step 408). Here, a newly set cursor is displayed.

FIG. 5 is a flowchart of the processing operation of the photo mouse input control unit in FIG. 1, that is, the operation flow when the mouse is clicked on the photo. First, it is checked whether a photograph is selected and displayed (step 50).
1). If the picture is displayed, the click position is converted from the screen coordinates to the relative coordinates of the picture, and the value of the conversion result is stored in the cursor relative position 34 (step 50).
2). Next, the cursor direction is calculated by proportional calculation from the start angle 24, the end angle 25, and the cursor relative position 34, and the value of the calculation result is stored in the cursor direction 33 (step 5).
03). The intersection of the half-line passing through the viewpoint coordinates 23 and having the inclination in the direction of the cursor and the arc of the sector is obtained and stored in the mouse coordinates 32 (step 504). Finally, the map display control unit 7c and the photo display control unit 7d are called (steps 505 and 506). Thereby, the cursor of the newly set line of sight is displayed.

FIG. 6 is a flowchart of the processing operation of the map display control unit in FIG. 1, that is, the operation flow of displaying a map on the display device 1. First, the base map is read from the recording medium 5 via the driving device 6 and displayed on the screen of the display device 1 (step 601). Note that the base map is a base map, which is also recorded on the recording medium 5. Next, the photo management table 4a is repeatedly searched for the number of cases,
A loop is performed to search whether or not a photo corresponding to the displayed map is stored in the table (step 602). If there is a corresponding photo, a sector corresponding to the photo is displayed on the displayed base map (step 603). When the loop is completed, a half-line cursor is displayed in the sector displayed on the base map (step 604). The half-line cursor can be displayed by connecting the viewpoint coordinates 23 and the mouse coordinates 32, that is, connecting the viewpoint and the click point.

FIG. 7 is a flowchart showing the processing operation of the photo display control unit in FIG. 1, that is, the operation of displaying a photo on the display device 1. First, it is determined whether or not the designated photograph has been selected (step 701). If a photo has been selected, a photo file is read from the recording medium 5 via the drive device 6 and displayed on the screen of the display device 1 (step 702). Next, a vertical cursor is displayed on the displayed photograph (step 703). Note that the vertical cursor can be displayed by displaying a vertical line at the cursor relative position 34 from the right side on the displayed screen.

FIG. 8 is a fan-shaped display diagram displayed by using the system for linking a map and a photograph with a visual line cursor according to the present invention. The sector on the map represents the location where the photo was taken.
The center of the circle represents the viewpoint of the photograph, and two sides extending from the center of the circle represent the visual field of the photograph. The extension of the two sides corresponds to the right and left edges of the photograph. Also, the dotted line extending from the center of the circle is
Represents the gaze cursor. When the user clicks inside the fan shape on the displayed base map, the map display control unit 7
c displays a half line formed by connecting the click point and the center of the circle as a line of sight cursor. In addition, the click result is also reflected in the photograph shown in FIG. 9 by activating the photograph display control unit 7d in conjunction therewith.

FIG. 9 is a display diagram of a photograph displayed using the system for linking a map and a photograph with a visual line cursor according to the present invention. The vertical dotted line on the photograph in FIG. 9 represents the cursor of the line of sight. When the user clicks inside the displayed photo, the photo display control unit 7d displays a vertical cursor on the photo so as to pass through the click point. In addition, when the map display control unit 7c is also activated in conjunction with this, the click result is reflected on the map shown in FIG. As described above, FIGS.
As described with reference to FIG. 9, in the system for linking the line of sight cursor in the map and the photograph according to the present embodiment, in the map and the photograph displayed on the display device 1, when the user clicks inside the sector on the map, the sector corresponds to the sector. Display the photo, and display a cursor with a line of sight corresponding to the clicked point on both the map and the photo. When the photograph is clicked, a cursor with a line of sight corresponding to the clicked point is displayed on both the map and the photograph.

The processing operations of the map mouse input control unit 7a, photographic mouse input control unit 7b, map display control unit 7c, and photographic display control unit 7d shown in FIG. 1, that is, the processing steps of the flow shown in FIGS. Each program is converted into a program, the converted program is stored in a recording medium such as a CD-ROM, and the recording medium is mounted on any computer provided with a pace map and a photo related thereto, and the program is installed. Alternatively, the present invention can be easily realized by downloading from another device via a network. The present invention is based on FIG.
9 is not limited to the example described with reference to FIG.
Various changes can be made without departing from the scope of the invention. For example, in this embodiment, a mouse is used as a pointing device, but a trackball or a cursor key of a keyboard may be used.

[0018]

As described above, according to the present invention,
Since the gaze cursor can be displayed in conjunction with both the map and the photo, you can see how the buildings and mountains on the map look like, and you can track the buildings and mountains in the photo on the map effective.

[Brief description of the drawings]

FIG. 1 is a block diagram of a display system linked to a visual line cursor of a map and a photograph showing an embodiment of the present invention.

FIG. 2 is a data configuration diagram of a photo management table in FIG. 1;

FIG. 3 is a data configuration diagram of a cursor information table in FIG. 1;

FIG. 4 is an operation flowchart of a map mouse input control unit according to an embodiment of the present invention.

FIG. 5 is an operation flowchart of a photo mouse input control unit according to the embodiment of the present invention.

FIG. 6 is an operation flowchart of a map display control unit according to an embodiment of the present invention.

FIG. 7 is an operation flowchart of a photograph display control unit according to the embodiment of the present invention.

FIG. 8 is a map display diagram showing one embodiment of the present invention.

FIG. 9 is a photograph display diagram showing one embodiment of the present invention.

[Explanation of symbols]

REFERENCE SIGNS LIST 1 display device 2 mouse 3 information processing device 4 external storage device 4 a photograph management table 4 b cursor information table 5 recording medium 6 driving device 7 control unit 7 a Map mouse input control unit, 7b: Photo mouse input control unit, 7c: Map display control unit, 7d: Photo display control unit, 21: Photo identifier, 22: Photo file name, 23 ...
View point coordinates, 24 start angle, 25 end angle, 26 sector radius, 27 photo width, 31 photo identifier, 32 mouse coordinates, 33 cursor direction, 34 relative cursor position.

Claims (3)

[Claims] 1. A map photograph display system for displaying photographed photographs in association with photographing points of an electronic map, comprising: display control means for displaying a line of sight as a cursor on both a map and a photograph; Alternatively, input and display control means for simultaneously changing the line-of-sight cursor when detecting that a click has been made on a photograph, and managing information of the current line-of-sight and accumulating information referred to when displaying the line-of-sight cursor. A display system linked to a line of sight cursor of a map and a photograph, characterized by providing a table for storing. 2. A display method for displaying a photographed photograph in association with a photographing point on an electronic map, the method comprising: displaying, at a photographing point on the electronic map, information on an angle at which the photograph appears in a fan shape; When the operator clicks an arbitrary position in the sector, a half-line cursor is displayed on the electronic map, the line of sight being a straight line connecting the clicked point and the center of a circle partially having the sector. Displaying a vertical cursor corresponding to the line of sight on the displayed photo; conversely, when the operator clicks on any location in the photo, a vertical cursor with the clicked position as the line of sight on the photo And displaying a half-line cursor corresponding to the line of sight on the map display. 3. A computer-readable recording medium, wherein the processing operation of the method of displaying a map and a photograph in conjunction with a visual line cursor according to claim 2 is converted into a program, and the program is recorded on a recording medium.