JPH1186027A - Image display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To make surely obtainable information on an object in an image displayed on a monitor, by coding facility information related with coordinates in a virtual or real space and allowing a user to select the code. SOLUTION: A means for calculating a distance by focusing a camera 2 on a position on the screen of a monitor 1 corresponding to position specification (clicking) is incorporated in the camera 2. Then, an actual image in a specific direction from a current position is picked up to display the real space image on the monitor 1 and the position of the object is determined according to the direction and distance from the coordinates of the current position to the object. In relation with the position of the object, more than one classification code is displayed hierarchically on the monitor 1 and higher, equal, and lower hierarchys are selectively displayed if necessary until a desired classification code among classification codes is obtained. Then, desired information regarding facilities is obtained from a mobile type storage device by specifying the classification code regarding specific facilities among the displayed classification codes and displayed on the monitor 1.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image display method, and more particularly to a method for obtaining desired specific information about a desired point by using a real image or a virtual image of the point. The application of the present invention is not limited to car navigation, but can be utilized for travel, shopping, walking around town, exploring nature, academic research, business, and the like.

[0002]

2. Description of the Related Art At present, a car navigation system for detecting a current position of an automobile and displaying map information centered on the current position has been put to practical use. For example, in Japanese Patent Application Laid-Open No. 1-263688 proposed by the present inventor, various perspective views are stored in accordance with current position information obtained from a current position detector using a space satellite or the like by storing fine data and coarse data in a ROM. According to one of the above, the vicinity of the current position is magnified and displayed finely, and the distant place is displayed small. This method has been partially put into practical use. A similar method is described in Japanese Patent Application Laid-Open No. Hei 8-263688, in which a data storage unit storing one or more types of virtual image information related to each geographical point and a storage unit storing virtual information received by communication means are provided. Prepared, the current position is detected by the position detecting means, one or more types of virtual information corresponding to the current position are read and displayed from the data storage unit and the storage unit, and various information near the current position, for example, merchandise information of a store can be displayed. . At this time, a real image can be taken by the image pickup means, and the real image can be displayed at the same time and compared with the virtual image.

[0003]

In the above-described image display method, a typical building or facility may be displayed as text information or image information at various places on a screen showing map information displayed on a monitor. It is only a part of the fixed image,
The information that can be displayed in detail is only a portion related to the coordinates of the current location. Moreover, it is not possible to arbitrarily and systematically select this detailed information only for the type of information, for example, for entertainment or merchandise, and only the prestored information is displayed unilaterally.

Accordingly, it is desirable to provide a navigation or portable image display method and a voice guidance method that allow a user to freely extract detailed information about an arbitrary point on a virtual map image in accordance with a desired degree of definition. It is. Furthermore, when it is difficult to grasp the relationship between the target position and the current position on the virtual map image, the actual scene can be photographed in a predetermined direction from the current position, and any information at any position on the display screen can be selected and obtained. It is desired to do so. In addition, there is a case where it is desired to grasp not only information on a desired destination position but also facilities or the like having desired information in a target area. further,
When information about a specific facility is obtained, it is convenient to be able to display an image of the facility at the same time.However, it is usually possible to display an image of a desired facility because of a building existing in front of the facility. It will be difficult. The present invention aims to solve these problems.

[0005]

According to the present invention, there is provided an image display method for displaying desired information using a virtual space click or a real space click. The present invention also encodes facility information associated with the coordinates of the virtual space or the real space, and if the user selects the code, it is desirable that the facility be located in the target azimuth and distance space. Make information readily available. Here, the virtual space click means, for example, displaying the map information stored in the storage device on the monitor as well as displaying the morphological image of the facility and the icons indicating the facilities and functions as described in the above publication. Then, by clicking (fixing) any desired point (coordinate point), facility form, icon, or the like, information on the facility, function, or neighborhood of the point is displayed.

[0006] Here, the real space click means that a scene including a desired point from a current position is actually photographed and displayed on a monitor, and an arbitrary desired object (mountain, facility, store, Building)),
When an object is in the vicinity and is limited, the object is specified by pointing and clicking (confirming) with the pointer of the apparatus, and information on the object is displayed as necessary. According to the coordinates determined by the click, data, images, and the like of various types of objects classified by the classification code and input and stored in the storage device can be freely extracted. Here, the storage device is provided in the user's device (mobile storage device). If necessary, the storage device can be updated or supplemented by a wireless or wired communication means from a centralized or distributed storage device. The selection of a classification code is displayed as a selection menu on a part of the monitor in a hierarchical structure or the like, and can be confirmed by selecting the target classification. If necessary, accurate information can be selected and obtained by using the classification code, such as combining and combining classification codes composed of a plurality of systems.

[0007]

BEST MODE FOR CARRYING OUT THE INVENTION An image display method according to the present invention for obtaining and displaying information relating to a place using classification coding information in association with the place (position) is as follows. First,
The following methods are available for obtaining information on a desired location and displaying an image when the desired location is known.

(1) Information about an object is classified and classified into a classification code, and a mobile storage device storing the image of the object, the classification code, and the position information in a hierarchical structure or the like is used. The image is taken, the real space image is displayed on the monitor, the position of the object is determined from the coordinates of the current position and the azimuth and distance to the object, and one or more classification codes related to the position of the object are determined. Hierarchical display on the monitor,
If necessary, the higher, the same, or the lower hierarchy is selected and displayed until a desired classification code is obtained from the classification codes, and the classification code relating to a specific facility is designated from the displayed classification code. An image display method, wherein desired information on the facility is obtained from a mobile storage device and displayed on the monitor. This is the real space click mode. Preferably, prior to determining the position of the object,
By determining the position of the object after selecting the coarse classification code, a quicker operation becomes possible.

(2) A mobile storage device that classifies and sorts information about an object into a classification code and stores the image of the object, the classification code, and the position information in a hierarchical structure is used to look at a specific direction from the current position. A virtual space image such as a building or a map display image is displayed on a monitor, and by specifying a classification code of an object in advance, an azimuth and a distance to the object are determined from coordinates of a current position, and a specific facility is specified. An image display method in which the classification code is selected until the information is grasped, desired information is obtained from the mobile storage device based on the selected classification code, and displayed on the monitor. This is a virtual space search mode.

(3) Information about the object is classified and classified into codes, and the moving image is viewed in a specific direction from the current position by using a mobile storage device that stores the image of the object, the classification code, and the position information in a hierarchical structure. A virtual space image such as a building or a map display image is displayed on the monitor, and at the same time, the same real image viewed from the current position is captured, and a combined image of the real space image in parallel with or superimposed on the virtual space is displayed on the monitor. If necessary, at this time, the real space image is electronically converted into a display based on a combination of contour lines to facilitate comparison with the virtual space image, and a portion of the virtual space image corresponding to a specific object in the real image ( The virtual space image is divided and assigned meaning, and one of the sections is selected and clicked, and if necessary, the classification code is selected until a specific facility is grasped, and the transfer is performed according to the selected classification code. Image and audio display method according to displayed on the monitor and / or voice guidance can obtain the desired information from the type storage device. This is a modification of (1).

(4) Using a mobile storage device that classifies and classifies information relating to an object, stores a real image in a specific direction from a current position and displays a real space image on a monitor, or The position of the object is determined by the three-point measurement method or the like from the coordinates of the position and the azimuth and distance to the object, one or more classification codes related to the position of the object are hierarchically displayed on the monitor, and the necessary In this case, the higher, the same, or the lower hierarchy is selected and displayed until a desired classification code is obtained from the classification codes, and the unique data (name, address, characteristic, etc.) of the specific facility related to the displayed classification code is displayed. , Landscape image, internal conditions, etc.) to generate a desired information group regarding the facility by the mobile storage device. This method is an input mode and facilitates the collection of classification coded data.

(5) In the above (1) to (4), when desired information on a desired facility is obtained from the mobile storage device and is displayed on the monitor, the desired information on the facility is used as the desired information. And the image is displayed together with the outline of the obstacle on the near side. Accordingly, it is easy to grasp the desired facility based on the current position.

[0013]

Next, the present invention will be described in detail with reference to embodiments. First, the facility coding which plays an important role in the present invention and a storage device for the information will be described. All information required by the user is hierarchized from the upper concept to the lower concept, and a code is attached. This is called a classification code. However, a case where a lower concept does not exist in a specific facility, article, or the like is also included in the term of hierarchy. FIG. 1 shows an example of the classification code. The classification code used here is not limited to all man-made objects such as fixed objects such as buildings and facilities, and movable objects such as vehicles, but also systematically classifies objects such as natural geology and vegetation by function and form. , And codes are assigned by hierarchy. Classification code targets not only visible objects, but also invisible virtual objects (legal conditions, including historical spaces), evacuation information at the time of disaster, such as disaster occurrence locations, evacuation sites, water supply sites, and traffic Situation.

Next, one or more classification codes are assigned to facilities and the like existing at many positions on the map, and these are associated with the positions, and the user is described together with explanations of images and functions of the facilities and other information. , That is, the mobile storage device. It is also possible for the central manager to update and add the classification code and the position information together with the image of the product or the like by wireless or wired communication. In one form, the access to the storage device is a position (coordinates calculated from an azimuth and a distance from the current position,
Or the coordinates specified on the real space or virtual space image displayed in relation to the current position).
Then, the image associated with the classification code is read or otherwise specified by pre-specifying the classification code (the classification code associated with the virtual space image displayed in relation to the current position), thereby satisfying the code. By selecting an object from one or more positions of the above object, desired information can be extracted from the mobile recording device.

Next, as described in JP-A-1-263688 and JP-A-8-263688, a virtual space image is displayed on a CD-ROM, a DVD, a high-density mini-disc storing map information, or the like. According to the information on the current position and the user's line of sight (azimuth) obtained from space satellites and other azimuth and position detection devices, the current position can be audited directly in the horizontal direction around the current position, or as a bird's-eye view compressed diagonally from above Although a display method is appropriate, a flat map display viewed from above can be used as a means for realizing the principle of the present invention.

The display of a real space image according to another embodiment of the present invention is performed as follows. FIG. 2 shows an example, and the image display device of the present invention includes a portable monitor 1 and a camera 2 set at the current position and the direction. The camera 2 displays a scene including a nearby object 3, an intermediate object (building) 4 and a remote object (mountain) 5 on the monitor 1 as a photographed image. The predetermined position of this image corresponds one-to-one with a specific position of the virtual space 6 in the mobile storage device by a storage medium such as a CD-ROM, and it is sufficient that the coordinates can be known from the real space image. Therefore, in this example, the camera 2 is provided with a means for calculating the distance by focusing on the position corresponding to the position designation (click) on the monitor screen. Since the position and orientation of the image display device are always known, by grasping the visible object from the shape data in the height direction of the object, and adding the calculated distance of the object to the current position, The coordinates of the object in the virtual space are calculated. That is, when the position of the real space image on the monitor is designated, the coordinates of the virtual space can be known. Thus, the position can be specified in the same manner in the real space and the virtual space.

In the currently displayed real space image,
To perform the distance and azimuth measurement by automatic focusing, in FIG. 2 ia), preferably displayed on a monitor
The type of the object is selected from the type of object (for example, building) selecting means (corresponding to the selection of a higher-order classification code), and ib)
The approximate distance range is input from the approximate distance range input means. ii) Move the cursor to the target position and click. This activates the autofocus device and displays its progress on the monitor. When the focus is on, after specifying the sub-category displayed in ia) or a lower hierarchy,
iv) Click the OK button. As a result, the classification code of the target object and the coordinates (distance and direction) in the virtual space are input, and the necessary information (image and / or text) is read from the mobile storage device and superimposed on the monitor. Or they are displayed side by side. This method is suitable for obtaining information on an arbitrary target specified on a screen. When the necessary information is an image of the facility, and there is an obstacle in front of the information, it is difficult to grasp the relationship with the current position by simply displaying the image of the facility. Therefore, if the outline of the obstacle in front of the facility is also displayed, the obstacle becomes transparent and the positional relationship can be easily grasped. Therefore, when the target facility is displayed on the monitor 1 as shown in FIG. 9, for example, only the outline of the obstacle 7 is displayed. For example, when it is desired to display an image of the facility 10 of the subway, the main image of the ground surface is displayed with only the outline to make it transparent. Further, it is also possible to simultaneously display the image 8 in which physical phenomena that cannot be seen in reality are visualized, the image of a historical event performed once on the spot, and the like at the same time as the transparent obstacle.

As another method for obtaining information on a target object from the currently displayed virtual space image, an ia) object type (for example, building) selecting means displayed on a monitor in FIG. 2 is selected. Then, the selection condition is set by displaying a hierarchy of the classification codes and selecting a classification code related to a desired object from among the hierarchy of the classification codes. As a result, one or more relevant facilities are displayed from the currently displayed virtual space image.
Click one of them on the screen. Then (with further sub-classification, if necessary), iv) click on the decision click means. As a result, the classification code of the object and the coordinates (distance and direction) in the virtual space are input,
The necessary information (image and / or text) is read from the mobile storage device and displayed on the monitor in a superimposed or side-by-side manner. This method is suitable for selecting an object that satisfies a specified classification code and obtaining information on the object. Also in this example, it is desirable to make the obstacle transparent when displaying the image of the facility.

Next, an example in which a virtual space image and a real space image are used together, information on a predetermined facility is obtained using a classification code, and the obtained information is displayed as an image and a sound will be described. In FIG.
In a monitor device having the same function as in FIG. 2, a virtual space image such as a building or a map display image viewed from a current position in a specific direction is superimposed (FIG. 6) or displayed in parallel (FIG. 6). Not shown). In the case of superimposition, if the virtual space image is simplified to an outline, the mutual relationship between the images can be easily understood. The virtual space image is composed of finely divided areas, and includes, for example, the sections 1 to 7 in FIG. Therefore, a section of the virtual space image corresponding to a predetermined portion of the real space image is clicked, and if necessary, the classification code is selected until a specific facility is grasped. Information is displayed on the monitor and voice guidance is generated simultaneously or alternatively.

It is also possible to easily collect data using a similar principle, and this method will be described. As in the above example, a real image in a specific direction is captured from the current position and a real space image is displayed on a monitor, or the position of the object is determined based on the coordinates of the current position and the azimuth and distance to the object, for example. One or more classification codes determined by a point measurement method or a reflection measurement method and related to the position of the object are hierarchically displayed on the monitor. For example, as shown in FIG. 7, a real space image is captured and displayed on a monitor, and while moving along a street as shown in FIG. One or more classification codes related to the object are determined by a measurement or a reflection measurement method, and are hierarchically displayed on a monitor. If necessary, a lower hierarchy is selectively displayed until a desired classification code is obtained from the classification codes, and unique data (name, address, feature, landscape image) related to a specific facility having the displayed classification code is displayed. , Internal conditions, etc.), a desired information group regarding the facility is generated by the mobile storage device. This method is suitable for additionally storing information corresponding to a classification code of a specific object in a mobile storage device. When collecting images, a method of collecting images using the Internet 11 as shown in FIG. That is, facility 1
The images sent by the organizer, such as 2, 13, 15, and 16, the signals imaged by a remote live camera such as the mountain 14, and the image of the scheduled march 25 are collected by communication means such as the Internet, and are collected. Using the method based on the classification code described in (1), the data is selectively called and displayed, or is temporarily stored and displayed. If you want to display the events 17, showrooms 18, natural phenomena and plants 19, parties 20, and sales 21 in the facility, select the facility 12-16 or the mountain 14 by selecting the one that collected the internal image as described above. It is possible to view as an image as if it were transparent by removing obstacles.

Next, a specific example of use will be described. (I) In the case of a nearby high-density place such as an urban space FIG. 3 is an example in which a portable monitor having a built-in mobile storage device is carried and used. This shows a case where other information is displayed on the monitor. In FIG. 3, a is a case where the target building or the sidewalk on the facility side is moved, b is a case where detection is performed from the sidewalk on the opposite side of the roadway, and c is a case where the building is detected while moving with the vehicle from the roadway side. . In any case, since the distance between the azimuth and the object is relatively constant, the distance range is determined in advance by the apparatus shown in FIG. 2 and the object is indicated by the pointer and clicked or the building is displayed on the monitor screen. Take and display the real image, click on the image of the specific building on the screen, and then select and confirm the code if necessary. on the other hand,
Since data such as the type and function of the spatial arrangement in the building is stored in the database classified by the classification code, the user specifies the classification code of the arrangement desired by the user and selectively extracts the data. It can also be displayed on the monitor screen. The user intermittently performs a spatial click as needed while moving along the street, and intermittently draws out and displays functions and data in the target space and data in the space and / or receives voice guidance. In this case, the object may be anything, such as a building, a monument in a square, a street, or the like, and it is possible to detect and grasp the functions (for example, classified and coded hotels, shops, and amusement spaces). Become. This mode corresponds to the above-described embodiment (1).

On the other hand, if a classification code assigned to a special function condition (for example, a store such as a certain type of fashion design or a certain type of service or product) is specified in advance, the classification code is sequentially determined during the movement. The target to be sought can be detected and grasped. Furthermore, a virtual space image such as bird's-eye view map data is displayed on the monitor screen, and a click (line click) along a line on the image is performed. It is possible to detect a specific target by designating a desired classification code and to display the image / information on the screen by dynamically continuing the line movement data along the street starting from the start. These modes correspond to the above-described embodiment (2).

(Ii) In the case of a wide space Although the detection of the target position and the azimuth has been described with reference to FIG. 2, special considerations are required in the case of a wide space. In the case of a screen that includes a distant view such as a mountain, unlike the case where the distance to the target is almost fixed, as in the case of urban space, the distance range is greatly expanded. Becomes difficult. Therefore, as described in connection with FIG. 2, before clicking on the object, the object is classified (mountain, tower,
City code of a building, etc.) is specified in advance. As shown in FIG. 4, the distance to the object is divided into several distance ranges in accordance with the accuracy of the distance detector, and the objects within the range are grasped (for example, A = 1 to 5 m, B = 5-15m, C =
15-100m, D = 100m, E = 1000m, F =
10,000m or more). For objects that are wide in size, consciously move (pan) the orientation of the detector,
For example, the device is made to recognize that the object is spread, and the accuracy of detecting the coordinates (azimuth and distance) of the target object in the virtual space can be improved by employing one or more of these methods. . In addition, if necessary, as shown in FIG.
In addition to displaying the perspective by the method of No. 3688, the representative building is specified in particular, and the function and structure of the whole city are systematically grasped by collating with the spatial click of the object while moving on the street be able to.

The various display methods and voice guidance methods of the present invention described above may be conveniently performed in relation to a particular area or time. For example, when going to a specific area (area), it may be desired to display or guide a specific facility or the inside thereof only when approaching the vicinity. As shown in FIG. 11, the information source (A
Area (area 1, area 2) corresponding to coordinates centered on point
Etc.) and a time zone, and when the mobile device (car navigator, portable monitor, etc.) enters the area and the time zone as indicated by an arrow (the content is changed depending on the area if necessary), information from the transmission source (Introduction of facilities, functional descriptions, products, services, events, etc.) are displayed or output as audio. This involves first storing a zone or time zone in advance on a CD-ROM, a mini-disc or the like in association with point A, selecting and extracting the information specified by a code, and secondly, a communication system such as the aforementioned Internet or the like. And thirdly, a combination of these methods. In the third method, video information having a large amount of information is stored and accumulated in advance, and information from a communication network is used in combination with information on changes such as updates and time.

[Brief description of the drawings]

FIG. 1 is an example of a city facility classification code used in the present invention.

FIG. 2 is a diagram showing a monitor device for implementing the present invention.

FIG. 3 is a diagram showing one mode of use of the present invention.

FIG. 4 is a diagram showing another embodiment of the use of the present invention.

FIG. 5 is a diagram showing a display of a virtual space that can be used in the present invention.

FIG. 6 is an example of a monitor image for explaining another embodiment of the present invention.

FIG. 7 is an example of a monitor image for explaining still another embodiment of the present invention.

8 is a diagram showing a relationship between a survey point and an object in FIG. 7;

FIG. 9 is a view for explaining still another embodiment of the present invention.

FIG. 10 is a diagram illustrating an embodiment for realizing the present invention on the Internet.

FIG. 11 is a diagram illustrating an embodiment that implements the present invention in association with a time zone or a zone.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Monitor 2 Camera 3 Near object 4 Intermediate object (building) 5 Remote object (mountain) 6 Virtual space ia) Target type (for example, building) selection means ib) Input means of approximate distance range ii) Target Position iv) Click method for determination

──────────────────────────────────────────────────の Continued on the front page (51) Int.Cl. ⁶ Identification code FI G09B 29/10 G06F 15/62 380

Claims (9)

[Claims] 1. A real image in a specific direction from a current position is captured by using a mobile storage device that classifies and classifies information relating to an object, converts the information into a classification code, and stores the image of the object, the classification code, and position information. A real space image is displayed on a monitor or displayed with a pointer, etc., the position of the object is determined from the coordinates of the current position and the azimuth and distance to the object, and one or more classification codes related to the position of the object are determined. Is displayed hierarchically on the monitor,
If necessary, the higher, same or lower hierarchy is selected and displayed until a desired classification code is obtained from the classification codes, and the movement is performed by designating a classification code related to a specific facility from the displayed classification code. An image display method, wherein desired information on the facility is obtained from a type storage device and displayed on the monitor. 2. A facility or a facility viewed in a specific direction from a current position using a mobile storage device that classifies and classifies information relating to an object, stores the image of the object, a classification code, and position information. A virtual space image such as an icon showing a map or a map display image is displayed on a monitor, and by specifying a classification code of the object in advance, an azimuth and a distance to the object are determined from coordinates of a current position, and a specific An image display method, wherein the classification code is selected until a facility is grasped, desired information is obtained from the mobile storage device by the selected classification code, and displayed on the monitor. 3. A facility or map display viewed from a current position in a specific direction using a mobile storage device that classifies and classifies information about an object and stores the image of the object, a classification code, and position information. A virtual space image such as an image is displayed on a monitor, and at the same time, the same real image viewed from the current position is captured and a real space image is displayed on the monitor in parallel or superimposed on the virtual space, and the real image is displayed on the monitor. Select and click on the part of the virtual space image corresponding to the specific object in, and if necessary, select the classification code until the specific facility is grasped, and use the selected classification code to move the facility from the mobile storage device. And displaying the desired information on the monitor and / or providing voice guidance. 4. A mobile storage device that classifies information about an object, classifies and stores the information, captures a real image in a specific direction from a current position, and displays a real space image on a monitor. The position of the object is determined by the three-point measurement method or the like from the coordinates of the position and the azimuth and distance to the object, one or more classification codes related to the position of the object are hierarchically displayed on the monitor, and the necessary In such a case, by selecting and displaying the higher, same or lower hierarchy until a desired classification code is obtained from the classification codes, and inputting unique data relating to a specific facility in association with the displayed classification code. And generating a desired information group regarding the facility by the mobile storage device. 5. When desired information on the facility is obtained from the mobile storage device and displayed on the monitor, the desired information on the facility includes an image of the facility, and the image is displayed on the near side. 2. The image display method according to claim 1, wherein the image is displayed together with an outline of a certain obstacle. 6. When desired information on the facility is obtained from the mobile storage device and displayed on the monitor, the desired information on the facility includes an image of the facility, and the image is displayed on the near side. 3. The image display method according to claim 2, wherein the image is displayed together with an outline of an obstacle. 7. The image input storage method according to claim 4, wherein the unique data relating to the specific facility is an image representing an outline of the facility and a real or virtual image representing the contents of the facility. 8. The image display method according to claim 1, wherein the specific data relating to the specific facility is automatically or manually displayed in accordance with a scheduled area and / or scheduled time. 9. The image and sound display method according to claim 3, wherein the unique data relating to the specific facility is displayed and / or voice-guided automatically or manually in accordance with a planned area and / or a planned time.