JP2003296329A - Information providing device, information providing method and information processing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To inexpensively and easily provide proper information associated with scenery. <P>SOLUTION: An electronic binocular 1 predicts a photographed subject from position information and direction at photographing the subject and the information of a scenery database, and the predicted scenery image is matched with the actually photographed scenery image so that the explanation of a target can be displayed at the accurate position of the photographed image. Therefore, it is possible for a user to easily and accurately know the information of each target in the image by photographing the target whose detail information the user wants to know by the electronic binocular 1. <P>COPYRIGHT: (C)2004,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information providing device, an information providing method, and an information processing program for providing information regarding a search target.

[0002]

2. Description of the Related Art Conventionally, when looking at a landscape such as a mountain or a star, when it is desired to know detailed information about the landscape, a map or a star map is used, and a map or the like is compared with the actual landscape by silent observation. I got various information. On the other hand, with the recent development of information processing technology, a method has been proposed in which desired information is searched by an information processing device and provided to a user.

For example, in Japanese Unexamined Patent Publication No. 8-75496, a target object is specified from map data based on the position of a user carrying an information processing device, the direction in which the information processing device is directed, and the elevation angle. , A technique for displaying information about the object is disclosed. In addition, JP-A-9
Japanese Patent Laid-Open No. 505138/1990 discloses a technique of identifying a target object by a method similar to that of Japanese Patent Laid-Open No. 8-74596, displaying the related information by superimposing the target object on a photographed image.

[0004]

However, in the method of identifying an object described in JP-A-8-75496 and JP-A-9-505138, the position, direction,
The angle of elevation and the like are detected by a sensor, and the target is specified (estimated) based on the output information of the sensor. However, at present, it is not possible to realize a sensor having an accuracy capable of accurately identifying a target object by such a method. Further, it is expected that even if such a sensor is realized in the future, it will be expensive.

Therefore, at present, it is highly possible that the product identified by these methods does not exactly match the target product, and appropriate information has not necessarily been provided. Therefore, in the technique disclosed in Japanese Patent Laid-Open No. 9-505138,
In some cases, accurate information was not displayed in layers. An object of the present invention is to provide appropriate information regarding a landscape easily at low cost.

[0006]

In order to solve the above-mentioned problems, the invention according to claim 1 includes landscape information storage means for storing predetermined information (for example, the name of a mountain) related to the landscape, An information providing device that retrieves information to be displayed from the information storage means and provides the information, and a photographing means (for example, a photographing means for photographing a subject as a display object of related predetermined information).
The CCD camera 12 in FIG. 1), a location information acquisition unit (for example, the GPS function unit 14 in FIG. 1) that acquires information about the location where the subject was photographed, and direction information that acquires information about the direction in which the subject was photographed. Acquisition means (eg, FIG. 1)
Electronic azimuth meter 16) and information for pseudo-imaging a landscape (for example, two-dimensional matrix data shown in FIG. 7)
Based on the information stored in the pseudo landscape information storage means (for example, the flash ROM 18 in FIG. 1), the shooting location, the shooting direction, and the information stored in the pseudo landscape information storage means. A pseudo landscape generation unit (for example, the CPU 11 in FIG. 1) that generates a pseudo image of the subject photographed by the photographing unit, an image of the subject photographed by the photographing unit, and the pseudo landscape generation unit. Information display that matches a pseudo image and displays predetermined information related to the landscape at a predetermined position of the captured image based on the correspondence between the image of the subject and the pseudo image Means (eg, CPU1 in FIG. 1)
1 and LCD 20) are included.

Note that the processing in the present invention can be performed both for one image (still image) taken and in real time by repeating the processing continuously. The invention according to claim 2 is the information providing apparatus according to claim 1, further comprising time information acquisition means for acquiring information regarding a time when the subject was photographed, and the pseudo-scene generation means includes information regarding the time. When,
A pseudo image of the subject photographed by the photographing means is generated based on the photographed place, the photographed direction, and the information stored in the pseudo landscape information storage means. There is.

The invention according to claim 3 is the invention according to claim 1 or 2.
The information providing device described above, wherein the information display unit corrects and displays an image of the subject photographed by the photographing unit based on the pseudo image of the subject generated by the pseudo landscape generating unit. It is characterized by that.

Here, "correction" includes the case where a part of the photographed subject is interpolated by a pseudo image and the case where the photographed image is emphasized. The invention according to claim 4 is the information providing apparatus according to any one of claims 1 to 3, wherein the information display means extracts edges of the image of the subject and the pseudo image, respectively. It is characterized in that the image of the subject and the pseudo image are matched by the pattern matching.

The invention according to claim 5 is the information providing apparatus according to any one of claims 1 to 4, wherein the predetermined information related to the landscape includes information related to the terrain, and the pseudo landscape. The information storage means is characterized by storing information for imaging the topographic map.

The invention according to claim 6 is the information providing apparatus according to any one of claims 1 to 4, wherein the predetermined information related to the landscape includes information related to a starry sky, and the pseudo landscape. The information storage means is characterized by storing information for imaging a star map.

The invention according to claim 7 is the information providing apparatus according to any one of claims 1 to 6, which is in the form of binoculars, in which the photographing means is provided on the objective side, and the information display means is the above-mentioned. It is characterized in that an image display device for displaying predetermined information related to the photographed image and the landscape is provided on the eyepiece side.

The invention according to claim 8 is the information providing apparatus according to any one of claims 1 to 6, which is in the form of a portable information terminal device, and is provided with a camera as the photographing means.
The information display means is characterized by displaying predetermined information related to the photographed image and the landscape on an image display device which is a display function unit of the portable information terminal device.

According to a ninth aspect of the present invention, there is provided landscape information storage means for storing predetermined information relating to landscape, and information provision in an information provision device for retrieving and providing information to be displayed from the information storage means. The method is to store pseudo-scene information for pseudo-imaging a landscape, photograph a subject as a display target of related predetermined information, and obtain information about a place where the subject is photographed and a subject. Acquires information about a shooting direction, generates a pseudo image of the shot subject based on the shooting location, the shooting direction, and the pseudo landscape information,
The image of the subject and the pseudo image are matched, and based on the correspondence between the image of the subject and the pseudo image, a predetermined position related to the landscape is set at a predetermined position of the captured image. It is characterized by displaying the information of.

The invention according to claim 10 is the information providing method according to claim 9, wherein the information regarding the time when the subject is photographed is further acquired, and the information regarding the time, the place where the photograph is taken, and the It is characterized in that a pseudo image of the photographed subject is generated based on the photographed direction and the pseudo landscape information.

The invention according to claim 11 is the information providing method according to claim 9 or 10, wherein the image of the photographed subject is corrected based on the generated pseudo image of the subject. It is characterized by displaying. The invention according to claim 12 is the information providing method according to any one of claims 9 to 11, wherein edges of the image of the subject and the pseudo image are extracted, and pattern matching of the edges is performed to extract the edges. It is characterized in that the image of the subject is matched with the pseudo image.

The invention according to claim 13 is the invention as claimed in claims 9 to 12.
The information providing method according to any one of claims 1 to 3, wherein the predetermined information related to the landscape includes information related to the terrain, and the information for imaging the topographic map is stored as the pseudo landscape information. Is characterized by. The invention according to claim 14 is the information providing method according to any one of claims 9 to 12, wherein the predetermined information related to the landscape includes information related to a starry sky, and as the pseudo landscape information, It is characterized by storing information for imaging a star map.

The invention according to claim 15 is the invention as claimed in claims 9 to 14.
The information providing method according to any one of claims 1 to 3, wherein the information providing apparatus is in the form of binoculars, a subject is photographed on the object side, and predetermined information related to the photographed image and landscape is displayed on the eyepiece side. It is characterized by doing.

The invention according to claim 16 is the invention according to claims 9 to 14.
The information providing method according to any one of claims 1 to 3, wherein the information providing device is in the form of a mobile information terminal device, and an image is captured by a camera provided in , And displaying predetermined information related to the photographed image and the landscape.

According to a seventeenth aspect of the present invention, there is provided an information providing device which includes landscape information storage means for storing predetermined information relating to a landscape and which retrieves and provides information to be displayed from the information storage means. An information processing program, which is information about a place where a subject, which is a display target of related predetermined information, is photographed, information about a direction in which the subject is photographed, and information for pseudo-imaging a landscape. The pseudo-scene generation function for generating a pseudo-image of the subject, and the image of the subject and the pseudo-image of the subject are matched, and based on the correspondence, An information display function of displaying predetermined information related to the landscape at a predetermined position is realized.

The invention according to claim 18 is the information processing program according to claim 17, wherein the pseudo-scene generation function includes information on a time when a subject was photographed, the place where the photograph was taken, and the photographed place. It is characterized in that a pseudo image of the subject is generated on the basis of the direction and the information for pseudo imaging the landscape.

The invention according to claim 19 is the information processing program according to claim 17 or 18, wherein the information display function is based on a pseudo image of a subject generated by the pseudo landscape generation function. The image of the subject is corrected and displayed.

The invention according to claim 20 is the invention according to claims 17 to 1.
10. The information processing program according to any one of 9, wherein the information display function extracts edges of the image of the subject and the pseudo image, and performs pattern matching of the edges to match the image of the subject and the pseudo image. The feature is that matching with a specific image is performed.

The invention according to claim 21 is the invention according to claims 17 to 2.
The information processing program according to any of 0, wherein the predetermined information related to the landscape includes information related to the topography, and the information for pseudo-imaging the landscape is a topographic map. The feature is that it is information for realization.

The invention according to claim 22 is the invention according to claims 17 to 2.
The information processing program according to any of 0, wherein the predetermined information related to the landscape includes information related to a starry sky, and the information for pseudo-imaging the landscape is a star map. It is characterized by being information for doing.

According to the present invention, the photographed subject is predicted (imaged) by the place and the photographing direction at the time of photographing, and the information for pseudo-imaging the landscape, and the image of the predicted landscape is obtained. By matching with the image of the landscape actually photographed, the description of the target object in the landscape can be displayed at an accurate position in the photographed image.

Therefore, the user can easily and accurately know the information about each target object in the image by photographing the target object for which detailed information is desired. Further, since the accuracy of the sensor and the like required in the present invention is the same as that of the conventional one and is sufficient, it is possible to provide appropriate information at low cost. Further, according to the present invention, even in the case of a target object that changes with time, such as when a starry sky is targeted as a landscape, it is possible to appropriately provide information by acquiring information regarding time.

[0028]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the electronic binoculars according to the present invention will be described in detail below with reference to the drawings. The electronic binoculars according to the present invention is a device that includes a photographing means and provides a user with information such as a name regarding the photographed object. In addition, at this time, it is possible to display the information to be provided so as to be superimposed on the captured image, or to process the captured image to create a visual effect. It should be noted that various subjects such as topography such as mountains or a starry sky can be assumed as subjects (targets of information provision) captured by the electronic binoculars. An example will be explained.

First, the structure will be described. FIG. 1 is a block diagram showing a functional configuration of the electronic binoculars 1. Also, FIG.
FIG. 3A is a perspective view and a sectional view of the electronic camera 1. In FIG. 1, electronic binoculars 1 include a CPU (Central Processing).
Unit) 11, CCD (Charge Coupled Diode) camera 12, real-time clock unit 13, GPS (Gl
obal Positioning System) function section 14, elevation angle sensor 15, electronic compass 16, and RAM (Random Access Me
mory) 17 and flash ROM (Read Only Memory)
18, program ROM 19, LCD (Liquid Cry)
stal display) 20.

The CPU 11 controls the entire electronic binoculars 1, and the flash R is operated in accordance with various instruction signals such as a shutter button depression signal which is depressed when a subject is photographed.
The programs related to various processes stored in the OM 16 or the program ROM 19 are read and executed. For example, the CPU 11 reads out and executes the information providing processing program when the CCD camera 12 takes an image. Then, the CPU 11 outputs the processing results of executing various programs or controls to the RAM 15 or the flash R.
It is stored in a predetermined area of the OM 16 or displayed on the LCD 20.

The CCD camera 12 is equipped with a CCD sensor and photographs a subject in response to the depression of a shutter button to convert it into digital image data. The real-time clock unit 13 includes means for measuring the current time, and outputs the current time to the CPU 11. Further, the real-time clock unit 13 outputs the time at that time to the RAM 15 according to the instruction of the CPU 11 in response to the pressing of the shutter button.

The GPS function unit 14 has a function of receiving radio waves from GPS satellites and calculating the current position and altitude of the own device based on the received radio waves. Then, the GPS function unit 14
The CPU determines the position and altitude of the electronic binoculars 1 at that time in response to the shutter button being pressed, and the calculated position and altitude (hereinafter referred to as “position information”) to be CPU.
It is output to the RAM 17 in accordance with the instruction of 11.

The elevation sensor 15 determines how much the posture of the electronic binoculars 1 is inclined from the horizontal (more precisely, CC
A sensor for detecting the elevation angle of the optical axis of the D camera 12,
The detected elevation angle is output to the RAM 17 according to the instruction of the CPU 11. The electronic azimuth meter 16 is a device that detects the direction in which the electronic binoculars 1 are facing (to be precise, the direction of the optical axis of the CCD camera 12), and outputs the detected direction to the RAM 17 according to the instruction of the CPU 11.

The RAM 17 has a work area for temporarily storing various data generated by various processes such as information providing process (described later) executed by the CPU 11. The flash ROM 18 is a non-volatile storage device, and stores an information providing processing program and programs related to various processings for controlling the electronic binoculars 1. The flash ROM 18 also stores a database (hereinafter, referred to as “landscape database”) that stores information regarding various landscapes referred to in the information providing process.

The landscape database is a database that stores a topographic map and information (names of mountains or rivers, names of famous places and information related thereto) corresponding to predetermined points on the topographic map. In addition, in the landscape database,
It is possible to store data about various landscapes, such as star charts and the name of each constellation or star and related information.

The flash ROM 18 also stores matrix data (see FIG. 11) relating to latitude / longitude and altitude for synthesizing the topographic image in the information providing process. The program ROM 19 is a non-volatile storage device, and stores a control program of the electronic binoculars 1, predetermined data, or the like. The flash RO described above
It is also possible for the program ROM 19 to store the data stored in the M18.

The LCD 20 displays various data such as an image of a photographed landscape (object), various processing results such as information about the object, and a message to the user according to an instruction from the CPU 11. Next, the operation will be described. FIG. 3 is a flowchart showing the information providing process executed by the CPU 11. The information providing process is executed when the power of the electronic binoculars 1 is turned on.

In FIG. 3, when the information providing process is started, the CPU 11 initializes each part of the electronic binoculars 1 (step S1) and displays the image currently taken by the CCD camera 12 on the LCD 20 or the viewfinder. (Step S2). Next, the CPU 11 determines whether or not the shutter button has been pressed (step S3),
If it is determined that the shutter button has not been pressed, the process proceeds to step S2.

When it is determined in step S3 that the shutter button has been pressed, the CPU 11 performs a process of photographing a subject with the CCD camera 12 (hereinafter referred to as "image photographing process") (step S4), and photographing is performed. The displayed image (see FIG. 4) is displayed (step S5). Next, the CPU 11 selects a mode that does not provide information regarding the captured image (hereinafter referred to as “normal mode”) or a mode that provides information regarding the captured image (hereinafter referred to as “guide mode”). A menu screen to be displayed is displayed (step S6).

Next, the CPU 11 determines whether or not any menu is selected on the menu screen (step S7). If it is determined that no menu is selected, the CPU 11 proceeds to the processing of step S6. Transition.
On the other hand, in step S7, when it is determined that any menu is selected, the CPU 11 determines whether the normal mode is selected (step S8), and when it is determined that the normal mode is selected, step S2 Process shifts to.

On the other hand, when it is determined in step S8 that the normal mode is not selected, the CPU 11 predicts (images) the terrain, which is the subject, based on the position information, the elevation angle, the direction, and the information of the landscape database. , Processing for synthesizing corresponding topographic images (hereinafter referred to as “terrain image synthesizing processing”) is performed (step S9). FIG. 5 is a diagram showing a sketch of a synthesized terrain (terrain image).

Next, the CPU 11 performs a process of extracting the feature of the terrain in the photographed image (hereinafter referred to as "feature extraction process") (step S10). FIG. 6 is a diagram showing an image as a result of edge detection performed on an actually photographed image. Then, the process of adjusting the position on the screen by matching the topographic image (see FIG. 5) synthesized in step S9 with the image of which the feature is extracted in step S10 (hereinafter, referred to as "matching process").
Say ) Is executed (step S11).

Next, the CPU 11 determines whether or not a mode for adding the explanation of the terrain to the image (hereinafter referred to as "explanation addition mode") is selected on the menu screen (step S12), and adds the explanation. When it is determined that the mode is selected, the captured image is displayed (step S13). Then, the CPU 11 displays information such as the name of the mountain at a predetermined position on the image based on the result of the matching process (step S14), and a predetermined input instruction (any key input operation or the like) is performed. It is determined whether or not (step S15).

If it is determined in step S15 that the predetermined input instruction has not been issued, the CPU 11 repeats the processing of step S15. If it is determined that the predetermined input instruction has been issued, the CPU 11 performs the processing of step S5. Move to. If it is determined in step S12 that the explanation addition mode is not selected, the CPU 11
Determines whether or not a mode in which a synthesized topographic image is added to a captured image and displayed (hereinafter referred to as "image synthesis mode") has been selected (step S16).

When it is determined in step S16 that the image synthesizing mode is selected, the CPU 11 displays the photographed image (step S17) and extracts the edge portion of the synthesized terrain image to obtain the image photographed. The images are overlaid and displayed (step S18). Then, the CPU 11 shifts to the processing of step S15. If it is determined in step S16 that the image combining mode is not selected, it means that the emphasized image display mode for displaying the emphasized image that has been subjected to the image processing based on the combined topographic image is selected, and the CPU 11 causes the emphasizing Display the image (step S1
9) and shifts to the processing of step S15.

Next, each processing which is a subroutine of the information providing processing shown in FIG. 3 will be described with reference to FIGS. First, the image capturing process executed in step S4 of the information providing process will be described. FIG. 7 is a flowchart showing the image capturing process.

When the image photographing process is started, the CPU 11
Takes an image of an object with the CCD camera 12 (step S101), and measures the position (latitude, longitude, altitude) at the time of image taking with the GPS function unit 14 (step S10).
2). Next, the CPU 11 detects the shooting direction with the electronic azimuth meter 16 (step S103), and detects the shooting angle with the elevation angle sensor 15 (step S1).
04).

Then, the CPU 11 returns to the main routine of the information providing process. Next, the terrain image synthesis processing will be described. FIG. 8 is a flowchart showing the terrain image synthesis processing. When the terrain image synthesis processing is started, the CPU
The reference numeral 11 refers to the terrain data (two-dimensional matrix data indicating altitude with respect to latitude / longitude) shown in FIG. 11 to create a terrain sketch (step S201) (see FIG. 5).

Next, the CPU 11 extracts the edge portion of the terrain such as mountains from the created sketch (step S20).
2) Return to the main routine of the information providing process. 12
FIG. 8 is a diagram showing an image resulting from edge detection in the combined topographic image. Next, the feature extraction process will be described.

FIG. 9 is a flowchart showing the feature extraction processing. When the feature extraction process is started, the CPU 11
Performs edge detection (see FIG. 6) on the photographed image by scanning pixel data (step S30).
1) Return to the main routine of the information providing process. Next, the matching process will be described.

FIG. 10 is a flowchart showing the matching process. The angles of the synthesized topographic image and the captured image are not strictly accurate and include some error (see FIGS. 4 and 5). Therefore, the matching process is a process for making the position of displaying the explanation of the terrain more accurate by matching the edge of the synthesized terrain image and the edge of the captured image.

When the matching process is started, the CPU 1
In step 1, the edges of the captured image and the edges of the synthesized topographic image are matched by pattern matching (step S401), and the process returns to the main routine of the information providing process. As a result of these processes, when the user selects the normal mode, as shown in FIG.
You can see the image of the actual landscape taken. In addition, when the user selects the explanation addition mode, FIG.
As shown in, it is possible to see an image in which an explanation of the topography is displayed at an accurate position with respect to the captured image of the actual landscape. Furthermore, when the user selects the emphasized image display mode, the user can see the image in which the explanation of the topography is displayed for the emphasized image obtained by performing the image processing on the captured image, as shown in FIG. it can.

In the emphasized image, a synthesis for interpolating a portion hidden by clouds or fog in the photographed image, or a process for emphasizing the photographed image (for example, the sky is blue while the mountains are the same, (The background is blackened, stars are displayed in bright colors, etc.)
Has been applied. By displaying the emphasized image, the user can confirm the original appearance of the mountain even when a part of the mountain is hidden by clouds or fog and cannot be seen. In addition, even when it is difficult to distinguish the background from what you want to see (for example, stars and background night sky, mountains and background blue sky, etc.), it is possible to increase the contrast by image processing. It becomes easier to confirm the target object.

As described above, the electronic binoculars 1 to which the present invention is applied predicts a photographed subject based on the position information and direction at the time of photographing and the information of the landscape database, and actually predicts the image of the predicted landscape. By matching the captured image of the landscape with the captured image, the description of the target object can be displayed at an accurate position in the captured image. Therefore, the user can easily and accurately know the information about each target object in the image by shooting the target object whose detailed information is desired to be captured with the electronic binoculars 1.

Since the devices such as the sensors used in the electronic binoculars 1 have the same accuracy as the conventional ones,
Electronic binoculars capable of providing appropriate information can be realized at low cost. In the present invention, in the case of a target object that changes with time, such as when a starry sky is targeted as a landscape, the above-described function can be realized by acquiring the current time with the real-time clock unit 13.

In addition to the form of the electronic binoculars, the present invention forms the form of a portable information terminal device (see FIG. 16), the form of a monocular or binocular telescope (electronic telescope), and the form of a microscope (electron microscope). , Camera type (electronic camera)
Such a form is possible. Further, in the present embodiment, the electronic binoculars 1 perform all processing such as capturing an image of a subject, terrain image synthesizing processing, matching between the subject image and the synthesized terrain image, and displaying information related to the landscape. However, it is also possible to divide the functions of the electronic binoculars 1 and realize them by different devices. For example, a function of photographing a subject and a function of acquiring a place, direction, and date and time at the time of photographing are realized by a digital camera or the like, and a function of synthesizing a terrain image by another information processing device, the synthesized terrain image and It is also possible to provide a function of performing image matching, displaying information regarding a landscape, and the like based on an image captured by a camera or the like and a location, direction, date and time at the time of capturing.

[0057]

According to the present invention, the photographed subject is
By predicting (imaging) with the location and direction of shooting and the information for pseudo-imaging the landscape, and matching the predicted landscape image with the actually captured landscape image , It is possible to display the description of the object in the landscape at the correct position in the captured image.

Therefore, the user can easily and accurately know the information about each target object in the image by photographing the target object for which detailed information is desired. Further, since the accuracy of the sensor and the like required in the present invention is the same as that of the conventional one and is sufficient, it is possible to provide appropriate information at low cost. Further, according to the present invention, even in the case of a target object that changes with time, such as when a starry sky is targeted as a landscape, it is possible to appropriately provide information by acquiring information regarding time.

[Brief description of drawings]

FIG. 1 is a block diagram showing a functional configuration of electronic binoculars 1.

FIG. 2 is a perspective view and a cross-sectional view of the electronic camera 1.

FIG. 3 is a flowchart showing an information providing process executed by a CPU 11.

FIG. 4 is a diagram showing an image of a photographed subject.

FIG. 5 is a diagram showing a sketch of a synthesized terrain (terrain image).

FIG. 6 is a diagram showing an image as a result of edge detection performed on an actually photographed image.

FIG. 7 is a flowchart showing an image capturing process.

FIG. 8 is a flowchart showing a terrain image synthesizing process.

FIG. 9 is a flowchart showing a feature extraction process.

FIG. 10 is a flowchart showing a matching process.

FIG. 11 is a diagram showing two-dimensional matrix data showing altitude with respect to latitude / longitude.

FIG. 12 is a diagram showing an image as a result of edge detection performed on a combined topographic image.

FIG. 13 is a diagram showing an image of an actually photographed landscape.

FIG. 14 is a diagram showing an image in which an explanation of the topography is displayed at an accurate position with respect to an image of an actual landscape taken.

FIG. 15 is a diagram showing an image in which a description of the topography is displayed for an emphasized image obtained by performing image processing on a captured image.

FIG. 16 is a diagram showing an example in which the present invention is realized as a mobile information terminal device.

[Explanation of symbols]

1 electronic binoculars 11 CPU 12 CCD camera 13 Real-time clock section 14 GPS function section 15 Elevation sensor 16 Electronic compass 17 RAM 18 Flash ROM 19 Program ROM 20 LCD

   ─────────────────────────────────────────────────── ─── Continued front page    F term (reference) 5B075 ND02 ND06 NK07 PQ32 PR06                       UU40                 5C022 AA00 AB62 AC01 AC13 AC69                       CA00                 5C053 FA09 FA14 GB12 HA30 JA16                       KA05 KA22 KA24 LA01

Claims (22)

[Claims] 1. An information providing apparatus, comprising landscape information storage means for storing predetermined information related to a landscape, for searching and providing information to be displayed from the information storage means, the predetermined information being related , A location information acquisition unit that acquires information about the location where the subject was captured, a direction information acquisition unit that acquires information about the direction in which the subject was captured, and a simulated landscape. Based on the information stored in the pseudo landscape information storage means, the location where the image was captured, the direction in which the image was captured, and the information stored in the pseudo landscape information storage means. Pseudo landscape generating means for generating a pseudo image of the subject photographed by the means, an image of the subject photographed by the photographing means, and a pseudo landscape generating means A predetermined image related to the landscape is displayed at a predetermined position of the photographed image based on the correspondence between the image of the subject and the pseudo image. An information providing device comprising: an information display unit. 2. The information processing apparatus further includes time information acquisition means for acquiring information about a time when the subject was photographed, wherein the pseudo landscape generation means includes information about the time, the place where the photograph was taken, and the direction where the photograph was taken. The information providing apparatus according to claim 1, wherein a pseudo image of the subject photographed by the photographing unit is generated based on the information stored in the pseudo landscape information storage unit. 3. The information display means corrects and displays the image of the subject photographed by the photographing means on the basis of the pseudo image of the subject generated by the pseudo landscape generating means. The information providing device according to claim 1 or 2. 4. The information display means extracts edges of the image of the subject and the pseudo image, and performs pattern matching of the edges to perform matching between the image of the subject and the pseudo image. The information providing device according to any one of claims 1 to 3, characterized in that: 5. The predetermined information related to the landscape includes information related to the terrain, and the pseudo landscape information storage means includes:
The information providing apparatus according to any one of claims 1 to 4, wherein information for imaging a topographic map is stored. 6. The predetermined information related to the landscape includes information related to a starry sky, and the pseudo-scene information storage means,
The information providing device according to any one of claims 1 to 4, wherein information for imaging a star map is stored. 7. An image display device in the form of binoculars is provided on the objective side, and the information display means is provided on the eyepiece side for displaying predetermined information related to the photographed image and the landscape. The information providing device according to any one of claims 1 to 6, characterized in that: 8. A portable information terminal device is provided, a camera is provided as the photographing means, and the information display means causes an image display device, which is a display function unit of the portable information terminal device, to display the photographed image and The information providing device according to any one of claims 1 to 6, wherein predetermined information related to the scenery is displayed. 9. An information providing method in an information providing apparatus which includes landscape information storage means for storing predetermined information related to a landscape, and which retrieves and provides information to be displayed from the information storage means. Pseudo landscape information for pseudo-imaging is stored, a subject that is a display target of related predetermined information is photographed, and information regarding a place where the subject is photographed and a direction where the subject is photographed are stored. Information is acquired, a pseudo image of the photographed subject is generated based on the photographed place, the photographed direction, and the pseudo landscape information, and the image of the subject and the Matching a pseudo image, and displaying predetermined information related to a landscape at a predetermined position of the photographed image based on the correspondence between the image of the subject and the pseudo image. Features and Information provided how. 10. The image pickup device further obtains information on a time when the subject was photographed, and based on the information on the time, the photographed place, the photographed direction, and the pseudo landscape information. The information providing method according to claim 9, wherein a pseudo image of the subject is generated. 11. The information providing method according to claim 9, wherein the captured image of the subject is corrected and displayed based on the generated pseudo image of the subject. 12. The edge of each of the image of the subject and the pseudo image is extracted, and the pattern of the edge is matched to perform the matching between the image of the subject and the pseudo image. The information providing method according to any one of 9 to 11. 13. The predetermined information related to the landscape includes information related to the terrain, and the information for imaging the topographic map is stored as the pseudo landscape information. 12. The information providing method according to any one of 12. 14. The predetermined information related to the landscape includes information related to a starry sky, and information for imaging a star map is stored as the pseudo landscape information. The information provision method described in any of the above. 15. The information providing device is in the form of binoculars, photographs a subject on the object side, and displays predetermined information related to the photographed image and landscape on the eyepiece side. The information providing method according to any one of 9 to 14. 16. The information providing device is in the form of a mobile information terminal device, an object is photographed by a camera provided, and an image display device, which is a display function unit of the mobile information terminal, is provided.
15. The information providing method according to claim 9, wherein predetermined information related to the photographed image and the landscape is displayed. 17. An information processing program for an information providing device, comprising landscape information storage means for storing predetermined information relating to a landscape, for searching and providing information to be displayed from the information storage means. , Based on information about a place where a subject, which is a display target of related predetermined information, is photographed, information about a direction in which the subject is photographed, and information for pseudo-imaging a landscape A pseudo-scene generation function for generating a pseudo-image of the subject, the image of the subject is matched with the pseudo-image of the subject, and based on the corresponding relationship, a landscape is created at a predetermined position of the image of the subject. An information processing program that realizes an information display function of displaying related predetermined information. 18. The pseudo-scene generation function includes information about a time when a subject is photographed, a place where the subject is photographed,
18. The information processing program according to claim 17, wherein the pseudo image of the subject is generated based on the shooting direction and information for pseudo imaging the landscape. 19. The information display function corrects and displays the image of the subject based on the pseudo image of the subject generated by the pseudo landscape generation function. Information processing program described. 20. The information display function extracts an edge of each of the image of the subject and the pseudo image,
The information processing program according to any one of claims 17 to 19, wherein the image of the subject and the pseudo image are matched by edge pattern matching. 21. The predetermined information related to the landscape includes information related to topography, and the information for pseudo-imaging the landscape is information for imaging a topographic map. The information processing program according to any one of claims 17 to 20, which is characterized in that. 22. The predetermined information related to the landscape includes information related to a starry sky, and the information for pseudo-imaging the landscape is information for imaging a star map. The information processing program according to any one of claims 17 to 20.