JPH06318231A - Information adding device for image - Google Patents

Abstract

PURPOSE:To improve the valud-added of a picture by adding the voice information or character information of a specified object in the image together with image information. CONSTITUTION:A present position is measured by a geographical position or the like measuring means 23, and the image azimuth angle of an image input means 12 or a telephotographic lens system visual confirming means is measured by an image azimuth angle or the like measuring means 25. Based on this information, an information calculating means 24 for image calculates a view at the present position and retrieves the previously decided object inside a range, which image can be picked up by the image input means 12 or visually confirmed by the telephotographic lens system visual confirming means on the view conditions of the position, from a data base. A message concerning the retrieved object is edited as voice information or character information and audibly outputted or added together with the picked-up image or the visually confirmed image, characters are displayed, and the specified object is directed and followed.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention adds image information from an image input means together with a message concerning the subject as voice information or character information, and directly displays it on a video display means or records it on a reproduction information recording medium. The present invention relates to a device for adding information of an image.

[0002]

2. Description of the Related Art FIG. 2 is a diagram for explaining a method of inputting an image and displaying a video in a conventional apparatus having an image inputting means and a video displaying means.

In FIG. 2, reference numeral 11 is a front view, that is, a subject, such as a city, factory area, mountains, strait, or a lighthouse, a cape, a port, an island shadow, a bus, or a train looking down from an aircraft. Includes sights you saw, historic spots or athletes watching sports, disaster scenes in news, astronomical constellations, etc. Reference numeral 12 denotes an image input means, which includes a television camera 121, a microphone 1211, and a video camera 12.
2a, a film camera 123a, etc., with a suffix "a", for example, the video camera 122a and the film camera 123a include an information recording medium.

Reference numeral 13 is an information carrying and editing means. The audio technician 131 uses the microphone 1211 to input image information 1331 to the image information 1331 captured by the television camera 121.
Is added to the audio information 134, and the information is carried to the video display means 14 by the wired or radio wave carrying means 136. Reference numeral 1361 is a wired line, 1362 is a wireless transmitter, 1363 is a radio wave, and 1364 is a wireless receiver. In addition, the video camera 122a and the film camera 123a
Image information 1332 obtained from the information recording medium through
It is edited by the audio engineer 131, the image engineer 132, etc. (137). In the process of this editing 137, the image information 13
32 is the voice information 134 and the character information 1 matching this.
35 is added. It should be noted that the audio information mentioned here is not a bird, a river murmuring, ambient noise, etc., which can be heard through a scene in front.

Reference numeral 14 denotes a video display means, which is composed of, for example, large projection display devices 141 and 141b or projection televisions and CRT displays 142 and 142b (not shown) or liquid crystal display devices (not shown). Projection display 1
41 and the CRT display 142, the image input means 1
The image is directly displayed from 2 through the wired or radio wave carrier 136. An information reproducing device (not shown) is provided in the projection display 141b and the CRT display 142b having a suffix b, for example, and an edited image is sent from the information reproducing device by the above-described editing 137 process. It is displayed on the projection display 141b and the CRT display 142b. In addition, after the information recording medium is edited 137, an image may be displayed on the image display unit 14 using the wired or radio wave carrier unit 136.

Next, the operation and operation of the conventional technique in the apparatus configured as described above will be described.

Image information 1 on the front scene (subject) 11 imaged from the image input means 12 for the purpose of tourism, geographical guidance, education, advertising activities, watching sports, news reporting, etc.
When displaying an image 331 on the projection display device 141 or the like in the front center seat of the aircraft or in the passenger waiting room in the passenger seat, or in the passenger cabin or in the train or the CRT display device 142 in the lobby by the image display means 14, a simple image is displayed. In some cases, only the information 1331 is displayed.

In addition, the audio engineer 131 and the image engineer 13
At the time of editing 137 by 2, etc., audio information 134 and character information 135 that match the image information 1332 are added, and a wired or radio wave carrier 136 is used, and a CRT display device (television receiver) 142 or direct playback means in each home is used. For example, in some cases, the above-described object has been achieved by increasing the image information and added value so that the image is displayed on the CRT display device 142b in front of the station.

[0009]

The problems of the prior art configured as described above will be described below with reference to an example.

In the action for the purpose of sightseeing, in the aisle seat of an aircraft without a window, in the waiting room or in the cabin without a window under the front deck, in the front view 11 visually recognized by the image display means 14. An image is, for example, image information 1331,
1332 alone will satisfy some of the above objectives, but when you are wondering what the name is, for example, the beautiful island that is visible in the image, by a voice engineer 131 like a guide on a bus trip. If the explanation is given, the effect can be further expected.

Therefore, when displaying an image for the purpose of sightseeing, geographical guidance, education, advertisement, news reporting, etc., not only the image information 1331 and 1332 but also the image information 1331 and 13 are displayed.
In some cases, it is necessary to add audio information 134 and character information 135 that match 32 to enhance the video information and added value.

However, in such a case, a voice engineer 131 and an image engineer 132 who have sufficient knowledge and experience in advance of exercising the information recording medium are required to be reproduced and displayed on the video display means 14. Except for the method (even in this case, prior knowledge and required man-hours are required at the time of editing 137), there is a problem that it is necessary to be present at the site each time.

The present invention has been made in order to solve the above-mentioned problems of the prior art, and by automatically adding voice information and character information matching image information without relying on human hands, Even if it is an unknown geographical target, etc. while enhancing the information and added value of the image, it will be directed to that target by a command and automatically tracked (aired)
It is for achieving the purpose efficiently.

[0014]

To solve the above problems, an image information adding apparatus according to the present invention is as follows.

Image input means for picking up an image of a subject, video display means for directly displaying image information about the picked up image input from the image input means, and information recording for inputting and recording the image information for reproduction from the image input means. In a device having a medium, information such as a place name matching the image information is calculated by an image information calculating unit, a geographic and place name database is searched, and voice information or character information is added to the image information by an image information adding unit. Is automatically added.

At this time, at the time of image input by the image inputting means, it has a geographical current position etc. measuring means and an image azimuth angle etc. measuring means, and the information in the field of view obtained thereby is obtained by the image information calculating means. When calculating and searching the database such as geography and place name, and displaying the image information directly on the video display means, or when inputting and recording the image information on the information recording medium for reproduction, the place name and the like matching the image information are displayed. The information is automatically added together with the image information as voice information or character information by the image information adding means.

Further, in the above structure, the image information calculating means has a computer, an image information calculating program, a database such as geography and place name, and when inputting an image of an image picked up by the image inputting means, the current geographical position or the like. Image viewing angle and visibility based on the current geolocation information and image azimuth information obtained from the measurement means and the digital map on the geographic database linked to the current geolocation information. Along with calculating the distance, etc., sightseeing that was input in advance as a database necessary for adding information to images on the database such as place names in the field of view seen from the current geographical position determined by the viewing angle and the viewing distance, Geographical information, education, advertising activities, watching sports, broadcasting of news reports, etc. It is automatically added as audio information or character information by stage.

Alternatively, instead of the image input means, a telescopic lens system visualizing means for enlarging and visually recognizing a front scene is provided,
Information such as a place name that matches the visual recognition information is calculated by the image information calculation means, and a database such as geography / place name on the information recording medium is searched and automatically added as audio or character information by the image information addition means together with the video information. To be added to.

Alternatively, the image input means or the telephoto lens system visual confirmation means enables manpower, manpower, and automatic control, and directs to a well-specified target on the image azimuth line by the image input means or on the visual azimuth line by the telephoto lens system visual confirmation means. The tracking control means can be used automatically based on the sensor information or geographical information for detecting a specific subject or a visual target, or it can be tracked by manpower or manpower while using the signal receiving means. The shaking calculation device in the control means may correct the shaking of the image input means and the telescopic lens system viewing means.

[0020]

[Function] Measures the current position by means of geographical position measurement,
An image azimuth angle of the image input means or the telescopic lens system visual recognition means is measured by the image azimuth angle measuring means. The image information calculation means calculates the field of view at the current position based on these information, and a predetermined object within a range that can be imaged by the image input means or visually recognized by the telephoto lens system visual recognition means under the visibility condition of the position. Is searched from the database. The message regarding the searched object is edited as voice information or character information, and voice output or addition is performed together with the captured image or the visually recognized image to display the character.

Further, when the azimuth of the image input means or the telescopic lens system visual recognition means is movable, it is possible to direct to a well-known target on the image azimuth line by the image input means or on the visual azimuth line by the telescopic lens system visual recognition means. , It enables tracking by manpower or manpower either automatically by tracking control means or using signal receiving means based on sensor information or geographical information for detection of specific subject or visible target, and tracking control means is set during tracking. A shake calculation device corrects the shake of the image input means and the telescopic lens system viewing means.

[0022]

Embodiments of the present invention will be described in detail below with reference to the drawings.

FIG. 1 is a block diagram showing the structure and information system of the image information adding apparatus of the present invention.

In FIG. 1, the image input means 12 includes a television camera 121, a video camera 122a or a film camera 123a. Front scene (subject) 11 imaged here (the same as FIG. 2 and not shown in FIG. 1)
Is used as image information 133 in the video display means 14 by using a wired or radio wave carrier means 136 (similar to FIG. 2 and not shown in FIG. 1) or by reproducing an information recording medium, and the projection in the video display means 14 is performed. Display device 14
1, 141b or a liquid crystal display device or the like (not shown) (hereinafter referred to as "CRT display device 142 or the like")
Use to display the image.

The geographic current position measuring means 23 includes a geographic position information section 231, an altitude / course / pitch / speed information section 2.
32, and a clock information section 233. Geolocation information part 231
Is for measuring the geographical position of the image input means 12, and is composed of a navigation device using artificial satellites of GPS (Globar Positioning System) or a radio navigation device such as Laurent. The altitude / course / pitch / speed information unit 232 includes an altimeter, a gyro, an accelerometer, and the like. Clock information section 233
Is a precision clock device or a radio clock receiving device for receiving clock information transmitted from, for example, the Nasaki Radio Transmission Station (Sanwa-cho, Ibaraki Prefecture) or the clock information transmitted from a GPS satellite. Get from This clock information becomes necessary information for position calculation and retrieval of a well-known target such as a planet, a first-class star, or a famous constellation when the image input means 12 is turned toward the celestial body.

The image information calculation means 24 includes a computer 241, an image information calculation program 2411, and a geographic map.
A place name database 2412 is used to calculate unique information such as a place name of a subject. Geographic and place name database 2
As will be described later in detail, 412 includes a geographic database created by a digital map and a database of place names or the like linked by addresses or codes attached to the digital map.

The image azimuth angle etc. measuring means 25 has an image depression / elevation angle information section 251, an image turning angle information section 252 and an image function information section 253, and at the time of image input (imaging), the image orientation of the image input means 12 is obtained. Measure the corners.

The image depression / elevation angle information section 251 is composed of an azimuth angle sensor such as a gyro having an initial absolute horizontal angle. In addition, the image turning angle information unit 252 includes a similar azimuth sensor such as a gyro that initially sets magnetic north (N). The azimuth angle sensor such as a gyro, which is each information source of the image depression / elevation angle information unit 251 and the image turning angle information unit 252, has a fixed image input means 12 and is mounted on a moving body such as a vehicle. If there is, the altitude / course / pitch / speed information 2 indicated by the geographical current position measuring means 23
You may input directly from 32. Image function information section 253
Is, for example, the image size related to the function of the TV camera,
It consists of focal length information. The image input means 12
This function may be pre-programmed as initial value data on the image information calculation program 2411 of the computer 241 unless a special function such as zoom is not used.

At the time of image input (imaging), the current position on the geographical point is measured by the current position measuring unit 23, and the image azimuth angle measuring unit 25 measures the image azimuth angle and the image size / focal length information. These pieces of information are sent to the computer 241 via respective interfaces not shown. The computer 241 calculates the viewing angle, the viewing distance, and the like of the image based on these pieces of information, and searches the database such as the geographic / place name based on the data in the field of view calculated from the current position and the information of the image in the field of view Set well-known designation goals required for addition.

The sensor input means 26 is, for example, an infrared sensor. This is because, for example, a specific subject or the like equipped with an infrared transmitter is detected by the sensor input means 26 synchronized with the image input means 12, and the detected sensor information 261 is tracked to, for example, a group of birds moving forward. This is used when observing the movement of a specific bird from the scene (subject) 11 of, or by tracking a specific sports player from the game and watching the movement.

The image information adding means 27 uses the voice information 13
The voice synthesis / information reproducing means 271 for outputting 4 and the character display means 272 for displaying the character information 135 are shown. The character display means 272 shows the character manufacturing means 2721 and the manufactured characters at a position corresponding to the video display. The character position calculating means 2722 is included. Information adding means 27 for this image
Even if the switches SW1 and SW2 are turned off and the switch SW3 is turned on to directly data link the voice information 134 and the character information 135 to the image input means 12, the switches SW1 and SW2 are turned on and the switch SW3 is turned off. Data link may be made to the image display means 14. Further, when the voice information 134 and the character information 135 are directly data-linked to the image input means 12, the image input means 12 is connected to the recording / recording means 28 via the switch SW2,
When the voice information 134 and the character information 135 are data-linked to the video display means 14, the image input means 12 is used.
The image information 133 is displayed on the video display means 14 by the video display step 142 via the switch SW2, and the voice information 134 and the character information 135 are displayed by the voice output character display step 141a.

In addition to the characters, the character display means 272 generates a + mark indicating an image center base line described later, an arrow indicating an image designation code, and a ○ mark indicating an image of an image from a sensor transmission source (not shown). Including means.

The operation of the embodiment will be described below.

FIG. 3A shows an algorithm of the image information calculation program 2411 in the image information calculation means 24 for determining the image size and calculating the viewing angle of the front scene (subject) 11 projected on the image. It is a figure for explaining. The viewing angle of the image input means 12 is determined by the screen size (width of the image forming screen) and the focal length of the lens, which is determined by the following equations (1) to (6).

In FIG. 3 (a),

[0036]

1 / a + 1 / b = 1 / f (Equation 1)

[0037]

[Equation 2] ∴b / a + 1 = b / f ∴1 / m = b / a = b / f-1 (Equation 2)

Here, D: size of screen (width of image forming screen) D ': width of front scene (subject) 11; m: magnification d: distance between image input means 12 and subject (Fig. 3 (a ) Equal to b) f: focal length (mm)

If d >> f >> D,

[0040]

## EQU00003 ## m = D / D '= D / 2 dtan .theta. / 2 (Equation 3)

[0041]

[Equation 4] ∴ tan θ / 2 = D / 2d · 1 / m = D / 2d (d / f−1) ≈D / 2d · d / f = D / 2f (Equation 4)

[0042]

[Equation 5] ∴θ = 2 tan ⁻¹ D / 2f≈D / f [radian] (Equation 5)

Therefore, a schematic view of the horizontal viewing angle is

[0044]

Horizontal viewing angle = (180 ° / π) × θ≈D / f (Equation 6)

It becomes

Now, the viewing angle of the front scene (subject) 11 picked up by the image input means 12 is calculated by the above equation, and the image display means 14 displays an image substantially equal to the viewing angle. Since the earth is circular, the front scene (subject) 11 within the viewing angle cannot be seen anywhere. Therefore, it is necessary to find the distance to see how far you can see.

FIG. 3 (b) is an explanatory diagram for obtaining the sight distance. In this figure, 11 indicates a front scene (a lighthouse in this example). The sea surface 31 indicates the roundness of the earth. Reference numeral 12 denotes an image input means, which is mounted on the ship 32 in the example of this drawing. Here, the front view (lighthouse in this example) 11 as seen from the image input means 12 is
It is calculated by the following equation (7).

[0048]

(7) D = 2.07 ((H) ^1/2 + (h) ^1/2 ) (7)

Here, D: view distance (mile) H: height (m) of the front scene 11 described on the map h: height (m) of the image input means 12

Therefore, from the above equation, the image inputting means 12 can be operated so as to intuitively reach a high mast and look far.
The higher the position of, the longer the distance can be seen. The visual confirmation state of the image displayed on the image display means 14 includes the screen size, the viewing angle, the viewing distance, the brightness,
In addition to imaging system information such as resolution (number of scanning lines and video signal bandwidth), lens quality and magnification, it is affected by subject system information such as weather conditions, visibility, and color contrast. Calculate the factors.

Therefore, the present geographical position measuring means 23
Based on the current geographical position where the image input means 12 is present and the image azimuth line obtained by the image azimuth angle measuring means 25, the prominence within the viewing angle and the visual range (hereinafter referred to as "in the field of view"). The means for searching the designated target will be described with reference to FIG. In addition, this famous designation target is tourism, geographical guidance, education,
An index of information that has been entered as a database in advance for purposes such as watching sports, advertising activities, and reporting. In FIG. 4, the case of tourist information will be described as an example.

FIG. 4 is a diagram for explaining the geography of a region where a pleasure boat sails, for example. FIG. 4A is a contour diagram 41, FIG.
FIG. 4B is a digital map 42 created from the contour map 41 of FIG. 4A.
(Longitude, altitude, etc.) is stored in the database 2412 of geography / place name etc. on the computer 241 together with the database of place name etc. (name of the place concerned, description of subject, etc.) and is used for calculation of the viewing angle and the view distance. The numbers in the blocks of the digital map 42, which are divided by the squares, represent the relative heights, where a unit of a certain height is tentatively expressed as 1. There is an address (not shown) for each block corresponding to each block indicating each geographic position and altitude in which this number is written, and by the address or search code attached to the digital map 42 which is a geographic database. It is linked to a place name database. The letters A and B in the right block of the digital map 42 indicate the geographic positions where the image input means 12 is on the database at a certain point. The digital map 42 may use the numerical database of the Geographical Survey Institute. FIG. 4C is a three-dimensional digital map map 43 in which the terrain is relatively close to the real scene. Like the digital map 42, A and B indicate the geographical position of the image input means 12. The three-dimensional digital map 43 is drawn to visually grasp the geographic database 42. 4 (d) is B
It is a figure which shows the famous designation | designated target 441 from a point, In this figure, 4411 is xx mountain of the 1st prominent designated target on a geographical data base, and 4412 is xx mountain of the 2nd well-designated target similarly. Further, 443 is a viewing angle, and 444 is a viewing distance.

Now, the method of searching the database 2412 for geography / place name and the method of calculating the target designation 441 in the visual field will be described step by step with reference to the above figure.

The viewing angle 443 and the viewing distance 444 are obtained by the above equations (Equation 1) to (Equation 7). When obtaining the viewing distance 444, it is very high if the height of the mountain in front is unknown. You have to search to infinity, where mountains are expected to exist. Therefore, first, for example, the highest mountain (target) existing within the range that can be seen from the action area where the sightseeing boat of the tourist destination sails is set as the initial designated target data. However, it is set to infinity in the calculation of the astronomical viewing distance when the subject is an astronomical object.

The obtained digital map 42 within the field of view is called, and an address (not shown) corresponding to each block on the digital map 42 (the digital map 42 in FIG.
In the above example, there are 99 individual addresses), and a code at the same address on the database such as a place name is searched for, and at the same time the famous name designation target 441 is called, the geographical position and altitude H on the digital map 42 of the address are searched. Then, the geographical position of the image input means 12 (point B in the example of FIG. 4) and its altitude h, the direct distance R from the image input means 12 to the well-known target, the depression angle α, and the turning angle β are obtained. The famous designation target 441 is called by searching the address in the digital map 42 of FIG. 4 and confirming that the data has a specific code indicating the famous designation target. In FIG. 4, instead of the reference numeral, a numeral representing the height is shown surrounded by a triangle.

Based on the data of the famous designation target 441 called by the term by the above-mentioned equation, the sight distance 4 is again set.
44 is calculated, and the famous designation target 441 within the field of view is determined. In FIG. 4, the first prominent designation target 4411 within the field of view
And the second prominent designation target 4412 is called.

However, in reality, there may be a case where the called mountain is also blocked by the front scene (subject) 11 and cannot be seen. Therefore, it is necessary to verify whether it is really visible or not, and FIG. 5 is a diagram visually and geometrically explaining the algorithm.

In FIG. 5 (a), from the geographical position of the image input means 12 at point A, a scene (subject) 11 in front is seen.
Although the xx mountain of the first prominent designation target 4411 is visible, the xx mountain of the second prominent designation target 4412 is the first prominent designation target 44 in the front even at a higher altitude in the rear.
It is invisible because it is blocked by 11 xx mountains. However, both mountains are visible from point B.

FIG. 5B shows the first prominent designation target 441.
It is a figure explaining the algorithm which determines whether the xx mountain of 1 and the xx mountain of the 2nd famous designation | designated target 4412 are actually visible or invisible. Image azimuth line 5 seen from point A
When the elevation angle α1 of 1 is larger than the elevation angle α2 of the image azimuth line viewed from the point B (α1> α2), the xx peak of the first prominent designation target 4411 is visible, but the xx of the second prominent designation target 4412.
I can't see the mountain. However, when the elevation angles α of the image azimuth lines are the same (α1 = α2) as seen from the point M indicated by the broken line in the figure, both of them start to be seen, and the farther back the mountain becomes, the better as the distance increases. The same applies when the mountain in the front in this figure is approached from point B to point A. The elevation angle α of the image azimuth line 51 is the image azimuth angle etc. measuring means 25.
The image depression / elevation angle information output from the image depression / elevation angle information section 251 or the mutual position in geography and the height of the mountain can be calculated on the computer 241 by the trigonometric theory. In this way, the famous designation target 441 in the visual field that is actually visible
1, 4412 are tested and updated to determine the final name-designating target 441, and the image information adding means 27 sets the voice information 1 of the name-designating target 4411 or 4412.
34 and character information 135 are data-linked to the video display means 14, are directly data-linked to the image input means 12 and are directly displayed on the video display means 14, or are input to the information recording medium of the image input means 12 ( record.

By the way, as described above, the prominent designation target is a database in advance corresponding to the purpose of tourism, geographical guidance, education, sports watching, advertising activities, news reporting, etc. in order to enhance the information and added value of the image. It is the index of the information entered as. When the famous name designation target 441 is determined, information regarding this is read out from the geographical name database etc. of the geographical / geographic name database 2412. Based on this, the voice synthesizing / information reproducing means 271 of the image information adding means 27 edits into a predetermined necessary voice message and outputs it as the voice information 134. Characters are read based on the database, etc. and made into a required character string. The prominence designation target is the position on the screen calculated from the present and position of the image input means 12, the image azimuth angle, the viewing angle and the image size as described above, and the character position on the screen of the read character string. Is a character position calculating means 2722 so that it is located in the vicinity of the famous designation target.
Calculated by This character string and character position are character information 135
Is connected to the video display means 14 or the image input means 12 together with the audio information 134.

FIG. 6A shows the image center base line 6 of the + mark showing the center of the screen in the video scene imaged from the point B of FIG. 5A.
11 and an arbitrary prominent designation target 441 as described above ↓
An image designation code 612 such as a mark is formed.

This image center base line 611 is the designated designation target 4
Tracking control when 41 is desired to be placed in the center of the screen (hereinafter referred to as "image center") for a long time, or when a specific athlete with a sensor transmitter (not shown) is placed in the image center, as will be described later. Used for automatic tracking by the device. Further, when it is desired to use the star as the well-known designation target 441 by orienting it toward the center of the image for educational purposes or the like, a command signal is similarly input to the tracking control device and the image azimuth line 51 is directed in that direction.

The computer 241 obtains the image dimension information from the viewing angle calculated by the image information calculation program 2411 and the distance between the well-known target 441 and the image input means 12, and further obtains the well-specified target 441 from the image azimuth line. Since it is known which azimuth angle is visible, the azimuth angle of the image input means 12 can be corrected by calculation, and as a result, the prominent designation target 441 can be placed at the center of the image.

The image designation code 612 is shown as an arrow or a circle at the image position in the field of view which coincides with the image display by the image information adding means 27, and the character information 13 is provided in the vicinity thereof.
5 is "x" as in the example shown in the image scenery 61 of FIG.
x mountain peak (zzm) "is displayed. This prominent designation target 441 is not only a place name, but by adding information (subject attribute related information) related to the place name, it is possible to more effectively carry out video activities such as tourism, geographical guidance, education, and promotional purposes. You can

On the other hand, when the unique or common sensor information 261 obtained by the sensor input 26 and the geographic / geographic name database 2412 are linked (see FIG. 1), the geographic database is passed and the geographic name database or the like is passed. By linking with a search code or index of another database, information on the database, for example, in the case of a sports player, past results according to the situation of the play may be output.

FIG. 7A is a diagram for explaining the tracking control device. In FIG. 7A, reference numeral 73 is an input unit, which operates and controls this tracking control apparatus by command operation. Reference numeral 241 denotes a computer, which is the same as the computer 241 shown in FIG. The computer 241 detects a sensor transmission signal (not shown) attached to a specific subject in the front scene 11 by the sensor input means 26 and sends the sensor information 261 to the computer 241. Since the computer 241 obtains the image size information from the viewing angle calculated by the image information calculation program 2411 and the distance between the specific subject and the image input unit 12, which position the sensor information 261 is from the center of the image. Recognize. Therefore, the computer 241
6 calculates the amount of correction for placing the image in the center of the image.
The calculation is performed as shown in (b), and the depression / elevation angle signal 2413 and the turning angle signal 2414 shown in FIG. 7 (a) are generated and sent to the image azimuth line control / sway calculation device 71. That is, this calculation is as follows.

[0067]

Xt = V · sin θ yt = V · cos θ or xt = R (dβ / dt) yt = dR / dt

From

[0069]

[Equation 9] ∴ V = √ ([R · (dβ / dt)] ² + (dR / dt) ² ) (Equation 9)

[Equation 10] θ = tan−1R · (dβ / dt ′) / (dR / dt) (Equation 10)

Ω = dβ (degrees) / dt (seconds) (Equation 11)

Here, V: subject speed θ: subject angle ω: angular velocity

As in the above (Equation 8) to (Equation 11), this calculation may be performed by correcting the variation rate (angular velocity ω) of the subject to the center of the image coordinate system. On the other hand, when the geographic position information 2415 (obtained from the geographic present position measuring means 23, the image azimuth angle measuring means 25, and the geographic / geographic name database 2412) is received without receiving the sensor information 261, the algorithm already explained. The center of the image is calculated by the same, and similarly, the depression / elevation angle signal 2413 and the turning angle signal 2414 are sent to the image azimuth line control / sway calculation device 71.

The image azimuth line control / sway calculation device 71 comprises a shake stabilizing device 72 and a gyro 721 constituting the device. The gyro 721 detects a roll angle signal 722 and a pitch angle signal 723 from the absolute horizontal plane 74, which will be described with reference to FIG. 7B, and sends them to the image azimuth line control / sway calculation device 71. The image azimuth line control / sway calculation device 71 corrects this shake, converts the depression / elevation angle signal 2413 and the turning angle signal 2414 sent from the computer 241, into the absolute horizontal plane 74, and always sets the image input means 12 in the designated direction. The corrected depression / elevation angle signal 711 and the corrected turning angle signal 712 for specifying

The control device 124 is composed of a signal receiver, a control motor, etc. (not shown), and directs the image input means 12 in the direction of the image azimuth line 51 calculated by the computer 241. The image input means 12 calculates the signal amount when the image input means 12 is physically oriented by the computer 241.
Then, it is fed back as the turning feedback signal 2415 and the elevation feedback signal 2416, and the automatic tracking control is performed.

The image azimuth line 5 calculated by the computer 241 by manpower or manpower, not depending on the automatic tracking control.
When it is desired to move in the direction of 1, the corrected depression / elevation angle signal 711 and the corrected turning angle signal 712 from the image azimuth control / sway calculation device 71 are sent to the optical signal generator 12 shown in FIG.
42 receives and transmits as a light spot signal 1243,
The half mirror 1212 between the eyepiece 1213 in the image input means 12 and the objective lens 1214 at the tip is made to project an image, and the projected light spot signal 1243 is partially reflected and projected to the human eye 1214.

The image azimuth baseline 1215 on the half mirror 1212 shown in FIG. 8B is the image azimuth line 51 of FIG. 8A.
Therefore, by aligning the image azimuth baseline 1215 on the half mirror 1212 with the light spot 1243 calculated by the computer 241, it is possible to direct the image to the prominent designation target 441 on the image azimuth line 51. The optical signal generator 1242 that outputs the optical spot signal 1243 may be, for example, a small CRT display.

At this time, the operation of directing the image input means 12 to the image azimuth line 51 is performed by manpower while confirming whether the image azimuth base line 1215 matches the light spot 1243, or driving the motor by, for example, a switch operation. Let me do it by manpower.

On the other hand, in FIG. 8A, the image input means 1
Instead of 2, the image adding device may be configured by a telephoto lens system visual recognition means (for example, binoculars) having an optical system similar to that of FIG. In this case, the image on the visual azimuth line visually recognized through the lens (visual recognition in this case) information 133
The audio information 134 such as a place name matching the
You may pour it in the headphones etc. which are equipped with. (Refer to voice output character display step 141a in FIG. 1)

Further, the character information 135 is transferred to the optical signal generator 1
It may be transmitted to the optical signal generating device 242 and the half mirror 1212 may project the image as the character information 135 from the optical signal generator 1242 as described above.

[0079]

Application Example of the Invention In the example of the present invention, when an image relating to the front scene (subject) imaged from the image input means is displayed by the image display means in the apparatus having the image input means and the image display means, the image display matches. Although the image information is displayed as voice information or character information, if the front view with the car window of a bus or the like is well visible, the voice information by the voice output means or the character information by the letter output means is used without using the image input means. You may just Further, in a device or the like having a telescopic lens system visual recognition means, instead of the azimuth angle sensor which is an image azimuth angle measuring means, a switch or the like installed in a well-known target direction is substituted, and for example, the above-mentioned telescopic lens system installed on a rooftop. When the image azimuth base line in the visual recognition means is sequentially directed toward the well-known target, the geographic / geographic name database may be searched from the sensor information and the voice information may be output to the headphones or the like. As an example, this database may have a system configuration constructed by a compact disc and a compact player that can be easily accessed.

Further, during tracking and imaging of individual sensor information attached to a specific subject using the sensor input means synchronized with the image input means together with the image information, the information source position calculated by the image information calculation means is stored in the computer. Write to the attached information recording medium, read the recorded data written in the information recording medium for behavior evaluation during tracking imaging or after tracking imaging, and reconstruct the wake so that the activity can be evaluated (Reconstruction). You may make it output to a Y plotter, a CRT display, etc. Further, the track may be reorganized in multiple directions by a plurality of image input means.

[0081]

According to the present invention, when displaying an image of a front scene (subject) picked up from the image input means by the video display means, not only simple image information but also voice information such as a place name matching the image information. By automatically adding text information and character information, the information and value added of the image can be increased without human intervention, and even if an unknown geographical target is directed to the target or automatically tracked by a command, sightseeing, geographical guidance It effectively achieves the purpose of broadcasting (visual recognition) through education, advertising activities, watching sports, and reporting.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration and an information system of an image information adding device of the present invention.

FIG. 2 is a diagram for explaining a method of inputting an image and displaying a video in a conventional device having an image inputting unit and a video displaying unit.

FIG. 3 is an explanatory diagram for obtaining a viewing angle and a viewing distance.

FIG. 4 is a diagram illustrating a means for searching for a well-known designation target in the field of view.

FIG. 5 is a diagram illustrating a relationship between a name designation target and an image azimuth line.

FIG. 6 is a diagram illustrating an image center and a correction amount for placing a specific subject in the image center.

FIG. 7 is a diagram illustrating a tracking control device and an operation thereof.

FIG. 8 is a diagram for explaining the orientation of the image input means or the telephoto lens system visual recognition means in the direction of the image azimuth line by human power or manpower.

[Explanation of symbols]

 12 image input means 14 video display means 23 current geographical position measurement means 24 image information calculation means 25 image azimuth angle measurement means 26 sensor input means 28 recording / sound recording means

Claims (5)

[Claims] 1. An image input means for picking up an image of a subject, a video display means for directly displaying image information about the imaged subject which is input from the image input means, and the image information for input and recording for reproduction from the image input means. In an apparatus having an information recording medium, information such as a place name that matches the image information is calculated by an image information calculating unit, a geographic and place name database is searched, and voice information or image information is added by the image information adding unit together with the image information. An image information adding device characterized by automatically adding character information. 2. An image input unit for picking up an image of a subject, a video display unit for directly displaying image information about the imaged subject which is input from the image input unit, and the image information for input and recording for reproduction from the image input unit. In an apparatus having an information recording medium, at the time of image input by image pickup by the image input means, it has a geographical current position etc. measuring means and an image azimuth angle etc. measuring means, and the information in the visual field obtained thereby is used as the image information. Calculated by the calculation means, searched the database such as geography and place name, and directly displayed the image information on the video display means, or when inputting and recording the image information to the information recording medium for reproduction, it matched the image information. An image information adding device characterized in that information such as a place name is automatically added together with image information by image information adding means as voice information or character information. 3. The image information adding apparatus according to claim 2, wherein the image information calculating means has a computer, an image information calculating program, a database such as geography and place name, and the image inputting means inputs the image. At this time, the current geographical position information and the image azimuth information obtained from the geographical current position measuring device and the image azimuth measuring device and the digital map on the geographic database linked to the current geographical position information are displayed. Based on the calculated image viewing angle, view distance, etc.,
Tourism, geographic guidance, education, and advertising activities that have been entered in advance as a database necessary for adding image information on a database such as a place name within the field of view seen from the current geographical position determined by the viewing angle and the sight distance. An image information adding device characterized in that a name-designated target or the like that matches a target for watching sports, watching news, etc. and a visual target is automatically added as voice information or character information by image information adding means. . 4. The image information adding device according to claim 2 or 3, further comprising, instead of the image inputting means, a telescopic lens system visualizing means for enlarging and visualizing a front scene, and a place name matching the visual recognition information. Etc. is calculated by image information calculating means, a database such as geographic / place name on the information recording medium is searched, and automatically added as audio or character information together with video information by image information adding means. Image information adding device. 5. The image information adding apparatus according to any one of claims 2 to 4, wherein the image input means or the telescopic lens system visual recognizing means is manpower, manpower,
It enables automatic piloting, enables pointing to a well-specified target on the image azimuth line by the image input means or on the visual azimuth line by the telescopic lens system visual recognition means, and based on sensor information or geographical information for detecting a specific subject or a visual target. In addition, the tracking control means enables tracking by manpower or automatically using the signal receiving means, and the shaking calculation device in the tracking control means detects the shaking of the image input means and the telescopic lens system visualizing means during tracking. An image information adding device characterized by correction.