JP2005283407A - Projection display of image with description - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide technology for projecting an image in a state in which an observer grasps an object by three-dimensionally observing a photographing object such as a scenery. <P>SOLUTION: The images concerning the same photographing object are expressed respectively by using two projectors and first and second image lights each being polarized light having a mutually orthogonal polarization direction are projected to be overlapped on the same projection face. The images supplied to the projectors are prepared so as to include infographics respectively for displaying description of a prescribed object included in the photographing object in the neighborhood of the object. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a technique for projecting and displaying an image with explanations.

  Techniques for projecting and displaying images include those disclosed in the following patent documents. For example, Patent Document 1 relates to a map display device using a map sheet in which map information is recorded on a transparent support. In this technology, when the position information and the map information are projected on the screen with a projection light source, the current position is detected by GPS (Global Positioning System) to generate the position information, and the map information and the current position are obtained. Zoom in on the screen.

JP-A-6-281467 Japanese Patent Laid-Open No. 7-257228 Japanese Patent Laid-Open No. 11-65431

  However, the above-described prior art has a problem that it is necessary to prepare and store an extremely large number of map sheets in advance. In addition, there has been a problem that a subject to be photographed such as a landscape cannot be observed stereoscopically.

  An object of the present invention is to provide a technique capable of observing a shooting target such as a landscape in a three-dimensional manner and projecting an image in a form in which an observer can easily grasp an object.

In order to achieve the above object, a projector system according to the present invention provides:
A first projector and a second projector for projecting the first and second image lights, which are polarized lights having polarization directions orthogonal to each other and representing images related to the same photographing object, on the same projection plane; ,
First and second image data generating units for generating first and second image data for generating the first and second image lights and supplying the first and second image data to the first and second projectors;
With
The first and second image data creating units include the first and second image data so as to include commentary images for displaying a commentary of a predetermined object included in the photographing object in the vicinity of the object, respectively. Create image data.

  In this projector system, two images including a description of the object are projected onto the projection plane with orthogonal polarized light, so if you observe with polarized glasses, you can observe the shooting object such as a landscape in three dimensions. The object can be easily grasped.

The projector system further includes:
First and second cameras for photographing the same subject and generating first and second photographing signals;
A database access unit for accessing a database pre-stored with explanations about a plurality of objects;
With
The first and second image data creation units create the first and second image data by superimposing a comment obtained from the database on an image represented by the first and second imaging signals. You may make it do.

  According to this configuration, since it is possible to display the images taken by the two cameras with explanations, it is possible to observe the images with explanations in real time.

The projector system further includes:
A coordinate detector for detecting geographical coordinates of the projector system;
An azimuth detecting unit for detecting the shooting azimuths of the first and second cameras;
With
The database has coordinate information regarding geographical coordinates of the plurality of objects,
The first and second image data creation units are included in the shooting target with reference to the database using the geographical coordinates detected by the coordinate detection unit and the shooting direction detected by the direction detection unit. It is also possible to search for an object to be searched and to obtain a comment on the searched object.

  According to this configuration, a description can be acquired in real time according to the coordinates of the projector system and the orientation of the camera.

The database has size information related to the sizes of the plurality of objects, and the first and second image data creation units obtain the sizes of the objects included in the photographing object with reference to the database. And
The first and second image data creation units may determine the display position of the comment according to the geographical coordinates and size of the object.

  According to this configuration, the explanation can be displayed at an appropriate position in the image.

The projector system is mounted on a moving body that operates along a predetermined operation route,
The database stores in advance landscape data along the operation route,
The first and second image data creation units use the landscape data acquired from the database instead of the first and second imaging signals supplied from the first and second cameras. You may make it have the mode which produces 1 and 2nd image data.

  According to this configuration, it is possible to display an image with a comment even in a situation where the scenery cannot be taken by the camera due to bad weather.

  It is preferable that the first and second image data creation units can move the display position of the explanation of the object in accordance with a user's designation.

  According to this configuration, the explanation can be arranged at an appropriate position.

  The first and second image data creation units include explanations about objects satisfying a predetermined condition among the objects included in the photographing object in the first and second image data. In addition, the first and second image data may be generated so that a description of an object that does not satisfy the predetermined condition is not included in the first and second image data.

  According to this configuration, it is possible to prevent an unnecessarily large number of explanations from being displayed.

  The present invention can be realized in various forms, for example, a projector system, an image projection display method, a computer program for realizing the function of the method or apparatus, and the computer program recorded therein. The present invention can be realized in the form of a recording medium, a data signal including the computer program and embodied in a carrier wave, and the like.

Next, embodiments of the present invention will be described in the following order.
A. Example:
B. Variation:

A. First embodiment:
FIG. 1 is an explanatory diagram showing a projector system as an embodiment of the present invention. This projector system is mounted on a moving body MB such as a bus or a train, and has two cameras 111 and 112 arranged separately on the left and right of the moving body MB, and 2 provided inside the moving body MB. Projectors 121 and 122, a landscape display control device 130, and a projection screen 140.

  The two cameras 111 and 112 are digital video cameras for photographing the same subject. In the example of FIG. 1, the landscape to be photographed includes a mountain MT, a river RV, and a bridge BG. The landscape display control device 130 creates first and second images in which explanations of an object (for example, a mountain MT and a bridge BG) are superimposed on color images taken by two cameras 111 and 112. These first and second images are supplied to the two projectors 121 and 122 and projected on the projection screen 140 in a superimposed manner. The projectors 121 and 122 project polarized light (for example, p-polarized light and s-polarized light) having polarization directions orthogonal to each other. A passenger of the moving body MB can observe a three-dimensional landscape by observing an image projected on the projection screen 140 with polarized glasses. The polarized glasses are configured such that the polarization directions of the transmitted light of the left eye and the right eye are orthogonal to each other.

  FIG. 2 is a block diagram showing the configuration of the projector system. The landscape display control device 130 includes an operation panel 200, a GPS device 210, a gyro 220, a direction sensor 230, a database access unit 240, a database 242, and two explanation image creation devices 251 and 252. . The operation panel 200 is an input device for the user to make various settings. The GPS device 210 acquires the geographical coordinates (latitude, longitude, altitude) of the projector system using GPS (Global Positioning System). The gyro 220 and the azimuth sensor 230 detect the shooting azimuth (horizontal direction and elevation angle) of the cameras 111 and 112. Note that the GPS device 210, the gyro 220, and the orientation sensor 230 can be considered to detect the geographical coordinates and orientation of the projector system.

  The database 242 has an explanation database that stores explanations about a plurality of objects (mountains, bridges, lakes, buildings, etc.) and a landscape database that stores landscape images themselves. Both are collectively referred to simply as a “database”. FIG. 3 shows the contents of the commentary database. The commentary database includes names and geographic information (latitude, longitude, altitude, representative size) for a plurality of objects. Here, the “representative size” is a representative value indicating the size of the object. Various values such as the maximum width and height can be registered as the representative size. In the example of FIG. 3, the maximum width is registered as the representative size. Data related to one object is called “explanatory data” or “name data”. The database 242 can also be installed at a location away from the landscape display control device 130.

  FIG. 4 is a block diagram showing the internal configuration of the comment image creation devices 251 and 252. The comment image creation devices 251 and 252 include an input image reception unit 262 that receives an input image, a comment image creation unit 264 that creates a comment image, and an image composition unit 268 that synthesizes the input image and the comment image. ing. The input image receiving unit 262 can receive any one of the video signal supplied from the video cameras 111 and 112 and the video signal supplied from the landscape database. The comment image creation unit 264 creates a comment image based on the geographical position and orientation acquired by the sensors 210, 220, and 230 described above and the comment acquired from the database.

  FIG. 5 is a flowchart showing a normal operation of the projector system. In step S1, an image is input. Specifically, the first and second imaging signals relating to the same imaging object are acquired using the two cameras 111 and 112. These photographing signals are supplied to the first and second explanation image creation devices 251 and 252, respectively. In step S2, the GPS device 210, the gyro 220, and the azimuth sensor 230 detect the geographical coordinates at the time of image shooting and the shooting direction (horizontal direction and elevation angle). These pieces of information are also transferred to the first and second explanation image creation devices 251 and 252.

  In step S3, the explanation image creation devices 251 and 252 select explanations that can be displayed. Specifically, the commentary image creation devices 251 and 252 access the commentary database (FIG. 3) via the database access unit 240, extract the objects present in the image represented by the photographing signal, and Get commentary (name) and geographic information. Note that access to the commentary database may be executed by only one of the two commentary image creation devices 251 and 252 or may be executed in a shared manner.

  FIG. 6 is an explanatory diagram illustrating a method for searching for an object present in an image. Here, as shown in FIGS. 6A and 6B, an explanation image plane CDP for arranging explanations (namely, names of objects) is set. The comment image plane CDP has a width w and a height h, and is a virtual plane disposed at a distance d from the cameras 111 and 112. The distance d is set to an arbitrary predetermined value. The width w and the height h are determined in accordance with the distance d and the angle of view θ of the cameras 111 and 112 (FIG. 6B). Note that the angle of view θ is a value determined according to the CCD imaging surface 114 of the cameras 111 and 112 and the focal length of the lens 116. When the XYZ coordinate system is set on the comment image plane CDP, the camera 111 (or 112) exists at the position (0, 0, −d).

  In step S4, the comment image creation devices 251 and 252 arrange the commentary on the object on the comment image plane CDP. FIG. 6C shows a method for determining the position S of the object. The comment image creation device 251 (or 252) first converts the latitude, longitude, and altitude of the object acquired from the comment database into the XYZ coordinate system, and obtains the coordinate value M (Xm, Ym, Zm). At this time, the coordinates of the position S of the object on the explanation image plane CDP are (Xm * d / (Zm + d), Ym * d / (Zm + d), 0). Therefore, in step S3, the position S is calculated for each object, and only the object whose coordinates are within the range of the comment image plane CDP is extracted. Note that the process of step S3 may be executed by only one of the two commentary image creating apparatuses 251 and 252 or may be executed in a shared manner.

  FIG. 7 is an explanatory diagram showing a state in which explanations are arranged on the explanation image plane CDP. In this example, mountains and bridges are detected as objects, and “mountain A” and “B bridge” are arranged on the explanation image plane CDP as explanations. Note that the mountain image display area DA1 and the bridge image display area DA2 indicated by the broken lines in FIG. 7A are the geographical information (particularly representative size and elevation) acquired from the commentary database (FIG. 3), It is set according to the altitude of the landscape display control device 130 acquired by the GPS device 210. The explanation of each object (“mountain A” and “B bridge”) is preferably arranged around these display areas DA1 and DA2.

  The description of the object can be changed to various positions according to the user's designation. For example, using the operation panel 200 (FIG. 2), the explanation of each object may be moved vertically and horizontally (XY directions) on the explanation image plane CDP. Further, the distance d of the comment image plane CDP may be changed. In addition, the user can specify various decorations (colors, gradations), change the font, and set the name color to a color different from the background color. It is also possible to make it more prominent.

  As shown in FIG. 7B, there is a case where the building A exists in front of the building B and the display area DA12 of the building B is completely covered by the display area DA11 of the building A. In this case, since the B building is not visible in the landscape, it is preferable not to display the explanation of the B building. By doing so, it is possible to prevent the problem that the explanation of the invisible object (B building) is displayed.

  The commentary image (FIG. 6A) composed of the commentary arranged on the commentary image plane CDP is created by the commentary image creation unit 264 in each commentary image creation device 251 or 252. In step S5, the image composition unit 268 composes images by superimposing the commentary image on the input image, and the synthesized images are output to the projectors 121 and 122, respectively. As a result, an image with a comment on the landscape is projected and displayed on the projection screen 140. A passenger can enjoy a three-dimensional landscape with explanation by wearing polarized glasses and observing the projection screen 140.

  When the weather is bad, there are cases where the scenery cannot be enjoyed directly from the mobile object MB. For such a case, instead of images taken in real time by the cameras 111 and 112, a video acquired when moving along the same movement route in advance is stored as a landscape database (FIG. 2). It may be left. In this case, the input image receiving unit 262 of the commentary image creating apparatuses 251 and 252 acquires a landscape image corresponding to the position of the moving body MB at that time from the landscape database and projects it on the projectors 121 and 122. That is, the commentary image creating apparatuses 251 and 252 have a first mode for synthesizing the commentary with the video signals supplied in real time from the cameras 111 and 112 and a second mode for synthesizing the commentary with the previously acquired video. Have. By using such a second mode, it is possible to enjoy the video even when the weather is bad.

  As described above, in this embodiment, a stereoscopic image captured by two cameras is projected by a projector, and an explanation of an object included in the image is displayed at the same time. A stereoscopic image can be displayed in real time. In addition, since the geographical information of the object is obtained from the commentary database and the position on the commentary image plane is calculated, the object is detected at a higher speed than when the object is detected by pattern matching of the object. Can be determined.

B. Variation:
The present invention is not limited to the above-described examples and embodiments, and can be implemented in various modes without departing from the gist thereof. For example, the following modifications are possible.

B1. Modification 1:
In the above embodiment, a stereoscopic image is displayed using two cameras and two projectors. However, an image with explanation is displayed using only one camera and one projector. You may do it. At this time, the viewer can see the commentary image with the naked eye.

  In addition, when a stereoscopic image is projected and displayed using two projectors as in the above-described embodiment, the viewer uses polarized glasses composed of different polarizing plates for the left eye and the right eye, and the same polarizing plate on the left and right. If one of the constructed polarized glasses is selected, it is possible to view either a stereoscopic image with commentary or a planar image with commentary as desired.

B2. Modification 2:
As an explanation, various things other than the name of the object can be used. For example, you may make it display the various description (history etc.) regarding a target object.

B3. Modification 3:
In the above embodiment, all the explanations of the objects existing in the explanation image plane CDP are displayed. However, it is also possible to limit the objects for which explanations are to be displayed to those satisfying a predetermined condition. is there. For example, when the moving body MB follows a substantially determined route, only an object for which an explanation is to be displayed may be selected in advance from objects that can be seen on the route. Further, only the explanation of the object whose distance from the current position is a predetermined allowable value or less may be displayed. According to these configurations, it is possible to perform a process required for displaying the explanation at a higher speed.

B4. Modification 4:
In the above embodiment, a part of the configuration realized by hardware may be replaced with software, and conversely, a part of the configuration realized by software may be replaced by hardware.

It is explanatory drawing which shows the projector system as one Example of this invention. It is a block diagram which shows the structure of a projector system. It is explanatory drawing which shows the content of the description database. It is a block diagram which shows the structure of the description image production apparatus. It is a flowchart which shows the normal operation | movement of a projector system. It is explanatory drawing which shows the search method of the target object which exists in an image. It is explanatory drawing which shows a mode that the description was arrange | positioned on description image plane CDP.

Explanation of symbols

111, 112 ... Video camera 114 ... Imaging surface 116 ... Lens 121, 122 ... Projector 130 ... Landscape display control device 140 ... Projection screen 200 ... Operation panel 210 ... GPS device 220 ... Gyro 230 ... Direction sensor 240 ... Database access unit 242 ... Databases 251, 252... Explanation image creation device 262... Input image reception unit 264. Explanation image creation part 268.

Claims (8)

A projector system,
A first projector and a second projector for projecting the first and second image lights, which are polarized lights having polarization directions orthogonal to each other and representing images related to the same photographing object, on the same projection plane; ,
First and second image data generating units for generating first and second image data for generating the first and second image lights and supplying the first and second image data to the first and second projectors;
With
The first and second image data creating units include the first and second image data so as to include commentary images for displaying a commentary of a predetermined object included in the photographing object in the vicinity of the object, respectively. A projector system that creates image data. The projector system according to claim 1, further comprising:
First and second cameras for photographing the same subject and generating first and second photographing signals;
A database access unit for accessing a database pre-stored with explanations about a plurality of objects;
With
The first and second image data creation units create the first and second image data by superimposing a comment obtained from the database on an image represented by the first and second imaging signals. A projector system. The projector system according to claim 2, further comprising:
A coordinate detector for detecting geographical coordinates of the projector system;
An azimuth detecting unit for detecting the shooting azimuths of the first and second cameras;
With
The database has coordinate information regarding geographical coordinates of the plurality of objects,
The first and second image data creation units are included in the shooting target with reference to the database using the geographical coordinates detected by the coordinate detection unit and the shooting direction detected by the direction detection unit. A projector system that searches for an object to be searched and obtains an explanation for the searched object. The projector system according to claim 3, wherein
The database has size information related to the sizes of the plurality of objects, and the first and second image data creation units obtain the sizes of the objects included in the photographing object with reference to the database. And
The projector system in which the first and second image data creation units determine the display position of the comment according to the geographical coordinates and size of the object. The projector system according to claim 3, wherein
The projector system is mounted on a moving body that operates along a predetermined operation route,
The database stores in advance landscape data along the operation route,
The first and second image data creation units use the landscape data acquired from the database instead of the first and second imaging signals supplied from the first and second cameras. A projector system having a mode for creating first and second image data. The projector system according to claim 3, wherein
The projector system in which the first and second image data creation units move the display position of the explanation of the object in accordance with a user's designation. The projector system according to any one of claims 2 to 6,
The first and second image data creation units include explanations about objects satisfying a predetermined condition among the objects included in the photographing object in the first and second image data. And a projector system that creates the first and second image data so that a description of an object that does not satisfy the predetermined condition is not included in the first and second image data. An image using a projector system including first and second projectors for projecting first and second image lights, which are linearly polarized light having polarization directions orthogonal to each other, on the same projection plane. Is a method of displaying
(A) creating first and second image data respectively representing images relating to the same photographing object;
(B) supplying the first and second image data to the first and second projectors to project the first and second image lights;
With
The step (a) includes generating the first and second image data so as to include commentary images for displaying a commentary of a predetermined object included in the photographing object in the vicinity of the object. An image display method including:

Images