JP2001148851A - Image display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve a problem of a conventional image display device that cannot display a real synthesis image because the conventional image display device simply synthesizes a photographed image picked up on the spot with a preset synthesis survey image and displays the synthesis image. SOLUTION: The image display device is provided with a CCD camera 3, an azimuth detection means 4 that outputs a signal to obtain a synthesis use image in matching with an image pickup direction of the CCD camera 3 to a computer 5 storing in advance the synthesis image, and a display section 2 that displays the synthesis image resulting from synthesizing the image picked up by the CCD camera with the synthesis image obtained on the basis of the signal from the azimuth detection means.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to an image display device for displaying a composite image.

[0002]

2. Description of the Related Art JP-B-6-100029, JP-A-9-16070, JP-A-9-244522, JP-A-8-63089, and JP-A-8-1900
In No. 4 Gazette, before the start of construction, before the completion of construction, or on sale,
A device for simulating the view from the opening of a building in a room is disclosed.

[0003]

However, in any of the above apparatuses, a captured image picked up on the spot and a preset view image for synthesis are simply synthesized and displayed. Could not be displayed.

[0004]

According to the present invention, there is provided an image display apparatus comprising: an image pickup means; and a signal for obtaining an image for synthesis adapted to the image pickup direction of the image pickup means, the image for synthesis being stored in advance. And a display unit that displays a combined image obtained by combining an image captured by the image capturing unit and an image for combination obtained based on a signal from the azimuth detecting unit. And was provided. With the above configuration, a realistic synthesized image in which the image for synthesis moves with a change in the direction of the imaging unit is displayed.

[0005]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiment 1 Embodiment 1 of the present invention will be described with reference to FIGS. FIG. 1 is a top view of the image display device according to the first embodiment, and FIG. 2 is a configuration diagram showing a view simulation experience device using the image display device. In each of the drawings, reference numeral 1 denotes a binocular small display device as an image display device according to the first embodiment. The display device 1 is used by the user X while holding it by hand so that the display unit 2 constituted by, for example, a color liquid crystal display device is maintained at the position of the eyes. The display device 1 includes the display unit 2, a CCD camera 3 as an imaging unit, an azimuth detecting unit 4 for detecting an imaging direction of the CCD camera 3 (treated as a line of sight of the user X), and an image captured by the CCD camera 3. Menu selection switch 6 for selecting a view image to be synthesized with the captured image, position detection means 7 for detecting the position of the CCD camera 3 (treated as the position of the eyes of the user X), and control means to be described later. Dedicated connector 8 for connecting to the computer 5 of the present invention, a holding unit 9, a speaker 10 for outputting a sound corresponding to the content displayed on the display unit 2, and the experience X is disturbed by the surrounding brightness. A visor 11 for blocking light so that a screen displayed on the display unit 2 can be viewed without a strap, and a strap for allowing the display device 1 to be hung on the neck.
2 is provided. The dedicated connector 8 is provided on the lower surface of the display device 1.

[0006] The CCD camera 3 captures an image of the front of the display device 1 in real time when the display device 1 is used. The azimuth detecting means 4 detects, as a roll angle, an angle at which the head of the user X tilts left and right around the neck as a roll angle, and detects an elevation angle at which the head of the user X tilts up and down about the neck as a pitch angle. Then, three angles are detected as azimuth angles at which the head of the user X rotates right and left around the neck as an azimuth angle. For example, the vibration gyro and three angle sensors are used. You. The angle signal from the azimuth detecting means 4 is converted into an azimuth signal (digital signal) by a controller (not shown) and sent to the computer 5. The position detector 7 outputs a position signal to the computer 5 for detecting the position of the CCD 3 to be treated as the position of the eyes of the experienced person X, and is composed of, for example, a magnetic sensor, a coma gyro, and the like. Also, the grip 9
Are provided on both sides of the display device 1. The holding unit 9 is provided so that the display unit 2 of the display device 1 can be maintained for a long time with the display unit 2 facing the eyes, and is slightly thinner than other parts so that the user X can easily hold the display unit 2. In order to facilitate the positioning of each finger, a small elongated recess 9a corresponding to each finger is formed. The grip 9 may be configured by providing a grip or forming a hole or the like. In short, anything that makes the display device 1 easy to hold by hand may be used.

Next, an apparatus for simulating a view using the display device 1 will be described with reference to FIG. First, various view images captured in advance are stored in advance in the respective storage areas 14 in the storage device 14A of the computer 5.
As the various view images, for example, a plurality of panoramic view images or the like that are imaged before the start of construction or before the completion of the building, or for each layer or group of layers of the building being sold, or the like are stored in advance. By operating the menu selection switch 6 of the display device 1 and reading out the view image 15 corresponding to the layer to which the room 13 desired by the experience person X belongs from the storage device 14A,
The computer 5 creates a plane image in which the plane is corrected in real time around the image vertex 16 from the view image 15 based on the azimuth signal based on the angle signal from the azimuth detecting means 4. This planar image is converted by the down converter 18 into data compatible with VGA or NTSC.
The image synthesizing device 19 treats colors in a range specified by a video signal corresponding to a color mask for synthesis, which will be described later, input from the CCD camera 3 as transparent, and synthesizes the data of the planar image on the transparent portion. . In this synthesis process,
8-bit quantized digital processing is used. That is, C
Image data corresponding to the blue portion of the color mask for synthesis in the image captured by the CD camera 3 is synthesized by digital processing in place of the plane image data, and the synthesized image data is output. A composite image based on the composite image data is displayed on the display unit 2. In addition, CC
Image information captured by the D camera 3 is converted into a video signal by the image signal signal converter 17 and sent to the image synthesizing device 19. The display unit 2 is controlled by the display controller 20.

The room 13 as a simulation experience room is, for example, a room in a building. 21 is a floor of the room 13, 22 is a partition between the rooms 13, and 23 is a wall that separates the outside and the inside of the room 13. Reference numeral 24 denotes a window as an opening, which corresponds to a window for simulating a view. 25 is a window frame, 26
Is a crosspiece inside the window frame 25. Reference numeral 27 denotes a synthetic coloring mask that covers the transparent region of the window. When the transparent region is covered with a window glass, the mask is formed by coloring the window glass or applying a colored sheet from the outside of the wall 23. .
The window 24, the window frame 25, the crosspiece 26, and the sheet on which the colored portion is drawn are attached to the inside of the wall 23 as the synthesis coloring mask 27, so that the window 24, the window frame 25, A practical opening element such as 26 may be omitted. If the color of the color mask 27 for synthesis is a blue color that is relatively rarely used in the actual living space, the color of the color mask 27 for synthesis and the other parts are used when synthesizing the image for the simulated experience. Ideal for proper identification by color.
In FIG. 2, the coloring mask 27 for synthesis is indicated by oblique lines to distinguish it from other portions.

Next, the operation of the above-mentioned view simulating experience apparatus will be described. First, the apparatus is started up, and a calibration operation is performed to match the direction of the direction detecting means 4 in one direction with the image vertex in one direction viewed from the image origin 16. Thereafter, when the user X selects the desired view image 15 with the selection switch 6, the display unit 2 displays an image in which the captured image captured by the CCD camera 3 and the plane image of the view are combined. . At this time, when combining the actual captured image that matches the viewing direction of the user X and the plane image selected as the view image 15 that matches the viewing direction by the control unit 5, as shown in FIG. The view image 15 corresponding to the window frame 25, its periphery, and the crosspiece 26, which is a part different from the color designated by the synthetic coloring mask 27 therein, is erased, and the view image 15 is displayed in the color designated by the synthetic coloring mask 27. Will be displayed.

[0010] The view image 15 is the room 1 of the user X.
The third window 24 changes in response to a change in the viewing direction. That is, as shown in FIG. 3, in the horizontal direction, the direction of the azimuth detecting means 4 coincides with the image vertex P1 in one direction viewed from the image origin 16 of the view image 15 as shown by an arrow X1. If there is, the control means 5 sets the image origin 16
A portion surrounded by two straight lines L1 and L2 connecting the points A and B is cut out from the view image 15, and a combined image of the view image 15 and the image of the CCD camera 3 is displayed on the display unit 2. Is done. In this state, the direction of the azimuth detecting means 4 is changed to the arrow X by the experience person X turning his / her head to the left.
If it moves from 1 to the arrow X2, the control means 5 cuts out a portion surrounded by two straight lines L3 and L4 connecting the image origin 16 and the points C and D from the view image 15, and An image synthesized with the image of the CCD camera 3 is displayed on the display unit 2. That is, if the user X leans his head to the left, the portion cut out from the view image 15 is displayed on the display unit 2.
It changes by the same angle to the screen of. According to the same principle in the vertical direction, if the user X turns his or her head up and down, the portion cut out from the view image 15 moves by the same angle in the same direction with respect to the screen of the display unit 2. Further, for example, when the user X moves to the window 24 side from the state where the image synthesized as shown in FIG. 4A is displayed on the screen of the display unit 2, as shown in FIG. Since the size of the window 24 occupied in the image captured by the CCD camera 3 increases, the portion of the view image 15 that can be seen through the window 24 eventually expands. Since such a combined image is displayed on the display unit 2, the range of the view seen by the experienced person X is widened. As a result, the user X can have a simulated experience with a sense of reality and three-dimensionality that is close to what is actually seen from the window 24 of a certain room 13 before the start of construction, before completion, or on the desired floor of the building being sold.

Therefore, the room 1 of the hierarchy desired by the experience person X
The display unit 2 displays a realistic view image that is 3 and simulates an actual view looking out from a predetermined position in the room 13.

According to the first embodiment, it is possible to combine an image picked up by the CCD camera 3 and an image for combination according to the direction of the CCD camera 3, and the image is combined with the change in the direction of the CCD camera 3. Thus, a display device 1 that can display a synthesized image in which the image for synthesis moves can be obtained. Further, the provision of the grip 9 makes it easier to maintain the display device 1 for a long time with the display 2 facing the eyes. In addition, since the grip unit 9 is provided, there is no need to hold the display device 1 on the body such as the head and the face, and the feeling of oppression can be reduced. Further, portability and detachability of the display device 1 can be improved. Further, since the selection switch 6 is provided, a desired image for synthesis can be easily selected, and a desired synthesized image can be quickly displayed.

In the above description, a case has been described in which an image obtained by synthesizing a view image of a building is displayed.
If, for example, program software for the game is stored, the image of the game can be captured in the captured image of the actual room 13, and the display device 1 can also display such a composite image. It is also possible to store scenery images of festivals and attractions in various places in the storage means 14 and to take such images into an actual captured image of the room 13. It is also possible to display a composite image.

Since the position detecting means 7 is provided, a position signal for detecting the position of the user X is sent from the position detecting means 7 to the computer 5, so that the above-mentioned view image or the like can be obtained based on the position signal. By sliding, enlarging, or reducing the game image or the landscape image, the position of the viewpoint moves in the horizontal, vertical, and depth directions, so that a synthesized image with reality can be displayed.

Further, since the speaker 10 is provided, the sound of the scene of the view image and the image to be synthesized (view image, game image,
BGM, narration, environmental sound, etc. according to the scenery image) can be output, and a more realistic feeling can be obtained.
In addition, the sound output allows the user to be isolated from the outside and feel immersive. In addition, since the narration can be heard while visually confirming, it is easy to understand the description of the above-described view image, game image, and landscape image.

In the above description, the binocular small display device 1 having the grip 9 has been described as an example of the image display device. However, the image display device of the present application is an FMD mounted on the face.
(Face mount display) or H attached to the head
It is also possible to apply to MD (head mounted display). Further, the image display device may be configured by integrating the small display device 1 (or FMD or HMD) described above with the computer 5.

[0017]

As described above, according to the present invention, it is possible to combine a picked-up image picked up by the image pickup means and an image for combination in accordance with the direction of the image pickup means, and it is possible to change the direction of the image pickup means. As a result, an image display device capable of displaying a synthesized image in which the image for synthesis moves can be obtained. In addition, since the grip portion is provided, the image display device can be easily maintained for a long time with the display portion facing the eyes, and it is not necessary to hold the image display device on the body such as the head and the face. The feeling of oppression can be reduced. Further, portability and detachability of the image display device can be improved. Further, since the selecting means is provided, a desired image for combination can be easily selected, and a desired combined image can be displayed quickly. Further, since the position detecting means is provided, a composite image having a sense of perspective can be displayed.

[Brief description of the drawings]

FIG. 1 is a plan view of an image display device according to a first embodiment of the present invention.

FIG. 2 is a schematic configuration diagram of a view pseudo experience device using the image display device according to the first embodiment of the present invention.

FIG. 3 is a schematic diagram of cutting out a line of sight from a view image.

FIG. 4 is a schematic diagram illustrating a change in a virtual reality image.

[Explanation of symbols]

1 binocular small display device (image display device), 2 display section, 3 CCD camera (imaging means), 4 direction detection means, 5 computer (control means), 6 selection switch (selection means), 7 position detection means, 9 Gripping part.

Claims (4)

[Claims] 1. An image pickup means, an azimuth detecting means for outputting a signal for obtaining an image for combination in accordance with an image pickup direction of the image pickup means to a control means which stores in advance an image for combination, An image display device comprising: a display unit that displays a composite image in which an image captured by an image capturing unit and an image for combination obtained based on a signal from the azimuth detecting unit are combined. 2. The image display device according to claim 1, wherein grip portions are provided on both sides. 3. The image processing apparatus according to claim 1, further comprising a selection unit that outputs a selection signal for selecting a desired image for combination desired to be combined with the image captured by the imaging unit to the control unit. Or the image display device according to claim 2. 4. The image display according to claim 1, further comprising a position detection unit that outputs a signal for detecting a position of the imaging unit to the control unit. apparatus.