JP4701149B2 - Image processing device - Google Patents

Description

The present invention relates to a document that can be viewed stereoscopically in a system that does not have a binocular stereoscopic display function (in this specification, the “document” is not limited to a text description only, and refers to a document that includes images widely). It relates to an image processing equipment that allows the creation of a thing).

  Conventionally, as one of the three-dimensional image display methods capable of binocular stereoscopic viewing, the left and right binocular images made up of images from different viewpoint positions are separately presented to the left and right eyes of the observer, so that both eyes There is a method in which parallax is given to enable stereoscopic observation. Further, for example, Patent Document 1 discloses a method for editing such an image.

  By the way, a great advantage of stereoscopic display by binocular stereoscopic vision is that the sensation given to the observer is very large. A presentation using binocular stereoscopic display will be able to take full advantage of this advantage.

  However, in creating a binocular stereoscopic document, it is necessary to use a system having a special binocular stereoscopic display function in order to confirm the effect. As such a display method, various methods are known as described below.

Anaglyph method: A method in which images for left and right eyes each composed of different shades of one color are presented, and an observer wears spectacles composed of two color filters corresponding to the left and right eyes for observation.
Polarization method: A method in which the polarization state of the display image for the left and right eyes is made different in advance, and corresponding polarized glasses are worn for observation.
・ Liquid Crystal Shutter Method: Using interlace of a CRT (Cathode-ray Tube) monitor, images for the left and right eyes are presented over time in separate fields, and observed by wearing liquid crystal shutter glasses synchronized with the field frequency. method.
Lenticular lens array method: Separates images for the left and right eyes into strips, separates the alternately arranged images using a corresponding lenticular lens array, and observes without special glasses (see Fig. 14) And later).
Parallax barrier method: A method of observing without eyeglasses by separately displaying images for the left and right eyes that are separated into strips and arranged alternately like the above lenticular lens array method using a corresponding parallax barrier (see FIG. 15) And later).
JP-A-9-172654

  However, all of the above methods still require a special display device for presenting and observing images respectively corresponding to the left and right eyes, and such a system is a normal display device. There is a problem that the current situation is that it is more expensive than a general user and cannot be easily used by general users.

  In view of this point, in the present invention, in a system that does not have the above-described special display device such as a normal CRT or a liquid crystal monitor and does not have a binocular stereoscopic display function, The purpose is to enable creation.

To achieve the above object, the present invention relates to an image viewer to create both eyes when stereoscopic Ri Do from at least one or more objects, the images data that can the be perceived by a viewer on an image display surface on a creation unit, through the observation position at the time of binocular stereopsis image observation, a first display means for displaying each object at the time of binocular stereopsis image observation as the projection against a plane parallel to the image display surface, the two Second display means for displaying each object at the time of binocular stereoscopic image observation as a projection on an overhead view plane substantially orthogonal to the image display surface at the time of eye stereoscopic image observation, and image display at the time of binocular stereoscopic image observation it is a plane substantially perpendicular to the plane, and a third display means for displaying the object at the time of binocular stereopsis observed as projection onto the plane view the entire observation system from the side, constituting the front Kiga image data It said each object You and generating a distance of a desired apparent by operation by the viewer.

  According to the present invention, it is possible to create a document that allows binocular stereoscopic viewing in a system that does not have a binocular stereoscopic display function.

Hereinafter, the principle of establishment of binocular stereoscopic vision will be described with reference to the drawings, and then a preferred embodiment of the present invention will be described with reference to the drawings.
First, the principle of establishing binocular stereoscopic vision will be described with reference to FIGS.

  FIG. 3 is an example of an image 201 presented to the left eye. For simplification, only the screen 200 and a circle (circle passing through AL and BL) observed at different depth positions with respect to the screen 200 are illustrated. 3A is a view of the image display surface viewed from the front, and FIG. 3B is a view of FIG. 3A viewed from directly above.

  Similarly, FIG. 4 is an example of an image 202 presented to the right eye. For the sake of simplification, the screen 200 and a circle (circle passing through AR and BR) observed at different depth positions with respect to the screen 200 are illustrated. 4A is a diagram of the image display surface viewed from the front, and FIG. 4B is a diagram of FIG. 4A viewed from directly above.

  Then, as shown in FIG. 5, by presenting these images (image 201 and image 202) to the left and right eyes independently, AR and BR are presented to the right eye 204, and AL and BL are presented only to the left eye 203. Therefore, binocular stereoscopic vision is established, and an apparent image is observed at a position indicated by AB (apparent position).

  Here, in FIG. 5, FIG. 5A is a view of the image (image 201, image 202) actually presented, as viewed from the front, and FIG. 5B is the view of FIG. 5A. It is the figure which looked at the mode at the time of observing the binocular stereoscopic vision image presented from above.

  Now, in order to actually observe the binocular stereoscopic image, the images for the left and right eyes must be presented to different eyes.

  As a generally used method, for example, a method in which an observer wears spectacles (polarized spectacles) that presents images for left and right eyes with different polarized lights and transmits only the corresponding polarized light. There is.

  Further, as shown in FIG. 14, the images for the left and right eyes are each divided into strips in the vertical direction, and the divided strip regions are alternately arranged, via an optical system such as a lenticular lens array 205. There is a method of observing.

  Further, as shown in FIG. 15, the images for the left and right eyes are divided into strips in the vertical direction, and the divided strip regions are alternately arranged, and a parallax barrier (parallax barrier) 206 is used. There is a method of obscuring a part of the visual field and observing through an aperture (slit) 207.

  However, in a system that does not have the binocular stereoscopic display function as shown in FIG. 14 or FIG. 15, it is difficult to observe the image perceived at the position AB in FIG.

  The system to which the present invention can be applied is the system as described above. Therefore, as will be described later, in the embodiment of the present invention, each object at the time of binocular stereoscopic observation is projected as a projection on a plane that passes through the observation position at the time of binocular stereoscopic image observation shown in FIG. 7 and is parallel to the image display surface. A front display window 302 to be displayed, and an overhead view display window 303 for displaying each object at the time of binocular stereoscopic image observation as a projection with respect to the overhead view plane substantially orthogonal to the image display surface at the time of binocular stereoscopic image observation shown in FIG. Have.

In FIG. 5B, if the observation distance: d is known, the apparent distance of point A (relative position with respect to the display surface) is the distance between the line segment ARAL: a and the distance between the left and right eyes LR. : B and given by db / (a + b). The present invention is the creation of a technical idea utilizing the laws of nature.
Next, a preferred embodiment of the present invention will be described.

  FIG. 1 is a block diagram illustrating a schematic configuration of a document creation system 100 which is an example of an image processing apparatus according to the present embodiment. FIG. 2 is a flowchart showing the operation of the document creation system 100.

  In FIG. 1, a document creation system 100 includes a CPU 101, a ROM 102, a RAM 103, an I / O controller 105, and a VRAM 107 controlled by the I / O controller 105, such as a CRT or a liquid crystal monitor, connected to each other by a bus 104. And a means 108 and an input means 106 (for example, comprising a keyboard, a pointing device, etc.) controlled by the I / O controller 105.

  The document creation system 100 has the configuration shown in FIG. 1 as described above, and performs the operation shown in FIG. In the following description of the operation, display examples of the display means 108 are shown in FIGS.

  In FIG. 2, first, a front display window 302 and an overhead view window 303 are generated on the VRAM 107 via the I / O controller 105 and displayed separately on the display means 108 such as a CRT or a liquid crystal monitor (step). S201 and step S202).

  Here, the system 100 receives a user event by the pointing device via the I / O controller 105 (step S203). At this time, the user transmits an instruction via, for example, a pull-down menu or an instruction button displayed on the screen.

If the user's instruction is to create a new object (step S207 / Yes), an object editing window 300 shown in FIG. 6 is displayed (step S208), and the object is observed from the front by a user event such as pointer movement or key input. The drawn object 400 is drawn (step S209).
In the object editing window 300, the apparent object 400 at the time of binocular stereoscopic observation is edited and drawn as a projection on a plane parallel to the image display surface through the observation position at the time of binocular stereoscopic observation (step S210). ).

  At this time, the attribute input window 301 is also displayed at the same time, and the user uses this attribute input window 301 to input the apparent distance during binocular stereoscopic observation of the object 400 together with the RGB values of the color of the object 400.

  When the size and the observation position viewed from the front of the object 400 are determined, the document creation system 100 observes all the objects if there are objects created before this, and the observation of the current object during binocular stereoscopic observation if there are none. Projection to the plane parallel to the image display surface passing through the position is displayed on the front display window 302. Similarly, when there is an object created before this, all objects are observed, and if there is a binocular stereoscopic image of the current object, A projection of the bird's-eye view plane with respect to the image display surface is drawn on the bird's-eye view display window 303 (steps S210 and S211).

Details regarding the display (drawing) will be described below.
Here, the width of the image is W, the horizontal distance from the left end of the image at the intersection of the perpendicular drawn from the left eye to the image display surface and the image display surface is l (el) [cm], and the point A in FIG. Assuming that the horizontal distance from the left edge of the image in the front display image is x [cm], the apparent distance at which point A is observed is z [cm], and the observation distance from the image display surface is d [cm], point A The distance from the left edge of the image for the left eye of
l + (xl) × d / z [cm]
Given in.

Similarly, the distance from the left edge of the image for the right eye at point A is
r + (x−r) × d / z [cm]
Given in. Here, r is the horizontal distance from the left end of the image at the intersection of the perpendicular drawn from the right eye to the image display surface and the image display surface.

  For the sake of simplicity, it is assumed that the observation position is on a perpendicular to the center position of the screen, and l and r can be determined by using an average human interocular distance of 6.5 [cm]. . It should be noted that a separate window for prompting the user to input coordinates in the image displayed at the intersection of the perpendicular drawn from the observation position (the center position of the left and right eyes) to the image display surface and the image display surface is displayed and input here. A value may be used.

Each position of the display image in pixel units is obtained from the resolution of the display device and the screen size. The horizontal length of the image is determined from the screen size S and the aspect ratio (a: b).
S × 2.54 × cos (arctan (b / a)) [cm]
The vertical length is also given by
S x 2.54 x sin (arctan (b / a)) [cm]
Given in.

If the number of pixels in the vertical and horizontal directions is m and n, respectively, the number of pixels per 1 cm in the vertical direction of the screen is
m / (S × 2.54 × sin (arctan (b / a)) [cm]
The number of pixels per 1cm in the horizontal direction of the screen is
n / (S × 2.54 × sin (arctan (b / a)) [cm]
Given in.

  Based on this, the CPU 101 calculates the position of the object for the left eye and the right eye, and secures a memory area corresponding to the image area for the left eye and the right eye in the RAM 103. Draw an eye object.

  This is the end of the detailed description regarding the above display (drawing). Hereinafter, the description will be continued by returning to the flowchart of FIG.

Next, it waits for a user event by the input means 106 such as a pointing device or a key input again via the I / O controller 105 (step S203).
If the event is “end”, the execution of the system is ended (step S204 / Yes).
If the event is “save”, all objects in the memory are saved as files (step S205 / Yes, step S212).

If the event is “export” (step S206 / Yes), the left-eye object and the right-eye object are integrated into one image, and the left-eye image and the right-eye image are each in a separate file. (Step S213).
At this time, it is only necessary to overwrite the memory in order from the object with the longest distance to be observed, and store it when all the objects have been processed.

  With the above configuration, even in systems that do not have binocular stereoscopic display function, it is easy to grasp and set the apparent positional relationship in the three-dimensional space when observing each object, and binocular stereoscopic viewing is possible It is possible to create a simple document.

Moreover, this invention can also be implemented as follows.
In the above embodiment, two windows corresponding to two different projection planes that are substantially orthogonal to the image display surface during binocular stereoscopic image observation are provided.

  This includes, for example, a front display window 302 that displays each object at the time of binocular stereoscopic image observation as a projection onto a plane that passes through the observation position at the time of binocular stereoscopic image observation shown in FIG. In addition to the overhead view display window 303 for displaying each object at the time of binocular stereoscopic image observation as a projection on the overhead view plane substantially orthogonal to the image display surface at the time of binocular stereoscopic image observation shown in FIG. This is a configuration having a side display window for displaying each object at the time of binocular stereoscopic observation as a projection onto a plane that is a plane substantially orthogonal to the image display surface at the time of stereoscopic image observation and viewing the entire observation system from the side.

  With the above-described configuration, it is easier to grasp and set the apparent positional relationship in the three-dimensional space when observing each object in a system that does not have a binocular stereoscopic display function. A visible document can be easily created.

Moreover, this invention can also be implemented as follows.
In any of the above-described embodiments, the apparent distance is displayed for each object during binocular stereoscopic image observation.
Note that all the objects may be displayed all at once.

  For example, as shown in FIGS. 10, 11, and 12, when viewing a binocular stereoscopic image set for each object in each of the front display window 302, the overhead view display window 303, and the side display window 304. The apparent distance is displayed.

  Alternatively, for example, as shown in FIG. 13 as a modification, for example, when a click on the object A 401 by the pointer 403 is detected, the apparent distance of the object A 401 is displayed by a pop-up window 404.

  With the above-described configuration, it is easier to grasp and set the apparent positional relationship in the three-dimensional space when observing each object in a system that does not have a binocular stereoscopic display function. A visible document can be easily created.

Moreover, this invention can also be implemented as follows.
Each function constituting the embodiment described above is programmed, written in advance in a recording medium such as a ROM, and this ROM is mounted on an image processing apparatus (including a document creation system), and a microprocessor mounted on the image processing apparatus By executing the program in the ROM, the object of the present invention can be achieved.

  In addition, as a recording medium, a semiconductor medium (for example, ROM, a non-volatile memory card, etc.), an optical medium (for example, DVD, MO, MD, CD-R, etc.), a magnetic medium (for example, magnetic tape, a flexible disk, etc.) Either may be sufficient.

  In addition, the case where the operating system or the like performs part or all of the actual processing based on the instruction of the loaded program and the functions of the above-described embodiments are realized by the processing is also included.

  Further, when the above-mentioned program is stored in a storage device such as an HDD of a server computer and is downloaded and distributed from a user's computer connected via a network, or distributed and distributed from a server computer, The storage device of the server computer is also included in the recording medium according to the embodiment of the present invention.

  In this way, by programming the function of the present invention, recording it on a recording medium and distributing it, it is possible to improve cost, portability and versatility.

1 is a block diagram showing a schematic configuration of a document creation system according to an embodiment of the present invention. It is a flowchart figure which shows operation | movement of the document preparation system which concerns on embodiment of this invention. It is a figure which shows one display example of the image which this embodiment presents to an observer's left eye, (a) is the figure which looked at the image from the front, (b) is the figure which looked at the image from right above. It is a figure which shows one display example of the image which this embodiment presents to an observer's right eye, (a) is the figure which looked at the image from the front, (b) is the figure which looked at the image from right above. It is a figure which shows the example of a display of the image which this embodiment shows independently to an observer's right and left eyes, (a) is the figure which looked at the image from the front, (b) is right above the image and the observer It is the figure seen from. It is a figure which shows the example of a display of the display means of this embodiment, and is a figure which shows the object edit window and the attribute input window. It is a figure which shows the example of a display of the display means of this embodiment, and is a figure which shows the front display window. It is a figure which shows the example of a display of the display means 108 of this embodiment, and is a figure which shows the bird's-eye view display window 303. FIG. It is a figure which shows the example of a display of the display means of this embodiment, and is a figure which shows the side surface display window. It is a figure which shows the example of a display of the display means of this embodiment, and is a figure which shows the front display window. It is a figure which shows the example of a display of the display means 108 of this embodiment, and is a figure which shows the bird's-eye view display window 303. FIG. It is a figure which shows the example of a display of the display means of this embodiment, and is a figure which shows the side surface display window. It is a figure which shows the example of a display of the display means of this embodiment, and is a figure which shows the front display window. (A) is a figure for demonstrating the method of implement | achieving binocular stereoscopic vision using a lenticular lens array of a prior art, (b) is an external appearance perspective view of a lenticular lens array. It is a figure for demonstrating the method of implement | achieving binocular stereoscopic vision using a parallax barrier of a prior art.

Explanation of symbols

100 document creation system 101 CPU
102 ROM
103 RAM
104 bus 105 I / O controller 106 input means 107 VRAM
108 display means 200 screen 201 image 202 image 203 left eye 204 right eye 205 lenticular lens (lenticular lens array)
206 Parallax barrier (Parallax barrier)
207 Aperture (slit)
300 Object Edit Window 301 Attribute Input Window 302 Front Display Window 303 Overhead Display Window 304 Side Display Window 400 Object 401 Object A
402 Object B
403 Pointer 404 Pop-up window

Claims (2)

When observer binocular stereopsis and image forming means for forming Ri Do from at least one or more objects, the images data that can the be perceived by a viewer on an image display surface,
First display means for displaying each object at the time of binocular stereoscopic image observation as a projection on a plane parallel to the image display surface through an observation position at the time of binocular stereoscopic image observation ;
Second display means for displaying each object at the time of binocular stereoscopic image observation as a projection on an overhead view plane substantially orthogonal to the image display surface at the time of binocular stereoscopic image observation ;
Third display means for displaying each object at the time of binocular stereoscopic observation as a projection onto a plane that is substantially orthogonal to the image display surface at the time of binocular stereoscopic image observation, and viewing the entire observation system from the side. Have
Image processing apparatus and generates the distance of the desired apparent by operation by the viewer each object constituting the front Kiga image data. The image processing apparatus according to claim 1, wherein the first and second display units display the apparent distance for each object during binocular stereoscopic observation .

Images