JP2001352563A - Stereoscopic image display device and data file for stereoscopic display - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily change the display forms of the position and attitude, etc., of stereoscopic images in a stereoscopic image display device. SOLUTION: A data storage part 67a stores this data file DF for stereoscopic display of a data structure provided with element position data DD for each fine element of a display object in a prescribed coordinate system, display position data DL for indicating the position of the stereoscopic image in a display coordinate system defined within the display space of the stereoscopic image and display attitude data DΦ for indicating the posture of the stereoscopic image in the display coordinate system. Then, in the case that the stereoscopic image is edited from a system controller 64, a data correction part 67b corrects one of the element position data DD, the display position data DL and the display attitude data DΦ corresponding to the editing contents. A cross sectional image generation part 67c generates a cross sectional image based on the corrected data file DF for the stereoscopic display and performs the stereoscopic display.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a three-dimensional image display device for displaying a three-dimensional image and a three-dimensional display data file.

[0002]

2. Description of the Related Art Conventionally, as a stereoscopic image display device for displaying a stereoscopic image, there is one disclosed in Japanese Patent Application Laid-Open No. 2000-78616. This stereoscopic image display device intermittently projects a cross-sectional image of an object on a rapidly rotating screen, thereby generating an afterimage effect and visually recognizing the envelope of the cross-sectional image. Is displayed.

[0003]

However, in the conventional three-dimensional image display device, the position and orientation of the three-dimensional image displayed in the rotation space of the screen cannot be easily changed.

Accordingly, the present invention has been made in view of the above problems, and has as its object to provide a three-dimensional image display device capable of easily changing the display form such as the position and orientation of a three-dimensional image. And

[0005]

In order to achieve the above object, according to the first aspect of the present invention, a plurality of sectional images constituting a stereoscopic image are intermittently projected on a screen moving in a predetermined direction. A stereoscopic image display device that displays the stereoscopic image of the display object, wherein element position data for each microelement constituting the display object in a predetermined coordinate system, and the stereoscopic image by the screen A display position data indicating a position of the stereoscopic image in a display coordinate system defined in a display space of the display space, and a display posture data indicating a posture of the stereoscopic image in the display coordinate system. Storage means for storing a data file, and projection at each position when the screen moves in the display space based on the stereoscopic display data file. And a cross-sectional image generation means for generating a plurality of cross-sectional images to, in synchronization with movement of the screen, and a means for projecting relative intermittently said screen a plurality of cross-sectional images.

According to a second aspect of the present invention, in the three-dimensional image display device according to the first aspect, an operation input means for editing and operating the three-dimensional image is provided based on input information from the operation input means. Data correction means for correcting at least one of the element position data, the display position data, and the display attitude data is further provided.

According to a third aspect of the present invention, in the three-dimensional image display device according to the first or second aspect, the storage means stores a plurality of three-dimensional display data files relating to a plurality of display objects. Wherein the cross-sectional image generating means generates the cross-sectional image in a state where the contents of each of the plurality of stereoscopic display data files are superimposed so that the plurality of stereoscopic images are displayed in the display space. It is characterized by doing.

According to a fourth aspect of the present invention, there is provided a data file used for displaying a three-dimensional image by intermittently projecting a plurality of cross-sectional images constituting the three-dimensional image onto a screen, Element position data for each minute element constituting the display object in a predetermined coordinate system, and display position data indicating a position of the stereoscopic image in a display coordinate system defined in a display space of the stereoscopic image on the screen And a display structure including display posture data indicating the posture of the stereoscopic image in the display coordinate system.

[0009]

Embodiments of the present invention will be described below in detail with reference to the drawings.

<1. Overall System Configuration> As an embodiment of a stereoscopic image display system according to the present invention, the overall configuration of a stereoscopic image display system 1 is shown in FIG. The three-dimensional image display system 1 includes a three-dimensional image display device 100 that performs three-dimensional display of a display target by a volume scanning method, and a host computer 3 that supplies a three-dimensional display data file relating to the display target to the three-dimensional image display device 100. It is composed of

The stereoscopic image display device 100 generates an afterimage effect by intermittently projecting a cross-sectional image of a display object on a screen that rotates at a high speed about a predetermined rotation axis, as described later. Display an image. Then, by updating the cross-sectional image to be projected according to the position (angle) of the rotating screen, three-dimensional images of various display objects are displayed.

The host computer 3 is a so-called general computer system including a CPU 3a, a display 3b, a keyboard 3c, and a mouse 3d. The host computer 3 is preliminarily input with a data file for stereoscopic display of a display object, and is configured to supply the data file for stereoscopic display to the stereoscopic image display device 100.

Between the host computer 3 and the three-dimensional image display device 100, a three-dimensional display data file can be transferred online, and the three-dimensional display data file can be transferred offline via a portable recording medium 4. Delivery is also possible. Recording media 4
Examples include magneto-optical discs (MO), compact discs (CD-RW), and digital video discs (DVD
-RAM), a memory card, and the like.

<2. Stereoscopic Image Display> Next, an embodiment of the stereoscopic image display 100 will be described. FIG.
1 is a diagram showing an overview of a stereoscopic image display device 100. FIG. The three-dimensional image display device 100 includes a housing 20 having a built-in optical system for projecting a cross-sectional image on a screen 38 and a control mechanism for performing various data processing, and an upper portion of the housing 20 provided inside. A cylindrical windshield 20a for accommodating the rotating screen 38, an operation input means 22 for editing a stereoscopic image displayed in a rotation space of the screen 38 in the windshield 20a (that is, a stereoscopic image display space); It has. The operation input means 22 includes a keyboard 22a, a mouse 22b, and a joystick 22.
c.

The windshield 20a is made of a transparent material such as glass or acrylic resin, and is configured so that a cross-sectional image projected on a screen 38 rotating on the inside can be visually recognized from the outside. Further, the windshield 20a seals the internal space, so that the screen 38
The aim is to stabilize the rotation of the motor and reduce the power consumption of the motor that rotates.

A liquid crystal display (LCD) 21 and a detachable opening 23 for the recording medium 4 are arranged on the front side of the housing 20, and the digital input / output terminal 2 is located on the side.
4 are provided. The liquid crystal display 21 is used as a display unit of an operation guide screen when performing an operation input and a display unit of a two-dimensional image for indexing a display target. The digital input / output terminal 24 is a SCSI terminal, an IEEE1394 terminal, or the like. Further, speakers 4 for outputting sound are provided at four places on the outer peripheral surface of the housing 20.
5 are arranged.

Next, an optical system for projecting a cross-sectional image on the screen 38 in the three-dimensional image display device 100 will be described. FIG. 3 is a diagram showing a configuration including an optical system in the stereoscopic image display device 100. As shown in FIG. 3, the optical system of the stereoscopic image display device 100 includes an illumination optical system 40, a projection optical system 50, a DMD (digital micromirror device) 33, and a TIR prism 44.

First, the DMD 33 will be described. DM
D33 functions as an image generation unit that generates a cross-sectional image to be projected on the screen 38.
It has a structure in which an extremely small mirror of a rectangular metal piece (for example, an aluminum piece) of about μm is laid out on a plane with a scale of several hundred thousand per chip as one pixel, and a static output of the SRAM output arranged immediately below each pixel. This device is capable of individually controlling the tilt angle of each mirror at ± 10 degrees by the action of an electric field. The mirror angle control is an ON / OFF binary control corresponding to the SRAM output “1” or “0”, and is turned ON (or OF) when light from the light source is applied.
Only the light reflected by the mirror facing the direction F) travels toward the projection optical system 50, and the light reflected by the mirror facing the OFF (or ON) direction deviates from the effective optical path. Do not go in the direction of. ON this mirror
By the / OFF control, a cross-sectional image corresponding to the ON / OFF mirror distribution is generated and projected on the screen 38.

The direction of the reflected light is switched by controlling the tilt angle of each mirror. By adjusting the switching time (the length of the reflected time), the density (gradation) of each pixel can be expressed. Thus, 256 gradations can be expressed for one color. Then, R that periodically switches white light from the light source
(Red), G (green), and B (blue) color filters to form a color image by synchronizing the DMD chip with each of the passed colors, or forming a color image for each of R, G, and B colors
A color image can be formed by preparing an MD chip and simultaneously projecting three colors of light.

Such a DMD 33 has two major features: first, it has a very high light use efficiency, and second, it has a high-speed response. Generally, the DMD 33 makes use of its high light use efficiency. It is used for applications such as video projectors.

In this embodiment, the sectional image projected on the screen 38 is switched at high speed in the volume scanning method using the afterimage effect by effectively utilizing the high-speed response which is another great feature of the DMD 33. Is realized as possible.

The DMD 33 generates one image because the response of the deflection of each mirror is about 10 μsec and the writing of image data can be performed in substantially the same manner as a general SRAM. 1ms required
Very fast, c or less. Temporarily 1ms
ec, 1/1 to realize the afterimage effect.
When performing a volume scan of 180 ° (ie, 9 rotations per second) in 8 seconds, the number of cross-sectional images that can be generated is about 60. Therefore, compared with the case where a cross-sectional image is generated using a CRT, a liquid crystal display, or the like, the DMD 33 displays much more cross-sectional images per unit time on the screen 38.
It can be projected on the top, and can support not only a three-dimensional display of a non-rotationally symmetrical shape but also a three-dimensional display of a moving image.

However, the high light utilization efficiency, which is one of the features of the DMD 33, also contributes to enhancing the afterimage effect by projecting a brighter cross-sectional image on the screen 38. High-quality stereoscopic images can be displayed.

As shown in FIG. 3, on the image generating surface side of the DMD 33, the illumination light from the illumination optical system 40 is guided to each micro mirror, and the cross-sectional image generated by the DMD 33 is guided to the projection optical system 50. For this purpose, a TIR prism 44 is provided.

The illumination optical system 40 has a white light source 41 and an illumination lens system 42, and illumination light from the white light source 41 is converted into parallel light by the illumination lens system 42. The illumination lens system 42 includes a condenser lens 421 and an integrator 42.
2, a color filter 43 and a relay lens 423. Illumination light from the white light source 41 is condensed by the condenser lens 421 and enters the integrator 422. Then, the illumination light whose light amount distribution is made uniform by the integrator 422 is separated into any one of R, G, and B color components by the rotary color filter 43. The split illumination light is converted into parallel light by the relay lens 423, and then enters the TIR prism 44.
Irradiated on DMD 33.

The DMD 33 reflects only the light component of the illumination light necessary for projecting the cross-sectional image toward the projection optical system 50 by changing the inclination angle of each micromirror based on the cross-sectional image data. Let it.

The projection optical system 50 has a projection lens system 51 and a screen 38. The projection lens system 51 includes two telecentric lenses 511, a projection lens 513, projection mirrors 36 and 37, and an image rotation compensating mechanism 34.
Among them, the projection lens 513 and the projection mirrors 36 and 37 are arranged inside a rotating member 39 for rotating the screen 38 around the rotation axis Z.

The light (cross-sectional image) reflected by the DMD 33 is converted into parallel light by the two telecentric lenses 511.
The image passes through the image rotation compensating mechanism 34 in order to compensate for the rotation of the cross-sectional image. The light beam whose rotation has been compensated by the image rotation compensating mechanism 34 is projected onto the projection mirror 36 and the projection lens 51.
3. Finally, the screen 38 via the projection mirror 37
Is projected on the main surface (projection plane) of the. Therefore, the projection optical system 50 and the DMD 33 generate a plurality of cross-sectional images (light images) required for displaying a stereoscopic image based on the cross-sectional image data, and synchronize the plurality of cross-sectional images (light images) with the rotational scanning of the screen 38. A means for sequentially projecting the sectional images on the screen 38 is formed.

In this optical system, the projection mirror 36, the projection lens 513, the projection mirror 37, and the screen 38 are fixed to a rotating member 39, and a vertical rotation axis Z including the central axis of the screen 38 with the rotation of the rotating member 39. Rotate at angular velocity Ω around. That is, when the screen 38 is rotated to perform volume scanning, the rotating member 39 is used.
Since the projection mirror 36, the projection lens 513, and the projection mirror 37 disposed inside also rotate integrally with the screen 38, the cross-sectional image is always projected from the front side regardless of the angle of the screen 38. The rotation angle of the screen 38 is always detected by the position detector 73.

As described above, the cross-sectional image generated by the DMD 33 is projected onto the screen 38. In this case, the role of the projection lens 513 is to set an appropriate image size where the light flux reaches the screen 38. It is to make. Further, the projection mirror 37 is obliquely downward from the front of the screen 38 (in FIG. 3, inside the rotating member 39) so as not to obstruct the line of sight of the observer when observing the stereoscopic image projected on the screen 38. Are arranged so as to project a cross-sectional image from. The projection lens 51
The positional order of the three projection mirrors 36 and 37 is not necessarily limited to this embodiment.

Here, the image rotation compensating mechanism 34 will be described. The image rotation compensating mechanism 34 shown in FIG. 3 is realized by the configuration of a so-called image rotator. When the image rotation compensating mechanism 34 is rotated around the optical axis, the output image with respect to the incident image is rotated at twice the angular speed of the image rotator and output. Have the property of Therefore, by rotating the image rotator at an angular velocity of half the angular velocity of the rotating member 39 to which the screen 38 is attached, an upright sectional image can always be projected regardless of the rotation of the screen 38.

A similar effect can be obtained by using a dub (type) prism other than the image rotator as the image rotation compensating mechanism. Also, without using the image rotation compensating mechanism 34 described here, the rotation of the projected image is performed by using a cross-sectional image generated on the surface of the DMD 33 as an image that rotates around the optical axis according to the rotation angle of the screen 38. You may cancel.

Here, the screen 38 and the rotating member 3
FIG. 4 shows an example of a perspective view of the ninth embodiment. As shown in FIG. 4, the rotating member 39 has a disk shape, and is rotatably driven by a rotating shaft of a motor 74 serving as a rotating drive unit being in contact with a side surface thereof. Note that a motor may be directly connected to the central axis of the rotating member 39, or may be driven via a gear or a belt.

When the screen 38 is at a certain rotation angle θ1 as shown in FIG. 4, a sectional image Q1 (generated by the DMD 33) of the display object corresponding to θ1 is formed by the projection mirror 36 and the projection lens 513 shown in FIG. And projected on a screen 38 via the projection mirror 37. When a minute time elapses from this and the screen 38 rotates and the rotation angle becomes θ2, a cross-sectional image Q2 (generated by the DMD 33) of the display object corresponding to θ2 is projected as shown in FIG. The light is projected onto the screen 38 via the mirror 36, the projection lens 513, and the projection mirror 37.

Since the projection mirror 36, the projection lens 513, and the projection mirror 37 rotate together while maintaining a fixed positional relationship with respect to the screen 38, the cross-sectional image is continuously projected on the screen 38 regardless of the rotation. Then, when the rotating member 39 is rotated 360 ° (or 180 °), the same cross-sectional image appears again, and one volume scan is completed. The above operation is performed by increasing the rotation speed of the rotating member 39 sufficiently fast so that an after-image effect occurs and by sufficiently increasing the number of cross-sectional images to be projected. You can see the image.

<3. Control mechanism in stereoscopic image display device> Next, a control mechanism for displaying a stereoscopic image in the stereoscopic image display device 100 will be described.

FIG. 5 is a block diagram showing a functional configuration of the three-dimensional image display device 100. In FIG. 5, solid arrows indicate the flow of electric signals, and broken arrows indicate the flow of light. The illumination optical system 40 and the projection optical system 50 shown in FIG.

The stereoscopic display data file relating to the display object is input from the host computer 3 to the interface 66 via the digital input / output terminal 24,
Alternatively, it is input from the recording medium 4 to the interface 66.

The host computer 3 compresses the data file for stereoscopic display in order to increase the transmission efficiency of the data file for stereoscopic display. This data compression is performed by a general-purpose compression method such as ZIP or LZH. Therefore, in the three-dimensional image display device 100, it is necessary to decompress (restore) a data file for three-dimensional display that is input after being compressed. Therefore, in the configuration shown in FIG. 5, a data decompressor 65 for decompressing the compressed stereoscopic display data file is provided. It should be noted that if data compression for the stereoscopic display data file input to the interface 66 is not performed, it is not necessary to provide the data decompressor 65.

The data file for stereoscopic display expanded by the data expander 65 is sent to the data converter 67. The data converter 67 generates cross-sectional image data of the display target based on the data file for stereoscopic display of the display target. Then, the plurality of cross-sectional image data of the display object generated by the data converter 67 is
To a DMD driving unit 60 that controls the generation of a cross-sectional image (light image) by using

The DMD driver 60 includes a DMD 33, a DMD controller 62, and memories 63a and 63b. The memories 63a and 63b are configured such that writing or reading is independently controlled, and each of them can store a plurality of cross-sectional image data. The DMD controller 62 supplies a gradation signal to the DMD 33, controls a driver 71 for driving the color filter 43 in accordance with the rotation angle of the screen 38 detected by the position detector 73, and controls the memory 63.
The write operation and the read operation in a and 63b are controlled.

Here, the configuration of the memories 63a and 63b will be described. As described above, it is assumed that the number of cross-sectional images that can be generated within a predetermined time by the DMD 33 is 60.
Since the cross-sectional image is intermittently projected according to the rotation angle of the screen 38 to perform the three-dimensional display, if a group of 60 cross-sectional images is defined as one scene, the cross-sectional image data included in the cross-sectional image group, that is, It is necessary to sequentially repeat the two-dimensional image data and transfer the data to the DMD 33. For this reason, the storage capacity of the memory for supplying the cross-sectional image data to the DMD 33 requires a memory size capable of storing at least 60 cross-sectional image data corresponding to one scene.

That is, when the memory size for the cross-sectional image data is small (for example, when data of less than 60 cross-sectional images can be stored in the memory),
It is necessary for the data converter 67 to generate and transfer the cross-sectional image data in synchronization with the projection switching speed of the cross-sectional image. Otherwise, even a still image cannot be appropriately displayed in three dimensions. .

On the other hand, if the memory size is equal to or larger than 60 sheets, all the cross-sectional image data of the cross-sectional image group constituting one scene can be stored in the memory. If data is stored, a three-dimensional image can be appropriately displayed by sequentially providing the cross-sectional image data to the DMD 33 according to the rotational position of the screen 38 from this memory.

The above is the same regardless of whether a still image is displayed or a moving image is displayed when performing stereoscopic display.

Next, the memory configuration for displaying a moving image will be described. R for color display
When an image is constructed for each of the G and B color components, these R,
The G and B images constitute one set of cross-sectional images. Therefore, if 60 sheets are made to correspond to each of the R, G, and B color components, the image for each color component has a configuration of 20 sheets.

When a moving image is displayed, the cross-sectional image data to be displayed as one scene changes every moment as the screen 38 rotates. It needs to be updated. That is, when handling a moving image, it is necessary to simultaneously perform reading (display) and writing (updating) of cross-sectional image data in parallel. For this reason, in this embodiment, two memories 63a and 63b are provided, and the storage capacity of each of the memories 63a and 63b is set at least for one scene so that a moving image can be appropriately displayed in three dimensions. It is configured such that cross-sectional image data can be stored.

Next, the system controller 64 controls the rotation operation of the image rotation compensation mechanism 34 and the operation of the motor 74 in the projection lens system 51 by the screen controller 7.
2 is given a drive command. The system controller 64 controls the driver 70 for driving the white light source 41 and manages and controls the interface 66 and the data decompressor 65.
Under the control, the state of supply of the cross-sectional image data to the DMD driving unit 60 is transmitted to the DMD controller 62 and the like.
Further, it is configured to give an instruction to the character generator 69 to display appropriate characters, symbols, and the like on the screen of the liquid crystal display 21. further,
The system controller 64 generates correction data for correcting the stereoscopic display data file based on the content of the user's editing operation obtained via the keyboard 22a, the mouse 22b, and the joystick 22c functioning as the operation input means 22. , Which are provided to the data converter 67.

When audio data is included in the stereoscopic display data file, the audio data is restored by an audio decoder (not shown) provided inside the data decompressor 65, and the audio data obtained there is converted to D / D. Speaker 25 via A converter 68a and amplifier 68b
It is configured to be output from.

Here, the data file for stereoscopic display will be described. FIG. 6 is a diagram showing a configuration example of the stereoscopic display data file DF. As shown in FIG. 6A, the stereoscopic display data file DF includes element position data DD indicating position coordinates of each minute element constituting a display target in a predetermined three-dimensional coordinate system, and a stereoscopic image on the screen 38. The display position data DL indicating the position of the stereoscopic image in the display coordinate system defined in the display space of the above, and the display posture data DΦ indicating the posture of the stereoscopic image in the display coordinate system. FIG. 6B shows an example of the element position data DD, FIG. 6C shows an example of the display position data DL, and FIG. 6D shows an example of the display posture data DΦ.

Since a display object generally exists in a three-dimensional space, the display object can be represented as an aggregate of points and minute regions in an arbitrary three-dimensional coordinate system. The element position data DD is stored in the host computer 3
This is data that stores the position coordinates and color components of each minute element such as a point or a minute area constituting a display object in an arbitrary three-dimensional coordinate system set in.

FIG. 7 is a diagram showing the contents indicated by the element position data DD. As shown in FIG. 7, if there is a quadrangular pyramid-shaped display target 8, an arbitrary three-dimensional coordinate system xyz is set for the display target 8 in the host computer 3. Then, minute elements (that is, points and minute areas) P1, P2, and P included in the display object 8 are displayed.
The coordinate values in the three-dimensional coordinate system xyz are obtained for all of 3, 3,.
The color component values (R, G, B) for each of 3,. By obtaining the coordinate values and the color component values for all the small elements constituting the display object 8 in this manner, element position data DD as shown in FIG. 6B is generated, and the shape of the display object 8 And patterns can be converted into data.

The display position data DL is stored in the three-dimensional image display device 100 in a three-dimensional image display space.
This is data indicating the position at which the three-dimensional image is to be displayed. As shown in FIG.
It is configured to include a coordinate value related to P and a position vector L of the representative point RP in the three-dimensional coordinate system XYZ in the display space. The representative point RP is set, for example, as the position of the center of gravity of the display object, and its coordinate value is set in a three-dimensional coordinate system xyz arbitrarily set by the host computer 3 as shown in FIG.
Is defined as the coordinate value at. Therefore, the representative point RP
Corresponds to which part of the display object 8 is apparent from the relationship with the element position data DD.

FIG. 8 is a diagram showing a display space of a three-dimensional image on the screen 38. As shown in FIG. 8, the display space 9 (that is, the rotation space of the screen 38) of the three-dimensional image of the three-dimensional image display device 100 is displayed separately from the three-dimensional coordinate system xyz determined by the host computer 3. Coordinate system (hereinafter referred to as "display coordinate system")
XYZ is specified. For example, this display coordinate system XY
In Z, the Z axis coincides with the rotation axis Z of the screen 38. Then, in order to determine at which position in the display coordinate system XYZ the stereoscopic image relating to the display object is to be displayed, the position at which the representative point RP of the display object 8 is arranged is determined by the position vector L. As a result, it is possible to determine where the stereoscopic image should be displayed in the stereoscopic image display space 9 on the screen 38.

Therefore, by determining the display position data DL, it is possible to determine at which position in the display space 9 the shape or the like of the stereoscopic image determined by the element position data DD is to be arranged. Note that the representative point RP and its position vector L included in the display position data DL are
May be set, for example, by a user's specification, or may be configured to automatically set a predetermined value as a default value.

Next, the display orientation data DΦ is data indicating the orientation of the stereoscopic image to be displayed in the display coordinate system. As shown in FIG.
Axis (Y-axis, Z-axis), and rotation amounts (rotation angles) α, β, and γ.

According to the above-described element position data DD and display position data DL, when a display object is displayed in the display space 9 for a stereoscopic image, the attitude (angular direction) of the stereoscopic image is constant. For example, assuming that the x-axis of the three-dimensional coordinate system xyz and the X-axis, the y-axis and the Y-axis, and the z-axis and the Z-axis of the display coordinate system are parallel to each other, a triangular pyramid-shaped display object shown in FIG. 8 is always displayed in the display space 9 as a stereoscopic image having a fixed posture.

In this embodiment, the display attitude data DΦ is determined so that a stereoscopic image of an arbitrary attitude can be displayed in the display space 9, and the amount of rotation for each of the X, Y, and Z axes is determined. To change the attitude of the display object 8. When the rotation based on the display posture data DΦ is performed, the position of the representative point RP of the display object 8 is a fixed point because the position of the representative point RP is defined by the position vector L. Becomes

That is, all the parameters necessary for displaying the stereoscopic image of the display object 8 in the display space 9 are determined by the element position data DD, the display position data DL and the display posture data DΦ. It becomes. Therefore, when the three-dimensional image display device 100 inputs the three-dimensional display data file DF, the data converter 67 converts data in the three-dimensional coordinate system xyz arbitrarily set into data in the display coordinate system XYZ. Thus, the shape, position, posture, and the like of the stereoscopic image in the display space 9 can be determined. As a result, it is possible to generate the cross-sectional image data based on the stereoscopic display data file DF.

FIG. 9 is a diagram in which the main parts of the configuration shown in FIG. 5 are extracted. As shown in FIG. 9, the data converter 67 includes a data storage unit 67a, a data correction unit 67b, and a cross-sectional image generation unit 67c.

The data storage section 67a is provided with a data decompressor 65.
When the stereoscopic display data file DF restored from is input, the stereoscopic display data file DF is stored in a storage unit such as a memory. Further, the data storage section 67a provides the data correction section 67b with the stereoscopic display data file DF stored in the storage means.

On the other hand, the system controller 64 is provided with an editing content analyzing section 64a, which edits the editing operation by the user based on input information obtained from the keyboard 22a, the mouse 22b or the joystick 22c. The contents are analyzed, and the element position data DD, the display position data DL, and the display attitude data D included in the three-dimensional display data file DF are edited according to the edited contents.
Correction data for correcting at least one of Φ is generated. Then, the configuration is such that correction data according to the editing content generated by the editing content analysis unit 64a is provided to the data correction unit 67b of the data converter 67.

The correction data given to the data correction section 67b can be input from the host computer 3 via the interface 66. Since the correction data has a small data amount, data transmission can be efficiently performed in a short communication time.

The data correction section 67b is provided with a data storage section 67
When the stereoscopic display data file DF from a is input,
The presence / absence of correction data from the editing content analysis unit 64a or the host computer 3 is determined. When there is correction data, at least one of the element position data DD, the display position data DL, and the display attitude data DΦ indicated in the correction data is corrected based on the correction data. Then, the data correction section 67b outputs the stereoscopic display data file DF on which the edited content is reflected to the cross-sectional image generation section 67c.

On the other hand, when there is no correction data, the data correction unit 67b outputs the stereoscopic display data file DF from the data storage unit 67a to the cross-sectional image generation unit 67c as it is.

The section image generating section 67c generates section image data to be projected at each rotational position of the screen 38 to be rotationally scanned, based on the stereoscopic display data file DF obtained from the data correcting section 67b.

The details of the processing for generating a cross-sectional image will be described. FIG. 10 is a diagram showing a case where the screen 38 is at a certain rotation angle θ in the display coordinate system XYZ. As shown in FIG. 10, when the coordinate value of an arbitrary point SP on the projection plane of the screen 38 is obtained, SP = (r · cos
θ, r · sin θ, Zp). Where r is the point SP
Is the distance from the rotation axis Z, and Zp is the Z coordinate value of the point SP. The coordinate value of this point SP is a coordinate value in the display coordinate system XYZ.

Further, as described above, the cross-sectional image generation unit 67c calculates each coordinate value (X ', Y', Z '),

[0069]

(Equation 1)

Is determined by Note that in Equation 1, R
(Α, β, γ) indicates a function of rotation conversion.

Then, based on a minute element having an XYZ coordinate value matching the coordinate value of an arbitrary point SP on the screen 38 or a minute element having an XYZ coordinate value near the coordinate value of the arbitrary point SP, The value of the point SP (for example, a color component value) is determined. Here, consideration is given to the minute elements that are located near the coordinate value of the point SP because the cross-sectional image is generated at each predetermined angle. This is to prevent it. For example, as shown in FIG.
In order to prevent loss of information between the rotation angles θ1 and θ2 in the cross-sectional image Q1 when the image is at 1 and the cross-sectional image Q2 when the rotation is at the angle θ2, Is information between the rotation angles θ1 and θ2, and is configured to generate data in consideration of information on a position near the coordinate value of the point SP.

When there is no minute element that coincides with the coordinate value of the point SP or a minute element at a nearby position, the point SP is not necessary for projecting the cross-sectional image. Is set to 0.

When such a correspondence between the point SP and the value is performed for all points (points corresponding to one pixel) of the screen 38, the cross-sectional image data when the screen 38 is at the rotation angle θ is generated. You can do it.

The generation of the cross-sectional image data as described above is sequentially repeated while changing the rotation angle θ of the screen 38 for each predetermined angle.
Generates all cross-sectional image data to be displayed during the rotation of 360 ° (or 180 °). As a result, cross-sectional image data relating to a plurality of cross-sectional images constituting one scene is generated.

In the case of a still image, the generation of the cross-sectional image is completed if the cross-sectional image data for one scene is generated. However, in the case of a moving image, the above-described cross-sectional image of all the continuous scenes is obtained. Generation processing will be performed.

Then, the slice image data generated by the slice image generating section 67c is output to the memory 63a or 63b.

As described above, in this embodiment, the two memories 63a and 63a are used to change the three-dimensional image of the display object every moment and display a moving image related to the display object.
63b is provided so that a write operation to one memory and a read operation to the other memory are performed in parallel in time. Specifically, the memory control unit 62a in the DMD controller 62 functions as a control unit for switching between a memory to be read and a memory to be written. The read operation and the write operation of the memories 63a and 63b are alternately switched in accordance with the rotation angle of the screen 38 to be read.

The cross-sectional image data supplied from the cross-sectional image generation unit 67c is supplied to both the memories 63a and 63b, but only the memory of the two memories to which the write command is given by the memory control unit 62a is specified. The data is written (or updated) sequentially from the address. On the other hand, the memory to which the read command is given from the memory control unit 62a is configured to sequentially output a plurality of already stored cross-sectional image data based on the command from the memory control unit 62a and to provide the same to the DMD 33. Is done.

When a still image is displayed, the cross-sectional image data for one scene is repeatedly provided to the DMD 33 using only one memory.

As a result, the cross-sectional image is projected on the projection surface of the screen 38 and the cross-sectional image projected according to the rotation angle of the screen 38 is updated, so that a stereoscopic image of the display target is displayed. It will be displayed in the space 9.

Next, editing of a stereoscopic image will be described.
As described above, the user checks the stereoscopic image displayed in the display space 9 and, if the user wants to change the display position or posture of the stereoscopic image or to deform the stereoscopic image, the operation input means such as the keyboard 22 a A predetermined operation is performed on 22.

FIG. 11 is a conceptual diagram in the case of performing the movement and the posture conversion of the stereoscopic image. As shown in FIG. 11, for example, if the user performs an editing operation such as moving the display position of the stereoscopic image 9 a and changing the posture, the editing content analysis unit 64 a of the system controller 64.
Is a position vector L of the representative point such that the representative point of the stereoscopic image 9a changes to the position of the stereoscopic image 9b in the display space 9, and XYZ for changing the attitude of the stereoscopic image 9a.
The correction data for correcting the rotation amounts α, β, and γ for each axis are generated.

The data correcting section 67b of the data converter 67 corrects the display position data DL and the display attitude data DΦ included in the three-dimensional display data file DF based on the correcting data, thereby obtaining a cross-sectional image generating section. 6
The cross-sectional image data generated in 7c reflects the editing result, and the stereoscopic image 9b is newly displayed in the display space 9.

FIG. 12 is a conceptual diagram in the case of performing movement, posture conversion and deformation of a stereoscopic image. As shown in FIG. 12, for example, if the user moves the display position of the stereoscopic image 9a, changes the posture, and performs an editing operation to deform the stereoscopic image 9a, the system controller 6
The editing content analysis unit 64a of the fourth embodiment is configured such that the position vector L of the representative point and the XYZ for changing the attitude of the stereoscopic image 9a are changed so that the representative point of the stereoscopic image 9a changes to the position of the stereoscopic image 9b in the display space 9. The rotation amounts α, β,
Correction data for correcting γ and the coordinate value of each minute element in the element position data DD is generated.

The transformation of the three-dimensional image 9a is performed by affine transformation, and a transformation instruction is performed by inputting affine transformation parameters as correction data. In addition, it may be configured to perform affine transformation including movement and rotation.

The data correcting section 67b of the data converter 67 corrects the element position data DD, the display position data DL and the display attitude data DΦ included in the three-dimensional display data file DF based on the correction data. The cross-sectional image data generated by the cross-sectional image generation unit 67c reflects the editing result, and the stereoscopic image 9c is newly displayed in the display space 9.

Therefore, the three-dimensional image display device 100 of this embodiment is configured so that the user can perform a three-dimensional image editing operation while visually recognizing the three-dimensional image displayed in the display space 9. Stereoscopic image display device 100
In, it is possible to update the stereoscopic image by immediately reflecting the edited content.

A three-dimensional mouse cursor or the like is displayed in the display space 9 and the mouse cursor or the like is moved to the mouse 22b.
And the joystick 22c can be moved, and the user can easily perform the editing operation by performing the editing operation such as the movement, the posture conversion, and the deformation of the stereoscopic image by the drag and drop operation or the like. Can be.

Next, an example of the configuration of a data file for stereoscopic display when displaying a moving image will be described. FIG.
3A is a diagram illustrating an example of a data file for stereoscopic display used for displaying a moving image, FIG. 3A is a data file relating to a still object displayed as a still image such as a background, and FIG. A data file relating to the first aspect of the object, (c) is a data file relating to the second aspect, and (d) is a data file relating to the third aspect.

As shown in FIG. 13A, a plurality of still objects such as stones and water plants are set as one stereoscopic display data file DFs. Therefore, if a stereoscopic image is displayed based on the stereoscopic display data file DFs relating to the stationary object, a plurality of stationary objects are displayed in the display space 9.

As shown in FIGS. 13B to 13D, three-dimensional display data files DF1 to DF3 are set as dynamic objects in the first to third aspects of fish. Therefore, if the stereoscopic images are sequentially displayed based on the stereoscopic display data files DF1 to DF3 related to the dynamic object, a moving image in which a fish swims is displayed in the display space 9.

Here, when the still object is to be displayed three-dimensionally during the three-dimensional display of the dynamic object, the three-dimensional display data file D for the still object is displayed.
It is preferable that the content of Fs is superimposed (combined) in advance on the content of each of the stereoscopic display data files DF1 to DF3 of each dynamic object.

By doing so, the display space 9 contains
While a plurality of still objects such as stones and aquatic plants are displayed in a three-dimensional manner, it is possible to perform a three-dimensional display in which a plurality of objects, such as fish swimming around, are superimposed (combined).

Further, in the example of FIG. 13, the dynamic object is configured to hold the element position data for each mode. This is because the portion of the caudal fin changes when the fish swims. However, if one dynamic object is decomposed into a plurality of parts, there is no need to hold element position data for each. In other words, in the case of the above fish example, the front part of the fish,
If it is configured to decompose into multiple parts such as the rear part, fin part and hold element position data for each,
The bent state of the caudal fin of the fish can be dealt with by changing the display posture data DΦ of the caudal fin parts. Therefore, if a plurality of parts are set for each deformable part of the dynamic object, it becomes possible to handle the plurality of stationary objects in the same manner as when changing the posture, and the superposition of the plurality of objects as described above is performed. The stereoscopic display of the moving image can be performed only by performing the processing.

<4. Outline of processing procedure in stereoscopic image display device 100> Next, an outline of a processing procedure when a stereoscopic image is actually displayed on the stereoscopic image display device 100 will be described.

FIG. 14 is a flowchart showing a processing procedure when a still image is stereoscopically displayed. First, when a still image is stereoscopically displayed, the data converter 67 in the stereoscopic image display device 100 reads a stereoscopic display data file to be stereoscopically displayed (step S10). For example, the system controller 64 specifies a data file for three-dimensional display to be read based on the specification information from the operation input unit 22.

In the data converter 67, the cross-sectional image generating section 67c generates cross-sectional image data relating to a plurality of cross-sectional images to be projected when the screen 38 is at each rotational position, based on the stereoscopic display data file. (Step S11).

The cross-sectional image data generated as a result is output from the data converter 67 to the memory 63a (or 63b) (step S12). And the memory 63
The cross-sectional image data output to a (or 63b) is DM
The memory 63a (or 6
3b) is sequentially supplied to the DMD 33, and the screen 3
The cross-sectional images according to the rotation of 8 are sequentially generated and projected on the screen 38. Therefore, in the display space 9 on the screen 38, a stereoscopic image based on the stereoscopic display data file read in step S1 is displayed.

Next, the system controller 64
However, it is determined whether or not a predetermined operation input for performing an editing operation has been performed by the user, and if the operation input has been performed, the process proceeds to step S14, and if not, the process ends. (Step S13).

When a predetermined operation input is made, the editing work by the user, that is, the keyboard 22a
By performing such operations, an editing operation of the stereoscopic image displayed in the display space 9 is performed (step S14). The editing content analysis unit 64a of the system controller 64 analyzes the editing content of the user to generate correction data, and provides the correction data to the data correction unit 67b inside the data converter 67.

The data correcting section 67b converts at least one of the element position data DD, the display position data DL, and the display attitude data DΦ included in the stereoscopic display data file currently being stereoscopically displayed based on the correction data. By making the correction, a data file for stereoscopic display on which the edited content is reflected is newly generated (step S15). Then, the stereoscopic display data file generated by the data correction unit 67b is provided to the cross-sectional image generation unit 67c.

Then, the cross-sectional image generating section 67c generates cross-sectional image data for a plurality of cross-sectional images to be projected when the screen 38 is at each rotation position, based on the stereoscopic display data file in which the correction contents are reflected. (Step S16).

The cross-sectional image data generated as a result is output from the data converter 67 to the memory 63a (or 63b) again (step S17). Then, the slice image data already stored in the memory 63a (or 63b) is updated to the slice image data reflecting the edited contents. Then, under the control of the DMD controller 62, the cross-sectional image data is sequentially supplied from the memory 63a (or 63b) to the DMD 33, and the cross-sectional images corresponding to the rotation of the screen 38 are sequentially generated and projected on the screen 38. Therefore, in the display space 9 on the screen 38, a stereoscopic image on which the editing content in step S14 is reflected is displayed.

Then, the system controller 64 determines whether or not there is an end operation by the user. If there is an end operation, the system controller 64 terminates the processing. (Step S18).

As described above, in the three-dimensional image display device 100,
While displaying the stereoscopic image, the user can perform the editing work while viewing the stereoscopic image, and when the editing work is performed, the stereoscopic image reflecting the edited content can be immediately displayed. It has become. This means that the data file for stereoscopic display in the data converter 67 is managed by three data of element position data DD, display position data DL, and display attitude data DΦ, which are easily converted based on the edited contents. It is realized by doing. That is, when the display position of the stereoscopic image is changed by the editing operation, the position vector L of the representative point may be changed based on the movement vector based on the operation, and when the display orientation of the stereoscopic image is changed. May change the display orientation data DΦ based on the amount of rotation about each of the XYZ axes based on the operation. Further, when the stereoscopic image is deformed, the element position data DD may be changed based on the amount of deformation based on the operation. Since it is sufficient to update the coordinate value of each microelement, data conversion based on the editing operation can be performed easily and at high speed.

Further, by managing the three-dimensional display data file with three data of element position data DD, display position data DL, and display attitude data DΦ, which can be easily converted based on the edited contents, the three-dimensional display data file can be easily converted. Processing for enlarging and reducing an image, and further, processing for appropriately placing a stereoscopic image in the display space 9 can be performed easily and at high speed.

Next, a processing procedure for displaying a moving image will be described. FIG. 15 is a flowchart illustrating a processing procedure when a moving image is stereoscopically displayed. First, when a moving image is stereoscopically displayed, a data storage unit 67a of the data converter 67 stores data files for stereoscopic display for a plurality of continuous scenes in advance.

Then, when there is an input from the user to start the three-dimensional display, the data converter 67
The data file for three-dimensional display of the first one of a plurality of continuous scenes is read (step S2).
0).

Then, the section image generating section 67c generates a section image for one scene based on the stereoscopic display data file for one scene (step S21).

The generated cross-sectional images for one scene are output to the memory 63 a (or 63 b), and the cross-sectional images are sequentially generated in the DMD 33 in accordance with the rotational position of the screen 38. Thereby, a stereoscopic image of one scene is displayed in the display space 9 (step S22).

Then, in a step S23, it is determined whether or not display of all scenes constituting the moving image has been completed.
If S, the process ends. If NO, the process returns to step S20 to repeat reading of a stereoscopic display data file of a subsequent scene, generation of a cross-sectional image, and stereoscopic display.

By the above-described processing, the contents to be stereoscopically displayed are sequentially updated based on the stereoscopic display data file for each scene constituting the moving image, and the moving image is stereoscopically displayed in the display space 9. .

<5. Modifications> While one embodiment of the stereoscopic image display device according to the present invention has been described in detail, the present invention is not limited to the above-described one.

For example, in the above description, an example has been described in which a three-dimensional image is displayed in the display space 9 by sequentially projecting cross-sectional images on the screen 38 that rotates at a high speed. May be used. However, in this case, it is necessary to generate a cross-sectional image according to the moving direction of the screen 38 when generating the cross-sectional image.

In the above description, the DMD 33 is exemplified as an example of a means for generating a cross-sectional image (light image) to be projected on the screen 38. However, an element other than the DMD 33 may be used.

[0116]

As described above, according to the first aspect of the present invention, the storage means stores the element position data for each minute element constituting the display object in the predetermined coordinate system and the stereoscopic image on the screen. The display position data indicating the position of the stereoscopic image in the display coordinate system defined within the display space of the display space, and the display posture data indicating the posture of the stereoscopic image in the display coordinate system, a data file for stereoscopic display having a data structure including The section image generating means is configured to generate a plurality of cross-sectional images to be projected at each position when the screen moves in the display space, based on the stereoscopic display data file. Therefore, it is possible to immediately generate a cross-sectional image to be used for stereoscopic display at the time of stereoscopic display in the stereoscopic image display device.

According to the second aspect of the present invention, the data correcting means corrects at least one of the element position data, the display position data, and the display attitude data based on the input information from the operation input means. With such a configuration, it is possible to generate a stereoscopic display data file in which the editing content is immediately reflected in the stereoscopic image display device,
Thereby, the display contents of the stereoscopic image can be updated based on the edited contents.

According to the third aspect of the present invention, the storage means stores a plurality of three-dimensional display data files relating to a plurality of display objects, and the cross-sectional image generation means comprises:
In order to generate a cross-sectional image in a state where the respective contents of a plurality of data files for stereoscopic display are superimposed so that a plurality of stereoscopic images are displayed in the display space, a plurality of display objects are placed in the display space. Can be displayed.

According to the fourth aspect of the present invention, the three-dimensional display data file includes the element position data of each minute element constituting the display object in the predetermined coordinate system and the three-dimensional image display space on the screen. Since the data structure includes display position data indicating the position of the stereoscopic image in the defined display coordinate system and display posture data indicating the posture of the stereoscopic image in the display coordinate system, it can be easily determined based on editing contents and the like. In addition, the mode of stereoscopic display can be changed efficiently.

[Brief description of the drawings]

FIG. 1 is a diagram showing an overall configuration of a stereoscopic image display system.

FIG. 2 is a diagram showing an overview of a stereoscopic image display device.

FIG. 3 is a diagram illustrating a configuration including an optical system in the stereoscopic image display device.

FIG. 4 is a diagram showing an example of a perspective overview of a screen and a rotating member.

FIG. 5 is a block diagram illustrating a functional configuration of the stereoscopic image display device.

FIG. 6 is a diagram illustrating a configuration example of a stereoscopic display data file.

FIG. 7 is a diagram showing contents indicated by element position data.

FIG. 8 is a diagram illustrating a display space of a stereoscopic image on a screen.

FIG. 9 is a diagram in which main parts of the configuration shown in FIG. 5 are extracted.

FIG. 10 is a diagram showing a case where a screen is at a certain rotation angle in a display coordinate system.

FIG. 11 is a conceptual diagram in the case of performing movement and posture conversion of a stereoscopic image.

FIG. 12 is a conceptual diagram in the case of performing movement, posture conversion, and deformation of a stereoscopic image.

FIG. 13 is a diagram showing an example of a data file for stereoscopic display used for moving image display.

FIG. 14 is a flowchart illustrating a processing procedure when a still image is stereoscopically displayed.

FIG. 15 is a flowchart illustrating a processing procedure when a moving image is stereoscopically displayed.

[Explanation of symbols]

 REFERENCE SIGNS LIST 1 stereoscopic image display system 3 host computer 9 display space 22 operation input means 33 DMD (projection means) 38 screen 64 system controller 64 a editing content analysis section 67 data converter 67 a data storage section (storage means) 67 b data correction section (data correction) Means) 67c Cross-sectional image generating unit (cross-sectional image generating means) 100 Stereoscopic image display device DF Data file for stereoscopic display DD Element position data DL Display position data DΦ Display posture data

Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat II (reference) G09G 3/34 G09G 3/34 D H04N 15/00 H04N 15/00 F term (reference) 5C061 AA06 AA11 AA21 AA23 AA29 AB16 AB21 AB24 5C080 AA18 BB05 CC04 DD21 EE17 JJ02 JJ06 JJ07 5G435 AA00 BB17 CC11 CC12 DD02 DD05 EE16 GG01 GG03 GG08 GG10 GG12 GG13 GG28 GG46

Claims (4)

[Claims] 1. A method according to claim 1, further comprising the step of:
A three-dimensional image display device that displays the three-dimensional image of a display object by intermittently projecting the screen on a screen that moves in a predetermined direction, wherein a micro element that constitutes the display object in a predetermined coordinate system Element position data, display position data indicating a position of the stereoscopic image in a display coordinate system defined in a display space of the stereoscopic image on the screen, and an orientation of the stereoscopic image in the display coordinate system. Storage means for storing a data file for stereoscopic display having a data structure including display attitude data; and, based on the data file for stereoscopic display, to project at each position when the screen moves in the display space. A cross-sectional image generating unit configured to generate the plurality of cross-sectional images; Stereoscopic image display apparatus characterized by comprising, a means for projecting to the screen. 2. The three-dimensional image display device according to claim 1, wherein an operation input unit for editing the three-dimensional image, and the element position data and the display based on input information from the operation input unit. A stereoscopic image display device, further comprising: data correction means for correcting at least one of the position data and the display orientation data. 3. The three-dimensional image display device according to claim 1, wherein the storage unit stores a plurality of data files for three-dimensional display concerning a plurality of display objects, and generates the cross-sectional image. Means for generating the cross-sectional image in a state in which respective contents of the plurality of stereoscopic display data files are superimposed so that a plurality of stereoscopic images are displayed in the display space. Image display device. 4. A data file used for displaying a three-dimensional image by intermittently projecting a plurality of cross-sectional images constituting a three-dimensional image onto a screen, wherein the display is performed in a predetermined coordinate system. Element position data for each minute element constituting the target object, display position data indicating a position of the stereoscopic image in a display coordinate system defined in a display space of the stereoscopic image on the screen, and And a display attitude data indicating an attitude of the stereoscopic image.