JPH10232665A - Device and method for controlling display - Google Patents

Abstract

PROBLEM TO BE SOLVED: To recognize whether or not a three-dimensional display is possible at every object and to properly control the display of the object. SOLUTION: A display driver 6 receiving a plotting instruction from a host computer 11 decides whether or not the file of the object to be plotted is provided with the three-dimensional image data by an object analytic part 10. When the file is provided with the three-dimensional image data, the driver 6 issues the instruction to perform a three-dimensional display for a plotting control part 9. The plotting control part 9 performs a stereoscopic display on a stereoscopic display device 12 by using a two-dimensional and three- dimensional image plotting part 7 and a parallax barrier pattern plotting part 8. On the other hand, when the file in not provided with the three-dimensional image data, the driver 6 erases the parallax barrier pattern of the plotting part of the relevant object by the control of the plotting control part 9 to perform a two-dimensional display.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a display control device and a display control method for controlling a three-dimensional display device for reproducing an image point in space to allow a viewer to observe a three-dimensional image.

[0002]

2. Description of the Related Art Conventionally, there is a system capable of switching between two-dimensional display and three-dimensional display or performing mixed display. As a means for displaying a stereoscopic image, a binocular parallax method and depth sampling are representative. The binocular parallax method uses a slight difference between images of the right eye and the left eye, that is, a binocular parallax to allow an observer to observe a stereoscopic image. In depth sampling, a number of cross-sectional images of an object are time-divisionally displayed in the observation space by changing the display surface in the depth direction by moving the imaging system, and the cross-sectional images are displayed in the observation space using the afterimage effect of the eye. Are superimposed and emerge.

[0003] Conventionally, as a user interface for improving operability, a computer system having a graphical user interface has been known. Hereinafter, the graphical user interface and the stereoscopic display mechanism will be described in more detail.

(1) Description of Graphical User Interface Conventionally, input devices such as a keyboard, tablet, mouse, and trackball have been used to operate a computer and input data. In particular, a tablet or a mouse can input coordinate information and trajectory information to a computer for a visually recognizable object such as a window, an icon, and a pull-down menu while watching a monitor, and a graphical user interface (hereinafter referred to as a GUI). Call). The input device and the monitor display enable an intuitive operation to be performed, thereby improving the operability of the computer.

FIG. 17 is a hierarchical diagram of a typical computer system using a GUI as an operating system. In the figure, reference numeral 200 denotes application software (hereinafter simply referred to as an application) used by a user, and reference numeral 201 denotes a visual shell which is an environment for the user to actually and interactively operate with a computer. The application 200 includes a GUI component application interface (API) 202, a GU
I parts library / server 203, display 2
06, a drawing API 204 for performing drawing, a drawing library / server 205, another API 207 for using the peripheral device 209, another library / server 208, and a device driver for controlling each device GU by using 210 etc.
Build a visual shell for the I environment and control external peripherals.

The progress of computer software and hardware is remarkable, and the development of display devices is no exception, and high-quality color, large-screen, high-definition, etc. are being promoted. On the other hand, stereoscopic observation of the display
There is also a tendency to pursue more information and a sense of reality, and several methods have been proposed and implemented.

(2) Description of a stereoscopic display mechanism based on binocular parallax As a system for performing stereoscopic display on a display, a stereoscopic image display system using a parallax barrier (hereinafter, referred to as a parallax barrier system) is widely used. Are known.

For the parallax barrier method, see S.
H. Kaplan, “Theory of Parallax Barriers”, J. SMPTE, Vo
l.59, No. 7, pp. 11-21 (1952). In the parallax barrier method, a stripe image in which at least left and right images are alternately arranged is displayed from a plurality of parallax images obtained from a plurality of viewpoints. Then, a parallax image corresponding to each eye is observed with each eye through a slit (referred to as a parallax barrier) having a predetermined opening provided at a position separated from the stripe image by a predetermined distance. Let it. In this way, the corresponding parallax image can be observed by each eye,
Stereoscopic vision can be performed.

Further, in order to improve compatibility with a two-dimensional image (one viewpoint image) display device, a parallax barrier is generated electronically by a transmission type liquid crystal display element or the like, and the shape and position of the barrier stripe are formed. A three-dimensional display device that electronically variably controls such a device is disclosed in Japanese Unexamined Patent Publication No. Hei.
9 and JP-A-5-122733.

FIG. 18 is a basic configuration diagram of a three-dimensional image display device disclosed in Japanese Patent Application Laid-Open No. 3-119889.
As shown in the figure, a transmission type liquid crystal display device 101 for displaying an image and an electronic parallax barrier 103 composed of a transmission type liquid crystal display element are arranged via a spacer 102 having a thickness d. The transmissive liquid crystal display element 101 displays a parallax image captured from two directions or multiple directions as a vertical stripe image. The electronic parallax barrier 103 forms a parallax barrier pattern at an arbitrary position on the barrier surface by designating an XY address by a control unit such as the microcomputer 104, and performs the parallax barrier method. Enables stereoscopic vision according to the principle.

FIG. 19 is a configuration diagram of a display unit of a three-dimensional image display device including a liquid crystal panel display 110 and an electronic barrier 103 disclosed in Japanese Patent Application Laid-Open No. 3-119889. According to the figure, two liquid crystal layers 115 and 125 are respectively connected to two polarizing plates 111 and 11.
8 and 121,128. In this apparatus, when displaying a two-dimensional image, the display of the electronic parallax barrier pattern is stopped, and the image is made colorless and transparent over the entire image display area. Such control realizes compatibility with two-dimensional display unlike a stereoscopic image display device using a conventional parallax barrier method.

FIG. 20 is a diagram showing the difference in the parallax barrier pattern formed on the electronic parallax barrier depending on the number of viewpoints. As shown in FIG. 3A, when observing a stripe image composed of parallax images for two viewpoints, the width A of the light shielding portion as the parallax barrier and the width B of the light shielding portion may be the same. On the other hand, as shown in FIGS. 20B and 20C, as the number of viewpoints increases to three and six, the aperture ratio of the electronic parallax barrier decreases.

Japanese Patent Application Laid-Open No. 5-122733 discloses that a barrier stripe pattern is generated only in a part of an electronic parallax barrier 103 composed of a transmission type liquid crystal display element as shown in FIG. An example is disclosed in which a three-dimensional image and a two-dimensional image can be mixedly displayed in the same plane.

In addition to the parallax barrier method,
As a method of displaying a stereoscopic image using binocular disparity between the right eye and the left eye, a lenticular method is widely known. In the lenticular system, a lenticular lens having a large number of semi-cylindrical lenses arranged on the front surface of a display is used to separate images spatially entering the left and right eyes, thereby allowing an observer to observe a stereoscopic image.

(3) Description of a stereoscopic display mechanism based on depth sampling FIG. 22 shows an example of an apparatus for stereoscopic display using depth sampling.
This will be described with reference to FIG. As shown in the figure, a laser beam narrowed to a small diameter is two-dimensionally scanned using an optical polarization scanner 301 to display an image on a vibrating screen 301. Here, the vibrating screen 301 is reciprocated in the depth direction at a high speed, and an image of the cross section of the object at that position is drawn by a laser beam in synchronization with the front and rear positions of the vibrating screen 301. If the above operation is repeated at high speed, a three-dimensional image will emerge due to the afterimage effect.

According to this method, a three-dimensional image having the same shape as the object is formed in the observation space. Therefore, even if the observer moves right and left, the observer always sees the same object as the one who saw the original object from that position. You can observe and always get a natural look.

[0017]

However, in a conventional system for realizing a GUI with a display only for two-dimensional display, an object such as a window or an icon operated by a user is an object capable of three-dimensional display. There was no means for the system itself to determine whether the object was displayed in three dimensions. Therefore, when a system capable of three-dimensional display is used, there are the following disadvantages.

(1) In a device that performs three-dimensional display and two-dimensional display, when a plurality of windows, icons, and the like are displayed, an arbitrary object among them is switched to active to move the current of the application. Sometimes, switching from two-dimensional display to three-dimensional display, or switching from three-dimensional display to two-dimensional display, or the host computer cannot determine whether or not the state is the same, so the user must specify or switch one by one. did not become.

(2) Objects handled by a conventional computer system do not have depth coordinates but only plane coordinates as locations displayed on a display. For this reason, it was not possible to select the arrangement in the depth direction and the operation environment in the depth direction as desired by the user.

Further, in the binocular parallax method, a stereoscopic image is displayed using the binocular parallax between the right eye and the left eye, and thus has the following problem.

(3) A stereoscopic display using binocular parallax is different from a user observing an object in a real space, is different in convergence and a focal length, and is not suitable for long-term observation from a physiological point of view. Observation over time has given the user discomfort and discomfort.

(4) In a parallax barrier type or lenticular type stereoscopic display using binocular parallax, the region that can be observed as a stereoscopic image is narrow, and the user can observe the image by fixing his or her head to the stereoscopic visual region. It is necessary to detect the viewpoint and make the user follow the stereoscopic vision area.

Further, the method of stereoscopic display using depth sampling has the following disadvantages.

(5) A high-speed moving image forming means (vibrating screen) having a size substantially equal to the size of a three-dimensional image to be reproduced is required, so that a large-scale apparatus is required and high-speed driving becomes difficult.

(6) An object having a large mass (high-speed moving image forming means) moves at a high speed in the image reproducing space, so that there is a danger at the time of observation.

The present invention has been made in view of the above problems, and has a display control device and a display control device capable of recognizing whether or not three-dimensional display is possible for each object and appropriately controlling the display of the object. The aim is to provide a method. It is another object of the present invention to provide a display control device and a display control method that allow an object such as a window and an operation environment to be freely arranged in a depth direction and improve a user interface.

Another object of the present invention is to reproduce a bright point sequentially and at high speed in a time series so that a natural stereoscopic image can be shown to an observer, and whether or not each object is three-dimensionally displayed is recognized. And a display control method and a display control method for appropriately controlling the display of an object.

Still another object of the present invention is to provide a safe and small display device which enables stereoscopic viewing without using a vibrating screen in a system for stereoscopic display using depth sampling. It is an object to provide a display control device and method.

[0029]

A display control device according to the present invention for achieving the above object has the following arrangement. That is, a display control device capable of two-dimensional display and three-dimensional display, a determination unit that determines whether or not the object to be rendered has three-dimensional image data, and the determination unit determines whether the object to be rendered is three-dimensional image data. And a three-dimensional display unit for performing three-dimensional display on the object to be drawn when it is determined that the object has three-dimensional image data.

Preferably, the three-dimensional display means displays a composite image in which at least two parallax images are carved in a stripe shape and arranged alternately, and performs a three-dimensional display by controlling a stripe-shaped aperture. This is because a so-called parallax barrier method can be used.

Preferably, the plurality of windows are
The information processing apparatus further includes a window display means for displaying on a screen, and a control means for executing the determination means and the three-dimensional display means on an object corresponding to a designated window among the plurality of windows. This is because two-dimensional display and three-dimensional display can be mixed in the display space.

Preferably, the file of the object to be rendered includes rendering information indicating whether the file includes three-dimensional image data for three-dimensional display in a header portion of the file, The means determines whether or not the object to be drawn has three-dimensional image data based on the drawing information. This is because rendering information indicating whether or not three-dimensional display is possible is provided in the header of the file and the execution of three-dimensional display is determined using the drawing information, so that whether or not three-dimensional display can be performed can be easily determined.

[0033] Preferably, the three-dimensional display means sequentially draws the image based on the three-dimensional image by the bright spots at positions corresponding to a plurality of surfaces arranged in the depth direction in the three-dimensional display space. Things. Thereby, the observer observes the set of bright spots emitted from the three-dimensional display means as an afterimage and performs stereoscopic vision. In particular, since the drawing position by the luminescent spot is changed in the depth direction, a vibrating screen is not required, and the safety of the device is improved, and the size of the device is reduced.

Preferably, the user can operate any display object or operation environment in the depth direction of the stereoscopic display space, and a more user-friendly user interface can be provided by increasing the number of operation objects in the depth direction. is there.

Preferably, the apparatus further comprises two-dimensional display means for displaying a two-dimensional image based on two-dimensional image data on at least one plane in the three-dimensional display space. And more preferably, the plane image includes a user interface component such as a pull-down menu or an icon. This is because the operability is improved by displaying the user interface components on a two-dimensional plane.

Preferably, the apparatus further comprises a prohibition unit for prohibiting three-dimensional display by the three-dimensional display unit while moving the display position of the object. This is because three-dimensional display is not performed during the movement of the object, thereby reducing the processing load on the device.

[0037]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of the present invention will be described below with reference to the accompanying drawings. In the following embodiments, a two-dimensional display is a display that is displayed two-dimensionally (two-dimensionally) in a three-dimensional space and has no depth when viewed from an observer.
The image at this time is simply called a two-dimensional image. In addition, the three-dimensional display is a display that is displayed in a three-dimensional space in a three-dimensional manner (three-dimensionally) and has a depth as viewed from an observer.

Further, there are two-dimensional images having depth coordinates in a three-dimensional display space and those having no depth coordinates reproduced on a conventional display only for two-dimensional display. In the present embodiment, the former two-dimensional display and two-dimensional image will be mainly described.
Mention also dimensional images.

[First Embodiment] In the first embodiment,
A computer system that operates in a GUI environment operated in a three-dimensional space and includes a stereoscopic display capable of stereoscopic display will be described. The stereoscopic display method according to the present embodiment has a parallax barrier method. Before describing the features of the present invention, a three-dimensional display of the parallax barrier type in which brightness correction is provided on a three-dimensional display unit will be described.

(1) Parallax with brightness correction
Description of the barrier system and the device configuration of the present embodiment FIG. 1 is a diagram showing the device configuration of a computer system according to the first embodiment. In the present embodiment, when displaying an image, a two-dimensional image (non-stereoscopic image, one-viewpoint image information) from one viewpoint and a three-dimensional image (stereoscopic image) from a plurality of viewpoints are switched and displayed. Such a window is provided, and a two-dimensional image and a three-dimensional image are displayed for each area limited by the window.

First, a three-dimensional image displayed on the display surface of the embodiment will be described. The three-dimensional image is synthesized from images having a plurality of parallaxes (parallax images) at a plurality of viewpoints. At least two parallax images are required to combine a three-dimensional image. Here, the parallax image corresponding to the right eye is Rs, and the parallax image corresponding to the left eye is Ls. Each parallax image is formed into a vertically long striped pixel group (hereinafter, referred to as a striped pixel) Ri, Li
(I = 1, 2,...). Then, stripe pixels obtained from each parallax image are alternately arranged, that is, stripe pixels are arranged as R1, L2, R3, L4,.
1, R2, L3, R4,...) To form one image is a three-dimensional image. The following 3
The two-dimensional image is also called a stripe image.

If there are three parallax images A, B and C, the stripe image is composed of stripe pixels A1, B2 and C
3, A4, B5, C6 ... or B1, C2, A3
B4, C5, A6, ... or C1, A2, B3, C
4, A5, B6,...

In FIG. 1, reference numeral 1 denotes a first light modulation panel, which is constituted by a liquid crystal display element (hereinafter, LCD1).
The LCD 1 has a two-dimensional image (two-dimensional image information) on its display surface.
Alternatively, a three-dimensional image (three-dimensional image information) or both are mixedly displayed. Reference numeral 2 denotes a second light modulation panel, which is constituted by a liquid crystal display element (LCD2). The LCD 2 displays a parallax barrier pattern according to the display of the stripe image. In order to provide compatibility with a conventionally used two-dimensional display, the stripe image may be changed to a normal two-dimensional image and the display of the parallax barrier pattern may be stopped.

What is a parallax barrier pattern?
This is a pattern in which stripe-shaped light transmitting portions and light shielding portions for guiding light beams from the stripe pixels of the right and left parallax images constituting the stripe image displayed in No. 1 to predetermined observation positions are alternately arranged in the horizontal direction. 12, these LCDs
1 and a three-dimensional display including the LCD 2.

FIG. 2 shows a three-dimensional display 12 according to this embodiment.
FIG. 3 is a diagram illustrating a configuration of a display unit. 3 is LCD1 and L
The backlight illuminates the CD2. 21, 22, 2
Reference numeral 3 denotes a polarizing plate, and each polarization direction is indicated by an arrow. As shown in FIG. 2, the display section of the present embodiment sandwiches a polarizing plate 22 between two LCDs 2 and 1 having the same configuration, and further interposes the polarizing plate 22 with two polarizing plates 21 and 22 whose polarization directions are orthogonal to each other. And the backlight 3 behind the polarizing plate 21.
Is arranged.

Referring again to FIG. 1, reference numeral 4 denotes an LCD2 driving circuit for driving the LCD2, and reference numeral 5 denotes an LCD2 for driving the LCD1.
One driving circuit. Reference numeral 6 denotes a display driver that controls the entire drawing of the stereoscopic display according to the present embodiment, and includes the following elements 7, 8, 9, and 10.

Reference numeral 7 denotes a two-dimensional image and three-dimensional image drawing unit, which controls drawing of data actually drawn on a three-dimensional display, that is, a two-dimensional image or a three-dimensional image combined with stripes which has been conventionally handled. . Reference numeral 8 denotes a parallax barrier pattern drawing unit, which controls drawing of a parallax barrier pattern to generate a three-dimensional image. Reference numeral 9 denotes a drawing control unit that generates and allocates control signals to the two-dimensional and three-dimensional image drawing unit 7 and the parallax barrier pattern drawing unit 8 described above. An object analysis unit 10 determines and analyzes the type of drawing data.

A host computer 11 can handle two-dimensional images and three-dimensional images. The host computer 11 updates a signal to the display driver every time the drawing data is updated. In addition,
The display driver may be configured by an electronic circuit and mounted outside the host computer 11 or on a throttle, or may be mounted as one software of the host computer or a configuration in which the software and the electronic circuit are mixed. That is, the host computer 11 includes a CPU 11a and a memory 11b in which a control program for realizing the processing procedure described with reference to the attached flowchart is stored, and the function of the display driver 12 is realized by the CPU of the host computer 11. It is good. Here, the memory 11b is a ROM or RA
M or a magnetic disk driver. Therefore, a control program for implementing the processing procedure described below by the CPU 11a may be provided from a storage medium such as a floppy disk and stored in the RAM.

If the user wants to work in a computer environment with a display having only a two-dimensional display,
This is achieved by sending a signal to the parallax / barrier pattern drawing unit 8 via a drawing control unit 9 by a predetermined transmission means to stop drawing of the parallax / needle or pattern.

(2) Operation environment of this embodiment, ie, GU
Description of I FIG. 3 is a diagram showing a display example of a user interface operating in the first embodiment. Here, the stereoscopic display 110 connected to the host computer 1016
0 indicates the display state of the screen. Reference numeral 1020 denotes a work space range that indicates a range actually used in the present system in the stereoscopic image reproducible area of the stereoscopic display 1100. This work space range may be explicitly displayed according to the user's preference. Reference numeral 1025 denotes a desktop plane which can be moved to an arbitrary position, on which a pull-down menu or the like relating to the operation of the computer is provided. It is more appropriate to arrange such a pull-down menu on a two-dimensional plane for operation.

Reference numeral 1031 denotes a title bar of a desktop plane, 1032 denotes a menu bar used in a pull-down menu, and 1033a and 1033b denote windows for displaying images. 1034a and 1034b are icons which are objects for virtually displaying a disk file and an input device to a user. 1035
Is a pointer which can be moved by a mouse (not shown) to select an object by moving three-dimensionally in the work space coordinates and to input three-dimensional coordinates or local two-dimensional coordinates. 1036a and 1036b are objects that are not drawn in the window coordinate system but are drawn directly in the work space range by the global coordinate system that is the coordinate system of the entire screen. As described above, in the user interface using icons, windows, menus, and the like, a space is provided for moving, copying, and deleting files, inputting and outputting to and from a peripheral device, and performing such operations in the display space. For the purpose, objects such as icons, windows, and menus associated with a directory or an application on a file system may be moved.

(3) Outline of Operation of Application, In particular, Outline of Event Processing Next, outline of operation processing of the application will be described.
FIG. 4 is a flowchart showing the flow of processing of an application operating in the GUI environment described above. The process shown in this example is called an event-driven type.

In step S40, initialization is performed. In the initialization process, a memory in the computer system is secured to actually operate the application, the contents of a register to be used are protected, or objects such as necessary windows and icons are generated. Step S41 is processing for acquiring an event that the user works on the computer. The events referred to here include mouse movement, mouse button press / release, various key press / release, disk insertion, and the like.

In step S42, the aforementioned step S4
The process corresponding to the event acquired in 1 is executed. For example, when a file opening process is instructed from a pull-down menu using a mouse, the file opening process is actually executed. In step S43, it is determined whether or not the event is an event (end event) issued by the user acting on the computer to end the running application. If not an end event,
The process returns to step S41 to acquire a new event. If it is determined that the event is the end event, the process proceeds to step S44, where predetermined processing such as releasing the secured memory or closing the file is executed, and the application is terminated.

(4) Description of Local Coordinate System and Global Coordinate System Used in this Embodiment In this embodiment, there are two types of coordinate systems, a global coordinate system and a local coordinate diameter. The global coordinate system includes three coordinate axes orthogonal to each other at a predetermined point serving as a reference for the display position. Then, the values of the three axes, for example, (X, Y,
Z) represents the absolute position of the display object. On the other hand, the local coordinate system is composed of three coordinate axes orthogonal to each other at the reference position of the object, and values of the three axes, for example,
The position is represented by (u, v, w). Objects such as windows and icons have global coordinate values for the display location of the display range and local coordinate values of the display content.

(5) Structure of a Three-Dimensional Image File Used in the Present Embodiment The data structure of an image file drawn in a window capable of displaying a three-dimensional image with the objects used in the present embodiment will be described as an example. FIG. 5 is an explanatory diagram showing the structure of three-dimensional image data in the present embodiment. Reference numeral 50 denotes a three-dimensional image file according to the present embodiment. Reference numeral 51 denotes a file header indicating the attribute of the image file, 52 denotes three-dimensional image data subjected to stripe composition, and 53 denotes two-dimensional image data representing a characteristic two-dimensional state of the parallax images used for stripe composition. .

The conventional image file header describes the file name, file creation date, file capacity, image format, image compression method, and the like. The application analyzes the header and reads the image data. The computer was drawing. In the case of this embodiment,
In addition to the above, data unique to the three-dimensional image such as whether or not the three-dimensional image can be displayed, the number of viewpoint images of the three-dimensional image, the presence or absence of the two-dimensional image, and the like are also described.

In this embodiment, stripe-composite three-dimensional image data is stored as the three-dimensional image data of the three-dimensional image file 50, but the form of the three-dimensional image data is not limited to this. For example, it may be configured by a set of a plurality of parallax images, and may take other forms such as stripe combination on an application.

In order to clarify that the file is an image file having three-dimensional image data, a predetermined extension may be provided to the file name. Further, data relating to a window frame or an icon may be attached to the file header, or a window frame for three-dimensional display different from two-dimensional display may be used.

(6) Description of Handling of User Interface of the Present Embodiment The user interface of the present embodiment has been described above with reference to FIG. Next, handling of a three-dimensional image file which is a feature of the present embodiment will be described with reference to FIGS. FIG. 6 is a diagram illustrating a state where three-dimensional display is partially executed in the user interface according to the first embodiment.

Here, the object window 1033a in FIGS. 3 and 6 is the three-dimensional image file described above with reference to FIG. In the state of FIG.
Reference numeral 5 indicates an icon 1034a. At this time, the icon 1034a changes its color or brightness and indicates an active state. That is, it indicates that the current of the process is in this icon. At this time, the icon 1034a can be moved to another place by dragging with the mouse, or a file associated with the icon 1034a can be opened by double-clicking.

Next, it is assumed that the user moves the pointer 1035 from the state of FIG. 3 to the window 1033a, which is a three-dimensional image file, using a mouse and selects the window 1033a. Then, as shown in FIG.
The current moves to 33a, and the window 1033a becomes active. Here, since the window 1033a corresponds to the three-dimensional image file,
A three-dimensional image is drawn in 033a (a perspective view is used in place of space limitations).

The mouse used here is provided with means for indicating the depth of the display space (not shown), and can point to an arbitrary position in the three-dimensional space desired by the user. In addition, these displayed objects, such as windows and icons, and desktop planes required for operating the computer can be three-dimensionally moved using a mouse.

The processing in this case will be described with reference to FIG. FIG. 7 is a flowchart illustrating a procedure of an image display process according to the first embodiment.

In step S61, a mouse event is acquired by detecting the movement of the mouse and the presence / absence of pressing of the mouse button. In a succeeding step S62, the content of the mouse event acquired in the step S61 is updated. In step S63, as a result of the event analysis in step S62, it is determined whether or not the mouse event is an event related to drawing a window. Here, the event related to the drawing of the window is, for example, a case where the window is shifted to an active state. Here, if it is determined that it is related to the drawing of the window, the process proceeds to step S64. In step S64, it is determined from the information in the file header 51 whether or not the window has three-dimensional image data.

If it is determined in step S64 that the file is a three-dimensional image file, the flow advances to step S65. Step S
At 165, the display driver 1015 is controlled,
Perform three-dimensional display. That is, based on the three-dimensional image data obtained from the three-dimensional image data 52, the image generation unit 1015a obtains the reproduction position and intensity of the bright spot, and the three-dimensional display 1
A signal is sent to the control unit 1001 of the controller 100 to draw a three-dimensional image by the above-described configuration. On the other hand, if it is determined in step S64 that the image file of the window does not have three-dimensional image data, the process proceeds to step S166, where a two-dimensional (plane) image is displayed at a predetermined position.

If it is determined in step S63 that the generated mouse event does not relate to drawing of a window, the flow advances to step S167 to perform two-dimensional display on the three-dimensionally displayed window using the two-dimensional data of the three-dimensional image. Display.

If the window that has shifted to the non-current state performs three-dimensional display in steps S165 and S166, the display of the window may be switched to two-dimensional.

According to the processing described above, it is determined whether or not the selected object has three-dimensional data. If the selected object has three-dimensional data, the object can be automatically switched to three-dimensional display and displayed. Thus, the operability of the three-dimensional image and the two-dimensional image in the device for performing the three-dimensional display is improved.

When a three-dimensional image is drawn in step S165, the result analyzed in step S62 is naturally reflected. For example, when opening a new window, 3
For example, when the two-dimensional image drawing unit is smaller than the window drawing unit, an appropriate background is stored in a margin thereof.

Further, when performing three-dimensional display, the number of parallax images described in the file header of the three-dimensional image data is used to correct the amount of light of the backlight and adjust the brightness of the display image. The brightness may be corrected based on the aperture ratio of the parallax barrier according to the number. The brightness can be adjusted, for example, as follows. That is, a table indicating the correspondence between the number of viewpoints and the voltage applied to the backlight (the applied voltage increases as the number of viewpoints increases) is stored in the memory 11 in advance.
b, the applied voltage is obtained by referring to the table from the number of parallax images (the number of viewpoints) recorded in the file header, and the backlight is driven by the obtained applied voltage. By performing such control, an image with stable luminance can be obtained regardless of the number of viewpoints.

[Second Embodiment] (1) Outline of Difference from First Embodiment In the device configuration of the first embodiment, a liquid crystal display element which is a light modulation element for generating a parallax barrier pattern However, since an ordinary liquid crystal display element is used, a matrix structure is formed, and this electrode pattern, a driving electronic circuit and driver software tend to be complicated, and the cost tends to be high.

On the other hand, in the second embodiment, the parallax circuit has a simple configuration having no matrix structure.
The configuration of barrier generation control is adopted.

(2) Description of the Configuration of the Parallax Barrier of the Second Embodiment In the second embodiment, the parallax barrier pattern is switched over the entire surface. Therefore, the liquid crystal LCD 2 (FIG. 2) that generates the parallax barrier pattern may have a stripe structure. That is, L of the first embodiment
A matrix control such as a normal liquid crystal display element such as a CD2 is not required, and the control of the LCD 2 is sufficient only by a signal for turning on / off a parallax barrier pattern. Therefore, simple and low-cost liquid crystal display elements, drive circuits, and driver software can be used.

Further, in order to use the conventional apparatus for reproducing only a two-dimensional image as in the first embodiment, the parallax barrier pattern is turned off and the conventional image is displayed on the LCD 1. . With the above configuration, the same effects as in the first embodiment can be obtained.

[Third Embodiment] In the above embodiment,
A configuration is adopted in which a user acts on each object to forcibly perform two-dimensional and three-dimensional display control. Such a configuration cannot cope with a case where the user does not want to observe three-dimensional images or a case where the user always wants to observe three-dimensional images. In the following, in the third embodiment, a configuration will be described in which the user can arbitrarily set the state of the three-dimensional display, similarly to the above-described embodiments.

FIG. 16 is a view showing a display state of a three-dimensional display screen for explaining the operation method of the third embodiment.
The user moves the pointer 1035 with the mouse according to the second embodiment, sets a three-dimensional display state by a pull-down operation from the menu bar (selects “option”, which is an entry of the menu bar 1032 in the figure), and performs predetermined processing. Can be run with In FIG. 16, the display state is automatically changed according to the object selected as in the first embodiment (“out” of the “option” entry).
o)) Does not perform three-dimensional display but only two-dimensional display (“2D” in the “option” entry), and continues three-dimensional display even if the current shifts to two-dimensional display (“option”)
"3D" in the entry of "3") or setting of the three-dimensional display time ("3d time" in the entry of "option") can be selected.

The operation according to the above settings is as follows.
Step S6 in the flowchart shown in FIG.
3. It is obvious to those skilled in the art that the present invention is realized by switching the branch condition of S64 according to each setting.

As described above, by adopting the configuration described in the third embodiment, a display environment suitable for the user's preference can be set, and a user-friendly environment can be provided.

[Fourth Embodiment] In a stereoscopic display for observing a stereoscopic image by using the parallax between the image for the right eye and the image for the left eye, contradiction occurs between the convergence angle of both eyes and the focal length of the eyes. Some observers complain of physiological discomfort due to long-term observation because of the fact that the amount of parallax is not appropriate or the like.

In the fourth embodiment, a user can arbitrarily set a three-dimensional image so as to alleviate or eliminate physiological discomfort. The user can arbitrarily set the three-dimensional display time by using a user interface (not shown) such as a pull-down menu or a keyboard.

As described above in the fourth embodiment,
The user can arbitrarily set the display time of the three-dimensional display, so that physiological discomfort caused by long-term observation can be reduced or eliminated.

In the above-described first to fourth embodiments, the mixed display of the two-dimensional image and the three-dimensional image by the stereoscopic display for realizing the stereoscopic vision using the binocular parallax has been described. According to each of the above embodiments, it is possible to determine whether or not the object is a three-dimensional object, and control the switching between two-dimensional display and three-dimensional display based on the result of the determination. Third,
According to the fourth embodiment, since the user can make desired settings for three-dimensional display, a computer system that handles comfortable two-dimensional display and three-dimensional display is provided.

In the above embodiment, the parallax
Although the barrier method has been described, other computer systems using binocular parallax and having a three-dimensional display that can mix or switch between two-dimensional and three-dimensional display can adopt a similar configuration. Similar effects can be obtained. Furthermore, in the above description, although the window was mainly described as an object, a similar configuration is established for other objects such as icons, and the same effect is obtained.

[Fifth Embodiment] In the fifth embodiment,
At the time of image display, a three-dimensional display system is adopted in which bright points are sequentially reproduced in a display space in a time-series and high-speed manner, and by using an afterimage of the observer, the observer can observe the set of bright points as a three-dimensional image. Such a three-dimensional display method and a graphical work environment in a three-dimensional display space provide a user-friendly user interface.

(1) Description of Computer System According to Fifth Embodiment FIG. 8 is a block diagram showing a device configuration of a computer system according to the present embodiment. In the figure, reference numeral 1100 denotes a stereoscopic display for reproducing a stereoscopic image in the present embodiment, and a specific display principle and configuration will be described later.

Reference numeral 1015 denotes a display driver for controlling drawing on the three-dimensional display according to the fifth embodiment, which comprises the following elements 1015a, 1015b, and 1015c. Reference numeral 1015a denotes an image generation unit for reproducing a three-dimensional image, which generates data (data indicating the position and intensity of a luminescent spot) to be actually drawn on a three-dimensional display. 10
An object analysis unit 15b determines and analyzes the type of drawing data. An event processing unit 1015c updates a message from the host computer, mainly a display content. Reference numeral 1016 denotes a host computer which processes an operating system (OS) and application software. Host computer 1
Step 016 updates the signal to the device driver every time the drawing data is updated.

The display driver may be constituted by an electronic circuit and mounted outside the host computer or on a throttle. Alternatively, the display driver may be implemented as a single software of the host computer or a configuration in which the software and the electronic circuit are mixed. Is also good. That is, the host computer 1016 includes a CPU 1016a and a memory 1016b in which a control program for realizing the processing procedure described with reference to the attached flowchart is stored, and the functions realized by the display driver 1015 are realized by the CPU 1016a of the host computer 1016. You may do it. Here, the memory 1016b has a ROM or RA
M or a magnetic disk driver. Therefore, a control program for realizing the processing procedure described below by the CPU 1016a may be provided from a storage medium such as a floppy disk, and loaded into the RAM for execution of the processing by the CPU 1016a.

(2) Explanation of Principle of Stereoscopic Display According to Fifth Embodiment A stereoscopic display 1100 shown in FIG. 8 will be described. The three-dimensional display of the present invention is roughly divided into a control unit 1001, a pulse beam forming unit 1102, a bright spot scanning unit 1103, and an image observation optical system 1009. The control unit 1001 inputs the scan information signal of the bright spot from the bright spot scan unit 1103, and outputs the luminance information signal of the bright spot to the pulse beam forming unit 110.
Output to 2. The pulse beam forming unit 1102 modulates the intensity of light from the light source based on the luminance information signal to form a high-frequency pulsed light beam and emits a bright spot. The luminescent spot scanning unit 1103 converts the light beam into a condensed light beam, and sets the converged point to a value including 3 in the optical axis direction (Z direction).
High-speed scanning is performed two-dimensionally, and the scan beam is emitted to the image observation optical system 1009. The image observation optical system 1009 sequentially forms images of bright spots in the three-dimensional space (observation space) by the scan beam processed in this way, and allows the observer to recognize the bright spots.

Here, since the speed of beam scanning and the luminance modulation are sufficiently high and the two are properly synchronized, an observer observing from a predetermined direction of the image observing optical system 1009 can observe by the afterimage effect. In space, a three-dimensional image can be observed as a set of bright spots.

FIG. 9 is a schematic view of a main part of the three-dimensional display of this embodiment. In the figure, reference numeral 1001 denotes a control unit, which is constituted by an electric circuit. The control unit 1001 obtains the scan information from the bright spot scanning unit 1103, obtains the position of the bright spot to be formed, and outputs the corresponding luminance information signal to the pulse beam forming unit 1
Output to 102.

Reference numeral 1002 denotes a light source, which uses a single-color LED point light source in the visible region in order to enhance the imaging performance. As the light source 1002, a light source having high spatial coherency, for example, an LED semiconductor laser, a metal halide lamp, or the like is appropriate. Note that this point light source may be replaced with a point light source obtained by causing a parallel beam to enter the imaging optical system.

Reference numeral 1004 denotes a transmittance control unit as intensity adjusting means, which uses a high-frequency modulation element such as an AOM (acoustic optical element) or EO (electro-optical device). As shown, the transmittance control unit 1004 is disposed on the optical path of the light beam, and controls the transmittance of the light beam emitted from the light source in response to the luminance information signal output from the control unit 1001, that is, the intensity of the light beam. adjust. However, the light source 100
If the emission intensity of the light source 2 itself can be modulated at a high frequency, the light emission intensity of the light source can be directly adjusted in accordance with the luminance signal output from the control unit 1, so that the transmittance control unit 4 is unnecessary. The above light source 1002 and transmittance control unit 1004
Constitutes one element of the pulse beam forming unit 1102.

Reference numeral 1005 denotes z as the optical axis direction scanning means.
It is a scanning unit. FIG. 10 is a diagram showing a detailed configuration of the z-scan unit. The z-scan unit 1005 includes a small zoom lens (condensing optical system) 1005-1 having an effective diameter slightly larger than the beam diameter, and a zoom lens 1005-
1 includes a movable lens (scan element) 1005-4, a linear motor 1005-2 for reciprocating the movable lens 1005-4 at high speed along the optical axis direction, and the like.

The zoom lens 1005-1 includes a light source 1002
Is focused at a certain distance on the optical axis. Further, the linear motor 1005-2 is moved in the optical axis direction (in the x direction in FIG.
006 deviates in the z-direction, so that it reciprocates linearly along the z-direction). With these configurations, the focal length of the zoom lens 1005-1 vibrates, and the focal point F of the light beam scans back and forth at high speed in the optical axis direction. That is, the z scan unit 100
Numeral 5 scans the focal point (luminance) of the light beam in the Z direction.

The displacement ZL of the movable lens unit 1005-4 is detected by a displacement detector (displacement detector) 1005-3 and transmitted to the controller 1001 as a scan information signal. In the case of the fifth embodiment, the displacement amount detection unit 1005-3
Uses an encoder for detecting the position of a linear motor. If there are a plurality of movable parts of the zoom lens, the number of linear motors may be increased or the gears and cams may be used to move appropriately.

In FIG. 9, reference numeral 1006 denotes a beam scanning unit. FIG. 11 is a block diagram showing a detailed configuration of the beam scanning unit 6. In the case of the present embodiment, the beam scanning unit 1006 functions as a two-dimensional scanning unit.
One set of galvanometer mirrors 1006- orthogonal to the scanning direction
1,1006-2. Motors 1006-3, 1006-4 for driving these galvanometer mirrors
Performs a reciprocating rotary motion. Accordingly, the light beam is directed in a direction corresponding to the rotation angle of each galvanometer mirror, that is, x in the observation space.
The light is deflected in the direction y and scanned two-dimensionally.

The galvanomirror 1006-1 of this embodiment
The rotation direction of the mirror is horizontal and that of the galvanometer mirror 1006-2 is vertical. The deflection angles θH and θV of the respective mirrors are detected by encoders built in the motors 1006-3 and 1006-4. It is transmitted to the control unit 1001 as scan information indicating the position of the bright spot.

The z-scan unit 1005 and the beam scan unit 1006 constitute one element of the bright spot scan unit 1103. In addition, the bright spot scanning unit 11 of the present embodiment
03 constitutes one element of the three-dimensional scanning means.

In FIG. 9, reference numeral 1009 denotes an image observation optical system. In this embodiment, the image observation optical system 1009 uses two large-diameter convex lenses. Image observation optical system 10
A step 09 converges a light beam emitted from the beam scanning unit 1006 to a predetermined observation area, forms an exit pupil of the entire apparatus, and forms a three-dimensional image by a bright spot in the observation area.

The operation of the present embodiment will be described. Light source 100
The intensity of the luminous flux emitted from the z-scan unit 1 is modulated by a signal from the control unit 1 in a transmittance control unit 1004.
The beam is emitted to 005. The z-scan unit 1005 converts the incident light beam into a condensed light beam, and scans the condensed point back and forth at high speed in the z-direction. The beam scanning unit 1006 deflects the condensed light incident parallel to the x-axis in the z-direction and two-dimensionally scans a predetermined area in the xy plane.

FIG. 12 is a view of the optical path from the vertical direction until the light beam exits the bright spot scanning unit 1103 in the fifth embodiment.

The principal ray 7 of the light beam emitted from the bright spot scanning unit 1103 is emitted in a direction diverging from the bright spot scanning unit 1103. In this state, the light beam entering the eye of the observer 8 is at the center. There are only a few parts. Therefore, in the present embodiment, the light beam emitted from the bright spot scanning unit 1103 is appropriately converged by the image observation optical system 1009.

FIG. 13 is a diagram showing the optical path from when the light beam exits the image observation optical system 1009 and reaches the observer in the fifth embodiment as viewed from vertically above. The operation of the image observation optical system 1009 will be described with reference to FIG.

When the optical system up to the bright spot scanning unit 1103 and the observation optical system 1009 are regarded as one optical system,
The position of the pupil 1010 of this optical system is the rotation center position of the galvanomirror (more precisely, the pupil center of the optical path in the meridional direction is the rotation center of the vertical galvanomirror). At this time, the pupil 1010 is an entrance pupil for the image observation optical system 1009, and forms an image on the exit pupil 1010 'by the image forming action of the image observation optical system 1009.

The exit pupil 1010 'is also an exit pupil for all optical systems. Therefore, since all the light beams that have passed through the entire optical system pass through the exit pupil 1010 ', if the observer 1008 places his or her eyes in the exit pupil 1010', it can recognize the bright spots of all the light beams. it can. As shown in FIG. 13, the optimal observation distance when observing a three-dimensional image with the present apparatus is a distance L (a distance from the front surface of the image observation optical system 1009 to the exit pupil 1010 ′), an observation viewing zone. Is the diameter D of the exit pupil 1010 '.

First, the conditions required for the image observation optical system 1009 are as follows.
09, the observation distance on the observer 1008 side is (Equation 10c).
Second, the principal ray 1007 of each light beam forms a bright spot, and then the exit pupil 101 is formed.
In order to intersect at the center of 0 ', the image observation optical system 10
09 is set to be larger than the three-dimensional image to be reproduced, and thirdly, the F-number (the value obtained by dividing the focal length by the diameter of the pupil) in order to make the observation visual field D as large as possible.
(A lens whose effective diameter of the image observation optical system 1009 is as large as possible and whose focal length is as short as possible).

As a result of scanning by the luminance scanning unit 1103, the light beam forms a group of bright spots (Xi, Yi, Zi) in a certain range in the three-dimensional space.

Next, the relationship between the control of the pulse beam forming 1102 and the bright spot scanning unit 1103, the data processing performed by the control unit 1001, and the information of the reproduced three-dimensional image will be described. In the present embodiment, first, the state of each scan device of the bright spot scanning unit 1103, that is, the rotation angle θH of the horizontal scanning galvanomirror, the vertical scanning galvanomirror θV, and the z-direction displacement (scan element displacement) ZL of the linear motor. The three parameters are detected, and the state of each of these scanning means, that is, as a scan information signal, is output from the control unit 10.
Enter 01.

The control unit 1001 determines the intensity L (θ of the light beam corresponding to the scan position based on the stereoscopic image to be displayed.
H, θV, ZL), and transmits a luminance signal to the pulse beam forming unit 1102. The light beam thus formed passes through the bright spot scanning unit 1103 and the image observation optical system 100.
9, the image is formed at the final light condensing position (luminance position), and the luminance L ′ is obtained at the position (x, y, z).
A (x, y, z) bright point is formed.

As shown in FIG. 14, the luminance position (x, y, z) and the luminance L '(x, y, z) by the image observation optical system 9 are obtained.
If the optical conversions are φ1 and φ2, the above data flow can be represented by the schematic diagram of FIG.

The bright spot scanning unit 1103 controls the control unit 100
Scan device information (θH, θV, Z
L) undergoes a conversion of Ψ1 inside the control unit 1001 and is converted into position information (x, y, z) of an image point. Control unit 1001
Refers to previously generated three-dimensional image data, searches for a three-dimensional image point that matches the position (x, y, z), and if it exists, luminance information L '(x, y, z) for that point Get)

Next, the control unit 1001 performs inverse transform of Ψ2Ψ2 ^ −1 on the luminance information L ′ (x, y, z) to obtain pulse beam luminance information L (θH, θV, zL). . However, regarding the conversion Ψ1 and the inverse conversion Ψ2 ^ −1, if the characteristics (aberration, transmittance, etc.) of the image observation optical system 1009 are grasped in advance by simulation or actual measurement, pseudo execution can be performed on the control unit 1001. it can.

The luminance information L ′ (θH ′, θV ′, zL ′) is transmitted to the pulse beam forming unit 1102, and the pulse beam forming unit 1102 controls the light beam intensity based on this. The light beam thus formed is applied to the bright spot scanning unit 1.
Injected to 103. Then, the image observation optical system 10
09, the optical transformations Ψ1 and Ψ2 are received, and the position (x, y,
In z), a bright spot having a luminance L ′ (x, y, z) is formed.

Note that part or all of the signal processing described with reference to FIG.
6 may be taken.

The above-mentioned luminescent spot has a luminance corresponding to each position. Then, the luminance shift is performed at such a high speed that it cannot be recognized by the human eye, and a set of these bright spots can be observed at once as a whole (one of three-dimensional scanning of the light beam).
If one cycle (reproduction of one stereoscopic image) is performed at a high speed of 1/30 second or less, an afterimage effect appears.)

In the present embodiment, a bright three-dimensional image is formed by bright spots of a light beam from a light source having high luminance, and a part of the light beam is directly incident on the observer's eyes. Can be. Further, as compared with the conventional stereoscopic display, by appropriately selecting the image observation optical system 100, the observation field of view can be widened and a large three-dimensional image can be obtained. Also, by moving the two-dimensional liquid crystal display device at high speed,
In contrast to the method of observing a three-dimensional image based on the afterimage, a large moving object is not used, so that the observation is safe.

As described above, by reproducing the bright spots corresponding to the three-dimensional coordinates of the object in the three-dimensional space in real space at high speed and sequentially, a three-dimensional display having a natural three-dimensional appearance can be realized. The difference from the first embodiment is the three-dimensional marking method and the three-dimensional marking coordinate conversion part, and the remaining parts, for example,
The user interface, the method of event processing, and the like can have the same configuration as in the first embodiment. Therefore, according to the present embodiment, the same effect as that of the first embodiment can be obtained.

[Sixth Embodiment] In a system for performing three-dimensional display, a user may move an object to an arbitrary position in a display area for a certain purpose. Naturally, the objects to be moved include 3
A window displaying a dimension is also included. However, in a display that performs stereoscopic display as described in the first embodiment, when a window during three-dimensional display is moved, the processing load on the computer increases due to display control of a parallax image in the window. Further, in a three-dimensional display as described in the fifth embodiment,
Optical conversion Ψ1, Ψ2 while moving 3D window
And so on, and the load of computer processing also increases. That is, it is not desirable that the movement of the object is performed simultaneously with the drawing of the three-dimensional image in the three-dimensional display device because the processing load on the computer becomes very heavy.

Therefore, in the sixth embodiment, when an object displayed three-dimensionally is moved (drag operation), the target object is displayed two-dimensionally in order to reduce the load on the computer system. Then, when the drag operation is completed, a process of returning the object to the three-dimensional display again is performed. Note that such processing is realized by appropriately setting the branch condition in step S63 of each flowchart shown in FIG.

As described above, when the object of the three-dimensional display is dragged, by performing the two-dimensional display, the processing load of the hardware and the software can be reduced. When the user is dragging the window, it is sufficient to know where to place the dragged object. Therefore, there is no practical problem even if two-dimensional display is performed during the dragging.

In the fifth embodiment, the mixed display of the two-dimensional image and the three-dimensional image by the stereoscopic display for realizing the stereoscopic vision by the afterimage effect by sequentially reproducing the bright spots at a high speed has been described. According to each of the above embodiments, it is possible to determine whether or not the object is a three-dimensional object, and control the switching between two-dimensional display and three-dimensional display based on the result of the determination.

Particularly, according to the third and fourth embodiments, 3
Since the user can perform desired settings for the three-dimensional display, a computer system that performs comfortable three-dimensional display is provided.

Further, according to the stereoscopic display method shown in the fifth embodiment, since the focal lens system is driven without using the vibrating screen, the size of the apparatus can be reduced, and the safety of the apparatus can be improved.

In addition to the above-described embodiment, even in a computer system having a three-dimensional display for sequentially reproducing bright points at high speed and observing a three-dimensional image by an afterimage effect, the same effect can be obtained by adopting the same configuration. Is obtained. Further, in the above description, the window has been mainly described as an object. However, the same configuration holds for other objects such as icons, and the same effect can be obtained.

The present invention can be applied to a system composed of a plurality of devices (for example, a host computer, an interface device, a reader, a printer, etc.), but can be applied to a single device (for example, a copier, a facsimile). Device).

Further, an object of the present invention is to provide a storage medium storing a program code of software for realizing the functions of the above-described embodiments to a system or an apparatus, and to provide a computer (or CPU) of the system or apparatus.
And MPU) read and execute the program code stored in the storage medium.

In this case, the program code itself read from the storage medium implements the functions of the above-described embodiment, and the storage medium storing the program code constitutes the present invention.

As a storage medium for supplying the program code, for example, a floppy disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD
-R, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.

When the computer executes the readout program code, not only the functions of the above-described embodiment are realized, but also the OS (Operating System) running on the computer based on the instruction of the program code. ) May perform some or all of the actual processing, and the processing may realize the functions of the above-described embodiments.

Further, after the program code read from the storage medium is written into a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, based on the instruction of the program code, It goes without saying that the CPU included in the function expansion board or the function expansion unit performs part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

When the present invention is applied to the storage medium, the storage medium stores program codes corresponding to the above-described flowcharts. Each module shown will be stored in a storage medium.

That is, the program codes of at least the “determination processing module” and the “three-dimensional display processing module” may be stored in the storage medium. Preferably, as shown in FIG. 23, a “window display processing module”, a “control processing module”, and a “two-dimensional display processing module” are stored.

Here, the judgment processing module is a program module that implements a judgment process for judging whether or not the object to be drawn has three-dimensional image data. In addition, the three-dimensional display processing module is configured to execute a three-dimensional display process for performing three-dimensional display on the object to be rendered, when the object to be rendered is determined to have three-dimensional image data by the determination process. Module.

Further, the window display processing module comprises:
This is a program module that implements window display processing for displaying a plurality of windows on one screen. The control processing module is a program module that implements control processing for executing the determination processing and the three-dimensional display processing on an object corresponding to a specified window among the plurality of windows. Further, the two-dimensional display processing module is a program module that implements two-dimensional display processing for performing two-dimensional display on a non-designated window of the plurality of windows.

[0136]

As described above, according to the present invention,
It is possible to recognize whether or not three-dimensional display is possible for each object, and it is possible to appropriately control the display of the object.

[0137]

[Brief description of the drawings]

FIG. 1 is a diagram illustrating an apparatus configuration of a computer system according to a first embodiment.

FIG. 2 is a diagram illustrating a configuration of a display unit of the stereoscopic display 12 according to the embodiment.

FIG. 3 is a diagram illustrating a display example of a user interface operating in the first embodiment.

FIG. 4 is a flowchart illustrating a processing flow of an application operating in a GUI environment.

FIG. 5 is an explanatory diagram illustrating a structure of three-dimensional image data according to the embodiment.

FIG. 6 is a diagram illustrating a state where three-dimensional display is partially executed in the user interface according to the first embodiment.

FIG. 7 is a flowchart illustrating a procedure of an image display process according to the first embodiment.

FIG. 8 is a block diagram illustrating a device configuration of a computer system according to a fifth embodiment.

FIG. 9 is a schematic diagram of a main part of the stereoscopic display of the embodiment.

FIG. 10 is a diagram illustrating a detailed configuration of a z-scan unit.

FIG. 11 is a block diagram showing a detailed configuration of a beam scanning unit 6.

FIG. 12 is a diagram illustrating an optical path from the vertical direction until a light beam exits a bright spot scanning unit 1103 in the fifth embodiment.

FIG. 13 is a diagram showing an optical path from when a light beam exits an image observation optical system 1009 to reach an observer viewed from above vertically in the fifth embodiment.

FIG. 14 is a diagram illustrating optical conversion by the image observation optical system 9 of the present embodiment.

FIG. 15 is a schematic diagram of a data flow in the present embodiment.

FIG. 16 is a diagram illustrating a display state of a stereoscopic display screen illustrating an operation method according to a sixth embodiment.

FIG. 17 is a hierarchical diagram of a typical computer system using a GUI as an operating system.

FIG. 18 is a basic configuration diagram of a stereoscopic image display device disclosed in Japanese Patent Application Laid-Open No. 3-119889.

FIG. 19 shows a liquid crystal panel display 110 and an electronic barrier 10 disclosed in JP-A-3-119889.
3 is a configuration diagram of a display unit of the stereoscopic image display device configured by No. 3. FIG.

FIG. 20 is a diagram showing a difference in a parallax barrier pattern formed in an electronic parallax barrier according to a difference in the number of viewpoints.

FIG. 21 is a diagram showing a state in which a barrier stripe pattern is partially generated.

FIG. 22 is a diagram illustrating an example of a device that performs stereoscopic display using depth sampling.

FIG. 23 is a diagram showing an example of a memory map of a storage medium for storing a control program according to the present invention.

[Explanation of symbols]

 REFERENCE SIGNS LIST 1 First light modulation panel (LCD) 2 Second light modulation panel (LCD) 3 Backlight 4, 5 Drive circuit 6 Display driver 7 2D image and 3D image drawing unit 8 Parallax barrier pattern drawing unit 9 Drawing control unit 10 Object analysis unit 11 Host computer 21, 22, 23 Polarizer 30 Outer frame 31 Title bar 32 Menu bar 33 Window 34a, 34b, 34c, 34d Icon 35 Pointer 36 Background 50 3D image file 51 File header 52 3 2D image data 53 2D image data

Claims (23)

[Claims] 1. A display device capable of three-dimensional display, comprising: a determination unit configured to determine whether an object to be displayed on the display device has three-dimensional image data; When it is determined that the object has three-dimensional image data, a three-dimensional display unit that performs three-dimensional display on the object, and the determination unit determines that the object to be displayed does not have three-dimensional image data. In a case, the display control device further comprises: two-dimensional display means for performing two-dimensional display of the object in the display space. 2. The display device capable of three-dimensional display performs stereoscopic display by selectively showing at least two parallax images to left and right eyes of an observer.
3. The display control device according to 1. 3. A display device capable of three-dimensional display, wherein at least two parallax images are carved in a stripe shape and alternately arranged, and a three-dimensional display that generates a three-dimensional display by generating a stripe-shaped opening. 2. The display control device according to claim 1, further comprising: a unit, and a two-dimensional display control unit that performs two-dimensional display by removing an opening on a stripe together with a two-dimensional image having no parallax image. 4. The three-dimensional display means displays a composite image in which at least two parallax images are carved in stripes and arranged alternately, and performs three-dimensional display by controlling stripe-shaped apertures. The display control device according to claim 1. 5. A window display means for displaying a plurality of windows in a display space, and a control means for executing the determination means and the three-dimensional display means on an object corresponding to a designated one of the plurality of windows. The display control device according to claim 1, further comprising: 6. The display control device according to claim 5, further comprising two-dimensional display means for performing two-dimensional display on a window in a non-designated state of the plurality of windows. 7. The file of the drawing object includes drawing information indicating whether the file includes three-dimensional image data for three-dimensional display in a header part of the file. The display control device according to claim 1, wherein it is determined whether or not the object to be drawn has three-dimensional image data based on the drawing information. 8. The image processing apparatus according to claim 1, further comprising adjusting means for adjusting display brightness of the striped image based on the number of parallax images when controlling the striped image and the striped aperture. Item 4. The display control device according to item 3. 9. The display control device according to claim 1, further comprising setting means for setting a three-dimensional display time on the three-dimensional display means to a desired time. 10. A user can arbitrarily decide whether to always perform three-dimensional display of a three-dimensionally displayable part or to always perform two-dimensional display of a three-dimensionally displayable part, regardless of the designated state of each of the plurality of windows. The display control device according to claim 5, further comprising a setting unit configured to set the display control. 11. The apparatus according to claim 1, wherein the determination unit determines whether the object to be rendered has three-dimensional image data based on an extension added to a file of the object to be rendered. 2. The display control device according to 1. 12. The three-dimensional display means sequentially draws, based on a three-dimensional image, bright spots of an image based on a three-dimensional image at positions corresponding to a plurality of surfaces arranged in a depth direction in a three-dimensional display space. The display control device according to claim 1, wherein the observer observes a set of bright spots emitted from the three-dimensional display means with an afterimage and performs stereoscopic vision. 13. The display control device according to claim 12, further comprising two-dimensional display means for displaying a two-dimensional image based on two-dimensional image data on at least one plane in the three-dimensional display space. . 14. The display control device according to claim 13, wherein the two-dimensional image includes a user interface component such as a pull-down menu or an icon. 15. The display control device according to claim 1, further comprising a prohibition unit for prohibiting three-dimensional display by the three-dimensional display unit while moving the display position of the object. 16. A method for controlling a display device capable of two-dimensional display and three-dimensional display, comprising: a determining step of determining whether an object to be rendered has three-dimensional image data; The object to be drawn is 3
A three-dimensional display step of performing three-dimensional display on the object to be drawn when it is determined that the object has two-dimensional image data. 17. A window display step of displaying a plurality of windows in a display space, and a control step of executing the determination step and the three-dimensional display step on an object corresponding to a specified one of the plurality of windows. The display control method according to claim 17, further comprising: 18. The display control method according to claim 17, further comprising a two-dimensional display step of performing two-dimensional display on a window in a non-designated state of the plurality of windows. 19. The display control method according to claim 16, further comprising a prohibition step of prohibiting three-dimensional display by the three-dimensional display step while moving the display position of the object. 20. A computer-readable memory storing a control program for controlling a display device capable of two-dimensional display and three-dimensional display, wherein a determination is made as to whether or not the object to be rendered has three-dimensional image data. The code of the process, and the object to be drawn is 3
A code for a three-dimensional display step of performing three-dimensional display on the object to be drawn when it is determined that the object has three-dimensional image data. 21. A code for a window display step of displaying a plurality of windows in a display space, and executing the determination step and the three-dimensional display step on an object corresponding to a specified window among the plurality of windows. 21. The computer-readable memory of claim 20, further comprising a control step code. 22. The computer-readable memory according to claim 21, further comprising a code of a two-dimensional display step of performing two-dimensional display on a window in a non-designated state of the plurality of windows. 23. The computer-readable memory according to claim 22, further comprising a code of a prohibition step of prohibiting three-dimensional display by the three-dimensional display step while moving a display position of the object.