JP4222875B2 - 3D image display apparatus and program - Google Patents

Description

[0001]
[Industrial application fields]
The present invention relates to a stereoscopic image display device and a program.
[0002]
[Prior art]
Conventionally, as a stereoscopic technique, a stereoscopic method without glasses using a parallax barrier, a stereoscopic method with glasses using polarized glasses, liquid crystal shutter glasses, and the like are known. In addition, as a stereoscopic image, there is not only a live-action image but also a 3D drawing image in which an object placed in a virtual space is projected onto a plane and drawn using computer graphics. Furthermore, a right-eye image and a left-eye image can be created by performing the drawing process from two viewpoints. In addition, a stereoscopic video receiving apparatus and a stereoscopic video system that generate a stereoscopic video based on depth information extracted from a two-dimensional video signal and the two-dimensional video signal have been proposed (see Patent Document 1). If a video file composed of two-dimensional video and depth information is created, a stereoscopic video can be generated when this file is opened. In addition, a method has been proposed in which two videos are broadcast as one-channel video and can be stereoscopically viewed on the receiver side (see Patent Document 2). If a video file composed of two videos is created, a stereoscopic video can be generated when the file is opened.
[0003]
[Patent Document 1]
JP 2000-78611 A [Patent Document 2]
Japanese Patent Laid-Open No. 10-174064
[Problems to be solved by the invention]
By the way, for example, when an HTML file is being drawn by a web browser, if the mouse cursor is superimposed on an object such as a banner advertisement, the cursor is drawn on the near side of the object (overwritten). At that time, as shown in FIGS. 11A and 11B, the shape of the cursor may change. When the object is displayed by popping out, the same image is prepared for the number of viewpoints and is shifted in the horizontal direction and displayed so as to meet the specification of the stereoscopic display device. In the two-lens parallax barrier system, two images are prepared, shifted in the horizontal direction, and alternately displayed for each line. As a result, an image in which characters are doubled is obtained. When a parallax barrier is placed, each image is observed separately on the left and right eyes, and the object appears to pop out.
[0005]
When the mouse cursor is overlaid on an object displayed in such a manner, the user feels uncomfortable when the cursor is overwritten. This is because, as shown in FIG. 12, the cursor that should be in the back is displayed as if only the overlapped area was in front. An object may be an icon on a desktop as well as an object on such an application. In the case of an icon, there may be a situation where the position is replaced with the cursor side instead of the object side. For example, the same thing occurs when a three-dimensionally displayed folder, an application shortcut, or an icon is dragged and superimposed on a window.
[0006]
In view of the above circumstances, the present invention provides a stereoscopic image display device that can eliminate a sense of incongruity caused by a cursor or the like that should originally exist on the far side of a stereoscopically displayed object being displayed on the near side, and The purpose is to provide a program.
[0007]
[Means for Solving the Problems]
In order to solve the above-described problem, a stereoscopic video display device according to the present invention is a stereoscopic video display device that generates a stereoscopic video image, a unit that draws a plurality of viewpoint images to stereoscopically display an object, and a pointing device Means for drawing so that the cursor or object is moved and displayed on the screen according to the operation information, means for determining an overlap between the object displayed in three dimensions and the cursor or the object, and when the overlap is determined, And a means for drawing a multi-viewpoint image of the cursor or object so that the cursor or object is stereoscopically viewed in front of the stereoscopically displayed object. When a stereoscopically displayed object or a stereoscopically displayed cursor is stereoscopically viewed on the front side, the stereoscopically displayed object or the stereoscopically displayed cursor is enlarged and rendered, and when stereoscopically viewed on the far side, it is stereoscopically displayed. An object or a three-dimensionally displayed cursor may be subjected to reduced drawing processing.
[0008]
The stereoscopic video display device according to the present invention is a stereoscopic video display device that generates a stereoscopic video image. The stereoscopic video display device has a means for rendering a plurality of viewpoint images for stereoscopic display of an object, and on the screen according to operation information of the pointing device. A means for rendering the cursor or object to be moved and displayed, a means for determining an overlap between the object displayed in three dimensions and the cursor or the object, and the cursor or object not being displayed when the overlap is determined. And a means for performing a drawing process. Such a stereoscopic video display device may be configured to perform drawing processing so that the cursor or object is gradually erased.
[0009]
The stereoscopic video display device according to the present invention is a stereoscopic video display device that generates a stereoscopic video image. The stereoscopic video display device has a means for rendering a plurality of viewpoint images for stereoscopic display of an object, and on the screen according to operation information of the pointing device. A means for drawing so that the cursor or object is moved, a means for determining an overlap between the object displayed in a three-dimensional display and the cursor or the object, and only an outline as the cursor or object when the overlap is determined And a means for performing a drawing process so that the transparent cursor or transparent object is displayed.
[0010]
The stereoscopic video display device according to the present invention is a stereoscopic video display device that generates a stereoscopic video image. The stereoscopic video display device has a means for rendering a plurality of viewpoint images for stereoscopic display of an object, and on the screen according to operation information of the pointing device. A means for drawing so that the cursor or object is moved and displayed, a means for determining an overlap between the object displayed in three dimensions and the cursor or object, and all or one of the cursor or object when the overlap is determined. And a means for performing drawing processing using pixel data of the object displayed stereoscopically.
[0011]
In these stereoscopic video display devices, when a stereoscopically displayed object is stereoscopically viewed on the front side, the stereoscopically displayed object is enlarged and drawn, and when stereoscopically viewed on the back side, the stereoscopically displayed object is reduced and drawn. You may come to process.
[0012]
Further, the program of the present invention includes a means for drawing a plurality of viewpoint images for stereoscopic display of an object, a means for drawing such that a cursor or an object is moved and displayed on a screen according to operation information of a pointing device, and A means for determining an overlap between a three-dimensionally displayed object and a cursor or an object, and when the overlap is determined, the cursor or the object is stereoscopically viewed in front of the three-dimensionally displayed object. It is characterized by functioning as a means for drawing a multi-viewpoint image of a cursor or object. In addition, when the stereoscopically displayed object or the stereoscopically displayed cursor is stereoscopically viewed on the near side, the computer performs an enlarged drawing process on the stereoscopically displayed object or the stereoscopically displayed cursor, and when the stereoscopically displayed object is stereoscopically viewed on the back side The object displayed in a three-dimensional manner or the cursor displayed in a three-dimensional manner may function as a means for performing a reduced drawing process.
[0013]
Further, the program of the present invention includes a means for drawing a plurality of viewpoint images for stereoscopic display of an object, a means for drawing such that a cursor or an object is moved and displayed on a screen according to operation information of a pointing device, and And a means for determining an overlap between a three-dimensionally displayed object and a cursor or an object, and a means for performing a drawing process so that the cursor or the object is not displayed when the overlap is determined. In such a program, the computer may perform drawing processing so that the cursor or object is gradually erased.
[0014]
Further, the program of the present invention includes a means for drawing a plurality of viewpoint images for stereoscopic display of an object, a means for drawing such that a cursor or an object is moved and displayed on a screen according to operation information of a pointing device, and A means for determining an overlap between a three-dimensionally displayed object and a cursor or an object, and a rendering process such that when the overlap is determined, a transparent cursor or transparent object having only a contour line is displayed as the cursor or object. It is made to function as a means to do.
[0015]
Further, the program of the present invention includes a means for drawing a plurality of viewpoint images for stereoscopic display of an object, a means for drawing such that a cursor or an object is moved and displayed on a screen according to operation information of a pointing device, and Means for determining an overlap between a three-dimensionally displayed object and a cursor or an object, and when the overlap is determined, all or a part of the cursor or the object is used by pixel data of the three-dimensionally displayed object. It functions as a means for drawing processing.
[0016]
Further, in these programs, when the stereoscopically displayed object is stereoscopically viewed on the front side, the computer performs an enlarged drawing process on the stereoscopically displayed object, and when stereoscopically viewed on the back side, the computer displays the stereoscopically displayed object. You may make it function as a means to carry out reduction drawing processing.
[0017]
DETAILED DESCRIPTION OF THE INVENTION
The stereoscopic image display apparatus and program according to the present invention will be described below with reference to FIGS.
[0018]
FIG. 1 shows an example of the architecture of a personal computer. The CPU 1 is connected to a north bridge 2 having a system control function and a south bridge 3 having an interface function such as a PCI bus or an ISA bus. A video card 5 is connected to the north bridge 2 via a memory 4 or an AGP (Accelerated Graphics Port). The south bridge 3 is connected to a USB (Universal Serial Bus) interface 6, a hard disk drive (HDD) 7, a CD-ROM device 8, and the like.
[0019]
FIG. 2 shows a general video card 5. A VRAM (video memory) controller 5b controls writing / reading of drawing data to / from the VRAM 5a by an instruction from the CPU 1 via the AGP. The DAC (D / A converter) 5c converts the digital video data from the VRAM controller 5b into an analog video signal, and supplies this video signal to the personal computer monitor 12 via the video buffer 5d. In this video display process (drawing process), it is possible to perform a stereoscopic video display process in which a right eye video and a left eye video are generated and alternately drawn in a vertical stripe shape.
[0020]
The personal computer has a network connection environment and can receive, for example, an HTML file or an XML file from a transmission-side device configured as a server on the Internet. In addition, the personal computer is provided with a liquid crystal barrier on the monitor 12, for example, so that both a planar video image and a stereoscopic video image can be displayed. If the stereoscopic video is, for example, a right-eye video and a left-eye video alternately arranged in a vertical stripe shape, a vertical stripe-shaped light shielding region is formed in the liquid crystal barrier under the control of the CPU 1. If a stereoscopic video is to be displayed in a partial area on the screen (a window portion for file playback or a partial video portion in an HTML file), the CPU 1 may display the window or partial video. Based on the display coordinates and size of the portion, the size and formation position of the vertical stripe-shaped light shielding region can be controlled. Not only a liquid crystal barrier but also a normal barrier (barrier stripes are fixedly formed at a predetermined pitch) may be used. The personal computer is equipped with browser software (viewer), and can open a file and display an image on the monitor 12.
[0021]
Next, a stereoscopic image drawing process by a personal computer (browser software) will be described with reference to FIGS. FIG. 3 shows an example in which characters such as “A Co., Ltd.” are three-dimensionally displayed (looks popping out). The left-eye video is shifted to the right of the predetermined pixel relative to the right-eye image, and these are combined to form a stereoscopic image. Here, the shift amount of the character part of “A corporation” is calculated based on the description of the file, for example, and the left-eye display data and the right-eye display data in FIG. 3 are generated. The description start position of “A Corporation” is described in the file, for example, <start x> 100 </ start X coordinate indicated by x> and <start y> 50 </ start It is specified by the Y coordinate indicated by y>. Then, the pixel data constituting the left-eye display data and the pixel data constituting the right-eye display data are alternately displayed from the pixel data storage position on the VRAM corresponding to the coordinates (in the horizontal direction as the display image). The right eye pixel and the left eye pixel are alternately written one by one).
[0022]
FIG. 4 shows a description example of a file for stereoscopic display of the character string “A Corporation”. The personal computer (browser software) determines a description portion indicating the stereoscopic processing in the description in the file. In the example in the figure, it is determined that the portion surrounded by <3d> and </ 3d> is a description portion indicating the stereoscopic processing. Then, the phase shift amount and shift direction of the target object are determined based on the description portion indicating the stereoscopic processing. In the example of FIG. 4, <zurasi L X> 8 </ zurasi L X>, and based on this description, it is determined that the phase shift amount of the left-eye character is 8 pixels on the right side. In this description example, the phase of the right-eye character is not shifted. The personal computer (browser software) determines the target character, the phase shift amount, and the shift direction in accordance with the meaning of the above description, and performs the right eye image drawing and the left eye image drawing processing.
[0023]
By the way, when the driver of the pointing device (hereinafter referred to as a mouse) detects the movement of the mouse, it transmits the detected content to an API (Application Programming Interface) prepared by the OS (Operating System). Then, the OS moves the mouse cursor (draws), and transmits the mouse position information as a message to the browser (same for other applications). Usually, the OS provides a plurality of cursors. For example, cursors such as “text”, “wait”, “heip”, and “hand” are prepared, and a cursor having a desired shape can be designated corresponding to a predetermined event by describing the file.
[0024]
When the personal computer (CPU, browser, OS) determines that the cursor is positioned on the drawing area of “A Inc.”, for example, the “hand” cursor is adopted, and the image of the “hand” cursor is Processing for right-eye image drawing and left-eye image drawing is performed. If the browser cannot perform cursor drawing control, the OS side may be left to perform the cursor drawing process. In this case, the OS may prepare a cursor such as “3Dhand” and the browser may request the OS to display the cursor. When the “3Dhand” cursor is designated, the OS executes two drawing processes of the original cursor and the phase-shifted cursor. The amount of phase shift may be given from the browser to the OS. Here, for stereoscopic viewing of “A Corporation”, <zurasi L X> 8 </ zurasi L X>, and if the “hand” cursor is to be displayed further forward than “A Corporation”, for example, an operation such as 8 + 1 = 9 is executed, and the left of the “hand” cursor image The drawing process is executed assuming that the phase shift amount for the eye is 9 pixels on the right side. Note that the phase shift amount of the left-eye character in the “hand” cursor image may be set to the same value as the phase shift amount in “A Corporation”.
[0025]
The drawing by the above processing is schematically shown as shown in FIG. The procedure of this process is summarized as follows.
(1) A three-dimensional cursor image is generated from the cursor image.
(2) Draw a composite image of the object.
(3) Draw a three-dimensional cursor image.
[0026]
When generating a three-dimensional cursor image, it may be the same as or larger than the shift amount of the object. If a sense of incongruity occurs due to sudden movement, the cursor may be gradually moved to the near side. For example, the above-described calculation of 8 + 1 = 9 is executed to set the maximum value of x to 9, the initial value x = 0, and the process of x = x + 1 is executed after a predetermined time display, and the left of the “hand” cursor The drawing process in which the phase shift amount of the eye image is x pixels on the right side may be executed for each predetermined time. Since the depth relationship between the object and the cursor is a relative relationship, display may be performed such that the object moves in the reverse direction without changing the Z position of the cursor. If the shift direction during the composition of the objects is reversed, the object moves deeper than the cursor. Also about this, you may move gradually.
[0027]
Next, another processing example will be described. In this example of processing, as shown in FIG. 6, when the cursor overlaps the display area of the object (banner advertisement) displayed as A Corporation, the cursor is positioned below the object. The specific process for this is, for example, a process for determining the overlap between the display area of the object and the display area of the cursor, or a process of always drawing the target object for stereoscopic viewing after executing the drawing process of the cursor graphic when the overlap is determined. Can be realized.
[0028]
Furthermore, other processing examples will be described. The processing example here is an example in which the cursor is erased when the cursor overlaps the display area of the object displayed as A Corporation. In this case, rather than hiding the cursor, it seems that the cursor suddenly disappears, so it is better to insert animation processing such as gradually disappearing and disappearing little by little like a cloud. When it appears on the contrary, it may be a process of gradually increasing or appearing little by little from a foggy object. FIGS. 7A, 7B, and 7C show how the cursor is gradually erased. Specific processing for this purpose is to prepare a cursor having a similar shape with different sizes in advance, or perform enlargement / reduction processing (pixel interpolation / pixel thinning processing) on the cursor graphic. Then, the process of determining the overlap between the display area of the object and the display area of the cursor, and the process of drawing a small cursor gradually at a predetermined time interval when it is determined that they overlap.
[0029]
However, the process of hiding the cursor described with reference to FIGS. 6 and 7 is inconvenient because the position of the cursor is unknown depending on the size of the object.
[0030]
As shown in FIGS. 8 and 9, such inconvenience is solved by making the cursor color and pattern the same as the object color and pattern when the cursor is over the display area of the object displayed as A Corporation. it can. Specific processing for this is as follows: (1) judgment processing for overlapping the display area of the object and the display area of the cursor, (2) processing for drawing the composite image of the object, (3) processing for drawing the cursor, (4) ▼ Consists of a drawing process that fills the overlapping portion of the cursor with the color or pattern of the object. For example, already written image data for a predetermined vertical pixel × horizontal predetermined pixel at the approximate center position of the cursor graphic to be drawn is extracted (that is, image data of a part of the already written object) to fill the cursor graphic. By repeatedly performing the drawing process as described above, the color and pattern of the cursor become substantially the same as the color and pattern of the object. As shown in FIG. 9, it is also possible to fill only the overlapping area.
[0031]
Or (1) a process for determining the overlap between the display area of the object and the display area of the cursor, (2) a process for cutting out the overlapping image from the composite image of the object, (3) a process for drawing the composite image of the object, (4) Processing for drawing a cursor, (5) Processing for drawing a clipped image on an overlapping portion of the cursor may be performed. Here, it is assumed that image data is drawn from left to right, and already written image data from the left edge to the right edge in the figure of the cursor to be drawn is developed on another memory, for example. In the process (5), the image data developed on the memory is drawn on the cursor, whereby the clipped image is pasted.
[0032]
Or (1) a process for determining the overlap between the display area of the object and the display area for the cursor, (2) a process for drawing a composite image of the object, and (3) a transparent cursor (only the contour line when the overlap is determined You may perform the process which draws (cursor which consists of image data). By such processing, as shown in FIG. 9, only the overlapping area becomes the color or pattern of the object.
[0033]
The display processing of the cursor shown in FIG. 8 and FIG. 9 described above is not a strict solution to the uncomfortable feeling caused by the cursor that should be in the back being displayed as if only the area overlapping the object is in front. The viewer is visually deceived and the uncomfortable feeling is reduced.
[0034]
By the way, when the object is popped out and stereoscopically viewed, the sensible object width F is smaller than the original character width D as shown in FIG. Therefore, the browser executes a process of processing the character “A Co., Ltd.” that is the object of stereoscopic vision into a character size that is twice as large, for example. After this processing, drawing processing (phase shift processing and alternate writing processing) for the right eye image and the left eye image is performed. As can be seen from FIG. 10, there is a relationship of D: (A + B) = F: B, C: A = E: B, and F / D = E / (E + C). Since the characters are expanded (shrinks) by E / (E + C) times due to the jumping out, the characters are enlarged and displayed in advance by (E + C) / E times. E is a constant of about 65 mm. For example, when a phase shift amount corresponding to the parallax amount C = 65 mm is set, the character is reduced to ½ and experienced, so that the character is drawn twice in advance. Here, the personal computer (browser) has a table for obtaining pixel pitch information (screen inch size and screen resolution based on the screen inch size and screen resolution) of its own monitor 12. , Pixel pitch (mm) is obtained). The personal computer (browser) obtains the value of (E + C) / E from C (mm) and E = 65 mm obtained by multiplying the phase shift amount (number of pixels) by the pixel pitch, and based on this value Perform pixel interpolation (enlargement processing) on the original character. Alternatively, the character size satisfying the size obtained by multiplying the original character size by the value of (E + C) / E is determined, and the dot data of “A Corporation” of this character size is acquired and drawn. Such processing can also be applied to a cursor to be stereoscopically displayed.
[0035]
In the above example, the case where the cursor is superimposed on the object displayed in a three-dimensional manner has been illustrated. The same processing as that performed for the cursor may be performed for the object.
[0036]
【The invention's effect】
As described above, according to the present invention, it is possible to eliminate a sense of incongruity caused by displaying a cursor that should originally exist on the far side of a stereoscopically displayed object on the near side. .
[Brief description of the drawings]
FIG. 1 is a block diagram illustrating an example of an architecture of a personal computer.
FIG. 2 is a block diagram illustrating a configuration example of a video card.
FIG. 3 is an explanatory diagram of object stereoscopic rendering processing by a personal computer (browser software);
FIG. 4 is an explanatory diagram showing a description example of a file.
FIG. 5 is an explanatory diagram showing a state in which a cursor is projected from a stereoscopically displayed object and is stereoscopically displayed.
FIG. 6 is an explanatory diagram showing a display example of a cursor for a stereoscopically displayed object.
FIGS. 7A, 7B, and 7C are explanatory diagrams showing examples of cursor display for objects displayed in a three-dimensional manner.
FIG. 8 is an explanatory diagram showing a display example of a cursor for an object displayed in a three-dimensional manner.
FIG. 9 is an explanatory diagram illustrating a display example of a cursor for an object displayed in a three-dimensional manner.
FIG. 10 is an explanatory diagram showing the principle of stereoscopic vision.
FIGS. 11A and 11B are explanatory diagrams showing examples of general cursor display. FIGS.
FIG. 12 is an explanatory diagram showing a state in which a cursor that should originally exist on the far side of an object displayed in three dimensions is displayed on the near side.
[Explanation of symbols]
1 CPU
4 Memory 5 Video card 5a VRAM
5b VRAM controller

Claims (8)

A stereoscopic image display device for generating a stereoscopic image,
Means for rendering a multi-viewpoint image for stereoscopic display of the object;
Means for drawing so that a cursor or object displayed in a plan view on the screen is moved and displayed according to the operation information of the pointing device;
Means for determining an overlap between the stereoscopically displayed object and the planarly displayed cursor or object;
Means for rendering so that the cursor or object displayed in a planar view is not displayed when the overlap is determined in a state where the object displayed in a stereoscopic view is stereoscopically viewed on the near side;
A stereoscopic image display device comprising: The stereoscopic image display apparatus according to claim 1,
A stereoscopic video display apparatus, wherein a rendering process is performed so that the cursor or object displayed in plan view is gradually erased. A stereoscopic image display device for generating a stereoscopic image,
Means for rendering a multi-viewpoint image for stereoscopic display of the object;
Means for drawing so that a cursor or object displayed in a plan view on the screen is moved and displayed according to the operation information of the pointing device;
Means for determining an overlap between the stereoscopically displayed object and the planarly displayed cursor or object;
When the overlapping is determined in a state where the stereoscopically displayed object is stereoscopically viewed on the near side, all or a part of the cursor or the object that is stereoscopically displayed is a pixel of the object that is stereoscopically displayed. Means for rendering using data ;
A stereoscopic image display device comprising: The stereoscopic image display device according to any one of claims 1 to 3,
When the stereoscopically displayed object is stereoscopically viewed on the front side, the stereoscopically displayed object is enlarged and drawn.
A stereoscopic video display apparatus, which performs reduction drawing processing on an object that is stereoscopically displayed when stereoscopically viewed on the back side . Means for rendering a multi-viewpoint image for stereoscopic display of an object;
Means for drawing so that a cursor or object displayed in a plan view on the screen is displayed in accordance with the operation information of the pointing device;
Means for determining an overlap between the stereoscopically displayed object and the planarly displayed cursor or object;
A program for functioning as a drawing processing unit so that the cursor or object displayed in a planar view is not displayed when the overlap is determined in a state where the object displayed in a stereoscopic view is stereoscopically viewed on the near side . The program according to claim 5,
A program for causing a computer to function as a drawing processing unit so that the cursor or object displayed in plan view is gradually erased . Means for rendering a multi-viewpoint image for stereoscopic display of an object;
Means for drawing so that a cursor or object displayed in a plan view on the screen is moved and displayed according to the operation information of the pointing device;
Means for determining an overlap between the stereoscopically displayed object and the planarly displayed cursor or object;
When the overlapping is determined in a state where the stereoscopically displayed object is stereoscopically viewed on the near side, all or a part of the cursor or the object that is stereoscopically displayed is a pixel of the object that is stereoscopically displayed. A program for functioning as a means of drawing processing using data . The program according to any one of claims 5 to 7,
When the stereoscopically displayed object is stereoscopically viewed on the near side, the computer performs an enlarged drawing process on the stereoscopically displayed object,
A program that causes an object that is stereoscopically displayed to function as a reduction drawing process when stereoscopically viewed on the far side .

Images