JP2005079704A - Stereoscopic video display apparatus and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a stereoscopic video image display apparatus capable of stereoscopically displaying an optional character on the basis of a file. <P>SOLUTION: When a personal computer (viewer) applies image drawing processing to characters, the personal computer draws an image of a shade of the characters in addition to drawing of left/right viewpoint images of the characters as to characters having a character attribute denoting a stereoscopic vision. In displaying the characters to be jumped out this side, a left eye image is shifted by a prescribed number of pixels to the right with respect to a substantial display position of displayed characters and a right eye image is shifted by a prescribed number of pixels to the left with respect to the substantial display position of the displayed characters. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a stereoscopic image display device and a program.

Conventionally, as a stereoscopic technique, a stereoscopic method without glasses using a parallax barrier, a stereoscopic method with glasses using polarized glasses, liquid crystal shutter glasses, and the like are known. In addition, as a stereoscopic image, there is not only a live-action image but also a 3D drawing image in which an object placed in a virtual space is projected onto a plane and drawn using computer graphics. Furthermore, a right-eye image and a left-eye image can be created by performing the drawing process from two viewpoints. In addition, a stereoscopic video receiving apparatus and a stereoscopic video system that generate a stereoscopic video based on depth information extracted from a two-dimensional video signal and the two-dimensional video signal have been proposed (see Patent Document 1). If a video file composed of two-dimensional video and depth information is created, a stereoscopic video can be generated when this file is opened. In addition, a method has been proposed in which two videos are broadcast as one-channel video and can be stereoscopically viewed on the receiver side (see Patent Document 2). If a video file composed of two videos is created, a stereoscopic video can be generated when the file is opened.
JP 2000-78611 A Japanese Patent Laid-Open No. 10-174064

  By the way, the file includes a document file created by a word processor, and it is desired to stereoscopically view an arbitrary character in such a file.

  In view of the above circumstances, an object of the present invention is to provide a stereoscopic video display apparatus and program capable of stereoscopically displaying an arbitrary character of a file.

  In order to solve the above problems, a stereoscopic video display device according to the present invention is a stereoscopic video display device that generates a stereoscopic video based on a file, and includes attribute information indicating stereoscopic processing for each character in the file. Means for determining presence / absence; means for determining a phase shift amount and a shift direction of the stereoscopic target character based on the attribute information; and rendering processing of each viewpoint image of the stereoscopic target character based on the phase shift amount and the shift direction. Means for performing (hereinafter referred to as a first configuration in this section).

  In the stereoscopic video display device having the first configuration, a shadow image of the stereoscopic target character may be drawn. Further, the shadow may be drawn so that the position of the shadow is largely shifted as the stereoscopic target character is made visible on the front side. Further, the shadow may be drawn with the same color system as the color of the three-dimensional character and with the saturation and / or lightness changed. Further, the stereoscopic target character may be drawn larger as the stereoscopic target character becomes visible on the near side. Further, the brightness of the color of the three-dimensional character may be increased as the three-dimensional character is made visible on the front side. Further, when the stereoscopic target character is a character with a strikethrough line, each viewpoint image of the strikethrough line may be drawn so that the strikethrough line can be seen in front of the stereoscopic target character. The strike-through line for the three-dimensional object character may be drawn by any one of a shaded line, a thick line, a wavy line, and a broken line.

  The software of the present invention also allows the computer to determine the presence / absence of attribute information indicating stereoscopic processing for each character in the file, and the phase shift amount and shift direction of the stereoscopic target character based on the attribute information. It is characterized by functioning as means for determining and means for rendering each viewpoint image of the stereoscopic character based on the phase shift amount and the shift direction (hereinafter referred to as a second configuration in this section).

  In the program having the second configuration, the computer may function as a means for drawing a shadow image of the three-dimensional target character. Further, the computer may be made to function as a means for drawing so that the position of the shadow is largely deviated as the three-dimensional character is made visible. In addition, the computer may function as a means for drawing a shadow by changing the saturation and / or lightness in the same color system as the color of the three-dimensional target character. In addition, the computer may function as a unit that draws the stereoscopic target character larger as the stereoscopic target character becomes visible in front. In addition, the computer may function as a means for drawing with the brightness of the color of the three-dimensional object character being increased as the three-dimensional object character is visible on the near side. In addition, when the stereoscopic target character is a character with a strikethrough, the computer may function as a means for drawing each viewpoint image of the strikethrough so that the strikethrough can be seen in front of the stereoscopic target character. In addition, the computer may function as a means for drawing the strike-through line of the three-dimensional target character as one of a shaded line, a thick line, a wavy line, and a broken line.

  As described above, according to the present invention, there is an effect that an arbitrary character portion can be stereoscopically displayed based on character attribute information described in a file.

  Hereinafter, an embodiment of the present invention will be described with reference to FIGS.

  FIG. 1 shows an example of the architecture of a personal computer (stereoscopic image display device). The CPU 1 is connected to a north bridge 2 having a system control function and a south bridge 3 having an interface function such as a PCI bus or an ISA bus. A video card 5 is connected to the north bridge 2 via a memory 4 or an AGP (Accelerated Graphics Port). The south bridge 3 is connected to a USB (Universal Serial Bus) interface 6, a hard disk drive (HDD) 7, a CD-ROM device 8, and the like.

  FIG. 2 shows a general video card 5. A VRAM (video memory) controller 5b controls writing / reading of drawing data to / from the VRAM 5a by an instruction from the CPU 1 via the AGP. The DAC (D / A converter) 5c converts the digital video data from the VRAM controller 5b into an analog video signal, and supplies this video signal to the personal computer monitor 12 via the video buffer 5d. In such video display processing (rendering processing), right-eye video and left-eye video are generated, and stereoscopic video display processing can be performed in which these are alternately drawn in a vertical stripe shape.

  The personal computer has a network connection environment and can receive a file (for example, a document file, a mail, an HTML file, an XML file, etc.) from a transmission side device configured as a server on the Internet. In addition, the personal computer is provided with a liquid crystal barrier on the monitor 12, for example, so that both a planar video image and a stereoscopic video image can be displayed. If the stereoscopic video is, for example, a right-eye video and a left-eye video alternately arranged in a vertical stripe shape, a vertical stripe-shaped light shielding region is formed in the liquid crystal barrier under the control of the CPU 1. If a stereoscopic video is to be displayed in a partial area on the screen (a window portion for file playback or a partial video portion in an HTML file), the CPU 1 may display the window or partial video. Based on the display coordinates and size of the portion, the size and formation position of the vertical stripe-shaped light shielding region can be controlled. Not only a liquid crystal barrier but also a normal barrier (barrier stripes are fixedly formed at a predetermined pitch) may be used. The personal computer is equipped with word processor software and browser software (viewer), and can open a file and display an image on the monitor 12.

  Next, a stereoscopic image drawing process by a personal computer (viewer) will be described with reference to FIGS. FIG. 3A shows a character display example of “Σ” having a plane (2D) character attribute, and FIG. 3B shows a character display example of “Σ” having a solid (3D) character attribute. Show. In the character display of “Σ” having a three-dimensional (3D) character attribute, not only the left and right viewpoint images of the character but also the shadow of the character is drawn (in the figure, the shadow portion is displayed lighter than the character). Have been). When performing a display in which the character “Σ” pops out to the near side, the image for the left eye is shifted by a predetermined amount to the right with respect to the original display position of the display character, and the image for the right eye is the original image of the display character. What is necessary is just to shift a predetermined pixel to the left with respect to the display position. As the phase shift amount, the shift pixel number may be described as the character attribute information, or the shift frequency may be described. The shift frequency may be determined on the software such that, for example, frequency 1 is shifted by 2 pixels and frequency 2 is shifted by 4 pixels. Further, the phase shift amount may be determined based on the character size that is the character attribute information. For example, there is a method of making the phase shift amount proportional to the character size. In this case, the phase shift amount can be determined by holding a proportional constant value on the software side and performing a process of multiplying the proportional constant value by the character size. Alternatively, a correspondence table of character size and phase shift amount may be prepared on software. As for the shifting direction, it is only necessary to give the appearance (jumping = 0, depth = 1, etc.) as a character attribute. In the drawing of the character (three-dimensional target character) and shadow subjected to the shift processing, the pixel data constituting the left eye display data and the pixel data constituting the right eye display data are used as the drawing coordinates. Writing is performed alternately from the corresponding VRAM pixel data storage position (right-eye pixels and left-eye pixels alternately in the horizontal direction as a display image).

  The shadow of the three-dimensional target character may be drawn in black, gray, or the like by shifting the same shape as the character by a predetermined pixel at the right position of the character, for example. And when drawing a 3D object character with a shadow, the 3D object character and the shadow may be integrated and shifted by the same phase, or the 3D object character and the shadow may be shifted in phase. . For example, when the left-eye character is shifted by 4 pixels to the right with respect to the original display position, the shadow is shifted by 2 pixels to the right, and the right-eye character is shifted to the left by 4 pixels with respect to the original display position. When shifting pixels, it is only necessary to shift the shadow by two pixels to the left. A phase shift amount in shadow drawing may be provided as a character attribute, or a personal computer (viewer) based on the character phase shift amount, such as half the character phase shift amount in shadow drawing. The shadow shift amount may be generated by performing arithmetic processing on the side.

  In addition, when a 3D object character is drawn with a shadow and displayed as a 3D object character, the shadow (the shadow portion in the figure is displayed lighter than the character) is displayed in 3D as shown in FIG. The target character may be displayed at the original display position, and only the three-dimensional target character may be shifted and displayed. In this case, the shadow appears on the same plane as the characters displayed on the other plane, and the three-dimensional target character appears at a position protruding from the plane.

  Further, when the personal computer (viewer) draws the three-dimensional target character with a shadow, as shown in FIG. 5A, the personal computer (viewer) is closer to the front side than when the three-dimensional target character is viewed on the back side ( It can be determined by the shift direction and the phase shift amount), and the shadow is drawn so as to be largely shifted. Such processing may be performed by changing the degree of separation between the three-dimensional target character and the shadow in accordance with the amount of phase shift when performing the processing of shifting the three-dimensional target character and the shadow by the same amount, or as described above. As described above, the shadow position may be seen to be greatly shifted by giving a parallax to the shadow itself, for example, by making the phase shift amount in the shadow drawing half of the character phase shift amount.

  The shadow color is not limited to the black or gray color described above, but may be drawn by changing the saturation and / or lightness in the same color system (same hue or approximate hue) as the color of the three-dimensional character. For example, the shadow color is displayed darker or brighter than the color of the three-dimensional character. When image processing is performed by RGB, the R value, the G value, and the B value are darkened when the R value, the G value, and the B value are uniformly lowered by a predetermined amount, and conversely, the image is brightened by uniformly raising the predetermined value by a predetermined amount. Also, the R value, G value, and B value are converted to HSI (Hue: Hue, saturation: Saturation, brightness: Intensity) and the saturation is changed, and the R value, G value, and B value are converted again. You may draw back. What is necessary is just to give the character attribute whether the color of the shadow is a constant color or subordinate to the character color. The personal computer (viewer) performs a drawing color selection process based on the character attribute.

  By the way, when the character is popped out and stereoscopically viewed, the sensible character width F is smaller than the original character width D, as shown in FIG. Therefore, instead of drawing the three-dimensional target character according to the character size indicated by the original character attribute, for example, a process of processing the character to a double character size is executed. After this processing, drawing processing (phase shift processing) for the right-eye image and the left-eye image is performed.

  As can be seen from FIG. 6, there is a relationship of D: (A + B) = F: B, C: A = E: B, and F / D = E / (E + C). Since the characters are expanded (shrinks) by E / (E + C) times due to the jumping out, the characters are enlarged and displayed in advance by (E + C) / E times. E is a constant of about 65 mm. For example, when a phase shift amount corresponding to the parallax amount C = 65 mm is set, the character is reduced to ½ and experienced, so that the character is drawn twice in advance. Here, the personal computer (viewer) holds the pixel pitch information of its own monitor 12. A personal computer (viewer) has a table in which the pixel pitch is obtained according to the screen inch size and the screen resolution. For example, when the user inputs the screen inch size and the screen resolution, the pixel pitch (mm) is obtained. The personal computer (viewer) obtains the value of (E + C) / E from C (mm) and E = 65 mm obtained by multiplying the amount of phase shift (number of pixels) in the character attribute by the pixel pitch. Based on the above, pixel interpolation (enlargement processing) is performed on the original character. Alternatively, a character size that satisfies the size obtained by multiplying the original character size by the value of (E + C) / E is determined, and dot data of this character size is acquired and drawn. At the time of this drawing, the coordinates are determined and drawn so that the up-and-down position of the enlarged three-dimensional target character is at the center of the line. For example, when the number of vertical pixels of the original character is 20 and the number of vertical pixels of the enlarged character is 40, the vertical direction with respect to the reference position (bottom aligned position) is calculated by (40−20) / 2 = 10. The three-dimensional target character is drawn downward by 10 pixels.

  In the above processing, the sensible width of characters that appear to pop out is the same as the original character width, but the personal computer (viewer), as shown in FIG. You may perform the process which enlarges a bodily sensation magnitude | size from the original magnitude | size. Further, a process may be performed in which the larger the depth is, the smaller the character's bodily sensation is than the original size (thinning out the character constituent pixels).

  Further, as shown in FIG. 5C, the personal computer (viewer) displays the characters brighter as the projection amount of the three-dimensional target character increases, and displays the characters darker as the depth amount increases. When image processing is performed by RGB, the color of the three-dimensional target character becomes dark when the R value, G value, and B value are uniformly reduced by a predetermined amount, and conversely, when the value is uniformly increased by a predetermined amount.

  Further, when the display character is a flat display character with a strikethrough, the personal computer (viewer) draws two horizontal lines on the display character “NY” as shown in FIG. 7A. . On the other hand, when the 3D object character is a character with a strikethrough, as shown in FIG. 7B, each viewpoint image of the strikethrough is displayed so that the strikethrough line can be seen in front of the 3D object character. draw. For example, when the character “NY” for the left eye is shifted to the right by 2 pixels with respect to the original display position, the strikethrough is shifted by 4 pixels to the right, and the character “NY” for the right eye is changed to the original display position. On the other hand, when shifting 2 pixels to the left, the strikethrough is shifted 4 pixels to the left. A personal computer based on the character phase shift amount, such as having a phase shift amount in the strikethrough drawing as a character attribute, or making the phase shift amount in the strikethrough drawing double the character phase shift amount, etc. An arithmetic process may be performed on the (viewer) side to generate a strike-through shift amount.

  As shown in FIG. 7C, the personal computer (viewer) draws a strike-through line of the three-dimensional character by any one of a shaded line, a thick line, a wavy line, and a broken line. Compared to drawing a simple line as a strike-through line, drawing as described above makes it easier to make a difference between the left and right viewpoint images for the strike-through line, improving the stereoscopic effect of the strike-through line.

  FIG. 8 is an explanatory diagram showing a sentence “I go to NY” and attribute information of each character constituting the sentence. Each character has an attribute of “3D display” (present / absent) in addition to normal font attributes such as “font” and “size”. As the “3D information”, for example, “jump / depth” (0/1), “shift frequency” (for example, specified by a value of 1 to 5), “shadowing” (present / absent), “ Shadow light color designation (with / without), Shadow displacement amount change designation (with / without), Character brightness change designation (with / without), Text size change designation (with / without), etc. It has the attribute of. The personal computer (viewer) recognizes the character “present” in “3D display” as a stereoscopic display character, and the meaning of the attribute as described above based on each attribute information of “3D information”. Accordingly, the phase shift amount and the shift direction are determined, and further, character color change, character size change, shadow drawing, and the like are performed, and right eye image drawing and left eye image drawing processing are performed.

  When a part of a sentence (for example, NY) is stereoscopically displayed, a stereoscopic target character may be drawn at the drawing position of the adjacent character. Therefore, in creating a sentence, it is preferable to widen the space between the three-dimensional target character and its adjacent character. Of course, in a personal computer (such as a word processor), when a three-dimensional target character is recognized based on its attribute information, an editing process for making the interval between the adjacent characters wider than usual may be automatically executed. Further, transparency (M) may be set as an attribute of the three-dimensional character. The personal computer (word processor or the like), for example, sets the R pixel data of the character to be enlarged designated transparently as R1 and the R pixel data of the overlapping character as R2, and the drawing R pixel data is (R2 × M / 100 + R1 × (1−M / 100)). This transparent setting is preferably used when the three-dimensional target character is displayed in a color different from other characters.

  In the above example, a personal computer that recognizes a file and displays an image is illustrated. However, the present invention is not limited to this, and the stereoscopic video display device can receive a data broadcast (BML file) and display an image. It can also be configured as a receiving device, a mobile phone equipped with a network connection environment and an image display function.

It is the block diagram which showed the architecture example of the personal computer. It is the block diagram which showed the structural example of the video card. FIG. 4A is an explanatory diagram of a plane display of “Σ”, and FIG. 4B is an explanatory diagram of a three-dimensional display of “Σ”. It is explanatory drawing of the three-dimensional display of "Σ". FIGS. 9A, 9B, and 9C are explanatory diagrams of a three-dimensional display of “Σ”. It is explanatory drawing which showed the principle of stereoscopic vision. FIG. 4A is an explanatory diagram of a planar display of characters with strikethrough, FIG. 5B is an explanatory diagram of a three-dimensional display of characters with strikethrough, and FIG. 4C is four types of cancellation. It is explanatory drawing of a line. It is explanatory drawing which showed the attribute information of each character in a sentence.

Explanation of symbols

1 CPU
4 memory 5 video card 5a VRAM
5b VRAM controller

Claims (16)

A stereoscopic video display device that generates a stereoscopic video based on a file, a unit for determining presence / absence of attribute information indicating a stereoscopic processing for each character in the file, and a stereoscopic target character based on the attribute information A stereoscopic image display apparatus comprising: means for determining a phase shift amount and a shift direction; and means for rendering each viewpoint image of a stereoscopic target character based on the phase shift amount and the shift direction. The stereoscopic video display apparatus according to claim 1, wherein a shadow image of the stereoscopic target character is drawn. 3. The stereoscopic image display device according to claim 2, wherein the drawing is performed such that the position of the shadow is shifted more greatly as the stereoscopic target character is made visible on the front side. 4. The stereoscopic image display apparatus according to claim 2, wherein the shadow is drawn with the same color system as the color of the stereoscopic target character and with the saturation and / or brightness changed. 5. The stereoscopic image display device according to claim 1, wherein the stereoscopic target character is drawn larger as the stereoscopic target character is made visible on the near side. 6. The stereoscopic image display device according to claim 1, wherein the stereoscopic target character is drawn with a higher brightness of the color of the stereoscopic target character as the stereoscopic target character is made visible in front. apparatus. 7. The stereoscopic image display device according to claim 1, wherein when the stereoscopic target character is a character with a strikethrough, each viewpoint image of the strikethrough so that the strikethrough can be seen in front of the stereoscopic target character. 3D image display device characterized by drawing. The stereoscopic video display device according to claim 7, wherein the cancellation line of the stereoscopic target character is drawn by any one of a shaded line, a thick line, a wavy line, and a broken line. Means for determining presence / absence of attribute information indicating stereoscopic processing for each character in the file; means for determining a phase shift amount and a shift direction of the stereoscopic character based on the attribute information; and the phase shift. A program for functioning as a means for performing drawing processing of each viewpoint image of a stereoscopic target character based on the amount and the shifting direction. The program according to claim 9, wherein the computer functions as means for drawing a shadow image of the three-dimensional character. The program according to claim 10, wherein the computer functions as a unit that draws a shadow so that the position of the shadow is greatly shifted as the three-dimensional target character is made visible. 12. The program according to claim 10, wherein the computer functions as a means for drawing a shadow by changing the saturation and / or brightness in the same color system as the color of the three-dimensional character. 13. The program according to claim 9, wherein the program causes the computer to function as a means for drawing a stereoscopic target character larger as the stereoscopic target character is made visible on the front side. 14. The program according to claim 9, wherein the program causes the computer to function as a means for drawing with a higher brightness of the color of the stereoscopic target character as the stereoscopic target character is made visible on the front side. 15. The program according to claim 9, wherein when the stereoscopic target character is a character with a strikethrough, each viewpoint image of the strikethrough so that the strikethrough can be seen in front of the stereoscopic target character. Program to function as a means to draw. The program according to claim 15, wherein the computer functions as means for drawing a strike-through line of the three-dimensional target character as one of a shaded line, a thick line, a wavy line, and a broken line.

Images