JP2005151080A - Stereoscopic image display - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a stereoscopic image display that does not simply, three-dimensionally display entire characters in a document, but can overlap a pictograph or the like to characters in a plan view for a stereoscopic view. <P>SOLUTION: For example, a text code and a pictograph code are included in received mail, a character image by the text code is processed in a plane view, and a pictograph image by the pictograph code is subjected to stereoscopy processing. By the stereoscopy processing, an observer observes a pictograph LP shown by the dotted line of a vehicle shifted to the left across a parallax barrier only with a right eye R, observes a pictograph RP shown by the dotted line of a vehicle shifted to the right across the parallax barrier only with a left eye L, and recognizes (three-dimensionally views) the pictograph of the vehicle at a position projecting from a display surface. More specifically, the entire characters in the document are not three-dimensionally displayed, but the pictograph or the like is overlapped to the characters in a plan view for a stereoscopic view. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a stereoscopic video display device.

Conventionally, as a stereoscopic technique, a stereoscopic method without glasses using a parallax barrier, a stereoscopic method with glasses using polarized glasses, liquid crystal shutter glasses, and the like are known. In addition, as a stereoscopic image, there is not only a live-action image but also a 3D drawing image in which an object placed in a virtual space is projected onto a plane and drawn using computer graphics. Furthermore, a right-eye image and a left-eye image can be created by performing the drawing process from two viewpoints. In addition, a stereoscopic video receiving apparatus and a stereoscopic video system that generate a stereoscopic video based on depth information extracted from a two-dimensional video signal and the two-dimensional video signal have been proposed (see Patent Document 1). If a video file composed of two-dimensional video and depth information is created, a stereoscopic video can be generated when this file is opened. In addition, a method has been proposed in which two videos are broadcast as one-channel video and can be stereoscopically viewed on the receiver side (see Patent Document 2). If a video file composed of two videos is created, a stereoscopic video can be generated when the file is opened.
JP 2000-78611 A Japanese Patent Laid-Open No. 10-174064

  By the way, there are files created by the mail function of personal computers and mobile phones, files created by word processors, etc. In these files, the entire character is not viewed stereoscopically, but more effectively viewed. It is desirable to allow a person to perform stereoscopic viewing.

  SUMMARY OF THE INVENTION In view of the above circumstances, an object of the present invention is to provide a stereoscopic video display device that allows a viewer to perform effective stereoscopic viewing rather than simply stereoscopically displaying characters in a document.

  In order to solve the above problems, a stereoscopic image display device according to the present invention uses a character image and an object image, and at least one of the character image and the object image is rendered for stereoscopic display. Of the character displayed in a plan view or stereoscopically displayed on the display or on the near side of the character or on the back side of the character in a stereoscopic view or displayed on the display. The object is configured to overlap with the near side or the back side of the character so as to be seen in a plan view.

  With the above configuration, for example, it is realized that characters in a document are planarly viewed while only an object is stereoscopically superimposed on the characters, etc., and effective stereoscopic viewing is performed for the viewer. Can be made.

  The file to be drawn may include a code specifying a character image and the image of the object. Alternatively, the file to be drawn may include a code that specifies a character image and a pictographic code that specifies the image of the object. The file may include control information for controlling the stereoscopic display, and may be configured as a text file or a binary file. Means for transmitting and / or receiving the file may be provided.

  The character image and the object image data may be transparently combined at a predetermined ratio. The character image data and the object image data may be developed on different memory areas and then combined on the drawing memory.

  It is good also as a structure by which the said target object is displayed by animation stereoscopic vision display or animation plane view. It has at least one of information for deforming the object, information for erasing, and information to be moved, and a plurality of images are generated using one or more of these information, and the object is displayed in an animation stereoscopic view or an animation plan view. It may be displayed. Animated stereoscopic display or animation plane with a plurality of dot data having at least one of deformed dot data, lost dot data, and moved dot data and forming different images You may make it display visually.

  It is good also as a structure by which control which does not perform two or more stereoscopic display simultaneously is performed when there exists two or more said objects. The animation stereoscopic display may be sequentially executed when there are a plurality of the objects, and the object on standby for animation stereoscopic display may be configured to be viewed stereoscopically or planarly in a stationary state. An object that has not been subjected to stereoscopic display or animation stereoscopic display may be configured to be displayed based on information instructing the state of the object.

  According to the present invention, the entire character in the document is not simply stereoscopically displayed but can be stereoscopically displayed by superimposing a pictograph or the like on the planar character so that the viewer can perform effective stereoscopic vision. There is an effect that can be.

  Hereinafter, embodiments of the present invention will be described with reference to FIGS. In the following, a personal computer equipped with a communication environment is exemplified, but it goes without saying that a portable device such as a mobile phone can be configured as a stereoscopic video display device.

  FIG. 1 shows an example of the architecture of a personal computer (stereoscopic image display device). The CPU 1 is connected to a north bridge 2 having a system control function and a south bridge 3 having an interface function such as a PCI bus or an ISA bus. A video card 5 is connected to the north bridge 2 via a memory 4 or an AGP (Accelerated Graphics Port). The south bridge 3 is connected to a USB (Universal Serial Bus) interface 6, a hard disk drive (HDD) 7, a CD-ROM device 8, and the like.

  FIG. 2 shows a general video card 5. A VRAM (video memory) controller 5b controls writing / reading of drawing data to / from the VRAM 5a by an instruction from the CPU 1 via the AGP. The DAC (D / A converter) 5c converts the digital video data from the VRAM controller 5b into an analog video signal, and supplies this video signal to the personal computer monitor 12 via the video buffer 5d. In such video display processing (rendering processing), right-eye video and left-eye video are generated, and stereoscopic video display processing can be performed in which these are alternately drawn in a vertical stripe shape.

  The personal computer has a network connection environment and can receive a file (for example, a document file, a mail, an HTML file, an XML file, etc.) from a transmission side device configured as a server on the Internet. In addition, the personal computer is provided with a liquid crystal barrier on the monitor 12, for example, so that both a planar video image and a stereoscopic video image can be displayed. If the stereoscopic video is, for example, a right-eye video and a left-eye video alternately arranged in a vertical stripe shape, a vertical stripe-shaped light shielding region is formed in the liquid crystal barrier under the control of the CPU 1. Further, if a stereoscopic video is to be displayed in a partial area on the screen (a window portion for file playback or a partial video portion of a mail document), the CPU 1 or the partial video is displayed. Based on the display coordinates and size of the portion, the size and position of the vertical stripe-shaped light shielding region may be controlled. Not only a liquid crystal barrier but also a normal barrier (barrier stripes are fixedly formed at a predetermined pitch) may be used. The personal computer is equipped with word processor software, mail software, and the like, and can open a file and display an image on the monitor 12.

  Next, the stereoscopic processing of a file by a personal computer (software) will be described based on FIGS.

  FIG. 3A shows text received by mail, and FIG. 3B shows an image in which the stereoscopic object is a pictograph of a car. The image (dot data) is received by e-mail as an attached file, for example. In a device that does not support stereoscopic vision, compatibility can be maintained by ignoring the attached file and displaying the screen using only text data. When an image is displayed as an animation, it may be composed of a plurality of images with slightly different positions of car pictograms, or based on control data for changing the position of car pictograms. You may do it. The control data may be added to the attached file or may be held in advance on the receiving side.

  FIG. 4 schematically shows an image display state on the display over the parallax barrier. The car pictogram, which is a stereoscopic object, is drawn on top of the text image, but for the sake of stereoscopic viewing, the car pictogram is shifted to the right with respect to the original drawing position (right pixel shift) and the left The image is converted into two images, that is, a shifted image (pixel shift in the left direction).

  FIG. 5 shows a stereoscopic image. A car pictogram appears to overlap with a text (or a normal pictogram) in a plane view mail text on different coordinates with respect to the observation axis (Z axis). However, as described above, the car pictograms appear to be at different positions on the Z-axis, so unlike the case where the car pictograms are displayed in two dimensions, there is no sense of incongruity even if they are displayed in a superimposed manner. In addition, when a car pictogram moves in an animated display, for example, even if the “do” character cannot be seen at a certain point in time, the “do” character will be seen at the next point in time. Is possible. In order to make a planar character show through a stereoscopic car pictogram, for example, the R (red) pixel value of the image data of a two-dimensional character is set to R1, and the R pixel of the image data of the car pictogram is displayed. If the value is R2 and the ratio of R1 is M%, the combined R pixel value may be obtained by calculation such as R = (R1 × M / 100 + R2 × (1−M / 100)) and drawn.

  FIG. 6 schematically shows the principle that the pictograph of a car is stereoscopically viewed. Here, the observer observes the left-shifted car pictogram LP (shown by a dotted line) only with the right eye R through the parallax barrier, and the right-shifted car pictogram RP (shown by a dotted line) is parallax. The observation is made only with the left eye L through the barrier, and the pictograph of the car is recognized at the position protruding from the display surface (stereoscopically viewed).

  Here, in the drawing on the VRAM, for example, an image based on text data is developed on another first memory area (virtual screen), and a car pictogram is displayed on another second memory area (virtual screen). It is conceivable that the image is developed and the two images are combined and drawn in the VRAM. In the case of such processing, it is convenient to adopt a pictograph having a size unrelated to the character size or to perform stereoscopic display of a pictograph that moves around the entire screen. In addition, when a plurality of stereoscopic pictograms are to be displayed, the image may be developed on another memory area (on the virtual screen).

  Next, a process for incorporating pictograms into a text sentence in correspondence with a word input in creating a text sentence such as an email will be described below.

  For example, when “Doraiba” is input as an input character string and converted on the text sentence creation software, several candidates are displayed on the display as shown in FIG. As candidates for this, there are two-dimensional pictograms of cars, as well as “drive” characters superimposed with the pictograms of cars. If the code (number) is “1”, the two-dimensional pictograph of the car is described as <image icon = “1”>, for example. Alternatively, it may be expressed by putting an existing ASCII character 2 bytes (pictogram code) between the pictogram start code “S!” And the pictogram end code “· E”. If the pictogram code of the car is 00, it becomes “S! 00 · E”.

  Next, an example of a file structure when a car pictogram is superimposed on the letter “drive” is shown below.

  File configuration example (1): In this configuration example, as shown in FIG. 8, text data 1 including the characters “drive” and text data 2 specifying a car pictogram to be displayed over “drive” Exist in one file. For example, there are two test data in the format of hierarchy 1 and hierarchy 2. Here, if an image is displayed based only on the text data 1, the result is as shown in FIG. The text data 2 includes a character string such as “S! 00 · E”, for example. When this character string (code) is recognized, two-dimensional pictographic image data is read out, stereoscopic processing is performed, and image display is performed, stereoscopic rendering is performed as shown in FIG. That is, the software that opens the mail file reads the pictographic image file based on the character string “S! 00 · E”. Even if there is only one image file of a two-dimensional pictogram of a car, a three-dimensional animation display can be realized by a pictogram display position changing process or an enlargement / reduction process on the device side that has received the mail. The description start position of “S! 00 · E” corresponds to the text position of “do” of “drive”, and defines the base display position of the pictograph of the car on the animation image of FIG. Value.

  A portion other than the character string “S! 00 · E” is a space. In a device that does not support stereoscopic vision, when text data 1 and text data 2 are received by mail, the text data 2 can be ignored to display only the text sentence. Further, when it is determined that the text data 2 is a stereoscopic pictographic file, the description of the text data 2 is simply “00” after a predetermined number of spaces if the text data 2 is a car pictograph, for example. Can be.

  The text data 1 and the text data 2 may be divided into separate files. That is, text data 1 in which character strings such as “How about a drive, etc.” are simply arranged is a body file, and “S! 00 · E” or simply “00” after a number of spaces corresponding to the character position of “do”. Processing may be performed in which the text data 2 in which is described as an attached file. When a body-incompatible device receives a text file and an attached file by e-mail, only the text sentence can be displayed by ignoring the attached file.

  Further, as shown in FIG. 8A, when “drive” extends over two lines, the drawing process may be performed so that the position of “La” is set as the display reference position of the pictograph. Alternatively, line feed processing may be automatically performed so that “drive” is displayed on one line. In the above example, the pictogram portion of the car is created in a quadruple size horizontally in accordance with the four characters “drive”. Quadruple-size information can be given by a description such as “S! 00 · E-4”. The text creation software determines whether or not four characters “drive” are included in one line for text data 1 when the above-mentioned candidate is selected to superimpose a car pictogram on the character “drive”. If it does not enter, a line feed is made and a text file is created so that the letter “drive” is displayed from the beginning of the line. Further, the text creation software describes “S! 00 · E-4” in the text data 2 with a space corresponding to the line feed.

  As described above, by giving a quadruple size to the animated stereoscopic display of the car pictogram, a stereoscopic animation display can be realized within a range in which the car pictogram corresponds to the four characters “drive”. On the other hand, it is not limited to setting the quadruple angle corresponding to the four characters “drive”. For example, the quadruple angle is set for the stereoscopic animation display of the car pictogram for one character “car”. You may do it. For example, as shown in FIG. 9, (1) a three-dimensional animation display that overlaps at the center of the four characters including the character “car” at the head, or (2) 4 centered on the character “car”. A three-dimensional animation display that overlaps at the center of the character may be used, or (3) three spaces may be inserted adjacent to the character “car”. The sentence creation software may create the text data 1 in any of the forms (1) to (3) described above. The sentence creation software may describe the text data 2 with “S! 00 · E-4” with a space corresponding to any of the above (1) to (3). The stereoscopic animation display can be performed with a plurality of images prepared in advance. In addition, it has at least one of information for deforming, erasing, and moving information of a car pictogram (object), and generates a plurality of images using one or more of these pieces of information to animate the object. Visual display or animation plane display may be displayed. Further, the object is represented by a plurality of dot data having at least one of dot data obtained by deforming a pictograph (object) of a car, dot data lost, and moved dot data, and forming different images. Animation stereoscopic display or animation plane display may be displayed.

  File configuration example (2): In the above example, a file example having text data 1 and text data 2 has been shown, but a file in which pictogram codes are arranged in one text data may be used. For example, pictogram codes may be arranged in the text data in a format such as “drive S! 00 / E-4 ...”. Further, format data (control information) may be included in the file. The format data may be embedded in a character format (text file), or may be provided in a format that is not a character (binary file) as in a word processor. In this format data, for example, it can be considered that the start position of a character is represented by a position with respect to the end position of the previous character, and the character position with respect to the character before the pictogram code is represented by a negative value. Specifically, as shown in FIGS. 10 (a) and 10 (b), an area surrounded by a square is an area given to each character, and “la” for “do”, “i” for “la”, If the character position of “B” with respect to “I” is 0, the area of each character is placed in contact with the display (actually, no square is displayed).

  The character interval (position on the display of the pictogram) between “bu” and “pictogram” is set to −W (bu). W (bu) is the width of the character region of “bu”. Then, “Emoji” is displayed at the position overlapping “B”. In this case, if the width W (pictogram) of the pictogram is larger than W (bu), the result is as shown in FIG. The position of “ni” should be 0. When the widths of “bu” and “pictogram” are different, the display position of the pictogram is set as − {W (bu) / 2 + W (pictogram) / 2} so that the centers of the two coincide and overlap. You may prescribe. Alternatively, when the width W (pictogram) of the pictogram is smaller than W (bub), the display position of the pictogram may be set to −W (pictogram). On the other hand, when the size of the pictogram is large, the position on the display of the pictogram may be defined as − {W (bu) + W (b)}. In this case, when the size of the pictogram is smaller than W (bu) + W (b), the position of “ni” may be {W (bu) + W (b) −W (pictogram)}. When the size is larger than W (bu) + W (b), it may be set to 0.

  The format data may have more detailed information. With the format data shown in FIG. 11, the full-size “pictogram” moves over “Let's go to the drive”, which is larger than its own width. The character position (W0) is as described above for the character and indicates the initial position for the pictograph. The initial position is used in a sequence (M) described later. The movement start position (W1) indicates an initial position where the pictograph moves. The movement end position (W2) indicates the last position where the pictograph moves. The moving speed (S) indicates the number of characters moving per second. You may define by the width | variety (the same unit as W) which moves in 1 second. This is a smoother movement when the character width is not equal. The moving method (N) is defined as “1” is reciprocating, “2” is moving from left to right, and “3” is moving from right to left. The sequence (M) defines the moving order when there are a plurality of moving pictograms. When other pictographs are moving, it stops at the position defined by the character position (W0). That is, the movement of the next pictogram is started after one pictogram moves in a manner, and a plurality of pictograms can be prevented from moving simultaneously and appearing messy. The pictogram with M = 1 moves first, and the pictogram with M = 2 moves second. A pictogram with M = 0 may always move. The pictogram stereoscopic degree (Q) indicates the stereoscopic degree at each position of the pictogram. When the degree of stereo is negative, an emoticon is visible on the back side of the screen, and when it is positive, the emoticon appears on the near side of the screen. The larger the numerical value, the greater the sense of depth or pop-out. The stereoscopic degree defines the amount of shift when the pixel receiving process is performed on the device side that has received the file from one two-dimensional pictogram to obtain two pictograms for the right eye and the left eye. Even when the right-eye and left-eye pictograms have synthesized glyph dot data, the stereoscopic degree (Q) can be used when this is once separated into a plurality of glyph dot data and re-synthesized. . Instead of determining the degree of stereology (Q) corresponding to each character position, for example, within the moving range of pictograms, for example, Q = 1 “move from the back to the front”, Q = 2 ”move from the front to the back “, Q = 3” can be defined as “repeatedly moving from the back side to the front side and moving again to the back side”. The initial position may be flat display or stereoscopic display. In the case of an animation image, the still image may be determined to use the first frame, or the frame to be used may be designated. The frame to be used is preferably written in a header or the like. When there are a plurality of pictograms, the pictograms on standby for stereoscopic stereoscopic display are viewed stereoscopically or in plan view in a stationary state. In this case, the pictograms that are not performing animated stereoscopic display (standby pictograms) May be displayed based on information indicating the state of the object (information indicating whether the object is in plan view or stereoscopic view). The instruction information and the frame to be used may be written in a header, format data, or the like.

  In the above example, the pictograph that is the object is superimposed on the character viewed in plan and stereoscopically viewed, but both the character and the object are stereoscopically viewed at different positions on the Z axis, for example. May be. Or it is good also as making it stereoscopically superimpose a character on the planarly viewed object. Further, the stereoscopic video display device can be configured as a digital broadcast receiving device capable of receiving a data broadcast (such as a BML file) and displaying an image in addition to a personal computer or a portable device having a communication environment and an image display function.

It is the block diagram which showed the architecture example of the personal computer. It is the block diagram which showed the structural example of the video card. FIG. 4A shows text data, and FIG. 4B is an explanatory diagram showing animation image data. It is explanatory drawing of the display display seen through the parallax barrier. It is explanatory drawing which showed the image of the stereoscopic vision. It is explanatory drawing which showed the principle of stereoscopic vision. It is explanatory drawing which showed the example of character conversion. It is explanatory drawing which showed text data. It is explanatory drawing which showed the positional relationship example of a pictogram and a planar view character. FIG. 4A is an explanatory diagram showing a display example using text data and format data, and FIG. 4B is an explanatory diagram showing a start position and an end position of characters. It is explanatory drawing which showed the correspondence of text data and detailed format data.

Explanation of symbols

1 CPU
4 memory 5 video card 5a VRAM
5b VRAM controller

Claims (13)

Characters that are displayed in a plan view or a stereoscopic view are displayed on a display by using a character image and an image of a target object and performing a rendering process for stereoscopic display on at least one of the character image and the target object image. The object overlaps the near side or the back side of the character and is stereoscopically viewed, or the object overlaps the front side of the stereoscopically displayed character displayed on the display or the back side of the character and is viewed in plan. A stereoscopic video display device configured to be configured as described above. The stereoscopic video display apparatus according to claim 1, wherein the file to be rendered includes a code for specifying a character image and an image of the target object. 2. The stereoscopic video display apparatus according to claim 1, wherein the file to be rendered includes a code for specifying a character image and a pictographic code for specifying the image of the object. Display device. 4. The stereoscopic video display device according to claim 2, wherein the file includes control information for controlling the stereoscopic display, and is configured as a text file or a binary file. Video display device. 5. The stereoscopic video display device according to claim 2, further comprising means for transmitting and / or receiving the file. 6. The stereoscopic video display device according to claim 1, wherein the stereoscopic video display device transparently combines the character image and the image data of the object at a predetermined ratio. The stereoscopic image display device according to any one of claims 1 to 6, wherein the character image data and the object image data are developed on a separate memory area and then combined on a drawing memory. 3D image display device. The stereoscopic video display device according to any one of claims 1 to 7, wherein the object is displayed in an animation stereoscopic view or an animation plane view. The stereoscopic image display device according to claim 8, comprising at least one of information for deforming the object, information for erasure, and information for movement, and generating a plurality of images using one or more of the information. A stereoscopic video display device characterized in that an object is displayed in an animation stereoscopic view or an animation plane view. 9. The stereoscopic video display device according to claim 8, wherein a plurality of dots having at least one of deformed dot data, erased dot data, and moved dot data of the object and forming different images from each other. A stereoscopic image display apparatus, wherein an object is displayed in an animation stereoscopic view or an animation plane view according to data. The stereoscopic video display device according to any one of claims 1 to 10, wherein when there are a plurality of objects, control is performed so that two or more stereoscopic displays are not performed simultaneously. Display device. The stereoscopic image display device according to any one of claims 8 to 10, wherein when there are a plurality of the objects, the animation stereoscopic display is sequentially executed, and the object on standby for animation stereoscopic display is stationary. A stereoscopic image display device configured to be stereoscopically or planarly viewed in a state. 13. The stereoscopic image display device according to claim 11 or 12, wherein an object for which stereoscopic display or animation stereoscopic display is not executed is displayed based on information indicating the state of the object. A stereoscopic image display device characterized by being configured as described above.

Images