JP2007081562A - Stereoscopic image display device, stereoscopic image display program, and stereoscopic image display method - Google Patents

Stereoscopic image display device, stereoscopic image display program, and stereoscopic image display method Download PDF

Info

Publication number
JP2007081562A
JP2007081562A JP2005264176A JP2005264176A JP2007081562A JP 2007081562 A JP2007081562 A JP 2007081562A JP 2005264176 A JP2005264176 A JP 2005264176A JP 2005264176 A JP2005264176 A JP 2005264176A JP 2007081562 A JP2007081562 A JP 2007081562A
Authority
JP
Japan
Prior art keywords
stereoscopic image
image display
position
movement
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2005264176A
Other languages
Japanese (ja)
Inventor
Rieko Fukushima
Yuzo Hirayama
Shunichi Numazaki
Tatsuo Saishiyu
雄三 平山
達夫 最首
俊一 沼崎
理恵子 福島
Original Assignee
Toshiba Corp
株式会社東芝
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Toshiba Corp, 株式会社東芝 filed Critical Toshiba Corp
Priority to JP2005264176A priority Critical patent/JP2007081562A/en
Publication of JP2007081562A publication Critical patent/JP2007081562A/en
Application status is Pending legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/398Synchronisation thereof; Control thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/302Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
    • H04N13/305Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using lenticular lenses, e.g. arrangements of cylindrical lenses
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/324Colour aspects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/366Image reproducers using viewer tracking

Abstract

When an instruction to move a stereoscopic image displayed on a stereoscopic image display unit is received, the movement position of the stereoscopic image according to the received movement instruction is controlled so that an appropriate stereoscopic image is displayed.
When a movement instruction for a stereoscopic image displayed on a stereoscopic image display unit is received (S1), the movement position of the stereoscopic image according to the received movement instruction is corrected to a position where the color information of the stereoscopic image is not destroyed. (S2-S4). As a result, when a stereoscopic image is moved as in the case of an integral imaging type stereoscopic image display device, the stereoscopic image looks strange unless the unit of the pixel or sub-pixel set is considered. However, it is possible to avoid the phenomenon that the stereoscopic image is not correctly viewed, and control can be performed so that an appropriate stereoscopic image is displayed.
[Selection] Figure 4

Description

  The present invention relates to a stereoscopic image display device, a stereoscopic image display program, and a stereoscopic image display method.

  In recent years, various types of stereoscopic image display devices have been developed and put into practical use. For example, the principle of an integral imaging type stereoscopic image display device using a vertical lenticular lens is described in detail in Patent Document 1 and the like.

  In such an integral imaging type stereoscopic image display device using a vertical lenticular lens, for example, 18 subpixels (that is, 6 pixels) are included in one pitch of the lens. Are distributed in 18 directions in the observation space by the lens. By displaying the light beams thus separated from all the lenses, a stereoscopic image display device in which different images are observed depending on the position of the eyes becomes possible. A characteristic of the configuration of such an integral imaging type stereoscopic image display device is that the configuration of the color filter is different from the usual one. In the integral imaging type stereoscopic image display apparatus, the color filters are arranged in the vertical direction with RBGRG. Thus, one color is constituted by three vertical sub-pixels. 18 parallaxes are realized by arranging 18 vertically arranged 3 sub-pixels at one lens pitch. When a normal color filter configuration is used, it is necessary to express one color with three subpixels in the horizontal direction, so that only six parallaxes can be realized. Therefore, it is significant to make such a configuration.

JP 2005-086414 A

  Conventionally, when displaying a stereoscopic image, it is normal to perform stereoscopic display on the entire display of the stereoscopic image display device. However, when displaying stereoscopic image content smaller than the display resolution on a part of the screen, such as a window that is a graphical user interface of an OS (Operating System) of a personal computer, for example, a stereoscopic image of the integral imaging method is used. There is a problem that must be solved in the image display apparatus.

  As described above, in the integral imaging type stereoscopic image display device, one color is constituted by three vertical sub-pixels by arranging the color filter arrangement in the vertical direction along with RBGRG .... For this reason, if the image to be displayed is shifted by one or two pixels in the vertical direction, the RGB combination is distorted and the color of the image changes. That is, when displaying stereoscopic image content smaller than the display resolution in the integral imaging type stereoscopic image display device, there is a problem that a correct color image cannot be displayed depending on the location where the content is arranged.

  In other words, the integral imaging type stereoscopic image display device sets several pixels or sub-pixels and displays them separately in a given direction. Therefore, when moving a stereoscopic image, the pixels or sub-pixels are moved. If the unit of the set is not taken into consideration, the stereoscopic image will look strange.

  In addition, there is a stereoscopic image display using an oblique lenticular lens. In this case, the color information is maintained, but the viewing zone direction is changed by being moved. It is difficult to move a stereoscopic image without changing the viewing zone direction.

  The present invention has been made in view of the above, and when an instruction to move a stereoscopic image displayed on the stereoscopic image display unit is received, the movement position of the stereoscopic image by the received movement instruction is determined as an appropriate stereoscopic image. The purpose is to control so that is displayed.

  In order to solve the above-described problems and achieve the object, a stereoscopic image display device of the present invention includes an image display element in which a plurality of color pixel dots are arranged, and the image display element disposed on the image display element. A stereoscopic image display device that includes a stereoscopic image display unit that includes a light beam direction limiting element that limits a light beam direction emitted from the stereoscopic image display unit, and displays the stereoscopic image so as to be visible on the stereoscopic image display unit. The movement information reception means for receiving the movement instruction for the stereoscopic image displayed on the image display unit, and the movement position of the stereoscopic image by the movement instruction received by the movement instruction reception means, the color information of the stereoscopic image does not collapse. Display position correcting means for correcting the position.

  The stereoscopic image display device of the present invention includes an image display element in which a plurality of color pixel dots are arranged, and a light beam direction limiting element that is disposed on the image display element and limits a light beam direction emitted from the image display element. In a stereoscopic image display device that displays a stereoscopic image so as to be visible on the stereoscopic image display unit, the stereoscopic image displayed on the stereoscopic image display unit A movement instruction receiving means for receiving a movement instruction; a viewing area direction correcting means for correcting the movement position of the stereoscopic image according to the movement instruction received by the movement instruction receiving means to a position that does not change the viewing area direction of the stereoscopic image; Is provided.

  The stereoscopic image display program of the present invention includes an image display element in which a plurality of color pixel dots are arranged, and a light beam direction limiting element that is disposed on the image display element and limits a light beam direction emitted from the image display element. A stereoscopic image display program that causes a computer of a stereoscopic image display device including a stereoscopic image display unit to display a stereoscopic image so that the stereoscopic image display unit can visually recognize the stereoscopic image display unit. A movement instruction reception function for receiving a movement instruction for the displayed stereoscopic image, and a movement position of the stereoscopic image by the movement instruction received by the movement instruction reception function is corrected to a position where the color information of the stereoscopic image is not collapsed. And causing the computer to execute a display position correction function.

  The stereoscopic image display program of the present invention includes an image display element in which a plurality of color pixel dots are arranged, and a light beam direction limiting element that is disposed on the image display element and limits a light beam direction emitted from the image display element. A stereoscopic image display program that causes a computer of a stereoscopic image display device including a stereoscopic image display unit to display a stereoscopic image so that the stereoscopic image display unit can visually recognize the stereoscopic image display unit. A movement instruction reception function for receiving a movement instruction for the displayed stereoscopic image, and a movement position of the stereoscopic image by the movement instruction received by the movement instruction reception function is corrected to a position that does not change the viewing area direction of the stereoscopic image. And causing the computer to execute a viewing direction correction function.

  The stereoscopic image display method of the present invention includes an image display element in which a plurality of color pixel dots are arranged, and a light beam direction limiting element that is disposed on the image display element and limits a light beam direction emitted from the image display element. A stereoscopic image display method for displaying a stereoscopic image in a stereoscopically visible manner on the stereoscopic image display unit of a stereoscopic image display device having a stereoscopic image display unit having a display on the stereoscopic image display unit. A moving instruction receiving step for receiving a moving instruction for the three-dimensional image, and a display position for correcting the moving position of the three-dimensional image according to the moving instruction received in the moving instruction receiving step to a position where the color information of the three-dimensional image is not destroyed. A correction step.

  The stereoscopic image display method of the present invention includes an image display element in which a plurality of color pixel dots are arranged, and a light beam direction limiting element that is disposed on the image display element and limits a light beam direction emitted from the image display element. A stereoscopic image display method for displaying a stereoscopic image in a stereoscopically visible manner on the stereoscopic image display unit of a stereoscopic image display device having a stereoscopic image display unit having a display on the stereoscopic image display unit. A moving instruction receiving step for receiving a moving instruction for the stereoscopic image, and a view for correcting the moving position of the stereoscopic image according to the moving instruction received by the moving instruction receiving step to a position that does not change the viewing zone direction of the stereoscopic image. A region direction correcting step.

  According to the present invention, there is an effect that even if a stereoscopic image is moved by a movement instruction, control can be performed so that an appropriate stereoscopic image is displayed.

  Exemplary embodiments of a stereoscopic image display device, a stereoscopic image display program, and a stereoscopic image display method according to the present invention are explained in detail below with reference to the accompanying drawings.

[First Embodiment]
A first embodiment of the present invention will be described with reference to FIGS.

  FIG. 1 is a block diagram showing a configuration of a stereoscopic image display apparatus 100 according to the first embodiment of the present invention. The stereoscopic image display apparatus 100 includes a CPU (Central Processing Unit) 1 that performs information processing, a ROM (Read Only Memory) 2 that is a read-only memory that stores a BIOS, and a RAM that is a storage unit that stores various data in a rewritable manner. (Random Access Memory) 3, HDD (Hard Disk Drive) 4 that functions as an image storage unit that stores stereoscopic image content and stores a stereoscopic image display program, and an integral imaging stereoscopic image that outputs and displays a stereoscopic image The display unit 5 includes a user interface 6 for allowing a user to input various instructions to the apparatus and display various information.

  The CPU 1 of the stereoscopic image display apparatus 100 executes various arithmetic processes according to the stereoscopic image display program and controls each unit. A characteristic process of the present embodiment that is executed by the CPU 1 of the stereoscopic image display apparatus 100 in accordance with the stereoscopic image display program will be described below.

  FIG. 2 is a block diagram illustrating a functional configuration of the stereoscopic image display apparatus 100. As shown in FIG. 2, the stereoscopic image display apparatus 100 includes an image reading unit 10 that reads the content of the stereoscopic image stored in the image storage unit (HDD 4) by the CPU 1 controlling each unit according to the stereoscopic image display program. The image read-out means 10 converts the image read into an appropriate image to be output to the stereoscopic image display unit 5 and the display position of the output image with respect to the stereoscopic image display unit 5 is appropriately controlled and determined. Output image display position determination means 12 to be performed, movement unit determination means 13 for determining a movement unit suitable for the currently connected stereoscopic image display unit 5, and movement units determined by the movement unit determination means 13 are stored in the RAM 3 or the like. Which movement unit storage means 14 to use and which of the plurality of movement units stored in the RAM 3 or the like is used or none is used. Or the mobile unit switching means 15 for switching the, on the secondary side.

  Here, the stereoscopic image display unit 5 will be described. FIG. 3 is a perspective view showing a partially enlarged configuration of the stereoscopic image display unit 5. As shown in FIG. 3, the stereoscopic image display unit 5 includes an image display element 51 having a plurality of color pixel dots arranged in a two-dimensional plane and capable of displaying a color image, and a direction of light emitted from the color pixel dots. It is comprised from the light direction limiting element 52 which restrict | limits the angle which can be visually recognized by limiting. The image display element 51 is preferably a so-called flat panel in which pixel dots are arranged in a two-dimensional matrix, rather than a CRT or projector, because the displacement of the color pixel dots in the screen greatly affects the light emission direction. Examples of such a display method include a non-light emitting liquid crystal panel (LCD), a light emitting plasma display panel (PDP), and an organic EL (electroluminescence) panel. The beam direction limiting element 52 is a vertical lenticular lens having a generatrix in the vertical direction of the screen.

  In the image display element 51, pixels with an aspect ratio of 3: 1 are arranged in a matrix in a straight line in the horizontal direction and the vertical direction, and each pixel has R (red) and G (green) in the horizontal direction in the same row. , B (blue) are alternately arranged, and R (red), B (blue), and G (green) are alternately arranged in the vertical direction in the same column. FIG. 4 is a plan view showing an example of the pixel array. The numbers from -9 to 9 represent parallax numbers, and the adjacent parallax numbers are assigned to the adjacent columns. The vertical period of the pixel row is three times the horizontal period Pp of the pixel. In the image display element 51 shown in FIG. 3, one effective pixel 53 (the one effective pixel 53 is indicated by a black frame in FIG. 3) is configured by pixels of 18 columns and 6 rows. With such a structure of the image display element 51, stereoscopic display that gives 18 parallaxes in the horizontal direction is possible.

  Since the image output to the stereoscopic image display unit 5 is interleaved with each parallax image, it is not recognized as a normal image when viewed without the light beam direction limiting element (vertical lenticular lens) 52, and JPEG It is not suitable for image compression such as MPEG. Therefore, the image storage means (HDD 4) stores an image in which the parallax images are arranged in an array and is compressed and stored. In the image conversion means 11 at the time of reproduction, the image read by the image reading means 10 is stored. Is decoded to restore the image, and interleave conversion is performed to convert the image into a format that can be output to the stereoscopic image display unit 5. Further, the image conversion means 11 can change the size by enlarging / reducing the decoded image before performing the interleave conversion. This is because the interleave conversion can be performed correctly even if the size is changed.

  By the way, in the image display element 51 of the integral imaging type stereoscopic image display unit 5, one color is constituted by three vertical sub-pixels by arranging the color filter color arrangement in the vertical direction with RBGRG. Therefore, if the image to be displayed is shifted by 1 or 2 pixels in the vertical direction, the RGB combination is out of order and the color of the image is changed. That is, in the case of displaying stereoscopic image content smaller than the display resolution in the integral imaging type stereoscopic image display unit 5, there is a problem that a correct color image is not displayed depending on the location where the content is arranged.

  Therefore, in the present embodiment, the movement unit determining unit 13 determines a movement unit suitable for the currently connected stereoscopic image display unit 5, and the movement unit determined by the movement unit determination unit 13 is the movement unit storage unit. 14 is stored in the RAM 3 or the like, and the movement unit switching means 15 switches which one of a plurality of movement units stored in the RAM 3 or the like is used or none is used. Then, the output image display position determination unit 12 refers to the movement unit switched by the movement unit switching unit 15 and appropriately controls and determines the display position of the output image on the stereoscopic image display unit 5. This point will be described in detail below.

  The movement unit has a different value depending on the type of the stereoscopic image display unit 5, and the movement unit for each type is stored in the RAM 3 or the like by the movement unit storage unit 14. The movement unit determination unit 13 determines a movement unit from the attribute information of the stereoscopic image display unit 5. As a method for this determination, the combination of the type and movement unit of the stereoscopic image display unit 5 is held as a table, the movement unit can be obtained by referring to the table, or the light direction limiting element (vertical lenticular) It can also be calculated from the inclination of the lens) 52 and the number of parallaxes. In addition, the movement unit determination means 13 can be controlled by the user specifying the type of the stereoscopic image display unit 5 through the user interface 6. Furthermore, it is also possible to store the movement unit amount in the stereoscopic image display unit 5 itself, and to read and store it.

  When the interleaved image is output to the stereoscopic image display unit 5, it is output to the output image display position determined by the output image display position determining means 12. When the user changes the position of the output image, the output image display position determining unit 12 refers to the movement unit and corrects and displays it at an appropriate place closest to the position to be changed.

  Here, a method of correcting the display position of the output image by the output image display position determining means 12 when the user changes the position of the output image will be described with reference to the flowchart shown in FIG. The movement unit storage means 14 stores the RAM 3 in the first movement unit (xu1, yu1) that is the smallest movement unit that does not change the viewing area direction of the stereoscopic image and the smallest movement unit that does not break the color information of the stereoscopic image. A certain second movement unit (xu2, yu2) is stored, and in this embodiment, the position is adjusted with reference to the second movement unit (xu2, yu2).

  For example, when the display of a stereoscopic image is handled on the OS, it is assumed that the contents of a window, which is a graphical user interface included in the OS, is a stereoscopic image and the window is moved. Normally, when displaying a window, the upper left coordinates (xw, yw) are designated and displayed. That is, since the stereoscopic image display portion in the window is displayed with a certain position (xs, ys) shifted from the left end of the window, the upper left coordinates are (xw + xs, yw + ys). The output image display position determining means 12 adjusts the position of (xw + xs, yw + ys) to be appropriate.

  As shown in FIG. 4, when the temporary coordinates (xwt, ywt) at the upper left of the window due to the user moving the window position are acquired (step S1), the temporary upper left coordinates (xwt + xs) of the stereoscopic image display portion in the window. , Ywt + ys) is obtained (step S2).

In subsequent step S3, nn and mm are calculated such that (nn × xu2, mm × yu2) is closest to the provisional upper left coordinates (xwt + xs, ywt + ys) of the stereoscopic image portion. More specifically,
n × xu2 <xwt + xs <(n + 1) × xu2
m × yu2 <yut + ys <(m + 1) × yu2
There are integers n and m that satisfy. At this time,
(Xwt + xs) − (n × xu2) <[(n + 1) × xu2] − (xwt + xs)
If so, nn = n, otherwise nn = n + 1.
Also,
(Ywt + ys) − (m × yu2) <[(m + 1) × yu2] − (ywt + ys)
If so, mm = m, otherwise, mm = m + 1. That is, the integer n such that n × xu2 is closest to xwt + xs is nn, and the integer m such that m × yu2 is closest to ywt + ys is mm.

Subsequently, using the obtained nn and mm, the final upper left coordinates (nn × xu2-xs, mm × yu2-ys) of the window are obtained (step S4), and the window and the stereoscopic image are obtained at the obtained position. Displayed (step S5). More specifically,
xw = nn × xu2-xs
yw = mm × yu2-ys
To obtain the adjusted window position (xw, yw), and display the window according to the coordinates. By doing so, the stereoscopic image portion in the window is displayed in an appropriate state.

  As described above, according to the present embodiment, when an instruction to move the stereoscopic image displayed on the stereoscopic image display unit is received, the color information of the stereoscopic image does not collapse the moving position of the stereoscopic image according to the received movement instruction. Correct to position. As a result, when a stereoscopic image is moved as in the case of an integral imaging type stereoscopic image display device, the stereoscopic image looks strange unless the unit of the pixel or sub-pixel set is considered. However, it is possible to avoid the phenomenon that the stereoscopic image cannot be correctly viewed, and even when the stereoscopic image is moved according to the movement instruction, it is possible to perform control so that an appropriate stereoscopic image is displayed.

  When a stereoscopic image is displayed inside a window that is a graphical user interface of the OS, the window itself can be moved, or only the internal stereoscopic image can be moved without moving the window itself. Both are possible as an implementation.

[Second Embodiment]
Next, a second embodiment of the present invention will be described with reference to FIGS. The same parts as those in the first embodiment described above are denoted by the same reference numerals, and description thereof is also omitted.

  In the first embodiment, the viewing zone direction is always maintained even when the window, which is a graphical user interface of the OS, is moved. However, in some cases, ease of use may be increased by controlling the viewing zone direction so that it always faces the viewer. For example, when the window size is large and the window is relatively small, if the window is moved toward the end, the position of the observer may move toward or away from the end of the viewing zone. The same phenomenon can occur when the stereoscopic image display unit 5 is originally designed to have a narrow viewing zone.

Here, FIG. 5 shows how the twelve sub-pixels in one element image in the stereoscopic image display unit of the 12 parallax integral imaging method using the vertical lenticular lens are reproduced in space by the lens. It is a thing. Here, it is assumed that the image is shifted by one pixel. Since one pixel corresponds to a shift of 3 sub-pixels, the ray reproduction of 12 sub-pixels of the element image changes as shown in FIG. The central direction of the viewing zone also changes from A to B. The deviation is “L × 3 × tan θ” at the observation distance L, and tan θ is a factor representing one light beam interval, and is a value unique to each stereoscopic image display unit. To be precise, when there are s subpixels in one element image and the lens is distributed to an angle of ± θ1, tanθ is expressed by the following equation.
tanθ = 2 × tanθ1 ÷ s

  Here, when the window, which is a graphical user interface of the OS, is moved, the viewing zone direction is set so that the center of the viewing zone of the stereoscopic display image portion in the window passes closest to the observation position. Can be adjusted. Here, the center of the viewing zone is assumed to be the center in the light beam reproduction direction at the center position of the stereoscopic image portion. First, when the x coordinate of a certain element image is “a × xu1 + b × xu2”, it is considered where the central direction of the light beam reproduction direction is directed. In the case of a 12-parallax stereoscopic display unit, the width of one element image is 4 pixels (12 sub-pixels), and a is a value from −3 to +3. The deviation of the viewing zone center at the observation distance L with respect to each value of a is “−a × L × 3 × tan θ”. The viewing zone shift is assumed to be positive when it is the same as the x-coordinate direction of the screen. However, for example, when a = −1, the position is shifted to “L × 3 × tan θ”, but at the same time, the same point can be observed at the position “−3 × L × 3 × tan θ” (see FIG. 7). ). This is the same as the same point can be observed repeatedly at the position of “± 12 × L × tan θ” even during normal stereoscopic image observation.

  Therefore, in the present embodiment, for example, when the user moves the position of a window, which is a graphical user interface that the OS has, the minimum movement that does not break the color information described in the first embodiment. In addition to the adjustment of the movement position according to the unit, the movement position is adjusted according to the minimum movement unit that does not change the viewing zone direction so that the viewing zone direction is always directed toward the observer.

  FIG. 8 is a block diagram illustrating a functional configuration of the stereoscopic image display apparatus 100 according to the second embodiment of the present invention. As shown in FIG. 8, in the stereoscopic image display apparatus 100, the stereoscopic image stored in the image storage means (HDD 4) described in the first embodiment is controlled by the CPU 1 according to the stereoscopic image display program. Image reading means 10 for reading the content of the image, image conversion means 11 for converting the image read by the image reading means 10 into an appropriate image to be output to the stereoscopic image display section 5, and the currently connected stereoscopic image display section In addition to the movement unit determination means 13 for determining the movement unit suitable for 5 and the movement unit storage means 14 for storing the movement unit determined by the movement unit determination means 13 in the RAM 3 or the like, the movement unit storage means 14 is linked. A plurality of display position control means (window position control means 21, scroll control means 22, viewing zone direction control means 23) and output image display means 24; It is provided.

  Note that the movement unit stored in the RAM 3 or the like by the movement unit storage unit 14 is the second movement unit that is the minimum movement unit that does not collapse the color information and the first movement unit that does not change the viewing zone direction. A unit of movement is provided for each type of stereoscopic image display unit 5.

  The window position control unit 21 determines a movement unit (first movement unit) suitable for the currently connected stereoscopic image display unit 5 from a plurality of movement units stored in the RAM 3 or the like by the movement unit storage unit 14. The display position of the output image on the stereoscopic image display unit 5 is appropriately controlled and determined, and the position information is passed to the output image display means 24.

  The viewing zone direction control means 23 detects the position of the observer's head by the head position detection means 30 provided in the stereoscopic image display device 100, finds the optimal viewing zone direction for the position, and Position information is passed to the output image display means 24. The head position detection means 30 is not described in detail here. For example, the position of the head is detected by attaching an ultrasonic sensor to the head, or the position of the head is detected using a camera image with a marker attached to the head. Or a method for detecting the position of a face from an image including an observer can be used.

  When scrolling the stereoscopic image, the scroll control means 22 moves from a plurality of movement units stored in the RAM 3 or the like by the movement unit storage means 14 to a movement unit suitable for the stereoscopic image display unit 5 currently connected (second display). The unit of movement) is determined, the display position of the output image on the stereoscopic image display unit 5 is appropriately controlled and determined, and the position information is passed to the output image display means 24. For example, in a stereoscopic image in which the right and left edges are continuous or the top and bottom edges are continuous, the part that can no longer be displayed from the edge by scrolling it in the free direction is displayed on the opposite side. Infinite scrolling is possible. In the case of such scroll control, basically, by using the movement unit (second movement unit), it is possible to scroll while maintaining the viewing zone direction. If it is desired to simultaneously perform the viewing zone control according to the head position while scrolling, it is possible to control both the scroll position and the viewing zone direction in cooperation with the viewing zone direction control means 23.

  The output image display means 24 displays a stereoscopic image according to the position information passed from each display position control means (window position control means 21, scroll control means 22, viewing area direction control means 23), so that an appropriate viewing zone is displayed. Direction control is possible.

  Even when the stereoscopic image is displayed on the entire screen, there are cases where it is desired to control the viewing zone direction. In such a case, the viewing zone direction can be controlled by slightly adjusting the position in the second movement unit from the state in which the stereoscopic image is displayed on the entire display device.

  Here, a method for optimizing the viewing direction when the user changes the position of the output image will be described with reference to the flowchart shown in FIG. Here, as a case of displaying a stereoscopic image on the OS, it is assumed that the contents of a window, which is a graphical user interface included in the OS, is a stereoscopic image and the window is moved. Note that the position of the observer is a position at a distance L from the center of the stereoscopic image display unit 5.

  As shown in FIG. 9, when the temporary coordinates (xwt, ywt) at the upper left of the window obtained by the user moving the window position are acquired (step S11), the center position of the stereoscopic image portion and the center of the stereoscopic image display unit 5 are obtained. Distance D (D is positive when the center of the stereoscopic image portion is shifted in the positive direction of the x-axis from the center of the stereoscopic image display unit 5) (step S12). In other words, the viewing zone center may be shifted by D at the observation distance L.

  In the subsequent step S13, a is obtained so that the viewing area shift amount “−a × L × 3 × tan θ” becomes an appropriate amount at the observation distance. In other words, a is obtained in which the viewing area shift amount “−a × L × 3 × tan θ” is closest to the distance D between the center position of the stereoscopic image portion and the center of the stereoscopic image display unit 5.

  Subsequently, a multiple of 4 is added to or subtracted from a to make a an integer between 0 and 3 (step S14).

  Subsequently, b is calculated such that “a × xu1 + b × xu2” is closest to the temporary window position at the center of the stereoscopic image portion (step S15).

  In the subsequent step S16, the stereo image center “a × xu1 + b × xu2” is obtained using a and b obtained in steps S14 and 15, and the upper left coordinates of the window are determined based on the stereo image center.

  Finally, the window and the stereoscopic image are displayed at the position obtained in step S16, and the process is terminated (step S17).

  The case where the vertical lenticular lens is used in the stereoscopic image display unit 5 has been described above, but the case where the oblique lenticular lens is used in the stereoscopic image display unit 5 will be briefly described.

  For example, in the case of a 16-parallax stereoscopic image display unit 5 configured by an oblique lenticular lens, if the second movement unit is moved in the horizontal direction, the viewing area is shifted by 4 parallaxes, but the second movement is performed in the vertical direction. When the unit moves by one unit, the viewing area for one parallax moves. In the case of a vertical lenticular lens, even if it moved in the vertical direction, there was no movement in the horizontal direction of the viewing zone, so it was sufficient to consider only the position adjustment in the horizontal direction. Finer viewing zone control is possible by adjusting the direction. In any case, the distance between the center position of the three-dimensional image portion and the center of the display device is obtained to determine how much the viewing zone is properly shifted, and the first movement unit and the second movement unit are adjusted accordingly. The process of obtaining the optimal position combining the above is the same.

  Here, a calculation method of the first movement unit and the second movement unit corresponding to various stereoscopic image display units 5 will be described. Here, a calculation method in the case of the N-parallax stereoscopic image display unit 5 in the case of a vertical lenticular lens and an oblique lenticular lens is shown.

  First, the arrangement of the color filters of the image display element 51 of the stereoscopic image display unit 5 affects the second movement unit, which is the minimum movement unit in which the color information does not collapse. Normally, RGB color filters are arranged in stripes in the vertical direction, and in the case of an oblique lenticular lens, the color filters are arranged in the same manner. In the case of a stereoscopic image display device with a vertical lenticular lens, the color of the filter is not the same in the vertical direction, as shown in FIG. Therefore, in the case of a vertical lenticular lens, it can move only in units of 3 pixels in the vertical direction. In the case of the horizontal direction and the oblique lenticular lens, the color information is not corrupted and can be moved in units of one pixel.

  Next, the first movement unit, which is the minimum movement unit that does not change the viewing zone direction, will be described. In the case of the vertical lenticular lens, one elemental image is composed of N sub-pixels in the horizontal direction, which corresponds to N / 3 pixels. Therefore, the viewing zone direction does not change by moving N / 3 pixels. In the case of an oblique lenticular lens, for example, in the case of 16 parallaxes, 4 × 4 pixels are units of element images, and 16 pixels = 48 subpixels are appropriately distributed in 16 directions. Similarly, in the case of 25 parallaxes, 5 × 5 pixels are element image units. Therefore, in the case of 16 parallaxes, the viewing zone direction does not change by moving in units of 4 pixels in both the vertical and horizontal directions, and in the case of 25 parallaxes, the viewing zone is moved by moving in units of 5 pixels in both the vertical and horizontal directions. does not change.

Therefore, in the case of N parallax vertical lenticular lens,
The first movement unit is (N / 3, 3)
The second movement unit is (1, 3)
It becomes. On the other hand, in the case of an N parallax oblique lenticular lens,
The first movement unit is (√N, √N)
The second movement unit is (1, 1)
It becomes.

  According to the present embodiment, it is possible to display a stereoscopic image of the contents of a window which is a graphical user interface possessed by the OS. The graphical user interface possessed by such an OS is expressed by a combination of various image elements such as various icons, fonts, and a desktop screen. Although the font is text information, it is a kind of image expressed by dots when displayed on the screen, so it is considered as one of the image elements. Each of these image elements is created as an image that can be stereoscopically displayed, and by arranging it, a screen configuration that is stereoscopically displayed can be created. At that time, it is possible to display a small image such as an icon in a stereoscopic manner, but control of the viewing zone direction is important because it is small. When the icon is placed toward the end, it is desirable that the second moving unit automatically adjusts so that the viewing zone faces the viewer's position. According to the present embodiment, by automatically adjusting the position when the icon is moved, the viewing zone can be directed to the position of the observer. Some OSs have a function of automatically aligning icons. In such a case, the OSs are aligned in consideration of the control of the viewing zone. Such an automatic position control function is suitably incorporated in the OS. In addition, the standard face position (particularly the distance from the display device) may differ depending on the user. In such a case, the setting of the presumed face position can be changed. In some cases, by constantly monitoring the position of the head using a camera or the like, viewing zone adjustment suitable for the position can be dynamically performed. By doing in this way, for example, there is a desktop screen that is retracted in the back of the screen, and a 3D icon popping out from the desktop surface is arranged, and an environment in which an operation can be performed with a 3D mouse cursor can be realized. All the stereoscopic images displayed on the screen are appropriately stereoscopically viewed from the observer's position.

  As described above, according to the present embodiment, when an instruction to move the stereoscopic image displayed on the stereoscopic image display unit is received, the movement position of the stereoscopic image according to the received movement instruction is changed, and the viewing area direction of the stereoscopic image is changed. Correct the position so that it does not. Thereby, it is possible to move the stereoscopic image display portion in a state where the viewing zone direction is always directed to the observer, so that the stereoscopic image included in the window smaller than the entire display device can be moved while maintaining the viewing zone direction, Moreover, it can control to become an appropriate visual field direction according to a display place, and it can control to display an appropriate three-dimensional image.

It is a block diagram which shows the structure of the three-dimensional image display apparatus concerning the 1st Embodiment of this invention. It is a block diagram which shows the function structure of a three-dimensional image display apparatus. It is a perspective view which expands and partially shows the structure of a three-dimensional image display part. It is a flowchart which shows the flow of a correction process of the display position of a stereo image. It is explanatory drawing which shows the visual field direction of the standard state in the stereoscopic image display part of the integral imaging system used as the premise of the 2nd Embodiment of this invention. It is explanatory drawing which shows the change of a viewing area direction when a display position shifts | deviates only by the 1st movement unit. It is explanatory drawing which shows two viewing zone directions observed simultaneously. It is a block diagram which shows the function structure of the three-dimensional image display apparatus of the 2nd Embodiment of this invention. It is a flowchart which shows the flow of the optimization process of a visual field direction.

Explanation of symbols

DESCRIPTION OF SYMBOLS 3 Memory | storage part 5 Stereoscopic image display part 14 Movement unit memory | storage means 15 Movement unit switching means 30 Head position detection means 51 Image display element 52 Ray direction limiting element 100 Stereoscopic image display apparatus

Claims (15)

  1. A stereoscopic image display unit having an image display element in which a plurality of color pixel dots are arranged, and a light beam direction limiting element that is disposed on the image display element and limits a light beam direction emitted from the image display element. In a stereoscopic image display device that displays a stereoscopic image so as to be visible on the stereoscopic image display unit,
    A movement instruction receiving means for receiving a movement instruction of the stereoscopic image displayed on the stereoscopic image display unit;
    Display position correcting means for correcting the movement position of the stereoscopic image by the movement instruction received by the movement instruction receiving means to a position where the color information of the stereoscopic image is not collapsed;
    A stereoscopic image display device comprising:
  2. The display position correcting unit further includes a viewing zone direction correcting unit that corrects the moving position of the stereoscopic image according to the moving instruction received by the moving instruction receiving unit to a position that does not change the viewing zone direction of the stereoscopic image.
    The three-dimensional image display device according to claim 1.
  3. A stereoscopic image display unit having an image display element in which a plurality of color pixel dots are arranged, and a light beam direction limiting element that is disposed on the image display element and limits a light beam direction emitted from the image display element. In a stereoscopic image display device that displays a stereoscopic image so as to be visible on the stereoscopic image display unit,
    A movement instruction receiving means for receiving a movement instruction of the stereoscopic image displayed on the stereoscopic image display unit;
    Viewing area direction correcting means for correcting the moving position of the stereoscopic image by the moving instruction received by the moving instruction receiving means to a position that does not change the viewing area direction of the stereoscopic image;
    A stereoscopic image display device comprising:
  4. The display position correction means corrects the movement position of the stereoscopic image output to the stereoscopic image display unit to a position where the color information of the stereoscopic image does not collapse. With reference to the movement unit, the movement instruction received by the movement instruction receiving means is corrected to a position closest to the movement position of the stereoscopic image.
    The stereoscopic image display apparatus according to claim 1 or 2, wherein
  5. The viewing zone direction calculating means has the center of the viewing zone, which is the center of the light beam reproduction direction at the center position of the stereoscopic image corrected to a position where the color information is not destroyed by the display position correcting means, passes the closest to the observation position. So as to adjust in increments of the minimum movement unit that does not change the viewing zone direction of the stereoscopic image,
    The three-dimensional image display apparatus according to claim 2 or 3,
  6. A moving unit storage unit that stores a minimum moving unit that does not change a viewing area direction of the stereoscopic image and a minimum moving unit that does not collapse color information of the stereoscopic image in a storage unit for each stereoscopic image display unit;
    A movement unit switching means for switching which one of a plurality of movement units stored in the storage unit by the movement unit storage means to use or none of which is used when the movement instruction is received by the movement instruction receiving means; ,
    The three-dimensional image display device according to claim 4, comprising:
  7. A head position detecting means for detecting the position of the head of the observer;
    The position of the observer's head is detected by this head position detecting means and set as the observation position.
    The three-dimensional image display apparatus according to claim 5.
  8. In the image display element, RGB color filters are arranged in stripes in the vertical direction, and when the light direction limiting element is an N parallax vertical lenticular lens,
    The minimum movement unit that does not collapse the color information of the stereoscopic image is (1, 3).
    The minimum moving unit that does not change the viewing zone direction of the stereoscopic image is (N / 3, 3)
    Is,
    The three-dimensional image display device according to claim 4 or 5, characterized by the above.
  9. In the image display element, RGB color filters are arranged in stripes in the vertical direction, and when the light beam direction limiting element is an N parallax oblique lenticular lens,
    The minimum movement unit that does not collapse the color information of the stereoscopic image is (1, 1).
    The minimum movement unit that does not change the viewing zone direction of the stereoscopic image is (√N, √N).
    Is,
    The three-dimensional image display device according to claim 4 or 5, characterized by the above.
  10. A stereoscopic image display unit having an image display element in which a plurality of color pixel dots are arranged, and a light beam direction limiting element that is disposed on the image display element and limits a light beam direction emitted from the image display element. A stereoscopic image display program for causing a computer of a stereoscopic image display device provided to display a stereoscopic image on the stereoscopic image display unit so as to be visible,
    A movement instruction accepting function for accepting an instruction to move the stereoscopic image displayed on the stereoscopic image display unit;
    A display position correction function for correcting the movement position of the stereoscopic image according to the movement instruction received by the movement instruction reception function to a position where the color information of the stereoscopic image does not collapse;
    A three-dimensional image display program for causing the computer to execute.
  11. Causing the computer to further execute a viewing area direction correcting function for correcting the movement position of the stereoscopic image by the movement instruction received by the movement instruction receiving means to a position that does not change the viewing area direction of the stereoscopic image;
    The three-dimensional image display program according to claim 10.
  12. A stereoscopic image display unit having an image display element in which a plurality of color pixel dots are arranged, and a light beam direction limiting element that is disposed on the image display element and limits a light beam direction emitted from the image display element. A stereoscopic image display program for causing a computer of a stereoscopic image display device provided to display a stereoscopic image on the stereoscopic image display unit so as to be visible,
    A movement instruction accepting function for accepting an instruction to move the stereoscopic image displayed on the stereoscopic image display unit;
    A viewing direction correction function for correcting the movement position of the stereoscopic image by the movement instruction received by the movement instruction receiving function to a position that does not change the viewing direction of the stereoscopic image;
    A three-dimensional image display program for causing the computer to execute.
  13. A stereoscopic image display unit having an image display element in which a plurality of color pixel dots are arranged, and a light beam direction limiting element that is disposed on the image display element and limits a light beam direction emitted from the image display element. A stereoscopic image display method for displaying a stereoscopic image so as to be visible on the stereoscopic image display unit of the provided stereoscopic image display device,
    A movement instruction receiving step of receiving a movement instruction of the stereoscopic image displayed on the stereoscopic image display unit;
    A display position correction step of correcting the movement position of the stereoscopic image by the movement instruction received by the movement instruction reception step to a position where the color information of the stereoscopic image is not collapsed;
    A stereoscopic image display method comprising:
  14. A viewing direction correction step of correcting the movement position of the stereoscopic image by the movement instruction received by the movement instruction receiving means to a position that does not change the viewing area direction of the stereoscopic image;
    The three-dimensional image display method according to claim 13.
  15. A stereoscopic image display unit having an image display element in which a plurality of color pixel dots are arranged, and a light beam direction limiting element that is disposed on the image display element and limits a light beam direction emitted from the image display element. A stereoscopic image display method for displaying a stereoscopic image so as to be visible on the stereoscopic image display unit of the provided stereoscopic image display device,
    A movement instruction receiving step of receiving a movement instruction of the stereoscopic image displayed on the stereoscopic image display unit;
    A viewing direction correction step of correcting the moving position of the stereoscopic image by the moving instruction received by the moving instruction receiving step to a position that does not change the viewing direction of the stereoscopic image;
    A stereoscopic image display method comprising:
JP2005264176A 2005-09-12 2005-09-12 Stereoscopic image display device, stereoscopic image display program, and stereoscopic image display method Pending JP2007081562A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2005264176A JP2007081562A (en) 2005-09-12 2005-09-12 Stereoscopic image display device, stereoscopic image display program, and stereoscopic image display method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2005264176A JP2007081562A (en) 2005-09-12 2005-09-12 Stereoscopic image display device, stereoscopic image display program, and stereoscopic image display method
US11/518,994 US20070058034A1 (en) 2005-09-12 2006-09-12 Stereoscopic image display device, stereoscopic display program, and stereoscopic display method

Publications (1)

Publication Number Publication Date
JP2007081562A true JP2007081562A (en) 2007-03-29

Family

ID=37854642

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2005264176A Pending JP2007081562A (en) 2005-09-12 2005-09-12 Stereoscopic image display device, stereoscopic image display program, and stereoscopic image display method

Country Status (2)

Country Link
US (1) US20070058034A1 (en)
JP (1) JP2007081562A (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013051627A (en) * 2011-08-31 2013-03-14 Toshiba Corp Vision adjustment device, image processor, and vision adjustment method
JP2013055666A (en) * 2012-09-26 2013-03-21 Toshiba Corp Video processing apparatus, video processing method and remote controller
CN103037230A (en) * 2011-09-30 2013-04-10 株式会社东芝 Three-dimensional image processing apparatus and three-dimensional image processing method
JP2013081177A (en) * 2012-10-18 2013-05-02 Toshiba Corp Electronic apparatus and control method for electronic apparatus
JP2013530413A (en) * 2010-04-20 2013-07-25 エントロピック・コミュニケーションズ・インコーポレイテッドEntropic Communications, Inc. System and method for displaying a user interface on a three-dimensional display
JP2013229828A (en) * 2012-04-26 2013-11-07 Toshiba Corp Image processing device, method, program, and stereoscopic image display device
KR101738001B1 (en) * 2011-03-25 2017-05-29 엘지전자 주식회사 Mobile Terminal And Method Of Controlling The Same

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4714116B2 (en) * 2006-09-07 2011-06-29 株式会社東芝 3D image display apparatus and 3D image display method
JP5320574B2 (en) * 2007-12-20 2013-10-23 リアルディー インコーポレイテッドRealD Inc. In-pixel lighting system and method
US8384718B2 (en) * 2008-01-10 2013-02-26 Sony Corporation System and method for navigating a 3D graphical user interface
JP2010045584A (en) * 2008-08-12 2010-02-25 Sony Corp Solid image correcting apparatus, solid image correcting method, solid image display, solid image reproducing apparatus, solid image presenting system, program, and recording medium
JP5368463B2 (en) * 2008-09-18 2013-12-18 パナソニック株式会社 Stereoscopic video playback device and stereoscopic video display device
US9066076B2 (en) * 2009-10-30 2015-06-23 Mitsubishi Electric Corporation Video display control method and apparatus
KR101629479B1 (en) * 2009-11-04 2016-06-10 삼성전자주식회사 High density multi-view display system and method based on the active sub-pixel rendering
CN102238409B (en) * 2011-05-10 2013-07-24 湖南创图视维科技有限公司 Naked eye 3D (three-dimensional) television wall
JP5143262B1 (en) * 2011-08-30 2013-02-13 株式会社東芝 3D image processing apparatus and 3D image processing method
EP2949121A1 (en) * 2013-02-06 2015-12-02 Koninklijke Philips N.V. Method of encoding a video data signal for use with a multi-view stereoscopic display device
CN103747236A (en) * 2013-12-30 2014-04-23 中航华东光电有限公司 3D (three-dimensional) video processing system and method by combining human eye tracking
KR20160021968A (en) * 2014-08-18 2016-02-29 삼성전자주식회사 Method and apparatus for processing image
CN105898139A (en) * 2015-12-23 2016-08-24 乐视致新电子科技(天津)有限公司 Panoramic video production method and device and panoramic video play method and device
DE102017117859A1 (en) * 2017-08-07 2019-02-07 Osram Opto Semiconductors Gmbh Method for operating an autostereoscopic display device and autostereoscopic display device
CN109698952A (en) * 2017-10-23 2019-04-30 腾讯科技(深圳)有限公司 Playback method, device, storage medium and the electronic device of full-view video image

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3441911B2 (en) * 1997-02-20 2003-09-02 キヤノン株式会社 Information processing apparatus and method

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013530413A (en) * 2010-04-20 2013-07-25 エントロピック・コミュニケーションズ・インコーポレイテッドEntropic Communications, Inc. System and method for displaying a user interface on a three-dimensional display
KR101738001B1 (en) * 2011-03-25 2017-05-29 엘지전자 주식회사 Mobile Terminal And Method Of Controlling The Same
US8487983B2 (en) 2011-08-31 2013-07-16 Kabushiki Kaisha Toshiba Viewing area adjusting device, video processing device, and viewing area adjusting method based on number of viewers
JP2013051627A (en) * 2011-08-31 2013-03-14 Toshiba Corp Vision adjustment device, image processor, and vision adjustment method
JP2013077993A (en) * 2011-09-30 2013-04-25 Toshiba Corp Electronic apparatus and control method of electronic apparatus
CN103037230A (en) * 2011-09-30 2013-04-10 株式会社东芝 Three-dimensional image processing apparatus and three-dimensional image processing method
JP2013229828A (en) * 2012-04-26 2013-11-07 Toshiba Corp Image processing device, method, program, and stereoscopic image display device
JP2013055666A (en) * 2012-09-26 2013-03-21 Toshiba Corp Video processing apparatus, video processing method and remote controller
JP2013081177A (en) * 2012-10-18 2013-05-02 Toshiba Corp Electronic apparatus and control method for electronic apparatus

Also Published As

Publication number Publication date
US20070058034A1 (en) 2007-03-15

Similar Documents

Publication Publication Date Title
US6911975B2 (en) Stereo image display apparatus and method, and storage medium
JP4371012B2 (en) Image display device, portable terminal device, display panel, and lens
US20040119896A1 (en) Multiple view display
JP5173830B2 (en) Display apparatus and method
JP2006154809A (en) Barrier device, stereoscopic image display device, and driving method thereof
JP4015090B2 (en) Stereoscopic display device and image display method
JP3885077B2 (en) 3D display
CN1920615B (en) Three-dimensional display device and driving method thereof
JP2007251914A (en) Image signal processing apparatus, and virtual reality creating system
US8063931B2 (en) Stereoscopic display apparatus
US20030179198A1 (en) Stereoscopic image processing apparatus and method, stereoscopic vision parameter setting apparatus and method, and computer program storage medium information processing method and apparatus
JP5055308B2 (en) Method for converting primitive pixel data in a first format for display in a second format
US7327410B2 (en) High resolution 3-D image display with liquid crystal shutter array
JP4949755B2 (en) Driving method of stereoscopic image display device
US7944464B2 (en) Three-dimensional image display device, three-dimensional image display method, and computer program product for three-dimensional image display
TWI424752B (en) Image color balance adjustment for display panels with 2d subpixel layouts
EP2418868A2 (en) Image processor, stereoscopic display, method of detecting parallax displacement in a stereoscopic display
US8941691B2 (en) Multi-layered displays
JP2008219788A (en) Stereoscopic image display device, and method and program therefor
US20110249026A1 (en) Electronic visual displays
JP3966830B2 (en) 3D display device
CN101261368B (en) Optical sheet for three-dimensional image and three-dimensional image display device using the same
TWI545348B (en) Multi-view display device
EP1272997B1 (en) Electronic device having a display
JP2009049751A (en) Stereoscopic image display apparatus

Legal Events

Date Code Title Description
A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20091029

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20091104

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20100309