WO2005020591A1 - 3-dimensional video reproduction device and 3-dimensional video reproduction method - Google Patents

3-dimensional video reproduction device and 3-dimensional video reproduction method Download PDF

Info

Publication number
WO2005020591A1
WO2005020591A1 PCT/JP2004/010203 JP2004010203W WO2005020591A1 WO 2005020591 A1 WO2005020591 A1 WO 2005020591A1 JP 2004010203 W JP2004010203 W JP 2004010203W WO 2005020591 A1 WO2005020591 A1 WO 2005020591A1
Authority
WO
WIPO (PCT)
Prior art keywords
parallax
display
amount
video data
image
Prior art date
Application number
PCT/JP2004/010203
Other languages
French (fr)
Japanese (ja)
Inventor
Ryuji Kitaura
Kazuto Ohhara
Toshio Nomura
Naoki Ishihara
Original Assignee
Sharp Kabushiki Kaisha
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sharp Kabushiki Kaisha filed Critical Sharp Kabushiki Kaisha
Priority to CN200480024145XA priority Critical patent/CN1864415B/en
Priority to US10/567,521 priority patent/US8035683B2/en
Priority to EP04747669A priority patent/EP1662809A4/en
Publication of WO2005020591A1 publication Critical patent/WO2005020591A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/128Adjusting depth or disparity

Definitions

  • the present invention relates to a stereoscopic video reproducing apparatus and a stereoscopic video reproducing method for reproducing a three-dimensional video so that it can be viewed stereoscopically.
  • the one that is generally used is the one that uses binocular parallax and is called the binocular system. That is, stereoscopic vision can be performed by preparing a left-eye image and a right-eye image having binocular parallax and projecting them independently to the left and right eyes.
  • Such three-dimensional images have different stereoscopic effects depending on the magnitude of binocular parallax (hereinafter, referred to as the amount of parallax). Therefore, even if the three-dimensional image is the same, if the display size displayed on the screen is different, the amount of parallax changes and the appearance is different. That is, even when the same display device is used, the amount of parallax increases when the display size of the video is enlarged.
  • different display devices may increase the amount of parallax when displayed on a display device having a large size.
  • FIG. 7 illustrates this, where w is W in the figure.
  • w is W in the figure.
  • FIG. 7 (a) when the stereoscopic image of the right-eye image 701 and the left-eye image 702 is fused at the position 703, as shown in FIG.
  • the amount of parallax which was w in the state shown in FIG. If W becomes too large, stereoscopic vision with both eyes becomes impossible.
  • the image is enlarged by image processing, it is enlarged by the processing on the terminal side, so it is possible to foresee in advance the possibility that stereoscopic viewing may not be possible. There was a problem that could not be grasped.
  • Patent Document 1 information on the size of a display device that can provide a suitable stereoscopic effect even when a 3D image is supplied as it is is received together with the 3D image data, There is disclosed a technique for changing the amount of parallax of a three-dimensional video so that a good stereoscopic effect can be obtained even in a display device of a user terminal.
  • Patent Document 1 JP-A-10-150608 Disclosure of the invention
  • the conventional technique has a problem that only the case where the size is different between different display devices is considered, and the case where the resolution is different is not considered.
  • FIG. 8 is a diagram showing examples of display devices having different sizes and resolutions.
  • the display device shown in FIG. 8 (a) and the display device shown in FIG. 8 (b) have different sizes, but have the same resolution, and the display devices shown in FIG. 8 (b) and FIG. Same, but different resolutions. Note that the dotted lines in the figure represent dot breaks. 8 (a) and 8 (b) show the image displayed on the full screen, and FIG. 8 (c) shows the image displayed at the center.
  • the present invention has been made to solve the above problems, and an object of the present invention is to display a three-dimensional image in a stereoscopic manner according to the size and resolution of a display device. It is an object of the present invention to provide a stereoscopic video reproducing apparatus and a stereoscopic video reproducing method which can be performed.
  • a stereoscopic video reproducing apparatus is a stereoscopic video reproducing apparatus that reproduces a three-dimensional video based on control information for controlling display of the three-dimensional video data. It is determined based on the control information whether or not the amount of parallax on the display screen when is displayed becomes larger than the amount of parallax on the display screen when the 3D video data is displayed on the reference display device. And image processing means for performing image processing for changing the amount of parallax, and performing image processing by the image processing means when the amount of parallax is determined to be large by the determining means.
  • the image processing means is a parallax amount adjusting means for adjusting a parallax amount by moving an image of a predetermined viewpoint forming the three-dimensional image data in a horizontal direction. I do.
  • the image processing means includes a size changing means for changing the size of the video.
  • control information includes information relating to the resolution of the reference display device.
  • control information includes information about a display size when the three-dimensional video data is displayed on the reference display device.
  • a stereoscopic video reproduction device is a stereoscopic video reproduction device that reproduces a three-dimensional video based on control information for controlling display of three-dimensional video data.
  • Determining means for determining whether or not the amount of parallax on the display screen when displaying the three-dimensional video data is a stereoscopically visible value; and size changing means for changing the image size of the three-dimensional video data Wherein the enlargement and reduction ratios are limited when the determination unit determines that the value is not a stereoscopically visible value.
  • control information includes a parallax amount of an important subject and parallax information indicating a parallax amount of the three-dimensional video data.
  • a stereoscopic video reproduction method is a stereoscopic video reproduction method for reproducing a three-dimensional video based on control information for controlling display of the three-dimensional video data. It is determined based on the control information whether or not the amount of parallax on the display screen when is displayed becomes larger than the amount of parallax on the display screen when the 3D video data is displayed on the reference display device. And an image processing step of performing image processing for changing the amount of parallax, and performing image processing by the image processing step when the amount of parallax is determined to be large in the determining step. And
  • the image processing step adjusts the amount of parallax by moving an image of a predetermined viewpoint constituting the 3D image data in a horizontal direction.
  • control information includes information on a resolution of the display device serving as the reference.
  • control information includes a display size when the three-dimensional video data is displayed on the reference display device.
  • a stereoscopic video reproduction method for reproducing a three-dimensional video based on control information for controlling display of the three-dimensional video data, wherein the three-dimensional video data is displayed according to the control information.
  • the image size of the three-dimensional video data is changed by limiting the enlargement and reduction ratios so that the amount of parallax on the display screen attains a value that enables stereoscopic viewing.
  • a stereoscopic video reproducing method is a stereoscopic video reproducing method for reproducing a three-dimensional video based on control information for controlling display of three-dimensional video data. Determining whether the amount of parallax on the display screen when displaying the three-dimensional video data is a stereoscopically visible value, and changing the image size of the three-dimensional video data Wherein the enlargement and reduction ratios are limited when it is determined in the determination step that the value is not a stereoscopically visible value.
  • control information includes a parallax amount of an important subject and parallax information indicating a parallax amount of the three-dimensional video data.
  • the amount of parallax on the display screen when the three-dimensional video data is displayed is reduced by the amount of parallax of the three-dimensional video data.
  • the parallax amount is limited by restricting the enlargement / reduction ratio of the image according to the parallax amount displayed on the screen of the display device or the actual display size of the video. This has the advantage of solving the problem of displaying 3D video data in a state where stereoscopic viewing is not possible due to the size exceeding the limit.
  • FIG. 1 is a block diagram showing a configuration example of a stereoscopic video playback device according to a first embodiment of the present invention.
  • FIG. 2 is a block diagram illustrating a configuration example of an image processing unit of the stereoscopic video playback device according to the first embodiment of the present invention.
  • FIG. 3 is a diagram illustrating a parallax barrier display device.
  • FIG. 4 is a diagram showing a processing flow of the stereoscopic video playback device according to the first embodiment of the present invention.
  • FIG. 5 is a diagram for explaining parallax amount adjustment processing.
  • FIG. 6 is a diagram showing a processing flow of a stereoscopic video playback device according to a second embodiment of the present invention.
  • FIG. 7 is a diagram illustrating a change in the amount of parallax due to enlargement.
  • FIG. 8 is a diagram showing an example of display depending on the display device.
  • FIG. 1 is a block diagram showing a configuration example of a stereoscopic video playback device according to the first embodiment of the present invention.
  • a stereoscopic video reproducing apparatus 10 includes a separating unit 11, a decoding unit 12, a control unit 13 (determining unit), an image processing unit 14, and a display unit 15.
  • the separating unit 11 is connected to a unit that reads data from a recording medium and a unit that receives data via a communication path.
  • the separating unit 11 separates multiplexed data obtained by multiplexing a plurality of types of data such as video data, audio data, control information, and the like according to a predetermined method into data of respective components.
  • a multiplexing method a transport stream defined by the MPEG-2 system standard is known. Note that the video data and the control information may be separately input without using the separation unit 11.
  • the control information includes information indicating that the video data is a three-dimensional video, and reference information.
  • the reference information is information serving as a reference for determining a change in the amount of parallax.
  • a 3D image is displayed as it is, information on a resolution of a reference display capable of obtaining a suitable stereoscopic effect ( Display size and resolution, which are referred to below as the reference display size and reference resolution).
  • the decoding means 12 decodes video data encoded by a predetermined method. Generally, when transmitting or recording video data, it is encoded to compress the data amount.
  • MPEG-2 video, MPEG-4 video, Mo JPEG is known as an encoding method for still images.
  • the control means 13 controls each means so that video data is appropriately reproduced based on control information and the like.
  • the display size and resolution of the display means 15 are input to the control means 13.
  • the change of the size of the three-dimensional video data, the adjustment of the amount of parallax, and the like in the case where the display means 15 having a different display size or resolution is changed will be described later in detail.
  • the display size and resolution are set by a predetermined force when the display means 15 is fixed to the stereoscopic video playback device, and set by a user when connected to an external display device. There is.
  • the image processing means 14 performs image processing in units of frames constituting video data.
  • FIG. 2 shows a configuration example of the image processing means 14.
  • the image processing means 14 includes a size changing means 141 for performing enlargement processing or reduction processing of the video data, a parallax amount adjusting means 142 for adjusting the parallax amount of the three-dimensional video, and a video display means. It comprises display video generation means 143 for converting into 15 display formats.
  • the display means 15 is a display device capable of displaying a three-dimensional image, and display devices such as a field sequential system and a parallax barrier system are known.
  • display devices such as a field sequential system and a parallax barrier system are known.
  • the power to describe a case where a display device of a parallax barrier method is used The present invention is not limited to this, and can be applied to display devices of other methods.
  • FIG. 3A is a diagram illustrating the principle of generating parallax by the parallax barrier method.
  • the parallax barrier 302 is placed on the front of the video display panel 301.
  • Fig. 3 (b) is a diagram showing a display format of a screen displayed by the parallax barrier method, in which left-eye images and right-eye images are arranged alternately every other pixel in the horizontal direction. .
  • an image as shown in Fig. 3 (b) is displayed on the image display panel 301, and is passed through a parallax barrier 302 having slits at intervals smaller than the interval between pixels at the same viewpoint.
  • the left-eye image can be observed only with the left eye 303 and the right-eye image can be observed only with the right eye 304, so that stereoscopic vision can be performed.
  • FIG. 4 is a diagram showing a flow of processing from the time when the multiplexed data is supplied to the stereoscopic video reproduction device 10 until the video is displayed.
  • Demultiplexing means 11 receives multiplexed data in which video data, audio data, and control information are multiplexed. Separating means 11 separates the input multiplexed data (step ST dish).
  • the decoding unit 12 interprets the format of the data defined by the encoding method, and decodes the image data.
  • the data is decrypted (step ST102).
  • encoded video data is encoded with information on the size of the video data (image size information indicating the number of pixels in one video frame).
  • Image size information of the decoded video data is output to the control means 13. Note that the image size information of the video data may not necessarily be obtained from the decoding unit 12 but may be separately input to the control unit 13 by another unit. If the video data has not been encoded, step ST102 is omitted.
  • the control means 13 interprets the control information input from the separation means 11, and calculates a reference dot pitch DPI from the reference display size and the reference resolution. Further, a dot pitch DP2 of the display means 15 is calculated from the display size and resolution of the display means 15 (step ST103).
  • the pitch between dots is, for example, that the size of the display means 15 is 12.1 inches and the resolution is 1024
  • the process branches depending on the presence or absence of the size change process (step ST104).
  • the process proceeds to step ST105. If not, the process proceeds to Step ST107.
  • the size change processing is an enlargement processing or a reduction processing of an image.
  • the display device shown in FIG. 8A is a reference display and the display device shown in FIG.
  • the display hand The display size of step 15 is larger than the reference display size, and the resolution is also higher than the reference resolution.
  • the image displayed on the entire screen on the reference display is displayed on the display unit 15 at a predetermined portion of the screen. Is displayed. In such a case, enlargement processing is performed to display the video data on the entire screen.
  • the resolution of the display means 15 is lower than the resolution of the reference display
  • the video data capacity display section 15 which was able to display the entire screen on the reference display cannot fit on the display screen, .
  • a reduction process is performed to display the video data on the entire screen.
  • the presence or absence of the size change process is set by a preset force ⁇ user as an internal flag.
  • the presence or absence of the size change processing is input to the image processing means 14 as a control signal A.
  • step ST105 the following processing is performed.
  • the control means 13 calculates an enlargement / reduction ratio from the image size information of the video data and the resolution of the display means 15.
  • the value obtained by calculating the ratio of the resolution of the video data before and after performing the size change processing is defined as the enlargement / reduction ratio.
  • the enlargement / reduction ratio is input to the image processing means 14, and the size changing processing is performed by the size changing means 141 of the image processing means 14.
  • step ST106 the control means 13 corrects the inter-dot pitch DP2 by multiplying the inter-dot pitch DP2 of the display means 15 by the enlargement / reduction ratio. This is because the result of enlarging and displaying an image is considered to be equivalent to the case where the pitch between dots is increased.
  • the control unit 13 compares the standard dot pitch DPI and the dot pitch DP2 of the display unit 15 with each other, and displays it on the display unit 15 rather than the parallax amount when the three-dimensional image is displayed on the reference display. It is determined whether or not the parallax amount at the time becomes large (step ST107). If DP2 is equal to or less than DP1, the parallax amount remains unchanged or becomes small, so that no correction is required, and the process proceeds to step ST109. If DP2 is larger than DPI, the amount of parallax increases, so it is determined that the amount of parallax needs to be adjusted, and the process proceeds to step ST108.
  • step ST108 The presence or absence of the parallax adjustment processing is input to the image processing means 14 as the control signal B, and the parallax adjustment processing is performed by the parallax adjustment means 142 (step ST108).
  • step ST109 the control means 13 outputs the type (two-dimensional / three-dimensional) of the video data to the image processing means 14 and the display means 15 as a control signal C.
  • FIG. Fig. 5 shows the composition of a 3D image displayed on the display viewed from above.
  • the pixel R1 of the right-eye image is displayed at the display position 501
  • the corresponding pixel L1 of the left-eye image is displayed at the display position 502. Since these pixels form an image at position 503, they are observed with a depth greater than the display surface.
  • FIG. 5B shows a state in which the display position of the pixel R1 of the right-eye image is moved to the left and changed from the position 501 to the position 504.
  • the image forming the image at the position 503 becomes visible at the position 505. Since the position 505 is located closer to the display than the position 503, the user can see the position closer to the display surface.
  • the pixel R1 is moved to the right of 501 on the contrary, an image is formed at the position 503, and the image becomes visible behind the display surface.
  • the amount of parallax is a horizontal relative distance between corresponding portions of the left-eye image and the right-eye image.
  • the relative distance of the display position of the pixel L1 of a certain left-eye image corresponds to that.
  • the display position of R1 and the display position of pixel L1 of the left eye image may be moved in a direction in which the relative distance between them is reduced.
  • the parallax adjustment value designates the amount of movement from the position 501 to the position 504, and uses a predetermined value according to the ratio between the dot pitches DP1 and DP2. Further, the left and right images may be moved in opposite directions by half of the parallax amount adjustment value.
  • the amount of parallax becomes larger than the limit, and the 3D image data is displayed in a state where stereoscopic viewing cannot be performed. Doing so can solve the problem.
  • a predetermined value is used as the parallax amount adjustment value.
  • the maximum parallax amount of the three-dimensional video or the most important The power including the parallax information such as the parallax amount of the subject in the control information may be received, and the parallax information may be changed according to the ratio of the dot pitches DP1 and DP2.
  • the case where the display size and the resolution are included in the control information as the information on the resolution of the reference display used as the reference information has been described.
  • the control information includes the following dot pitch or the number of dots per unit area.
  • the display size on the reference display may be included in the control information instead of the information on the resolution.
  • the pitch may be changed to the pitch between dots by dividing by the image size information of the video data.
  • the size change process may be performed by using a value obtained by dividing the force dot pitch DP2, which is performing the parallax adjustment process in step ST108, by the DPI as a reduction ratio. Since the amount of parallax is reduced by reducing the video data, the same effect as the above-described parallax amount adjustment processing can be obtained.
  • the enlargement / reduction ratio is obtained by calculation, but the enlargement / reduction ratio may be specified by the user.
  • the amount of parallax is corrected according to the specified enlargement / reduction ratio.
  • a means for notifying the user of the presence / absence of the size change processing and the presence / absence of the parallax amount adjustment processing in the control unit 13 is separately provided, so that the video data is enlarged or reduced by the user.
  • a message indicating that the amount is being adjusted may be displayed, and the reference display size and the reference resolution may be displayed together. By doing so, the user can determine whether or not the size For example, when multiple resolutions can be selected as in a personal computer that is widely used, video data can be displayed with a desired amount of parallax by switching resolutions. Therefore, convenience can be improved.
  • the stereoscopic video playback device receives the parallax information such as the maximum parallax amount of the three-dimensional video and the parallax amount of the most important subject in the control information, and receives the parallax information of the three-dimensional video displayed on the display unit 15. Adjust the volume.
  • the parallax information may be an absolute amount such as a dot unit or a millimeter unit.
  • FIG. 6 is a diagram showing a flow of processing at this time.
  • the processing of step ST201 and step ST202 are the same as those of step ST101 and step ST102 in the above-described embodiment, respectively, and thus description thereof will be omitted.
  • the control unit 13 calculates an enlargement / reduction ratio from the sizes of the video data before and after performing the size change processing (step ST203), and calculates the actual amount of disparity by multiplying the disparity information (step ST203). Step ST204). At this time, if the input parallax information is in units of dots, the inter-dot pitch DP on the display means 15 is calculated, and the parallax information is multiplied by the inter-dot pitch DP.
  • the parallax amount in step ST204 is compared with a predetermined limit value, and if the parallax amount exceeds the limit value, the process proceeds to step ST206; otherwise, the process proceeds to step ST207.
  • the limit value is determined so that the three-dimensional image falls within a range that can be fused as a stereoscopic image. It is known that if the amount of parallax is greater than the distance between human eyes, stereoscopic vision becomes difficult. For example, the limit value may be about 6.5 cm, which is the approximate distance between both eyes.
  • step ST206 the enlargement / reduction ratio is limited so that the actual amount of parallax does not exceed the limit value.
  • the calculated enlarged Z reduction ratio is output to the image processing means 14.
  • the image processing means 14 performs a size change process using the limited enlargement Z reduction ratio (step ST207), and converts the image into a display format that can be displayed on the display means 15 (step ST207). Step ST208).
  • a size change process using the limited enlargement Z reduction ratio step ST207
  • converts the image into a display format that can be displayed on the display means 15 step ST207.
  • Step ST208 step ST208.
  • video data whose size (in millimeters) when video data is actually displayed on the screen may be reproduced in the control information. Also in this case, by observing the specified display size, the parallax amount does not increase beyond the limit, and the problem of displaying 3D video data in a state where stereoscopic viewing is impossible is solved. Can be.
  • a means for notifying the user that the enlargement / reduction ratio is restricted is provided separately, and the user is informed that the enlargement / reduction ratio is restricted, and the enlargement / reduction ratio is displayed together.
  • the user can display video data at a desired enlargement / z reduction ratio with reference to this display, so that the convenience can be improved.
  • the stereoscopic video playback device of the present invention is not limited to the above-described embodiments, but may be implemented in various forms within the scope of the present invention. Of course, changes can be made.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

When displaying a 3-dimensional video in various display devices, it is possible to display the video in such a manner that it can be viewed 3-dimensionally even when the size of the display device is large or the display device has a lowered resolution. A 3-dimensional video reproduction device includes: judgment means for judging whether a parallax mount on a display screen when the 3-dimensional video data is displayed is greater than a parallax amount in a display device appropriate for display of the 3-dimensional video data according to reference information contained in control information; and image processing means for performing image processing for modifying the parallax amount. The parallax amount of the 3-dimensional video is adjusted according to the ratio between the inter-dot pitch of the display device serving as a reference when displaying the 3-dimensional video and the inter-dot pitch of the local device.

Description

明 細 書  Specification
立体映像再生装置および立体映像再生方法  Stereoscopic video reproducing apparatus and stereoscopic video reproducing method
技術分野  Technical field
[0001] 本発明は、 3次元映像を立体視できるように再生する立体映像再生装置および立 体映像再生方法に関するものである。  The present invention relates to a stereoscopic video reproducing apparatus and a stereoscopic video reproducing method for reproducing a three-dimensional video so that it can be viewed stereoscopically.
背景技術  Background art
[0002] 従来、 3次元映像を表示する様々な方法が提案されてきた。その中でも一般的に 用いられているのは両眼視差を利用する、 2眼式と呼ばれるものである。すなわち、 両眼視差を持った左眼用映像と右眼用映像を用意し、それぞれ独立に左右の眼に 投影することにより立体視を行うことができる。このような 3次元映像は、両眼視差の大 きさ(以下、視差量と呼ぶ)により得られる立体感が異なる。したがって、同じ 3次元映 像であっても、画面に表示される表示サイズが異なると、視差量が変化して見え方が 異なってくる。つまり、同一の表示装置を用いる場合でも、映像の表示サイズを拡大 した場合に視差量が大きくなる。また、異なる表示装置では、サイズの大きい表示装 置で表示すると視差量が大きくなる場合がある。  Conventionally, various methods for displaying a three-dimensional image have been proposed. Among them, the one that is generally used is the one that uses binocular parallax and is called the binocular system. That is, stereoscopic vision can be performed by preparing a left-eye image and a right-eye image having binocular parallax and projecting them independently to the left and right eyes. Such three-dimensional images have different stereoscopic effects depending on the magnitude of binocular parallax (hereinafter, referred to as the amount of parallax). Therefore, even if the three-dimensional image is the same, if the display size displayed on the screen is different, the amount of parallax changes and the appearance is different. That is, even when the same display device is used, the amount of parallax increases when the display size of the video is enlarged. In addition, different display devices may increase the amount of parallax when displayed on a display device having a large size.
[0003] 図 7はこれを示したものであり、図において wく Wである。図 7 (a)に示すように、右 眼用映像 701と左眼用映像 702の立体像が位置 703に融合している場合に、図 7 (b )に示すように、映像の表示サイズが大きくなると、図 7 (a)に示す状態では wであった 視差量が Wへと大きくなる。 Wが大きくなりすぎると両眼による立体視ができなくなる。 画像処理により拡大する場合には、端末側の処理により拡大されるため、予め立体 視できなくなる可能性について予見することができるが、表示装置の違いにより拡大 される場合には、端末側では正確に把握できないという問題があった。  [0003] Fig. 7 illustrates this, where w is W in the figure. As shown in FIG. 7 (a), when the stereoscopic image of the right-eye image 701 and the left-eye image 702 is fused at the position 703, as shown in FIG. As the size increases, the amount of parallax, which was w in the state shown in FIG. If W becomes too large, stereoscopic vision with both eyes becomes impossible. If the image is enlarged by image processing, it is enlarged by the processing on the terminal side, so it is possible to foresee in advance the possibility that stereoscopic viewing may not be possible. There was a problem that could not be grasped.
[0004] このような問題を解決するために、特許文献 1では、 3次元映像をそのまま供給して も好適な立体感の得られる表示装置のサイズに関する情報を、 3次元映像データと 共に受け取り、ユーザ端末の表示装置においても良好な立体感が得られるように、 3 次元映像の視差量を変更する技術が開示されている。  [0004] In order to solve such a problem, in Patent Document 1, information on the size of a display device that can provide a suitable stereoscopic effect even when a 3D image is supplied as it is is received together with the 3D image data, There is disclosed a technique for changing the amount of parallax of a three-dimensional video so that a good stereoscopic effect can be obtained even in a display device of a user terminal.
特許文献 1 :特開平 10 - 150608号公報 発明の開示 Patent Document 1: JP-A-10-150608 Disclosure of the invention
発明が解決しょうとする課題  Problems to be solved by the invention
[0005] し力しながら、前記従来の技術では、異なる表示装置の間でサイズのみが異なる場 合しか考慮しておらず、解像度が異なる場合が考慮されていないという問題がある。  [0005] However, the conventional technique has a problem that only the case where the size is different between different display devices is considered, and the case where the resolution is different is not considered.
[0006] 図 8はサイズおよび解像度の異なる表示装置の例を示す図である。図 8 (a)に示す 表示装置と図 8 (b)に示す表示装置はサイズが異なるが、解像度が同じであり、図 8 ( b)と図 8 (c)に示す表示装置は、サイズは同じだが、解像度が異なる。なお、図中の 点線はドットの区切りを表している。また、図 8 (a)と図 8 (b)では映像が全画面に表示 されており、図 8 (c)では、中央部分に表示されている状態を表している。  FIG. 8 is a diagram showing examples of display devices having different sizes and resolutions. The display device shown in FIG. 8 (a) and the display device shown in FIG. 8 (b) have different sizes, but have the same resolution, and the display devices shown in FIG. 8 (b) and FIG. Same, but different resolutions. Note that the dotted lines in the figure represent dot breaks. 8 (a) and 8 (b) show the image displayed on the full screen, and FIG. 8 (c) shows the image displayed at the center.
[0007] 図 8 (a)に示す表示装置と図 8 (b)に示す表示装置を比較すると、表示装置のサイ ズが大きくなり、解像度が変化しない場合には、表示装置のドットの間隔が広くなるた め、表示される映像は空間的に引き伸ばされる。しかし、図 8 (a)に示す表示装置と 図 8 (c)に示す表示装置のように、サイズに応じて解像度が高くなるような場合には、 必ずしも映像の表示サイズが大きくなるとは限らない。  [0007] Comparing the display device shown in FIG. 8 (a) with the display device shown in FIG. 8 (b), the size of the display device becomes large, and when the resolution does not change, the dot interval of the display device becomes large. To be wider, the displayed image is spatially stretched. However, when the resolution increases according to the size as in the display device shown in FIG. 8A and the display device shown in FIG. 8C, the display size of the video does not always increase. .
[0008] また、表示装置のサイズが変化しない場合であっても、解像度が低くなつた場合に は、映像が拡大されて表示されるため、視差量が大きくなる。以上のように、表示装 置のサイズのみを考慮するだけでは不十分である。  [0008] Even when the size of the display device does not change, if the resolution is reduced, the video is enlarged and displayed, so that the amount of parallax increases. As described above, it is not enough to consider only the size of the display device.
[0009] 本発明は、以上のような問題点を解決するためになされたものであって、その目的 は、表示装置のサイズと解像度に応じて、 3次元映像を立体視可能に表示することの できる立体映像再生装置および立体映像再生方法を提供することにある。  [0009] The present invention has been made to solve the above problems, and an object of the present invention is to display a three-dimensional image in a stereoscopic manner according to the size and resolution of a display device. It is an object of the present invention to provide a stereoscopic video reproducing apparatus and a stereoscopic video reproducing method which can be performed.
課題を解決するための手段  Means for solving the problem
[0010] 本発明に係る立体映像再生装置は、 3次元映像データの表示を制御するための制 御情報に基づいて、 3次元映像を再生する立体映像再生装置であって、前記 3次元 映像データを表示した際の表示画面における視差量が、前記 3次元映像データを基 準となる表示装置に表示した際の表示画面における視差量よりも大きくなるか否かを 、前記制御情報に基づいて判定する判定手段と、視差量を変更するための画像処 理を施す画像処理手段とを備え、前記判定手段により視差量が大きくなると判定され た場合に、前記画像処理手段による画像処理を行うことを特徴とする。 [0011] より好ましくは、前記画像処理手段は、前記 3次元映像データを構成する所定の視 点の映像を水平方向に移動して視差量を調整する視差量調整手段であることを特 徴とする。 [0010] A stereoscopic video reproducing apparatus according to the present invention is a stereoscopic video reproducing apparatus that reproduces a three-dimensional video based on control information for controlling display of the three-dimensional video data. It is determined based on the control information whether or not the amount of parallax on the display screen when is displayed becomes larger than the amount of parallax on the display screen when the 3D video data is displayed on the reference display device. And image processing means for performing image processing for changing the amount of parallax, and performing image processing by the image processing means when the amount of parallax is determined to be large by the determining means. Features. [0011] More preferably, the image processing means is a parallax amount adjusting means for adjusting a parallax amount by moving an image of a predetermined viewpoint forming the three-dimensional image data in a horizontal direction. I do.
[0012] より好ましくは、前記画像処理手段は、映像のサイズを変更するサイズ変更手段を 備えることを特徴とする。  [0012] More preferably, the image processing means includes a size changing means for changing the size of the video.
[0013] より好ましくは、前記制御情報は、前記基準となる表示装置の分解能に関する情報 を含むことを特徴とする。  [0013] More preferably, the control information includes information relating to the resolution of the reference display device.
[0014] より好ましくは、前記制御情報は、前記基準となる表示装置において、前記 3次元 映像データを表示した際の表示サイズに関する情報を含むことを特徴とする。  [0014] More preferably, the control information includes information about a display size when the three-dimensional video data is displayed on the reference display device.
[0015] 本発明に係る立体映像再生装置は、 3次元映像データの表示を制御するための制 御情報に基づいて、 3次元映像を再生する立体映像再生装置であって、前記制御 情報に応じて、前記 3次元映像データを表示した際の表示画面における視差量が、 立体視可能な値であるか否かを判定する判定手段と、前記 3次元映像データの画像 サイズを変更するサイズ変更手段とを備え、前記判定手段により立体視可能な値で ないと判定された場合に、前記拡大及び縮小率を制限することを特徴とする。  [0015] A stereoscopic video reproduction device according to the present invention is a stereoscopic video reproduction device that reproduces a three-dimensional video based on control information for controlling display of three-dimensional video data. Determining means for determining whether or not the amount of parallax on the display screen when displaying the three-dimensional video data is a stereoscopically visible value; and size changing means for changing the image size of the three-dimensional video data Wherein the enlargement and reduction ratios are limited when the determination unit determines that the value is not a stereoscopically visible value.
[0016] より好ましくは、前記制御情報は、重要な被写体の視差量を含み前記 3次元映像デ ータの視差量を表す視差情報を含むことを特徴とする。  [0016] More preferably, the control information includes a parallax amount of an important subject and parallax information indicating a parallax amount of the three-dimensional video data.
[0017] 本発明に係る立体映像再生方法は、 3次元映像データの表示を制御するための制 御情報に基づいて、 3次元映像を再生する立体映像再生方法であって、前記 3次元 映像データを表示した際の表示画面における視差量が、前記 3次元映像データを基 準となる表示装置に表示した際の表示画面における視差量よりも大きくなるか否かを 、前記制御情報に基づいて判定する判定ステップと、視差量を変更するための画像 処理を施す画像処理ステップとを備え、前記判定ステップにより視差量が大きくなると 判定された場合に、前記画像処理ステップによる画像処理を行うことを特徴とする。  [0017] A stereoscopic video reproduction method according to the present invention is a stereoscopic video reproduction method for reproducing a three-dimensional video based on control information for controlling display of the three-dimensional video data. It is determined based on the control information whether or not the amount of parallax on the display screen when is displayed becomes larger than the amount of parallax on the display screen when the 3D video data is displayed on the reference display device. And an image processing step of performing image processing for changing the amount of parallax, and performing image processing by the image processing step when the amount of parallax is determined to be large in the determining step. And
[0018] より好ましくは、前記画像処理ステップは、前記 3次元映像データを構成する所定 の視点の映像を水平方向に移動して視差量を調整することを特徴とする。  [0018] More preferably, the image processing step adjusts the amount of parallax by moving an image of a predetermined viewpoint constituting the 3D image data in a horizontal direction.
[0019] より好ましくは、前記画像処理ステップは、前記 3次元映像データの画像サイズを変 更することを特徴とする。 [0020] より好ましくは、前記制御情報は、前記基準となる表示装置の分解能に関する情報 を含むことを特徴とする。 [0019] More preferably, in the image processing step, an image size of the three-dimensional video data is changed. [0020] More preferably, the control information includes information on a resolution of the display device serving as the reference.
[0021] より好ましくは、前記制御情報は、前記基準となる表示装置において、前記 3次元 映像データを表示した際の表示サイズを含むことを特徴とする。  More preferably, the control information includes a display size when the three-dimensional video data is displayed on the reference display device.
[0022] 3次元映像データの表示を制御するための制御情報に基づいて、 3次元映像を再 生する立体映像再生方法であって、前記制御情報に応じて、前記 3次元映像データ を表示した際の表示画面における視差量が、立体視可能な値となるように拡大及び 縮小率を制限して前記 3次元映像データの画像サイズを変更することを特徴とする。  [0022] A stereoscopic video reproduction method for reproducing a three-dimensional video based on control information for controlling display of the three-dimensional video data, wherein the three-dimensional video data is displayed according to the control information. In this case, the image size of the three-dimensional video data is changed by limiting the enlargement and reduction ratios so that the amount of parallax on the display screen attains a value that enables stereoscopic viewing.
[0023] 本発明に係る立体映像再生方法は、 3次元映像データの表示を制御するための制 御情報に基づいて、 3次元映像を再生する立体映像再生方法であって、前記制御 情報に応じて、前記 3次元映像データを表示した際の表示画面における視差量が、 立体視可能な値であるか否かを判定する判定ステップと、前記 3次元映像データの 画像サイズを変更するサイズ変更ステップとを備え、前記判定ステップにより立体視 可能な値でないと判定された場合に、前記拡大及び縮小率を制限することを特徴と する。  [0023] A stereoscopic video reproducing method according to the present invention is a stereoscopic video reproducing method for reproducing a three-dimensional video based on control information for controlling display of three-dimensional video data. Determining whether the amount of parallax on the display screen when displaying the three-dimensional video data is a stereoscopically visible value, and changing the image size of the three-dimensional video data Wherein the enlargement and reduction ratios are limited when it is determined in the determination step that the value is not a stereoscopically visible value.
[0024] より好ましくは、前記制御情報は、重要な被写体の視差量を含み前記 3次元映像デ ータの視差量を表す視差情報を含むことを特徴とする。  [0024] More preferably, the control information includes a parallax amount of an important subject and parallax information indicating a parallax amount of the three-dimensional video data.
発明の効果  The invention's effect
[0025] 本発明によれば、 1つの 3次元映像データを異なる表示装置において表示させる場 合に、前記 3次元映像データを表示した際の表示画面における視差量が、前記 3次 元映像データの表示に最適な表示装置における視差量よりも大きくなる場合に、前 記 3次元映像の視差量を調整することにより、 3次元映像を立体視できない状態で表 示してしまうといった問題を解決すことができるという有利な効果が得られる。  According to the present invention, when one piece of three-dimensional video data is displayed on different display devices, the amount of parallax on the display screen when the three-dimensional video data is displayed is reduced by the amount of parallax of the three-dimensional video data. By adjusting the amount of parallax of the three-dimensional video when the amount of parallax is larger than that of a display device that is optimal for display, it is possible to solve the problem that the three-dimensional video is displayed in a state where stereoscopic viewing is not possible. The advantageous effect that it can be obtained is obtained.
[0026] また、本発明によれば、表示装置の画面上に表示される視差量や映像の実際の表 示サイズに応じて画像の拡大/縮小率を制限することで、視差量が限度を越えて大 きくなり、立体視ができない状態で 3次元映像データを表示してしまうという問題を解 決することができるという有利な効果が得られる。  Further, according to the present invention, the parallax amount is limited by restricting the enlargement / reduction ratio of the image according to the parallax amount displayed on the screen of the display device or the actual display size of the video. This has the advantage of solving the problem of displaying 3D video data in a state where stereoscopic viewing is not possible due to the size exceeding the limit.
図面の簡単な説明 [0027] [図 1]本発明の第 1の実施形態による立体映像再生装置の構成例を示すブロック図 である。 Brief Description of Drawings FIG. 1 is a block diagram showing a configuration example of a stereoscopic video playback device according to a first embodiment of the present invention.
[図 2]本発明の第 1の実施形態による立体映像再生装置の画像処理手段の構成例 を示すブロック図である。  FIG. 2 is a block diagram illustrating a configuration example of an image processing unit of the stereoscopic video playback device according to the first embodiment of the present invention.
[図 3]視差バリア方式の表示装置を説明するための図である。  FIG. 3 is a diagram illustrating a parallax barrier display device.
[図 4]本発明の第 1の実施形態による立体映像再生装置の処理の流れを示す図であ る。  FIG. 4 is a diagram showing a processing flow of the stereoscopic video playback device according to the first embodiment of the present invention.
[図 5]視差量調整処理を説明するための図である。  FIG. 5 is a diagram for explaining parallax amount adjustment processing.
[図 6]本発明の第 2の実施形態による立体映像再生装置の処理の流れを示す図であ る。  FIG. 6 is a diagram showing a processing flow of a stereoscopic video playback device according to a second embodiment of the present invention.
[図 7]拡大による視差量の変化を説明する図である。  FIG. 7 is a diagram illustrating a change in the amount of parallax due to enlargement.
[図 8]表示装置の違いによる表示の例を示す図である。  FIG. 8 is a diagram showing an example of display depending on the display device.
符号の説明  Explanation of symbols
[0028] 10 立体映像再生装置  [0028] 10 Stereoscopic video playback device
11 分離手段  11 Separation means
12 復号手段  12 Decryption means
13 制御手段 (判定手段)  13 Control means (judgment means)
14 画像処理手段  14 Image processing means
15 表示手段  15 Display means
141 サイズ変更手段  141 Sizing means
142 个見; ^里^整 1¾  142 pieces; ^ Sato ^ Single 1¾
143 表示映像生成手段  143 Display video generation means
301 映像表示パネル  301 Video display panel
302 視差バリア  302 Parallax Barrier
303 左眼  303 Left Eye
304 右眼  304 right eye
501 表示位置  501 display position
502 表示位置 503 位置 502 display position 503 position
504 表示位置  504 display position
505 位置  505 position
701 右眼用映像  701 Right Eye Video
702 左眼用映像  702 Left eye video
703 位置  703 position
発明を実施するための最良の形態  BEST MODE FOR CARRYING OUT THE INVENTION
[0029] 以下、本発明を実施するための最良の形態について、図面を参照しながら説明す る。  Hereinafter, the best mode for carrying out the present invention will be described with reference to the drawings.
<第 1の実施の形態 >  <First embodiment>
[0030] 図 1は本発明の第 1の実施形態による立体映像再生装置の構成例を示すブロック 図である。図 1において、立体映像再生装置 10は、分離手段 11、復号手段 12、制 御手段 13 (判定手段)、画像処理手段 14、表示手段 15から構成される。図示しない 、分離手段 11は、記録媒体からデータを読み出す手段や、通信路を介してデータ を受信する手段に接続される。  FIG. 1 is a block diagram showing a configuration example of a stereoscopic video playback device according to the first embodiment of the present invention. In FIG. 1, a stereoscopic video reproducing apparatus 10 includes a separating unit 11, a decoding unit 12, a control unit 13 (determining unit), an image processing unit 14, and a display unit 15. Although not shown, the separating unit 11 is connected to a unit that reads data from a recording medium and a unit that receives data via a communication path.
[0031] 分離手段 11は、映像データや音声データ、制御情報などの複数種類のデータを 所定の方式により多重化した多重化データをそれぞれの構成要素のデータに分離 する。多重化の方式としては、 MPEG—2システム規格で定められたトランスポートスト リームなどが知られている。なお、分離手段 11を用いずに、映像データと制御情報を 別々に入力するようにしてもよい。  [0031] The separating unit 11 separates multiplexed data obtained by multiplexing a plurality of types of data such as video data, audio data, control information, and the like according to a predetermined method into data of respective components. As a multiplexing method, a transport stream defined by the MPEG-2 system standard is known. Note that the video data and the control information may be separately input without using the separation unit 11.
[0032] 制御情報には、映像データが 3次元映像であることを示す情報や、基準情報が含 まれている。基準情報とは、視差量の変化を判定するための基準となる情報であり、 ここでは、 3次元映像をそのまま表示した際に、好適な立体感の得ることのできる基準 ディスプレイの分解能に関する情報 (ディスプレイサイズと解像度。以下、それぞれを 基準ディスプレイサイズ、基準解像度と呼ぶ)である。  [0032] The control information includes information indicating that the video data is a three-dimensional video, and reference information. The reference information is information serving as a reference for determining a change in the amount of parallax.Here, when a 3D image is displayed as it is, information on a resolution of a reference display capable of obtaining a suitable stereoscopic effect ( Display size and resolution, which are referred to below as the reference display size and reference resolution).
[0033] 復号手段 12は、所定の方式により符号化されている映像データを復号する。一般 に映像データを伝送あるいは記録する際には、データ量を圧縮するために符号化さ れている。動画像の符号化方式としては、 MPEG— 2ビデオ、 MPEG— 4ビデオ、 Mo tion— JPEGなどが、静止画像の符号化方式としては JPEGなどが知られている。 [0033] The decoding means 12 decodes video data encoded by a predetermined method. Generally, when transmitting or recording video data, it is encoded to compress the data amount. MPEG-2 video, MPEG-4 video, Mo JPEG is known as an encoding method for still images.
[0034] 制御手段 13は、制御情報等により映像データが適切に再生されるように各手段を 制御する。制御手段 13には、表示手段 15のディスプレイサイズと解像度が入力され ている。ディスプレイサイズや解像度が異なる表示手段 15に変更された場合におけ る 3次元映像データのサイズの変更や視差量の調整等については、詳細に後述する 。このディスプレイサイズと解像度は、表示手段 15が該立体映像再生装置に固定さ れている場合は予め定められている力 外部の表示装置に接続される場合には、ュ 一ザにより設定されることあある。 [0034] The control means 13 controls each means so that video data is appropriately reproduced based on control information and the like. The display size and resolution of the display means 15 are input to the control means 13. The change of the size of the three-dimensional video data, the adjustment of the amount of parallax, and the like in the case where the display means 15 having a different display size or resolution is changed will be described later in detail. The display size and resolution are set by a predetermined force when the display means 15 is fixed to the stereoscopic video playback device, and set by a user when connected to an external display device. There is.
[0035] 画像処理手段 14は、映像データを構成するフレーム単位で画像処理を施す。図 2 に画像処理手段 14の構成例を示す。図 2に示すように、画像処理手段 14は映像デ ータの拡大処理または縮小処理を行うサイズ変更手段 141と、 3次元映像の視差量 を調整する視差量調整手段 142と、映像を表示手段 15の表示形式に変換するため の表示映像生成手段 143から構成される。 [0035] The image processing means 14 performs image processing in units of frames constituting video data. FIG. 2 shows a configuration example of the image processing means 14. As shown in FIG. 2, the image processing means 14 includes a size changing means 141 for performing enlargement processing or reduction processing of the video data, a parallax amount adjusting means 142 for adjusting the parallax amount of the three-dimensional video, and a video display means. It comprises display video generation means 143 for converting into 15 display formats.
[0036] 表示手段 15は 3次元映像を表示することのできる表示装置であり、フィールドシー ケンシャル方式や視差バリア方式などの表示装置が知られている。本実施形態にお いては、視差バリア方式の表示装置を用いる場合について述べる力 本発明はこれ に限定されるものではなぐその他の方式の表示装置についても適用することができ る。 [0036] The display means 15 is a display device capable of displaying a three-dimensional image, and display devices such as a field sequential system and a parallax barrier system are known. In the present embodiment, the power to describe a case where a display device of a parallax barrier method is used The present invention is not limited to this, and can be applied to display devices of other methods.
[0037] 視差バリア方式について、図 3を用いて説明する。図 3 (a)は、視差バリア方式によ つて視差が生じる原理を示す図であり、映像表示パネル 301の前面に視差バリア 30 2が置かれている。図 3 (b)は、視差バリア方式で表示される画面の表示形式を示す 図であり、左眼用映像と右眼用映像が水平方向 1画素おきに交互に並んだ形に配置 されている。  The parallax barrier method will be described with reference to FIG. FIG. 3A is a diagram illustrating the principle of generating parallax by the parallax barrier method. The parallax barrier 302 is placed on the front of the video display panel 301. Fig. 3 (b) is a diagram showing a display format of a screen displayed by the parallax barrier method, in which left-eye images and right-eye images are arranged alternately every other pixel in the horizontal direction. .
[0038] 視差バリア方式では、図 3 (b)に示すような映像を、映像表示パネル 301に表示し、 同一視点の画素の間隔よりも狭い間隔でスリットを持つ視差バリア 302を介すること により、左眼用映像は左眼 303だけで、右眼用映像は右眼 304だけで観察すること になり、立体視を行うことができる。  [0038] In the parallax barrier method, an image as shown in Fig. 3 (b) is displayed on the image display panel 301, and is passed through a parallax barrier 302 having slits at intervals smaller than the interval between pixels at the same viewpoint. The left-eye image can be observed only with the left eye 303 and the right-eye image can be observed only with the right eye 304, so that stereoscopic vision can be performed.
[0039] なお、図 1には図示しないが、多重化データに音声データが含まれている場合には 、分離手段 11により分離されて復号処理された後、スピーカから出力される。 Although not shown in FIG. 1, when audio data is included in the multiplexed data, After being separated by the separation means 11 and subjected to the decoding process, they are output from the speaker.
[0040] 以上のように構成された立体映像再生装置 10の動作について、図 4を参照しなが ら説明する。図 4は立体映像再生装置 10に多重化データが供給されてから、映像が 表示されるまでの処理の流れを示す図である。 The operation of the stereoscopic video playback device 10 configured as described above will be described with reference to FIG. FIG. 4 is a diagram showing a flow of processing from the time when the multiplexed data is supplied to the stereoscopic video reproduction device 10 until the video is displayed.
[0041] 分離手段 11には、映像データと音声データと制御情報とが多重化された多重化デ ータが入力される。分離手段 11は入力された多重化データを分離する(ステップ ST 皿)。 [0041] Demultiplexing means 11 receives multiplexed data in which video data, audio data, and control information are multiplexed. Separating means 11 separates the input multiplexed data (step ST dish).
[0042] 復号手段 12は、分離手段 11により分離された映像データが所定の符号化方式に より符号化されている場合に、該符号化方式により規定されるデータの書式を解釈し て、映像データを復号する(ステップ ST102)。一般に符号化された映像データには 、映像データのサイズに関する情報(映像 1フレームの画素数である画像サイズ情報 )が符号化されている。復号された映像データの画像サイズ情報が制御手段 13に出 力される。なお、前記映像データの画像サイズ情報は必ずしも復号手段 12から取得 する必要はなぐ他の手段により別途制御手段 13に入力するようにしてもよい。映像 データが符号ィ匕されていない場合には、ステップ ST102は省略される。  [0042] When the video data separated by the separation unit 11 is encoded by a predetermined encoding method, the decoding unit 12 interprets the format of the data defined by the encoding method, and decodes the image data. The data is decrypted (step ST102). In general, encoded video data is encoded with information on the size of the video data (image size information indicating the number of pixels in one video frame). Image size information of the decoded video data is output to the control means 13. Note that the image size information of the video data may not necessarily be obtained from the decoding unit 12 but may be separately input to the control unit 13 by another unit. If the video data has not been encoded, step ST102 is omitted.
[0043] 制御手段 13は、分離手段 11から入力された制御情報を解釈し、このうち基準ディ スプレイサイズと基準解像度から基準ドット間ピッチ DPIを算出する。さらに、表示手 段 15のディスプレイサイズと解像度から表示手段 15のドット間ピッチ DP2を計算する (ステップ ST103)。  The control means 13 interprets the control information input from the separation means 11, and calculates a reference dot pitch DPI from the reference display size and the reference resolution. Further, a dot pitch DP2 of the display means 15 is calculated from the display size and resolution of the display means 15 (step ST103).
[0044] ドット間ピッチは、例えば、表示手段 15のサイズが 12. 1インチで、解像度が 1024  The pitch between dots is, for example, that the size of the display means 15 is 12.1 inches and the resolution is 1024
X 768ドットの場合、約 0. 24mmと計算される。なお、ドット間ピッチを計算する際に は、両眼視差に関係するのは水平方向のみであることから、水平方向のドット間ピッ チのみを考慮するようにしてもょレ、。  In the case of X768 dots, it is calculated as about 0.24mm. When calculating the pitch between dots, only the horizontal direction is concerned with the binocular disparity, so only the horizontal dot pitch may be considered.
[0045] 次いで、サイズ変更処理の有無に応じて処理が分岐する(ステップ ST104)。サイ ズ変更処理を行う場合には、処理がステップ ST105に進む。サイズ変更処理を行わ ない場合には、処理がステップ ST107に進む。ここで、サイズ変更処理とは画像の 拡大処理または縮小処理である。例えば、図 8 (a)に示した表示装置が基準ディスプ レイであり、図 8 (c)に示した表示装置が表示手段 15であるとする。この場合、表示手 段 15のディスプレイサイズが基準ディスプレイサイズよりも大きぐ解像度も基準解像 度よりも高くなつており、基準となるディスプレイで画面全体に表示されていた映像が 、表示手段 15では画面の所定部分に表示される。このような場合に、映像データを 画面全体に表示するには拡大処理が行われる。また、表示手段 15の解像度が基準 となるディスプレイの解像度よりも低レ、場合には、基準となるディスプレイで画面全体 に表示できていた映像データ力 表示部 15では表示画面に収まりきらなレ、。このよう な場合に、映像データを画面全体に表示するには縮小処理が行われる。サイズ変更 処理の有無は内部フラグとして、予め設定されている力 \ユーザにより設定される。サ ィズ変更処理の有無は制御信号 Aとして画像処理手段 14に入力される。 Next, the process branches depending on the presence or absence of the size change process (step ST104). When performing the size change process, the process proceeds to step ST105. If not, the process proceeds to Step ST107. Here, the size change processing is an enlargement processing or a reduction processing of an image. For example, it is assumed that the display device shown in FIG. 8A is a reference display and the display device shown in FIG. In this case, the display hand The display size of step 15 is larger than the reference display size, and the resolution is also higher than the reference resolution.The image displayed on the entire screen on the reference display is displayed on the display unit 15 at a predetermined portion of the screen. Is displayed. In such a case, enlargement processing is performed to display the video data on the entire screen. Also, in the case where the resolution of the display means 15 is lower than the resolution of the reference display, in the case where the video data capacity display section 15 which was able to display the entire screen on the reference display cannot fit on the display screen, . In such a case, a reduction process is performed to display the video data on the entire screen. The presence or absence of the size change process is set by a preset force \ user as an internal flag. The presence or absence of the size change processing is input to the image processing means 14 as a control signal A.
[0046] ステップ ST105では、次の処理が行われる。まず、制御手段 13は映像データの画 像サイズ情報と、表示手段 15の解像度から拡大/縮小率を計算する。ここでは水平 方向について、サイズ変更処理を行う前と後の映像データの解像度の比を計算した 値を拡大/縮小率とする。拡大/縮小率が画像処理手段 14に入力され、画像処理 手段 14のサイズ変更手段 141によりサイズ変更処理が行われる。ステップ ST106で は、制御手段 13は表示手段 15のドット間ピッチ DP2に、前記拡大/縮小率を掛け て、ドット間ピッチ DP2を補正する。これは、映像を拡大処理して表示した結果が、ド ット間ピッチが大きくなつた場合と等価であると考えられるためである。  [0046] In step ST105, the following processing is performed. First, the control means 13 calculates an enlargement / reduction ratio from the image size information of the video data and the resolution of the display means 15. Here, in the horizontal direction, the value obtained by calculating the ratio of the resolution of the video data before and after performing the size change processing is defined as the enlargement / reduction ratio. The enlargement / reduction ratio is input to the image processing means 14, and the size changing processing is performed by the size changing means 141 of the image processing means 14. In step ST106, the control means 13 corrects the inter-dot pitch DP2 by multiplying the inter-dot pitch DP2 of the display means 15 by the enlargement / reduction ratio. This is because the result of enlarging and displaying an image is considered to be equivalent to the case where the pitch between dots is increased.
[0047] 制御手段 13は、標準ドット間ピッチ DPIと表示手段 15のドット間ピッチ DP2の大小 を比較し、 3次元映像を基準ディスプレイに表示した際の視差量よりも、表示手段 15 に表示した際の視差量が大きくなるか否かを判定する(ステップ ST107)。 DP2が D P1以下の場合には、視差量が変わらなレ、か、小さくなるため補正の必要がないので 、処理がステップ ST109に進む。 DP2が DPIよりも大きい場合には、視差量が大き くなるため、視差量の調整が必要であると判断され、処理がステップ ST108に進む。 視差量調整処理の有無は、制御信号 Bとして画像処理手段 14に入力され、視差量 調整手段 142により視差量の調整処理が行われる(ステップ ST108)。ステップ ST1 09では、制御手段 13は、映像データの種別(2次元 /3次元)を、制御信号 Cとして 画像処理手段 14と表示手段 15に対して出力する。  [0047] The control unit 13 compares the standard dot pitch DPI and the dot pitch DP2 of the display unit 15 with each other, and displays it on the display unit 15 rather than the parallax amount when the three-dimensional image is displayed on the reference display. It is determined whether or not the parallax amount at the time becomes large (step ST107). If DP2 is equal to or less than DP1, the parallax amount remains unchanged or becomes small, so that no correction is required, and the process proceeds to step ST109. If DP2 is larger than DPI, the amount of parallax increases, so it is determined that the amount of parallax needs to be adjusted, and the process proceeds to step ST108. The presence or absence of the parallax adjustment processing is input to the image processing means 14 as the control signal B, and the parallax adjustment processing is performed by the parallax adjustment means 142 (step ST108). In step ST109, the control means 13 outputs the type (two-dimensional / three-dimensional) of the video data to the image processing means 14 and the display means 15 as a control signal C.
映像データが 3次元映像である場合には、画像処理手段 14の表示画像生成手段 1 43により、表示手段 15における 3次元映像の表示形式に変換されて、表示手段 15 に表示される。 When the video data is a three-dimensional video, the display image generating means 1 of the image processing means 14 By 43, the display format is converted into a three-dimensional video display format on the display means 15 and displayed on the display means 15.
[0048] ここで、視差量調整処理について、図 5を用いて説明する。図 5はディスプレイに表 示される 3次元映像を観察する様子を上方から見下ろした構図となっている。図 5 (a) において、右眼用映像の画素 R1は表示位置 501に表示され、対応する左眼用映像 の画素 L1は表示位置 502に表示される。これらの画素は位置 503に結像するため、 ディスプレイ面よりも奥行きをもって観察される。  Here, the parallax amount adjustment processing will be described with reference to FIG. Fig. 5 shows the composition of a 3D image displayed on the display viewed from above. In FIG. 5A, the pixel R1 of the right-eye image is displayed at the display position 501, and the corresponding pixel L1 of the left-eye image is displayed at the display position 502. Since these pixels form an image at position 503, they are observed with a depth greater than the display surface.
[0049] 右眼用映像の画素 R1の表示位置を左に移動して位置 501から位置 504に変更し た状態が図 5 (b)である。ここで、位置 503に像を結んでいた映像が位置 505に見え るようになる。位置 505は位置 503と比べて手前にあるため、表示面に近づいて見え るようになる。図示しないが、逆に画素 R1を 501よりも右に移動させると、位置 503に 像を結んでレ、た映像が表示面よりも奥に見えるようになる。  FIG. 5B shows a state in which the display position of the pixel R1 of the right-eye image is moved to the left and changed from the position 501 to the position 504. Here, the image forming the image at the position 503 becomes visible at the position 505. Since the position 505 is located closer to the display than the position 503, the user can see the position closer to the display surface. Although not shown, if the pixel R1 is moved to the right of 501 on the contrary, an image is formed at the position 503, and the image becomes visible behind the display surface.
[0050] 図 7 (b)で示したように、視差量が大きくなりすぎる場合には、右眼用画像を左方向 に移動するか、あるいは左眼用画像を右方向に移動させて視差量を調整する。視差 量とは、左眼用と右眼用の画像のそれぞれで対応する部分の水平方向の相対距離 であり、例えば、図 5の右眼用画像の画素 R1の表示位置と、その対応点である左眼 用画像の画素 L1の表示位置の相対距離がそれにあたる。この場合、視差量を小さく 調整するには、 R1の表示位置と左眼画像の画素 L1の表示位置を、それらの相対距 離が縮まる方向にそれぞれ動かしてやればよい。視差量調整値は、上記位置 501か ら位置 504までの移動量を指定するものであり、ドット間ピッチ DP1、 DP2の比に応じ て、予め決められた値を使用する。また、左右の映像をそれぞれ反対方向に、前記 視差量調整値の半分だけ移動するようにしてもよい。  As shown in FIG. 7 (b), when the amount of parallax becomes too large, the image for the right eye is moved to the left, or the image for the left eye is moved to the right, and the amount of the parallax is increased. To adjust. The amount of parallax is a horizontal relative distance between corresponding portions of the left-eye image and the right-eye image.For example, the display position of the pixel R1 of the right-eye image in FIG. The relative distance of the display position of the pixel L1 of a certain left-eye image corresponds to that. In this case, in order to adjust the amount of parallax to be small, the display position of R1 and the display position of pixel L1 of the left eye image may be moved in a direction in which the relative distance between them is reduced. The parallax adjustment value designates the amount of movement from the position 501 to the position 504, and uses a predetermined value according to the ratio between the dot pitches DP1 and DP2. Further, the left and right images may be moved in opposite directions by half of the parallax amount adjustment value.
[0051] ここで、上記の処理を具体例により補足する。ここで、基準ディスプレイサイズが 10 インチ、基準解像度力 ¾40 Χ 480ドットである 3次元映像を、 12. 1インチ、 1024 X 7 68ドットのディスプレイを備えた立体映像再生装置で再生する場合を考える。基準ド ット間ピッチ DPIと立体映像再生装置の表示装置におけるドット間ピッチ DP2を計算 すると、 DPI 0. 32mm, DP2 = 0. 24mmである。サイズ変更処理を行わない場 合、 DPI >DP2であるので視差量の調整をせずに表示する。 [0052] サイズ変更処理を行う場合、全画面表示をするために拡大処理をすると、映像デー タを水平方向、垂直方向とも 1. 6倍にする必要がある。ドット間ピッチ DP2を補正す ると、 DP2 = 0. 38となる。この場合、 DPI < DP2であるので視差量の調整を行う。 Here, the above processing will be supplemented by a specific example. Here, consider a case in which a three-dimensional image having a reference display size of 10 inches and a reference resolution of {40 to 480 dots} is reproduced by a stereoscopic image reproduction device having a display of 12.1 inches and 1024 × 768 dots. Calculating the standard dot-to-dot pitch DPI and the dot-to-dot pitch DP2 in the display device of the stereoscopic video playback device, DPI is 0.32 mm and DP2 = 0.24 mm. When the resizing process is not performed, DPI> DP2, so the image is displayed without adjusting the parallax amount. [0052] In the case of performing the size changing process, if the enlargement process is performed to display a full screen, the video data needs to be 1.6 times in both the horizontal and vertical directions. If the dot pitch DP2 is corrected, DP2 = 0.38. In this case, since DPI <DP2, the amount of parallax is adjusted.
[0053] このように、表示部 15の分解能に応じて、適応的に視差量を調整することにより、視 差量が限度を越えて大きくなり、立体視ができない状態で 3次元映像データを表示し てしまうとレ、う問題を解決することができる。  [0053] As described above, by adaptively adjusting the amount of parallax according to the resolution of the display unit 15, the amount of parallax becomes larger than the limit, and the 3D image data is displayed in a state where stereoscopic viewing cannot be performed. Doing so can solve the problem.
[0054] なお、上記の実施形態では、視差量調整処理を行う際に、視差量調整値は予め定 められた値を使用しているが、 3次元映像の最大視差量、または最も重要な被写体 の視差量などの視差情報を制御情報に含む力、たちで受け取り、ドット間ピッチ DP1、 DP2の比に応じて前記視差情報を変更するようにしてもょレ、。  In the above embodiment, when performing the parallax amount adjustment processing, a predetermined value is used as the parallax amount adjustment value. However, the maximum parallax amount of the three-dimensional video or the most important The power including the parallax information such as the parallax amount of the subject in the control information may be received, and the parallax information may be changed according to the ratio of the dot pitches DP1 and DP2.
[0055] また、上記の実施形態では、基準情報として用いる基準ディスプレイの分解能に関 する情報として、ディスプレイサイズと解像度が制御情報に含まれている場合につい て述べたが、これらの代わりに基準となるドット間ピッチや単位面積当りのドット数が制 御情報に含まれる場合にも、同様にして前述の効果が得られる。または、分解能に 関する情報の代わりに基準ディスプレイ上における表示サイズが制御情報に含まれ ていてもよぐこの場合、映像データの画像サイズ情報で割ることにより、ドット間ピッ チに変更すればよい。  Further, in the above embodiment, the case where the display size and the resolution are included in the control information as the information on the resolution of the reference display used as the reference information has been described. The same effect can be obtained in a case where the control information includes the following dot pitch or the number of dots per unit area. Alternatively, the display size on the reference display may be included in the control information instead of the information on the resolution. In this case, the pitch may be changed to the pitch between dots by dividing by the image size information of the video data.
[0056] また、上記の実施形態では、ステップ ST108において視差量調整処理を行ってい る力 ドット間ピッチ DP2を DPIで割った値を縮小率として、サイズ変更処理を行うよ うにしてもよい。映像データを縮小することにより、視差量が減少するために、前述の 視差量調整処理と同様の効果が得られる。  Further, in the above embodiment, the size change process may be performed by using a value obtained by dividing the force dot pitch DP2, which is performing the parallax adjustment process in step ST108, by the DPI as a reduction ratio. Since the amount of parallax is reduced by reducing the video data, the same effect as the above-described parallax amount adjustment processing can be obtained.
[0057] また、上記の実施形態では、拡大/縮小率は計算により求めているが、ユーザ指 定により、拡大/縮小率を指定できるようにしてもよい。この場合、指定された拡大 Z 縮小率に応じて視差量を補正するようにする。また、この場合に限らず、制御手段 13 におけるサイズ変更処理の有無や視差量調整処理の有無をユーザに通知する手段 を別途設けて、ユーザに映像データが拡大または縮小されていることや、視差量が 調整されている旨を表示し、合せて基準ディスプレイサイズと基準解像度を表示する ようにしてもよい。こうすることで、ユーザがサイズ変更処理の有無や視差量調整処理 の有無を知ることができるだけでなぐ例えば、一般に普及しているパーソナルコンビ ユータのように複数の解像度が選択できる場合に、解像度を切替えることにより所望 の視差量で映像データを表示することができるため、利便性を向上させることができ る。 Further, in the above embodiment, the enlargement / reduction ratio is obtained by calculation, but the enlargement / reduction ratio may be specified by the user. In this case, the amount of parallax is corrected according to the specified enlargement / reduction ratio. Not limited to this case, a means for notifying the user of the presence / absence of the size change processing and the presence / absence of the parallax amount adjustment processing in the control unit 13 is separately provided, so that the video data is enlarged or reduced by the user. A message indicating that the amount is being adjusted may be displayed, and the reference display size and the reference resolution may be displayed together. By doing so, the user can determine whether or not the size For example, when multiple resolutions can be selected as in a personal computer that is widely used, video data can be displayed with a desired amount of parallax by switching resolutions. Therefore, convenience can be improved.
ぐ第 2の実施の形態 >  Second embodiment>
[0058] さらに、本発明による別の実施形態について説明する。本実施形態における立体 映像再生装置は、 3次元映像の最大視差量や最も重要な被写体の視差量などの視 差情報を制御情報に含むかたちで受け取り、表示手段 15に映し出される 3次元映像 の視差量を調整するものである。ここで、視差情報はドット単位でもよぐミリメートノレ単 位などの絶対量でもよい。  Further, another embodiment of the present invention will be described. The stereoscopic video playback device according to the present embodiment receives the parallax information such as the maximum parallax amount of the three-dimensional video and the parallax amount of the most important subject in the control information, and receives the parallax information of the three-dimensional video displayed on the display unit 15. Adjust the volume. Here, the parallax information may be an absolute amount such as a dot unit or a millimeter unit.
[0059] 図 6は、このときの処理の流れを示す図である。図 6において、ステップ ST201とス テツプ ST202の処理はそれぞれ、前述の実施形態におけるステップ ST101とステツ プ ST102と同様であるため、ここでの説明は省略する。  FIG. 6 is a diagram showing a flow of processing at this time. In FIG. 6, the processing of step ST201 and step ST202 are the same as those of step ST101 and step ST102 in the above-described embodiment, respectively, and thus description thereof will be omitted.
[0060] 制御手段 13は、サイズ変更処理を行う前と後の映像データのサイズから拡大/縮 小率を計算し (ステップ ST203)、前記視差情報に乗ずることで実際の視差量を計算 する(ステップ ST204)。このとき、入力された前記視差情報がドット単位である場合 には、表示手段 15におけるドット間ピッチ DPを計算し、前記視差情報にドット間ピッ チ DPを乗ずる。  The control unit 13 calculates an enlargement / reduction ratio from the sizes of the video data before and after performing the size change processing (step ST203), and calculates the actual amount of disparity by multiplying the disparity information (step ST203). Step ST204). At this time, if the input parallax information is in units of dots, the inter-dot pitch DP on the display means 15 is calculated, and the parallax information is multiplied by the inter-dot pitch DP.
[0061] 次いで、ステップ ST204の視差量と所定の制限値を比較し、前記視差量が制限値 を越える場合には、処理がステップ ST206に進み、それ以外の場合には処理がステ ップ ST207に進む(ステップ ST205)。ここで前記制限値は、 3次元映像が立体像と して融合可能な範囲内に収まるように決定される。視差量が人の両眼の間の距離より も大きくなると立体視が困難になることが知られており、例えば制限値はおよその両 眼の間の距離である 6. 5cm程度としてもよい。  [0061] Next, the parallax amount in step ST204 is compared with a predetermined limit value, and if the parallax amount exceeds the limit value, the process proceeds to step ST206; otherwise, the process proceeds to step ST207. (Step ST205). Here, the limit value is determined so that the three-dimensional image falls within a range that can be fused as a stereoscopic image. It is known that if the amount of parallax is greater than the distance between human eyes, stereoscopic vision becomes difficult. For example, the limit value may be about 6.5 cm, which is the approximate distance between both eyes.
[0062] ステップ ST206では、実際の視差量が制限値を越えないように、拡大/縮小率を 制限する。こうして計算した拡大 Z縮小率を画像処理手段 14に出力する。  [0062] In step ST206, the enlargement / reduction ratio is limited so that the actual amount of parallax does not exceed the limit value. The calculated enlarged Z reduction ratio is output to the image processing means 14.
[0063] 画像処理手段 14において、制限された拡大 Z縮小率を用いてサイズ変更処理を 行い (ステップ ST207)、表示手段 15で表示することのできる表示形式に変換する( ステップ ST208)。このように、画像の拡大/縮小率を制限することで、視差量が限 度を越えて大きくなり、立体視ができない状態で、 3次元映像データを表示してしまう という問題を解決することができる。 [0063] The image processing means 14 performs a size change process using the limited enlargement Z reduction ratio (step ST207), and converts the image into a display format that can be displayed on the display means 15 (step ST207). Step ST208). In this way, by limiting the enlargement / reduction ratio of the image, it is possible to solve the problem that the amount of parallax becomes larger than the limit and the 3D video data is displayed in a state where stereoscopic viewing cannot be performed. it can.
[0064] また、前記視差情報以外に映像データを実際に画面に表示する際のサイズ (ミリメ 一トル単位)が制御情報に含まれている映像データを再生するようにしてもよい。この 場合にも、指定された表示サイズを守ることで、視差量が限度を越えて大きくなること がなくなり、立体視ができない状態で、 3次元映像データを表示してしまうという問題 を解決することができる。  [0064] In addition to the parallax information, video data whose size (in millimeters) when video data is actually displayed on the screen may be reproduced in the control information. Also in this case, by observing the specified display size, the parallax amount does not increase beyond the limit, and the problem of displaying 3D video data in a state where stereoscopic viewing is impossible is solved. Can be.
[0065] また、拡大/縮小率が制限されたことをユーザに通知する手段を別途設けて、ユー ザに拡大 Z縮小率が制限された旨を表示し、合せて拡大/縮小率を表示することで [0065] Further, a means for notifying the user that the enlargement / reduction ratio is restricted is provided separately, and the user is informed that the enlargement / reduction ratio is restricted, and the enlargement / reduction ratio is displayed together. By
、ユーザがこの表示を参考に、所望の拡大 z縮小率で映像データを表示することが できるため、利便性を向上させることができる。 The user can display video data at a desired enlargement / z reduction ratio with reference to this display, so that the convenience can be improved.
[0066] 以上、本発明の実施形態について説明したが、本発明の立体映像再生装置は、上 記の実施形態に限定されるものではなぐ本発明の要旨を逸脱しない範囲内におい て、種々の変更を加えうることは勿論である。  Although the embodiments of the present invention have been described above, the stereoscopic video playback device of the present invention is not limited to the above-described embodiments, but may be implemented in various forms within the scope of the present invention. Of course, changes can be made.
産業上の利用の可能性  Industrial potential
[0067] 本発明に係る立体映像再生装置は、基準表示サイズや基準解像度を知ることがで き、所望の視差量で映像データを表示できるので、一般に普及しているパーソナルコ ンピュータのように複数の解像度が選択できる機器に対して広く適用できる。 The stereoscopic video playback device according to the present invention can know the reference display size and the reference resolution, and can display video data with a desired amount of parallax. It can be widely applied to devices that can select the resolution.

Claims

請求の範囲 The scope of the claims
[1] 3次元映像データの表示を制御するための制御情報に基づいて、 3次元映像を再 生する立体映像再生装置であって、  [1] A stereoscopic video playback device that plays back a 3D video based on control information for controlling the display of 3D video data,
前記 3次元映像データを表示した際の表示画面における視差量が、前記 3次元映 像データを基準となる表示装置に表示した際の表示画面における視差量よりも大きく なるか否かを、前記制御情報に基づいて判定する判定手段と、  The control is performed to determine whether or not the amount of parallax on the display screen when the 3D image data is displayed is larger than the amount of parallax on the display screen when the 3D image data is displayed on a reference display device. Determining means for determining based on the information;
前記視差量を変更するための画像処理を施す画像処理手段とを備え、 前記判定手段により前記視差量が大きくなると判定された場合に、前記画像処理 手段による画像処理を行うことを特徴とする立体映像再生装置。  Image processing means for performing image processing for changing the amount of parallax; and performing image processing by the image processing means when the determining means determines that the amount of parallax becomes large. Video playback device.
[2] 前記画像処理手段は、前記 3次元映像データを構成する所定の視点の映像を水 平方向に移動して視差量を調整する視差量調整手段を備えることを特徴とする請求 項 1に記載の立体映像再生装置。 2. The image processing device according to claim 1, wherein the image processing unit includes a parallax amount adjustment unit that adjusts the amount of parallax by moving a video of a predetermined viewpoint forming the three-dimensional video data in a horizontal direction. The stereoscopic video reproduction device as described in the above.
[3] 前記画像処理手段は、前記 3次元映像データの画像サイズを変更するサイズ変更 手段を備えることを特徴とする請求項 1又は請求項 2に記載の立体映像再生装置。 [3] The stereoscopic video playback device according to claim 1, wherein the image processing unit includes a size changing unit configured to change an image size of the three-dimensional video data.
[4] 前記制御情報は、前記基準となる表示装置の分解能に関する情報を含むことを特 徴とする請求項 1から請求項 3のいずれか 1項に記載の立体映像再生装置。 4. The stereoscopic video playback device according to claim 1, wherein the control information includes information on a resolution of the display device serving as the reference.
[5] 前記制御情報は、前記基準となる表示装置において、前記 3次元映像データを表 示した際の表示サイズに関する情報を含むことを特徴とする請求項 1から請求項 3の いずれか 1項に記載の立体映像再生装置。 [5] The control information according to any one of claims 1 to 3, wherein the control information includes information on a display size when the 3D video data is displayed on the reference display device. 3. The stereoscopic video playback device according to claim 1.
[6] 3次元映像データの表示を制御するための制御情報に基づいて、 3次元映像を再 生する立体映像再生装置であって、 [6] A stereoscopic video playback device that plays back a 3D video based on control information for controlling the display of the 3D video data,
前記制御情報に応じて、前記 3次元映像データを表示した際の表示画面における 視差量が、立体視可能な値であるか否かを判定する判定手段と、  Judging means for judging whether or not the amount of parallax on the display screen when displaying the three-dimensional video data is a value that allows stereoscopic viewing according to the control information;
前記 3次元映像データの画像サイズを変更するサイズ変更手段とを備え、 前記判定手段により立体視可能な値でないと判定された場合に、前記拡大及び縮 小率を制限することを特徴とする立体映像再生装置。  Size changing means for changing an image size of the three-dimensional video data, wherein when the determination means determines that the value is not stereoscopically viewable, the enlargement and reduction ratios are limited. Video playback device.
[7] 前記制御情報は、重要な被写体の視差量を含み前記 3次元映像データの視差量 を表す視差情報を含むことを特徴とする請求項 6に記載の立体映像再生装置。 7. The stereoscopic video reproduction device according to claim 6, wherein the control information includes a parallax amount of an important subject and includes parallax information indicating a parallax amount of the three-dimensional video data.
[8] 3次元映像データの表示を制御するための制御情報に基づいて、 3次元映像を再 生する立体映像再生方法であって、 [8] A stereoscopic video reproduction method for reproducing a 3D video based on control information for controlling display of the 3D video data,
前記 3次元映像データを表示した際の表示画面における視差量が、前記 3次元映 像データを基準となる表示装置に表示した際の表示画面における視差量よりも大きく なるか否かを、前記制御情報に基づレ、て判定する判定ステップと、  The control is performed to determine whether or not the amount of parallax on the display screen when the 3D image data is displayed is larger than the amount of parallax on the display screen when the 3D image data is displayed on a reference display device. A determining step of determining based on the information;
視差量を変更するための画像処理を施す画像処理ステップとを備え、  Image processing step of performing image processing for changing the amount of parallax,
前記判定ステップにより視差量が大きくなると判定された場合に、前記画像処理ス テツプによる画像処理を行うことを特徴とする立体映像再生方法。  A stereoscopic video reproduction method, characterized in that when the parallax amount is determined to be large in the determining step, image processing is performed by the image processing step.
[9] 前記画像処理ステップは、前記 3次元映像データを構成する所定の視点の映像を 水平方向に移動して視差量を調整することを特徴とする請求項 8に記載の立体映像 再生方法。 9. The stereoscopic video reproduction method according to claim 8, wherein the image processing step adjusts a parallax amount by moving an image of a predetermined viewpoint constituting the three-dimensional video data in a horizontal direction.
[10] 前記画像処理ステップは、前記 3次元映像データの画像サイズを変更することを特 徴とする請求項 8又は請求項 9に記載の立体映像再生方法。  10. The stereoscopic video reproduction method according to claim 8, wherein the image processing step changes an image size of the three-dimensional video data.
[11] 前記制御情報は、前記基準となる表示装置の分解能に関する情報を含むことを特 徴とする請求項 8から請求項 10のいずれか 1項に記載の立体映像再生方法。 11. The stereoscopic video playback method according to claim 8, wherein the control information includes information on a resolution of the reference display device.
[12] 前記制御情報は、前記基準となる表示装置において、前記 3次元映像データを表 示した際の表示サイズを含むことを特徴とする請求項 8から請求項 10のいずれ力 1項 に記載の立体映像再生方法。 12. The control device according to claim 8, wherein the control information includes a display size when the three-dimensional video data is displayed on the reference display device. 3D video playback method.
[13] 3次元映像データの表示を制御するための制御情報に基づいて、 3次元映像を再 生する立体映像再生方法であって、 [13] A stereoscopic video reproducing method for reproducing a 3D video based on control information for controlling display of the 3D video data,
前記制御情報に応じて、前記 3次元映像データを表示した際の表示画面における 視差量が、立体視可能な値であるか否かを判定する判定ステップと、  A determining step of determining whether or not the amount of parallax on the display screen when displaying the three-dimensional video data is a value capable of stereoscopic viewing according to the control information;
前記 3次元映像データの画像サイズを変更するサイズ変更ステップとを備え、 前記判定ステップにより立体視可能な値でないと判定された場合に、前記拡大及 び縮小率を制限することを特徴とする立体映像再生方法。  A size changing step of changing an image size of the three-dimensional video data, wherein when the determination step determines that the value is not a stereoscopically visible value, the enlargement and reduction ratio is limited. Video playback method.
[14] 前記制御情報は、重要な被写体の視差量を含み前記 3次元映像データの視差量 を表す視差情報を含むことを特徴とする請求項 13に記載の立体映像再生方法。  14. The stereoscopic video reproduction method according to claim 13, wherein the control information includes a parallax amount of an important subject and parallax information indicating a parallax amount of the three-dimensional video data.
PCT/JP2004/010203 2003-08-26 2004-07-16 3-dimensional video reproduction device and 3-dimensional video reproduction method WO2005020591A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN200480024145XA CN1864415B (en) 2003-08-26 2004-07-16 3-dimensional video reproduction device and 3-dimensional video reproduction method
US10/567,521 US8035683B2 (en) 2003-08-26 2004-07-16 Stereoscopic image reproducing apparatus and stereoscopic image reproducing method
EP04747669A EP1662809A4 (en) 2003-08-26 2004-07-16 3-dimensional video reproduction device and 3-dimensional video reproduction method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2003-301471 2003-08-26
JP2003301471A JP2005073049A (en) 2003-08-26 2003-08-26 Device and method for reproducing stereoscopic image

Publications (1)

Publication Number Publication Date
WO2005020591A1 true WO2005020591A1 (en) 2005-03-03

Family

ID=34213897

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2004/010203 WO2005020591A1 (en) 2003-08-26 2004-07-16 3-dimensional video reproduction device and 3-dimensional video reproduction method

Country Status (6)

Country Link
US (1) US8035683B2 (en)
EP (1) EP1662809A4 (en)
JP (1) JP2005073049A (en)
KR (1) KR100820129B1 (en)
CN (1) CN1864415B (en)
WO (1) WO2005020591A1 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7944444B2 (en) 2005-09-03 2011-05-17 Samsung Electronics Co., Ltd. 3D image processing apparatus and method
JP2011525075A (en) * 2008-06-10 2011-09-08 マスターイメージ 3ディー アジア リミテッド ライアビリティ カンパニー Stereo image generation chip for mobile equipment and stereo image display method using the same
JP2012004663A (en) * 2010-06-14 2012-01-05 Nintendo Co Ltd Display control program, display control apparatus, display control method, and display control system
US8116557B2 (en) 2005-10-12 2012-02-14 Samsung Electronics Co., Ltd. 3D image processing apparatus and method
US8120606B2 (en) 2009-02-05 2012-02-21 Fujifilm Corporation Three-dimensional image output device and three-dimensional image output method
US9600923B2 (en) 2011-05-26 2017-03-21 Thomson Licensing Scale-independent maps
US10791314B2 (en) 2010-03-31 2020-09-29 Interdigital Ce Patent Holdings, Sas 3D disparity maps

Families Citing this family (85)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4630150B2 (en) * 2005-07-26 2011-02-09 シャープ株式会社 Stereoscopic image recording apparatus and program
KR100667810B1 (en) 2005-08-31 2007-01-11 삼성전자주식회사 Apparatus for controlling depth of 3d picture and method therefor
US8619121B2 (en) 2005-11-17 2013-12-31 Nokia Corporation Method and devices for generating, transferring and processing three-dimensional image data
FR2906899B1 (en) * 2006-10-05 2009-01-16 Essilor Int DISPLAY DEVICE FOR STEREOSCOPIC VISUALIZATION.
TWI331872B (en) * 2006-12-29 2010-10-11 Quanta Comp Inc Method for displaying stereoscopic image
CN101237590B (en) * 2007-02-01 2010-05-19 广达电脑股份有限公司 3D image display method
JP4608563B2 (en) 2008-03-26 2011-01-12 富士フイルム株式会社 Stereoscopic image display apparatus and method, and program
JP5449162B2 (en) 2008-07-31 2014-03-19 三菱電機株式会社 Video encoding apparatus, video encoding method, video reproduction apparatus, and video reproduction method
JP2010045584A (en) 2008-08-12 2010-02-25 Sony Corp Solid image correcting apparatus, solid image correcting method, solid image display, solid image reproducing apparatus, solid image presenting system, program, and recording medium
JP2010098479A (en) * 2008-10-15 2010-04-30 Sony Corp Display apparatus, display method, and display system
JP2010102137A (en) * 2008-10-24 2010-05-06 Fujifilm Corp Three-dimensional photographing device, method and program
US8335425B2 (en) * 2008-11-18 2012-12-18 Panasonic Corporation Playback apparatus, playback method, and program for performing stereoscopic playback
US8301013B2 (en) * 2008-11-18 2012-10-30 Panasonic Corporation Reproduction device, reproduction method, and program for stereoscopic reproduction
JP5355208B2 (en) * 2009-05-01 2013-11-27 富士フイルム株式会社 Three-dimensional display device and digital zoom correction method
JP5515301B2 (en) 2009-01-21 2014-06-11 株式会社ニコン Image processing apparatus, program, image processing method, recording method, and recording medium
JP5313713B2 (en) * 2009-02-03 2013-10-09 Necカシオモバイルコミュニケーションズ株式会社 Terminal device and program
US20100265315A1 (en) * 2009-04-21 2010-10-21 Panasonic Corporation Three-dimensional image combining apparatus
JP2010278878A (en) * 2009-05-29 2010-12-09 Fujifilm Corp Stereoscopic image device and display image switching method thereof
JP4576570B1 (en) * 2009-06-08 2010-11-10 Necカシオモバイルコミュニケーションズ株式会社 Terminal device and program
JP4587237B1 (en) * 2009-06-17 2010-11-24 Necカシオモバイルコミュニケーションズ株式会社 Terminal device and program
KR101719980B1 (en) * 2010-06-22 2017-03-27 엘지전자 주식회사 Method for processing image of display system outputting 3 dimensional contents and display system enabling of the method
JP2011024003A (en) * 2009-07-16 2011-02-03 Fujifilm Corp Three-dimensional moving image recording method and apparatus, and moving image file conversion method and apparatus
JP5503438B2 (en) * 2009-07-21 2014-05-28 富士フイルム株式会社 3D image display apparatus and 3D image display method
KR20110011000A (en) 2009-07-27 2011-02-08 삼성전자주식회사 Method and appratus for generating three-dimensional image datastream including additional information for displaying three-dimensional image, method and apparatus for receiving the same
US8878912B2 (en) * 2009-08-06 2014-11-04 Qualcomm Incorporated Encapsulating three-dimensional video data in accordance with transport protocols
US9330434B1 (en) * 2009-09-01 2016-05-03 Disney Enterprises, Inc. Art-directable retargeting for streaming video
US8373802B1 (en) * 2009-09-01 2013-02-12 Disney Enterprises, Inc. Art-directable retargeting for streaming video
US8717390B2 (en) * 2009-09-01 2014-05-06 Disney Enterprises, Inc. Art-directable retargeting for streaming video
RU2559735C2 (en) * 2009-09-16 2015-08-10 Конинклейке Филипс Электроникс Н.В. 3d display size compensation
JP5299214B2 (en) * 2009-10-20 2013-09-25 ソニー株式会社 Image processing apparatus, image processing method, and program
US9066076B2 (en) * 2009-10-30 2015-06-23 Mitsubishi Electric Corporation Video display control method and apparatus
JP2011109294A (en) * 2009-11-16 2011-06-02 Sony Corp Information processing apparatus, information processing method, display control apparatus, display control method, and program
JP2011138354A (en) * 2009-12-28 2011-07-14 Sony Corp Information processing apparatus and information processing method
GB2477333B (en) * 2010-01-29 2014-12-03 Sony Corp A method and apparatus for creating a stereoscopic image
US9049434B2 (en) 2010-03-05 2015-06-02 Panasonic Intellectual Property Management Co., Ltd. 3D imaging device and 3D imaging method
JP5432365B2 (en) 2010-03-05 2014-03-05 パナソニック株式会社 Stereo imaging device and stereo imaging method
US9128367B2 (en) 2010-03-05 2015-09-08 Panasonic Intellectual Property Management Co., Ltd. 3D imaging device and 3D imaging method
JP4806082B2 (en) 2010-03-30 2011-11-02 株式会社東芝 Electronic apparatus and image output method
JP2011223482A (en) * 2010-04-14 2011-11-04 Sony Corp Image processing apparatus, image processing method, and program
JP2011223481A (en) * 2010-04-14 2011-11-04 Sony Corp Data structure, image processor, image processing method, and program
CN102860020A (en) * 2010-04-28 2013-01-02 松下电器产业株式会社 Image conversion device
JP5449536B2 (en) 2010-04-28 2014-03-19 富士フイルム株式会社 Stereoscopic image reproduction apparatus and method, stereoscopic imaging apparatus, and stereoscopic display apparatus
WO2011136191A1 (en) * 2010-04-28 2011-11-03 富士フイルム株式会社 Stereoscopic image reproduction device and method, stereoscopic image capturing device, stereoscopic display device
CN102860017B (en) * 2010-04-28 2015-06-10 富士胶片株式会社 Stereoscopic image pickup device and control method therefor
US8970672B2 (en) 2010-05-28 2015-03-03 Qualcomm Incorporated Three-dimensional image processing
KR101685343B1 (en) * 2010-06-01 2016-12-12 엘지전자 주식회사 Image Display Device and Operating Method for the Same
JP5546633B2 (en) 2010-06-25 2014-07-09 富士フイルム株式会社 Stereoscopic image reproducing apparatus, stereoscopic image reproducing system, and stereoscopic image reproducing method
EP2586209A1 (en) * 2010-06-28 2013-05-01 Thomson Licensing Method and apparatus for customizing 3-dimensional effects of stereo content
CN102316332B (en) * 2010-07-09 2014-11-26 深圳Tcl新技术有限公司 Stereo image signal processing method
CN101895779B (en) * 2010-07-23 2011-10-05 深圳超多维光电子有限公司 Stereo display method and system
CN101895780B (en) * 2010-07-23 2012-07-25 深圳超多维光电子有限公司 Stereo display method and stereo display device
US8446461B2 (en) 2010-07-23 2013-05-21 Superd Co. Ltd. Three-dimensional (3D) display method and system
JP5675197B2 (en) * 2010-07-26 2015-02-25 オリンパスイメージング株式会社 Display device
KR20120015165A (en) * 2010-08-11 2012-02-21 엘지전자 주식회사 Method for controlling depth of image and mobile terminal using this method
JP2012044308A (en) * 2010-08-16 2012-03-01 Sharp Corp Three dimensional image output device and three dimensional image display device
JP5324538B2 (en) * 2010-09-06 2013-10-23 富士フイルム株式会社 Stereoscopic image display control device, operation control method thereof, and operation control program thereof
JP2012060318A (en) * 2010-09-07 2012-03-22 Sony Corp Display controller, display control method, and program
KR101640404B1 (en) 2010-09-20 2016-07-18 엘지전자 주식회사 Mobile terminal and operation control method thereof
JP5681588B2 (en) * 2010-09-30 2015-03-11 富士フイルム株式会社 Stereoscopic image editing apparatus and stereoscopic image editing method
EP2437513A1 (en) * 2010-10-01 2012-04-04 Hitachi Consumer Electronics Co. Ltd. Receiver for 2D and 3D video content
WO2012047073A2 (en) * 2010-10-08 2012-04-12 엘지전자 주식회사 Three-dimensional glasses, three-dimensional image display apparatus, and method for driving the three-dimensional glasses and the three-dimensional image display apparatus
JP4956658B2 (en) * 2010-10-12 2012-06-20 シャープ株式会社 3D image conversion device and 3D image display device
KR101763686B1 (en) * 2010-11-15 2017-08-01 삼성전자 주식회사 Apparatus and method for processing 3 dimensional video signal
WO2012068724A1 (en) * 2010-11-23 2012-05-31 深圳超多维光电子有限公司 Three-dimensional image acquisition system and method
KR101727899B1 (en) * 2010-11-26 2017-04-18 엘지전자 주식회사 Mobile terminal and operation control method thereof
KR20120062589A (en) * 2010-12-06 2012-06-14 삼성전자주식회사 3d display apparatus and method thereof
WO2012105121A1 (en) * 2011-02-03 2012-08-09 富士フイルム株式会社 3d video playing device, 3d video playing program and recording medium for same, 3d display device, 3d imaging device, and 3d video playing method
US20120200676A1 (en) * 2011-02-08 2012-08-09 Microsoft Corporation Three-Dimensional Display with Motion Parallax
JP2012204852A (en) * 2011-03-23 2012-10-22 Sony Corp Image processing apparatus and method, and program
CN102823264A (en) * 2011-03-31 2012-12-12 松下电器产业株式会社 Video processing apparatus that can change depth of stereoscopic video, system therefor, video processing method, and video processing program
JP5052683B1 (en) * 2011-04-19 2012-10-17 株式会社東芝 Electronic device and video display method
KR101789624B1 (en) * 2011-06-20 2017-10-25 엘지전자 주식회사 Mobile terminal and method for controlling the same
JP2011223640A (en) * 2011-08-09 2011-11-04 Toshiba Corp Electronic device and image output method
JP5978573B2 (en) * 2011-09-06 2016-08-24 ソニー株式会社 Video signal processing apparatus and video signal processing method
CN102427542B (en) * 2011-09-28 2014-07-30 深圳超多维光电子有限公司 Method and device for processing three-dimensional image and terminal equipment thereof
CN103828363B (en) * 2011-09-29 2015-03-18 富士胶片株式会社 Parallax adjustment device and operation control method therefor
CN103843331B (en) * 2011-09-30 2016-03-02 富士胶片株式会社 Image pick-up device and image pickup method
JP5864996B2 (en) * 2011-10-05 2016-02-17 キヤノン株式会社 Image processing apparatus, image processing method, and program
KR101878808B1 (en) * 2012-01-20 2018-07-19 엘지전자 주식회사 Image display apparatus and method for operating the same
CN102685369B (en) * 2012-04-23 2016-09-07 Tcl集团股份有限公司 Eliminate the method for right and left eyes image ghost image, ghost canceller and 3D player
US20150085073A1 (en) * 2012-05-02 2015-03-26 Koninklijke Philips N.V. Quality metric for processing 3d video
JP2014204299A (en) * 2013-04-05 2014-10-27 キヤノン株式会社 Imaging apparatus and method for controlling the same
EP3032828A4 (en) * 2013-08-06 2016-12-14 Sony Interactive Entertainment Inc Three-dimensional image generating device, three-dimensional image generating method, program, and information storage medium
WO2015191767A1 (en) * 2014-06-10 2015-12-17 Bitanimate, Inc. Stereoscopic depth adjustment and focus point adjustment
EP3293972B1 (en) * 2015-06-24 2023-08-30 Sony Olympus Medical Solutions Inc. Three-dimensional observation device for medical use, three-dimensional observation method for medical use, and program

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08317429A (en) * 1995-05-23 1996-11-29 Matsushita Electric Ind Co Ltd Stereoscopic electronic zoom device and stereoscopic picture quality controller
JPH09121370A (en) * 1995-08-24 1997-05-06 Matsushita Electric Ind Co Ltd Stereoscopic television device
JPH10150608A (en) * 1996-11-19 1998-06-02 Sanyo Electric Co Ltd User-side terminal of digital broadcasting system
JP2000224612A (en) * 1999-01-28 2000-08-11 Nippon Telegr & Teleph Corp <Ntt> Three-dimensional image input-output device

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1043062A (en) * 1988-11-28 1990-06-13 中国人民解放军沈阳军区军训模拟器材研究所 Framing type stereo-television system and height visual angle image increasing method thereof
JP3157384B2 (en) * 1994-06-20 2001-04-16 三洋電機株式会社 3D image device
US6005607A (en) * 1995-06-29 1999-12-21 Matsushita Electric Industrial Co., Ltd. Stereoscopic computer graphics image generating apparatus and stereoscopic TV apparatus
JP2002095018A (en) * 2000-09-12 2002-03-29 Canon Inc Image display controller, image display system and method for displaying image data

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08317429A (en) * 1995-05-23 1996-11-29 Matsushita Electric Ind Co Ltd Stereoscopic electronic zoom device and stereoscopic picture quality controller
JPH09121370A (en) * 1995-08-24 1997-05-06 Matsushita Electric Ind Co Ltd Stereoscopic television device
JPH10150608A (en) * 1996-11-19 1998-06-02 Sanyo Electric Co Ltd User-side terminal of digital broadcasting system
JP2000224612A (en) * 1999-01-28 2000-08-11 Nippon Telegr & Teleph Corp <Ntt> Three-dimensional image input-output device

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7944444B2 (en) 2005-09-03 2011-05-17 Samsung Electronics Co., Ltd. 3D image processing apparatus and method
US8116557B2 (en) 2005-10-12 2012-02-14 Samsung Electronics Co., Ltd. 3D image processing apparatus and method
JP2011525075A (en) * 2008-06-10 2011-09-08 マスターイメージ 3ディー アジア リミテッド ライアビリティ カンパニー Stereo image generation chip for mobile equipment and stereo image display method using the same
US8120606B2 (en) 2009-02-05 2012-02-21 Fujifilm Corporation Three-dimensional image output device and three-dimensional image output method
US10791314B2 (en) 2010-03-31 2020-09-29 Interdigital Ce Patent Holdings, Sas 3D disparity maps
JP2012004663A (en) * 2010-06-14 2012-01-05 Nintendo Co Ltd Display control program, display control apparatus, display control method, and display control system
US9602809B2 (en) 2010-06-14 2017-03-21 Nintendo Co., Ltd. Storage medium storing display control program for providing stereoscopic display desired by user with simpler operation, display control device, display control method, and display control system
US9600923B2 (en) 2011-05-26 2017-03-21 Thomson Licensing Scale-independent maps

Also Published As

Publication number Publication date
KR20060087511A (en) 2006-08-02
US8035683B2 (en) 2011-10-11
CN1864415A (en) 2006-11-15
KR100820129B1 (en) 2008-04-08
US20060290778A1 (en) 2006-12-28
JP2005073049A (en) 2005-03-17
CN1864415B (en) 2010-04-28
EP1662809A4 (en) 2012-01-18
EP1662809A1 (en) 2006-05-31

Similar Documents

Publication Publication Date Title
WO2005020591A1 (en) 3-dimensional video reproduction device and 3-dimensional video reproduction method
CN1741621B (en) Method of generating stereoscopic image signal and method of scaling the same
US8384766B2 (en) Apparatus for processing a stereoscopic image stream
JP4154569B2 (en) Image compression / decompression device
US20100265315A1 (en) Three-dimensional image combining apparatus
JP4763571B2 (en) Stereo image generating device and stereo image decoding device
JP2007536825A (en) Stereoscopic television signal processing method, transmission system, and viewer expansion apparatus
JP2013526094A5 (en)
JP2004343290A (en) Stereographic picture display device
JP5390016B2 (en) Video processing device
JP5390017B2 (en) Video processing device
JP4657258B2 (en) Stereoscopic image display apparatus and method
JP4173684B2 (en) Stereoscopic image creation device
JP2001069530A (en) Stereoscopic video signal encoding device of high efficiency
JP4243095B2 (en) Stereoscopic image processing method, program, and recording medium
JP2013021683A (en) Image signal processing device, image signal processing method, image display device, image display method, and image processing system
JP3129784B2 (en) 3D video high-efficiency coding device
JPH10336699A (en) Stereoscopic broadcasting system, transmitter therefor and receiver therefor
KR20120050041A (en) Multivision system and 3-dimensional image reproducing method including multi 3-dimentional image reproducing appparatus
JPH03114385A (en) Device for video image number switching, coding and decoding
JP2012034038A (en) Three-dimensional video processor and three-dimensional video processing method

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200480024145.X

Country of ref document: CN

AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DPEN Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed from 20040101)
WWE Wipo information: entry into national phase

Ref document number: 2006290778

Country of ref document: US

Ref document number: 10567521

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 2004747669

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 1020067003516

Country of ref document: KR

WWP Wipo information: published in national office

Ref document number: 2004747669

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 1020067003516

Country of ref document: KR

WWP Wipo information: published in national office

Ref document number: 10567521

Country of ref document: US