WO2009031872A2 - System and method for generating and reproducing 3d stereoscopic image file including 2d image - Google Patents

System and method for generating and reproducing 3d stereoscopic image file including 2d image Download PDF

Info

Publication number
WO2009031872A2
WO2009031872A2 PCT/KR2008/005294 KR2008005294W WO2009031872A2 WO 2009031872 A2 WO2009031872 A2 WO 2009031872A2 KR 2008005294 W KR2008005294 W KR 2008005294W WO 2009031872 A2 WO2009031872 A2 WO 2009031872A2
Authority
WO
WIPO (PCT)
Prior art keywords
image
stereoscopic
information
stereoscopic image
reproduction
Prior art date
Application number
PCT/KR2008/005294
Other languages
French (fr)
Other versions
WO2009031872A3 (en
Inventor
Gun-Ill Lee
Original Assignee
Samsung Electronics Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co., Ltd. filed Critical Samsung Electronics Co., Ltd.
Priority to EP08829834A priority Critical patent/EP2183925A4/en
Publication of WO2009031872A2 publication Critical patent/WO2009031872A2/en
Publication of WO2009031872A3 publication Critical patent/WO2009031872A3/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/172Processing image signals image signals comprising non-image signal components, e.g. headers or format information
    • H04N13/178Metadata, e.g. disparity information
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/161Encoding, multiplexing or demultiplexing different image signal components
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/172Processing image signals image signals comprising non-image signal components, e.g. headers or format information
    • H04N13/183On-screen display [OSD] information, e.g. subtitles or menus

Definitions

  • the present invention relates generally to a system and a method for generating and reproducing Three-Dimensional (3D) stereoscopic image files based on Two-Dimensional (2D) image media standards, and more particularly, to a system and a method for generating and reproducing a 2D image on a portion of a 3D stereoscopic image.
  • 3D Three-Dimensional
  • 2D Two-Dimensional
  • MPEG Moving Picture Experts Group
  • MPEG-4 MPEG-4
  • MPEG-7 MPEG-21
  • MPEG-I Moving Picture Experts Group
  • DMB MAF Digital Multimedia Broadcasting MAF
  • an aspect of the present invention provides a file format required to generate, store, and reproduce a 3D stereoscopic image.
  • the present invention provides a file format for a 3D stereoscopic image based on a file format used to generate, store, and reproduce an existing 2D image.
  • the present invention provides a system and a method for generating and reproducing a 3D stereoscopic image file using a file format for a 3D stereoscopic image.
  • Another aspect of the present invention provides a system and a method for generating and reproducing a 3D stereoscopic image file including a 2D image, which enables a user to view a caption of a 3D stereoscopic image in the form of a 2D image when a user views a 3D stereoscopic image. Further, the present invention provides a system and a method for providing an image, which include an advertisement broadcast or a news broadcast, in addition to a caption, in the form of a 2D image, on a part on a 3D stereoscopic image.
  • a system for generating and reproducing a 3D stereoscopic image file including a 2D image.
  • the system includes a stereoscopic image file generating apparatus for generating a stereoscopic image file including first image data, second image data used to generate a 3D stereoscopic image after being synchronized with the first image data, and third image data used to generate a 2D image.
  • the system also includes a stereoscopic image file reproducing apparatus for reproducing and displaying the 3D stereoscopic image by synthesizing the first image data and the second image data, and for reproducing and displaying the 2D image generated from the third image data on a portion of the 3D stereoscopic image being reproduced, when the generated stereoscopic image file is input.
  • a stereoscopic image file reproducing apparatus for reproducing and displaying the 3D stereoscopic image by synthesizing the first image data and the second image data, and for reproducing and displaying the 2D image generated from the third image data on a portion of the 3D stereoscopic image being reproduced, when the generated stereoscopic image file is input.
  • a system for generating and reproducing a 3D stereoscopic image file including a 2D image.
  • the system includes a stereoscopic image file generating apparatus for generating a stereoscopic image file, which includes a data area including first image data, second image data used to generate a 3D stereoscopic image after being synchronized with the first image data, and third image data used to generate a 2D image, a header area including information of the first image data, and a metadata area including information of the second image data and information of the third image data.
  • the system also includes a stereoscopic image file reproducing apparatus for reproducing and displaying the 3D stereoscopic image by parsing the information of the first image data and the second image data and synthesizing the first image data and the second image data, and for parsing the information of the third image data, and then reproducing and displaying the 2D image generated from the third image data on a portion of the 3D stereoscopic image being reproduced, when the generated stereoscopic image file is input.
  • a stereoscopic image file reproducing apparatus for reproducing and displaying the 3D stereoscopic image by parsing the information of the first image data and the second image data and synthesizing the first image data and the second image data, and for parsing the information of the third image data, and then reproducing and displaying the 2D image generated from the third image data on a portion of the 3D stereoscopic image being reproduced, when the generated stereoscopic image file is input.
  • a method for generating and reproducing a 3D stereoscopic image file including a 2D image.
  • a predetermined subject is photographed from a first view and first image data is output, and the subject is photographed from a second view and second image data is output.
  • the output first image data and second image data are pre-processed.
  • the pre-processed first image data and second image data, and third image data are stored and used to generate a 2D image.
  • the stored first image data and second image data, and the stored third image data are encoded.
  • the stereoscopic image file including the encoded first image data and second image data, and the encoded third image data is generated.
  • FIG. 1 is a diagram illustrating a storage format of a conventional International Standardization Organization (ISO) 14496-12 based 2D image file;
  • ISO International Standardization Organization
  • FIG. 2A is a diagram illustrating a storage format of a 3D stereoscopic image file according to a first embodiment of the present invention
  • FIG. 2B is a diagram illustrating a storage format of a 3D stereoscopic image file according to a second embodiment of the present invention
  • FIG. 2C is a diagram illustrating a storage format of a 3D stereoscopic image file according to a third embodiment of the present invention. - A -
  • FIG 3 is a conceptual diagram illustrating a 2D image displayed on a portion of a 3D stereoscopic image according to one embodiment of the present invention
  • FIG. 4A is a view in which news of a 2D image is reproduced and displayed on a portion of a 3D stereoscopic image according to a first embodiment of the present invention
  • FIG 4B is a view in which a caption of a 2D image is reproduced and displayed on a portion of a 3D stereoscopic image according to a second embodiment of the present invention
  • FIG 4C is a view in which an advertisement of a 2D image is reproduced and displayed on a portion of a 3D stereoscopic image according to a third embodiment of the present invention.
  • FIG. 5 is a block diagram illustrating a construction of a stereoscopic image file generating apparatus according to an embodiment of the present invention
  • FIG 6 is a block diagram illustrating a construction of a stereoscopic image file reproducing apparatus according to an embodiment of the present invention
  • FIG 7 is a flowchart illustrating a method for generating a stereoscopic image file according to an embodiment of the present invention.
  • FIG 8 is a flowchart illustrating a method for reproducing a stereoscopic image file according to an embodiment of the present invention.
  • FIG 1 is a diagram illustrating a conventional ISO 14496-12 based 2D image file format 100.
  • the 2D image file format 100 includes a moviebox(moov) area 110 and an mediadatabox(mdat) area 120.
  • the mdat area 120 is a data area of the file format, and includes actual image data within an image track 121, and audioaudio data within a audioaudio track 123.
  • Each of the tracks includes the image data 122 and audioaudio data 124 stored in a frame unit.
  • the moov area 110 is a header area of the file format and has an object based structure.
  • the moov area 110 includes all pieces of information used to reproduce a file, including content information, such as a frame rate, a bit rate, image size, etc., and synchronization information used to support a reproduction function of FF/REW.
  • content information such as a frame rate, a bit rate, image size, etc.
  • synchronization information used to support a reproduction function of FF/REW.
  • the moov area 110 includes information, such as the number of frames within the image data 111 and audio data 112, and a size of each frame, etc. Therefore, it is possible to restore and reproduce image data and audio data by parsing the moov area during reproduction.
  • 3D stereoscopic image files 201 to 203 are constructed by basically adding only a metabox(meta) area to the 2D image file format 100 shown in FIG. 1. Therefore, without important modification in a structure and a function of a 2D image file format, it is possible to use the function thereof.
  • FIG 2A is a diagram illustrating a storage format of a 3D stereoscopic image file including a 2D image according to a first embodiment of the present invention.
  • An mdat area 230 corresponding to a data area includes a first image track 231, a second image track 233, a third image track 235, a first audio track 237, and a second audio track 239a.
  • the first image track 231 includes first image data 232
  • the second image track 233 includes second image data 234.
  • the first image data 232 and the second image data 234 are data generated by utilizing human visual characteristics, and are data generated by photographing a predetermined subject from a left view and a right view by using two cameras. As such, by generating and reproducing a separated image on left and right eyes of a user, the user can view an image displayed in a stereoscopic manner. When only one of the first image data 232 and the second image data 234 is reproduced, the user can view a 2D image. When the first image data 232 and the second image data 234 are reproduced by being synthesized, the user can view a 3D stereoscopic image.
  • First audio data 238 within the first image track 237 is data regarding a audio which is to be added to a 3D stereoscopic image.
  • the third image track 235 includes third image data 236, which corresponds to a characteristic of the present invention
  • the second audio track 239a includes a second audio data 239b.
  • the second audio track 239a and the second audio data 239b are used to reproduce and display a 2D image on a portion of the 3D stereoscopic image.
  • FIG 3 shows that a 2D image 310 is separately reproduced and displayed on a portion of the 3D stereoscopic image 300.
  • letters of the caption are also displayed in three dimensions, which causes severe eyestrain to the user. Therefore, the caption should be displayed in the format of a 2D image.
  • FIG 4A is an exemplary view in which a caption of a 2D image is reproduced and displayed on a portion of a 3D stereoscopic image. Meanwhile, it is possible to reproduce and display additional images, such as news, or advertisements, as sub- images displayed in the form of a 2D image, which is illustrated in FIGs. 4B and 4C.
  • Second audio data 239b is data regarding a audio added to the 2D image 310.
  • the second audio data 239b may be skipped.
  • the moov area 210 corresponding to a header area includes information 211 of first image data and information 212 of first audio data
  • the meta 220 includes information 221 of second image data, information 222 of third image data, and information 223 of second audio data.
  • Such information includes information about the number of total frames within each data, and a size of the frames, so that, when a 3D stereoscopic image 300 of FIG 3 is reproduced, it is possible to parse such information and synthesize respective data.
  • the first image data 232 and the second image data 234 are respectively synthesized, and then the first audio data 238 is added to the synthesized image data. Meanwhile, the information 222 of the third image data is data used to generate the 2D image 310.
  • the information 222 of the third image data includes information regarding a location and a size where the 2D image 310 is reproduced and displayed on the 3D stereoscopic image 300, regarding a time when the 2D image 310 begins to be reproduced and displayed on the 3D stereoscopic image 300, regarding a time during which the 2D image 310 is being reproduced and displayed, and regarding a time at which reproduction and display of the 2D image 310 is terminated.
  • information regarding a location at which the 2D image 310 is reproduced and displayed may be set by designating an upper-left-end vertex coordinate 311 and lower-right-end vertex coordinate 312, as shown in FIG 3.
  • the information 223 of the second audio data may be various types of information that are set to add the second audio data 239b to the 2D image 310.
  • the information 223 of the second audio data may be skipped.
  • FIG. 2B is a diagram illustrating a storage format of a 3D stereoscopic image file according to a second embodiment of the present invention.
  • the storage format of the 3D stereoscopic image file 202 of the present invention includes an mdat area 260 corresponding to a data area, a moov area 240 corresponding to a header area, and a meta area 250.
  • the storage scheme is a scheme for storing one from among the first image data 262, the second image data 263, and the third image data 264 in a predetermined order. Therefore, it is possible to construct image data with only one track. It is also possible to construct the first audio data 265, the second audio data 266, and the third audio data 267 with one audio track.
  • the moov area 240 includes the information 241 of the first image data and the information 242 of the first audio data.
  • the meta area 250 includes information 251 of the second image data, information 252 of the third image data, and the information 253 of the second audio data.
  • Each information includes the number of total frames within each data, a size of the frames, and a starting address pointing to the location where each data is stored in a corresponding track. Therefore, it is possible to reproduce the 3D stereoscopic image 300 by synthesizing the first image data 262 and the second image data 263.
  • the information 252 of the third image data includes a location and a size where the 2D image 310 is reproduced and displayed on the 3D stereoscopic image 300, a time at which the 2D image 310 is reproduced and displayed, a time during which the 2D image 310 is reproduced and displayed, and a time when the reproduction and display of the 2D image 310 is terminated. In this way, it is possible to reproduce and display the 2D image 310, generated from the third image data 264, on a portion of the 3D stereoscopic image 300.
  • FIG 2C is a diagram illustrating a storage format of a 3D stereoscopic image file according to a third embodiment of the present invention.
  • the storage format of the 3D stereoscopic image file according to the present invention also includes an mdat area 290 corresponding to a data area, a moov area 270 corresponding to a header area, and a meta area 280.
  • the storage format shown in FIG 2C includes one image track 291, as in the case of the storage format of the 3D stereoscopic image file 202 of FIG 2b, and is different in that the storage format of FIG 2C includes one image track 291 in which the first image data, the second image data, and the third image data 292 are stored by turns.
  • the storage format of FIG 2C includes one audio track 293, and is different in that first audio data and second audio data are also stored in one audio track 293, as indicated by reference numeral 294.
  • the moov area 270 corresponding to the header area includes information 271 of first image data and information 272 of first audio data
  • the meta area 280 includes information 281 of second image data, information 282 of third image data, and information 283 of second audio data, each including the number of total frames of each data, a size of the frames, and a starting address pointing to the location where each data is stored in a corresponding track.
  • the 3D stereoscopic image file 203 further includes an offset indicating the displacement from data within each track until a next corresponding data.
  • the information 282 of the third image data further includes a location and a size where the 2D image 310 is reproduced and displayed on the 3D stereoscopic image 300, a time when the 2D image 310 begins to be reproduced and displayed on the 3D stereoscopic image 300, a time during which the 2D image 310 is being reproduced and displayed on the 3D stereoscopic image 300, and a time when the reproduction and display of the 2D image 310 on the 3D stereoscopic image 300 is terminated, all of which are used to reproduce and display the 2D image 310 generated from the third image data on a portion of the 3D stereoscopic image 300.
  • top left x top left x location at which partial monoscopic contents are reproduced top_left_y: top_left_y location at which partial monoscopic contents are reproduced bottom right x: bottom right x location at which partial monoscopic contents are reproduced bottom_right_y: bottom_right_y location at which partial monoscopic contents are reproduced
  • timescale timescale for presentation of monoscopic contents duration: duration for resentation of monoscopic contents start time: value indicating a time interval from the starting of reproduction of stereoscopic contents to the starting of reproduction of monoscopic contents (second unit)
  • a system for generating and reproducing a stereoscopic image file using 3D stereoscopic image files 201 to 202 shown in FIGs. 2A to 2C are described.
  • Such a system may broadly include a stereoscopic image file generating apparatus and a stereoscopic image file reproducing apparatus.
  • the stereoscopic image file generating apparatus according to one embodiment of the present invention is described with reference to FIG 5.
  • the stereoscopic image file generating apparatus 500 includes a first camera 510, a second camera 511, an image signal processing unit 520, a storage unit 530, an encoding unit 540, and a file generating unit 550.
  • the first camera 510 photographs a predetermined subject from a left view or a right view, and then outputs first image data
  • the second camera 511 photographs the subject from a view different from that of the first camera 510 and then outputs second image data.
  • the first image data and the second image data output from each of the first camera 510 and the second camera 511 are pre-processed by the image signal processing unit 520.
  • the pre-processing performed by the video signal processing unit 520 means conversion of an external image value, i.e., light and color components, that is an analog value recognized by a Charge Coupled Device (CCD) or a Complimentary Metal-Oxide Semiconductor (CMOS) type sensor, into a digital value.
  • CCD Charge Coupled Device
  • CMOS Complimentary Metal-Oxide Semiconductor
  • the storage unit 530 stores the first image data and the second image data pre-processed by the image signal processing unit 520 and provides the stored image data to the encoding unit 540.
  • the storage unit 530 also pre-stores third image data for generation of the 2D image 310.
  • the third image may be data for additional images, such as a caption, news, advertisements, etc.
  • FIG. 5 illustrates the storage unit 530, it does not separately show a storage construction for buffering between the elements shown in FIG 5.
  • the encoding unit 540 encodes the first image data, the second image data, and the third image data provided from the storage unit 530.
  • the encoding operation performed by the encoding unit 540 includes encoding of data, which can be skipped as necessary.
  • the file generating unit 550 generates 3D stereoscopic image files 201 to 203 by using the first image data, the second image data, and the third image data encoded by the encoding unit 540.
  • the first image data, the second image data, and the third image data are stored in an mdat area (i.e. a data area), information used to synthesize the first image data and the second image data for generation of the 3D stereoscopic image 300 is stored in the moov area (i.e. header area), and information used to generate the 2D image 310 from the third image data for reproduction and display of the generated 2D image 310 on a portion of the 3D stereoscopic image 300 is stored in a meta area.
  • the generated stereoscopic image files 201 to 203 are input and transmitted to the stereoscopic image file reproducing apparatus, and then the stereoscopic image file reproducing apparatus generates and reproduces the 3D stereoscopic image 300 from the 3D stereoscopic image files 201 to 203.
  • the stereoscopic image file reproducing apparatus will be described.
  • FIG. 6 is a block diagram illustrating a construction of a stereoscopic image file reproducing apparatus according to one embodiment of the present invention.
  • the stereoscopic image file reproducing apparatus 600 includes a file parsing unit 610, a decoding unit 620, a storage unit 630, a reproducing unit 640, and a display unit 650.
  • the file parsing unit 610 receives and parses the 3D stereoscopic image file generated by the file generating unit 550 of the stereoscopic image file generating apparatus 500.
  • the file parsing unit 610 parses information of first image data, information of second image data, and information of third image data stored respectively in the moov area and the meta area, and then extracts the first image data, the second image data, and the third image data stored in the mdat area.
  • the decoding unit 620 decodes the extracted first image data, second image data, and third image data, which is preformed in the case where the stereoscopic image file generating apparatus 500 uses the encoding unit 540 to perform encoding. Then, decoded data is stored in the storage unit 630.
  • the reproducing unit 640 makes reference to the information of the first image data and the information of the second image data, and reproduces the 3D stereoscopic image 300 obtained by synthesizing the first image data and the second image data stored in the storage unit 630. Then, the display unit 650 displays the reproduced 3D stereoscopic image 300.
  • the reproducing unit 640 reproduces the 3D stereoscopic image 300 together with the 2D image 310, which is obtained by making reference to the information of the third image data to generate and reproduce the 2D image 310. Then, the display unit 650 displays the 2D image 310 on a portion of the 3D stereoscopic image 300.
  • FIG. 7 is a flowchart illustrating a method for generating a stereoscopic image file according to one embodiment of the present invention.
  • the method includes a photographing step (S710), a pre-processing step (S720), an encoding step (S730), and a file generating step (S740).
  • step S710 a predetermined subject is photographed from a left view or a right view, and first image data is output. Then, the subject is photographed from another view and second image data is output.
  • step S720 the first image data and the second image data are pre- processed, and converted into digital signals from analog signals recognized by the CCD or CMOS type sensor.
  • step S 730 the first image data, the second image data, and the third image data stored in the storage unit 530 are encoded. Step S730 can be skipped if necessary.
  • step S740 a 3D stereoscopic image file is generated using the first image data and the second image data having been encoded in the encoding unit 540.
  • the 3D stereoscopic image file may be generated as described in FIGs. 2A to 2C.
  • FIG. 8 is a flowchart illustrating a method for reproducing a stereoscopic image file according to an embodiment of the present invention.
  • the method for reproducing the stereoscopic image file includes a file parsing step (S810), a decoding step (S820), an image generating step (S830), and a reproducing and display step (S840).
  • FIG 8 illustrates a method for reproducing the stereoscopic image file generated in FIG 7.
  • first image data, second image data, and third image data are extracted using information of first image data, information of second image data, and information of third image data stored in either of the moov area or the meta area of the stereoscopic image file.
  • step S820 the first image data, the second image data, and the third image data are decoded.
  • the decoding step (S730) is skipped in the method for generating the stereoscopic image file, the decoding step (S820) is also skipped.
  • step S830 the 3D stereoscopic image 300 is generated by synthesizing the first image data and the second image data decoded in step S820.
  • the 2D image 310 is generated from the third image data.
  • step S 840 the 3D stereoscopic image 300 generated in the above-described generating step is reproduced and displayed on the display unit 650 and the 2D image 310 is reproduced and displayed on a portion of the 3D stereoscopic image 300.
  • Such a display unit 650 can perform reproduction, even in a general Liquid Crystal Display (LCD).
  • LCD Liquid Crystal Display

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Library & Information Science (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

A method for controlling moving picture encoding using channel information of wireless networks is provided. By the method, it is possible to use a pre-verified standard technology in the prescription of a stereoscopic image file format, thereby simplifying a verification procedure for a new standard. Also, it is possible to use a new a stereoscopic image file format, thereby selecting, generating, and reproducing either of a 2D image file or a 3D stereoscopic image file. In particular, according to a system and a method for using a file format used to generate a 3D stereoscopic image, it is possible to reproduce and display a caption in the form of a 2D image during reproduction of the 3D stereoscopic image, thereby reducing eyestrain of a user, and additionally providing an image such as news, or an advertisement, to a user.

Description

SYSTEM AND METHOD FOR GENERATING AND REPRODUCING 3D STEREOSCOPIC IMAGE FILE INCLUDING 2D IMAGE
BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates generally to a system and a method for generating and reproducing Three-Dimensional (3D) stereoscopic image files based on Two-Dimensional (2D) image media standards, and more particularly, to a system and a method for generating and reproducing a 2D image on a portion of a 3D stereoscopic image.
2. Description of the Related Art
Conventional standards for a file format used to store a 2D image have been known, whereas standards for a file format used to store a 3D stereoscopic image are not yet known.
In general, the Moving Picture Experts Group (MPEG), which is an international standardization organization related to multimedia, has been standardizing MPEG-2, MPEG-4, MPEG-7 and MPEG-21, since its first standardization of MPEG-I in 1988. Since a variety of standards have been developed in this way, a need has arisen to generate one profile by combining different standard technologies. In response to this need, MPEG-A (MPEG Application: ISO/ICE 230000) multimedia application standardization activities have been carried out. In a Multimedia Application Format (MAF) that is one of MPEG-A activities, non-MPEG standards, as well as the conventional MPEG standards, are combined so that the utilization value of the standard can be enhanced. In this way, already verified standard technologies can be easily combined without any further efforts to set up a separate standard, thereby developing the MAF and maximizing the efficiency value thereof. The standardization, such as a Digital Multimedia Broadcasting MAF (DMB MAF), has been ongoing, but a file format for storing a 3D stereoscopic image has not yet been standardized.
According to recent technology for implementing a 3D stereoscopic image, it is possible to reproduce a stereoscopic image by only a portal terminal with a barrier LCD. However, technology for reproducing a 3D stereoscopic image by a general portable terminal or a storage format of a stereoscopic image therefor has never been known. Meanwhile, when a caption is displayed during reproduction of a 3D stereoscopic image, a user views the caption of a 3D stereoscopic image, which may easily cause eyestrain for the user.
SUMMARY OF THE INVENTION
The present invention has been made to address at least the above problems and/or disadvantages and to provide at least the advantages described below. Accordingly, an aspect of the present invention provides a file format required to generate, store, and reproduce a 3D stereoscopic image. Particularly, the present invention provides a file format for a 3D stereoscopic image based on a file format used to generate, store, and reproduce an existing 2D image. Further, the present invention provides a system and a method for generating and reproducing a 3D stereoscopic image file using a file format for a 3D stereoscopic image.
Another aspect of the present invention provides a system and a method for generating and reproducing a 3D stereoscopic image file including a 2D image, which enables a user to view a caption of a 3D stereoscopic image in the form of a 2D image when a user views a 3D stereoscopic image. Further, the present invention provides a system and a method for providing an image, which include an advertisement broadcast or a news broadcast, in addition to a caption, in the form of a 2D image, on a part on a 3D stereoscopic image.
According to an aspect of the present invention, a system is provided for generating and reproducing a 3D stereoscopic image file including a 2D image. The system includes a stereoscopic image file generating apparatus for generating a stereoscopic image file including first image data, second image data used to generate a 3D stereoscopic image after being synchronized with the first image data, and third image data used to generate a 2D image. The system also includes a stereoscopic image file reproducing apparatus for reproducing and displaying the 3D stereoscopic image by synthesizing the first image data and the second image data, and for reproducing and displaying the 2D image generated from the third image data on a portion of the 3D stereoscopic image being reproduced, when the generated stereoscopic image file is input.
According to another aspect of the present invention, a system is provided for generating and reproducing a 3D stereoscopic image file including a 2D image. The system includes a stereoscopic image file generating apparatus for generating a stereoscopic image file, which includes a data area including first image data, second image data used to generate a 3D stereoscopic image after being synchronized with the first image data, and third image data used to generate a 2D image, a header area including information of the first image data, and a metadata area including information of the second image data and information of the third image data. The system also includes a stereoscopic image file reproducing apparatus for reproducing and displaying the 3D stereoscopic image by parsing the information of the first image data and the second image data and synthesizing the first image data and the second image data, and for parsing the information of the third image data, and then reproducing and displaying the 2D image generated from the third image data on a portion of the 3D stereoscopic image being reproduced, when the generated stereoscopic image file is input.
According to an additional aspect of the present invention, a method is provided for generating and reproducing a 3D stereoscopic image file including a 2D image. A predetermined subject is photographed from a first view and first image data is output, and the subject is photographed from a second view and second image data is output. The output first image data and second image data are pre-processed. The pre-processed first image data and second image data, and third image data are stored and used to generate a 2D image. The stored first image data and second image data, and the stored third image data are encoded. The stereoscopic image file including the encoded first image data and second image data, and the encoded third image data is generated.
BRIEF DESCRIPTION OF THE DRAWINGS
The above and other aspects, features and advantages of the present invention will be more apparent from the following detailed description when taken in conjunction with the accompanying drawings, in which:
FIG. 1 is a diagram illustrating a storage format of a conventional International Standardization Organization (ISO) 14496-12 based 2D image file;
FIG. 2A is a diagram illustrating a storage format of a 3D stereoscopic image file according to a first embodiment of the present invention;
FIG. 2B is a diagram illustrating a storage format of a 3D stereoscopic image file according to a second embodiment of the present invention;
FIG. 2C is a diagram illustrating a storage format of a 3D stereoscopic image file according to a third embodiment of the present invention; - A -
FIG 3 is a conceptual diagram illustrating a 2D image displayed on a portion of a 3D stereoscopic image according to one embodiment of the present invention;
FIG. 4A is a view in which news of a 2D image is reproduced and displayed on a portion of a 3D stereoscopic image according to a first embodiment of the present invention;
FIG 4B is a view in which a caption of a 2D image is reproduced and displayed on a portion of a 3D stereoscopic image according to a second embodiment of the present invention;
FIG 4C is a view in which an advertisement of a 2D image is reproduced and displayed on a portion of a 3D stereoscopic image according to a third embodiment of the present invention;
FIG. 5 is a block diagram illustrating a construction of a stereoscopic image file generating apparatus according to an embodiment of the present invention;
FIG 6 is a block diagram illustrating a construction of a stereoscopic image file reproducing apparatus according to an embodiment of the present invention;
FIG 7 is a flowchart illustrating a method for generating a stereoscopic image file according to an embodiment of the present invention; and
FIG 8 is a flowchart illustrating a method for reproducing a stereoscopic image file according to an embodiment of the present invention.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
Preferred embodiments of the present invention are described in detail with reference to the accompanying drawings. Similar component are designated by similar reference numerals although they are illustrated in different drawings. Detailed descriptions of constructions or processes known in the art may be omitted to avoid obscuring the subject matter of the present invention.
Before describing a format for storing a 3D stereoscopic image according to the present invention, a storage format of a conventional ISO based 2D image file will be described with reference to FIG 1. FIG 1 is a diagram illustrating a conventional ISO 14496-12 based 2D image file format 100. Referring to FIG 1, the 2D image file format 100 includes a moviebox(moov) area 110 and an mediadatabox(mdat) area 120. The mdat area 120 is a data area of the file format, and includes actual image data within an image track 121, and audioaudio data within a audioaudio track 123. Each of the tracks includes the image data 122 and audioaudio data 124 stored in a frame unit. The moov area 110 is a header area of the file format and has an object based structure. The moov area 110 includes all pieces of information used to reproduce a file, including content information, such as a frame rate, a bit rate, image size, etc., and synchronization information used to support a reproduction function of FF/REW. In particular, the moov area 110 includes information, such as the number of frames within the image data 111 and audio data 112, and a size of each frame, etc. Therefore, it is possible to restore and reproduce image data and audio data by parsing the moov area during reproduction.
The storage format of a 3D stereoscopic image file including a 2D image according to one embodiment of the present invention will be described with reference to FIGs. 2A-2C. In the present invention, 3D stereoscopic image files 201 to 203 are constructed by basically adding only a metabox(meta) area to the 2D image file format 100 shown in FIG. 1. Therefore, without important modification in a structure and a function of a 2D image file format, it is possible to use the function thereof.
An example of one embodiment of the present invention will be described with reference to FIG. 2A. FIG 2A is a diagram illustrating a storage format of a 3D stereoscopic image file including a 2D image according to a first embodiment of the present invention. An mdat area 230 corresponding to a data area includes a first image track 231, a second image track 233, a third image track 235, a first audio track 237, and a second audio track 239a. The first image track 231 includes first image data 232, and the second image track 233 includes second image data 234. Herein, the first image data 232 and the second image data 234 are data generated by utilizing human visual characteristics, and are data generated by photographing a predetermined subject from a left view and a right view by using two cameras. As such, by generating and reproducing a separated image on left and right eyes of a user, the user can view an image displayed in a stereoscopic manner. When only one of the first image data 232 and the second image data 234 is reproduced, the user can view a 2D image. When the first image data 232 and the second image data 234 are reproduced by being synthesized, the user can view a 3D stereoscopic image. First audio data 238 within the first image track 237 is data regarding a audio which is to be added to a 3D stereoscopic image. Meanwhile, the third image track 235 includes third image data 236, which corresponds to a characteristic of the present invention, and the second audio track 239a includes a second audio data 239b. Herein, the second audio track 239a and the second audio data 239b are used to reproduce and display a 2D image on a portion of the 3D stereoscopic image. Such a conception of displaying a 2D image on a portion of a 3D stereoscopic image is shown in FIG 3. In other words, FIG 3 shows that a 2D image 310 is separately reproduced and displayed on a portion of the 3D stereoscopic image 300. For example, when a user views a caption of a 3D stereoscopic image, letters of the caption are also displayed in three dimensions, which causes severe eyestrain to the user. Therefore, the caption should be displayed in the format of a 2D image.
FIG 4A is an exemplary view in which a caption of a 2D image is reproduced and displayed on a portion of a 3D stereoscopic image. Meanwhile, it is possible to reproduce and display additional images, such as news, or advertisements, as sub- images displayed in the form of a 2D image, which is illustrated in FIGs. 4B and 4C.
Second audio data 239b is data regarding a audio added to the 2D image 310. When the 2D image 310 corresponds to a caption, the second audio data 239b may be skipped. Next, the moov area 210 corresponding to a header area includes information 211 of first image data and information 212 of first audio data, and the meta 220 includes information 221 of second image data, information 222 of third image data, and information 223 of second audio data. Such information includes information about the number of total frames within each data, and a size of the frames, so that, when a 3D stereoscopic image 300 of FIG 3 is reproduced, it is possible to parse such information and synthesize respective data. In order to generate the 3D stereoscopic image 300, the first image data 232 and the second image data 234 are respectively synthesized, and then the first audio data 238 is added to the synthesized image data. Meanwhile, the information 222 of the third image data is data used to generate the 2D image 310. Since the 2D image 310 is reproduced and displayed on a portion of the 3D stereoscopic image 300, the information 222 of the third image data includes information regarding a location and a size where the 2D image 310 is reproduced and displayed on the 3D stereoscopic image 300, regarding a time when the 2D image 310 begins to be reproduced and displayed on the 3D stereoscopic image 300, regarding a time during which the 2D image 310 is being reproduced and displayed, and regarding a time at which reproduction and display of the 2D image 310 is terminated. For example, information regarding a location at which the 2D image 310 is reproduced and displayed may be set by designating an upper-left-end vertex coordinate 311 and lower-right-end vertex coordinate 312, as shown in FIG 3. Meanwhile, the information 223 of the second audio data may be various types of information that are set to add the second audio data 239b to the 2D image 310. When the 2D image 310 corresponds to a caption, the information 223 of the second audio data may be skipped.
A second embodiment of the present invention is described with reference to FIG 2B. FIG. 2B is a diagram illustrating a storage format of a 3D stereoscopic image file according to a second embodiment of the present invention. The storage format of the 3D stereoscopic image file 202 of the present invention includes an mdat area 260 corresponding to a data area, a moov area 240 corresponding to a header area, and a meta area 250. The difference between the storage format of the 3D stereoscopic image file 202 and the storage format of the 3D stereoscopic image file 201 lies in that the storage format of the 3D stereoscopic image file 202 includes one image track 261 containing all of the first image data 262, the second image data 263, and the third image data 264. The storage scheme is a scheme for storing one from among the first image data 262, the second image data 263, and the third image data 264 in a predetermined order. Therefore, it is possible to construct image data with only one track. It is also possible to construct the first audio data 265, the second audio data 266, and the third audio data 267 with one audio track.
The moov area 240 includes the information 241 of the first image data and the information 242 of the first audio data. Meanwhile, the meta area 250 includes information 251 of the second image data, information 252 of the third image data, and the information 253 of the second audio data. Each information includes the number of total frames within each data, a size of the frames, and a starting address pointing to the location where each data is stored in a corresponding track. Therefore, it is possible to reproduce the 3D stereoscopic image 300 by synthesizing the first image data 262 and the second image data 263. The information 252 of the third image data includes a location and a size where the 2D image 310 is reproduced and displayed on the 3D stereoscopic image 300, a time at which the 2D image 310 is reproduced and displayed, a time during which the 2D image 310 is reproduced and displayed, and a time when the reproduction and display of the 2D image 310 is terminated. In this way, it is possible to reproduce and display the 2D image 310, generated from the third image data 264, on a portion of the 3D stereoscopic image 300.
A third embodiment of the present invention is described with reference to FIG 2C. FIG 2C is a diagram illustrating a storage format of a 3D stereoscopic image file according to a third embodiment of the present invention. The storage format of the 3D stereoscopic image file according to the present invention also includes an mdat area 290 corresponding to a data area, a moov area 270 corresponding to a header area, and a meta area 280. The storage format shown in FIG 2C includes one image track 291, as in the case of the storage format of the 3D stereoscopic image file 202 of FIG 2b, and is different in that the storage format of FIG 2C includes one image track 291 in which the first image data, the second image data, and the third image data 292 are stored by turns. Further, the storage format of FIG 2C includes one audio track 293, and is different in that first audio data and second audio data are also stored in one audio track 293, as indicated by reference numeral 294. The moov area 270 corresponding to the header area includes information 271 of first image data and information 272 of first audio data, and the meta area 280 includes information 281 of second image data, information 282 of third image data, and information 283 of second audio data, each including the number of total frames of each data, a size of the frames, and a starting address pointing to the location where each data is stored in a corresponding track. Meanwhile, unlike the 3D stereoscopic image file 202, the 3D stereoscopic image file 203 further includes an offset indicating the displacement from data within each track until a next corresponding data.
The information 282 of the third image data further includes a location and a size where the 2D image 310 is reproduced and displayed on the 3D stereoscopic image 300, a time when the 2D image 310 begins to be reproduced and displayed on the 3D stereoscopic image 300, a time during which the 2D image 310 is being reproduced and displayed on the 3D stereoscopic image 300, and a time when the reproduction and display of the 2D image 310 on the 3D stereoscopic image 300 is terminated, all of which are used to reproduce and display the 2D image 310 generated from the third image data on a portion of the 3D stereoscopic image 300.
Standards regarding information requiring reproduction and display of the 2D image 310 on a portion of the 3D stereoscopic image 300 are proposed below.
[Definition]
Box Type: 'sp2i'
Container: Smaple Table Box('stbl') mandatory: Yes
Quantity: Zero or one
[Syntax] aligned(8) class StereoscopicPartial2DInformationBox extends
FullBox('sp2i', version=0, 0)
{ unsigned int(16) top left x; unsigned int(16) top_left_y; unsigned int(16) bottom right x; unsigned int(16) bottom_right_y;
unsigned int(32) timescale; unsigned int(32) duration; unsigned int(32) start time; }
[Semantics] top left x: top left x location at which partial monoscopic contents are reproduced top_left_y: top_left_y location at which partial monoscopic contents are reproduced bottom right x: bottom right x location at which partial monoscopic contents are reproduced bottom_right_y: bottom_right_y location at which partial monoscopic contents are reproduced timescale: timescale for presentation of monoscopic contents duration: duration for resentation of monoscopic contents start time: value indicating a time interval from the starting of reproduction of stereoscopic contents to the starting of reproduction of monoscopic contents (second unit)
A system for generating and reproducing a stereoscopic image file using 3D stereoscopic image files 201 to 202 shown in FIGs. 2A to 2C are described. Such a system may broadly include a stereoscopic image file generating apparatus and a stereoscopic image file reproducing apparatus. First, the stereoscopic image file generating apparatus according to one embodiment of the present invention is described with reference to FIG 5.
The stereoscopic image file generating apparatus 500 includes a first camera 510, a second camera 511, an image signal processing unit 520, a storage unit 530, an encoding unit 540, and a file generating unit 550. The first camera 510 photographs a predetermined subject from a left view or a right view, and then outputs first image data, and the second camera 511 photographs the subject from a view different from that of the first camera 510 and then outputs second image data.
The first image data and the second image data output from each of the first camera 510 and the second camera 511 are pre-processed by the image signal processing unit 520. Herein, the pre-processing performed by the video signal processing unit 520 means conversion of an external image value, i.e., light and color components, that is an analog value recognized by a Charge Coupled Device (CCD) or a Complimentary Metal-Oxide Semiconductor (CMOS) type sensor, into a digital value.
The storage unit 530 stores the first image data and the second image data pre-processed by the image signal processing unit 520 and provides the stored image data to the encoding unit 540. The storage unit 530 also pre-stores third image data for generation of the 2D image 310. In this case, the third image may be data for additional images, such as a caption, news, advertisements, etc. Although FIG. 5 illustrates the storage unit 530, it does not separately show a storage construction for buffering between the elements shown in FIG 5. The encoding unit 540 encodes the first image data, the second image data, and the third image data provided from the storage unit 530. The encoding operation performed by the encoding unit 540 includes encoding of data, which can be skipped as necessary.
The file generating unit 550 generates 3D stereoscopic image files 201 to 203 by using the first image data, the second image data, and the third image data encoded by the encoding unit 540. The first image data, the second image data, and the third image data are stored in an mdat area (i.e. a data area), information used to synthesize the first image data and the second image data for generation of the 3D stereoscopic image 300 is stored in the moov area (i.e. header area), and information used to generate the 2D image 310 from the third image data for reproduction and display of the generated 2D image 310 on a portion of the 3D stereoscopic image 300 is stored in a meta area. The generated stereoscopic image files 201 to 203 are input and transmitted to the stereoscopic image file reproducing apparatus, and then the stereoscopic image file reproducing apparatus generates and reproduces the 3D stereoscopic image 300 from the 3D stereoscopic image files 201 to 203. Hereinafter, the stereoscopic image file reproducing apparatus will be described.
FIG. 6 is a block diagram illustrating a construction of a stereoscopic image file reproducing apparatus according to one embodiment of the present invention. Referring to FIG. 6, the stereoscopic image file reproducing apparatus 600 includes a file parsing unit 610, a decoding unit 620, a storage unit 630, a reproducing unit 640, and a display unit 650.
The file parsing unit 610 receives and parses the 3D stereoscopic image file generated by the file generating unit 550 of the stereoscopic image file generating apparatus 500. The file parsing unit 610 parses information of first image data, information of second image data, and information of third image data stored respectively in the moov area and the meta area, and then extracts the first image data, the second image data, and the third image data stored in the mdat area.
The decoding unit 620 decodes the extracted first image data, second image data, and third image data, which is preformed in the case where the stereoscopic image file generating apparatus 500 uses the encoding unit 540 to perform encoding. Then, decoded data is stored in the storage unit 630. The reproducing unit 640 makes reference to the information of the first image data and the information of the second image data, and reproduces the 3D stereoscopic image 300 obtained by synthesizing the first image data and the second image data stored in the storage unit 630. Then, the display unit 650 displays the reproduced 3D stereoscopic image 300. Herein, the reproducing unit 640 reproduces the 3D stereoscopic image 300 together with the 2D image 310, which is obtained by making reference to the information of the third image data to generate and reproduce the 2D image 310. Then, the display unit 650 displays the 2D image 310 on a portion of the 3D stereoscopic image 300.
Next, a method for generating and reproducing a stereoscopic image file by using such a 3D stereoscopic image file format i described.
FIG. 7 is a flowchart illustrating a method for generating a stereoscopic image file according to one embodiment of the present invention. Referring to FIG 5, the method includes a photographing step (S710), a pre-processing step (S720), an encoding step (S730), and a file generating step (S740).
In step S710, a predetermined subject is photographed from a left view or a right view, and first image data is output. Then, the subject is photographed from another view and second image data is output.
In step S720, the first image data and the second image data are pre- processed, and converted into digital signals from analog signals recognized by the CCD or CMOS type sensor.
In step S 730, the first image data, the second image data, and the third image data stored in the storage unit 530 are encoded. Step S730 can be skipped if necessary. In step S740, a 3D stereoscopic image file is generated using the first image data and the second image data having been encoded in the encoding unit 540. The 3D stereoscopic image file may be generated as described in FIGs. 2A to 2C.
FIG. 8 is a flowchart illustrating a method for reproducing a stereoscopic image file according to an embodiment of the present invention. Referring to FIG. 8, the method for reproducing the stereoscopic image file includes a file parsing step (S810), a decoding step (S820), an image generating step (S830), and a reproducing and display step (S840). FIG 8 illustrates a method for reproducing the stereoscopic image file generated in FIG 7.
In step S810, first image data, second image data, and third image data are extracted using information of first image data, information of second image data, and information of third image data stored in either of the moov area or the meta area of the stereoscopic image file.
In step S820, the first image data, the second image data, and the third image data are decoded. When the decoding step (S730) is skipped in the method for generating the stereoscopic image file, the decoding step (S820) is also skipped.
In step S830, the 3D stereoscopic image 300 is generated by synthesizing the first image data and the second image data decoded in step S820. The 2D image 310 is generated from the third image data. In step S 840, the 3D stereoscopic image 300 generated in the above-described generating step is reproduced and displayed on the display unit 650 and the 2D image 310 is reproduced and displayed on a portion of the 3D stereoscopic image 300. Such a display unit 650 can perform reproduction, even in a general Liquid Crystal Display (LCD).
While the invention has been shown and described with reference to certain preferred embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

WHAT IS CLAIMED IS:
1. A stereoscopic video application format in a stereoscopic video reproduction apparatus, the format comprising: an media data box(mdat) area including a first image and a second image used to generate a 3D stereoscopic image, and a 2D image; a moviebox (moov) area including information of the first image; a metabox(meta) area including information of the second image, and information of the 2D image used to display the 2D image in a portion of the 3D stereoscopic image.
2. The format as claimed in claim 1, wherein the moov area further comprises information of a first audio data corresponding to the first image.
3. The format as claimed in claim 1, wherein the meta area further comprises information of a second audio data corresponding to the second image.
4. The format as claimed in claim 1, wherein the first image corresponds to an image, which is generated by photographing from a left view, from among images photographed by two cameras, and the second image corresponds to an image, which is generated by photographing from a right view, from among images photographed by the two cameras.
5. The format as claimed in claim 4, wherein the information of the first image or the information of the second image comprises the number of frames within the first image or the second image, and a size of the frames.
6. The format as claimed in claim 1, wherein the information of the 2D image comprises any one of a reproduction location, a reproduction start time, a reproduction duration time, and a reproduction end time of the 2D image used for reproduction in a portion of the 3D stereoscopic image.
7. A stereoscopic video reproduction apparatus, the apparatus comprising: a file parsing unit for parsing stereoscopic video application data, thereby extracting a first image and a second image used to generate a 3D stereoscopic image, and extracting a 2D image, when the stereoscopic video application data with the 2D image is received; a decoding unit for decoding the extracted first and second images, and the extracted 2D image; a reproducing unit for reproducing the 3D stereoscopic image obtained by synthesizing the decoded first image and second image through information of the first image and the second image, and for reproducing the 2D image in a portion of the reproduced 3D stereoscopic image by using the information of the 2D image; and a display unit for displaying the reproduced 3D stereoscopic image, and for displaying the reproduced 2D image in a portion of the displayed 3D stereoscopic image.
8. The apparatus as claimed in claim 7, wherein the first image corresponds to an image, which is generated by photographing from a left view, from among images photographed by two cameras, and the second image corresponds to an image, which is generated by photographing from a right view, from among images photographed by the two cameras.
9. The apparatus as claimed in claim 7, wherein the information of the first image or the information of the second image comprises the number of frames within the first image or the second image, and a size of the frames.
10. The apparatus as claimed in claim 7, wherein the information of the 2D image comprises any one of a reproduction location, a reproduction start time, a reproduction duration time, and a reproduction end time of the 2D image used for reproduction in a portion of the 3D stereoscopic image.
11. A method for reproducing stereoscopic video in a stereoscopic video reproduction apparatus, the method comprising the steps of: parsing stereoscopic video application data when the stereoscopic video application data with a 2D image is received; extracting a first image and a second image used to generate a 3D stereoscopic image from the parsed stereoscopic video application data, and extracting the 2D image; decoding the extracted first and second images, and the extracted 2D image; reproducing the 3D stereoscopic image obtained by synthesizing the decoded first image and second image through information of the first image and the second image, and reproducing the 2D image in a portion of the reproduced 3D stereoscopic image by using the information of the 2D image; displaying the reproduced 3D stereoscopic image, and displaying the reproduced 2D image in a portion of the displayed 3D stereoscopic image.
12. The method as claimed in claim 11, wherein the first image corresponds to an image, which is generated by photographing from a left view, from among images photographed by two cameras, and the second image corresponds to an image, which is generated by photographing from a right view from among images photographed by the two cameras.
13. The method as claimed in claim 11, wherein the information of the first image and the information of the second image comprises the number of frames within the first image or the second image, and a size of the frames.
14. The method as claimed in claim 11, wherein the information of the 2D image comprises any one of any one of a reproduction location, a reproduction start time, a reproduction duration time, and a reproduction end time of the 2D image used for reproduction in a portion of the 3D stereoscopic image.
PCT/KR2008/005294 2007-09-07 2008-09-08 System and method for generating and reproducing 3d stereoscopic image file including 2d image WO2009031872A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP08829834A EP2183925A4 (en) 2007-09-07 2008-09-08 System and method for generating and reproducing 3d stereoscopic image file including 2d image

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020070090973A KR101362647B1 (en) 2007-09-07 2007-09-07 System and method for generating and palying three dimensional image file including two dimensional image
KR10-2007-0090973 2007-09-07

Publications (2)

Publication Number Publication Date
WO2009031872A2 true WO2009031872A2 (en) 2009-03-12
WO2009031872A3 WO2009031872A3 (en) 2009-04-30

Family

ID=40429570

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2008/005294 WO2009031872A2 (en) 2007-09-07 2008-09-08 System and method for generating and reproducing 3d stereoscopic image file including 2d image

Country Status (4)

Country Link
US (1) US8508579B2 (en)
EP (1) EP2183925A4 (en)
KR (1) KR101362647B1 (en)
WO (1) WO2009031872A2 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010095074A1 (en) * 2009-02-17 2010-08-26 Koninklijke Philips Electronics N.V. Combining 3d image and graphical data
US20110141247A1 (en) * 2009-12-16 2011-06-16 Samsung Electronics Co., Ltd. Display device and display method thereof
EP2346021A1 (en) * 2009-12-31 2011-07-20 Broadcom Corporation Frame formatting supporting mixed two and three dimensional video data communication
CN102215364A (en) * 2009-12-31 2011-10-12 美国博通公司 Method for formating first video data and second video data and communication interface
EP2442561A2 (en) * 2009-06-08 2012-04-18 LG Electronics Inc. Device and method for providing a three-dimensional pip image
WO2012055892A1 (en) * 2010-10-29 2012-05-03 Thomson Licensing Method for generation of three-dimensional images encrusting a graphic object in the image and an associated display device
CN104052983A (en) * 2013-03-12 2014-09-17 辉达公司 Efficient autostereo support using display controller windows

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2380105A1 (en) * 2002-04-09 2003-10-09 Nicholas Routhier Process and system for encoding and playback of stereoscopic video sequences
KR101387212B1 (en) * 2007-06-12 2014-04-21 삼성전자주식회사 System and method for generating and playing three dimensional image files based on two dimensional image media standards
WO2009075495A1 (en) * 2007-12-10 2009-06-18 Samsung Electronics Co., Ltd. System and method for generating and reproducing image file including 2d image and 3d stereoscopic image
US8358331B2 (en) * 2008-12-02 2013-01-22 Lg Electronics Inc. 3D caption display method and 3D display apparatus for implementing the same
US8269821B2 (en) * 2009-01-27 2012-09-18 EchoStar Technologies, L.L.C. Systems and methods for providing closed captioning in three-dimensional imagery
US8723927B2 (en) * 2009-03-31 2014-05-13 Daniel Rosen Subtitling stereographic imagery
KR101676037B1 (en) * 2009-12-04 2016-11-14 한국전자통신연구원 Apparatus and method for dimension broadcasting service in broadcasting system that mobile broadcasting is combined
US8743178B2 (en) * 2010-01-05 2014-06-03 Dolby Laboratories Licensing Corporation Multi-view video format control
KR101329065B1 (en) * 2010-03-31 2013-11-14 한국전자통신연구원 Apparatus and method for providing image data in an image system
JP5510097B2 (en) * 2010-06-16 2014-06-04 ソニー株式会社 Signal transmission method, signal transmission device, and signal reception device
JP5573426B2 (en) * 2010-06-30 2014-08-20 ソニー株式会社 Audio processing apparatus, audio processing method, and program
KR101645465B1 (en) * 2010-07-23 2016-08-04 삼성전자주식회사 Apparatus and method for generating a three-dimension image data in portable terminal
US20120092364A1 (en) * 2010-10-14 2012-04-19 Microsoft Corporation Presenting two-dimensional elements in three-dimensional stereo applications
KR20120085476A (en) * 2011-01-24 2012-08-01 삼성전자주식회사 Method and apparatus for reproducing image, and computer-readable storage medium
US9420259B2 (en) 2011-05-24 2016-08-16 Comcast Cable Communications, Llc Dynamic distribution of three-dimensional content
US20140192033A1 (en) * 2013-01-07 2014-07-10 Htc Corporation 3d image apparatus and method for displaying images
KR101430985B1 (en) * 2013-02-20 2014-09-18 주식회사 카몬 System and Method on Providing Multi-Dimensional Content
CN105916022A (en) * 2015-12-28 2016-08-31 乐视致新电子科技(天津)有限公司 Video image processing method and apparatus based on virtual reality technology

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1501316A1 (en) 2002-04-25 2005-01-26 Sharp Corporation Multimedia information generation method and multimedia information reproduction device
EP1739979A2 (en) 2005-07-02 2007-01-03 Samsung Electronics Co., Ltd. Method and apparatus for encoding/decoding video data to implement local three-dimensional video

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3789794B2 (en) 2001-09-26 2006-06-28 三洋電機株式会社 Stereoscopic image processing method, apparatus, and system
KR100397511B1 (en) * 2001-11-21 2003-09-13 한국전자통신연구원 The processing system and it's method for the stereoscopic/multiview Video
CN101982979B (en) * 2002-07-16 2013-01-02 韩国电子通信研究院 Apparatus and method for adapting 2d and 3d stereoscopic video signal
CN100339875C (en) * 2002-08-27 2007-09-26 夏普株式会社 Content reproduction device capable of reproducing a content in optimal reproduction mode
JP2005026800A (en) * 2003-06-30 2005-01-27 Konica Minolta Photo Imaging Inc Image processing method, imaging apparatus, image processing apparatus, and image recording apparatus
KR20050005607A (en) * 2003-07-05 2005-01-14 박해영 Permanent power generating apparatus for generating electrical energies by using n and s poles of permanent magnet and converting potential energy into motion energy
KR100576544B1 (en) 2003-12-09 2006-05-03 한국전자통신연구원 Apparatus and Method for Processing of 3D Video using MPEG-4 Object Descriptor Information
JP4638784B2 (en) * 2005-07-19 2011-02-23 オリンパスイメージング株式会社 Image output apparatus and program
KR100667823B1 (en) 2005-10-13 2007-01-11 삼성전자주식회사 Multi-channel imaging system
US20070167702A1 (en) * 2005-12-30 2007-07-19 Intuitive Surgical Inc. Medical robotic system providing three-dimensional telestration
KR101340911B1 (en) * 2006-03-31 2013-12-13 코닌클리케 필립스 엔.브이. Efficient encoding of multiple views
KR100744371B1 (en) 2006-08-02 2007-07-30 삼성전자주식회사 Apparatus for displaying a 3-d image capable of selecting a composite frame structure, and method for processing the 3-d image
KR100716142B1 (en) 2006-09-04 2007-05-11 주식회사 이시티 Method for transferring stereoscopic image data
WO2008033856A1 (en) * 2006-09-11 2008-03-20 3Ality Digital, Llc 3d augmentation of traditional photography
US8237776B2 (en) * 2007-10-19 2012-08-07 Warner Bros. Entertainment Inc. Method and apparatus for generating stereoscopic images from a DVD disc
US8755672B2 (en) * 2007-06-26 2014-06-17 Lg Electronics Inc. Media file format based on, method and apparatus for reproducing the same, and apparatus for generating the same

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1501316A1 (en) 2002-04-25 2005-01-26 Sharp Corporation Multimedia information generation method and multimedia information reproduction device
EP1739979A2 (en) 2005-07-02 2007-01-03 Samsung Electronics Co., Ltd. Method and apparatus for encoding/decoding video data to implement local three-dimensional video

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2183925A4

Cited By (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11310486B2 (en) 2009-02-17 2022-04-19 Koninklijke Philips N.V. Method and apparatus for combining 3D image and graphical data
US9438879B2 (en) 2009-02-17 2016-09-06 Koninklijke Philips N.V. Combining 3D image and graphical data
WO2010095074A1 (en) * 2009-02-17 2010-08-26 Koninklijke Philips Electronics N.V. Combining 3d image and graphical data
EP2442561A4 (en) * 2009-06-08 2013-10-16 Lg Electronics Inc Device and method for providing a three-dimensional pip image
EP2442561A2 (en) * 2009-06-08 2012-04-18 LG Electronics Inc. Device and method for providing a three-dimensional pip image
US9185328B2 (en) 2009-06-08 2015-11-10 Lg Electronics Inc. Device and method for displaying a three-dimensional PIP image
US20110141247A1 (en) * 2009-12-16 2011-06-16 Samsung Electronics Co., Ltd. Display device and display method thereof
EP2357832A3 (en) * 2009-12-16 2012-09-05 Samsung Electronics Co., Ltd. Display device and display method thereof
US9049440B2 (en) 2009-12-31 2015-06-02 Broadcom Corporation Independent viewer tailoring of same media source content via a common 2D-3D display
CN102215364A (en) * 2009-12-31 2011-10-12 美国博通公司 Method for formating first video data and second video data and communication interface
US8964013B2 (en) 2009-12-31 2015-02-24 Broadcom Corporation Display with elastic light manipulator
US8988506B2 (en) 2009-12-31 2015-03-24 Broadcom Corporation Transcoder supporting selective delivery of 2D, stereoscopic 3D, and multi-view 3D content from source video
EP2346021A1 (en) * 2009-12-31 2011-07-20 Broadcom Corporation Frame formatting supporting mixed two and three dimensional video data communication
US9066092B2 (en) 2009-12-31 2015-06-23 Broadcom Corporation Communication infrastructure including simultaneous video pathways for multi-viewer support
CN102215364B (en) * 2009-12-31 2015-08-05 美国博通公司 Format method and the communication interface of the first video data and the second video data
US9124885B2 (en) 2009-12-31 2015-09-01 Broadcom Corporation Operating system supporting mixed 2D, stereoscopic 3D and multi-view 3D displays
US9143770B2 (en) 2009-12-31 2015-09-22 Broadcom Corporation Application programming interface supporting mixed two and three dimensional displays
US9979954B2 (en) 2009-12-31 2018-05-22 Avago Technologies General Ip (Singapore) Pte. Ltd. Eyewear with time shared viewing supporting delivery of differing content to multiple viewers
US9204138B2 (en) 2009-12-31 2015-12-01 Broadcom Corporation User controlled regional display of mixed two and three dimensional content
US9247286B2 (en) 2009-12-31 2016-01-26 Broadcom Corporation Frame formatting supporting mixed two and three dimensional video data communication
US9654767B2 (en) 2009-12-31 2017-05-16 Avago Technologies General Ip (Singapore) Pte. Ltd. Programming architecture supporting mixed two and three dimensional displays
CN103202024B (en) * 2010-10-29 2016-05-04 汤姆逊许可公司 Method, the related display device of the 3-D view of parcel Drawing Object in synthetic image
WO2012055892A1 (en) * 2010-10-29 2012-05-03 Thomson Licensing Method for generation of three-dimensional images encrusting a graphic object in the image and an associated display device
CN103202024A (en) * 2010-10-29 2013-07-10 汤姆逊许可公司 Method for generation of three-dimensional images encrusting a graphic object in the image and an associated display device
CN104052983A (en) * 2013-03-12 2014-09-17 辉达公司 Efficient autostereo support using display controller windows

Also Published As

Publication number Publication date
KR101362647B1 (en) 2014-02-12
US8508579B2 (en) 2013-08-13
US20090066785A1 (en) 2009-03-12
KR20090025836A (en) 2009-03-11
WO2009031872A3 (en) 2009-04-30
EP2183925A2 (en) 2010-05-12
EP2183925A4 (en) 2012-06-27

Similar Documents

Publication Publication Date Title
US8508579B2 (en) System and method for generating and reproducing 3D stereoscopic image file including 2D image
US9781403B2 (en) Method and apparatus for generating stereoscopic file
US8842903B2 (en) System and method for generating and reproducing image file including 2D image and 3D stereoscopic image
CN101388988B (en) Method for recording three-dimensional video data and computer readable medium recording the same
US20080252719A1 (en) Apparatus, method, and system for generating stereo-scopic image file based on media standards
AU2009210926B2 (en) Apparatus and method for generating and displaying media files
JP6320366B2 (en) System and method for generating and playing 3D stereoscopic video files based on 2D video media standards
US20080310762A1 (en) System and method for generating and regenerating 3d image files based on 2d image media standards
US20090199100A1 (en) Apparatus and method for generating and displaying media files
KR20090088772A (en) System and method for generating and playing image file for slide show
CA2707428C (en) System and method for generating and reproducing image file including 2d image and 3d stereoscopic image
KR20090026012A (en) Apparatus and method for generating stereoscopic files
KR101453084B1 (en) Portable terminal and method for generating and playing three dimensional image file
KR20080092810A (en) Apparatus and method for generating file of three dimensional images based on media standards and system thereof

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 08829834

Country of ref document: EP

Kind code of ref document: A2

REEP Request for entry into the european phase

Ref document number: 2008829834

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2008829834

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE