WO2009048254A1 - Osmu(one source multi use)-type stereoscopic camera and method of making stereoscopic video content thereof - Google Patents

Osmu(one source multi use)-type stereoscopic camera and method of making stereoscopic video content thereof Download PDF

Info

Publication number
WO2009048254A1
WO2009048254A1 PCT/KR2008/005897 KR2008005897W WO2009048254A1 WO 2009048254 A1 WO2009048254 A1 WO 2009048254A1 KR 2008005897 W KR2008005897 W KR 2008005897W WO 2009048254 A1 WO2009048254 A1 WO 2009048254A1
Authority
WO
WIPO (PCT)
Prior art keywords
separation
image
parallax
far point
stereoscopic
Prior art date
Application number
PCT/KR2008/005897
Other languages
French (fr)
Inventor
Youn-Woo Lee
Original Assignee
Stereopia Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Stereopia Co., Ltd. filed Critical Stereopia Co., Ltd.
Priority to MX2010003645A priority Critical patent/MX2010003645A/en
Priority to CA2701785A priority patent/CA2701785C/en
Priority to CN2008801140863A priority patent/CN101843107B/en
Priority to US12/734,017 priority patent/US8482600B2/en
Priority to BRPI0818500 priority patent/BRPI0818500A2/en
Priority to JP2010528799A priority patent/JP5572094B2/en
Priority to EP08836985.5A priority patent/EP2201785A4/en
Publication of WO2009048254A1 publication Critical patent/WO2009048254A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • H04N13/246Calibration of cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/67Focus control based on electronic image sensor signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • H04N13/239Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/296Synchronisation thereof; Control thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/144Processing image signals for flicker reduction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N2013/0074Stereoscopic image analysis
    • H04N2013/0081Depth or disparity estimation from stereoscopic image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2213/00Details of stereoscopic systems
    • H04N2213/002Eyestrain reduction by processing stereoscopic signals or controlling stereoscopic devices

Definitions

  • the present invention relates to a one source multi use (OSMU) type stereoscopic camera and a method of making stereoscopic video content, and more particularly to a stereoscopic camera and a method of making stereoscopic video content capable of providing stereoscopic video content that can be viewed on various sizes of 3D (three-dimensional) displays, such as cellular phones, display panels, personal computers, digital televisions, large movie screens, and so on, without eye fatigue.
  • OSMU one source multi use
  • a stereoscopic image may be generated by mixing left and right images having parallax.
  • an image having negative parallax appears to protrude out of the screen, and an image having positive parallax appears to be recessed into the screen in comparison with an image having zero parallax.
  • fusion processes of the eyes are varied according to parallaxes of images.
  • the images may be perceived to be located in front of or behind the screen so that an observer may experience eye fatigue, dizziness, headaches, and so on when the parallax exceeds a fusion range.
  • the images may not seem to be natural or realistic, and the observer may see a double image in serious cases.
  • the parallax of the stereoscopic image is varied based on the separation between left and right cameras and the distance from a lens to an object.
  • the stereoscopic image has generally been made by a conventional stereoscopic camera in consideration of a single 3D display platform.
  • stereoscopic images made for a large movie screen having a convergence distance over 10 m may not be suitable for small-size displays such as mobile handsets having a convergence distance under 30 cm.
  • stereoscopic images made for small-size displays cannot be displayed on a large movie screen having a long convergence distance. Because the stereoscopic images have been made as one source-one use type images, distribution of stereoscopic video content has been limited, and thus the various content business market has not been active.
  • the sizes of flat panel displays such as liquid crystal displays (LCDs) and plasma display panels (PDPs) have become larger.
  • the parallax of an object having a large horizontal width may exceed a convergence limit when the display size becomes extremely wide, not only in normal 2D (two-dimensional) viewing conditions but also in stereoscopic imaging.
  • the parallax may be easily distinguishable in the stereoscopic imaging, and thus the size of a display image has to be considered.
  • OSMU one source multi use
  • the present invention provides a stereoscopic camera and a method of making stereoscopic video content solving the problems mentioned above.
  • the present invention provides a stereoscopic camera providing stereoscopic images that provide a natural stereoscopic effect without eye fatigue regardless of viewing distance or screen size.
  • the present invention provides a method of making one source multi use (OSMU) type stereoscopic video content using the stereoscopic camera.
  • a stereoscopic camera includes left and right cameras, a separation adjustment unit, a critical parallax computing unit, a camera separation computing unit, an image storage unit.
  • the left and right cameras are aligned to have parallel optical axes.
  • the separation adjustment unit adjusts the separation between the left and right cameras.
  • the critical parallax computing unit adjusts the focus of a stereoscopic camera to an object and determines the far point of an image, the focus of which has been adjusted to the object, so that a maximum critical parallax is computed based on a far point limit parallax of a medium-size stereoscopic display.
  • the separation between optical axes in the stereoscopic camera is set to an arbitrary value.
  • the camera separation computing unit computes the separation between the parallel optical axes based on the computed critical parallax and drives the separation adjustment unit in response to the computed separation.
  • the image storage unit stores left and right images photographed by left and right cameras readjusted by the camera separation computing unit.
  • OSMU-type stereoscopic video content In OSMU-type stereoscopic video content, according to a method of making OSMU video content, the focus of a stereoscopic camera, of which parallel optical axes are set to an arbitrary value, is adjusted to an object. The far point of an image of which the focus has been adjusted to an object is determined. A maximum allowable critical parallax at the far point of the image based on a far point limit parallax of a medium-size stereoscopic display is computed. The separation between the parallel optical axes based on the computed critical parallax is readjusted. The object by the readjusted stereoscopic camera is photographed.
  • the medium-size stereoscopic display is preferably a desktop monitor having a size within a range of 17" to 24", which are among the most widespread types of monitors.
  • a far point limit parallax of the medium-size stereoscopic display may be approximately 2.79% of an optimal viewing distance. 2.79% corresponds to a maximum angle of 1.6 degrees until which stereoscopic images may converge for ordinary people who have not been trained to view stereoscopic images.
  • a stereoscopic camera according to a second example embodiment of the present invention includes left and right cameras, a sensor separation adjustment unit, a critical parallax computing unit, a camera separation computing unit, and an image storage unit. The left and right cameras are aligned to have parallel optical axes.
  • the sensor separation adjustment unit adjusts the separation between image sensors while the separation between the left and right cameras is fixed.
  • the critical parallax computing unit adjusts the focus of a stereoscopic camera to an object and determines the far point of an image, the focus of which has been adjusted to the object, so that a maximum critical parallax is computed based on a far point limit parallax of a medium-size stereoscopic display.
  • the separation between optical axes in the stereoscopic camera is set to an arbitrary value.
  • the camera separation computing unit computes the separation between the parallel optical axes based on the computed critical parallax and drives the sensor separation adjustment unit in response to the computed separation.
  • the image storage unit stores left and right images photographed by left and right cameras readjusted by the camera separation computing unit.
  • the separation between the parallel optical axes of image sensors is set to an arbitrary value.
  • the far point of an image of which the focus has been adjusted to the object is determined.
  • a maximum allowable critical parallax at the far point of the image is computed based on a far point limit parallax of a medium-size stereoscopic display.
  • the separation between the parallel optical axes is readjusted based on the computed critical parallax.
  • the object is photographed by the readjusted stereoscopic camera.
  • An OSMU-type stereoscopic camera includes left and right cameras, a critical parallax computing unit, a camera separation computing unit, and an image storage unit.
  • the left and right cameras include image sensors and wide lenses, each of the image sensors and wide lenses having a field of view (FOV) corresponding to a wide imaging area which is greater than a native imaging area. Parallel optical axes of the wide lenses are fixed.
  • FOV field of view
  • the critical parallax computing unit adjusts the focus of a stereoscopic camera with the fixed separation to an object and determines the far point of an image, the focus of which has been adjusted to the object, so that a maximum critical parallax is computed based on a far point limit parallax of a medium-size stereoscopic display.
  • the camera separation computing unit computes the separation between the parallel optical axes based on the computed critical parallax.
  • the image storage unit stores wide left and right images photographed by left and right cameras. During a read operation, the image storage unit outputs left and right display images in response to the separation computed by the camera separation computing unit.
  • an object is photographed by a stereoscopic camera set to have a fixed separation.
  • the stereoscopic camera includes image sensors and wide lenses, each of image sensors and wide lenses having the FOV corresponding to the wide imaging area which is greater than the native imaging area.
  • the photographed left and right images having wide imaging areas are stored.
  • the far point of an image of which the focus has been adjusted to the object is determined.
  • a maximum allowable critical parallax at the far point of the image is computed based on a far point limit parallax of a medium-size stereoscopic display.
  • An OSMU-type stereoscopic camera includes left and right cameras, a critical parallax computing unit, a camera separation computing unit, and an image storage unit.
  • the left and right cameras include image sensors and wide lenses, each of image sensors and wide lenses having the FOV corresponding to the wide imaging area which is greater than the native imaging area.
  • the wide imaging area is greater than a display image size and optical axes of the wide lenses are set to have a fixed separation.
  • the critical parallax computing unit adjusts the focus of the stereoscopic camera set to have the fixed separation to an object and determines the far point of an image of which the focus has been adjusted to the object. Therefore, the critical parallax computing unit computes a maximum critical parallax based on a far point limit parallax of a medium-size stereoscopic display.
  • the camera separation computing unit computes the separation between the parallel optical axes based on the computed critical parallax.
  • the image storage unit writes wide-area left and right images picked up by the left and right cameras. During a read operation, the image storage unit outputs left and right display images in response to the separation value computed by the camera separation unit.
  • an object is photographed by a stereoscopic camera set to have a fixed separation between cameras.
  • the stereoscopic camera includes image sensors and wide lenses, each of image sensors and wide lenses having the FOV corresponding to the wide imaging area which is greater than the native imaging area.
  • the far point of an image of which the focus has been adjusted to the object is determined and a maximum critical parallax at the far point of the image is computed based on a far point limit parallax of a medium-size stereoscopic display so that the separation between the cameras are computed based on the computed critical parallax.
  • An OSMU-type stereoscopic camera includes left and right cameras, a critical parallax computing unit, a camera separation computing unit, and an image storage unit.
  • the left and right cameras include image sensors and wide lenses, each of image sensors and wide lenses having the FOV corresponding to the wide imaging area which is greater than the native imaging area.
  • the wide imaging area is greater than a display image size and optical axes of the wide lenses being fixed parallel to each other.
  • the critical parallax computing unit adjusts the focus of the stereoscopic camera set to have the fixed separation to an object and determines the far point of an image of which the focus has been adjusted to the object.
  • the critical parallax computing unit computes a maximum critical parallax based on a far point limit parallax of a medium-size stereoscopic display.
  • the camera separation computing unit computes the separation between the parallel optical axes based on the computed critical parallax.
  • the image storage unit stores wide-area left and right images picked up by the left and right cameras.
  • the image sensors of the left and right cameras only output pixel data having a display size in response to the separation between the cameras computed.
  • an object is photographed by a stereoscopic camera set to have a fixed separation between cameras.
  • the stereoscopic camera includes image sensors and wide lenses, each of image sensors and wide lenses having the FOV corresponding to the wide imaging area which is greater than the native imaging area.
  • the far point of an image of which the focus has been adjusted to the photographed object is determined.
  • a maximum allowable critical parallax is computed based on a far point limit parallax of a medium-size stereoscopic display.
  • the separation between cameras is computed based on the computed critical parallax. Only pixel data having a display size is output from the image sensors and stored.
  • a desktop monitor may be the most widespread type of display among the small-size mobile handsets to the large movie screen.
  • the stereoscopic camera according to the present invention readjusts a camera separation of the stereoscopic camera based on a far point parallax of the desktop monitor. Thereafter, the stereoscopic camera may make OSMU-type stereoscopic video content by taking stereoscopic images.
  • FIG. 1 is a block diagram illustrating a one source multi use (OSMU) type stereoscopic camera according to an example embodiment of the present invention.
  • FIG. 2 is a diagram for describing a relation between a far point limit parallax of a stereoscopic display and a critical parallax of a stereoscopic camera.
  • OSMU one source multi use
  • FIG. 3 illustrates optical geometry between left and right cameras and an object.
  • FIG. 4 illustrates a geometry structure of left and right images photographed by image sensors and a mixed stereoscopic image on condition that the separation between cameras is an initial state.
  • FIG. 5 illustrates a geometry structure of left and right images photographed by image sensors and a mixed stereoscopic image on condition that the separation between cameras is readjusted.
  • FIG. 6 is a block diagram illustrating an OSMU-type stereoscopic camera according to another example embodiment of the present invention.
  • FIG. 7 is a block diagram illustrating an OSMU-type stereoscopic camera according to a modified example embodiment.
  • FIG. 8 is a block diagram illustrating still another example embodiment of the OSMU-type stereoscopic camera.
  • FIG. 9 is a diagram for describing an example of FIG. 8.
  • FIG. 10 is a block diagram illustrating a fourth example embodiment of the OSMU-type stereoscopic camera.
  • FIG. 11 is a diagram for describing an address generating operation of the address generating unit in FIG. 10.
  • FIG. 12 is a block diagram illustrating still another example embodiment of an OSMU-type stereoscopic camera.
  • FIG. 13 is a diagram for describing a pixel data output operation of image sensors in FIG. 12.
  • FIG. 1 is a block diagram illustrating a one source multi use (OSMU) type stereoscopic camera according to a first example embodiment of the present invention.
  • a stereoscopic camera 100 may include a camera unit 110, a critical parallax computing unit 120, a camera separation computing unit 130, an image storage unit 140, and an image mixing unit 150.
  • OSMU one source multi use
  • the camera unit 110 may include a left camera 112, a right camera 114, and a separation adjustment unit 116.
  • the left and right cameras 112 and 114 are aligned parallel with each other on the separation adjustment unit 116.
  • the left and right cameras 112 and 114 move in a direction perpendicular to optical axes, that is, left and right directions, and thus the separation between the left and right cameras 112 and 114 may be varied.
  • the left camera 112 may include a lens L L and an image sensor S L arranged on a common optical axis.
  • the right camera 112 may include a lens L R and an image sensor S R arranged on a common optical axis.
  • the image sensors S L and S R may be charge-coupled device (CCD) image sensors or complimentary metal oxide semiconductor (CMOS) image sensors.
  • CCD charge-coupled device
  • CMOS complimentary metal oxide semiconductor
  • the critical parallax computing unit 120 adjusts the focus of a stereoscopic camera, of which the separation between the parallel optical axes is the set to an arbitrary value, to an object.
  • the critical parallax computing unit 120 determines the far point of an image and computes a critical parallax based on a far point limit parallax of a stereoscopic display having medium size.
  • FIG. 2 is a diagram illustrating a relation between a far point limit parallax of a stereoscopic display and a critical parallax of a stereoscopic camera.
  • a far point limit parallax P D of a screen of the stereoscopic display based on a tan (1.6) value of a convergence distance Z v .
  • An ordinary person who has not been trained for viewing stereoscopic images may generally perceive images having parallax to a maximum angle of 1.6 degrees, which is half of a maximum value of retinal disparity obtained from an actual screen. Thus, eye fatigue symptoms and headaches may be reduced when a screen parallax is limited to half of the retinal disparity.
  • TABLE 1 represents a limit parallax according to a convergence distance.
  • TABLE 1. Far point limit parallax of stereoscopic display
  • the far point limit parallax based on the medium-size display such as a desktop monitor having a size within a range of 17" to 24".
  • the medium-size desktop monitor may have a shortest convergence distance according to a display size as represented in TABLE 2. Therefore, the medium-size desktop monitor may be under the most unfavorable conditions because of the greatest field of view (FOV).
  • FOV field of view
  • Equation 1 The far point limit parallax (PQ) may be derived from Equation 1.
  • Equation 2 P 8 denotes a critical parallax at the far point of an image sensor, W s denotes the horizontal width of the image sensor, P D denotes a far point limit parallax of the medium-size display, and W D denotes the horizontal width of the display.
  • the camera separation computing unit 130 computes the separation between the parallel optical axes based on the computed critical parallax P s and drives a separation adjustment unit 160 in response to the computed separation to adjust the separation between the left and right cameras C c .
  • FIG. 3 is a diagram illustrating an optical geometry between the left and right cameras 112 and 114 in the camera unit 110 and the object.
  • AX L optical axis of a left lens
  • AX R optical axis of a right lens Z 0 : distance in a straight line between the center of a lens and a convergence point Oz (zero parallax distance)
  • Cp distance between the centers of far point left and right images photographed by the image sensors S L and S R (separation between the centers of left and right far point limit parallax images)
  • W 8 horizontal width between the image sensors S L and S R
  • Equation 4 Equation 4
  • Equation 5 is represented as follows.
  • Equation 6 Parallax between the left and right images corresponding to the far point is represented by Equation 6.
  • Equation 3 may be derived by solving Equation 6.
  • the image storage unit 140 stores the respective left and right images photographed by the stereoscopic camera of which the separation between the cameras is readjusted based on Equation 3.
  • the image mixing unit 150 respectively shifts the left and right images stored in the image storage unit 140 in the left and right directions so that zero parallaxes of the images converge by overlapping. Thereafter, the image mixing unit 150 mixes the overlapped image with the stereoscopic image having parallax. The mixed stereoscopic image is shown on a stereoscopic display.
  • FIG. 4 illustrates a geometry structure of left and right images photographed by image sensors and a mixed stereoscopic image on condition that the separation between cameras is an initial state.
  • FIG. 5 illustrates a geometry structure of left and right images photographed by image sensors and a mixed stereoscopic image on condition that the separation between cameras is readjusted according to the present invention.
  • FIG. 6 is a block diagram illustrating an OSMU-type stereoscopic camera according to a second example embodiment of the present invention.
  • the OSMU-type stereoscopic camera according to the second example embodiment independently adjusts separations between lenses and image sensors of a camera unit in compare with the OSMU-type stereoscopic camera according to the first example embodiment.
  • a stereoscopic camera 200 may include a camera unit 210, a critical parallax computing unit 220, a camera separation computing unit 230, an image storage unit 240, and an image mixing unit 250.
  • the camera unit 210 may include a left camera 212, a right camera 214, a camera separation adjustment unit 216, and a sensor separation adjustment unit 218.
  • the left and right cameras 212 and 214 are aligned parallel with each other on the camera separation adjustment unit 216.
  • the left and right cameras 212 and 214 may move in the directions perpendicular to optical axes, that is, left and right directions so that the separation between the left and right cameras 212 and 214 may be adjusted.
  • the right camera 212 may include an image sensor S L which may move in the directions perpendicular to the optical axis of a lens L L .
  • the left camera 214 may include an image sensor S R which may move in the directions perpendicular to the optical axis of a lens L R .
  • the left and right image sensors S L and S R are aligned parallel with each other on the sensor separation adjustment unit 218 so that the separation between the left and right image sensors S L and S R are adjusted with each other.
  • the critical parallax computing unit 220 adjusts the focus of the stereoscopic camera to an object and determines the far point of an image, of which the focus has been adjusted to the object, to compute a maximum allowable critical parallax at the far point of the image based on a far point limit parallax of the medium-size stereoscopic display.
  • the separation between the image sensors S L and S R is set to an arbitrary value.
  • the camera separation computing unit 230 computes the separation between the image sensors S L and S R based on the computed critical parallax and drives the sensor separation adjustment unit 218 in response to the computed separation.
  • the camera separation computing unit 230 may adjust the separation between the lenses by driving the camera separation adjustment unit 216.
  • the image storage unit 240 respectively stores left and right images photographed by the stereoscopic camera of which the separation is readjusted based on Equation 3.
  • the image mixing unit 250 respectively shifts the left and right images stored in the image storage unit 240 so that zero parallaxes of the images converge by overlapping.
  • the image mixing unit 250 mixes the overlapped images with the stereoscopic image having the parallax.
  • the mixed stereoscopic image is shown on the stereoscopic display.
  • the separation between the left and right image sensors S L and S R aligned with parallel optical axes is set to an arbitrary value.
  • the focus of the stereoscopic camera including the left and right image sensors S L and S R is adjusted to the object so that the far point of the image, of which the focus has been adjusted to the object, is determined.
  • a maximum allowable critical parallax at the far point of the image is computed based on the far point limit parallax of the medium-size stereoscopic display.
  • the separation between the left and right image sensors S L and S R is readjusted based on the computed critical parallax.
  • the stereoscopic camera with the readjusted image sensors photographs the object so that OSMU-type stereoscopic video content may be made.
  • FIG. 7 is a block diagram illustrating an OSMU-type stereoscopic camera according to a modified example embodiment. Compared to the second example embodiment, image sensors are fixed and lenses move in the left and right directions with reference to FIG. 7.
  • a stereoscopic camera 300 may include a camera unit 310, a critical parallax computing unit 320, a camera separation computing unit 330, an image storage unit 340, and an image mixing unit 350.
  • the camera unit 310 may include a left camera 312, a right camera 314, a camera separation adjustment unit 316, and a lens separation adjustment unit 318.
  • the left and right cameras 312 and 314 are aligned parallel with each other on the camera separation adjustment unit 316 and able to move in perpendicular to optical axes, that is, the left and right directions so that the separation between the left and right cameras 312 and 314 may be adjusted.
  • the left camera 312 may include a lens L L which may move to the left and right in the directions perpendicular to the optical axis of the image sensor S L .
  • the right camera 312 may include a lens L R which may move to the left and right in the directions perpendicular to the optical axis of the image sensor S R .
  • the left and right lenses L L and L R are aligned parallel with each other on the lens separation adjustment unit 318 so that the separation between the left and right lenses L L and L R may be adjusted with respect to each other.
  • the critical parallax computing unit 320 adjusts the focus of the stereoscopic camera, of which the lenses L L and L R have been set to an arbitrary value, to an object.
  • the critical parallax computing unit 320 determines the far point of an image of which the focus has been adjusted to the object. Therefore, the critical parallax computing unit 320 may compute a maximum allowable critical parallax at the far point of the image based on a far point limit parallax of the medium-size stereoscopic display.
  • the camera separation computing unit 330 computes the separation between the lenses L L and L R based on the computed critical parallax and drives the lens separation adjustment unit 318 in response to the computed separation.
  • the camera separation computing unit 330 may adjust the separation between the sensors S L and S R by driving the camera separation adjustment unit 316.
  • the image storage unit 340 stores left and right images photographed by the stereoscopic camera of which the separation between the cameras has been readjusted based on Equation 3.
  • the image mixing unit 350 respectively shifts the left image and right images stored in the image storage unit 340 in the left and right directions such that zero parallaxes of the images converge by overlapping. Thereafter, the image mixing unit 350 mixes the overlapped images with the stereoscopic image having parallax.
  • the mixed stereoscopic image is shown on a stereoscopic display.
  • the separation between the left and right lenses L L and L R aligned with parallel optical axes is set to an arbitrary value.
  • the stereoscopic camera including the left and right lenses L L and L R adjusts the focus to the object and determines the far point of the image of which the focus has been adjusted to the object. Thereafter, the maximum allowable critical parallax at the far point of the image is computed based on the far point limit parallax of the medium-size stereoscopic display. The separation between the left and right lenses L L and L R is readjusted based on the computed critical parallax. The stereoscopic camera with the readjusted lenses photographs the object so that OSMU-type stereoscopic video content may be made.
  • FIG. 8 is a block diagram illustrating a third example embodiment of the OSMU-type stereoscopic camera.
  • the stereoscopic camera 400 may include a camera unit 410, a critical parallax computing unit 420, a camera separation computing unit 430, an image storage unit 440, and an image mixing unit 450.
  • the camera unit 410 may include a left camera 412 and a right camera 414.
  • the left and right cameras 412 and 414 are aligned parallel with each other.
  • the left and right cameras 412 and 414 respectively include left and right wide image sensors WS L and WS R and left and right wide lenses WL L and WL R .
  • the sizes of the left and right wide image sensors WS L and WS R and left and right wide lenses WL L and WL R are greater than the above-mentioned left and right image sensors S L and S R and lenses L L and L R such that the sizes of the left and right wide image sensors WS L and WS R and left and right wide lenses WL L and WL R may include maximum allowable moving distances of the left and right image sensors S L and S R and lenses L L and L R .
  • the left and right wide image sensors WS L and WS R may have a wide FOV which corresponds to a wide imaging area W w xH w .
  • the wide imaging area W W X H W is greater than a display imaging area W O X H O .
  • the display imaging area W O X H O may corresponds to a native imaging area.
  • the critical parallax computing unit 420 adjusts the focus of the stereoscopic camera which has a fixed separation between the left and right cameras and determines the far point of an image of which the focus has been adjusted to an object.
  • the critical parallax computing unit 420 computes a maximum allowable critical parallax at the far point of the image based on a far point limit parallax of the medium-size stereoscopic display.
  • the camera separation computing unit 430 computes the separation between virtual cameras based on the computed critical parallax.
  • the image storage unit 440 may include an address generating unit 442, a left image storage unit 444, and a right image storage unit 446.
  • the left and right image storage units 444 and 446 may have large storage capacities such that the left and right image storage units 444 and 446 may store the wide imaging area
  • the address generating unit 442 generates write addresses to respectively store left and right images photographed by the stereoscopic camera as the size of the wide imaging area Ww ⁇ H w in the left and right image storage unit 444 and 446 as the originally photographed size.
  • the address generating unit 442 When the address generating unit 442 reads the stored image data from the left and right image storage units 444 and 446, the address generating unit 442 respectively generates left and right image read addresses (L(i-(cc-co)/2)j, L(i+ wo- (cc-co)/2)G+HO)) and (R(i+(cc-co)/2)j, R (i+wo+ ( CC-CO )/ 2 )( j + H O)) by shifting to left and right directions as much as the readjusted separation Cc between the cameras in response to the separation which is computed by the camera separation computing unit 430. Therefore, a shaded portion in FIG. 9 is read as the read image data.
  • the image mixing unit 450 respectively shifts the left and right images read from the image storage unit 430 to the left and right directions so that zero parallaxes of the left and right images converge by overlapping.
  • the overlapped image is mixed with the stereoscopic image having the parallax and the mixed stereoscopic image is shown on the stereoscopic display.
  • FIG. 10 is a block diagram illustrating a fourth example embodiment of the OSMU-type stereoscopic camera and FIG. 11 is a diagram for describing an address generating operation of the address generating unit in FIG. 10.
  • a stereoscopic camera 500 of the fourth example embodiment may include a camera unit 510, a critical parallax computing unit 520, a camera separation computing unit 530, an image storage unit 540, and an image mixing unit 550.
  • the camera unit 510 may include left and right cameras 512 and 514.
  • the left and right cameras 512 and 514 are aligned parallel with each other in fixed locations.
  • the left and right cameras 512 and 514 respectively include left and right wide image sensors WS L an d WS R and left and right wide lenses WL L and WL R .
  • the sizes of the left and right wide image sensors WS L and WS R and left and right wide lenses WL L and WL R are greater than the above-mentioned left and right image sensors S L and S R and lenses L L and L R in the first and second example embodiments such that the sizes of the left and right wide image sensors WS L and WS R and left and right wide lenses WL L and WL R may include the maximum allowable moving distance of the left and right image sensors S L and S R and lenses L L and L R .
  • the left and right wide image sensors WS L and WS R may have the wide FOV corresponding to the wide imaging area W w ⁇ H w which is greater than the display imaging area W o ⁇ H o .
  • the critical parallax computing unit 520 adjusts the focus of a stereoscopic camera including fixed cameras to an object and determines the far point of an image of which the focus has been adjusted to the object.
  • the critical parallax computing unit 520 computes a maximum allowable critical parallax at the far point of the image based on a far point limit parallax of the medium-size stereoscopic display.
  • the camera separation computing unit 530 computes the separation between virtual cameras based on the computed critical parallax.
  • the image storage unit 540 may include an address generating unit 542, a left image storage unit 544, and a right image storage unit 546.
  • the left and right image storage units 544 and 546 may have large storage capacities such as the wide imaging area W W X H W corresponding to the size of the wide image sensors
  • WS L and WS R may be storable.
  • the address generating unit 542 receives left and right sync signals Sync L (L_Sync L , FJSync L ) and Sync R (L_Sync R , F_Sync R ) from the left and right image sensors WS L and WS R .
  • the address generating unit 542 generates X address valid signals X_Valid L and X_Valid R and Y address valid signals Y_Valid L and Y_Valid R in response to the readjusted separation between cameras Cc computed by the camera separation computing unit 530 with reference to FIG. 11.
  • the address generating unit 542 generates signals which are in a valid region (a shaded region) of Y addresses Y_Addr L and Y_Addr R and X addresses X_Addr L and X_Addr R stored in the image storage unit 540 as valid addresses in response to the generated X address valid signal X Valid L and X_Valid R and Y address valid signal Y_Valid L and Y_Valid R . Therefore, the left and right image storage units 544 and 546 store pixel data in the valid addresses represented in a restricted region that is the shaded region with reference to FIG. 11. Because the stored data restricted within the shaded region is read during a read operation, the left and right images having sizes of the shaded region are read and provided to the image mixing unit 550.
  • the image mixing unit 550 respectively shifts the left and right images read from the image storage unit 540 and adjusts zero parallaxes with each other by overlapping so that the overlapped image is mixed with a stereoscopic image having parallax.
  • the mixed stereoscopic image is shown on the stereoscopic display.
  • FIG. 12 is a block diagram illustrating a fifth example embodiment of an OSMU-type stereoscopic camera and FIG. 13 is a diagram for describing an output operation of pixel data of image sensors in FIG. 12.
  • a stereoscopic camera 600 may include a camera unit 610, a critical parallax computing unit 620, a camera separation computing unit 630, an image storage unit 640, and an image mixing unit 650.
  • the camera unit 610 may include a left camera 612 and a right camera
  • the left and right cameras 612 and 614 are aligned parallel with each other in fixed locations.
  • the left and right camera 612 and 614 includes left and right wide image sensors WS L and WS R and left and right wide lenses WL L and WL R .
  • the sizes of the left and right wide image sensors WS L and WS R and left and right wide lenses WL L an d WL R are greater than the above-mentioned left and right image sensors S L and S R and lenses L L and L R of the first and second example embodiments by means of including a maximum allowable moving distance of the left and right image sensors S L and S R and lenses L L and L R .
  • the left and right wide image sensors WS L and WS R may have the FOV corresponding to the wide imaging area W w ⁇ H w which is greater than the display imaging area W o ⁇ H o .
  • the wide image sensors WS L and WS R output wide imaging area-size W w ⁇ H w pixel data in response to line valid signals L_Valid L and L_Valid R and frame valid signals F_Valid L and F_Valid R as illustrated in FIG. 13.
  • the wide image sensors WS L and WS R of the fifth example embodiment output display imaging area display-size Wo ⁇ Ho pixel data in response to adjusted line valid signals CL_Valid L and CL_Valid R and adjusted frame valid signals CF Valid L and CF_Valid R as illustrated in FIG. 13.
  • the adjusted line valid signals CL_Valid L and CL_Valid R and adjusted frame valid signals CF_Valid L and CF_Valid R are generated in response to a separation computed by the camera separation computing unit 630.
  • a valid section of a pixel clock signal PC is adjusted by the adjusted line valid signals CL_Valid L and CL_Valid R so that only pixel data corresponding to the valid section in a first line is output as valid line data.
  • a valid section of adjusted line valid signals CL_Valid L and CL_Valid R is adjusted by the adjusted frame valid signals CF_Valid L and CF_Valid R so that only line data corresponding to the valid section in a first frame is output as valid frame data.
  • the critical parallax computing unit 620 adjusts the stereoscopic camera having a fixed separation between cameras to an object and determines the far point of an image of which the focus has been adjusted to the object.
  • the critical parallax computing unit 620 computes a maximum allowable critical parallax at the far point of the image based on the far point limit parallax of medium-size stereoscopic display.
  • the camera separation computing unit 630 computes the separation between virtual cameras based on the computed critical parallax.
  • the image storage unit 640 receives the left and right images output from the image sensors and stores the received left and right images.
  • the image mixing unit 650 respectively shifts the left and right images stored in the image storage unit 640 to converge the zero parallax of each image by overlapping the left and right images.
  • the overlapped image is mixed with the stereoscopic image having the parallax.
  • the mixed stereoscopic image is shown on the stereoscopic display.
  • the stereoscopic image made by the example embodiments of the present invention may be viewed on various display sizes, such as mobile cell phones, desktop monitors, televisions, large-screen projection televisions, and movie screens so that the stereoscopic video content market may be expanded.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Stereoscopic And Panoramic Photography (AREA)
  • Cameras In General (AREA)

Abstract

A one source multi use (OSMU)-type stereoscopic camera is disclosed. The stereoscopic camera includes left and right cameras of which lenses are aligned with parallel optical axes, a separation adjustment unit for adjusting the separation between the cameras, a critical parallax computing unit, a camera separation computing unit, and an image storage unit. The critical parallax computing unit adjusts the focus of the stereoscopic camera to an object and determines the far point of an image so that a maximum critical parallax is computed based on a far point limit parallax of a medium-size display. The camera separation computing unit computes the separation between the optical axes based on the computed critical parallax and drives the separation adjustment unit. The image storage unit stores images photographed by the readjusted cameras. Therefore, stereoscopic video made according to the present invention may be viewed on various sizes of displays.

Description

OSMU (ONE SOURCE MULTI USE)-TYPE STEREOSCOPIC CAMERA AND METHOD OFMAKING STEREOSCOPIC VIDEO CONTENT
THEREOF
Technical Field
The present invention relates to a one source multi use (OSMU) type stereoscopic camera and a method of making stereoscopic video content, and more particularly to a stereoscopic camera and a method of making stereoscopic video content capable of providing stereoscopic video content that can be viewed on various sizes of 3D (three-dimensional) displays, such as cellular phones, display panels, personal computers, digital televisions, large movie screens, and so on, without eye fatigue.
Background Art A stereoscopic image may be generated by mixing left and right images having parallax. In the stereoscopic image displayed on a screen, an image having negative parallax appears to protrude out of the screen, and an image having positive parallax appears to be recessed into the screen in comparison with an image having zero parallax. In reality, even though eye focus is adjusted to the screen, fusion processes of the eyes are varied according to parallaxes of images. Thus, the images may be perceived to be located in front of or behind the screen so that an observer may experience eye fatigue, dizziness, headaches, and so on when the parallax exceeds a fusion range. Moreover, the images may not seem to be natural or realistic, and the observer may see a double image in serious cases.
The parallax of the stereoscopic image is varied based on the separation between left and right cameras and the distance from a lens to an object.
The stereoscopic image has generally been made by a conventional stereoscopic camera in consideration of a single 3D display platform. Thus, stereoscopic images made for a large movie screen having a convergence distance over 10 m may not be suitable for small-size displays such as mobile handsets having a convergence distance under 30 cm. Conversely, stereoscopic images made for small-size displays cannot be displayed on a large movie screen having a long convergence distance. Because the stereoscopic images have been made as one source-one use type images, distribution of stereoscopic video content has been limited, and thus the various content business market has not been active.
Recently, the sizes of flat panel displays such as liquid crystal displays (LCDs) and plasma display panels (PDPs) have become larger. However, the parallax of an object having a large horizontal width may exceed a convergence limit when the display size becomes extremely wide, not only in normal 2D (two-dimensional) viewing conditions but also in stereoscopic imaging. In addition, the parallax may be easily distinguishable in the stereoscopic imaging, and thus the size of a display image has to be considered.
However, a one source multi use (OSMU) type stereoscopic image which is suitable for a small-size display of 2" to a large movie screen for a theater has not been made until now.
Disclosure of the Invention Technical Problem
The present invention provides a stereoscopic camera and a method of making stereoscopic video content solving the problems mentioned above. The present invention provides a stereoscopic camera providing stereoscopic images that provide a natural stereoscopic effect without eye fatigue regardless of viewing distance or screen size.
In addition, the present invention provides a method of making one source multi use (OSMU) type stereoscopic video content using the stereoscopic camera. Technical Solution
To accomplish the goal mentioned above, a stereoscopic camera according to an example embodiment of the present invention includes left and right cameras, a separation adjustment unit, a critical parallax computing unit, a camera separation computing unit, an image storage unit. The left and right cameras are aligned to have parallel optical axes. The separation adjustment unit adjusts the separation between the left and right cameras. The critical parallax computing unit adjusts the focus of a stereoscopic camera to an object and determines the far point of an image, the focus of which has been adjusted to the object, so that a maximum critical parallax is computed based on a far point limit parallax of a medium-size stereoscopic display. The separation between optical axes in the stereoscopic camera is set to an arbitrary value. The camera separation computing unit computes the separation between the parallel optical axes based on the computed critical parallax and drives the separation adjustment unit in response to the computed separation. The image storage unit stores left and right images photographed by left and right cameras readjusted by the camera separation computing unit.
In OSMU-type stereoscopic video content, according to a method of making OSMU video content, the focus of a stereoscopic camera, of which parallel optical axes are set to an arbitrary value, is adjusted to an object. The far point of an image of which the focus has been adjusted to an object is determined. A maximum allowable critical parallax at the far point of the image based on a far point limit parallax of a medium-size stereoscopic display is computed. The separation between the parallel optical axes based on the computed critical parallax is readjusted. The object by the readjusted stereoscopic camera is photographed.
The medium-size stereoscopic display is preferably a desktop monitor having a size within a range of 17" to 24", which are among the most widespread types of monitors. A far point limit parallax of the medium-size stereoscopic display may be approximately 2.79% of an optimal viewing distance. 2.79% corresponds to a maximum angle of 1.6 degrees until which stereoscopic images may converge for ordinary people who have not been trained to view stereoscopic images. A stereoscopic camera according to a second example embodiment of the present invention includes left and right cameras, a sensor separation adjustment unit, a critical parallax computing unit, a camera separation computing unit, and an image storage unit. The left and right cameras are aligned to have parallel optical axes. The sensor separation adjustment unit adjusts the separation between image sensors while the separation between the left and right cameras is fixed. The critical parallax computing unit adjusts the focus of a stereoscopic camera to an object and determines the far point of an image, the focus of which has been adjusted to the object, so that a maximum critical parallax is computed based on a far point limit parallax of a medium-size stereoscopic display. The separation between optical axes in the stereoscopic camera is set to an arbitrary value. The camera separation computing unit computes the separation between the parallel optical axes based on the computed critical parallax and drives the sensor separation adjustment unit in response to the computed separation. The image storage unit stores left and right images photographed by left and right cameras readjusted by the camera separation computing unit.
In OSMU-type stereoscopic video content, according to a second example embodiment of a method of making OSMU video content, the separation between the parallel optical axes of image sensors is set to an arbitrary value. The far point of an image of which the focus has been adjusted to the object is determined. A maximum allowable critical parallax at the far point of the image is computed based on a far point limit parallax of a medium-size stereoscopic display. The separation between the parallel optical axes is readjusted based on the computed critical parallax. The object is photographed by the readjusted stereoscopic camera. An OSMU-type stereoscopic camera according to a third example embodiment of the present invention includes left and right cameras, a critical parallax computing unit, a camera separation computing unit, and an image storage unit. The left and right cameras include image sensors and wide lenses, each of the image sensors and wide lenses having a field of view (FOV) corresponding to a wide imaging area which is greater than a native imaging area. Parallel optical axes of the wide lenses are fixed. The critical parallax computing unit adjusts the focus of a stereoscopic camera with the fixed separation to an object and determines the far point of an image, the focus of which has been adjusted to the object, so that a maximum critical parallax is computed based on a far point limit parallax of a medium-size stereoscopic display. The camera separation computing unit computes the separation between the parallel optical axes based on the computed critical parallax. The image storage unit stores wide left and right images photographed by left and right cameras. During a read operation, the image storage unit outputs left and right display images in response to the separation computed by the camera separation computing unit.
In OSMU-type stereoscopic video content, according to a third example embodiment of a method of making OSMU video content, an object is photographed by a stereoscopic camera set to have a fixed separation. The stereoscopic camera includes image sensors and wide lenses, each of image sensors and wide lenses having the FOV corresponding to the wide imaging area which is greater than the native imaging area. The photographed left and right images having wide imaging areas are stored. The far point of an image of which the focus has been adjusted to the object is determined. A maximum allowable critical parallax at the far point of the image is computed based on a far point limit parallax of a medium-size stereoscopic display. Display image read addresses from the stored wide imaging area images are reset in response to the computed separation based on the computed critical parallax. Left and right display images are read in response to the reset read addresses. An OSMU-type stereoscopic camera according to a fourth example embodiment includes left and right cameras, a critical parallax computing unit, a camera separation computing unit, and an image storage unit. The left and right cameras include image sensors and wide lenses, each of image sensors and wide lenses having the FOV corresponding to the wide imaging area which is greater than the native imaging area. The wide imaging area is greater than a display image size and optical axes of the wide lenses are set to have a fixed separation. The critical parallax computing unit adjusts the focus of the stereoscopic camera set to have the fixed separation to an object and determines the far point of an image of which the focus has been adjusted to the object. Therefore, the critical parallax computing unit computes a maximum critical parallax based on a far point limit parallax of a medium-size stereoscopic display. The camera separation computing unit computes the separation between the parallel optical axes based on the computed critical parallax. The image storage unit writes wide-area left and right images picked up by the left and right cameras. During a read operation, the image storage unit outputs left and right display images in response to the separation value computed by the camera separation unit.
In OSMU-type stereoscopic video content, according to a fourth example embodiment of a method of making OSMU video content, an object is photographed by a stereoscopic camera set to have a fixed separation between cameras. The stereoscopic camera includes image sensors and wide lenses, each of image sensors and wide lenses having the FOV corresponding to the wide imaging area which is greater than the native imaging area. The far point of an image of which the focus has been adjusted to the object is determined and a maximum critical parallax at the far point of the image is computed based on a far point limit parallax of a medium-size stereoscopic display so that the separation between the cameras are computed based on the computed critical parallax. Display-size left and right images are stored among the wide area images in response to the computed separation between the cameras. An OSMU-type stereoscopic camera according to a fifth example embodiment includes left and right cameras, a critical parallax computing unit, a camera separation computing unit, and an image storage unit. The left and right cameras include image sensors and wide lenses, each of image sensors and wide lenses having the FOV corresponding to the wide imaging area which is greater than the native imaging area. The wide imaging area is greater than a display image size and optical axes of the wide lenses being fixed parallel to each other. The critical parallax computing unit adjusts the focus of the stereoscopic camera set to have the fixed separation to an object and determines the far point of an image of which the focus has been adjusted to the object. Therefore, the critical parallax computing unit computes a maximum critical parallax based on a far point limit parallax of a medium-size stereoscopic display. The camera separation computing unit computes the separation between the parallel optical axes based on the computed critical parallax. The image storage unit stores wide-area left and right images picked up by the left and right cameras. The image sensors of the left and right cameras only output pixel data having a display size in response to the separation between the cameras computed.
In OSMU-type stereoscopic video content, according to a fifth example embodiment of a method of making OSMU video content, an object is photographed by a stereoscopic camera set to have a fixed separation between cameras. The stereoscopic camera includes image sensors and wide lenses, each of image sensors and wide lenses having the FOV corresponding to the wide imaging area which is greater than the native imaging area. The far point of an image of which the focus has been adjusted to the photographed object is determined. A maximum allowable critical parallax is computed based on a far point limit parallax of a medium-size stereoscopic display. The separation between cameras is computed based on the computed critical parallax. Only pixel data having a display size is output from the image sensors and stored. Advantageous Effects A desktop monitor may be the most widespread type of display among the small-size mobile handsets to the large movie screen. As described above, the stereoscopic camera according to the present invention readjusts a camera separation of the stereoscopic camera based on a far point parallax of the desktop monitor. Thereafter, the stereoscopic camera may make OSMU-type stereoscopic video content by taking stereoscopic images.
Brief Description of the Drawings
FIG. 1 is a block diagram illustrating a one source multi use (OSMU) type stereoscopic camera according to an example embodiment of the present invention. FIG. 2 is a diagram for describing a relation between a far point limit parallax of a stereoscopic display and a critical parallax of a stereoscopic camera.
FIG. 3 illustrates optical geometry between left and right cameras and an object.
FIG. 4 illustrates a geometry structure of left and right images photographed by image sensors and a mixed stereoscopic image on condition that the separation between cameras is an initial state.
FIG. 5 illustrates a geometry structure of left and right images photographed by image sensors and a mixed stereoscopic image on condition that the separation between cameras is readjusted. FIG. 6 is a block diagram illustrating an OSMU-type stereoscopic camera according to another example embodiment of the present invention.
FIG. 7 is a block diagram illustrating an OSMU-type stereoscopic camera according to a modified example embodiment.
FIG. 8 is a block diagram illustrating still another example embodiment of the OSMU-type stereoscopic camera.
FIG. 9 is a diagram for describing an example of FIG. 8.
FIG. 10 is a block diagram illustrating a fourth example embodiment of the OSMU-type stereoscopic camera.
FIG. 11 is a diagram for describing an address generating operation of the address generating unit in FIG. 10.
FIG. 12 is a block diagram illustrating still another example embodiment of an OSMU-type stereoscopic camera.
FIG. 13 is a diagram for describing a pixel data output operation of image sensors in FIG. 12. Hereinafter, embodiments according to the present invention will be described more fully with reference to the accompanying drawings. These embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.
Best Mode for Carrying Out the Invention
FIG. 1 is a block diagram illustrating a one source multi use (OSMU) type stereoscopic camera according to a first example embodiment of the present invention. Referring to FIG. 1, a stereoscopic camera 100 may include a camera unit 110, a critical parallax computing unit 120, a camera separation computing unit 130, an image storage unit 140, and an image mixing unit 150.
The camera unit 110 may include a left camera 112, a right camera 114, and a separation adjustment unit 116. The left and right cameras 112 and 114 are aligned parallel with each other on the separation adjustment unit 116. The left and right cameras 112 and 114 move in a direction perpendicular to optical axes, that is, left and right directions, and thus the separation between the left and right cameras 112 and 114 may be varied. The left camera 112 may include a lens LL and an image sensor SL arranged on a common optical axis. The right camera 112 may include a lens LR and an image sensor SR arranged on a common optical axis. The image sensors SL and SR may be charge-coupled device (CCD) image sensors or complimentary metal oxide semiconductor (CMOS) image sensors.
The critical parallax computing unit 120 adjusts the focus of a stereoscopic camera, of which the separation between the parallel optical axes is the set to an arbitrary value, to an object. The critical parallax computing unit 120 determines the far point of an image and computes a critical parallax based on a far point limit parallax of a stereoscopic display having medium size.
FIG. 2 is a diagram illustrating a relation between a far point limit parallax of a stereoscopic display and a critical parallax of a stereoscopic camera.
Referring to FIG. 2, a far point limit parallax PD of a screen of the stereoscopic display based on a tan (1.6) value of a convergence distance Zv. An ordinary person who has not been trained for viewing stereoscopic images may generally perceive images having parallax to a maximum angle of 1.6 degrees, which is half of a maximum value of retinal disparity obtained from an actual screen. Thus, eye fatigue symptoms and headaches may be reduced when a screen parallax is limited to half of the retinal disparity.
TABLE 1 represents a limit parallax according to a convergence distance. TABLE 1. Far point limit parallax of stereoscopic display
Figure imgf000012_0001
In order to view one source of stereoscopic image content in all sizes of stereoscopic displays, the far point limit parallax based on the medium-size display, such as a desktop monitor having a size within a range of 17" to 24".
The medium-size desktop monitor may have a shortest convergence distance according to a display size as represented in TABLE 2. Therefore, the medium-size desktop monitor may be under the most unfavorable conditions because of the greatest field of view (FOV).
Figure imgf000013_0001
With reference to TABLE 2, a standard convergence distance is 46 cm when using a 19" display. The far point limit parallax (PQ) may be derived from Equation 1.
[Equation 1]
PD = 0.46 mχθ.0279 = 0.0128 m
When the standard convergence distance is 50 cm, the far point limit parallax is derived as 0.0140 m in a 24" display. An allowable critical parallax, that is, a critical parallax under unfavorable display watching conditions, may be derived from Equation 2. [Equation 2] Ps = PD χ(Ws/WD)
In Equation 2, P8 denotes a critical parallax at the far point of an image sensor, Ws denotes the horizontal width of the image sensor, PD denotes a far point limit parallax of the medium-size display, and WD denotes the horizontal width of the display.
For example, a critical parallax at the far point of the image sensor P8 is 0.0128 mχ(0.0088 m/0.378 m) = 0.298 mm by Equation 2 when a horizontal width WD of 19" monitor is 0.378 m and a horizontal width W5 of 2/3" CCD image sensor is 0.0088 m.
The camera separation computing unit 130 computes the separation between the parallel optical axes based on the computed critical parallax Ps and drives a separation adjustment unit 160 in response to the computed separation to adjust the separation between the left and right cameras Cc. [Equation 3]
Cc = Ps/Zs (l/Zo-l/ZF)
According to Equation 3, the critical parallax P8 under the unfavorable watching conditions may be characterized to adjust a camera separation so that the OSMU condition may be satisfied. FIG. 3 is a diagram illustrating an optical geometry between the left and right cameras 112 and 114 in the camera unit 110 and the object.
Each symbol in FIG. 3 denotes:
AXL: optical axis of a left lens
AXR : optical axis of a right lens Z0: distance in a straight line between the center of a lens and a convergence point Oz (zero parallax distance)
ZF: distance in a straight line between the center of a lens and the far point of (critical parallax distance)
Zs: distance in a straight line between the center of a lens and the image sensors SL and SR (image distance) f: focal length of the lens
Cc: distance between the centers of the left and right lenses LL and LR (separation between the left and right cameras)
Cz: distance between the centers of the left and right image sensors SL and SR (separation between the centers of left and right zero parallax images)
Cp: distance between the centers of far point left and right images photographed by the image sensors SL and SR (separation between the centers of left and right far point limit parallax images) W8: horizontal width between the image sensors SL and SR
PL: left parallax
PR: right parallax
In similar triangles Ai and A2, Zo:C(/2 = Zs:(Cz - C0)/2 is derived by Equation 3, and thus Equation 4 is represented as follows. [Equation 4]
CZ = (ZS/ZO)CC+CC
In the same way, ZF:Cc/2 = Zs:(CF - Cc)/2 is derived in similar triangles
A3 and A4, and thus Equation 5 is represented as follows.
[Equation 5] CF = (ZS/ZF)CC+CC
Parallax between the left and right images corresponding to the far point is represented by Equation 6.
[Equation 6]
Figure imgf000015_0001
= CZ-CF
= (ZS/ZO)CC+CC-{(ZS/ZF)CC+CC} = ZSCC (1/Zo-1/ZF)
Therefore, Equation 3 may be derived by solving Equation 6. The image storage unit 140 stores the respective left and right images photographed by the stereoscopic camera of which the separation between the cameras is readjusted based on Equation 3.
The image mixing unit 150 respectively shifts the left and right images stored in the image storage unit 140 in the left and right directions so that zero parallaxes of the images converge by overlapping. Thereafter, the image mixing unit 150 mixes the overlapped image with the stereoscopic image having parallax. The mixed stereoscopic image is shown on a stereoscopic display.
FIG. 4 illustrates a geometry structure of left and right images photographed by image sensors and a mixed stereoscopic image on condition that the separation between cameras is an initial state. FIG. 5 illustrates a geometry structure of left and right images photographed by image sensors and a mixed stereoscopic image on condition that the separation between cameras is readjusted according to the present invention.
Referring to FIGS. 4 and 5, the separation between cameras is readjusted from Co to Cc so that an initial far point screen parallax SPQ becomes a critical screen parallax SPc corresponding to a critical parallax of the stereoscopic display. Therefore, the parallax of the left and right far point images FL and FR is readjusted from the initial far point screen parallax PSQ to the critical screen parallax PSC. FIG. 6 is a block diagram illustrating an OSMU-type stereoscopic camera according to a second example embodiment of the present invention. The OSMU-type stereoscopic camera according to the second example embodiment independently adjusts separations between lenses and image sensors of a camera unit in compare with the OSMU-type stereoscopic camera according to the first example embodiment.
Referring to FIG. 6, a stereoscopic camera 200 may include a camera unit 210, a critical parallax computing unit 220, a camera separation computing unit 230, an image storage unit 240, and an image mixing unit 250.
The camera unit 210 may include a left camera 212, a right camera 214, a camera separation adjustment unit 216, and a sensor separation adjustment unit 218. The left and right cameras 212 and 214 are aligned parallel with each other on the camera separation adjustment unit 216. The left and right cameras 212 and 214 may move in the directions perpendicular to optical axes, that is, left and right directions so that the separation between the left and right cameras 212 and 214 may be adjusted. The right camera 212 may include an image sensor SL which may move in the directions perpendicular to the optical axis of a lens LL. The left camera 214 may include an image sensor SR which may move in the directions perpendicular to the optical axis of a lens LR. The left and right image sensors SL and SR are aligned parallel with each other on the sensor separation adjustment unit 218 so that the separation between the left and right image sensors SL and SR are adjusted with each other.
The critical parallax computing unit 220 adjusts the focus of the stereoscopic camera to an object and determines the far point of an image, of which the focus has been adjusted to the object, to compute a maximum allowable critical parallax at the far point of the image based on a far point limit parallax of the medium-size stereoscopic display. The separation between the image sensors SL and SR is set to an arbitrary value.
The camera separation computing unit 230 computes the separation between the image sensors SL and SR based on the computed critical parallax and drives the sensor separation adjustment unit 218 in response to the computed separation. The camera separation computing unit 230 may adjust the separation between the lenses by driving the camera separation adjustment unit 216.
The image storage unit 240 respectively stores left and right images photographed by the stereoscopic camera of which the separation is readjusted based on Equation 3.
The image mixing unit 250 respectively shifts the left and right images stored in the image storage unit 240 so that zero parallaxes of the images converge by overlapping. The image mixing unit 250 mixes the overlapped images with the stereoscopic image having the parallax. The mixed stereoscopic image is shown on the stereoscopic display.
In the second example embodiment, the separation between the left and right image sensors SL and SR aligned with parallel optical axes is set to an arbitrary value. The focus of the stereoscopic camera including the left and right image sensors SL and SR is adjusted to the object so that the far point of the image, of which the focus has been adjusted to the object, is determined. Thereafter, a maximum allowable critical parallax at the far point of the image is computed based on the far point limit parallax of the medium-size stereoscopic display. The separation between the left and right image sensors SL and SR is readjusted based on the computed critical parallax. The stereoscopic camera with the readjusted image sensors photographs the object so that OSMU-type stereoscopic video content may be made.
FIG. 7 is a block diagram illustrating an OSMU-type stereoscopic camera according to a modified example embodiment. Compared to the second example embodiment, image sensors are fixed and lenses move in the left and right directions with reference to FIG. 7.
Referring to FIG. 7, a stereoscopic camera 300 may include a camera unit 310, a critical parallax computing unit 320, a camera separation computing unit 330, an image storage unit 340, and an image mixing unit 350.
The camera unit 310 may include a left camera 312, a right camera 314, a camera separation adjustment unit 316, and a lens separation adjustment unit 318. The left and right cameras 312 and 314 are aligned parallel with each other on the camera separation adjustment unit 316 and able to move in perpendicular to optical axes, that is, the left and right directions so that the separation between the left and right cameras 312 and 314 may be adjusted. The left camera 312 may include a lens LL which may move to the left and right in the directions perpendicular to the optical axis of the image sensor SL. The right camera 312 may include a lens LR which may move to the left and right in the directions perpendicular to the optical axis of the image sensor SR. The left and right lenses LL and LR are aligned parallel with each other on the lens separation adjustment unit 318 so that the separation between the left and right lenses LL and LRmay be adjusted with respect to each other.
The critical parallax computing unit 320 adjusts the focus of the stereoscopic camera, of which the lenses LL and LR have been set to an arbitrary value, to an object. The critical parallax computing unit 320 determines the far point of an image of which the focus has been adjusted to the object. Therefore, the critical parallax computing unit 320 may compute a maximum allowable critical parallax at the far point of the image based on a far point limit parallax of the medium-size stereoscopic display.
The camera separation computing unit 330 computes the separation between the lenses LL and LR based on the computed critical parallax and drives the lens separation adjustment unit 318 in response to the computed separation. The camera separation computing unit 330 may adjust the separation between the sensors SL and SR by driving the camera separation adjustment unit 316.
The image storage unit 340 stores left and right images photographed by the stereoscopic camera of which the separation between the cameras has been readjusted based on Equation 3. The image mixing unit 350 respectively shifts the left image and right images stored in the image storage unit 340 in the left and right directions such that zero parallaxes of the images converge by overlapping. Thereafter, the image mixing unit 350 mixes the overlapped images with the stereoscopic image having parallax. The mixed stereoscopic image is shown on a stereoscopic display. In the modified example embodiment, the separation between the left and right lenses LL and LR aligned with parallel optical axes is set to an arbitrary value. The stereoscopic camera including the left and right lenses LL and LR adjusts the focus to the object and determines the far point of the image of which the focus has been adjusted to the object. Thereafter, the maximum allowable critical parallax at the far point of the image is computed based on the far point limit parallax of the medium-size stereoscopic display. The separation between the left and right lenses LL and LR is readjusted based on the computed critical parallax. The stereoscopic camera with the readjusted lenses photographs the object so that OSMU-type stereoscopic video content may be made. FIG. 8 is a block diagram illustrating a third example embodiment of the OSMU-type stereoscopic camera.
The stereoscopic camera 400 may include a camera unit 410, a critical parallax computing unit 420, a camera separation computing unit 430, an image storage unit 440, and an image mixing unit 450.
The camera unit 410 may include a left camera 412 and a right camera 414. The left and right cameras 412 and 414 are aligned parallel with each other. The left and right cameras 412 and 414 respectively include left and right wide image sensors WSL and WSR and left and right wide lenses WLL and WLR. The sizes of the left and right wide image sensors WSL and WSR and left and right wide lenses WLL and WLR are greater than the above-mentioned left and right image sensors SL and SR and lenses LL and LR such that the sizes of the left and right wide image sensors WSL and WSR and left and right wide lenses WLL and WLR may include maximum allowable moving distances of the left and right image sensors SL and SR and lenses LL and LR. Referring to FIG. 9, the left and right wide image sensors WSL and WSR may have a wide FOV which corresponds to a wide imaging area WwxHw. The wide imaging area WW XHW is greater than a display imaging area WO XHO. The display imaging area WO XHO may corresponds to a native imaging area. The critical parallax computing unit 420 adjusts the focus of the stereoscopic camera which has a fixed separation between the left and right cameras and determines the far point of an image of which the focus has been adjusted to an object. The critical parallax computing unit 420 computes a maximum allowable critical parallax at the far point of the image based on a far point limit parallax of the medium-size stereoscopic display.
The camera separation computing unit 430 computes the separation between virtual cameras based on the computed critical parallax.
The image storage unit 440 may include an address generating unit 442, a left image storage unit 444, and a right image storage unit 446. The left and right image storage units 444 and 446 may have large storage capacities such that the left and right image storage units 444 and 446 may store the wide imaging area
Ww χHw corresponding to the size of the wide image sensors WSL and WSR. The address generating unit 442 generates write addresses to respectively store left and right images photographed by the stereoscopic camera as the size of the wide imaging area WwχHw in the left and right image storage unit 444 and 446 as the originally photographed size. When the address generating unit 442 reads the stored image data from the left and right image storage units 444 and 446, the address generating unit 442 respectively generates left and right image read addresses (L(i-(cc-co)/2)j, L(i+wo-(cc-co)/2)G+HO)) and (R(i+(cc-co)/2)j, R(i+wo+(CC-CO)/2)(j+HO)) by shifting to left and right directions as much as the readjusted separation Cc between the cameras in response to the separation which is computed by the camera separation computing unit 430. Therefore, a shaded portion in FIG. 9 is read as the read image data.
The image mixing unit 450 respectively shifts the left and right images read from the image storage unit 430 to the left and right directions so that zero parallaxes of the left and right images converge by overlapping. The overlapped image is mixed with the stereoscopic image having the parallax and the mixed stereoscopic image is shown on the stereoscopic display.
FIG. 10 is a block diagram illustrating a fourth example embodiment of the OSMU-type stereoscopic camera and FIG. 11 is a diagram for describing an address generating operation of the address generating unit in FIG. 10.
Comparing with the third example embodiment, the fourth example embodiment of FIG. 10 readjusts not the read addresses but the write addresses in response to the separation between cameras. A stereoscopic camera 500 of the fourth example embodiment may include a camera unit 510, a critical parallax computing unit 520, a camera separation computing unit 530, an image storage unit 540, and an image mixing unit 550.
The camera unit 510 may include left and right cameras 512 and 514. The left and right cameras 512 and 514 are aligned parallel with each other in fixed locations. The left and right cameras 512 and 514 respectively include left and right wide image sensors WSL and WS R and left and right wide lenses WLL and WLR. The sizes of the left and right wide image sensors WSL and WSR and left and right wide lenses WLL and WLR are greater than the above-mentioned left and right image sensors SL and SR and lenses LL and LR in the first and second example embodiments such that the sizes of the left and right wide image sensors WSL and WSR and left and right wide lenses WLL and WLR may include the maximum allowable moving distance of the left and right image sensors SL and SR and lenses LL and LR. Referring to FIG. 11, the left and right wide image sensors WSL and WSR may have the wide FOV corresponding to the wide imaging area Ww χHw which is greater than the display imaging area Wo χHo. The critical parallax computing unit 520 adjusts the focus of a stereoscopic camera including fixed cameras to an object and determines the far point of an image of which the focus has been adjusted to the object. The critical parallax computing unit 520 computes a maximum allowable critical parallax at the far point of the image based on a far point limit parallax of the medium-size stereoscopic display.
The camera separation computing unit 530 computes the separation between virtual cameras based on the computed critical parallax.
The image storage unit 540 may include an address generating unit 542, a left image storage unit 544, and a right image storage unit 546. The left and right image storage units 544 and 546 may have large storage capacities such as the wide imaging area WW XHW corresponding to the size of the wide image sensors
WSL and WSR may be storable.
The address generating unit 542 receives left and right sync signals SyncL(L_SyncL, FJSyncL) and SyncR(L_SyncR, F_SyncR) from the left and right image sensors WSL and WSR. The address generating unit 542 generates X address valid signals X_ValidL and X_ValidR and Y address valid signals Y_ValidL and Y_ValidR in response to the readjusted separation between cameras Cc computed by the camera separation computing unit 530 with reference to FIG. 11. The address generating unit 542 generates signals which are in a valid region (a shaded region) of Y addresses Y_AddrL and Y_AddrR and X addresses X_AddrL and X_AddrR stored in the image storage unit 540 as valid addresses in response to the generated X address valid signal X ValidL and X_ValidR and Y address valid signal Y_ValidL and Y_ValidR. Therefore, the left and right image storage units 544 and 546 store pixel data in the valid addresses represented in a restricted region that is the shaded region with reference to FIG. 11. Because the stored data restricted within the shaded region is read during a read operation, the left and right images having sizes of the shaded region are read and provided to the image mixing unit 550.
The image mixing unit 550 respectively shifts the left and right images read from the image storage unit 540 and adjusts zero parallaxes with each other by overlapping so that the overlapped image is mixed with a stereoscopic image having parallax. The mixed stereoscopic image is shown on the stereoscopic display.
FIG. 12 is a block diagram illustrating a fifth example embodiment of an OSMU-type stereoscopic camera and FIG. 13 is a diagram for describing an output operation of pixel data of image sensors in FIG. 12.
Compared to other example embodiments, the fifth example embodiment with reference to FIG. 12 readjusts pixel data output from image sensors WSL and WSR having the FOV corresponding to the wide imaging area WwχHw in response to a computed separation between cameras. Referring to FIG. 12, a stereoscopic camera 600 may include a camera unit 610, a critical parallax computing unit 620, a camera separation computing unit 630, an image storage unit 640, and an image mixing unit 650.
The camera unit 610 may include a left camera 612 and a right camera
614. The left and right cameras 612 and 614 are aligned parallel with each other in fixed locations. The left and right camera 612 and 614 includes left and right wide image sensors WSL and WSR and left and right wide lenses WLL and WLR.
The sizes of the left and right wide image sensors WSL and WSR and left and right wide lenses WLL and WLR are greater than the above-mentioned left and right image sensors SL and SR and lenses LL and LR of the first and second example embodiments by means of including a maximum allowable moving distance of the left and right image sensors SL and SR and lenses LL and LR.
Referring to FIG. 13, the left and right wide image sensors WSL and WSR may have the FOV corresponding to the wide imaging area Ww χHw which is greater than the display imaging area Wo χHo.
The wide image sensors WSL and WSR output wide imaging area-size Ww χHw pixel data in response to line valid signals L_ValidL and L_ValidR and frame valid signals F_ValidL and F_ValidR as illustrated in FIG. 13.
The wide image sensors WSL and WSR of the fifth example embodiment output display imaging area display-size WoχHo pixel data in response to adjusted line valid signals CL_ValidL and CL_ValidR and adjusted frame valid signals CF ValidL and CF_ValidR as illustrated in FIG. 13. The adjusted line valid signals CL_ValidL and CL_ValidR and adjusted frame valid signals CF_ValidL and CF_ValidR are generated in response to a separation computed by the camera separation computing unit 630. Therefore, in the wide image sensors WSL and WSR, a valid section of a pixel clock signal PC is adjusted by the adjusted line valid signals CL_ValidL and CL_ValidR so that only pixel data corresponding to the valid section in a first line is output as valid line data. A valid section of adjusted line valid signals CL_ValidL and CL_ValidR is adjusted by the adjusted frame valid signals CF_ValidL and CF_ValidR so that only line data corresponding to the valid section in a first frame is output as valid frame data.
The critical parallax computing unit 620 adjusts the stereoscopic camera having a fixed separation between cameras to an object and determines the far point of an image of which the focus has been adjusted to the object. The critical parallax computing unit 620 computes a maximum allowable critical parallax at the far point of the image based on the far point limit parallax of medium-size stereoscopic display.
The camera separation computing unit 630 computes the separation between virtual cameras based on the computed critical parallax.
The image storage unit 640 receives the left and right images output from the image sensors and stores the received left and right images.
The image mixing unit 650 respectively shifts the left and right images stored in the image storage unit 640 to converge the zero parallax of each image by overlapping the left and right images. The overlapped image is mixed with the stereoscopic image having the parallax. The mixed stereoscopic image is shown on the stereoscopic display.
Industrial Applicability The stereoscopic image made by the example embodiments of the present invention may be viewed on various display sizes, such as mobile cell phones, desktop monitors, televisions, large-screen projection televisions, and movie screens so that the stereoscopic video content market may be expanded.
Having described the example embodiments of the present invention and its advantages, it is noted that various changes, substitutions and alterations can be made herein without departing from the spirit and scope of the invention as defined by appended claims.

Claims

WHAT IS CLAIMED IS:
1. A one source multi use (OSMU) type stereoscopic camera, comprising: left and right cameras aligned with parallel optical axes; a separation adjustment unit configured to adjust the separation between the left and right cameras; a critical parallax computing unit configured to adjust the focus of a stereoscopic camera to an object and determine the far point of an image, the focus of which has been adjusted to the object so that a maximum critical parallax is computed based on a far point limit parallax of a medium-size stereoscopic display on condition that the separation between the optical axes is set to an arbitrary value; a camera separation computing unit configured to compute the separation between the parallel optical axes based on the computed critical parallax and drive the separation adjustment unit in response to the computed separation; and an image storage unit configured to store left and right images photographed by left and right cameras readjusted by the camera separation computing unit.
2. The OSMU-type stereoscopic camera of claim 1, wherein the medium-size stereoscopic display is a desktop monitor having a size within a range of 17" to 24".
3. The OSMU-type stereoscopic camera of claim 1, wherein a far point limit parallax of the medium-size stereoscopic display is approximately 2.79% of an optimal convergence distance.
4. The OSMU-type stereoscopic camera of claim 1, wherein the critical parallax is represented by the following equation:
Ps = PD χ(Ws/WD) wherein,
P5 denotes the critical parallax of the far point, Ws denotes the horizontal width of the image sensor,
PD denotes the far point limit parallax of the medium-size stereoscopic display, and
WQ denotes the horizontal width of the stereoscopic display.
5. The OSMU-type stereoscopic camera of claim 4, wherein readjusted the separation between the parallel optical axes is represented by the following equation:
CC = PS/ZS(1/ZO-1/ZF) wherein, Zs denotes the distance from the center of a lens of the stereoscopic camera to the image sensor,
Z0 denotes the vertical distance from the center of the lens to the object, and
ZF denotes the vertical distance from the center of the lens to a far point object at the back of the object.
6. A method of making OSMU-type stereoscopic video content, comprising: adjusting the focus of a stereoscopic camera, of which the separation between parallel optical axes is set to an arbitrary value, to an object; determining the far point of an image of which the focus is adjusted to the object; computing a maximum allowable critical parallax at the far point of the image based on a far point limit parallax of a medium-size stereoscopic display; readjusting the separation between the parallel optical axes based on the computed critical parallax; and photographing of the object by the readjusted stereoscopic camera.
7. The method of claim 6, wherein the medium-size stereoscopic display is a desktop monitor.
8. The method of claim 7, wherein the desktop monitor has a size within a range of 17" to 24".
9. The method of claim 6, wherein the far point limit parallax of the medium-size stereoscopic display is approximately 2.79% of an optimal viewing distance of the stereoscopic display.
10. The method of claim 6, wherein the maximum allowable critical parallax is represented by the following equation: Ps = PD χ(Ws/WD) wherein,
Ps denotes the critical parallax of at the far point of the image sensor, W8 denotes the horizontal width of the image sensor,
PD denotes the far point limit parallax of the medium-size stereoscopic display, and
WD denotes the horizontal width of the stereoscopic display.
1 1. The method of claim 10, wherein the readjusted separation between the parallel optical axes is represented by the following equation: Cc = Ps/Zs(l/Zo-l/ZF) wherein, Zs denotes the distance from the center of a lens of the stereoscopic camera to the image sensor,
Z0 denotes the vertical distance from the center of the lens to the object, and
ZF denotes the vertical distance from the center of the lens to far point object at the back of the object.
12. The method of claim 6, further comprising: generating a single stereoscopic image by mixing left and right images photographed by the stereoscopic camera.
13. An OSMU-type stereoscopic camera, comprising: left and right cameras aligned to have parallel optical axes; a sensor separation adjustment unit configured to adjust the separation between image sensors on condition that the separation between the left and right cameras is fixed; a critical parallax computing unit configured to adjust the focus of a stereoscopic camera to an object and determine the far point of an image, the focus of which has been adjusted to the object, so that a maximum allowable critical parallax is computed based on a far point limit parallax of a medium-size stereoscopic display on condition that the separation between the image sensors is set to an arbitrary value; a camera separation computing unit configured to compute the separation between the image sensors based on the computed critical parallax and drive the sensor separation adjustment unit in response to the computed separation; and an image storage unit configured to store left and right images photographed by left and right cameras readjusted by the camera separation computing unit.
14. The OSMU-type stereoscopic camera of claim 13, wherein the medium-size stereoscopic display having a size within a range of 17" to 24".
15. The OSMU-type stereoscopic camera of claim 13, wherein a far point limit parallax of the medium-size stereoscopic display is approximately 2.79% of an optimal viewing distance.
16. The OSMU-type stereoscopic camera of claim 13, wherein the critical parallax is represented by the following equation:
Ps = PD χ(Ws/WD) wherein,
Ps denotes the critical parallax at the far point of the image sensor,
Ws denotes the horizontal width of the image sensor,
PD denotes the far point limit parallax of the medium-size stereoscopic display, and WQ denotes the horizontal width of the stereoscopic display.
17. The OSMU-type stereoscopic camera of claim 16, wherein the readjusted separation between the parallel optical axes is represented by the following equation: CC = PS/ZS(1/ZO-1/ZF) wherein,
Zs denotes the distance from the center of a lens of the stereoscopic camera to the image sensor,
Zo denotes the vertical distance from the center of the lens to the object, and
Zp denotes the vertical distance from the center of the lens to a far point object at the back of the object.
18. A method of making OSMU-type stereoscopic video content, comprising: adjusting the focus of a stereoscopic camera to an object on condition that the separation between the parallel optical axes of image sensors is set to an arbitrary value; determining the far point of an image of which the focus is adjusted to the object; computing a maximum allowable critical parallax at the far point of the image based on a far point limit parallax of a medium-size stereoscopic display; readjusting the separation between the left and right image sensors based on the computed critical parallax; and photographing of the object by the readjusted stereoscopic camera.
19. The method of claim 18, wherein the medium-size stereoscopic display is a desktop monitor.
20. The method of claim 19, wherein the desktop monitor has a size within a range of 17" to 24".
21. The method of claim 18, wherein the far point limit parallax of the medium-size stereoscopic display is approximately 2.79% of an optimal viewing distance of the stereoscopic display.
22. The method of claim 18, wherein the maximum allowable critical parallax is represented by the following equation: Ps = PDx(Ws/WD) wherein,
Ps denotes the maximum allowable critical parallax at the far point of the image sensor,
W8 denotes the horizontal width of the image sensor, PD denotes the far point limit parallax of the medium-size stereoscopic display, and
WD denotes the horizontal width of the stereoscopic display.
23. The method of claim 22, wherein the readjusted separation between the left and right image sensors is represented by the following equation:
CC = PS/ZS(1/ZO-1/ZF) wherein, Zs denotes the distance from the center of a lens of the stereoscopic camera to the image sensor,
Z0 denotes the vertical distance from the center of the lens to the object, and
Zr denotes the vertical distance from the center of the lens to far point object at the back of the object.
24. The method of claim 18, further comprising: generating a single stereoscopic image by mixing left and right images photographed by the stereoscopic camera.
25. An OSMU-type stereoscopic camera, comprising: left and right cameras aligned with parallel optical axes; a lens separation adjustment unit for adjusting the separation between left and right lenses on condition of the separation between image sensors in the cameras being fixed; a critical parallax computing unit configured to adjust the focus of a stereoscopic camera to an object and determine the far point of an image, the focus of which has been adjusted to the object, so that a maximum critical parallax is computed based on a far point limit parallax of a medium-size stereoscopic display on condition that the separation between the lenses in the stereoscopic camera is set to an arbitrary value; a camera separation computing unit configured to compute the separation between the lenses based on the computed critical parallax and drive the lens separation adjustment unit in response to the computed separation; and an image storage unit configured to store left and right images photographed by the left and right cameras of which the separation between the lenses is readjusted by the camera separation computing unit.
26. A method of making OSMU-type stereoscopic video content, comprising: adjusting the focus of a stereoscopic camera to an object on condition that the separation between left and right lenses having parallel optical axes is set to an arbitrary value; determining the far point of an image of which the focus has been adjusted to the object; computing a maximum allowable critical parallax at the far point of the image based on a far point limit parallax of a medium-size stereoscopic display; readjusting the separation between the left and right lenses based on the computed critical parallax; photographing of the object by the readjusted stereoscopic camera.
27. A method of making OSMU-type stereoscopic video content configured to take stereoscopic images adapting to a maximum allowable critical parallax based on the most unfavorable display watching conditions.
28. An OSMU-type stereoscopic camera, comprising: left and right cameras including image sensors and wide lenses on condition that parallel optical axes of the lenses is fixed, each of the image sensors and wide lenses having a field of view corresponding to a wide imaging area which is greater than a native imaging area; a critical parallax computing unit configured to adjust the focus of a stereoscopic camera to an object and determine the far point of an image, the focus of which has been adjusted to the object, so that a maximum critical parallax is computed based on a far point limit parallax of a medium-size stereoscopic display on condition that the separation between the cameras is fixed; a camera separation computing unit configured to compute the separation between the parallel optical axes based on the computed critical parallax; and an image storage unit configured to store wide left and right images photographed by left and right cameras and output left and right display images in response to the separation computed by the camera separation computing unit during a read operation.
29. A method of making OSMU-type stereoscopic video content, comprising: photographing of an object by a stereoscopic camera including image sensors and wide lenses having fields of view corresponding to wide imaging areas, the stereoscopic camera being set to have a fixed separation; storing the photographed left and right image having the wide imaging areas; determining the far point of an image of which the focus has been adjusted to the object; computing a maximum allowable critical parallax at the far point of the image based on a far point limit parallax of a medium-size stereoscopic display; resetting display image read addresses of desired display images from the stored wide imaging area images in response to the computed separation based on the computed critical parallax; and reading left and right display images in response to the reset read addresses.
30. An OSMU-type stereoscopic camera, comprising: left and right cameras including image sensors and wide lenses on condition that optical axes of the wide lenses being fixed with parallel optical axes, each of the image sensors and wide lenses having a filed of view corresponding to a wide imaging area which is greater than a native imaging area; a critical parallax computing unit configured to adjust the focus of the stereoscopic camera to an object and determine the far point of an image of which the focus of the image has been adjusted to the object, so that a maximum allowable critical parallax at the far point of the image is computed based on a far point limit parallax of the medium-size stereoscopic display on condition that the separation between the parallel optical axes is fixed; a camera separation computing unit configured to compute the separation between the parallel optical axes based on the computed critical parallax; and an image storage unit configured to write display-size left and right images among wide-area left and right images picked up by the left and right cameras in response to the separation computed by the camera separation computing unit.
31. A method of making OSMU-type stereoscopic video content, comprising: photographing of an object by a stereoscopic camera including image sensors and wide lenses on condition that the stereoscopic camera is set to have a fixed separation between cameras, each of the image sensors and wide lenses having a filed of view corresponding to a wide imaging area which is greater than a native imaging area; determining the far point of an image of which the focus has been adjusted to the photographed object; computing a maximum allowable critical parallax at the far point of the image based on a far point limit parallax of a medium-size stereoscopic display; computing the separation between the cameras based on the computed critical parallax; storing display-size left and right images among wide-area images in response to the computed separation between cameras.
32. An OSMU-type stereoscopic camera, comprising: left and right cameras including image sensors and wide on condition that optical axes of the wide lenses being fixed parallel to each other, each of the image sensors and wide lenses having a filed of view corresponding to a wide imaging area which is greater than a native imaging area; a critical parallax computing unit configured to adjust the focus of the stereoscopic camera to an object and determine the far point of an image of which the focus has been adjusted to the object, so that a maximum allowable critical parallax at the far point of the image is computed based on a far point limit parallax of a medium-size stereoscopic display on condition that the separation between the optical axes is fixed; a camera separation computing unit configured to compute the separation between the parallel optical axes based on the computed critical parallax; an image storage unit configured to store left and right images picked up by the left and right cameras, and wherein each of the image sensors of the left and right cameras output only display sized pixel data in response to the computed separation.
33. A method of making OSMU-type stereoscopic video content, comprising: photographing of an object by a stereoscopic camera including image sensors and wide lenses having wide imaging areas, the stereoscopic camera being set to have a fixed separation between cameras; determining the far point of an image of which the focus has been adjusted to the photographed object; computing a maximum critical parallax at the far point of the image based on a far point limit parallax of a medium-size stereoscopic display; computing the separation between cameras based on the computed critical parallax; outputting pixel data having a display size from the image sensors in response to the computed separation between cameras; and storing the output pixel data having the display size.
PCT/KR2008/005897 2007-10-08 2008-10-08 Osmu(one source multi use)-type stereoscopic camera and method of making stereoscopic video content thereof WO2009048254A1 (en)

Priority Applications (7)

Application Number Priority Date Filing Date Title
MX2010003645A MX2010003645A (en) 2007-10-08 2008-10-08 Osmu(one source multi use)-type stereoscopic camera and method of making stereoscopic video content thereof.
CA2701785A CA2701785C (en) 2007-10-08 2008-10-08 Osmu (one source multi use)-type stereoscopic camera and method of making stereoscopic video content thereof
CN2008801140863A CN101843107B (en) 2007-10-08 2008-10-08 OSMU(one source multi use)-type stereoscopic camera and method of making stereoscopic video content thereof
US12/734,017 US8482600B2 (en) 2007-10-08 2008-10-08 OSMU (one source multi use)-type stereoscopic camera and method of making stereoscopic video content thereof
BRPI0818500 BRPI0818500A2 (en) 2007-10-08 2008-10-08 Osmu-type stereoscopic camera (multiple use of one source) and method of manufacturing stereoscopic video content
JP2010528799A JP5572094B2 (en) 2007-10-08 2008-10-08 One-source multi-use (OSMU) type stereo camera and method for producing stereo image content thereof
EP08836985.5A EP2201785A4 (en) 2007-10-08 2008-10-08 Osmu(one source multi use)-type stereoscopic camera and method of making stereoscopic video content thereof

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2007-0100904 2007-10-08
KR1020070100904A KR101313740B1 (en) 2007-10-08 2007-10-08 OSMU( One Source Multi Use)-type Stereoscopic Camera and Method of Making Stereoscopic Video Content thereof

Publications (1)

Publication Number Publication Date
WO2009048254A1 true WO2009048254A1 (en) 2009-04-16

Family

ID=40549359

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2008/005897 WO2009048254A1 (en) 2007-10-08 2008-10-08 Osmu(one source multi use)-type stereoscopic camera and method of making stereoscopic video content thereof

Country Status (9)

Country Link
US (1) US8482600B2 (en)
EP (2) EP2201785A4 (en)
JP (1) JP5572094B2 (en)
KR (1) KR101313740B1 (en)
CN (1) CN101843107B (en)
BR (1) BRPI0818500A2 (en)
CA (1) CA2701785C (en)
MX (1) MX2010003645A (en)
WO (1) WO2009048254A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102959969A (en) * 2010-06-29 2013-03-06 富士胶片株式会社 Single-lens stereoscopic image capture device
JP2013524688A (en) * 2010-04-05 2013-06-17 クゥアルコム・インコーポレイテッド Combining data from multiple image sensors
US9001227B2 (en) 2010-04-05 2015-04-07 Qualcomm Incorporated Combining data from multiple image sensors
CN106331679A (en) * 2015-06-30 2017-01-11 深圳市墨克瑞光电子研究院 Binocular camera space adjusting method and device
EP2717582B1 (en) * 2012-08-30 2020-03-11 LG Innotek Co., Ltd. Camera module and apparatus for calibrating position thereof

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8791984B2 (en) * 2007-11-16 2014-07-29 Scallop Imaging, Llc Digital security camera
JP5425554B2 (en) * 2009-07-27 2014-02-26 富士フイルム株式会社 Stereo imaging device and stereo imaging method
KR101121421B1 (en) * 2010-02-23 2012-03-20 주식회사 빅아이 Method and computer readable recording medium for providing optimal distance between cameras in stereoscopic video production and apparatus for producing stereoscopic video
CN102860017B (en) * 2010-04-28 2015-06-10 富士胶片株式会社 Stereoscopic image pickup device and control method therefor
EP2395763A3 (en) 2010-06-14 2012-02-29 Nintendo Co., Ltd. Storage medium having stored therein stereoscopic image display program, stereoscopic image display device, stereoscopic image display system, and stereoscopic image display method
EP2434764A1 (en) * 2010-09-23 2012-03-28 Thomson Licensing Adaptation of 3D video content
JP5681588B2 (en) * 2010-09-30 2015-03-11 富士フイルム株式会社 Stereoscopic image editing apparatus and stereoscopic image editing method
US8879902B2 (en) * 2010-10-08 2014-11-04 Vincent Pace & James Cameron Integrated 2D/3D camera with fixed imaging parameters
JP5750457B2 (en) 2011-01-25 2015-07-22 富士フイルム株式会社 Stereoscopic video processing device, stereoscopic video processing program and recording medium therefor, stereoscopic imaging device, and stereoscopic video processing method
CN103339948B (en) * 2011-02-03 2015-04-08 富士胶片株式会社 3D video playing device, 3D imaging device, and 3D video playing method
KR101824439B1 (en) * 2011-02-16 2018-02-02 주식회사 스테레오피아 Mobile Stereoscopic Camera Apparatus and Method of Shooting thereof
KR20130024504A (en) * 2011-08-31 2013-03-08 삼성전기주식회사 Stereo camera system and method for controlling convergence
KR101219859B1 (en) * 2011-08-31 2013-01-09 성균관대학교산학협력단 Apparatus and method for semi-auto convergence in 3d photographing apparatus
US20140225991A1 (en) * 2011-09-02 2014-08-14 Htc Corporation Image capturing apparatus and method for obatining depth information of field thereof
US20130057655A1 (en) * 2011-09-02 2013-03-07 Wen-Yueh Su Image processing system and automatic focusing method
CN103930826B (en) * 2011-09-13 2016-12-28 富士胶片株式会社 Stereo photographic device
JP5989315B2 (en) * 2011-09-22 2016-09-07 任天堂株式会社 Display control program, display control system, display control apparatus, and display control method
KR101888967B1 (en) 2011-12-16 2018-08-20 엘지이노텍 주식회사 3-dimensional camera module and method for auto focusing the same
US20130208107A1 (en) * 2012-02-14 2013-08-15 Nokia Corporation Apparatus and a Method for Producing a Depth-Map
CN103888750B (en) * 2012-12-20 2016-02-24 比比威株式会社 3-dimensional image shoot control system and method
US20140267617A1 (en) * 2013-03-15 2014-09-18 Scott A. Krig Adaptive depth sensing
US9282265B2 (en) * 2013-09-09 2016-03-08 Omnivision Technologies, Inc. Camera devices and systems based on a single image sensor and methods for manufacturing the same
US10045005B2 (en) 2013-12-10 2018-08-07 Lg Electronics Inc. 3D camera module
CN111246195B (en) * 2014-03-25 2022-01-11 6115187加拿大公司暨伊美景象公司 System for automatically defining user experience or system behavior related to scene image content
US9330436B2 (en) 2014-04-01 2016-05-03 Gopro, Inc. Multi-camera array with adjacent fields of view
US11019323B2 (en) * 2015-02-06 2021-05-25 Tara Chand Singhal Apparatus and method for 3D like camera system in a handheld mobile wireless device
US10119809B2 (en) * 2015-02-16 2018-11-06 Intel Corporation Simulating multi-camera imaging systems
US9953403B2 (en) * 2016-06-10 2018-04-24 The Boeing Company Stereoscopic camera and associated method of varying a scale of a stereoscopic image pair
WO2018052228A1 (en) * 2016-09-13 2018-03-22 엘지이노텍 주식회사 Dual camera module, optical device, camera module, and method for operating camera module
CN109525830A (en) * 2018-11-28 2019-03-26 浙江未来技术研究院(嘉兴) A kind of dimensional video collecting system
CN111726599B (en) * 2019-03-22 2022-04-05 舜宇光学(浙江)研究院有限公司 Matching method of binocular different-internal-reference camera-imaging optical system, system and electronic equipment

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20010003426A (en) * 1999-06-23 2001-01-15 미노루 이나바 Stereo camera
KR20060009178A (en) * 2004-07-21 2006-01-31 한국방송공사 Driving apparatus of both-eyes typed stereo carmera system and control method thereof
JP2006303832A (en) * 2005-04-19 2006-11-02 Minoru Inaba Digital stereo camera or digital stereo video camera

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5063441A (en) * 1990-10-11 1991-11-05 Stereographics Corporation Stereoscopic video cameras with image sensors having variable effective position
EP0888017A2 (en) * 1993-08-26 1998-12-30 Matsushita Electric Industrial Co., Ltd. Stereoscopic image display apparatus and related system
US6005607A (en) * 1995-06-29 1999-12-21 Matsushita Electric Industrial Co., Ltd. Stereoscopic computer graphics image generating apparatus and stereoscopic TV apparatus
JPH10155104A (en) * 1996-11-22 1998-06-09 Canon Inc Compound eye image pickup method and device and storage medium
JPH11341522A (en) * 1998-05-22 1999-12-10 Fuji Photo Film Co Ltd Stereoscopic image photographing device
JP4149037B2 (en) * 1998-06-04 2008-09-10 オリンパス株式会社 Video system
SE521735C2 (en) * 1999-06-11 2003-12-02 Minoru Inaba Stereo camera; has right and left objectives spaced between spacing between centres of two images and spacing between optical axes of objectives for shortest picture distance
JP2001016619A (en) * 1999-06-30 2001-01-19 Canon Inc Image pickup device, its convergence distance decision method, storage medium and optical device
JP2001142166A (en) * 1999-09-15 2001-05-25 Sharp Corp 3d camera
JP2001218228A (en) * 2000-02-01 2001-08-10 Canon Inc Optical system for stereoscopic image photographing, and stereoscopic image photographing device using the same
JP3749227B2 (en) * 2002-03-27 2006-02-22 三洋電機株式会社 Stereoscopic image processing method and apparatus
JP4490074B2 (en) * 2003-04-17 2010-06-23 ソニー株式会社 Stereoscopic image processing apparatus, stereoscopic image display apparatus, stereoscopic image providing method, and stereoscopic image processing system
US20050207486A1 (en) * 2004-03-18 2005-09-22 Sony Corporation Three dimensional acquisition and visualization system for personal electronic devices
JP2005297168A (en) * 2004-04-16 2005-10-27 Fujinon Corp Remote control robot
DE102005063503B4 (en) 2005-03-10 2011-05-19 Inaba, Minoru, Oyama 3D display and 3D projector
DE202007010389U1 (en) * 2007-07-24 2007-09-27 Maier, Florian Device for automatic positioning of coupled cameras for plastic imaging

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20010003426A (en) * 1999-06-23 2001-01-15 미노루 이나바 Stereo camera
KR20060009178A (en) * 2004-07-21 2006-01-31 한국방송공사 Driving apparatus of both-eyes typed stereo carmera system and control method thereof
JP2006303832A (en) * 2005-04-19 2006-11-02 Minoru Inaba Digital stereo camera or digital stereo video camera

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2201785A4 *

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013524688A (en) * 2010-04-05 2013-06-17 クゥアルコム・インコーポレイテッド Combining data from multiple image sensors
US8896668B2 (en) 2010-04-05 2014-11-25 Qualcomm Incorporated Combining data from multiple image sensors
US9001227B2 (en) 2010-04-05 2015-04-07 Qualcomm Incorporated Combining data from multiple image sensors
CN102959969A (en) * 2010-06-29 2013-03-06 富士胶片株式会社 Single-lens stereoscopic image capture device
CN102959969B (en) * 2010-06-29 2015-07-15 富士胶片株式会社 Single-lens stereoscopic image capture device
EP2717582B1 (en) * 2012-08-30 2020-03-11 LG Innotek Co., Ltd. Camera module and apparatus for calibrating position thereof
CN106331679A (en) * 2015-06-30 2017-01-11 深圳市墨克瑞光电子研究院 Binocular camera space adjusting method and device
CN106331679B (en) * 2015-06-30 2018-07-06 深圳市墨克瑞光电子研究院 Binocular camera spacing adjusting method and device

Also Published As

Publication number Publication date
EP2201785A1 (en) 2010-06-30
KR20090035880A (en) 2009-04-13
EP2230858A2 (en) 2010-09-22
US8482600B2 (en) 2013-07-09
JP2010541513A (en) 2010-12-24
KR101313740B1 (en) 2013-10-15
JP5572094B2 (en) 2014-08-13
EP2201785A4 (en) 2014-02-19
CA2701785C (en) 2016-05-17
BRPI0818500A2 (en) 2015-04-22
CA2701785A1 (en) 2009-04-16
CN101843107B (en) 2012-08-15
MX2010003645A (en) 2010-08-09
EP2230858A3 (en) 2014-02-19
US20100231691A1 (en) 2010-09-16
CN101843107A (en) 2010-09-22

Similar Documents

Publication Publication Date Title
US8482600B2 (en) OSMU (one source multi use)-type stereoscopic camera and method of making stereoscopic video content thereof
US10536687B2 (en) Stereoscopic video imaging display system having a predetermined width of a viewing field angle
US8289380B2 (en) Polarized stereoscopic display device and method
KR101824439B1 (en) Mobile Stereoscopic Camera Apparatus and Method of Shooting thereof
US20080174659A1 (en) Wide field of view display device and method
JP2009017207A (en) Stereoscopic television system and stereoscopic television receiver
JP5628819B2 (en) Computer graphics video composition apparatus and method, and display apparatus
EP2566166B1 (en) Three-dimensional imaging device
CN106559662B (en) Multi-view image display apparatus and control method thereof
KR101376734B1 (en) OSMU( One Source Multi Use)-type Stereoscopic Camera and Method of Making Stereoscopic Video Content thereof
JP2013105000A (en) Video display device and video display method
JP4481275B2 (en) 3D video information transmission method
JPH1152292A (en) Stereoscopic picture observation system
JP2013191950A (en) Stereoscopic image data generation system, stereoscopic image data display system, and stereoscopic image data display method
CN219225208U (en) VR perspective system and VR equipment
CA2361729C (en) 3d multimedia visualization system
CN114935814A (en) Naked eye 3D display device and method, electronic equipment and storage medium
KR20000002339A (en) Cubic image device by polarized light method
TWI523491B (en) Image capturing device and three-dimensional image capturing method thereof
CN116300085A (en) VR perspective system and VR equipment
JPH07239451A (en) Stereoscopic picture device

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200880114086.3

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 08836985

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: MX/A/2010/003645

Country of ref document: MX

WWE Wipo information: entry into national phase

Ref document number: 2701785

Country of ref document: CA

WWE Wipo information: entry into national phase

Ref document number: 12734017

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 2010528799

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2008836985

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2583/DELNP/2010

Country of ref document: IN

ENP Entry into the national phase

Ref document number: PI0818500

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20100408