KR20140070856A - Global depth map generation method and stereoscopic image display device using the same - Google Patents
Global depth map generation method and stereoscopic image display device using the same Download PDFInfo
- Publication number
- KR20140070856A KR20140070856A KR1020120136164A KR20120136164A KR20140070856A KR 20140070856 A KR20140070856 A KR 20140070856A KR 1020120136164 A KR1020120136164 A KR 1020120136164A KR 20120136164 A KR20120136164 A KR 20120136164A KR 20140070856 A KR20140070856 A KR 20140070856A
- Authority
- KR
- South Korea
- Prior art keywords
- edge
- data
- horizontal
- vertical
- depth map
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N2013/0074—Stereoscopic image analysis
- H04N2013/0081—Depth or disparity estimation from stereoscopic image signals
Landscapes
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
Description
The present invention relates to a global depth map generation method and a stereoscopic image display apparatus using the same.
The stereoscopic display is divided into a stereoscopic technique and an autostereoscopic technique. The binocular parallax method uses parallax images of right and left eyes with large stereoscopic effect, and both glasses and non-glasses are used, and both methods are practically used. In the spectacle system, there is a pattern retarder system in which a polarizing direction of a right and left parallax image is displayed on a direct view type display device or a projector, and a stereoscopic image is realized using polarizing glasses. The eyeglass system has a shutter glasses system in which right and left parallax images are displayed in a time-division manner on a direct view type display device or a projector, and a stereoscopic image is implemented using liquid crystal shutter glasses. In the non-eyeglass system, an optical plate such as a parallax barrier or a lenticular lens is generally used to separate the optical axes of the right and left parallax images to realize a stereoscopic image.
Generally, a stereoscopic image display device receives 3D image data from outside in order to realize a stereoscopic image. In this case, the three-dimensional image is displayed by converting the 3D image data into a 3D format corresponding to the stereoscopic image method described above. However, the stereoscopic image display apparatus can implement a stereoscopic image even when 2D image data is inputted from the outside. In this case, the stereoscopic image display apparatus generates 3D image data from the received 2D image data, and converts the 3D image data into a 3D format corresponding to the stereoscopic image method, thereby displaying the stereoscopic image.
Specifically, the stereoscopic image display apparatus can generate 3D image data using a depth map calculated from 2D image data and 2D image data. The depth map means a map created with depth data of one frame period calculated by analyzing 2D image data of one frame period. The depth data is a value indicating the depth information of the 2D image data. The depth data becomes smaller as the depth of the 2D image data becomes deeper, and the depth data becomes larger as the depth of the 2D image data becomes shallower. The depth map can be calculated using a global depth map and a local depth map. The global depth map is a depth map calculated by analyzing edges of 2D image data. The local depth map is a depth map calculated by analyzing the luminance and color of 2D image data. Edge refers to the outline of each of the 2D image objects.
On the other hand, generally, the upper area of the 2D image is a deep background area, and the lower area is an area where objects having a shallow depth are displayed. That is, since the perspective of the 2D image is generally displayed in the vertical direction, the global depth map is generated by analyzing the edge in the horizontal direction of the 2D image data. However, the perspective of the 2D image may appear in the horizontal direction (x-axis direction) as shown in Fig. In Fig. 1, the left area of the 2D image is a shallow area, and the right area is a deep area. However, the global depth map generated by analyzing the edges in the horizontal direction of the 2D image data can only reflect the perspective of the vertical direction, and there is a problem that the perspective of the horizontal direction can not be reflected. That is, when the perspective of the 2D image occurs in the horizontal direction (x-axis direction) as shown in Fig. 1, there occurs a problem that the global depth map is created incorrectly. Owing to the misrepresentation of the global depth map, the 3D sensation of the 3D image that the user feels is reduced.
The present invention provides a global depth map calculation method and a stereoscopic image display apparatus using the same that can prevent erroneous creation of a global depth map.
A global depth map generation method according to an embodiment of the present invention includes a first step of converting 2D image data into edge data; A second step of analyzing the edge data to determine the direction of the edge; And generating a global depth map by analyzing an edge in the horizontal direction of the 2D image data when the direction of the edge is a vertical direction and generating an edge in the vertical direction of the 2D image data, And a third step of generating the global depth map by analyzing the global depth map.
A stereoscopic image display device according to an embodiment of the present invention includes a display panel including data lines and gate lines; A depth map is generated from the
According to the present invention, a direction in which a perspective of a 2D image appears can be detected by determining the direction of an edge, and the edge is analyzed in the vertical direction of the 2D image data according to the direction of the edge to calculate global depth data, And determines whether to calculate global depth data. That is, according to the present invention, global depth data is calculated in consideration of the direction in which the perspective of the 2D image appears, so that it is possible to prevent erroneous creation of the global depth map. As a result, the present invention can maintain the stereoscopic quality of the 3D image at a high level.
1 is an image showing an example of a 2D image in which a perspective is displayed in a horizontal direction.
2 is a block diagram schematically showing a stereoscopic image display apparatus according to an embodiment of the present invention.
3 is a block diagram showing the image processing circuit of FIG. 2 in detail;
4 is a flow chart showing in detail the image processing method of the image processing circuit.
5 is a detailed block diagram of the global depth map generator of FIG.
FIG. 6 is a flowchart showing in detail a global depth map generating method of a global depth map generating unit. FIG.
7A and 7B are images showing an edge image and a compressed image.
8 is a flow chart showing in detail the edge direction determination method of the edge direction determination unit.
Figure 9 is an example showing a histogram of edge direction vectors;
10 is a flowchart showing in detail a global depth map calculating method of the global depth map calculating unit.
11A is an exemplary view showing one example of first through nth horizontal weights.
11B is an exemplary view showing one example of first through nth vertical weights.
11C is an exemplary view showing another example of the first to n-th vertical weights.
12A is an exemplary view showing a calculated global depth map when an edge direction is a vertical direction;
12B is an exemplary view showing the calculated global depth map when the direction of the edge is the horizontal direction.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings. Like reference numerals throughout the specification denote substantially identical components. In the following description, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. The component name used in the following description may be selected in consideration of easiness of specification, and may be different from the actual product name.
2 is a block diagram schematically showing a stereoscopic image display apparatus according to an embodiment of the present invention. 2, a stereoscopic image display apparatus according to an exemplary embodiment of the present invention includes a
The
The
The
The
The
The
The
3 is a detailed block diagram of the image processing circuit of FIG. 4 is a flow chart showing in detail the image processing method of the image processing circuit. 3, the
First, the global
Secondly, the local
Thirdly, the
Specifically, the
Fourth, the 3D image
Specifically, the 3D image
The 3D
The stereoscopic image display apparatus according to the embodiment of the present invention may be applied to a stereoscopic image display system that implements a stereoscopic image by a binocular disparity such as a shutter glass system, a pattern retarder system, and an active retarder system, Or a non-eyeglass system in which a stereoscopic image is realized by a binocular parallax using an optical plate such as a parallax barrier, a lenticular lens, or the like. Accordingly, the 3D image
5 is a detailed block diagram of the global depth map generator of FIG. 6 is a detailed flowchart illustrating a global depth map generating method of the global depth map generating unit. 5, the global depth
First, the edge
The edge
The edge
7A is an image showing an edge image. The edge image is an image obtained from the edge data ED of one frame period. As shown in FIG. 7A, an edge is expressed by a white gray scale value in an edge image. (S201)
Second, the compressed
Alternatively, the compressed
7B is an image showing a compressed image. The compressed image is an image obtained from compressed data (CD) in one frame period. 7A and 7B, the compressed image is an image compressed by 1 / r in the horizontal direction as compared with the edge image. As shown in FIG. 7B, the edge is expressed by a white gray scale value in a compressed image. (S202)
Thirdly, the edge
Fourth, the global depth data calculating method of the global depth
As described above, according to the present invention, it is possible to detect the direction in which the perspective of the 2D image appears by determining the direction of the edge, and to analyze the edge in the vertical direction of the 2D image data according to the direction of the edge, To determine whether to calculate the global depth data. That is, according to the present invention, global depth data is calculated in consideration of the direction in which the perspective of the 2D image appears, so that it is possible to prevent erroneous creation of the global depth map. As a result, the present invention can maintain the stereoscopic quality of the 3D image at a high level.
8 is a flowchart showing in detail an edge direction determination method of the edge direction determination unit. Referring to FIG. 8, the edge
First, the edge
Second, the edge
Third, the edge
(M, n)) of the compressed data CD (m, n) at the coordinates (m, n) The edge direction data ED (m, n) at the (m, n) coordinates can be calculated from 0 DEG to 180 DEG (pi). (S303)
Fourth, the edge
Fifth, the edge
Sixth, the edge
The edge
10 is a flowchart showing in detail a global depth map calculating method of the global depth data calculating unit. Referring to FIG. 10, the global depth
First, the global depth
Second, the global
Third, the global depth
That is, the step S404 is a step of smoothing to prevent the global depth data GDD (j) of the j-th horizontal line from becoming too large compared to the global depth data of the plurality of horizontal lines adjacent to the j-th horizontal line Can be defined.
12A is an exemplary view showing the calculated global depth map when the direction of the edge is the vertical direction. The global depth
Fourth, the global depth
The global
Sixth, the global depth
Step S406 is a step for preventing the global depth data GDD (i) of the i-th vertical line from becoming too large compared to the global depth data of a plurality of vertical lines adjacent to the i-th vertical line.
12B is an exemplary view showing the calculated global depth map when the direction of the edge is the horizontal direction. The global depth
As described above, according to the present invention, it is possible to detect the direction in which the perspective of a 2D image appears by determining the direction of the edge, and to analyze the edge in the vertical direction of the 2D image data according to the direction of the edge to calculate global depth data , And determines whether to calculate the global depth data by analyzing the edge in the horizontal direction. That is, according to the present invention, global depth data is calculated in consideration of the direction in which the perspective of the 2D image appears, so that it is possible to prevent erroneous creation of the global depth map. As a result, the present invention can maintain the stereoscopic quality of the 3D image at a high level.
It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention. Therefore, the technical scope of the present invention should not be limited to the contents described in the detailed description of the specification, but should be defined by the claims.
10: display panel 110: gate drive circuit
120: Data driving circuit 130: Timing controller
140: image processing circuit 150: host system
200: Global depth map generator 210: Edge data converter
220: compressed data generation unit 230: edge direction determination unit
240: Global depth data calculating unit 300: Local depth map generating unit
400: Depth map generation unit 500: 3D image data generation unit
Claims (20)
A second step of analyzing the edge data to determine the direction of the edge; And
When the direction of the edge is a vertical direction, a global depth map is generated by analyzing the edges in the horizontal direction of the 2D image data, and when the direction of the edge is horizontal, the edge is analyzed in the vertical direction of the 2D image data And a third step of generating the global depth map.
The second step comprises:
Compressing the edge data to generate compressed data;
Calculating a horizontal direction factor and a vertical direction factor of the compressed data;
Calculating edge strength data and edge direction data using the horizontal direction factor and the vertical direction factor;
Calculating an edge direction vector including the edge strength data and edge direction data;
Calculating an accumulated number of the edge direction vectors to generate a histogram, and analyzing the histogram to determine the direction of the edge.
Wherein the step of compressing the edge data to generate compressed data comprises:
Wherein the compressed data is generated by compressing the edge data by 1 / r (r is a natural number equal to or larger than 2) in the horizontal direction.
Wherein the step of calculating the horizontal direction factor and the vertical direction factor of the compressed data comprises:
(m, n) coordinate and the compressed data adjacent in the horizontal direction to the compressed data in the (m, n) coordinate, the horizontal direction factor of the compressed data in the (m, n) And the smaller the difference between the compressed data at the (m, n) coordinate and the compressed data adjacent to the compressed data at the (m, n) coordinate in the vertical direction, The global depth map generation method comprising the steps of:
Wherein the step of calculating the edge strength data and the edge direction data using the compressed data comprises:
(M, n), the horizontal direction factor of the compressed data is Sx (m, n), the vertical direction factor is Sy (m, n) , n)
EI (m, n) represents edge intensity data at the (m, n)
Wherein the global depth map is calculated using the global depth map.
Wherein the step of calculating the edge strength data and the edge direction data using the compressed data comprises:
The edge direction data at the (m, n) coordinate is ED (m, n), the horizontal direction factor of the compressed data at the (m, n) , n)
The edge direction data ED (m, n) at the (m, n)
Wherein the global depth map is calculated using the global depth map.
In the third step,
Calculating a first edge representative value of the first through n-th horizontal lines when the direction of the edge is the vertical direction; And
And calculating second edge representative values of the first through nth horizontal lines by applying first through nth horizontal weights to the first edge representative values of the first through nth horizontal lines,
Wherein the first to nth horizontal weights are increased from the first horizontal weight to the nth horizontal weight.
In the third step,
Further comprising calculating global depth data of the j-th horizontal line by applying weights to a second edge representative value of the j-th horizontal line and a second edge representative value of a plurality of horizontal lines adjacent to the j-th horizontal line, The global depth map generation method comprising:
In the third step,
Calculating a first edge representative value of the first through mth vertical lines when the direction of the edge is the horizontal direction; And
And calculating second edge representative values of the first through mth vertical lines by applying first through mth vertical weights to the first edge representative values of the first through mth vertical lines,
When the direction of the edge is the first horizontal direction, the value decreases from the first vertical weight to the mth vertical weight,
And when the direction of the edge is the second horizontal direction, the value increases from the first vertical weight to the mth vertical weight.
In the third step,
Calculating global depth data of the i-th horizontal line by applying weights to a second edge representative value of the i-th vertical line and a second edge representative value of a plurality of vertical lines adjacent to the i-th vertical line, The global depth map generation method comprising:
A global depth map and a local depth map are generated from input 2D image data, a depth map is generated using a global depth map and a local depth map, and an image processing for generating 3D image data using 2D image data and the depth map Circuit;
A data driving circuit for converting the 3D image data into data voltages and outputting the data voltages to the data lines; And
And a gate driving circuit sequentially outputting gate pulses synchronized with the data voltages to the gate lines,
The image processing circuit comprising:
An edge data conversion unit for converting the 2D image data into edge data, an edge direction determination unit for determining the direction of the edge by analyzing the edge data, and an edge direction determination unit for determining the edge direction in the horizontal direction of the 2D image data, And a global depth data calculation unit for calculating the global depth data by analyzing an edge in the vertical direction of the 2D image data when the direction of the edge is a horizontal direction, And a display unit for displaying the three-dimensional image.
Wherein the global depth map generator comprises:
Further comprising a compressed data generation unit for generating the compressed data by compressing the edge data by 1 / r (r is a natural number of 2 or more) in the horizontal direction.
The edge direction determination unit may determine,
The edge direction data and the edge direction data are calculated using the horizontal direction factor and the vertical direction factor, and the edge direction data and the edge direction data are calculated using the horizontal direction factor and the vertical direction factor, Calculating a direction vector, calculating an accumulated number of the edge direction vectors to generate a histogram, and analyzing the histogram to determine the direction of the edge.
The edge direction determination unit may determine,
(m, n) coordinate and the compressed data adjacent in the horizontal direction to the compressed data in the (m, n) coordinate, the horizontal direction factor of the compressed data in the (m, n) And the smaller the difference between the compressed data at the (m, n) coordinate and the compressed data adjacent to the compressed data at the (m, n) coordinate in the vertical direction, And the factor of the three-dimensional image is largely calculated.
The edge direction determination unit may determine,
(M, n), the horizontal direction factor of the compressed data is Sx (m, n), the vertical direction factor is Sy (m, n) , n)
EI (m, n) represents edge intensity data at the (m, n)
And the three-dimensional image display apparatus.
The edge direction determination unit may determine,
The edge direction data at the (m, n) coordinate is ED (m, n), the horizontal direction factor of the compressed data at the (m, n) , n)
The edge direction data ED (m, n) at the (m, n)
And the three-dimensional image display apparatus.
Wherein the global depth data calculating unit calculates,
N-th horizontal lines of the first through n-th horizontal lines, and a first edge representative value of the first through n-th horizontal lines when the edge direction is the vertical direction, To calculate second edge representative values of the first through n-th horizontal lines,
Wherein the first to nth horizontal weights are increased from the first horizontal weight to the nth horizontal weight.
Wherein the global depth data calculating unit calculates,
And calculates global depth data of the j-th horizontal line by applying weights to a second edge representative value of the j-th horizontal line and a second edge representative value of a plurality of horizontal lines adjacent to the j-th horizontal line, Video display device.
Wherein the global depth data calculating unit calculates,
And calculating a first edge representative value of the first through mth vertical lines when the direction of the edge is the horizontal direction and calculating a first edge representative value of the first through mth vertical lines based on the first through mth vertical weights To calculate a second edge representative value of the first through m th vertical lines,
When the direction of the edge is the first horizontal direction, the value decreases from the first vertical weight to the mth vertical weight,
And when the direction of the edge is the second horizontal direction, the value increases from the first vertical weight to the mth vertical weight.
Wherein the global depth data calculating unit calculates,
Wherein the global depth data of the i-th horizontal line is calculated by applying a weight to a second edge representative value of the i-th vertical line and a second edge representative value of a plurality of vertical lines adjacent to the i- Video display device.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020120136164A KR101996657B1 (en) | 2012-11-28 | 2012-11-28 | Global depth map generation method and stereoscopic image display device using the same |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020120136164A KR101996657B1 (en) | 2012-11-28 | 2012-11-28 | Global depth map generation method and stereoscopic image display device using the same |
Publications (2)
Publication Number | Publication Date |
---|---|
KR20140070856A true KR20140070856A (en) | 2014-06-11 |
KR101996657B1 KR101996657B1 (en) | 2019-10-02 |
Family
ID=51125480
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020120136164A KR101996657B1 (en) | 2012-11-28 | 2012-11-28 | Global depth map generation method and stereoscopic image display device using the same |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR101996657B1 (en) |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20090008808A (en) * | 2007-07-19 | 2009-01-22 | 주식회사 이시티 | Apparatus and method for converting 2d image signals into 3d image signals |
KR20120087867A (en) * | 2012-06-20 | 2012-08-07 | 이광호 | Method for converting 2 dimensional video image into stereoscopic video |
-
2012
- 2012-11-28 KR KR1020120136164A patent/KR101996657B1/en active IP Right Grant
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20090008808A (en) * | 2007-07-19 | 2009-01-22 | 주식회사 이시티 | Apparatus and method for converting 2d image signals into 3d image signals |
KR20120087867A (en) * | 2012-06-20 | 2012-08-07 | 이광호 | Method for converting 2 dimensional video image into stereoscopic video |
Also Published As
Publication number | Publication date |
---|---|
KR101996657B1 (en) | 2019-10-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR101888672B1 (en) | Streoscopic image display device and method for driving thereof | |
US8743111B2 (en) | Stereoscopic image display and method for driving the same | |
KR101869872B1 (en) | Method of multi-view image formation and stereoscopic image display device using the same | |
KR101992163B1 (en) | Stereoscopic image display device and method for driving the same | |
KR20130009173A (en) | Image processing method and stereoscopic image display device using the same | |
KR101963385B1 (en) | Disparity calculation method and stereoscopic image display device | |
KR101990334B1 (en) | Stereoscopic image display device and method for driving the same | |
KR101929042B1 (en) | Disparity calculation unit and stereoscopic image display device including the same and disparity calculation method | |
KR20120127893A (en) | Image processing method and stereoscopic image display device using the same | |
KR101681776B1 (en) | Method of controlling picture quality and display device using the same | |
KR20120040386A (en) | 2d-3d image conversion method and stereoscopic image display using the same | |
KR101996657B1 (en) | Global depth map generation method and stereoscopic image display device using the same | |
KR20140092055A (en) | Stereoscopic image display device and driving method thereof | |
KR101798236B1 (en) | Stereoscopic image display and method of adjusting brightness thereof | |
KR101843197B1 (en) | Method of multi-view image formation and stereoscopic image display device using the same | |
KR101870233B1 (en) | Method for improving 3d image quality and stereoscopic image display using the same | |
KR102022527B1 (en) | Stereoscopic image display device and disparity calculation method thereof | |
KR101961943B1 (en) | 3d image data formation method and stereoscopic image display device using the same | |
KR101843198B1 (en) | Method of multi-view image formation and stereoscopic image display device using the same | |
KR20120015006A (en) | Stereoscopic image display device and driving method the same | |
KR101829466B1 (en) | Stereoscopic image display device | |
KR101983369B1 (en) | Multiview image generation method and stereoscopic image display device using the same | |
KR102126530B1 (en) | 3d conversion method and stereoscopic image display device using the same | |
KR20140073814A (en) | Disparity calculation method and stereoscopic image display device | |
KR101957975B1 (en) | Disparity calculation method and stereoscopic image display device using the same |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A201 | Request for examination | ||
E902 | Notification of reason for refusal | ||
E902 | Notification of reason for refusal | ||
E701 | Decision to grant or registration of patent right |