KR20140079107A - Image display apparatus, and method for operating the same - Google Patents
Image display apparatus, and method for operating the same Download PDFInfo
- Publication number
- KR20140079107A KR20140079107A KR1020120148721A KR20120148721A KR20140079107A KR 20140079107 A KR20140079107 A KR 20140079107A KR 1020120148721 A KR1020120148721 A KR 1020120148721A KR 20120148721 A KR20120148721 A KR 20120148721A KR 20140079107 A KR20140079107 A KR 20140079107A
- Authority
- KR
- South Korea
- Prior art keywords
- image
- eye image
- right eye
- left eye
- error
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N2013/0074—Stereoscopic image analysis
- H04N2013/0081—Depth or disparity estimation from stereoscopic image signals
Abstract
The present invention relates to an image display apparatus and an operation method thereof. A method of operating an image display apparatus according to an embodiment of the present invention includes receiving a left eye image from a first source, receiving a right eye image from a second source different from the first source, Displaying a 3D image using an image, restoring a lost image using a pre-stored depth map when an error of more than an allowable value occurs in any of the received left eye image and right eye image, And displaying the 3D image using the image. This makes it possible to improve the usability of the user.
Description
BACKGROUND OF THE
A video display device is a device having a function of displaying an image that a user can view. The user can view the broadcast through the video display device. A video display device displays a broadcast selected by a user among broadcast signals transmitted from a broadcast station on a display. Currently, broadcasting is changing from analog broadcasting to digital broadcasting around the world.
Digital broadcasting refers to broadcasting in which digital video and audio signals are transmitted. Compared to analog broadcasting, digital broadcasting is strong against external noise and has a small data loss, is advantageous for error correction, has a high resolution, and provides a clear screen. Also, unlike analog broadcasting, digital broadcasting is capable of bidirectional service.
It is an object of the present invention to provide an image display apparatus and an operation method thereof that can improve the usability of the user.
Another object of the present invention is to provide an image display apparatus and a method of operating the same that can stably view a 3D image when one of a left eye image and a right eye image is lost when viewing a 3D image.
According to another aspect of the present invention, there is provided a method of operating a video display device including receiving a left eye image from a first source, receiving a right eye image from a second source different from the first source, Displaying a 3D image using the received left eye image and right eye image, and restoring the lost image using a pre-stored depth map when an error of more than an allowable value occurs in any of the received left eye image and right eye image And displaying the 3D image using the reconstructed image.
According to another aspect of the present invention, there is provided an image display apparatus including a tuner unit for receiving one of a left eye image and a right eye image, a network interface unit for receiving another one of a left eye image and a right eye image, A display for displaying the 3D image using the received left and right eye images and a display for displaying the lost image using the pre-stored depth map when an error of more than an allowable value occurs in any of the received left eye image and right eye image, And reconstructs the 3D image using the reconstructed image.
According to another aspect of the present invention, there is provided an image display apparatus including a broadcast receiver for receiving a left eye image encoded by a first encoding method and a right eye image encoded by a second encoding method, A display for displaying a 3D image using a left eye image and a right eye image and a display unit for restoring the lost image using the pre-stored depth map when an error of more than an allowable value occurs in any of the received left eye image and right eye image, And a controller for controlling the 3D image to be displayed using the reconstructed image.
According to the embodiment of the present invention, when an error of more than a tolerance value occurs in any one of the images during reception of the left eye image and the right eye image from different sources, the lost image is restored using the previously stored depth map, The 3D image is displayed using the image obtained from the 3D image, and the 3D image is stably displayed. Accordingly, the usability of the user can be increased.
In particular, the 3D image is displayed by restoring the lost image by using the image with no loss and the depth map, thereby displaying the 3D image stably and seamlessly when displaying the 3D image. Accordingly, the usability of the user can be increased.
According to another embodiment of the present invention, when receiving the left eye image encoded by the first encoding method and the right eye image encoded by the second encoding method, When an error occurs, the 3D image is displayed stably by restoring the lost image using the pre-stored depth map and displaying the 3D image using the reconstructed image. Accordingly, the usability of the user can be increased.
1 is a view showing an appearance of a video display device of the present invention.
2 is an internal block diagram of an image display apparatus according to an embodiment of the present invention.
3 is an internal block diagram of the control unit of FIG.
4 is a diagram showing various formats of a 3D image.
5 is a diagram showing the operation of the viewing apparatus according to the format of FIG.
6 is a diagram illustrating various scaling methods of a 3D image signal according to an exemplary embodiment of the present invention.
Fig. 7 is a view for explaining how images are formed by the left eye image and the right eye image.
8 is a view for explaining the depth of the 3D image according to the interval between the left eye image and the right eye image.
9 is a flowchart illustrating an operation method of an image display apparatus according to an embodiment of the present invention.
FIGS. 10 to 14B are views referred to explain various examples of the operation method of the image display apparatus of FIG.
Hereinafter, the present invention will be described in detail with reference to the drawings.
The suffix "module" and " part "for components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Accordingly, the terms "module" and "part" may be used interchangeably.
1 is a view showing an appearance of a video display device of the present invention.
Referring to FIG. 1, an
According to the embodiment of the present invention, the
On the other hand, the
At this time, when an error of more than a tolerance value occurs in any of the received left eye image and right eye image, the
Particularly, the
On the other hand, the
Meanwhile, the
2 is an internal block diagram of an image display apparatus according to an embodiment of the present invention.
2, an
The
The
For example, if the selected RF broadcast signal is a digital broadcast signal, it is converted into a digital IF signal (DIF). If the selected RF broadcast signal is an analog broadcast signal, it is converted into an analog baseband image or voice signal (CVBS / SIF). That is, the
The
Meanwhile, the
On the other hand, the
The
The
The stream signal output from the
The external
The external
The A / V input / output unit can receive video and audio signals from an external device. Meanwhile, the wireless communication unit can perform short-range wireless communication with other electronic devices.
The
The
In addition, the
Although the
The user
(Not shown), such as a power key, a channel key, a volume key, and a set value, from the
The
The video signal processed by the
The audio signal processed by the
Although not shown in FIG. 2, the
In addition, the
In addition, the
Meanwhile, the
Meanwhile, the
Such a 3D object may be processed to have a different depth than the image displayed on the
On the other hand, the
Although not shown in the drawing, a channel browsing processing unit for generating a channel signal or a thumbnail image corresponding to an external input signal may be further provided. The channel browsing processing unit receives the stream signal TS output from the
At this time, the thumbnail list may be displayed in a simple view mode displayed on a partial area in a state where a predetermined image is displayed on the
The
The
In order to view the three-dimensional image, the
The single display method can implement a 3D image only on the
In addition, the additional display method can implement a 3D image using an additional display as the
On the other hand, the glasses type can be further divided into a passive type such as a polarizing glasses type and an active type such as a shutter glass type. Also, the head mount display type can be divided into a passive type and an active type.
On the other hand, the
For example, when the
As another example, when the
Meanwhile, the
The
A photographing unit (not shown) photographs the user. The photographing unit (not shown) may be implemented by a single camera, but the present invention is not limited thereto, and may be implemented by a plurality of cameras. On the other hand, the photographing unit (not shown) may be embedded in the
The
The
Meanwhile, a block diagram of the
2, the
On the other hand, the
FIG. 3 is an internal block diagram of the control unit of FIG. 2, FIG. 4 is a diagram illustrating various formats of a 3D image, and FIG. 5 is a diagram illustrating operations of a viewing apparatus according to the format of FIG.
The
The
The
The
The
On the other hand, the image signal decoded by the
For example, when an external video signal input from the external device 190 or a broadcast video signal of a broadcast signal received from the
Meanwhile, the image signal decoded by the
4, the format of the 3D video signal is a side-by-side format (Fig. 4A) in which the left eye image signal L and the right eye image signal R are arranged left and right, A frame sequential format (FIG. 4C) for arranging in a time division manner, an interlaced format (FIG. 4B) for mixing the left eye image signal and the right eye image signal line by line 4d), a checker box format (FIG. 4e) for mixing the left eye image signal and the right eye image signal box by box, and the like.
The
In addition, the
In addition, the
The
The
The
The
A frame rate converter (FRC) 350 can convert the frame rate of an input image. On the other hand, the
The
The
In the present specification, a 3D video signal means a 3D object. Examples of the 3D object include a picuture in picture (PIP) image (still image or moving picture), an EPG indicating broadcasting program information, Icons, texts, objects in images, people, backgrounds, web screens (newspapers, magazines, etc.).
On the other hand, the
5A illustrates operation of the 3D-
That is, when the left eye image L is displayed on the
On the other hand, FIG. 5B illustrates the operation of the 3D-
Meanwhile, the
Although not shown in the drawing, it is also possible that a 3D processor (not shown) for 3-dimensional effect signal processing is further disposed after the
Meanwhile, the audio processing unit (not shown) in the
In addition, the audio processing unit (not shown) in the
The data processing unit (not shown) in the
3, the signals from the
Meanwhile, the block diagram of the
In particular, the
6 is a diagram illustrating various scaling methods of a 3D image signal according to an exemplary embodiment of the present invention.
Referring to the drawing, in order to increase the 3-dimensional effect, the
The
On the other hand, as the slope becomes larger, the difference in length between the parallel sides of the trapezoidal shapes 514, 516 becomes larger as shown in Fig. 6B or 6C, .
The size adjustment or the tilt adjustment may be performed after the 3D image signal is aligned in a predetermined format in the
Although not shown in the drawing, signal processing for a 3D effect (3-dimensional effect) may be performed by adjusting the brightness, tint, and brightness of an image signal or object, It is also possible that signal processing such as color adjustment is performed. For example, it is possible to perform signal processing such as making the near field clear and the far field blurring. The signal processing for the 3D effect may be performed in the
FIG. 7 is a view for explaining how images are formed by a left eye image and a right eye image, and FIG. 8 is a view for explaining depths of a 3D image according to an interval between a left eye image and a right eye image.
First, referring to FIG. 7, a plurality of images or a plurality of
First, the
Next, since the second object 625 includes the second left eye image 621, L and the second right eye image 623, R and overlaps with each other and is displayed on the
Next, the
According to the above-described method, the user recognizes that the
At this time, it is recognized that the
Meanwhile, in the embodiment of the present invention, the distance between the
8, the interval a between the
In this way, when the 3D image is exemplified as the left eye image and the right eye image, the positions recognized as images are different depending on the interval between the left eye image and the right eye image. Accordingly, by adjusting the display intervals of the left eye image and the right eye image, the depth of the 3D image or the 3D object composed of the left eye image and the right eye image can be adjusted.
FIG. 9 is a flowchart illustrating an operation method of an image display apparatus according to an embodiment of the present invention, and FIGS. 10 to 14B are referenced to explain various examples of an operation method of the image display apparatus of FIG.
Referring to FIG. 9, the
The
Alternatively, the
Alternatively, the
That is, the
Meanwhile, the coding method of the left eye image and the right eye image may be different from each other. For example, the left eye image may be an image compressed and transmitted by the first encoding method, and the right eye image may be an image compressed and transmitted by the second encoding method.
Here, the first encoding method is an MPEG-2 encoding method. The second encoding scheme may be an H.264 encoding scheme.
On the other hand, the
Alternatively, the
In this specification, it can be defined that, even if they are received through the same unit, they are received through different sources when different coding schemes are used.
As described above, when 3D broadcasting is transmitted through airwave or cable broadcasting, the left eye image and the right eye image can be transmitted to the
11A shows an image display apparatus in which a
Next, the
The
The
11B illustrates that the parallax between the
The
The depth map is caused by parallax information per object, and can be generated with only luminance information without color information. That is, the higher the brightness level is, the more the object is projected, and the lower the brightness level is, the more the object is depressed.
FIG. 11C illustrates a
Next, the
In the case of the passive system, the
Alternatively, in the active mode, the
FIG. 11D illustrates that a left eye image and a right eye image are simultaneously displayed by a passive method. This enables the user wearing the
Next, the
The
Here, the error of the tolerance value or more may be a concept including a loss error of a predetermined area or more of the image frames of the left eye image or the right eye image, or an error in which the difference between the reception time of the left eye image frame and the right eye image frame is longer than a predetermined time.
12A illustrates a case where the
That is, as shown in FIG. 12B, the
In this case, the
In the depth map, the depth data corresponding to the object stored in the
The
13A illustrates that the reception timings of the
13B, the
In this case, the
The
Next, FIG. 14A illustrates that a loss occurs in some areas of the
In this case, as shown in FIG. 14B, the
The
Although not shown in the drawing, the
On the other hand, if it is determined in step 935 that the error does not occur in the left eye image or the right eye image, a step 950 may be performed. That is, the
In summary, in the embodiment of the present invention, when a loss occurs in either the left eye image or the right eye image received from different sources, the lost image is restored using the pre-stored depth map, .
Fig. 10 shows this series of processes.
That is, during the first period T1 during which the left eye image Sl and the right eye image Sr are received through different sources without error, the
Next, when a loss occurs in the right eye image Sr during the second period T2 between the time Ta and the time Tb, the
Meanwhile, since the left eye image Sl and the right eye image Sr are received without loss during the third period T3 from the time Tb, the
It is to be understood that the present invention is not limited to the configuration and the method of the embodiments described above but may be applied to all or any of the embodiments so that various modifications may be made. Some of which may be selectively combined.
Meanwhile, the operation method of the image display apparatus of the present invention can be implemented as a code that can be read by a processor on a recording medium readable by a processor included in the image display apparatus. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored. Examples of the recording medium that can be read by the processor include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and may also be implemented in the form of a carrier wave such as transmission over the Internet . In addition, the processor-readable recording medium may be distributed over network-connected computer systems so that code readable by the processor in a distributed fashion can be stored and executed.
While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.
Claims (15)
Receiving a right eye image from a second source different from the first source;
Displaying a 3D image using the received left eye image and right eye image;
Reconstructing the lost image using a pre-stored depth map when an error of more than a tolerance value occurs in any one of the received left eye image and right eye image; And
And displaying the 3D image using the reconstructed image. The method of claim 1, wherein the reconstructed image is a 3D image.
Generating the depth map based on the received left and right eye images; And
And storing the generated depth map. The method of claim 1, further comprising:
Wherein the period of displaying the 3D image using the restored image is longer than the period of error occurrence.
In the restoring step,
Wherein the lost image is restored by using one of the received left eye image and right eye image in which no error has occurred and the depth data in the depth map.
In the restoring step,
And restores the lost image so as to have a parallax corresponding to the depth data.
And stopping the 3D image display if an error of more than a tolerance value occurs in both of the received left eye image and right eye image.
If the error exceeds the tolerance,
Wherein a loss error of a predetermined area or more of an image frame of the left eye image or a right eye image or an error of a difference in reception time of the left eye image frame and the right eye image frame is equal to or longer than a predetermined time.
A network interface unit receiving another one of the left eye image and the right eye image;
A display for displaying a 3D image using the received left and right eye images;
And restoring the lost image using the pre-stored depth map when the error in the received left eye image or the right eye image exceeds an allowable error, and controlling the 3D image to be displayed using the restored image And a control unit for controlling the display unit.
Further comprising: a storage unit,
Wherein,
Wherein the depth map generation unit generates the depth map based on the received left and right eye images and stores the generated depth map in the storage unit.
Wherein a period for displaying the 3D image using the reconstructed image is longer than the error occurrence period.
Wherein,
Wherein the restored image is reconstructed using another one of the received left eye image and right eye image in which no error has occurred and the depth data in the depth map.
Wherein,
And restores the lost image so as to have a parallax corresponding to the depth data.
Wherein,
And stops the 3D image display when an error of more than a tolerance value occurs in both of the received left eye image and right eye image.
If the error exceeds the tolerance,
Wherein a loss error of a predetermined area or more of the image frames of the left eye image or the right eye image or an error of a difference in reception time of the left eye image frame and the right eye image frame is equal to or greater than a predetermined time.
A display for displaying a 3D image using the received left and right eye images; And
And restoring the lost image using the pre-stored depth map when the error in the received left eye image or the right eye image exceeds an allowable error, and controlling the 3D image to be displayed using the restored image And a control unit for controlling the display unit.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020120148721A KR20140079107A (en) | 2012-12-18 | 2012-12-18 | Image display apparatus, and method for operating the same |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020120148721A KR20140079107A (en) | 2012-12-18 | 2012-12-18 | Image display apparatus, and method for operating the same |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| KR20140079107A true KR20140079107A (en) | 2014-06-26 |
Family
ID=51130413
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| KR1020120148721A KR20140079107A (en) | 2012-12-18 | 2012-12-18 | Image display apparatus, and method for operating the same |
Country Status (1)
| Country | Link |
|---|---|
| KR (1) | KR20140079107A (en) |
-
2012
- 2012-12-18 KR KR1020120148721A patent/KR20140079107A/en not_active Application Discontinuation
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR20110052771A (en) | Image display device and operating method for the same | |
| KR20120034996A (en) | Image display apparatus, and method for operating the same | |
| US20130057541A1 (en) | Image display apparatus and method for operating the same | |
| EP2574068A2 (en) | Image display apparatus and method for operating the same | |
| US9117387B2 (en) | Image display apparatus and method for operating the same | |
| KR101836846B1 (en) | Image display apparatus, and method for operating the same | |
| KR101741432B1 (en) | Apparatus for displaying image and method for operating the same | |
| KR101730323B1 (en) | Apparatus for viewing image image display apparatus and method for operating the same | |
| KR20120062428A (en) | Image display apparatus, and method for operating the same | |
| KR102014149B1 (en) | Image display apparatus, and method for operating the same | |
| KR20140079107A (en) | Image display apparatus, and method for operating the same | |
| KR101880479B1 (en) | Image display apparatus, and method for operating the same | |
| KR101825669B1 (en) | Image display apparatus, and method for operating the same | |
| KR101890323B1 (en) | Image display apparatus, settop box and method for operating the same | |
| KR20140055124A (en) | Image display apparatus, and method for operating the same | |
| KR101878808B1 (en) | Image display apparatus and method for operating the same | |
| KR20140083544A (en) | Image display apparatus, image transmitting apparatus, and method for operating the same | |
| KR20130076349A (en) | Image display apparatus, and method for operating the same | |
| KR101716144B1 (en) | Image display apparatus, and method for operating the same | |
| KR101882214B1 (en) | Image display apparatus, server and method for operating the same | |
| KR101176500B1 (en) | Image display apparatus, and method for operating the same | |
| KR101737367B1 (en) | Image display apparatus and method for operating the same | |
| KR101691801B1 (en) | Multi vision system | |
| KR20110134087A (en) | Image display apparatus and method for operating the same | |
| KR20130030603A (en) | Image display apparatus, and method for operating the same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| WITN | Withdrawal due to no request for examination |