KR101343551B1 - Three-dimensional image display apparatus adjusting three-dimensional effect using eye blinking - Google Patents

Three-dimensional image display apparatus adjusting three-dimensional effect using eye blinking Download PDF

Info

Publication number
KR101343551B1
KR101343551B1 KR1020120074271A KR20120074271A KR101343551B1 KR 101343551 B1 KR101343551 B1 KR 101343551B1 KR 1020120074271 A KR1020120074271 A KR 1020120074271A KR 20120074271 A KR20120074271 A KR 20120074271A KR 101343551 B1 KR101343551 B1 KR 101343551B1
Authority
KR
South Korea
Prior art keywords
image
dimensional
eye
display apparatus
disparity
Prior art date
Application number
KR1020120074271A
Other languages
Korean (ko)
Inventor
조준동
이동훈
허준회
서남석
이정후
Original Assignee
인텔렉추얼디스커버리 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 인텔렉추얼디스커버리 주식회사 filed Critical 인텔렉추얼디스커버리 주식회사
Priority to KR1020120074271A priority Critical patent/KR101343551B1/en
Application granted granted Critical
Publication of KR101343551B1 publication Critical patent/KR101343551B1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/128—Adjusting depth or disparity
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/144—Processing image signals for flicker reduction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/366—Image reproducers using viewer tracking

Abstract

An image sensor is mounted on three-dimensional glasses for viewing a three-dimensional image to measure eye blinks, and accordingly, visual fatigue is determined to adjust the disparity of the display image. According to an aspect of the present invention, there is provided a three-dimensional image display apparatus comprising: a receiver configured to receive image information from an image sensor external to the display apparatus; A data processor for processing the received image information to derive the number of eye blinks; A fatigue degree determining unit for determining fatigue degree according to the number of eye blinks derived; A disparity adjuster configured to determine a disparity value of the left and right images according to the determined fatigue degree; And a display for displaying a 3D image using the determined disparity value.

Description

Three-dimensional image display apparatus adjusting three-dimensional effect using eye blinking}

The present invention relates to a three-dimensional image display device, and more particularly to a three-dimensional image display device for adjusting the three-dimensional effect through eye blink measurement.

Recent developments of telecommunication and information technology have led to the development of TVs, which are representative household appliances, as smart TVs. Unlike past TVs, which transmit information through the screen and speakers, various types of sensors are embedded in the smart TV, which enables various new interfaces.

Accordingly, various functions are added in addition to information transmission, which is a basic function of a TV, and various services using interactive properties have been developed.

In addition, with the development of multimedia technology, three-dimensional content has been developed and spread, and a three-dimensional TV capable of watching three-dimensional images at home has been spread.

3D content provides a realistic three-dimensional image, so you can enjoy realistic content, but it is difficult to watch for a long time due to the problem of fatigue caused by watching the created three-dimensional image.

Accordingly, attempts have been made to resolve visual fatigue caused by viewing stereoscopic images.

Patent application No. 10-2008-0101086 discloses "a method for driving a stereoscopic display without eye strain and a variable refractive index shutter glasses", in order to eliminate visual fatigue, a plurality of viewpoint images having different viewpoints are generated, and the viewpoints It is a technique of shifting and outputting a plurality of different images by a predetermined interval so as to be input into one left eye pupil and one right eye pupil.

An object of the present invention is to provide a three-dimensional image display device that can reduce the visual fatigue when the user watches a three-dimensional image for a long time as the technical background as described above.

In order to solve this problem, in the present invention, by mounting an image sensor in the three-dimensional glasses for viewing the three-dimensional image to measure the eye blink of the user, according to determine the visual fatigue degree to adjust the disparity of the display image.

That is, the 3D image display device according to an embodiment of the present invention, the receiving unit for receiving image information from an image sensor outside the display device; A data processor for processing the received image information to derive the number of eye blinks; A fatigue degree determining unit for determining fatigue degree according to the number of eye blinks derived; A disparity adjuster configured to determine a disparity value of the left and right images according to the determined fatigue degree; And a display displaying a 3D image using the determined disparity value.

Here, the image sensor is mounted on the three-dimensional glasses for viewing the image displayed on the three-dimensional image display device, the image information received by the receiver is raw data that does not process the information obtained by the image sensor (raw data) is preferable.

The data processor may determine eye blink using a dispersion value of the received image information, or determine eye blink using an average value of the received image information.

According to the present invention, since the user's eye blink is detected to determine the visual fatigue level and the parallax is adjusted accordingly, the user can watch an image corresponding to the visual fatigue degree felt by each user. Therefore, a user can watch a 3D image for a long time without feeling much fatigue.

The small camera or image sensor mounted on the glasses to measure eye blinking is negligible in terms of weight and size, and the small camera or image sensor used for measuring eye blinking is low cost. It can be implemented as.

1 is a view schematically showing the overall configuration of a three-dimensional smart TV system for adjusting the three-dimensional effect by eye blink measurement according to an embodiment of the present invention.
2 is a block diagram showing in more detail the configuration of a three-dimensional smart TV system for adjusting the three-dimensional effect by eye blink measurement according to an embodiment of the present invention.
3 is a flowchart illustrating a method for adjusting image parallax of a 3D smart TV system for adjusting stereoscopic effect through eye blink measurement according to an exemplary embodiment of the present invention.

Advantages and features of the present invention and methods for achieving them will be apparent with reference to the embodiments described below in detail with the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Is provided to fully convey the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims. It is to be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification. It is noted that the terms "comprises" and / or "comprising" used in the specification are intended to be inclusive in a manner similar to the components, steps, operations, and / Or additions.

Hereinafter, with reference to the accompanying drawings will be described in detail with respect to the three-dimensional smart TV system for adjusting the three-dimensional effect by eye blink measurement according to an embodiment of the present invention.

1 is a view schematically showing the overall configuration of a three-dimensional smart TV system for adjusting the three-dimensional effect by eye blink measurement according to an embodiment of the present invention.

As shown in Figure 1, the three-dimensional smart TV system for adjusting the three-dimensional through the eye blink measurement in accordance with an embodiment of the present invention is displayed on the TV 200 and the TV 200 that can display a three-dimensional image 3 It consists of a three-dimensional glasses 100 that the user wears to watch the three-dimensional image.

2 is a block diagram showing in more detail the configuration of a three-dimensional smart TV system for adjusting the three-dimensional effect by eye blink measurement according to an embodiment of the present invention.

As shown in FIG. 2, the 3D glasses 100 of the 3D smart TV system for adjusting the 3D effect through eye blink measurement according to an exemplary embodiment of the present invention include an image sensor 110 and a wireless transmitter 120. .

The parallax adjustment of the 3D image which has been proposed in the past is mostly performed in the TV. However, the parallax adjustment is not tailored to each user, and the parallax is adjusted based on a general average. Therefore, the user may watch an image that does not fit his / her eyes, and in this case, the user may feel a lot of visual fatigue. However, if you adjust the parallax to the individual users without this average parallax adjustment, the fatigue of each user will be reduced.

According to an embodiment of the present invention, the user may obtain a 3D image adjusted to fit each individual. To this end, in the embodiment of the present invention, the image sensor is attached to the three-dimensional glasses that are essentially used to watch the three-dimensional image to measure the blinking of the user.

As the user wears the glasses 100 and the image sensor 120 is operated, the user's eyes are continuously photographed. Shooting at this time is the blink of the user's eyes. If the flicker is severe enough, the eyes are judged to be tired. The image sensor 120 of the eyeglasses 100 photographs the user's eyes and continuously transmits and receives the TV 200, and continuously transmits blinking data to the TV 200. The TV 200 analyzes this data and adjusts the parallax accordingly.

To this end, as shown in FIG. 2, the TV 200 of the 3D smart TV system for adjusting stereoscopic effect through eye blink measurement according to an embodiment of the present invention receives a eye blink information from the eyeglasses 100. 220, a memory 230 for storing the received information, a data processor 240 for processing the received information, a fatigue determination unit 250 for determining the visual fatigue of the user based on the processed data, the determined visual The disparity controller 260 adjusts parallax according to the degree of fatigue, and the display unit 270 displays a 3D image according to the adjusted disparity.

According to the exemplary embodiment of the present invention, when the user increases the amount of blinking of the eyes, the parallax is reduced when the 3D image is output. In addition, if the user's eye flickers or maintains the current state, the disparity is increased or maintained as it is. This allows the user to see the image that is tailored to the user, rather than the average image, and to reduce the visual fatigue even when watching the 3D image for a long time.

3 is a flowchart illustrating a method for adjusting image parallax of a 3D smart TV system for adjusting stereoscopic effect through eye blink measurement according to an exemplary embodiment of the present invention.

As shown in FIG. 3, when the image sensor 110 of the glasses 100 is turned on, the blink of the user is measured (S310). The measured eye blink information is transmitted from the glasses 100 to the TV 200 (S320).

The TV 200 receives eye blink information from the glasses 100 (S330), and determines whether the eye blink is greater than or equal to the reference value based on the received information (S340). If the eye blink is greater than or equal to the reference value (YES in S340), since the visual fatigue of the user may be seen to increase, the parallax of the image is adjusted (S350).

There are no particular limitations on how eye blinks are measured, but some examples are given below.

<Blinking measurement method 1>

The raw data of the image frame captured by the image sensor 110 is directly transmitted to the TV 200.

Next, in order to simplify the calculation without using all the values of the RGB data received from the image sensor 110, the values are converted into gray values (0 to 255).

When a person is opening his or her eyes, gray values are distributed in various ways, such as black eyes, whites, and flesh color around the eyes. In this case, a variety of gray level values exist, and a dispersion value is greatly increased. However, when eyes are closed, most of the frames captured by the image sensor 110 are fleshy. In this case, there is a constant gray level value and the variance value is low.

This feature eliminates the need for large computational techniques such as eye tracking, fatigue estimation by fast blink measurement, and parallax adjustment at the image control. That is, real time is guaranteed.

The dispersion equation for eye blink measurement is as follows.

Figure 112012054450375-pat00001

V: variance value, Pn: n-th pixel data of the current frame,

Fmean: average of pixel data of current frame, n: pixel address

The test value is set as a reference value between the variance value at the time of waking up and the variance value at the time of winding. When the value becomes larger than the reference value and becomes smaller again, it is determined that the eye blink occurs and counts it. At the same time, measure the time when blinking is judged. The degree of fatigue is determined using eye blinks and measured time data.

<Blinking measurement method 2>

The eye flicker measurement uses the same method as the eye flicker measurement method 1 described above, but the average value of the frame, not the variance value, can be used. The average value when the eyes are opened and closed is different. That is, when the eyes are opened, the average value of the brightness data (gray value) of the black part, the white part, and the flesh color of the eyes are different from the average value of the brightness data (gray value) of the flesh colored pixels when the eyes are closed. Can be measured.

While the invention has been described in terms of the preferred embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the invention. Accordingly, the appended claims are intended to embrace all such modifications and variations as fall within the true spirit of the invention.

Claims (5)

A display device for displaying a three-dimensional image,
A receiver configured to receive image information from an image sensor external to the display device;
A data processor for processing the received brightness data of the image information to derive the number of eye blinks;
A fatigue degree determining unit for determining fatigue degree according to the number of eye blinks derived;
A disparity adjusting unit which determines a disparity value of the left and right images according to the determined fatigue degree; And
And a display configured to display a 3D image by using the determined disparity value. The method of claim 1, wherein the image sensor,
And a three-dimensional glasses for viewing an image displayed by the three-dimensional image display apparatus. The image information received by the receiver,
And 3D image display device which is raw data which has not processed information obtained by the image sensor. The method of claim 1, wherein the data processing unit,
3D image display apparatus for determining eye blink using a dispersion value of brightness data of the received image information. The method of claim 1, wherein the data processing unit,
3D image display apparatus for determining eye blink using an average value of the brightness data of the received image information.
KR1020120074271A 2012-07-09 2012-07-09 Three-dimensional image display apparatus adjusting three-dimensional effect using eye blinking KR101343551B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020120074271A KR101343551B1 (en) 2012-07-09 2012-07-09 Three-dimensional image display apparatus adjusting three-dimensional effect using eye blinking

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020120074271A KR101343551B1 (en) 2012-07-09 2012-07-09 Three-dimensional image display apparatus adjusting three-dimensional effect using eye blinking

Publications (1)

Publication Number Publication Date
KR101343551B1 true KR101343551B1 (en) 2013-12-20

Family

ID=49988782

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020120074271A KR101343551B1 (en) 2012-07-09 2012-07-09 Three-dimensional image display apparatus adjusting three-dimensional effect using eye blinking

Country Status (1)

Country Link
KR (1) KR101343551B1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108347594A (en) * 2018-03-09 2018-07-31 京东方科技集团股份有限公司 3D glasses, display server, display, display system and its working method
US10531066B2 (en) 2015-06-30 2020-01-07 Samsung Electronics Co., Ltd Method for displaying 3D image and device for same

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004165708A (en) 2002-09-27 2004-06-10 Sharp Corp Stereoscopic image display apparatus, stereoscopic image encoder, stereoscopic image decoder, stereoscopic image recording method and stereoscopic image transmission method
KR101046259B1 (en) 2010-10-04 2011-07-04 최규호 Stereoscopic image display apparatus according to eye position

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004165708A (en) 2002-09-27 2004-06-10 Sharp Corp Stereoscopic image display apparatus, stereoscopic image encoder, stereoscopic image decoder, stereoscopic image recording method and stereoscopic image transmission method
KR101046259B1 (en) 2010-10-04 2011-07-04 최규호 Stereoscopic image display apparatus according to eye position

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10531066B2 (en) 2015-06-30 2020-01-07 Samsung Electronics Co., Ltd Method for displaying 3D image and device for same
CN108347594A (en) * 2018-03-09 2018-07-31 京东方科技集团股份有限公司 3D glasses, display server, display, display system and its working method

Similar Documents

Publication Publication Date Title
CN111095077B (en) Electronic device with adaptive display
CN105684074B (en) Image display device, image display method, image output device, image output method, and image display system
JP6023801B2 (en) Simulation device
CN106484116B (en) The treating method and apparatus of media file
WO2013191120A1 (en) Image processing device, method, and program, and storage medium
CN104320714B (en) A kind of display device and its vision-control method
JP2011059658A (en) Display device, display method, and computer program
JP2011055421A5 (en)
JP2023525191A (en) Displays that use light sensors to generate environmentally consistent artificial reality content
TWI478146B (en) Method for reducing crosstalk of stereoscopic image and display system thereof
US20140139647A1 (en) Stereoscopic image display device
CN102291588A (en) Method for remote user control for stereoscopic display and device thereof
KR20120030639A (en) Display apparatus and image processing method of the same
CN104185986A (en) Image processing device, image processing method and program
WO2011108287A1 (en) Illumination control device, illumination device and illumination system using illumination control device, and display device and eyeglass device used together with the illumination control device
KR101343551B1 (en) Three-dimensional image display apparatus adjusting three-dimensional effect using eye blinking
JP5400901B2 (en) Glasses device and video system
US11521297B2 (en) Method and device for presenting AR information based on video communication technology
WO2012176683A1 (en) Image display device and image display system
TW201223244A (en) Method and system for displaying stereoscopic images
WO2014057385A3 (en) Personalized optimization of image viewing
KR101449934B1 (en) Stereoscopic glasses and power control method for smart TV using the same
JP2013048358A (en) Viewing system and control method of the same
CN210745404U (en) Wearable visual display device
CN102892023A (en) Display apparatus with 3D structure and control method thereof

Legal Events

Date Code Title Description
N231 Notification of change of applicant
A201 Request for examination
E902 Notification of reason for refusal
E701 Decision to grant or registration of patent right
GRNT Written decision to grant
FPAY Annual fee payment

Payment date: 20161114

Year of fee payment: 4

FPAY Annual fee payment

Payment date: 20171129

Year of fee payment: 5

LAPS Lapse due to unpaid annual fee