CN102915115A - Method for adjusting display frame by eye - Google Patents
Method for adjusting display frame by eye Download PDFInfo
- Publication number
- CN102915115A CN102915115A CN2012103601699A CN201210360169A CN102915115A CN 102915115 A CN102915115 A CN 102915115A CN 2012103601699 A CN2012103601699 A CN 2012103601699A CN 201210360169 A CN201210360169 A CN 201210360169A CN 102915115 A CN102915115 A CN 102915115A
- Authority
- CN
- China
- Prior art keywords
- pupil
- gray
- position relationship
- camera
- value sum
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 27
- 210000001747 pupil Anatomy 0.000 claims abstract description 48
- 230000003321 amplification Effects 0.000 claims description 5
- 238000003199 nucleic acid amplification method Methods 0.000 claims description 5
- 230000000295 complement effect Effects 0.000 claims description 2
- 230000000694 effects Effects 0.000 abstract description 12
- 238000011161 development Methods 0.000 abstract description 3
- 210000001508 eye Anatomy 0.000 description 22
- 238000005516 engineering process Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000018109 developmental process Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 210000005252 bulbus oculi Anatomy 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011549 displacement method Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000012447 hatching Effects 0.000 description 1
- 230000001795 light effect Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 210000000056 organ Anatomy 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Landscapes
- Telephone Function (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The invention provides a method for adjusting a display frame by an eye. The method comprises the following steps of: S1, identifying the position of the pupil of a human eye; S2, establishing the position relationship between the pupil and an electronic device; and S3, adjusting the display frame according to the position relationship. With the adoption of the method for adjusting the display frame by the eye, the effect of three-dimensional display is realized by using software on the basis of the hardware of the existing cell phone or the electronic device, so that the cost of the development of the three-dimensional display is effectively reduced.
Description
Technical field
The present invention relates to electronic communication technology, relate in particular to the method for adjusting display frame according to eye.
Background technology
In the prior art, the picture that mobile phone or other electronic equipments show mostly is two-dimension picture, and it is static, stiff that display effect seems; Along with the development of technology, some electronic equipment can present three-dimensional visual effect, and the eyes that mainly are based on to the user produce sight equation, need to be equipped with three-dimensional eyes to the electronic configurations three-dimensional display screen or to the user, can increase more cost like this.
Summary of the invention
The invention provides a kind of method of adjusting display frame according to eye.
The method of adjusting display frame according to eye provided by the present invention comprises:
S1 identification human eye pupil position;
S2 sets up the position relationship between pupil and the electronic equipment;
S3 adjusts display frame according to described position relationship.
The method of adjusting display frame according to eye provided by the present invention, can be on the hardware foundation of existing mobile phone or electronic equipment, utilize software to realize the effect of 3-D display, effectively reduce the cost of development of 3-D display, and utilized the human organ feature, utilize the obvious eyes of feature to carry out the vision location, image display technology is also very ripe, is beneficial to quick realization.The present invention can be used as the excessive product of the full intelligence of family, the consumer can arrange threshold range according to self-demand, in the situation that limbs are inconvenient to realize physical contact, utilize eyes to send control information, experience smooth, clear, dynamic mobile phone display effect.
Description of drawings
Fig. 1 adjusts the schematic flow sheet of the method for display frame for what the embodiment of the invention provided according to eye;
Fig. 2 is the concrete steps schematic diagram of the extraction human eye information described in Fig. 1;
Fig. 3 is camera and the position view of pupil position in coordinate system;
The position of 1 camera in coordinate system wherein; The position of 2 pupils in coordinate system;
Fig. 4 is the display effect schematic diagram that human eye is observed in the mobile phone dead ahead;
Fig. 5 is the display effect schematic diagram that human eye is observed in mobile phone right side side;
Fig. 6 is the display effect schematic diagram that human eye is observed in mobile phone left side side.
Wherein, 21 human eyes; Image in 3 mobile phones; The display effect that 31 human eyes are observed in current location.
Embodiment
For the purpose, technical scheme and the advantage that make the embodiment of the invention clearer, below in conjunction with the accompanying drawing in the embodiment of the invention, technical scheme in the embodiment of the invention is clearly and completely described, obviously, described embodiment is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, those of ordinary skills belong to the scope of protection of the invention not making the every other embodiment that obtains under the creative work prerequisite.
As shown in Figure 1, the present embodiment provides a kind of method of adjusting display frame according to eye, comprises the steps:
S1 identification human eye pupil position;
S2 sets up the position relationship between pupil and the electronic equipment;
S3 adjusts display frame according to described position relationship.
It will be appreciated by those skilled in the art that, when observing the display frame of mobile phone or electronic equipment, when the angle of observing not simultaneously, user's pupil position can change, eyeball can rotate thereupon simultaneously, therefore can judge the angle that the user observes mobile phone or electronic equipment according to the position of user's pupil, adjust display frame according to this angle again, present the stereoscopic picture plane corresponding with this viewing angle, like this, a kind of new 3-D display picture technology not only is provided, has also saved the higher cost that configure hardware spends.
The step of described S1 identification human eye pupil position comprises:
S11 utilizes mobile phone or electronic equipment front-facing camera that user's face is taken, thereby obtains face's picture and face's picture is converted to gray-scale map (Gray Scale Image); Described gray-scale map (Gray Scale Image) refers to the image that represents with gray scale.It will be understood by those skilled in the art that any color in the picture,
All formed by Red Green Blue, if the color of certain point was RGB (R, G, B) originally, so, can pass through following several method, be converted into gray scale: floating-point arithmetic Gray=R*0.3+G*0.59+B*0.11; Integer method Gray=(R*30+G*59+B*11)/100; Displacement method Gray=(R*76+G*151+B*28)〉〉 8; Mean value method Gray=(R+G+B)/3; Only get green Gray=G.After trying to achieve Gray by above-mentioned any method, with the R among the original RGB (R, G, B), G, B is unified to be replaced with Gray, forms new color RGB (Gray, Gray, Gray), and original RGB (R, G, B) has just obtained gray-scale map with its replacement.The process that is converted to gray-scale map owing to face's picture that camera is taken is technological means well known in the art, no longer gives unnecessary details here.
S12 divides the search window in described gray-scale map, calculate the gray-scale value sum of pixels all in each search window; It will be understood by those skilled in the art that described search window is the zone that comprises one or more pixels.
S13 compares the gray-scale value sum of all search boxes, finds out two pixel windows of gray-scale value sum minimum, and the zone of these two pixel windows is identified as pupil position.
It will be appreciated by those skilled in the art that, the gray-scale value sum of all pixels is less in the pixel window, illustrate that the field color of this pixel window is darker, and the color of pupil is the darkest part of face color, as long as thereby find the pixel window with minimum gradation value sum, just determined the position of pupil.
In the step of described S1 identification human eye pupil position, after described S13, also comprise the step that pupil position is confirmed, be specially:
S14 amplifies the area in the zone of determined pixel window among the S13; The quantity of the pixel that the quantity of the pixel that the described pixel window after namely amplifying comprises comprises greater than the described pixel window before amplifying.
The gray-scale value sum of all pixels in the described pixel window after S15 calculating is amplified;
The gray-scale value sum of all pixels compares in the pixel window in the described pixel window before S16 will amplify after the gray-scale value sum of all pixels and the amplification, when the two difference during greater than the threshold value set, judge that the zone of the determined pixel window of S13 is pupil position really; When the difference of the two is less than or equal to the threshold value of setting, judge that the zone of the determined pixel window of S13 is not pupil position, the recognition result of S13 is mistake identification.
It will be appreciated by those skilled in the art that, pupil area is less, if the zone of search window is pupil position, then will search for after the window amplification, the zone of non-pupil can be brought in this search box, but not the gray-scale value difference of pupil region and pupil region is larger, thereby the gray-scale value sum of the search window after causing amplifying has obvious increase before amplifying.Otherwise, if the zone of search window is non-pupil position, then can not cause the obvious increase of gray-scale value sum.It will be understood by those skilled in the art that described threshold value can obtain according to the empirical data of repeated detection and arrange.
Search window after the described amplification is 15 * 15(pixel).
Described S2 sets up the step of the position relationship between pupil and the electronic equipment, comprising:
S21 sets up three-dimensional system of coordinate, and the position coordinates of definite camera in coordinate system;
S22 includes the position of pupil in the described coordinate system in, thereby obtains the position coordinates of pupil;
S23 calculates position relationship between described pupil and the camera according to the position coordinates of the position coordinates of described pupil and described camera.
Described S2 sets up the step of the position relationship between pupil and the electronic equipment, after described S23, also comprises:
S24 is according to the position relationship at camera and display screen center, and the position relationship between pupil and the camera calculates the position relationship at pupil and display screen center.Like this, the effect that desirable display frame is adjusted with the position relationship at pupil and display screen center, 3-D effect is better true to nature.
The step that described S3 adjusts display frame according to described position relationship comprises:
The demonstration data that the S31 inquiry is corresponding with described position relationship; Described demonstration data comprise all or part of in angles of display parameter, display size parameter, hatching effect parameter and the light effects parameter.We take camera can identify perpendicular apart from the eyellipse within the 20cm as example, carry out convergent-divergent and mapping according to certain ratio, here suppose for convenience of description the ratio of 1:10, limit the rotating range of screen-picture in the mobile phone, for example the relative camera of eyes to right rotation 10cm, screen-picture is then to anticlockwise 1cm, and display effect such as Fig. 4 are to shown in Figure 6.
Thereby S32 processes picture according to described demonstration data and obtains the image that is complementary with current described pupil position;
Picture after S33 will process shows.
It should be noted that at last: above embodiment only in order to technical scheme of the present invention to be described, is not intended to limit; Although with reference to previous embodiment the present invention is had been described in detail, those of ordinary skill in the art is to be understood that: it still can be made amendment to the technical scheme that aforementioned each embodiment puts down in writing, and perhaps part technical characterictic wherein is equal to replacement; And these modifications or replacement do not make the essence of appropriate technical solution break away from the spirit and scope of various embodiments of the present invention technical scheme.
Claims (7)
1. a method of adjusting display frame according to eye is characterized in that, comprising:
S1 identification human eye pupil position;
S2 sets up the position relationship between pupil and the electronic equipment;
S3 adjusts display frame according to described position relationship.
2. the method for claim 1 is characterized in that, the step of described S1 identification human eye pupil position comprises:
S11 utilizes mobile phone or electronic equipment front-facing camera that user's face is taken, thereby obtains face's picture and face's picture is converted to gray-scale map;
S12 divides several search windows in described gray-scale map, calculate the gray-scale value sum of pixels all in each search window;
S13 compares the gray-scale value sum of all search boxes, finds out two pixel windows of gray-scale value sum minimum, and the zone of these two pixel windows is identified as pupil position.
3. method as claimed in claim 2 is characterized in that, also comprises after the described S13:
S14 amplifies the area in the zone of determined pixel window among the S13;
The gray-scale value sum of all pixels in the described pixel window after S15 calculating is amplified;
The gray-scale value sum of all pixels compares in the pixel window in the described pixel window before S16 will amplify after the gray-scale value sum of all pixels and the amplification, when the two difference during greater than the threshold value set, judge that the zone of the determined pixel window of S13 is pupil position really; When the difference of the two is less than or equal to the threshold value of setting, judge that the zone of the determined pixel window of S13 is not pupil position, the recognition result of S13 is mistake identification.
4. method as claimed in claim 3 is characterized in that, the search window after the described amplification is 15 pixel * 15 pixels.
5. such as each described method in the claim 1 to 4, it is characterized in that, described S2 sets up the step of the position relationship between pupil and the electronic equipment, comprising:
S21 sets up three-dimensional system of coordinate, and the position coordinates of definite camera in coordinate system;
S22 includes the position of pupil in the described coordinate system in, thereby obtains the position coordinates of pupil;
S23 calculates position relationship between described pupil and the camera according to the position coordinates of the position coordinates of described pupil and described camera.
6. method as claimed in claim 5 is characterized in that, also comprises after described S23:
S24 is according to the position relationship at camera and display screen center, and the position relationship between pupil and the camera calculates the position relationship at pupil and display screen center.
7. method as claimed in claim 5 is characterized in that, the step that described S3 adjusts display frame according to described position relationship comprises:
The demonstration data that the S31 inquiry is corresponding with described position relationship;
Thereby S32 processes picture according to described demonstration data and obtains the image that is complementary with current described pupil position;
Picture after S33 will process shows.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012103601699A CN102915115A (en) | 2012-09-25 | 2012-09-25 | Method for adjusting display frame by eye |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012103601699A CN102915115A (en) | 2012-09-25 | 2012-09-25 | Method for adjusting display frame by eye |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102915115A true CN102915115A (en) | 2013-02-06 |
Family
ID=47613512
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2012103601699A Pending CN102915115A (en) | 2012-09-25 | 2012-09-25 | Method for adjusting display frame by eye |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102915115A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103309451A (en) * | 2013-06-20 | 2013-09-18 | 上海华勤通讯技术有限公司 | Mobile terminal and display method thereof |
| CN103327172A (en) * | 2013-04-28 | 2013-09-25 | 华为终端有限公司 | Method and terminal for regulating terminal screen luminance |
| CN105339867A (en) * | 2013-05-24 | 2016-02-17 | 微软技术许可有限责任公司 | Object display with visual verisimilitude |
| CN105425971A (en) * | 2016-01-15 | 2016-03-23 | 中意工业设计（湖南）有限责任公司 | Interaction method and interaction device for eye movement interface and near-eye display |
| CN105607730A (en) * | 2014-11-03 | 2016-05-25 | 航天信息股份有限公司 | Eyeball tracking based enhanced display method and apparatus |
| CN105867616A (en) * | 2016-03-25 | 2016-08-17 | 北京酷云互动科技有限公司 | A display frame transformation method and transformation system |
| CN107133008A (en) * | 2014-09-29 | 2017-09-05 | 华勤通讯技术有限公司 | The method of mobile terminal adjust automatically output |
| CN107272200A (en) * | 2017-05-02 | 2017-10-20 | 北京奇艺世纪科技有限公司 | A kind of focal distance control apparatus, method and VR glasses |
| CN107566639A (en) * | 2017-08-31 | 2018-01-09 | 河南首弘电子科技有限公司 | A kind of mobile phone and its screen magnifying method with enlarging function |
| CN107948430A (en) * | 2017-11-29 | 2018-04-20 | 努比亚技术有限公司 | A kind of display control method, mobile terminal and computer-readable recording medium |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101556694A (en) * | 2009-05-15 | 2009-10-14 | 广东工业大学 | Matching method of rotating images |
| CN101751209A (en) * | 2008-11-28 | 2010-06-23 | 联想(北京)有限公司 | Method and computer for adjusting screen display element |
| CN101807303A (en) * | 2010-03-05 | 2010-08-18 | 北京智安邦科技有限公司 | Tracking device based on multiple-target mean shift |
| CN101893934A (en) * | 2010-06-25 | 2010-11-24 | 宇龙计算机通信科技(深圳)有限公司 | Method and device for intelligently adjusting screen display |
| CN201893934U (en) * | 2010-12-03 | 2011-07-06 | 聂李刚 | Processing machine of microphone sleeve |
| CN102176191A (en) * | 2011-03-23 | 2011-09-07 | 山东大学 | Television control method based on sight-tracking |
| CN102289948A (en) * | 2011-09-02 | 2011-12-21 | 浙江大学 | Multi-characteristic fusion multi-vehicle video tracking method under highway scene |
| CN102640502A (en) * | 2009-10-14 | 2012-08-15 | 诺基亚公司 | Autostereoscopic rendering and display apparatus |
| US20120235893A1 (en) * | 2011-03-18 | 2012-09-20 | Research In Motion Limited | System and method for bendable display |
-
2012
- 2012-09-25 CN CN2012103601699A patent/CN102915115A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101751209A (en) * | 2008-11-28 | 2010-06-23 | 联想(北京)有限公司 | Method and computer for adjusting screen display element |
| CN101556694A (en) * | 2009-05-15 | 2009-10-14 | 广东工业大学 | Matching method of rotating images |
| CN102640502A (en) * | 2009-10-14 | 2012-08-15 | 诺基亚公司 | Autostereoscopic rendering and display apparatus |
| CN101807303A (en) * | 2010-03-05 | 2010-08-18 | 北京智安邦科技有限公司 | Tracking device based on multiple-target mean shift |
| CN101893934A (en) * | 2010-06-25 | 2010-11-24 | 宇龙计算机通信科技(深圳)有限公司 | Method and device for intelligently adjusting screen display |
| CN201893934U (en) * | 2010-12-03 | 2011-07-06 | 聂李刚 | Processing machine of microphone sleeve |
| US20120235893A1 (en) * | 2011-03-18 | 2012-09-20 | Research In Motion Limited | System and method for bendable display |
| CN102176191A (en) * | 2011-03-23 | 2011-09-07 | 山东大学 | Television control method based on sight-tracking |
| CN102289948A (en) * | 2011-09-02 | 2011-12-21 | 浙江大学 | Multi-characteristic fusion multi-vehicle video tracking method under highway scene |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103327172A (en) * | 2013-04-28 | 2013-09-25 | 华为终端有限公司 | Method and terminal for regulating terminal screen luminance |
| CN105339867B (en) * | 2013-05-24 | 2018-09-25 | 微软技术许可有限责任公司 | It is shown using the object of visual vivid |
| CN105339867A (en) * | 2013-05-24 | 2016-02-17 | 微软技术许可有限责任公司 | Object display with visual verisimilitude |
| CN103309451B (en) * | 2013-06-20 | 2016-06-08 | 上海华勤通讯技术有限公司 | The display packing of mobile terminal and mobile terminal |
| CN103309451A (en) * | 2013-06-20 | 2013-09-18 | 上海华勤通讯技术有限公司 | Mobile terminal and display method thereof |
| CN107133008A (en) * | 2014-09-29 | 2017-09-05 | 华勤通讯技术有限公司 | The method of mobile terminal adjust automatically output |
| CN105607730A (en) * | 2014-11-03 | 2016-05-25 | 航天信息股份有限公司 | Eyeball tracking based enhanced display method and apparatus |
| CN105425971A (en) * | 2016-01-15 | 2016-03-23 | 中意工业设计（湖南）有限责任公司 | Interaction method and interaction device for eye movement interface and near-eye display |
| CN105425971B (en) * | 2016-01-15 | 2018-10-26 | 中意工业设计（湖南）有限责任公司 | A kind of exchange method, device and the near-eye display at eye movement interface |
| CN105867616A (en) * | 2016-03-25 | 2016-08-17 | 北京酷云互动科技有限公司 | A display frame transformation method and transformation system |
| CN105867616B (en) * | 2016-03-25 | 2019-11-05 | 北京酷云互动科技有限公司 | Show the transform method and transformation system of picture |
| CN107272200A (en) * | 2017-05-02 | 2017-10-20 | 北京奇艺世纪科技有限公司 | A kind of focal distance control apparatus, method and VR glasses |
| CN107566639A (en) * | 2017-08-31 | 2018-01-09 | 河南首弘电子科技有限公司 | A kind of mobile phone and its screen magnifying method with enlarging function |
| CN107948430A (en) * | 2017-11-29 | 2018-04-20 | 努比亚技术有限公司 | A kind of display control method, mobile terminal and computer-readable recording medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102915115A (en) | Method for adjusting display frame by eye | |
| US10572010B2 (en) | Adaptive parallax adjustment method and virtual reality display device | |
| US9948911B2 (en) | Method and apparatus for efficient depth image transformation | |
| US9872007B2 (en) | Controlling light sources of a directional backlight | |
| CN104539935B (en) | The adjusting method and adjusting means of brightness of image, display device | |
| US20160165205A1 (en) | Holographic displaying method and device based on human eyes tracking | |
| CN112738389B (en) | System and method for providing sliding zoom view synthesis | |
| US20120154376A1 (en) | Tracing-type stereo display apparatus and tracing-type stereo display method | |
| CN103747225B (en) | Based on the high dynamic range images double-screen display method of color space conversion | |
| US11461883B1 (en) | Dirty lens image correction | |
| US20180114353A1 (en) | Integrating Real World Conditions into Virtual Imagery | |
| CN107580209B (en) | A method and device for photographing and imaging of a mobile terminal | |
| US9639991B2 (en) | Augmented reality provision system | |
| US10049608B2 (en) | Video display system, video display device, and video display method | |
| KR102746351B1 (en) | Separable distortion mismatch determination | |
| CN107005670A (en) | Image display, image display system and image display method | |
| US20200029057A1 (en) | Systems and methods for correcting color separation in field-sequential displays | |
| US20130100125A1 (en) | Method, System and Computer Program Product for Enhancing a Depth Map | |
| CN112543318B (en) | 3D display screen compensation method, system and computer readable storage medium | |
| CN109660748A (en) | Image processing method and its system for the correction of eyeball sight | |
| TW201937922A (en) | Scene reconstructing system, scene reconstructing method and non-transitory computer-readable medium | |
| US20190306457A1 (en) | Video communication device and method for video communication | |
| CN105654424B (en) | Adjustment ratio display methods, display system, display device and the terminal of image | |
| WO2018028138A1 (en) | Naked-eye 3d display device and display method therefor | |
| US20190306459A1 (en) | Video communication device and method for video communication |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20130206 |