CN107566639A - A kind of mobile phone and its screen magnifying method with enlarging function - Google Patents
A kind of mobile phone and its screen magnifying method with enlarging function Download PDFInfo
- Publication number
- CN107566639A CN107566639A CN201710771451.9A CN201710771451A CN107566639A CN 107566639 A CN107566639 A CN 107566639A CN 201710771451 A CN201710771451 A CN 201710771451A CN 107566639 A CN107566639 A CN 107566639A
- Authority
- CN
- China
- Prior art keywords
- human eye
- eye
- screen
- current
- function
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention discloses a kind of mobile phone with enlarging function and its screen magnifying method, in this programme, due to when user uses, collection user the image of screen can be faced as standard eye image first, and the eyeball toroidal function and eye benevolence toroidal function established in three dimensions, that is standard eyeball toroidal function and standard eye benevolence toroidal function and for being demarcated to human eye information, and standard eyes image is constantly updated in whole process.Then the information in the active user's eyes image collected in real time is compared with user's eye information in standard eyes image, so as to judge the displacement of eye and move angle, and then auto zoom is carried out to corresponding position on screen.
Description
Technical field
The present invention relates to technical field of intelligence, more particularly to a kind of mobile phone and its amplification side of screen with enlarging function
Method.
Background technology
With the development of science and technology, various electronic equipments are increasingly popularized in crowd, especially mobile phone, are almost turned into
The indispensable electronic product of human hand.In recent years, with the popularization of smart mobile phone, intelligent machine is closely bound up with the life of people,
And it is widely used in entertaining, learns, navigates.Requirement of the people to intelligent machine also more and more higher, in order to meet people increasingly
The requirement of raising, the intelligent machine of various functions are to emerge in an endless stream.
The time that people are spent on mobile phone is increasingly longer, when using mobile phone, is especially browsing webpage, is checking text
Shelves or during picture, due to the limitation of intelligent machine screen size, often shield that the content of display is extremely limited, and therefore, display content is often
It is smaller.Should one wish to clearer view screen display content, operation is zoomed in and out to screen, just must be often manual
Screen is operated, since growing this, the hand of user is easily tired.And have some interfaces, it can not zoom in and out at all.When with
It is inconvenient when family needs recording-related information.
In addition, existing its zoom mode of this scalable manner is single, removes outside picture and webpage, can only nearly all pass through
System setting carry out font, the size of icon set, and can not according to the change of position relationship between user and screen come pair
Interface carries out auto zoom.
The content of the invention
It is an object of the invention to：For above-mentioned existing mobile phone in use, its screen scaling feature operation it is complicated,
The problem of being unable to auto zoom, the present invention propose a kind of mobile phone and its amplification method with enlarging function.
The technical solution adopted by the present invention is as follows：
A kind of mobile phone with enlarging function, including,
Pattern setup module, for setting amplification mode according to user's request；
Human eye detection module, for detecting the gauged distance between human eye and screen, and determine human eye radian；
Image capture module, for gathering the eyes image of user；
Image processing module, for handling the eyes image of image capture module collection, and extract human eye edge and eye
The positional information at benevolence edge；
Position of human eye judge module, for judging the distance between human eye and screen and human eye angle of inclination, so as to sentence
Disconnected viewpoint of the human eye on screen；
Video adjusting module, for according to set amplification mode, position of human eye judge module judged result,
Testing result apart from detection module adjusts the local scale of screen.
Further, described image acquisition module persistently obtains user's face image according to default time interval.
Further, row distance detection is entered using ultrasonic sensor in human eye detection module.
A kind of mobile phone screen amplification method with enlarging function, comprises the following steps：
(1) system is initialized, the standard position of human eye information and human eye radian when user faces screen is obtained, people is set
The mobile threshold value of eye；
(2) the real-time eyes image of user is gathered, as current frame image, feature extraction is carried out to user's eyes image,
Current position of human eye information is obtained, then calculates human eye displacement and move angle；
(3) if human eye displacement is more than threshold value, viewpoint position of the human eye on screen is judged, and to current human eye
View region carries out local scale；
(4) judge whether to meet termination condition, if it is satisfied, end zoom process, otherwise, performs step (2).
Further, the initialization of step (1) comprises the following steps that：
(11) user sets amplification mode；
(12) fixing point is set in screen, and the positional information of eyes image when collection user faces fixing point is made
For standard position of human eye information and the radian information of eyeball；
(13) extract the function of the eyes image of collection in step (12), including standard eye benevolence toroidal function f (x,
Y, z), standard eyeball toroidal function g (x, y, z), eye benevolence area S, tiltangleθ, human eye and screen between user's eye benevolence and screen
The distance between curtain d, extracts eyeball center O position coordinateses.
Further, in step (2), current position of human eye information includes current eye benevolence toroidal function f ' (x, y, z), current
Tiltangleθ between the real-time eye benevolence area S ' of eyeball toroidal function g ' (x, y, z), user's eye benevolence and screen ', user's eye benevolence and screen
The distance between curtain d ', eyeball center point coordinate O '.
Further, in step (2), the method for calculating human eye displacement and human eye move angle is as follows：
Judge whether current frame image is the first two field picture after initialization, if it is, by current position of human eye information
Contrasted with standard position of human eye information, human eye displacement and human eye move angle are calculated, then by current human eye information
As standard human eye information, otherwise, current human eye information and standard human eye information are contrasted, calculate human eye displacement and
Human eye move angle.
Further, the calculation procedure of human eye displacement is,
(21) the mapping relations ψ (x, y, z) established between current eyeball toroidal function and standard eyeball toroidal function, and root
Current eye benevolence toroidal function f ' (x, y, z) is calculated according to mapping relations ψ (x, y, z)；
(22) standard eye socket center of surface point coordinates P and eye benevolence center of surface point coordinates Q is calculated；
(23) the function h (x, y, z) of the straight line between current eye benevolence central point and the center of circle, and current eye socket and circle are calculated
The function i (x, y, z) of straight line between the heart；Then the angle between function h (x, y, z) and function i (x, y, z) is calculated, that is, is obtained
Obtain Rotation of eyeball angle；
(24) calculated according to step (23) between current view point and eye benevolence and viewpoint of the eye benevolence on screen it is current away from
From；
(25) viewpoint of the current human eye on screen is calculated according to the result of calculation of step (24), and to human eye on screen
Viewpoint carry out local scale.
In summary, by adopting the above-described technical solution, the beneficial effects of the invention are as follows：
1. using the mobile phone of such scheme, automatic row user interface can be entered according to the distance between eyes of user and screen
Amplification, liberated the both hands of user significantly.
2., can be according to the position for the screen that user is seen to screen relevant position carry out office using the mobile phone of such scheme
Amplify in portion.
3. using the mobile phone of such scheme, its zoom control to screen is flexible, disclosure satisfy that different user different zoom
The demand of multiple.
Brief description of the drawings
Examples of the present invention will be described by way of reference to the accompanying drawings, wherein：
Fig. 1 is the structured flowchart of the present invention；
Fig. 2 is the flow chart of the present invention.
Embodiment
All features disclosed in this specification, or disclosed all methods or during the step of, except mutually exclusive
Feature and/or step beyond, can combine in any way.
The present invention is elaborated with reference to Fig. 1, Fig. 2.
A kind of mobile phone with enlarging function, including,
Pattern setup module, for setting amplification mode according to user's request；
Human eye detection module, for detecting the gauged distance between human eye and screen, and determine human eye radian；
Image capture module, for gathering the eyes image of user；
Image processing module, for handling the eyes image of image capture module collection, and extract human eye edge and eye
The positional information at benevolence edge；
Position of human eye judge module, for judging the distance between human eye and screen and human eye angle of inclination, so as to sentence
Disconnected viewpoint of the human eye on screen；
Video adjusting module, for according to set amplification mode, position of human eye judge module judged result,
Testing result apart from detection module adjusts the local scale of screen.
Further, described image acquisition module persistently obtains user's face image according to default time interval.
Further, row distance detection is entered using ultrasonic sensor in human eye detection module.
A kind of mobile phone screen amplification method with enlarging function, comprises the following steps：
(1) system is initialized, the standard position of human eye information and human eye radian when user faces screen is obtained, people is set
The mobile threshold value of eye；
(2) the real-time eyes image of user is gathered, as current frame image, feature extraction is carried out to user's eyes image,
Current position of human eye information is obtained, then calculates human eye displacement and move angle；
(3) if human eye displacement is more than threshold value, viewpoint position of the human eye on screen is judged, and to current human eye
View region carries out local scale；
(4) judge whether to meet termination condition, if it is satisfied, end zoom process, otherwise, performs step (2).
Further, the initialization of step (1) comprises the following steps that：
(11) user sets amplification mode；
(12) fixing point is set in screen, and the positional information of eyes image when collection user faces fixing point is made
For standard position of human eye information and the radian information of eyeball；
(13) extract the function of the eyes image of collection in step (12), including standard eye benevolence toroidal function f (x,
Y, z), standard eyeball toroidal function g (x, y, z), eye benevolence area S, tiltangleθ, human eye and screen between user's eye benevolence and screen
The distance between curtain d, extracts eyeball center O position coordinateses.
Further, in step (2), current position of human eye information includes current eye benevolence toroidal function f ' (x, y, z), current
Tiltangleθ between the real-time eye benevolence area S ' of eyeball toroidal function g ' (x, y, z), user's eye benevolence and screen ', user's eye benevolence and screen
The distance between curtain d ', eyeball center point coordinate O '.
Further, in step (2), the method for calculating human eye displacement and human eye move angle is as follows：
Judge whether current frame image is the first two field picture after initialization, if it is, by current position of human eye information
Contrasted with standard position of human eye information, human eye displacement and human eye move angle are calculated, then by current human eye information
As standard human eye information, otherwise, current human eye information and standard human eye information are contrasted, calculate human eye displacement and
Human eye move angle.
Further, the calculation procedure of human eye displacement is,
(21) the mapping relations ψ (x, y, z) established between current eyeball toroidal function and standard eyeball toroidal function, and root
Current eye benevolence toroidal function f ' (x, y, z) is calculated according to mapping relations ψ (x, y, z)；Its calculation formula is：
F ' (x, y, z)=ψ (x, y, z) * f (x, y, z)
(22) standard eye socket center of surface point coordinates P and eye benevolence center of surface point coordinates Q is calculated；
(23) the function h (x, y, z) of the straight line between current eye benevolence central point and the center of circle, and current eye socket and circle are calculated
The function i (x, y, z) of straight line between the heart；Then the angle between function h (x, y, z) and function i (x, y, z) is calculated, that is, is obtained
Obtain Rotation of eyeball angle, θ (x, y, z)；
(24) calculated according to step (23) between current view point and eye benevolence and viewpoint of the eye benevolence on screen it is current away from
From；
(25) viewpoint of the current human eye on screen is calculated according to the result of calculation of step (24), and to human eye on screen
Viewpoint carry out local scale.
In this programme, due in user in use, can gather user first faces the image of screen as standard people's eye pattern
Picture, and the eyeball toroidal function and eye benevolence toroidal function established in three dimensions, i.e. standard eyeball toroidal function and standard eye benevolence
Toroidal function simultaneously is used for demarcating human eye information, and standard eyes image is constantly updated in whole process.Then will be real
When active user's eyes image for collecting in information be compared with user's eye information in standard eyes image, so as to sentence
The displacement and move angle of disconnected eye, and then auto zoom is carried out to corresponding position on screen.
Claims (8)
- A kind of 1. mobile phone with enlarging function, it is characterised in that including,Pattern setup module, for setting amplification mode according to user's request；Human eye detection module, for detecting the gauged distance between human eye and screen, and determine human eye radian；Image capture module, for gathering the eyes image of user；Image processing module, for handling the eyes image of image capture module collection, and extract human eye eyeball and eye benevolence Positional information；Position of human eye judge module, for judging the distance between human eye and screen and human eye angle of inclination, so as to judge people Viewpoint of the eye on screen；Video adjusting module, for according to the pattern, the judged result of position of human eye judge module, distance detection set The local scale of the testing result adjustment screen of module.
- A kind of 2. mobile phone with enlarging function according to claim 1, it is characterised in that described image acquisition module root User's face image is persistently obtained according to default time interval.
- 3. a kind of mobile phone with enlarging function according to claim 1, it is characterised in that used in human eye detection module Ultrasonic sensor enters row distance detection.
- 4. a kind of mobile phone screen amplification method with enlarging function, it is characterised in that comprise the following steps：(1) system is initialized, standard position of human eye information when user faces screen is obtained and human eye radian, setting human eye moves Dynamic threshold value；(2) the real-time eyes image of user is gathered, as current frame image, feature extraction is carried out to user's eyes image, obtained Current position of human eye information, then calculates human eye displacement and move angle；(3) if human eye displacement is more than threshold value, viewpoint position of the human eye on screen is calculated, and to current human eye viewpoint Region carries out local scale；(4) judge whether to meet termination condition, if it is satisfied, end zoom process, otherwise, performs step (2).
- A kind of 5. mobile phone screen amplification method with enlarging function according to claim 4, it is characterised in that step (1) initialization comprises the following steps that：(11) user sets amplification mode；(12) fixing point is set in screen, and the positional information of eyes image when collection user faces fixing point is used as mark The radian information of quasi- position of human eye information and eyeball；(13) extract the function of the eyes image of collection in step (12), including standard eye benevolence toroidal function f (x, y, Z), tiltangleθ, human eye and the screen between standard eyeball toroidal function g (x, y, z), eye benevolence area S, user's eye benevolence and screen The distance between d, extract eyeball center O position coordinateses.
- A kind of 6. mobile phone screen amplification method with enlarging function according to claim 4, it is characterised in that step (2) in, current position of human eye information includes current eye benevolence toroidal function f ' (x, y, z), current eyeball toroidal function g ' (x, y, z) Tiltangleθ between real-time eye benevolence area S ', user's eye benevolence and screen ', the distance between user's eye benevolence and screen d ', in eyeball Heart point coordinates O '.
- A kind of 7. mobile phone screen amplification method with enlarging function according to claim 4, it is characterised in that step (2) in, the method for calculating human eye displacement and human eye move angle is as follows：Judge current frame image whether be initialization after the first two field picture, if it is, by current position of human eye information with mark Quasi- position of human eye information is contrasted, and calculates human eye displacement and human eye move angle, then using current human eye information as Standard human eye information, otherwise, current human eye information and standard human eye information are contrasted, calculate human eye displacement and human eye Move angle.
- 8. the amplification method of a kind of mobile phone with enlarging function according to claim 7, it is characterised in that human eye moves The calculation procedure of distance is,(21) the mapping relations ψ (x, y, z) established between current eyeball toroidal function and standard eyeball toroidal function, and according to reflecting Penetrate relation ψ (x, y, z) and calculate current eye benevolence toroidal function f ' (x, y, z)；(22) standard eye socket center of surface point coordinates P and eye benevolence center of surface point coordinates Q is calculated；(23) calculate the function h (x, y, z) of the straight line between current eye benevolence central point and the center of circle, and current eye socket and the center of circle it Between straight line function i (x, y, z)；Then the angle between function h (x, y, z) and function i (x, y, z) is calculated, that is, obtains eye Ball rotational angle；(24) current distance between current view point and eye benevolence and viewpoint of the eye benevolence on screen is calculated according to step (23)；(25) viewpoint of the current human eye on screen, and the regarding on screen to human eye are calculated according to the result of calculation of step (24) Point carries out local scale.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710771451.9A CN107566639A (en) | 2017-08-31 | 2017-08-31 | A kind of mobile phone and its screen magnifying method with enlarging function |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710771451.9A CN107566639A (en) | 2017-08-31 | 2017-08-31 | A kind of mobile phone and its screen magnifying method with enlarging function |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107566639A true CN107566639A (en) | 2018-01-09 |
Family
ID=60978434
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710771451.9A Pending CN107566639A (en) | 2017-08-31 | 2017-08-31 | A kind of mobile phone and its screen magnifying method with enlarging function |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107566639A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108255299A (en) * | 2018-01-10 | 2018-07-06 | 京东方科技集团股份有限公司 | A kind of image processing method and device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102842301A (en) * | 2012-08-21 | 2012-12-26 | 京东方科技集团股份有限公司 | Display frame adjusting device, display device and display method |
| CN102915115A (en) * | 2012-09-25 | 2013-02-06 | 上海华勤通讯技术有限公司 | Method for adjusting display frame by eye |
| CN102981620A (en) * | 2012-11-27 | 2013-03-20 | 中兴通讯股份有限公司 | Terminal operation method and terminal |
| WO2013168171A1 (en) * | 2012-05-10 | 2013-11-14 | Umoove Services Ltd. | Method for gesture-based operation control |
| CN103399636A (en) * | 2013-07-30 | 2013-11-20 | 深圳市中兴移动通信有限公司 | Method and device for adjusting terminal font through eye motion |
| CN104749980A (en) * | 2015-03-17 | 2015-07-01 | 联想(北京)有限公司 | Display control method and electronic equipment |
| CN106791135A (en) * | 2016-12-29 | 2017-05-31 | 努比亚技术有限公司 | A kind of automatic local Zoom display method and mobile terminal |
-
2017
- 2017-08-31 CN CN201710771451.9A patent/CN107566639A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013168171A1 (en) * | 2012-05-10 | 2013-11-14 | Umoove Services Ltd. | Method for gesture-based operation control |
| CN102842301A (en) * | 2012-08-21 | 2012-12-26 | 京东方科技集团股份有限公司 | Display frame adjusting device, display device and display method |
| CN102915115A (en) * | 2012-09-25 | 2013-02-06 | 上海华勤通讯技术有限公司 | Method for adjusting display frame by eye |
| CN102981620A (en) * | 2012-11-27 | 2013-03-20 | 中兴通讯股份有限公司 | Terminal operation method and terminal |
| CN103399636A (en) * | 2013-07-30 | 2013-11-20 | 深圳市中兴移动通信有限公司 | Method and device for adjusting terminal font through eye motion |
| CN104749980A (en) * | 2015-03-17 | 2015-07-01 | 联想(北京)有限公司 | Display control method and electronic equipment |
| CN106791135A (en) * | 2016-12-29 | 2017-05-31 | 努比亚技术有限公司 | A kind of automatic local Zoom display method and mobile terminal |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108255299A (en) * | 2018-01-10 | 2018-07-06 | 京东方科技集团股份有限公司 | A kind of image processing method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10157477B2 (en) | Robust head pose estimation with a depth camera | |
| CN111182205B (en) | Photographing method, electronic device, and medium | |
| US10126834B2 (en) | Electronic device and a method for controlling the functions of the electronic device as well as program product for implementing the method | |
| US9413967B2 (en) | Apparatus and method for photographing an image using photographing guide | |
| CN105787884A (en) | Image processing method and electronic device | |
| WO2011158511A1 (en) | Instruction input device, instruction input method, program, recording medium and integrated circuit | |
| US9930269B2 (en) | Apparatus and method for processing image in device having camera | |
| CN109800676B (en) | Gesture recognition method and system based on depth information | |
| WO2004066097A3 (en) | Gaze tracking system and method | |
| US20140300570A1 (en) | Mobile information processing terminal | |
| WO2021035646A1 (en) | Wearable device and control method therefor, gesture recognition method, and control system | |
| CN109839827B (en) | Gesture recognition intelligent household control system based on full-space position information | |
| CN104850842A (en) | Mobile terminal iris identification man-machine interaction method | |
| CN107797648B (en) | Virtual touch system, image recognition positioning method and computer-readable storage medium | |
| CN113903078A (en) | Human eye gaze detection method, control method and related equipment | |
| WO2010142455A2 (en) | Method for determining the position of an object in an image, for determining an attitude of a persons face and method for controlling an input device based on the detection of attitude or eye gaze | |
| CN107527353B (en) | Projection picture outer frame detection method based on visual processing | |
| WO2023029113A1 (en) | Image splicing method, terminal device, and computer-readable storage medium | |
| CN109947243B (en) | Intelligent electronic equipment gesture capturing and recognizing technology based on touch hand detection | |
| JPWO2018146922A1 (en) | Information processing apparatus, information processing method, and program | |
| CN107436675A (en) | A kind of visual interactive method, system and equipment | |
| CN107566639A (en) | A kind of mobile phone and its screen magnifying method with enlarging function | |
| CN111050081B (en) | Shooting method and electronic equipment | |
| CN108227923A (en) | A kind of virtual touch-control system and method based on body-sensing technology | |
| US10824237B2 (en) | Screen display control method and screen display control system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180109 |