CN103760980A - Display method, system and device for conducting dynamic adjustment according to positions of two eyes - Google Patents

Display method, system and device for conducting dynamic adjustment according to positions of two eyes Download PDF

Info

Publication number
CN103760980A
CN103760980A CN201410026562.3A CN201410026562A CN103760980A CN 103760980 A CN103760980 A CN 103760980A CN 201410026562 A CN201410026562 A CN 201410026562A CN 103760980 A CN103760980 A CN 103760980A
Authority
CN
China
Prior art keywords
eyes
display
photographic images
display device
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201410026562.3A
Other languages
Chinese (zh)
Inventor
陈永洒
邵诗强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
TCL Corp
Original Assignee
TCL Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by TCL Corp filed Critical TCL Corp
Priority to CN201410026562.3A priority Critical patent/CN103760980A/en
Publication of CN103760980A publication Critical patent/CN103760980A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a display method, system and device for conducting dynamic adjustment according to positions of the two eyes. The method includes the steps of firstly, calibrating two cameras which are installed on a front face plate of the display device; secondly, collecting eye position images through the two cameras; thirdly, processing the eye position images to obtain spatial position data of the two eyes; fourthly, automatically conducting dynamic adjustment on a display interface according to the spatial position data of the two eyes. By collecting the eye position images of the two eyes of a user through the two cameras which are installed on the front face plate of the display device, processing the eye position images to obtain three-dimensional spatial coordinates of the two eyes, judging data such as the distance between the eyes and the display device, and rotation and inclination of the head of the user, generating corresponding adjustment control instruments according to the data, and automatically conducting dynamic adjustment on display content and display settings, the display device is more intelligent and has better interaction performance.

Description

According to eyes position, carry out display packing, system and the display device dynamically adjusted
Technical field
The present invention relates to a kind of field of display devices, in particular a kind of display packing, system and display device that carries out dynamically adjustment according to eyes position.
Background technology
In life, the application of display screen is very general, is bearing to the vital task of people's transmission of information, as all can't do without one flat plate display screen in the digital products such as existing mobile phone, digital camera, Digital Television, panel computer in various fields.But existing display device major part all cannot be for user's the state of checking (if the distance between user's eyes and display device, user's head are with respect to the rotation of display device and inclination etc.) to the content showing with arrange automatically and adjust.
Distance between user's eyes and display device, user's head are with respect to data such as the rotation of display device and inclinations, can obtain by existing technological means, as existing Binocular Stereo Vision System, its principle as shown in Figure 8, by two or the movement of a video camera (CCD) process or the same width scene of rotary taking of diverse location, parallax by computer memory o'clock in two width images, obtains the three dimensional space coordinate value of this point.If described technology is applied in display device, can make display device automatically to displaying contents and demonstration setting, dynamically adjust according to states such as the rotation of the distance of user's eyes and equipment room, user's head and inclinations, make display device more intelligent, there is stronger interactive performance, therefore, prior art has yet to be improved and developed.
Summary of the invention
The object of the invention is to solve above-mentioned deficiency of the prior art, a kind of display packing, system and display device that carries out dynamically adjustment according to eyes position is provided, by display device, obtain the data such as the rotation of distance, user's head of user's eyes and equipment room and inclination, and then to operating system, or/and display device sends, adjust instruction to displaying contents or/and show to arrange and dynamically adjust according to data.
For reaching above-mentioned purpose, the invention provides a kind of display packing of carrying out dynamic adjustment according to eyes position, comprise the following steps:
A, two cameras that are arranged on display device front panel are demarcated;
B, by two camera collection position of human eye images;
C, position of human eye image is processed, obtained the spatial position data of eyes;
D, according to the spatial position data of eyes, automatically display interface is dynamically adjusted.
Display packing of carrying out dynamic adjustment according to eyes position as above, wherein, described step B specifically comprises:
B1, the image of camera collection is carried out to face detection, in detected image, whether has face, if there is face in image, by rectangular area by face locking position, if image does not exist face, inoperation;
B2, human eye detection is carried out in the rectangular area of face in image, by rectangular area, position of human eye is locked.
Display packing of carrying out dynamic adjustment according to eyes position as above, wherein, described step C specifically comprises:
C1, obtain left eye in the first camera photographic images and the position coordinates of right eye, and the position coordinates of the left eye in second camera photographic images and right eye;
C2, to left eye and right eye, the position coordinates in two width camera photographic images mates, obtain left eye position coordinates in the first camera photographic images and second camera photographic images, and right eye position coordinates in the first camera photographic images and second camera photographic images;
Left eye position coordinates and right eye position coordinates in the first camera photographic images and second camera photographic images in the first camera photographic images and second camera photographic images that C3, combination are obtained, and the intrinsic parameter of the Binocular Stereo Vision System of having demarcated and outer parameter, export corresponding left eye three dimensional space coordinate and right eye three dimensional space coordinate.
Display packing of carrying out dynamic adjustment according to eyes position as above, wherein, described step D specifically comprises:
D1, to eyes three dimensional space coordinate analyzing and processing, calculate the distance of eyes mid point and display device display screen, and connect the angle of inclination with respect to the horizontal plane of straight line of eyes, and connect the straight line of eyes with respect to the anglec of rotation of display device display screen;
D2, by the distance of eyes mid point and display device display screen, and the straight line of connection eyes angle of inclination with respect to the horizontal plane, and connect eyes position that the straight line of eyes sets in advance with respect to the anglec of rotation input of display device display screen and the control relation function of display interface, export the steering order to display interface;
D3, operating system and/or display device are adjusted display interface according to the steering order of the display interface receiving.
Display packing of carrying out dynamic adjustment according to eyes position as above, wherein, the dynamic adjustment of described display interface comprises the adjustment of operating system and/or the adjustment of display device of output display content, wherein,
The adjustment of the operating system of described output display content comprises the adjustment of word size, the rotation to picture and/or tilt adjustments;
The adjustment of described display device is corresponding with display device setting operation.
In conjunction with said method, the present invention also provides a kind of and has carried out the dynamically display system of adjustment according to eyes position, comprises the Binocular Stereo Vision System demarcating module being connected successively, position of human eye image capture module, image analysis processing module and demonstration adjusting module, wherein
Binocular Stereo Vision System demarcating module, for demarcating two cameras that are arranged on display device front panel;
Position of human eye image capture module, for passing through two camera collection position of human eye images;
Image analysis processing module, processes position of human eye image, obtains the spatial position data of eyes;
Show adjusting module, according to the spatial position data of eyes, automatically display interface is dynamically adjusted.
Display system of carrying out dynamic adjustment according to eyes position as above, wherein, position of human eye image capture module specifically comprises:
Face locking module, carries out face detection to the image of camera collection, whether has face in detected image, if there is face in image, by rectangular area by face locking position, if image does not exist face, inoperation;
Human eye locking module, carries out human eye detection to the rectangular area of face in image, by rectangular area, position of human eye is locked.
Display system of carrying out dynamic adjustment according to eyes position as above, wherein, described image analysis processing module specifically comprises:
2-D data acquisition module, obtains left eye in the first camera photographic images and the position coordinates of right eye, and the position coordinates of the left eye in second camera photographic images and right eye;
Coordinate matching module, to left eye and right eye, the position coordinates in two width camera photographic images mates, obtain left eye position coordinates in the first camera photographic images and second camera photographic images, and right eye position coordinates in the first camera photographic images and second camera photographic images;
Three-dimensional data acquisition module, in conjunction with the left eye obtaining position coordinates and right eye position coordinates in the first camera photographic images and second camera photographic images in the first camera photographic images and second camera photographic images, and the intrinsic parameter of the Binocular Stereo Vision System of having demarcated and outer parameter, export corresponding left eye three dimensional space coordinate and right eye three dimensional space coordinate.
Display system of carrying out dynamic adjustment according to eyes position as above, wherein, described demonstration adjusting module specifically comprises:
Analytical calculation module, to eyes three dimensional space coordinate analyzing and processing, calculate the distance of eyes mid point and display device display screen, and the straight line of connection eyes angle of inclination with respect to the horizontal plane, and connect the straight line of eyes with respect to the anglec of rotation of display device display screen
Steering order generation module, by the distance of eyes mid point and display device display screen and the straight line that is connected eyes angle of inclination with respect to the horizontal plane, and connect eyes position that the straight line of eyes sets in advance with respect to the anglec of rotation input of display device display screen and the control relation function of display interface, export the steering order to display interface
Instruction respond module, operating system and/or display device are adjusted display interface according to the steering order of the display interface receiving.
According to eyes position, carry out a display device of dynamically adjusting, comprise system as above.
The invention provides a kind of display packing, system and display device that carries out dynamically adjustment according to eyes position, by two camera collection users' binocular images is set at display device front panel, by the processing to image, obtain eyes three dimensional space coordinate, and then judge human eye rotating and the data such as inclination relative to the distance of display device, user's head, according to data, generate corresponding regulating control command, automatically to displaying contents with show to arrange and dynamically adjust, make display device more intelligent, there is stronger interactive performance.
Accompanying drawing explanation
Fig. 1 is that the present invention carries out the display packing process flow diagram of dynamically adjusting according to eyes position.
Fig. 2 is that the present invention carries out the display system architectures figure dynamically adjusting according to eyes position.
Fig. 3 is two camera setting position schematic diagram described in the inventive method one embodiment.
Fig. 4 is two camera image pickup scope schematic diagram described in the inventive method one embodiment.
Fig. 5 is the schematic diagram of the face locking position described in the inventive method one embodiment.
Fig. 6 is the schematic diagram of the position of human eye locking described in the inventive method one embodiment.
Fig. 7 is the human eye three dimensional space coordinate schematic diagram described in the inventive method one embodiment.
Fig. 8 is the schematic diagram that obtains human eye three dimensional space coordinate that the inventive method adopts.
Embodiment
The invention provides a kind of display packing, system and display device that carries out dynamically adjustment according to eyes position, for making object of the present invention, technical scheme and effect clearer, clear and definite, referring to accompanying drawing examples, the present invention is described in more detail.Should be appreciated that specific embodiment described herein, only in order to explain the present invention, is not intended to limit the present invention.
Fig. 1 is that the present invention carries out the display packing process flow diagram of dynamically adjusting according to eyes position.As shown in Figure 1, said method comprising the steps of:
101, two cameras that are arranged on display device front panel are demarcated.
Described step 101, concrete, using before camera, need to demarcate two pieces of cameras on display device front panel, obtain respectively intrinsic parameter and the outer parameter of two pieces of cameras, and the relative tertiary location of camera 1 and camera 2.The method of camera calibration is the known technology of field of machine vision, repeats no more herein.To the demarcation of camera, only need when display device dispatches from the factory, carry out once, without all repeat to demarcate when using at every turn, the calibrating parameters obtaining can be stored in the storage inside device of display device.
102, by two camera collection position of human eye images.
In described step 102, gather position of human eye image and comprise following two steps:
The first, carries out face detection to the image of camera collection, whether has face in detected image, if there is face in image, by rectangular area by face locking position, if image does not exist face, inoperation.
Implementing method step of the present invention needs first at display device front panel, two cameras to be set, camera position can be as Fig. 3 setting, but be not limited to Fig. 3, in Fig. 3, camera 1 and camera 2 are arranged on the top of display device front panel, and be horizontally disposed with, the public field of view of two cameras as shown in Figure 4, image in the public field of view of two camera Real-time Collections, then image is carried out to face detection, the detection of face can realize by human-face detector, in detected image, whether there is face, if there is face in image, can obtain size and the position in image thereof of face rectangular area, and by rectangle frame, the face detecting is locked, specifically as shown in Figure 5, if there is not face, inoperation in image.Due to the position difference at people place, can obtain different location drawing pictures, in these images, only have the image of public field of view to meet, in other words, the image that only has two cameras to take all comprises face and is only and meets.
Another is, human eye detection is carried out in the rectangular area of face in image, by rectangular area, position of human eye is locked.On to the basis of face locking, further the human eye in image is locked, to the detection of human eye, can realize by human eye detection device, when human eye being detected, mark position of human eye with rectangular area, it is locked, specifically as shown in Figure 6, wherein, the position coordinates of human eye can be as the criterion with the center position coordinates of rectangular area.
It is emphasized that, in above-mentioned, the detection of face and the detection of human eye are existing technology, in the application of succeeding of many occasions, the for example human face region automatic focusing function in many photographing devices, it is based on binocular stereo vision principle that the present invention adopts dual camera to take, and this system has been widely used in field of machine vision, and technology is comparatively ripe.
103, position of human eye image is processed, obtained the spatial position data of eyes.
On the basis of step 102, position of human eye image is further processed, obtain the spatial position data of eyes, specifically comprise following three steps:
The first, obtains left eye in the first camera photographic images and the position coordinates of right eye, and the position coordinates of the left eye in second camera photographic images and right eye.This step is for obtaining two position coordinateses at image, and this coordinate is two-dimensional coordinate, as: in the image that camera 1 is gathered, user's left eye and the image coordinate of right eye position are respectively (X l, Y l) and (X r, Y r), in the image that camera 2 gathers, the image coordinate of user's left eye and right eye position is respectively (X l', Y l') and (X r', Y r').
It two is, to left eye and right eye, the position coordinates in two width camera photographic images mates, obtain left eye position coordinates in the first camera photographic images and second camera photographic images, and right eye position coordinates in the first camera photographic images and second camera photographic images.Left eye in photographic images and the position coordinates of right eye in above-mentioned steps, have been obtained, on this basis, by left eye is carried out associated at the first camera photographic images with the position coordinates in second camera photographic images, and right eye is carried out associated at the first camera with the position coordinates in second camera photographic images, can mate eye and the position coordinates of right eye in two width figure, left eye is (X l, Y l)---(X l', Y l'), right eye is (X r, Y r)---(X r', Y r').
It three is, in conjunction with the left eye obtaining position coordinates and right eye position coordinates in the first camera photographic images and second camera photographic images in the first camera photographic images and second camera photographic images, and the intrinsic parameter of the Binocular Stereo Vision System of having demarcated and outer parameter, export corresponding left eye three dimensional space coordinate and right eye three dimensional space coordinate.This step is for obtaining the locus coordinate of eyes, in prior art, Binocular Stereo Vision System is two or the movement of a video camera (CCD) process or the same width scene of rotary taking by diverse location, according to the parallax of the imaging point in two width images of certain spatial point in scene, in conjunction with the calibrating parameters of Binocular Stereo Vision System, based on binocular stereo vision measuring principle, obtain the three dimensional space coordinate value of this spatial point.
104, according to the spatial position data of eyes, automatically display interface is dynamically adjusted.
On the basis of step 103, described step 104, taked following steps:
First, to eyes three dimensional space coordinate analyzing and processing, calculate the distance of eyes mid point and display device display screen, described eyes mid point refers to the centre position of the spatial three-dimensional position of left eye and the spatial three-dimensional position of right eye, i.e. the intermediate point of the line of the point of left eye in space and the point of right eye in space.And the straight line of connection eyes angle of inclination with respect to the horizontal plane, and connect the straight line of eyes with respect to the anglec of rotation of display device display screen.This step is mainly obtained the parameter between the residing locus of eyes and display device, comprise distance, angle of inclination and the anglec of rotation, described distance is the distance of mid point and the display device display screen of eyes, described angle of inclination is straight line and the surface level angulation that connects eyes, and the described anglec of rotation is straight line and the display device display screen plane angulation that connects eyes.Certainly, in implementation process, need set up three-dimensional coordinate system, as shown in Figure 7, the central point that the initial point O that establishes three-dimensional coordinate system is display screen, horizontal direction is left X-axis positive dirction, vertical direction is downwards Y-axis positive dirction, E lpoint and E rpoint represents respectively user's left eye and right eye position, and these 2 volume coordinates in OXYZ coordinate system have been tried to achieve, E lpoint and E rthe distance that the mid point of point is ordered to O just can be for characterizing the distance between user and display device; And E lpoint and E rthe straight line that point is linked to be and the angle of XOY plane can be for characterizing the anglec of rotation of user's head; In addition E, lpoint and E rthe straight line that point is linked to be and the angle of XOZ plane can be for characterizing the angle of inclination of user's head.
It should be noted that, camera real-time image acquisition, image is carried out to analyzing and processing, due to the impact of various noises in each link of testing process, the position coordinates meeting less stable of the eyes that gather in three dimensions, data have jitter phenomenon, in order to suppress this shake, can carry out smoothly the eyes volume coordinate calculating.For example, when the successive image frame of camera collection is processed, can use exponential smoothing wave filter to carry out smoothing processing to the spatial data of eyes:
Figure 385367DEST_PATH_IMAGE001
Wherein,
Figure 378731DEST_PATH_IMAGE002
be the level and smooth coordinate that n two field picture obtains,
Figure 940250DEST_PATH_IMAGE003
for from n two field picture detect obtain without level and smooth coordinate,
Figure 677262DEST_PATH_IMAGE004
be the level and smooth coordinate that n-1 two field picture obtains, for smoothing factor,
Figure 692809DEST_PATH_IMAGE006
, value can according to experiment determine,
Figure 22607DEST_PATH_IMAGE005
value more small data is more level and smooth, but also can to make to lag behind larger simultaneously, and vice versa.
Secondly, by the distance of eyes mid point and display device display screen, and the straight line of connection eyes angle of inclination with respect to the horizontal plane, and connect eyes position that the straight line of eyes sets in advance with respect to the anglec of rotation input of display device display screen and the control relation function of display interface, export the steering order to display interface.For the adjusting of display interface, need the canonical function of a kind of adjusting in advance, this function can be exported the instruction that regulates display interface automatically according to the data of input, different regulative mode correspondences different steering orders, as: the amplification of font with dwindle and can control by Macintosh " Ctrl+[" and " Ctrl+] ", the method of the invention, when amplifying and dwindle, generates corresponding steering order.
Finally, operating system and/or display device are adjusted display interface according to the steering order of the display interface receiving.The adjustment of described display interface comprises the adjustment of operating system and/or the adjustment of display device of output display content, and wherein, the adjustment of the operating system of described output display content comprises the adjustment of word size, the rotation to picture and/or tilt adjustments; The adjustment of described display device is corresponding with display device setting operation.Operating system control be mainly the content of output, as the size of font, the position of demonstration and the rotation of picture and/or inclination etc., the display effect of display device control, as brightness, color etc.For the size adjustment of display font, as: establish when the mid point of user's eyes and the distance of display device display screen central point and be
Figure 666078DEST_PATH_IMAGE007
time, the height of display font is set to
Figure 1244DEST_PATH_IMAGE008
can make user obtain the good impression of watching, can dynamically adjust pro rata according to the variable in distance of the mid point of user's eyes and display device display screen central point the height of display font, in adjustment process, make set width also with height with same ratio adjustment, indeformable to guarantee font, as method of adjustment can adopt formula:
Figure 792483DEST_PATH_IMAGE009
, wherein d is the distance of user's eyes mid point and display device display screen central point, h is the display font height corresponding to the new adjustment apart from d.Thus, when user distance display screen is far away, display font size can increase; Otherwise when user distance display screen is nearer, display font size can reduce, make user can more cosily see the content of demonstration clearly with display screen different distance place.The adjusting of display interface is to carry out according to the steering order receiving, described steering order is to be exported by function, function is exported steering order according to three dimensional space coordinate, owing to three dimensional space coordinate having been carried out smoothly, can make the display frame of adjusting have better fluency and ride comfort.
In addition, it should be noted that, display interface is comprised of system interface and displaying contents, displaying contents is the set of software output content, for these software, by steering order, can control it, in fact, most software, as: QQ, word, browser etc., all support zoom operations order, it is adjusted that the present invention only need generate corresponding steering order according to the variation of eyes position, certainly, system interface is to be exported by operating system, operating system itself is realized by software, we can directly generate the instruction of control operation system overall display interface is adjusted, as control resolution, certainly, if operating system provides the api interface of controlling display interface will make to control better effects if.
Fig. 2 is that the present invention carries out the display system architectures figure dynamically adjusting according to eyes position.As shown in Figure 2, comprise the demarcating module 201 being connected successively, position of human eye image capture module 202, image analysis processing module 203 and demonstration adjusting module 204, wherein,
Described Binocular Stereo Vision System demarcating module 201, for demarcating two cameras that are arranged on display device front panel, as detailed above;
Described position of human eye image capture module 202, for passing through two camera collection position of human eye images, as detailed above;
Described image analysis processing module 203, processes position of human eye image, obtains the spatial position data of eyes, as detailed above;
Described demonstration adjusting module 204, dynamically adjusts display interface automatically according to the spatial position data of eyes, as detailed above.
Display system of carrying out dynamic adjustment according to eyes position as above, wherein, position of human eye image capture module specifically comprises:
Face locking module, carries out face detection to the image of camera collection, whether has face in detected image, if there is face in image, by rectangular area by face locking position, if there is not face in image, inoperation, as detailed above.
Human eye locking module, carries out human eye detection to the rectangular area of face in image, by rectangular area, position of human eye is locked, as detailed above.
Display system of carrying out dynamic adjustment according to eyes position as above, wherein, described image analysis processing module specifically comprises:
2-D data acquisition module, obtains left eye in the first camera photographic images and the position coordinates of right eye, and the position coordinates of the left eye in second camera photographic images and right eye, as detailed above.
Coordinate matching module, to left eye and right eye, the position coordinates in two width camera photographic images mates, obtain left eye position coordinates in the first camera photographic images and second camera photographic images, and right eye position coordinates in the first camera photographic images and second camera photographic images, as detailed above.
Three-dimensional data acquisition module, in conjunction with the left eye obtaining position coordinates and right eye position coordinates in the first camera photographic images and second camera photographic images in the first camera photographic images and second camera photographic images, and the intrinsic parameter of the Binocular Stereo Vision System of having demarcated and outer parameter, export corresponding left eye three dimensional space coordinate and right eye three dimensional space coordinate, as detailed above.
Display system of carrying out dynamic adjustment according to eyes position as above, wherein, described demonstration adjusting module specifically comprises:
Analytical calculation module, to eyes three dimensional space coordinate analyzing and processing, calculate the distance of eyes mid point and display device display screen, and the straight line of connection eyes angle of inclination with respect to the horizontal plane, and connect the straight line of eyes with respect to the anglec of rotation of display device display screen, as detailed above.
Steering order generation module, by the distance of eyes mid point and display device display screen and the straight line that is connected eyes angle of inclination with respect to the horizontal plane, and connect eyes position that the straight line of eyes sets in advance with respect to the anglec of rotation input of display device display screen and the control relation function of display interface, the steering order of output to display interface, as detailed above.
Instruction respond module, operating system and/or display device are adjusted display interface according to the steering order of the display interface receiving, as detailed above.
The present invention also provides a kind of and has carried out the dynamically display device of adjustment according to eyes position, it is characterized in that, comprises system described above.
The invention provides a kind of display packing, system and display device that carries out dynamically adjustment according to eyes position, by two camera collection users' binocular images is set at display device front panel, by the processing to image, obtain eyes three dimensional space coordinate, and then judge human eye rotating and the data such as inclination relative to the distance of display device, user's head, according to data, generate corresponding regulating control command, automatically to displaying contents with show to arrange and dynamically adjust, make display device more intelligent, there is stronger interactive performance.
Should be understood that, application of the present invention is not limited to above-mentioned giving an example, and for those of ordinary skills, can be improved according to the above description or convert, and all these improvement and conversion all should belong to the protection domain of claims of the present invention.

Claims (10)

1. according to eyes position, carry out the display packing of dynamically adjusting, it is characterized in that, comprise the following steps:
A, two cameras that are arranged on display device front panel are demarcated;
B, by two camera collection position of human eye images;
C, position of human eye image is processed, obtained the spatial position data of eyes;
D, according to the spatial position data of eyes, automatically display interface is dynamically adjusted.
2. display packing of carrying out dynamic adjustment according to eyes position according to claim 1, is characterized in that, described step B specifically comprises:
B1, the image of camera collection is carried out to face detection, in detected image, whether has face, if there is face in image, by rectangular area by face locking position, if image does not exist face, inoperation;
B2, human eye detection is carried out in the rectangular area of face in image, by rectangular area, position of human eye is locked.
3. display packing of carrying out dynamic adjustment according to eyes position according to claim 1, is characterized in that, described step C specifically comprises:
C1, obtain left eye in the first camera photographic images and the position coordinates of right eye, and the position coordinates of the left eye in second camera photographic images and right eye;
C2, to left eye and right eye, the position coordinates in two width camera photographic images mates, obtain left eye position coordinates in the first camera photographic images and second camera photographic images, and right eye position coordinates in the first camera photographic images and second camera photographic images;
Left eye position coordinates and right eye position coordinates in the first camera photographic images and second camera photographic images in the first camera photographic images and second camera photographic images that C3, combination are obtained, and the intrinsic parameter of the Binocular Stereo Vision System of having demarcated and outer parameter, export corresponding left eye three dimensional space coordinate and right eye three dimensional space coordinate.
4. display packing of carrying out dynamic adjustment according to eyes position according to claim 1, is characterized in that, described step D specifically comprises:
D1, to eyes three dimensional space coordinate analyzing and processing, calculate the distance of eyes mid point and display device display screen, and connect the angle of inclination with respect to the horizontal plane of straight line of eyes, and connect the straight line of eyes with respect to the anglec of rotation of display device display screen;
D2, by the straight line that calculates the distance of eyes mid point and display device display screen and be connected eyes angle of inclination with respect to the horizontal plane, and connect eyes position that the straight line of eyes sets in advance with respect to the anglec of rotation input of display device display screen and the control relation function of display interface, export the steering order to display interface;
D3, operating system and/or display device are adjusted display interface according to the steering order of the display interface receiving.
5. according to the display packing of carrying out dynamic adjustment according to eyes position described in claim 1 or 4, it is characterized in that, the dynamic adjustment of described display interface comprises the adjustment of operating system and/or the adjustment of display device of output display content, wherein,
The adjustment of the operating system of described output display content comprises the adjustment of word size, the rotation to picture and/or tilt adjustments;
The adjustment of described display device is corresponding with display device setting operation.
6. according to eyes position, carry out a display system of dynamically adjusting, it is characterized in that, comprise the Binocular Stereo Vision System demarcating module being connected successively, position of human eye image capture module, image analysis processing module and demonstration adjusting module, wherein,
Binocular Stereo Vision System demarcating module, for demarcating two cameras that are arranged on display device front panel;
Position of human eye image capture module, for passing through two camera collection position of human eye images;
Image analysis processing module, processes position of human eye image, obtains the spatial position data of eyes;
Show adjusting module, according to the spatial position data of eyes, automatically display interface is dynamically adjusted.
7. display system of carrying out dynamic adjustment according to eyes position according to claim 6, is characterized in that, position of human eye image capture module specifically comprises:
Face locking module, carries out face detection to the image of camera collection, whether has face in detected image, if there is face in image, by rectangular area by face locking position, if image does not exist face, inoperation;
Human eye locking module, carries out human eye detection to the rectangular area of face in image, by rectangular area, position of human eye is locked.
8. display system of carrying out dynamic adjustment according to eyes position according to claim 6, is characterized in that, described image analysis processing module specifically comprises:
2-D data acquisition module, obtains left eye in the first camera photographic images and the position coordinates of right eye, and the position coordinates of the left eye in second camera photographic images and right eye;
Coordinate matching module, to left eye and right eye, the position coordinates in two width camera photographic images mates, obtain left eye position coordinates in the first camera photographic images and second camera photographic images, and right eye position coordinates in the first camera photographic images and second camera photographic images;
Three-dimensional data acquisition module, in conjunction with the left eye obtaining position coordinates and right eye position coordinates in the first camera photographic images and second camera photographic images in the first camera photographic images and second camera photographic images, and the intrinsic parameter of the Binocular Stereo Vision System of having demarcated and outer parameter, export corresponding left eye three dimensional space coordinate and right eye three dimensional space coordinate.
9. display system of carrying out dynamic adjustment according to eyes position according to claim 6, is characterized in that, described demonstration adjusting module specifically comprises:
Analytical calculation module, to eyes three dimensional space coordinate analyzing and processing, calculate the distance of eyes mid point and display device display screen, and the straight line of connection eyes angle of inclination with respect to the horizontal plane, and connect the straight line of eyes with respect to the anglec of rotation of display device display screen
Steering order generation module, by the distance of eyes mid point and display device display screen, and the straight line of connection eyes angle of inclination with respect to the horizontal plane, and connect eyes position that the straight line of eyes sets in advance with respect to the anglec of rotation input of display device display screen and the control relation function of display interface, export the steering order to display interface
Instruction respond module, operating system and/or display device are adjusted display interface according to the steering order of the display interface receiving.
10. according to eyes position, carry out a display device of dynamically adjusting, it is characterized in that, comprise the arbitrary described system of 6-8.
CN201410026562.3A 2014-01-21 2014-01-21 Display method, system and device for conducting dynamic adjustment according to positions of two eyes Pending CN103760980A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410026562.3A CN103760980A (en) 2014-01-21 2014-01-21 Display method, system and device for conducting dynamic adjustment according to positions of two eyes

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410026562.3A CN103760980A (en) 2014-01-21 2014-01-21 Display method, system and device for conducting dynamic adjustment according to positions of two eyes

Publications (1)

Publication Number Publication Date
CN103760980A true CN103760980A (en) 2014-04-30

Family

ID=50528232

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410026562.3A Pending CN103760980A (en) 2014-01-21 2014-01-21 Display method, system and device for conducting dynamic adjustment according to positions of two eyes

Country Status (1)

Country Link
CN (1) CN103760980A (en)

Cited By (41)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104063689A (en) * 2014-06-20 2014-09-24 南京航空航天大学 Face image identification method based on binocular stereoscopic vision
CN104133550A (en) * 2014-06-27 2014-11-05 联想(北京)有限公司 Information processing method and electronic equipment
CN104200195A (en) * 2014-08-12 2014-12-10 上海天奕达电子科技有限公司 Image recognition processing method and system
CN104410882A (en) * 2014-11-28 2015-03-11 苏州福丰科技有限公司 Smart television with three-dimensional face scanning function
CN104539923A (en) * 2014-12-03 2015-04-22 深圳市亿思达科技集团有限公司 Depth-of-field adaptive holographic display method and device thereof
CN104575357A (en) * 2015-01-21 2015-04-29 昆山龙腾光电有限公司 Method and system for stabilizing display picture of handheld equipment and handheld device
CN104683867A (en) * 2015-03-23 2015-06-03 三星电子(中国)研发中心 Method and device for reconfiguring video playing parameter and video playing equipment
CN104881263A (en) * 2015-05-27 2015-09-02 天津三星电子有限公司 Display control method and display equipment
CN105120148A (en) * 2015-08-14 2015-12-02 深圳市金立通信设备有限公司 An automatic focusing method and a terminal
CN105278821A (en) * 2014-07-22 2016-01-27 福建福昕软件开发股份有限公司北京分公司 Method and device for automatically regulating electronic document page
CN105320264A (en) * 2015-05-25 2016-02-10 维沃移动通信有限公司 Mobile terminal display method and mobile terminal
CN105511846A (en) * 2014-09-24 2016-04-20 联想(北京)有限公司 Electronic device and display control method
CN105592367A (en) * 2015-12-23 2016-05-18 青岛海信电器股份有限公司 Image display parameter adjusting method and system
CN105933690A (en) * 2016-04-20 2016-09-07 乐视控股(北京)有限公司 Adaptive method and device for adjusting 3D image content size
CN106254802A (en) * 2016-08-08 2016-12-21 Tcl海外电子(惠州)有限公司 The control method of telescreen viewing location and device
CN106569611A (en) * 2016-11-11 2017-04-19 努比亚技术有限公司 Apparatus and method for adjusting display interface, and terminal
CN106575162A (en) * 2014-09-19 2017-04-19 英特尔公司 Facilitating dynamic eye torsion-based eye tracking on computing devices
CN106648387A (en) * 2016-11-16 2017-05-10 深圳天珑无线科技有限公司 Terminal with shooting function and anti-shake display method thereof
CN106773962A (en) * 2016-12-19 2017-05-31 李业清 The curved screen that can be automatically adjusted
CN107133008A (en) * 2014-09-29 2017-09-05 华勤通讯技术有限公司 The method of mobile terminal adjust automatically output
CN107155099A (en) * 2017-06-06 2017-09-12 苏州佳世达电通有限公司 Display device and its control method
CN107506171A (en) * 2017-08-22 2017-12-22 深圳传音控股有限公司 Audio-frequence player device and its effect adjusting method
CN107797664A (en) * 2017-10-27 2018-03-13 广东欧珀移动通信有限公司 Content display method, device and electronic installation
CN107831902A (en) * 2017-11-23 2018-03-23 腾讯科技(上海)有限公司 A kind of motion control method and its equipment, storage medium, terminal
CN107885325A (en) * 2017-10-23 2018-04-06 上海玮舟微电子科技有限公司 A kind of bore hole 3D display method and control system based on tracing of human eye
CN107975659A (en) * 2017-12-05 2018-05-01 安徽理工大学 A kind of control method for automatically adjusting computer screen location means
CN108388849A (en) * 2018-02-07 2018-08-10 广东欧珀移动通信有限公司 The method and apparatus of the display image of adjustment terminal, electronic equipment, storage medium
CN110162232A (en) * 2018-02-11 2019-08-23 中国移动通信集团终端有限公司 Screen display method, device, equipment and storage medium with display screen
CN110390686A (en) * 2019-07-24 2019-10-29 张天 Naked eye 3D display method and system
CN110727316A (en) * 2019-10-12 2020-01-24 北京硬壳科技有限公司 Method and device for automatically adjusting position of display and display
CN110897604A (en) * 2019-12-26 2020-03-24 深圳市博盛医疗科技有限公司 Laparoscope system for reducing three-dimensional distortion in 3D vision and use method
CN110969984A (en) * 2019-12-02 2020-04-07 英华达(上海)科技有限公司 Dynamic brightness adjusting method, system, equipment and storage medium of display equipment
CN112040316A (en) * 2020-08-26 2020-12-04 深圳创维-Rgb电子有限公司 Video image display method, video image display device, multimedia device and storage medium
CN112799508A (en) * 2021-01-18 2021-05-14 Oppo广东移动通信有限公司 Display method and device, electronic equipment and storage medium
CN112925497A (en) * 2021-03-31 2021-06-08 维沃移动通信有限公司 Content display method and device, electronic equipment and readable storage medium
WO2021110034A1 (en) * 2019-12-05 2021-06-10 北京芯海视界三维科技有限公司 Eye positioning device and method, and 3d display device and method
CN113132642A (en) * 2021-04-26 2021-07-16 维沃移动通信有限公司 Image display method and device and electronic equipment
CN113742012A (en) * 2021-07-23 2021-12-03 上海闻泰信息技术有限公司 Screen display method, device, equipment and storage medium
CN114035673A (en) * 2020-11-18 2022-02-11 武汉联影医疗科技有限公司 Ultrasonic eye movement control system and method
CN114071231A (en) * 2021-10-25 2022-02-18 中国航空无线电电子研究所 Eye position self-adaptive display system and implementation method thereof
WO2023221885A1 (en) * 2022-05-16 2023-11-23 北京芯海视界三维科技有限公司 Display mode determination method and display mode determination apparatus

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008146221A (en) * 2006-12-07 2008-06-26 Sony Corp Image display system
CN101271678A (en) * 2008-04-30 2008-09-24 深圳华为通信技术有限公司 Screen font zooming method and terminal unit
CN101587704A (en) * 2008-05-20 2009-11-25 鸿富锦精密工业(深圳)有限公司 Portable video unit and method for adjusting display font size thereof
CN101609659A (en) * 2008-06-19 2009-12-23 深圳富泰宏精密工业有限公司 Adjust the system and method for resolution of screen
CN101639747A (en) * 2009-08-31 2010-02-03 广东威创视讯科技股份有限公司 Spatial three-dimensional positioning method
CN102043576A (en) * 2009-10-26 2011-05-04 鸿富锦精密工业(深圳)有限公司 System and method for automatically adjusting display picture
CN102436304A (en) * 2011-11-14 2012-05-02 华为技术有限公司 Method and terminal for switching horizontal and vertical display modes of screen
CN102480631A (en) * 2010-11-29 2012-05-30 索尼公司 Information processing apparatus, information processing method and program
CN102740100A (en) * 2011-03-31 2012-10-17 索尼公司 Display control device, display control method, and program
CN102917232A (en) * 2012-10-23 2013-02-06 深圳创维-Rgb电子有限公司 Face recognition based 3D (three dimension) display self-adaptive adjusting method and face recognition based 3D display self-adaptive adjusting device
CN103024191A (en) * 2012-12-21 2013-04-03 广东欧珀移动通信有限公司 Screen rotating method, screen rotating device and mobile terminal
CN103517060A (en) * 2013-09-03 2014-01-15 展讯通信(上海)有限公司 Method and device for display control of terminal device

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008146221A (en) * 2006-12-07 2008-06-26 Sony Corp Image display system
CN101271678A (en) * 2008-04-30 2008-09-24 深圳华为通信技术有限公司 Screen font zooming method and terminal unit
CN101587704A (en) * 2008-05-20 2009-11-25 鸿富锦精密工业(深圳)有限公司 Portable video unit and method for adjusting display font size thereof
CN101609659A (en) * 2008-06-19 2009-12-23 深圳富泰宏精密工业有限公司 Adjust the system and method for resolution of screen
CN101639747A (en) * 2009-08-31 2010-02-03 广东威创视讯科技股份有限公司 Spatial three-dimensional positioning method
CN102043576A (en) * 2009-10-26 2011-05-04 鸿富锦精密工业(深圳)有限公司 System and method for automatically adjusting display picture
CN102480631A (en) * 2010-11-29 2012-05-30 索尼公司 Information processing apparatus, information processing method and program
CN102740100A (en) * 2011-03-31 2012-10-17 索尼公司 Display control device, display control method, and program
CN102436304A (en) * 2011-11-14 2012-05-02 华为技术有限公司 Method and terminal for switching horizontal and vertical display modes of screen
CN102917232A (en) * 2012-10-23 2013-02-06 深圳创维-Rgb电子有限公司 Face recognition based 3D (three dimension) display self-adaptive adjusting method and face recognition based 3D display self-adaptive adjusting device
CN103024191A (en) * 2012-12-21 2013-04-03 广东欧珀移动通信有限公司 Screen rotating method, screen rotating device and mobile terminal
CN103517060A (en) * 2013-09-03 2014-01-15 展讯通信(上海)有限公司 Method and device for display control of terminal device

Cited By (55)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104063689B (en) * 2014-06-20 2017-04-19 南京航空航天大学 Face image identification method based on binocular stereoscopic vision
CN104063689A (en) * 2014-06-20 2014-09-24 南京航空航天大学 Face image identification method based on binocular stereoscopic vision
CN104133550A (en) * 2014-06-27 2014-11-05 联想(北京)有限公司 Information processing method and electronic equipment
CN104133550B (en) * 2014-06-27 2017-05-24 联想(北京)有限公司 Information processing method and electronic equipment
WO2016011787A1 (en) * 2014-07-22 2016-01-28 福建福昕软件开发股份有限公司 Method and apparatus for automatically adjusting electronic document page
CN105278821A (en) * 2014-07-22 2016-01-27 福建福昕软件开发股份有限公司北京分公司 Method and device for automatically regulating electronic document page
CN104200195A (en) * 2014-08-12 2014-12-10 上海天奕达电子科技有限公司 Image recognition processing method and system
CN104200195B (en) * 2014-08-12 2018-07-31 上海卓易科技股份有限公司 A kind of recognition processing method and system
CN106575162B (en) * 2014-09-19 2020-04-07 英特尔公司 Facilitating dynamic eye torsion-based eye tracking on computing devices
CN106575162A (en) * 2014-09-19 2017-04-19 英特尔公司 Facilitating dynamic eye torsion-based eye tracking on computing devices
CN105511846A (en) * 2014-09-24 2016-04-20 联想(北京)有限公司 Electronic device and display control method
CN105511846B (en) * 2014-09-24 2018-12-14 联想(北京)有限公司 Electronic equipment and display control method
CN107133008A (en) * 2014-09-29 2017-09-05 华勤通讯技术有限公司 The method of mobile terminal adjust automatically output
CN104410882A (en) * 2014-11-28 2015-03-11 苏州福丰科技有限公司 Smart television with three-dimensional face scanning function
CN104539923A (en) * 2014-12-03 2015-04-22 深圳市亿思达科技集团有限公司 Depth-of-field adaptive holographic display method and device thereof
CN104575357A (en) * 2015-01-21 2015-04-29 昆山龙腾光电有限公司 Method and system for stabilizing display picture of handheld equipment and handheld device
CN104683867A (en) * 2015-03-23 2015-06-03 三星电子(中国)研发中心 Method and device for reconfiguring video playing parameter and video playing equipment
CN105320264B (en) * 2015-05-25 2019-10-15 维沃移动通信有限公司 A kind of display methods and mobile terminal of mobile terminal
CN105320264A (en) * 2015-05-25 2016-02-10 维沃移动通信有限公司 Mobile terminal display method and mobile terminal
CN104881263A (en) * 2015-05-27 2015-09-02 天津三星电子有限公司 Display control method and display equipment
CN104881263B (en) * 2015-05-27 2018-03-23 天津三星电子有限公司 A kind of display control method and display device
CN105120148A (en) * 2015-08-14 2015-12-02 深圳市金立通信设备有限公司 An automatic focusing method and a terminal
CN105592367A (en) * 2015-12-23 2016-05-18 青岛海信电器股份有限公司 Image display parameter adjusting method and system
CN105933690A (en) * 2016-04-20 2016-09-07 乐视控股(北京)有限公司 Adaptive method and device for adjusting 3D image content size
CN106254802A (en) * 2016-08-08 2016-12-21 Tcl海外电子(惠州)有限公司 The control method of telescreen viewing location and device
CN106569611A (en) * 2016-11-11 2017-04-19 努比亚技术有限公司 Apparatus and method for adjusting display interface, and terminal
CN106648387A (en) * 2016-11-16 2017-05-10 深圳天珑无线科技有限公司 Terminal with shooting function and anti-shake display method thereof
CN106773962A (en) * 2016-12-19 2017-05-31 李业清 The curved screen that can be automatically adjusted
CN107155099A (en) * 2017-06-06 2017-09-12 苏州佳世达电通有限公司 Display device and its control method
CN107506171A (en) * 2017-08-22 2017-12-22 深圳传音控股有限公司 Audio-frequence player device and its effect adjusting method
CN107885325B (en) * 2017-10-23 2020-12-08 张家港康得新光电材料有限公司 Naked eye 3D display method and control system based on human eye tracking
CN107885325A (en) * 2017-10-23 2018-04-06 上海玮舟微电子科技有限公司 A kind of bore hole 3D display method and control system based on tracing of human eye
CN107797664A (en) * 2017-10-27 2018-03-13 广东欧珀移动通信有限公司 Content display method, device and electronic installation
CN107831902A (en) * 2017-11-23 2018-03-23 腾讯科技(上海)有限公司 A kind of motion control method and its equipment, storage medium, terminal
CN107831902B (en) * 2017-11-23 2020-08-25 腾讯科技(上海)有限公司 Motion control method and device, storage medium and terminal
CN107975659A (en) * 2017-12-05 2018-05-01 安徽理工大学 A kind of control method for automatically adjusting computer screen location means
CN108388849B (en) * 2018-02-07 2021-02-02 Oppo广东移动通信有限公司 Method and device for adjusting display image of terminal, electronic equipment and storage medium
CN108388849A (en) * 2018-02-07 2018-08-10 广东欧珀移动通信有限公司 The method and apparatus of the display image of adjustment terminal, electronic equipment, storage medium
CN110162232A (en) * 2018-02-11 2019-08-23 中国移动通信集团终端有限公司 Screen display method, device, equipment and storage medium with display screen
CN110390686A (en) * 2019-07-24 2019-10-29 张天 Naked eye 3D display method and system
CN110727316A (en) * 2019-10-12 2020-01-24 北京硬壳科技有限公司 Method and device for automatically adjusting position of display and display
CN110969984A (en) * 2019-12-02 2020-04-07 英华达(上海)科技有限公司 Dynamic brightness adjusting method, system, equipment and storage medium of display equipment
EP4068769A4 (en) * 2019-12-05 2023-12-20 Beijing Ivisual 3D Technology Co., Ltd. Eye positioning device and method, and 3d display device and method
WO2021110034A1 (en) * 2019-12-05 2021-06-10 北京芯海视界三维科技有限公司 Eye positioning device and method, and 3d display device and method
CN110897604A (en) * 2019-12-26 2020-03-24 深圳市博盛医疗科技有限公司 Laparoscope system for reducing three-dimensional distortion in 3D vision and use method
CN112040316A (en) * 2020-08-26 2020-12-04 深圳创维-Rgb电子有限公司 Video image display method, video image display device, multimedia device and storage medium
CN112040316B (en) * 2020-08-26 2022-05-20 深圳创维-Rgb电子有限公司 Video image display method, device, multimedia equipment and storage medium
CN114035673A (en) * 2020-11-18 2022-02-11 武汉联影医疗科技有限公司 Ultrasonic eye movement control system and method
CN112799508A (en) * 2021-01-18 2021-05-14 Oppo广东移动通信有限公司 Display method and device, electronic equipment and storage medium
CN112925497A (en) * 2021-03-31 2021-06-08 维沃移动通信有限公司 Content display method and device, electronic equipment and readable storage medium
CN113132642A (en) * 2021-04-26 2021-07-16 维沃移动通信有限公司 Image display method and device and electronic equipment
CN113132642B (en) * 2021-04-26 2023-09-26 维沃移动通信有限公司 Image display method and device and electronic equipment
CN113742012A (en) * 2021-07-23 2021-12-03 上海闻泰信息技术有限公司 Screen display method, device, equipment and storage medium
CN114071231A (en) * 2021-10-25 2022-02-18 中国航空无线电电子研究所 Eye position self-adaptive display system and implementation method thereof
WO2023221885A1 (en) * 2022-05-16 2023-11-23 北京芯海视界三维科技有限公司 Display mode determination method and display mode determination apparatus

Similar Documents

Publication Publication Date Title
CN103760980A (en) Display method, system and device for conducting dynamic adjustment according to positions of two eyes
US11388385B2 (en) Primary and auxiliary image capture devices for image processing and related methods
US11106275B2 (en) Virtual 3D methods, systems and software
US10623626B2 (en) Multiple lenses system, operation method and electronic device employing the same
US9965026B2 (en) Interactive video display method, device, and system
US9270941B1 (en) Smart video conferencing system
US8274552B2 (en) Primary and auxiliary image capture devices for image processing and related methods
WO2016065913A1 (en) Video image processing method, device and system
US9299152B2 (en) Systems and methods for image depth map generation
TWI503786B (en) Mobile device and system for generating panoramic video
US8208048B2 (en) Method for high dynamic range imaging
US20120060177A1 (en) Perspective display systems and methods
WO2016191464A1 (en) Omnistereo capture and render of panoramic virtual reality content
US20110025830A1 (en) Methods, systems, and computer-readable storage media for generating stereoscopic content via depth map creation
US9813693B1 (en) Accounting for perspective effects in images
CN109660738B (en) Exposure control method and system based on double cameras
JP2014532206A (en) Interactive screen browsing
US9641800B2 (en) Method and apparatus to present three-dimensional video on a two-dimensional display driven by user interaction
US20100172585A1 (en) Image synthesizing apparatus and method of synthesizing images
US20130088574A1 (en) Detective Adjusting Apparatus for Stereoscopic Image and Related Method
WO2011014421A2 (en) Methods, systems, and computer-readable storage media for generating stereoscopic content via depth map creation
CN114630053B (en) HDR image display method and display device
TW201445977A (en) Image processing method and image processing system
US20120121163A1 (en) 3d display apparatus and method for extracting depth of 3d image thereof
US11087435B1 (en) Adaptive dewarping of wide angle video frames

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20140430