CN103760975B - A kind of method of tracing and positioning face and display system - Google Patents
A kind of method of tracing and positioning face and display system Download PDFInfo
- Publication number
- CN103760975B CN103760975B CN201410002101.2A CN201410002101A CN103760975B CN 103760975 B CN103760975 B CN 103760975B CN 201410002101 A CN201410002101 A CN 201410002101A CN 103760975 B CN103760975 B CN 103760975B
- Authority
- CN
- China
- Prior art keywords
- line segment
- actual
- point
- user
- display screen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The invention discloses method and the display system of a kind of tracing and positioning face, the method includes: S0: at least four line segments formed by multiple fixed reference feature points, it is set to first with reference to line segment, the second reference line segment, the 3rd reference line segment and the 4th with reference to line segment, a comparison reference point is set；S1: form first actual line segment, second actual line segment, threeth actual line segment and the fourth actual line segment corresponding with reference to line segment, an actual comparison point is set；S2: the ratio comparing the first actual line segment and the ratio of the second actual line segment and the first reference line segment and the second reference line segment is the most identical；S3: the ratio comparing the 3rd actual line segment and the ratio of the 4th actual line segment and the 3rd reference line segment and the 4th reference line segment is the most identical；S4: the relatively position of actual comparison point is the most identical with the position of comparison reference point.Enforcement the invention has the beneficial effects as follows, it is possible to accurately tracing and positioning face.
Description
Technical field
The present invention relates to electronic device field, more particularly, it relates to one chases after by adjusting screen position
The method of track locating human face and display system.
Background technology
Electronic installation has the display screen for user's viewing, and it is widely used in and includes notebook individual electricity
In the various terminating machines such as brain, desktop personal computer, all-in-one, only when user relative to this electronic installation at
When optimal viewing angle, its viewing effect is the most best.At present when the direction of electronic installation is constant user due to certain
Plant and need to change face towards when using this electronic installation, although there is also and adjust according to face location change
The method that the whole position of electronic installation display screen and the position of face adapt, but it is the most multiple to realize process
Miscellaneous, calculate relatively complicated, it is difficult to realize being accurately positioned, affect user's impression, the use reducing user is pleased
Happy sense.
Summary of the invention
The technical problem to be solved in the present invention is, changes according to face location present in prior art
Adjust electronic installation screen position complex with the method that face location adapts, it is difficult to realize accurately
The defect of location, it is provided that it is simple that one realizes process, and accurately can follow the trail of by adjusting screen position
The method of locating human face, described method comprises the steps:
S0: by camera collection user's face image, extracts and stores and the pre-determined bit in face image
Put the most corresponding multiple fixed reference feature points, according to predetermined rule by biphase for the plurality of fixed reference feature point two
Even form first with reference to line segment, the second reference line segment, the 3rd reference line segment and the 4th with reference to line segment, note
Record the length of this first to fourth reference line segment, and from the plurality of fixed reference feature point, select a comparison ginseng
Examination point；
S1: during again by camera collection user's face image, from the user's face image collected
Extract the fact characteristic point that correspond to the identical precalculated position in face image with described fixed reference feature point；By institute
State fact characteristic point be connected to form two-by-two with described first to fourth with reference to the first actual line segment corresponding to line segment,
Second actual line segment, the 3rd actual line segment and the 4th actual line segment, and by described fact characteristic point with institute
State comparison reference point to correspond to the fact characteristic point in the identical precalculated position in face image and be set to actual ratio
To point；
S2: compare the first actual line segment and the ratio of the second actual line segment and first with reference to line segment and the second ginseng
The ratio examining line segment is the most identical, if identical, then performs next sub-step；If differing, then adjust aobvious
Display screen tilts forward and back angle；
S3: compare the 3rd actual line segment and the ratio of the 4th actual line segment and the 3rd with reference to line segment and the 4th ginseng
The ratio examining line segment is the most identical, if identical, then performs next sub-step；If differing, then adjust aobvious
Display screen horizontal rotation angle；
S4: the relatively position of actual comparison point is the most identical with the position of comparison reference point, if identical, then
Adjustment completes, if differing, then adjusts display screen vertical height.
In the method for above-mentioned tracing and positioning face, described step S1 also includes: if photographic head cannot gather
To the fact characteristic point that all and described fixed reference feature point is identical, then provide user's not carrying in adjusting range
Show.
In the method for above-mentioned tracing and positioning face, also include between described step S1 and described step S2:
S12: according to the horizontal range that relatively the actual position of comparison point and the position calculation of comparison reference point go out
And vertical dimension, it is sequentially adjusted in display screen horizontal rotation angle, vertical height and tilts forward and back angle, directly
To meeting: the position of actual comparison point is identical with comparison reference point locations.
In the method for above-mentioned tracing and positioning face, described step S2 also includes: if cannot be aobvious by adjusting
Display screen tilt forward and back angle make the first actual line segment and the ratio of the second actual line segment and first with reference to line segment and
When the ratio of the second reference line segment is identical, then provide user's prompting not in adjusting range；
In the method for above-mentioned tracing and positioning face, described step S3 also includes: if cannot be aobvious by adjusting
Display screen horizontal rotation angle make the 3rd actual line segment and the ratio of the 4th actual line segment and the 3rd with reference to line segment and
When the ratio of the 4th reference line segment is identical, then provide user's prompting not in adjusting range；
In the method for above-mentioned tracing and positioning face, described step S4 also includes: if cannot be aobvious by adjusting
When display screen vertical height makes the position of comparison reference point identical with the position of actual comparison point, then provide user not
Prompting in adjusting range.
In the method for above-mentioned tracing and positioning face, from user's face image of camera collection obtain multiple
Fixed reference feature point is user eyeball position A0 and B0, nose position C0 and the end points of user two corners of the mouth
X0 and Y0；Actual fixed reference feature point is user eyeball position A1 and B1, nose position C1 and user
End points X1 and Y1 of two corners of the mouths；
Wherein, described first reference line segment is A0 and the line segment AB0 of B0 formation, and second with reference to line segment is
The line segment XY0 that X0 and Y0 is formed, the 3rd reference line segment is A0 and the line segment AC0 of C0 formation, the 4th
Being B0 and the line segment BC0 of C0 formation with reference to line segment, comparison reference point is C0；First actual line segment is
The line segment AB1 that A1 and B1 is formed, the second actual line segment is X1 and the line segment XY1 of Y1 formation, the 3rd
Actual line segment is A1 and the line segment AC1 of C1 formation, and the 4th actual line segment is B1 and the line segment of C1 formation
BC1, actual comparison point is C1.
In the method for above-mentioned tracing and positioning face, from user's face image of camera collection obtain multiple
Fixed reference feature point is user eyeball position A0 and B0, nose position C0, the end points X0 of user two corners of the mouth
With Y0 and end points D0 and E0 of user's nose both sides；Fact characteristic point be user eyeball position A1 and
B1, nose position C1, end points X1 and Y1 of user two corners of the mouth and the end points D1 of user's nose both sides
And E1；
Wherein, described first reference line segment is A0 and the line segment AB0 of B0 formation, and second with reference to line segment is
The line segment XY0 that X0 and Y0 is formed, the 3rd reference line segment is A0 and the line segment AD0 of D0 formation, the 4th
Being B0 and the line segment BE0 of E0 formation with reference to line segment, comparison reference point is C0；Described first actual line segment
The line segment AB1 formed for A1 and B1, the second actual line segment is X1 and the line segment XY1 of Y1 formation,
3rd actual line segment be A1 and D1 formed line segment AD1, the 4th actual line segment be B1 and E1 formation
Line segment BE1, actual comparison point is C1.
Also provide for a kind of display system, including display screen, photographic head, central processing unit and driving module；
Described central processing unit includes feature point extraction unit, the first comparing unit, the second comparing unit and the 3rd
Comparing unit；
Described photographic head is used for gathering user's face image, and is transferred to described central processing unit；
Described feature point extraction unit is used for receiving user's face image, extracts identical with described fixed reference feature point
Fact characteristic point；According to predetermined rule, described fact characteristic point is connected two-by-two and is formed and described first
To the 4th with reference to the first actual line segment corresponding to line segment, the second actual line segment, the 3rd actual line segment and the 4th
Actual line segment, and identical by described fact characteristic point correspond in face image with described comparison reference point
The fact characteristic point in precalculated position is set to actual comparison point；；
Described first comparing unit is for comparing the first actual line segment and the ratio and first of the second actual line segment
The most identical with reference to the ratio of line segment with reference to line segment and second, if differing, then output is used for adjusting display screen
Tilt forward and back the signal of angle to described driving module；
Described second comparing unit is for comparing the 3rd actual line segment and the ratio and the 3rd of the 4th actual line segment
The most identical with reference to the ratio of line segment with reference to line segment and the 4th, if differing, then output is used for adjusting display screen
The signal of horizontal rotation angle gives described driving module；
For the position of the position of relatively actual comparison point and comparison reference point whether described 3rd comparing unit
Identical, if differing, then output is for adjusting the signal of display screen vertical height to described driving module；
Described driving module is for driving display screen to rotate and/or lifting according to the signal received.
Implement method and the display system of the tracing and positioning face of the present invention, have the advantages that basis
In at least four actual line segments that the user's face image characteristic point extracted is formed, compare the first actual line
Section is the most identical with the ratio of the ratio of the second actual line segment and the first reference line segment and the second reference line segment, ratio
Relatively the 3rd actual line segment and the ratio of the 4th actual line segment and the 3rd are with reference to line segment and the ratio of the 4th reference line segment
The most identical and relatively actual comparison point the position of value is the most identical with the position of comparison reference point to be adjusted
Screen position, reaches the purpose of accurate tracing and positioning face, and it is simple to realize process, it is possible to face
It is accurately positioned, uses to user and offer convenience.
Accompanying drawing explanation
Below in conjunction with drawings and Examples, the invention will be further described, in accompanying drawing:
Fig. 1 is the flow chart of the method for the present invention a kind of tracing and positioning face；
Fig. 2 is that the critical data point of user's face image that the present invention the first preferred embodiment provides is formed
Characteristic pattern；
Fig. 3 is the flow chart that the present invention the first preferred embodiment provides；
Fig. 4 is that the critical data point of user's face image that the present invention the second preferred embodiment provides is formed
Characteristic pattern；
Fig. 5 is the flow chart that the present invention the second preferred embodiment provides；
Fig. 6 is the structural representation of a kind of display system of the present invention.
Detailed description of the invention
In order to be more clearly understood from the technical characteristic of the present invention, purpose and effect, now comparison accompanying drawing is detailed
Describe the detailed description of the invention of the bright present invention in detail.
Fig. 1 is the flow chart of the method for the present invention a kind of tracing and positioning face, and method comprises the steps: main
Comprise the steps:
S0: beforehand through camera collection user's face image, that extracts and store with face image is pre-
The most corresponding multiple fixed reference feature points and storage are put according to pre-defined rule by multiple fixed reference feature points in location
Be connected and at least four line segments being formed two-by-two, be respectively set to first with reference to line segment, second with reference to line segment,
3rd with reference to line segment and the 4th reference line segment, and record first to fourth is with reference to the length of line segment and many from this
Individual fixed reference feature point selects a comparison reference point；
S1: during again by camera collection user's face image, extracts from the user images collected
The actual spy of the fact characteristic point in identical precalculated position in face image is correspond to described fixed reference feature point
Levy a little；According to the fixed reference feature point related to reference to line segment, and corresponding fact characteristic point is connected,
With formed with described reference the first actual line segment corresponding to line segment, the second actual line segment, the 3rd actual line segment with
And the 4th actual line segment, and the characteristic point identical with comparison reference point in described fact characteristic point is set to
Actual contrast points；The fact characteristic point i.e. extracted will, institute shape identical with the fixed reference feature point prestored
The actual line segment become also wants actual comparison that is identical and that select with the characteristic point with reference to corresponding to line segment
A point and comparison reference point also same characteristic point being set to user's face image.
S2: compare the first actual line segment and the ratio of the second actual line segment and first with reference to line segment and the second ginseng
The ratio examining line segment is the most identical, if identical, then performs next sub-step；If differing, then adjust aobvious
Display screen tilts forward and back angle makes it identical；If angle cannot be tilted forward and back by adjustment display screen to make the first reality
When the ratio of line segment and the ratio of the second actual line segment and the first reference line segment and the second reference line segment is identical, then
Illustrate that user comes back or bows beyond adjusting range, provide user's prompting not in adjusting range.
S3: compare the 3rd actual line segment and the ratio of the 4th actual line segment and the 3rd with reference to line segment and the 4th ginseng
The ratio examining line segment is the most identical, if identical, then performs next sub-step；If differing, then adjust aobvious
Display screen horizontal rotation angle makes it identical；If the 3rd reality cannot be made by adjusting display screen horizontal rotation angle
When the ratio of line segment and the ratio of the 4th actual line segment and the 3rd reference line segment and the 4th reference line segment is identical, say
Bright user towards left side or right side and beyond scope, then provides user's prompting not in adjusting range.
S4: the relatively position of actual comparison point is the most identical with the position of comparison reference point, if identical, then
Adjustment completes, if differing, then adjusts display screen vertical height and makes it identical.If cannot be shown by adjustment
When screen vertical height makes the position of comparison reference point identical with the position of actual comparison point, the mistake that user sits is described
High or too low and beyond adjusting range, then provide user's prompting not in adjusting range.
In above process, the fixed reference feature point of extraction according to the line segment that pre-defined rule is formed must be fulfilled for as
Lower condition: the two lines section tilting forward and back angle for adjusting display screen must be two horizontal line sections, at this
In the definition of horizontal line section be: camera collection to user's facial image can be regarded as the screen with display screen
The rectangle that curtain size shape is identical, forms four end points, forms line segment as base with the bottom two-end-point of screen
Standard, the line segment that the fixed reference feature point of the user face of extraction is formed is that the bottom two-end-point with screen is formed
Line segment is parallel, but because of the difference of different user face, can there is certain error, i.e. miss certain
All may be considered parallel in the range of difference, and when extracting characteristic point, can select the most as far as possible
Take the point that line segment that the bottom two-end-point with screen formed is the most parallel, such as when extracting eyeball characteristic point,
Can select according to actual needs to deviate in eyeball center allowed band point also may be used.And be used for adjusting display
Two lines Duan Zewei that the characteristic point of screen horizontal rotation angle is formed has the two lines section having certain angle,
But can not be all the parallel line segment of line segment that the bottom two-end-point with screen is formed, such line segment can define
It is two line segments tilted.
If the line segment tilting forward and back angle for adjusting display screen is two line segments tilted, then this two lines section
Proportionate relationship i.e. changed to be affected and changed by horizontal rotation angle affected by tilting forward and back angle, if
Select two horizontal line sections, then this two lines section is the most only affected by tilting forward and back angle, when before this
After rear-inclined angle is adjusted, remaining any two inclined line segment ratio formed an angle all can be used to
As the foundation of adjustment horizontal rotation angle, but one group of vertical segment can be preferably.
Described step S1 also includes: if the user's face image arrived according to camera collection, by existing
If face characteristic point extracting method cannot extract the fact characteristic point that all and described fixed reference feature point is identical,
Then illustrate the position of user beyond adjusting range, such as, user side face, or deviation display screen farther out,
In this case it can be assumed that be now not desired to use, for user, the electronic installation such as computer including this display screen,
Then provide user's prompting not in adjusting range.
Additionally, also include between step S1 and step S2:
S12: according to the horizontal range that relatively the actual position of comparison point and the position calculation of comparison reference point go out
And vertical dimension, it is sequentially adjusted in display screen horizontal rotation angle, vertical height and tilts forward and back angle, directly
To meeting: the position of actual comparison point is identical with comparison reference point locations.
It is apparent that photographic head is after receiving location requirement, gather user's face image, now user face position
Putting and determine that, the position and the actual segment data that affect fact characteristic point be no longer user's face location, and
It it is the position of display screen.Adjust before and after display screen angle of inclination or horizontal rotation angle or vertical height every time
Afterwards, photographic head all can Resurvey user's face image, extract same fact characteristic point and formed with
The actual line segment of sample, adjusts the actual spy extracted from face image after the position of display screen the most every time
Levy a position or actual segment data all can make corresponding changes until meeting requirement.
Fig. 2 is formed by the critical data point of user's face image that the present invention the first preferred embodiment provides
Characteristic pattern, first pass through user and select suitable position, by camera collection, user is corresponding with precalculated position
Face image, by existing features of human face images extracting method extract the multiple fixed reference features specified
Point is respectively user eyeball position A0 and B0, nose position C0 and end points X0 and Y0 of two corners of the mouths,
Forming four line segments according to these five fixed reference feature points, wherein, AB0 is fixed reference feature point A0 and B0 shape
First become is with reference to line segment, and XY0 is the second reference line segment that fixed reference feature point X0 Yu Y0 is formed, AC0
The 3rd reference line segment formed for fixed reference feature point A0 Yu C0, BC0 is fixed reference feature point B0 and C0 shape
The 4th become is with reference to line segment, and C0 is the comparison reference point arranged.
Afterwards, after photographic head receives location requirement, gather the face image of user, by existing face
Characteristics of image point extracting method extracts the fact characteristic point identical with fixed reference feature point, and this fact characteristic point is also
End points X1 and Y1 of eyeball position A1 and B1 of user, nose position C1 and two corners of the mouths, and prestores
User's facial feature points included by fixed reference feature point and the number of storage are on all four, according to these five
Critical data point forms four line segments, and wherein, AB1 is that fact characteristic point A1 is real with the first of B1 formation
Border line segment, XY1 is the second actual line segment that fact characteristic point X1 is formed with Y1, and AC1 is actual characteristic
The 3rd actual line segment that point A1 Yu C1 is formed, BC1 is that fact characteristic point B1 is real with the 4th of C1 formation the
Border line segment.C1 is the actual comparison point arranged.
Wherein, for comparing the first actual line segment and the ratio of the second actual line segment and the first reference line segment and the
Two with reference to the standard that the ratio of line segment is the most identical are: AB1/XY1=AB0/XY0, are used for comparing the 3rd real
Border line segment and the ratio of the 4th actual line segment and the 3rd with reference to line segment and the 4th with reference to the ratio whether phase of line segment
Same standard is: AD1/BE1=AD0/BE0, for position and the comparison reference point of relatively actual comparison point
The most identical standard in position be: C1 with C0 overlaps.
As it is shown on figure 3, the flow chart provided for the present invention the first preferred embodiment, the side provided according to Fig. 1
Method flow chart can be summarized as following steps:
S0 ': beforehand through camera collection user's face image, the fixed reference feature extracting and storing point is A0,
B0, C0, X0, Y0；Four formed are AB0, XY0, AC0 and AD0 with reference to line segment, than
It is C0 to reference point；
S1 ': after photographic head receives location requirement, again gathers user's face image, extracts fact characteristic point
For A1, B1, C1, X1, Y1；Four the actual line segments formed are AB1, XY1, AC1 and AD1,
Actual comparison point is C1；
S2 ': more whether meet: AB1/XY1=AB0/XY0；If meeting, then perform next sub-step
Suddenly, if being unsatisfactory for, then adjust display screen and tilt forward and back angle, until meeting this condition；If cannot be by adjusting
Whole display screen tilts forward and back angle when making it meet AB1/XY1=AB0/XY0, then provide user and do not adjusting
Prompting in whole scope；
S3 ': more whether meet: AC1/BC1=AC0/BC0；If meeting, then perform next sub-step,
If being unsatisfactory for, then adjust display screen horizontal rotation angle until meeting this condition；If cannot be shown by adjustment
When screen horizontal rotation angle makes it meet AC1/BC1=AC0/BC0, then provide user not in adjusting range
Interior prompting；
S4 ': more whether meet: C1 with C0 overlaps, is that the position of C1 is identical with the position of C0；If
Meeting, then adjusted, it is not necessary to again display screen is adjusted, if being unsatisfactory for, then adjusting display screen vertical
Height is until meeting this condition；If it cannot be made to meet C1 Yu C0 weight by adjusting display screen vertical height
During conjunction, then provide user's prompting not in adjusting range.
In above-mentioned steps, AB1/XY1=AB0/XY0, AC1/BC1=AC0/BC0 and C1 and C0
Overlapping, equal and coincidence here can be defined as being exactly equal within the specific limits and coincidence, has i.e. allowed
Certain deviation, can be set as required.Step S2 ' and step S3 ' be used to more whether need
The angle of display screen to be adjusted, thus it is possible to vary both orders, only need to meet the last display screen height that adjusts is
Can.
Further comprise the steps of: between step S1 ' and step S2 '
S12 ': at first according to the position of actual comparison point C1 Yu comparison reference Point C 0, is sequentially adjusted in display
Shield horizontal rotation angle, vertical height and tilt forward and back angle, until meeting: C1 with C0 overlaps.Should
Step is by just successive step (could also say that coarse adjustment), the step for be to compare the pixel C1 photographed
The level that calculates with the position of C0, vertical dimension x, y, this horizontal range, vertical dimension concrete
Algorithm is: with comparison reference Point C 0 as initial point, and parallel with the line segment that the bottom two-end-point of screen is formed is straight
Line is x-axis, and perpendicular straight line is y-axis.This x value is used directly to adjust display screen horizontal rotation
Angle, y value is used for adjusting display screen vertical height, if adjust display screen anteversion and retroversion again beyond height adjustment
Rake angle.
The step for purpose be face is placed on shooting relatively in the middle of position, so extract fact characteristic point
It is relatively more accurate to be formed when AB1, the data of the line segments such as AC1, because the edge of shooting easily produces distortion,
But also the position that with raising efficiency, can adjust display screen quickly adapts with face location, to reach
Purpose to tracing and positioning face.
In above-mentioned steps S1 ' in, after receiving location requirement, if user's face image that camera collection arrives
In, it is impossible to extracting all fact characteristic point identical with fixed reference feature point, being equivalent to fact characteristic point does not has
All in face image, then illustrate the position of user beyond adjusting range, such as side face, or deviation
Display screen farther out, can be assert that user is not intended that the most in this case and use this display screen, the most then be given
User's not prompting in adjusting range.
Therefore, the detailed process implementing the present invention the first preferred embodiment is as follows: by camera collection user
Face image, the user face fact characteristic point of extraction is A1, B1, C1, X1, Y1, first determines whether
Whether can extract all these characteristic point, if can not, i.e. these fact characteristic point do not have all in face
In image, then be the position of user beyond adjusting range, such as, user side face, or deviation display screen
Farther out, this situation can be assert that user is not intended that and use this display screen, now provides user not in adjusting range
Interior prompting.
Then comparing AB1/XY1 whether equal to AB0/XY0, here equal can be defined as at certain model
Enclosing interior the most equal, this is the angle for judging face and display screen vertical direction, by adjusting display screen
Tilt forward and back angle to complete, such as, when user comes back, can relatively become big near the position of display screen,
So AB1/XY1 is less than AB0/XY0, now needs to adjust display screen and tilt forward and back angle, thus change
The data of line segment AB1 or XY1, so that the value of AB1/XY1 is equal to or levels off to AB0/XY0, so
If the position required cannot be adjusted to, then explanation user comes back or bows beyond adjusting range, then provide use
The family not prompting in adjusting range, when user bows, AB1/XY1 is greater than AB0/XY0, adjusts aobvious
Display screen tilts forward and back angle, i.e. changes the data of line segment AB1 or XY1, to complete to tilt forward and back angle
Adjust.
Equally, comparing AC1/BC1 whether equal to AC0/BC0, here equal can be defined as necessarily
In the range of the most equal, this is the angle for judging face and display screen horizontal direction, by adjust display screen
Horizontal rotation angle, i.e. can change the data of line segment AC1 or BC1, to complete horizontal rotation angle
Adjusting, if the position required cannot be adjusted to, then explanation user is towards left side or right side and beyond adjustment
Scope, then provide user's prompting not in adjusting range.Finally confirm whether C1 with C0 overlaps, this
In coincidence can be defined as within the specific limits overlap, the most only need to adjust display screen vertical height
, by adjusting the lifting/lowering of display screen, the position data of C1 can be changed so that it is overlap with C0,
If the position required cannot be adjusted to, then the too high or too low of user's seat is described and beyond adjusting range,
Then provide user's prompting not in adjusting range.
The critical data point institute shape of user's face image that Fig. 4 provides for the present invention the second preferred embodiment
The characteristic pattern become, first passes through user and selects suitable position, by camera collection user and precalculated position pair
The face image answered, the multiple references specified extracted by existing features of human face images extracting method are special
Levy and be a little respectively user eyeball position A0 and B0 or the terminal A 0 ' at two canthus and B0 ' or two canthus
Terminal A 0 ' ' and B0 ' ', nose position C0, end points D0 and E0 of nose both sides and the end of two corners of the mouths
Point X0 and Y0, as it can be seen, form four line segments, wherein, with eye according to these seven fixed reference feature points
As a example by ball position A0 and B0, AB0 is the first reference line segment that fixed reference feature point A0 Yu B0 is formed,
XY0 be fixed reference feature point X0 Yu Y0 formed second with reference to line segment, AD0 be fixed reference feature point A0 with
The 3rd reference line segment that D0 is formed, BE0 is the 4th reference line segment that fixed reference feature point B0 Yu E0 is formed,
C0 is the comparison reference point arranged.
Afterwards, after photographic head receives location requirement, the face image of Real-time Collection user, by existing
Features of human face images extracting method extracts the fact characteristic point identical with fixed reference feature point, this fact characteristic point
Also it is eyeball position A1 and B1 of user or the terminal A 1 ' at two canthus and B1 ' or the end points at two canthus
A1 ' ' and B1 ' ', nose position C1, end points D1 and E1 of nose both sides and the end points X1 of two corners of the mouths
And Y1, it is completely the same with the user's facial feature points included by the fixed reference feature of pre-stored point and number
, four line segments can be formed, wherein, with eyeball position A1 and B1 according to these seven critical data points
As a example by, AB1 is the first actual line segment that fact characteristic point A1 is formed with B1, and XY1 is fact characteristic point
The second actual line segment that X1 Yu Y1 is formed, AD1 is the 3rd reality that fact characteristic point A1 is formed with D1
Line segment, BE1 is the 4th actual line segment that fact characteristic point B1 is formed with E1, and C1 is the actual ratio arranged
To point.
Wherein, for comparing the first actual line segment and the ratio of the second actual line segment and the first reference line segment and the
Two with reference to the standard that the ratio of line segment is the most identical are: AB1/XY1=AB0/XY0, are used for comparing the 3rd real
Border line segment and the ratio of the 4th actual line segment and the 3rd with reference to line segment and the 4th with reference to the ratio whether phase of line segment
Same standard is: AD1/BE1=AD0/BE0, for position and the comparison reference point of relatively actual comparison point
The most identical standard in position be: C1 with C0 overlaps.
As it is shown in figure 5, the flow chart of the second preferred embodiment provided for the present invention, implementation step and figure
3 principles are the same, and here is omitted.
The detailed process now introducing the enforcement present invention the second preferred embodiment is as follows: used by camera collection
Family face image, the user face fact characteristic point of extraction is A1, B1, C1, D1, E1, X1, Y1,
It is first determined whether all these characteristic point can be extracted, if can not, i.e. these fact characteristic point are the most complete
Portion in face image, then be the position of user beyond adjusting range, such as, user side face, or partially
From display screen farther out, this situation can be assert that user is not intended that and use this display screen, now provides user and does not exists
Prompting in adjusting range.
Then comparing AB1/XY1 whether equal to AB0/XY0, here equal can be defined as at certain model
Enclosing interior the most equal, this is the angle for judging facial image and display screen vertical direction, is shown by adjustment
Before and after screen, angle of inclination completes, such as, when user comes back, can relatively become near the position of display screen
Greatly, so AB1/XY1 is less than AB0/XY0, now needs to adjust display screen and tilt forward and back angle, change
The data of line segment AB1 or XY1, so that the value of AB1/XY1 is equal to or levels off to AB0/XY0, so
If the position required cannot be adjusted to, then explanation user comes back or bows beyond adjusting range, then provide use
The family not prompting in adjusting range, when user bows, AB1/XY1 is greater than AB0/XY0, adjusts aobvious
Display screen position, i.e. changes the data of line segment AB1 or XY1, to complete to tilt forward and back the adjustment of angle.
Equally, comparing AD1/BE1 whether equal to AD0/BE0, here equal can be defined as necessarily
In the range of the most equal, this is the angle for judging face and display screen horizontal direction, by adjust display screen
Horizontal rotation angle complete, i.e. by adjust screen position, change line segment AD1 or BE1 data,
Until the ratio equal or close to AD0 Yu BE0, if the position required cannot be adjusted to, then illustrate to use
Family towards left side or right side and beyond adjusting range, then provides user's prompting not in adjusting range.
Finally confirm whether C1 with C0 overlaps, and coincidence here can be defined as overlapping the most exactly
, the most only need to adjust display screen vertical height, i.e. by adjusting the vertical high data of display screen, i.e.
The position data of C1 can be changed, until overlapping with C0.If the position required cannot be adjusted to, then illustrate
User sit too high or too low and beyond adjusting range, then provide user's not carrying in adjusting range
Show.
In the second preferred embodiment, it is also possible to by compare fact characteristic point formed line segment AB1 and
Line segment AB0's and DE0 that the fixed reference feature point whether the ratio AB1/DE1 of DE1 is equal to prestore is formed
Ratio AB0/DE0 is used as adjusting display screen and tilts forward and back the standard of angle.Wherein, DE1 is actual spy
Levying the line segment that D1 and E1 is formed, DE0 is the line segment that in fixed reference feature point, D0 Yu E0 is formed.And
Eyeball position A1 and B1 in fact characteristic point can be with the terminal A 1 ' at two canthus and B1 ' or two canthus
Terminal A 1 ' ' and B1 ' ' replace, all can realize the purpose of tracing and positioning face.
Additionally, be also not limited to above-mentioned several implementation, wherein, user eyeball position A1 and B1,
End points X1 and Y1 of nose position C1 and two corners of the mouths is to be easier to capture, easily illustrate, easily
The user's facial feature points understood, but the characteristic point of face also includes that the tip of the brow and people are medium, according to face figure
As characteristic point grasping means all can capture, only at least two horizontal line sections need to be formed, as more whether needing
Display screen to be adjusted tilt forward and back angle foundation, formed two inclined line segments formed an angle, as than
Relatively the need of adjust display screen horizontal rotation angle according to, can be with image characteristic point such as nose, place between the eyebrows
Deng as compare the need of adjust display screen vertical height foundation, but because of nose relatively face hit exactly
Between, the process of adjustment can be the simplest and accurate.In a word, in addition to above-mentioned these several examples enumerated, also have relatively
Many embodiments, do not repeat them here.
The method implementing the present invention a kind of tracing and positioning face, by coordinating certain hardware configuration, the most adjustable
Whole screen position adapts with face location, it is achieved tracing and positioning face.As shown in Figure 6, this display system
System includes display screen, also includes photographic head 20, central processing unit 30 and drives module 40；Central authorities process
Device 30 includes feature point extraction unit the 301, first comparing unit the 302, second comparing unit 303 and
Three comparing units 304.Wherein, central processing unit 30, when user selects correct position, passes through photographic head
Gather user's face image, extract and store corresponding the most with the precalculated position in face image in advance
Multiple reference points are connected to form first to fourth reference line according to predetermined rule by individual fixed reference feature point two-by-two
Section, and from these multiple fixed reference feature points, select a comparison reference point.
Photographic head 20 is installed on a display screen, is used for gathering user's face image, and is transferred to central authorities' process
Device 30.
Feature point extraction unit 301 is used for receiving user's face image, extracts the reality identical with fixed reference feature point
Border characteristic point；According to the fixed reference feature point related to reference to line segment, and by corresponding fact characteristic point even
Connect, with formed with reference the first actual line segment corresponding to line segment, the second actual line segment, the 3rd actual line segment with
And the 4th actual line segment, and the characteristic point identical with comparison reference point in fact characteristic point is set to reality
Comparison point.
First comparing unit 302 is for comparing the first actual line segment and the ratio and first of the second actual line segment
The most identical with reference to the ratio of line segment with reference to line segment and second, if differing, then output is used for adjusting display screen
Tilt forward and back the signal of angle to driving module 40.
Second comparing unit 303 is for comparing the 3rd actual line segment and the ratio and the 3rd of the 4th actual line segment
The most identical with reference to the ratio of line segment with reference to line segment and the 4th, if differing, then output is used for adjusting display screen
The signal of horizontal rotation angle is given and is driven module 40.
For the position of the position of relatively actual comparison point and comparison reference point whether the 3rd comparing unit 304
Identical, if differing, then output is for adjusting the signal of display screen vertical height to driving module 40.Its
Comparison and method of adjustment realize all in accordance with above-mentioned tracing and positioning face method.
Drive module 40 for driving display screen to rotate and/or lifting according to the signal received.
Specifically, drive module 40 being used for of receiving is adjusted display screen tilt forward and back angle signal,
For adjusting the signal of display screen horizontal rotation angle and dividing for adjusting the signal of display screen vertical height
Do not export the to first to the 3rd motor, and then adjustment display screen tilts forward and back angle, horizontal rotation angle respectively
And vertical height, make the position of display screen finally adapt with face location, reach tracing and positioning face
Purpose.
The method of the present invention a kind of tracing and positioning face and display system, be mainly used in the electronics of single camera
Device, because in existing electronic product, such as all-in-one, display, mostly the product such as mobile phone is be furnished with one
Individual photographic head, therefore has the strongest practicality, it is achieved method is simple, and can be accurately positioned face.
Above in conjunction with accompanying drawing, embodiments of the invention are described, but the invention is not limited in above-mentioned
Detailed description of the invention, above-mentioned detailed description of the invention is only schematic rather than restrictive, this
The those of ordinary skill in field, under the enlightenment of the present invention, is being protected without departing from present inventive concept and claim
Under the ambit protected, it may also be made that a lot of form, within these belong to the protection of the present invention.
Claims (9)
1. the method for a tracing and positioning face, it is characterised in that described method comprises the steps:
S0: by camera collection user's face image, extract and store the multiple fixed reference feature points the most corresponding with the precalculated position in face image, according to predetermined rule, the plurality of fixed reference feature point is connected two-by-two and forms first with reference to line segment, the second reference line segment, the 3rd reference line segment and the 4th with reference to line segment, record the length of this first to fourth reference line segment, and from the plurality of fixed reference feature point, select a comparison reference point；The fixed reference feature point extracted meets following condition according to the line segment that pre-defined rule is formed: the two lines section tilting forward and back angle for adjusting display screen is two horizontal line sections；
S1: during again by camera collection user's face image, extracts the fact characteristic point that correspond to the identical precalculated position in face image with described fixed reference feature point from the user's face image collected；Described fact characteristic point is connected to form two-by-two first actual line segment, second actual line segment, threeth actual line segment and the fourth actual line segment corresponding with described first to fourth reference line segment, and the fact characteristic point that correspond to the identical precalculated position in face image in described fact characteristic point with described comparison reference point is set to actual comparison point；
S2: the ratio comparing the first actual line segment and the ratio of the second actual line segment and the first reference line segment and the second reference line segment is the most identical, if identical, then performs next sub-step；If differing, then adjust display screen and tilt forward and back angle；
S3: the ratio comparing the 3rd actual line segment and the ratio of the 4th actual line segment and the 3rd reference line segment and the 4th reference line segment is the most identical, if identical, then performs next sub-step；If differing, then adjust display screen horizontal rotation angle；
S4: the relatively position of actual comparison point is the most identical with the position of comparison reference point, if identical, has then adjusted, if differing, then adjusts display screen vertical height.
2. according to the method for tracing and positioning face according to claim 1, it is characterised in that described step S1 also includes: if photographic head cannot collect the fact characteristic point that all and described fixed reference feature point is identical, then provide user's prompting not in adjusting range.
3. according to the method for tracing and positioning face according to claim 1, it is characterised in that also include between described step S1 and described step S2:
S12: according to the horizontal range that relatively the actual position of comparison point and the position calculation of comparison reference point go out and vertical dimension, it is sequentially adjusted in display screen horizontal rotation angle, vertical height and tilts forward and back angle, until meeting: the position of actual comparison point is identical with comparison reference point locations.
The method of tracing and positioning face the most according to claim 1, it is characterized in that, described step S2 also includes: if cannot by adjust display screen tilt forward and back angle make the first actual line segment and the ratio of the second actual line segment and first reference line segment and second reference line segment ratio identical time, then provide user's prompting not in adjusting range.
The method of tracing and positioning face the most according to claim 1, it is characterized in that, described step S3 also includes: if cannot by adjust display screen horizontal rotation angle make the 3rd actual line segment and the ratio of the 4th actual line segment and the 3rd reference line segment and the 4th reference line segment ratio identical time, then provide user's prompting not in adjusting range.
The method of tracing and positioning face the most according to claim 1, it is characterized in that, described step S4 also includes: if the position of comparison reference point cannot be made identical with the position of actual comparison point by adjusting display screen vertical height, then provide user's prompting not in adjusting range.
The method of tracing and positioning face the most according to claim 1, it is characterised in that the multiple fixed reference feature points extracted from user's face image of camera collection are user eyeball position A0 and B0, nose position C0 and end points X0 and Y0 of user two corners of the mouth；Actual fixed reference feature point is user eyeball position A1 and B1, nose position C1 and end points X1 and Y1 of user two corners of the mouth；
Wherein, described first reference line segment is A0 and the line segment AB0 of B0 formation, and the second reference line segment is X0 and the line segment XY0 of Y0 formation, and the 3rd reference line segment is A0 and the line segment AC0 of C0 formation, and the 4th reference line segment is B0 and the line segment BC0 of C0 formation, and comparison reference point is C0；First actual line segment is A1 and the line segment AB1 of B1 formation, and the second actual line segment is X1 and the line segment XY1 of Y1 formation, and the 3rd actual line segment is A1 and the line segment AC1 of C1 formation, and the 4th actual line segment is B1 and the line segment BC1 of C1 formation, and actual comparison point is C1.
The method of tracing and positioning face the most according to claim 1, it is characterized in that, the multiple fixed reference feature points obtained from user's face image of camera collection are user eyeball position A0 and B0, nose position C0, end points X0 and Y0 of user two corners of the mouth and end points D0 and E0 of user's nose both sides；Fact characteristic point is user eyeball position A1 and B1, nose position C1, end points X1 and Y1 of user two corners of the mouth and end points D1 and E1 of user's nose both sides；
Wherein, described first reference line segment is A0 and the line segment AB0 of B0 formation, and the second reference line segment is X0 and the line segment XY0 of Y0 formation, and the 3rd reference line segment is A0 and the line segment AD0 of D0 formation, and the 4th reference line segment is B0 and the line segment BE0 of E0 formation, and comparison reference point is C0；Described first actual line segment is A1 and the line segment AB1 of B1 formation, and the second actual line segment is X1 and the line segment XY1 of Y1 formation, and the 3rd actual line segment is A1 and the line segment AD1 of D1 formation, and the 4th actual line segment is B1 and the line segment BE1 of E1 formation, and actual comparison point is C1.
9. a display system, it is characterised in that include display screen, photographic head, central processing unit and drive module；Described central processing unit includes feature point extraction unit, the first comparing unit, the second comparing unit and the 3rd comparing unit；
Described photographic head is used for gathering user's face image, and is transferred to described central processing unit；By camera collection user's face image, extract and store the multiple fixed reference feature points the most corresponding with the precalculated position in face image, according to predetermined rule, the plurality of fixed reference feature point is connected two-by-two and forms first with reference to line segment, the second reference line segment, the 3rd reference line segment and the 4th with reference to line segment, record the length of this first to fourth reference line segment, and from the plurality of fixed reference feature point, select a comparison reference point；
Described feature point extraction unit is used for receiving user's face image, extracts the fact characteristic point in the identical precalculated position that correspond in face image with fixed reference feature point；According to predetermined rule, described fact characteristic point is connected two-by-two and forms first actual line segment, second actual line segment, threeth actual line segment and the fourth actual line segment corresponding with first to fourth reference line segment, and the fact characteristic point that correspond to the identical precalculated position in face image in described fact characteristic point with comparison reference point is set to actual comparison point；The fixed reference feature point extracted meets following condition according to the line segment that pre-defined rule is formed: the two lines section tilting forward and back angle for adjusting display screen is two horizontal line sections；
Described first comparing unit is the most identical with reference to the ratio of line segment with reference to line segment and second for comparing the first actual line segment and the ratio of the second actual line segment and first, if differing, then output tilts forward and back the signal of angle to described driving module for adjusting display screen；
Described second comparing unit is the most identical with reference to the ratio of line segment with reference to line segment and the 4th for comparing the 3rd actual line segment and the ratio of the 4th actual line segment and the 3rd, if differing, then output is for adjusting the signal of display screen horizontal rotation angle to described driving module；
Described 3rd comparing unit is the most identical with the position of comparison reference point for the position of relatively actual comparison point, if differing, then output is for adjusting the signal of display screen vertical height to described driving module；
Described driving module is for driving display screen to rotate and/or lifting according to the signal received.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410002101.2A CN103760975B (en) | 2014-01-02 | 2014-01-02 | A kind of method of tracing and positioning face and display system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410002101.2A CN103760975B (en) | 2014-01-02 | 2014-01-02 | A kind of method of tracing and positioning face and display system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103760975A CN103760975A (en) | 2014-04-30 |
| CN103760975B true CN103760975B (en) | 2017-01-04 |
Family
ID=50528227
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410002101.2A Active CN103760975B (en) | 2014-01-02 | 2014-01-02 | A kind of method of tracing and positioning face and display system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103760975B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105242888B (en) * | 2014-07-10 | 2018-10-12 | 联想(北京)有限公司 | A kind of system control method and electronic equipment |
| CN105234940A (en) * | 2015-10-23 | 2016-01-13 | 上海思依暄机器人科技有限公司 | Robot and control method thereof |
| CN105301789A (en) * | 2015-12-09 | 2016-02-03 | 深圳市中视典数字科技有限公司 | Stereoscopic display device following human eye positions |
| CN105701763B (en) * | 2015-12-30 | 2019-05-21 | 青岛海信移动通信技术股份有限公司 | A kind of method and device adjusting facial image |
| CN106955122A (en) * | 2017-03-20 | 2017-07-18 | 苏州网颢信息科技有限公司 | Head 3 D detection method based on single camera module in radiotherapy |
| CN108134902B (en) * | 2017-12-25 | 2020-09-18 | 三星电子（中国）研发中心 | Method and device for shooting pictures with same background |
| CN109995994A (en) * | 2018-01-02 | 2019-07-09 | 上海银晨智能识别科技有限公司 | Camera system and its control device, method, the readable storage medium storing program for executing of automatic adjustment |
| CN109121031B (en) * | 2018-10-29 | 2020-11-17 | 歌尔科技有限公司 | Directional display method and device for audio equipment and audio equipment |
| CN110909662A (en) * | 2019-11-20 | 2020-03-24 | 湖南检信智能科技有限公司 | Face motion blur correction method |
| CN112869701B (en) * | 2021-01-11 | 2024-03-29 | 上海微创医疗机器人（集团）股份有限公司 | Sight line detection method, surgical robot system, control method, and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101458531A (en) * | 2007-12-12 | 2009-06-17 | 深圳富泰宏精密工业有限公司 | Display screen automatic adjustment system and method |
| CN101859176A (en) * | 2009-04-08 | 2010-10-13 | 群康科技(深圳)有限公司 | Screen control device and method thereof |
| CN102547209A (en) * | 2012-02-06 | 2012-07-04 | 华为技术有限公司 | Method and device for controlling videoconferencing equipment, and videoconferencing system |
| US8379059B2 (en) * | 2009-08-07 | 2013-02-19 | Fih (Hong Kong) Limited | Portable electronic device and method for adjusting display orientation of the portable electronic device |
| CN103092344A (en) * | 2013-01-11 | 2013-05-08 | 深圳市金立通信设备有限公司 | Method of controlling terminal screen to rotate and terminal |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9047806B2 (en) * | 2009-05-25 | 2015-06-02 | Lg Electronics Inc. | Display device and method of adjusting viewing angle thereof |
-
2014
- 2014-01-02 CN CN201410002101.2A patent/CN103760975B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101458531A (en) * | 2007-12-12 | 2009-06-17 | 深圳富泰宏精密工业有限公司 | Display screen automatic adjustment system and method |
| CN101859176A (en) * | 2009-04-08 | 2010-10-13 | 群康科技(深圳)有限公司 | Screen control device and method thereof |
| US8379059B2 (en) * | 2009-08-07 | 2013-02-19 | Fih (Hong Kong) Limited | Portable electronic device and method for adjusting display orientation of the portable electronic device |
| CN102547209A (en) * | 2012-02-06 | 2012-07-04 | 华为技术有限公司 | Method and device for controlling videoconferencing equipment, and videoconferencing system |
| CN103092344A (en) * | 2013-01-11 | 2013-05-08 | 深圳市金立通信设备有限公司 | Method of controlling terminal screen to rotate and terminal |
Non-Patent Citations (1)
| Title |
|---|
| 《人脸识别方法综述》;吴巾一;《计算机应用研究》;20090926;第26卷(第9期);第3204-3209页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103760975A (en) | 2014-04-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103760975B (en) | A kind of method of tracing and positioning face and display system | |
| US10867449B2 (en) | Apparatus and method for augmenting sight | |
| US5880814A (en) | Visual acuity tester with improved test character generation | |
| CN105812777B (en) | Binocular AR wears display device and its method for information display | |
| CN109269405B (en) | A kind of quick 3D measurement and comparison method | |
| EP2502410B1 (en) | A method for augmenting sight | |
| CN101140365B (en) | Unevenness inspection method, method for manufacturing display panel, and unevenness inspection apparatus | |
| CN103927005B (en) | display control method and display control device | |
| CN101390128B (en) | Detecting method and detecting system for positions of face parts | |
| CN110032271A (en) | Contrast control device and its method, virtual reality device and storage medium | |
| CN107431796A (en) | The omnibearing stereo formula of panoramic virtual reality content catches and rendered | |
| EP0734683A2 (en) | Apparatus for and method of simulating ocular optical system | |
| CN107702894A (en) | The method and device of virtual reality eyeglass dispersion detection | |
| CN106600855A (en) | Payment device and method based on face recognition | |
| CN112288043A (en) | Kiln surface defect detection method, system and medium | |
| CN102043942A (en) | Visual direction judging method, image processing method, image processing device and display device | |
| CN106570447A (en) | Face photo sunglass automatic removing method based on gray histogram matching | |
| CN112232128B (en) | Eye tracking based method for identifying care needs of old disabled people | |
| CN109146949B (en) | A kind of 3D measurement and information acquisition device based on video data | |
| CN112352261A (en) | Object detection device and object detection method for construction machine | |
| CN107204167A (en) | Terminal device and display methods | |
| CN106618479A (en) | Pupil tracking system and method thereof | |
| WO2019223067A1 (en) | Multiprocessing-based iris image enhancement method and apparatus, and device and medium | |
| CN108429878A (en) | Deep sky object shoots intelligent optical imaging method, apparatus and system | |
| CN110536044B (en) | Automatic certificate photo shooting method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |