CN102043942A - Visual direction judging method, image processing method, image processing device and display device - Google Patents
Visual direction judging method, image processing method, image processing device and display device Download PDFInfo
- Publication number
- CN102043942A CN102043942A CN2009101802719A CN200910180271A CN102043942A CN 102043942 A CN102043942 A CN 102043942A CN 2009101802719 A CN2009101802719 A CN 2009101802719A CN 200910180271 A CN200910180271 A CN 200910180271A CN 102043942 A CN102043942 A CN 102043942A
- Authority
- CN
- China
- Prior art keywords
- image
- face
- visual direction
- screen
- judge
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention discloses a visual direction judging method, an image processing method, an image processing device and a display device, wherein the visual direction judging method is used for judging a visual direction of a tested person when the tested person observes an object. The visual direction judging method comprises the following steps of obtaining a face image of the tested person when the tested person observes the object; identifying a plurality of face features in the face image to generate an identification result; and judging a face direction according to the identification result when the tested person observes the object so as to judge the visual direction.
Description
Technical field
The present invention relates to a kind of visual direction determination process, visual direction judgment means, image treatment method, image processor, display device and electronic installation, particularly relate to a kind of accuracy that visual direction is judged that improves, and improve visual direction determination process, visual direction judgment means, image treatment method, image processor, display device and the electronic installation of related application usefulness.
Background technology
Along with the progress of development of science and technology and industry, portable electron device, as mobile computer, personal digital assistant, intelligent mobile phone, mobile phone, MP3 walkman etc., the chance that is used in daily life also significantly increases.Generally speaking, portable electron device all is equipped with and is used for the display screen of image output, and some portable electron device (as personal digital assistant, intelligent mobile phone etc.) also is equipped with Touch Screen, in order to the function that realizes simultaneously showing and controlling.
On the other hand, in order to increase convenience, the Presentation Function of portable electron device no longer is confined to the single display direction, and changeable be the display direction of straight formula or horizontal type.Simultaneously, prior art also provides the mechanism of automatic switchover picture display direction, and it is by gravity sensor (G-sensor), the angle during sensing user hand-held portable electronic device, and switch display direction according to this.For instance, Figure 1A and Figure 1B are the synoptic diagram that an intelligent mobile phone 10 switches display direction.In Figure 1A and Figure 1B, arrow G is represented gravity direction.When the user switched to the hand-held of Figure 1B by the hand-held of Figure 1A, intelligent mobile phone 10 can be judged user's visual direction according to the change of gravity, and then display frame is switched to the content shown in Figure 1B by Figure 1A.
By the display direction handover mechanism shown in Figure 1A and Figure 1B, prior art can improve convenience and the interest when using.Yet such switching mode still has its shortcoming, for example when intelligent mobile phone 10 is flat on desktop, owing to can't sense the change of gravity, thereby the display direction that can't automatically switch.
Therefore, the method for the visual direction of existing judgement user still has room for improvement.
Summary of the invention
Therefore, fundamental purpose of the present invention promptly is to provide a kind of visual direction determination process, visual direction judgment means, image treatment method, image processor, display device and electronic installation.
The present invention discloses a kind of visual direction determination process, is used for judging the visual direction a when measured observes an object, includes the image of face when obtaining this measured and observing this object; Discern a plurality of face features in this image of face, to produce a recognition result; And, judge the face orientation when this measured observes this object according to this recognition result, to judge this visual direction.
The present invention also discloses a kind of visual direction judgment means, is used for judging the visual direction a when measured observes an object, includes an image of face acquisition module, the image of face when being used for obtaining this measured and observing this object; One face feature identification module is used for discerning a plurality of face features in this image of face, to produce a recognition result; And a judge module, be used for according to this recognition result, judge the face orientation when this measured observes this object, to judge this visual direction.
The present invention also discloses a kind of image treatment method that is used for a display device, and this display device comprises a screen, and this method includes reception one image data, and this image data comprises a plurality of pixel datas, corresponding to a plurality of display units of this screen; Judge the visual direction a when user observes this screen; According to this visual direction, adjust the pairing display unit of these a plurality of pixel datas; And by adjusted these a plurality of pixel datas of these a plurality of display units demonstrations, to show the pairing picture of this image data.
The present invention also discloses a kind of image processor that is used for a display device, this display device comprises a screen, and this image processor includes a receiver module, is used for receiving an image data, this image data comprises a plurality of pixel datas, corresponding to a plurality of display units of this screen; One visual direction judgment means is used for judging the visual direction of a user with respect to this screen; One adjusting module is used for adjusting the pairing display unit of these a plurality of pixel datas according to this visual direction; And a display module, being used for driving should adjusted these a plurality of pixel data of a plurality of display units demonstrations, to show the pairing picture of this image data.
The present invention also discloses a kind of display device of the display direction that automaticallyes switch, and includes a screen, includes a plurality of display units; One image data generation device is used for producing an image data, and this image data comprises a plurality of pixel datas, corresponding to these a plurality of display units of this screen; And an image processor, be used for handling this image data that this image data generation device is produced, and by the result after this screen playback process.This image processor includes a receiver module, is used for receiving an image data, and this image data comprises a plurality of pixel datas, corresponding to a plurality of display units of this screen; One visual direction judgment means is used for judging the visual direction of a user with respect to this screen; One adjusting module is used for adjusting the pairing display unit of these a plurality of pixel datas according to this visual direction; And a display module, being used for driving should adjusted these a plurality of pixel data of a plurality of display units demonstrations, to show the pairing picture of this image data.
The present invention also discloses a kind of electronic installation, has Presentation Function, includes a screen, includes a plurality of display units; An and image processor.This image processor includes a receiver module, is used for receiving an image data, and this image data comprises a plurality of pixel datas, corresponding to these a plurality of display units of this screen; One visual direction judgment means is used for judging the visual direction of a user with respect to this screen; One adjusting module is used for adjusting the pairing display unit of these a plurality of pixel datas according to the visual direction of this user with respect to this screen; And a display module, being used for driving should adjusted these a plurality of pixel data of a plurality of display units demonstrations, to show the pairing picture of this image data.
Description of drawings
Figure 1A and Figure 1B switch the synoptic diagram of display direction for an existing intelligent mobile phone.
Fig. 2 is face's synoptic diagram of a beholder.
Fig. 3 is the synoptic diagram that the embodiment of the invention one visual direction is judged flow process.
Fig. 4 is the synoptic diagram of the embodiment of the invention one visual direction judgment means.
Fig. 5 is the synoptic diagram of the embodiment of the invention one display device.
Fig. 6 A among Fig. 5 by a screen to the look image synoptic diagram of gained of a user.
Fig. 6 B is the angle synoptic diagram of the horizontal direction of user's the face's horizontal direction of Fig. 6 A and screen.
Fig. 7 is the embodiment of the invention one a coordinate conversion synoptic diagram.
Fig. 8 is the synoptic diagram of the embodiment of the invention one image processing flow process.
Fig. 9 A to Fig. 9 G is the running synoptic diagram of the embodiment of the invention one intelligent handheld device.
The reference numeral explanation
10 intelligent mobile phones
The G arrow
30 visual directions are judged flow process
300,302,304,306,308 steps
40 visual direction judgment means
400 image of face acquisition modules
402 face feature identification modules
404 judge modules
406 image acquisition units
408 arithmetic elements
410 position judgment unit
412 direction judging units
50 display device
500 screens
502 image data generation devices
504 image processors
506 receiver modules
508 visual direction judgment means
510 adjusting modules
512 display modules
The IMG image data
USR_a user
V_default, H_default, DT_a direction
δ, θ angle
The P pixel data
80 image processing flow processs
800,802,804,806,808,810 steps
90 intelligent handheld devices
900 cameras
Embodiment
In order to clearly demonstrate spirit of the present invention, at first be illustrated as who brain and can distinguish the image that eyes are looked, the visual phenomenon that image general reference described herein produces because of the light reflection, but not singly refer to plane picture or picture.When light is injected eyeball from pupil, through the crystalline refraction, and when accumulating in sensory cell on the retina, optic nerve can pass to brain with the message that sensory cell produced.After message enters brain, be separated into fragment at once, deliver to the different cortex of brain (cortex) zone.Part cortex zone as temporal lobe (Temporal Lobe) and occipital lobe (Occipital Lobe), can produce vision immediately, and another part cortex zone, as top (Parietal Lobe), then can (segment) recording image.When repeatedly look behind the image of same type, cerebral cortex can write down enough information, and produces so-called " storage " or " impression ", this promptly distinguishes the foundation of image.Simultaneously, for all of same image in " impression ", only have " impression " of continuous appearance can be deep especially, why human except distinguishing the image this also be, can distinguish that also known image is whether correct or meet normality.For instance, human impression for trees is a root down and Ye Zaishang, if the shown trees of a picture are roots last and leaf is descending, then most of people can distinguish rapidly that this picture is to be squeezed.
Because human brain comprises directivity for the impression of known image, therefore, the presentation mode of any non-natural product all should be followed most of people's impression, and cutting really is " the visual direction " that will meet the beholder." visual direction " is a kind of abstract concept, what represent is the normality direction that human eye is looked thing, in fact, visual direction can't be used easy model representation, because what cause that the mankind have visual sense of orientation is not the structure of eyes, but be present in the impression of brain, and growth environment of impression and beholder, education etc. are relevant.For example, if someone from little by the instruction English alphabet " A " be symbol
Then when seeing " A ", can assert that subjectively " A " direction visual with it is not inconsistent, and for turning upside down.Inquiring into this special case is to emphasize the practical significance of visual direction, the problem that non-institute of the present invention desire solves.
Because therefore visual direction can't, must otherwise describe visual direction with easy model representation.Under normal circumstances, owing to reasons such as terrestrial attraction, binocular balances, the normal person is to look thing towards the mode of being looked thing.With outward appearance, if by being looked object plane to the beholder, then beholder's face is as shown in Figure 2.Wherein, arrow G is represented the terrestrial attraction direction, and dotted line H represents horizontal line.By this, though can't describe visual direction, still have the standard that to follow with particular model.For example, when thing is looked in people's emmetropia, the rough horizontal line that is parallel to of the straight line that eyes were linked to be, eyes central authorities are to the central rough plumb line that is parallel to of chin or face, and eyes are under eyebrow, and nose is under eyes ... or the like.The present invention utilizes these check criteria, judges beholder's face orientation, and then judges visual direction.
Please refer to Fig. 3, Fig. 3 is the synoptic diagram that the embodiment of the invention one visual direction is judged flow process 30.Visual direction judges that flow process 30 is used for judging the visual direction a when measured observes an object, and it comprises following steps:
Step 300: beginning.
Step 302: the image of face when obtaining this measured and observing this object.
Step 304: discern a plurality of face features in this image of face, to produce a recognition result.
Step 306: according to this recognition result, judge the face orientation when this measured observes this object, to judge this visual direction.
Step 308: finish.
Therefore, by identification measured's face feature, the present invention can judge measured's face orientation, and then judges its visual direction.Face feature position when such deterministic process is only merely looked thing with the measured is relevant, is not subjected to gravity effect.In addition, be noted that visual direction judges that flow process 30 only is used for illustrating notion of the present invention, the variation that all notions are according to this done all belongs to category of the present invention.For example, when obtaining measured's image of face, can obtain the image that comprises image of face earlier, as measured's upper part of the body or whole body image etc., again by face detection, identification measured's face mask is to obtain measured's image of face.Wherein, face detection is common image processing technique, and its principle is that the people is bold and causes ovalize, and roughly is the identical colour of skin in the face mask except that Partial Feature (as eyes, eyebrow).Therefore, after obtaining the image that comprises measured's image of face, can judge face mask according to image characteristics values such as the GTG value of all pixels that image comprised, contrast, chroma, brightness.
Similarly, in identification during face feature, also can adopt constructedly, promptly according to the image characteristics value (as GTG value, contrast, chroma, brightness etc.) of the pixel that measured's image of face comprised, identify the profile of face feature, with the identification face feature.Further, behind the face feature that identifies the measured, can judge the position of face feature,, judge measured's face orientation, to judge visual direction again according to the position of face feature with respect to this image of face.For instance, eyes central authorities are face's vertical direction of measured to the central authorities of chin or face, and images of left and right eyes is online to be face's horizontal direction (judgment mode of images of left and right eyes can according to the position of nose with respect to eyes) of measured.
The present invention is the face feature according to the measured, judges face orientation, and then judges visual direction, and this deterministic process is not subjected to gravity effect, and only to observe face's angle of object relevant with the measured.Therefore, if when visual direction is judged that flow process 30 is applied to intelligent mobile phone 10 shown in Figure 1A and Figure 1B or similar mancarried device, can guarantee the normal operation of display direction handover mechanism, convenience and interest when using to improve, details are as follows for the related realization mode.
Please refer to Fig. 4, Fig. 4 is the synoptic diagram of the embodiment of the invention one visual direction judgment means 40.Visual direction judgment means 40 is used for realizing visual direction determination process 30, the visual direction when judging that a measured observes an object.Visual direction judgment means 40 includes an image of face acquisition module 400, a face feature identification module 402 and a judge module 404.The image of face that image of face acquisition module 400 is used for obtaining the measured when observing object, it comprises an image acquisition unit 406 and an arithmetic element 408.Image acquisition unit 406 can be a camera, is used for obtaining the image of the image of face when comprising the measured and observing object; Arithmetic element 408 then can be according to the image characteristics value (as GTG value, contrast, chroma, brightness etc.) of all pixels in the obtained image of image acquisition unit 406, and identification measured's face mask is to obtain image of face.Face feature identification module 402 is used for discerning a plurality of face features in the image of face, and it can imitate the running of arithmetic element 408, and promptly according to the image characteristics value of the pixel that image of face comprised, the profile of identification face feature is with the identification face feature.Judge module 404 is used for according to the recognition result of face feature identification module 402 gained, judges measured's face orientation (horizontal direction that is linked to be as the vertical direction or the eyes of eyes central authorities to chin central authorities), to judge visual direction.Judge module 404 includes a position judgment unit 410 and a direction judging unit 412.Position judgment unit 410 is used for according to the recognition result of face feature identification module 402 gained, judges the position of measured's face feature with respect to image of face.Direction judging unit 412 is used for according to the result of position judgment unit 410 gained, judges measured's face orientation, to judge visual direction.
Visual direction judgment means 40 is to be used for realizing visual direction judgement flow process 30, and detailed description can be with reference to aforementioned.In addition, be noted that image of face acquisition module 400, face feature identification module 402 and judge module 404 only are used for possible implementation is described, are not limited thereto.For example, image acquisition unit 406 is except can being the camera, can also be the device of tool real-time imaging acquisition functions such as video camera, infrared sensing instrument, or not have the device or a module of image acquisition function, as network download module, data read module etc.With the data read module is example, and it is by reading data memory devices such as storage card, hard disk, to obtain measured's image.
Visual direction judges that flow process 30 and visual direction judgment means 40 are the face features according to the measured, judge measured's face orientation, and then judge its visual direction.Because the foundation of judging is measured's a face feature, so its result do not influence by gravity factor, if be used for the display direction handover mechanism of mancarried device, can improve convenience and interest.
Please refer to Fig. 5, Fig. 5 is the synoptic diagram of the embodiment of the invention one display device 50.Display device 50 preferably is used for a portable electron device, is used for visual direction according to the user, switches display direction.Display device 50 includes a screen 500, an image data generation device 502 and an image processor 504.Screen 500 can be the screen of various forms (as plane, solid, projection etc.) or external form (circle, rectangle, 4:3,16:9,16:10 etc.), and it includes a plurality of display units, and each display unit is used for showing a pixel data.Image data generation device 502 is used for producing image data IMG, and image data IMG can be any type of image data (as JPEG, GIFF etc.), and it comprises a plurality of pixel datas, corresponds respectively to a display unit of screen 500.Image processor 504 includes a receiver module 506, one visual direction judgment means 508, an adjusting module 510 and a display module 512.Receiver module 506 is used for receiving image data IMG.Visual direction judgment means 508 preferably be arranged at around the screen 500 or near, be used for judging when the user watches screen 500 that with respect to the visual direction of screen 500, its implementation is identical with the visual direction judgment means 40 of Fig. 4, so do not give unnecessary details.The visual direction that adjusting module 510 can be declared according to visual direction judgment means 508 is adjusted the pairing display unit of pixel data among the image data IMG.The display unit that display module 512 can drive screen 500 shows adjusting module 510 adjusted pixel datas, with the pairing picture of image data displaying IMG.
In simple terms, display device 50 can be judged its face orientation and visual direction according to user's face feature, and adjusts the pairing display unit of (conversion) video data according to this, makes the picture display direction of screen 500 be relevant to user's visual direction.For instance, if look to a user USR_a by screen 500, the image of gained as shown in Figure 6A, and direction V_default and H_default represent vertical (going up extremely down) and the horizontal direction of screen 500 respectively, and the relation between formed direction DT_a of user USR_a eyes (right eye is to left eye) and direction H_default is shown in Fig. 6 B as can be known.By Fig. 6 B as can be known, the angle between direction DT_a and direction H_default is δ.In this case, identify the eyes and nose or face of user USR_a when visual direction judgment means 508 after, the face's horizontal direction that can judge user USR_a is direction DT_a.Then, adjusting module 510 can be according to the angle δ between direction DT_a and direction H_default, adjust the pairing display unit of each pixel data among the image data IMG, make screen 500 shown pictures meet the visual direction of user USR_a, that is compensate angle δ.
Be noted that direction V_default and H_default are that the picture that adjusting module 510 is carried out before adjusting vertically reaches horizontal display direction, it has nothing to do in the content of image data IMG.In addition, the adjustment mode of adjusting module 510 is not limited to any special rules, as long as can make screen 500 shown pictures meet the visual direction of user USR_a.For instance, each pixel data among the image data IMG can be corresponded to a coordinate system, behind the angle δ that gets between outgoing direction DT_a and direction H_default, utilize the coordinate conversion mode, the coordinate of each pixel data among the conversion image data IMG, with compensation angle δ, relevant function mode can Fig. 7 explanation.In Fig. 7, if the coordinate of a pixel data P is among the image data IMG (a, b), with the distance of initial point O be R, with the angle of x axle be θ, then can with pixel data P with polar coordinate mode be expressed as P (R, θ), wherein,
By coordinate conversion, will can get P ' behind the pixel data P anglec of rotation δ, its coordinate is (a ', b '), polar coordinates be P ' (R, θ+δ), wherein, a '=R*cos (θ+δ), b '=R*sin (θ+δ).Be noted that initial point 0 can be optional position in the picture, look closely the definition mode of coordinate axis.For example, if screen 500 shown pictures are a rectangle, and coordinate axis x, y correspond respectively to the center line of length and width, and then initial point 0 is the center (or center of gravity) of this rectangle, and position how to set coordinate axis or initial point only can influence the carrying out of coordinate conversion, and is irrelevant with spirit of the present invention.
Above-mentioned coordinate conversion mode is the possible adjustment mode of adjusting module 510, and in fact, any conversion regime that can compensate angle δ all can be used for the present invention, and is not limited thereto.In display device 50, image processor 504 is the face features according to the user, judges face orientation, and then determines its visual direction, and its function mode can reduce an image processing flow process 80, as shown in Figure 8.Image processing flow process 80 comprises following steps:
Step 800: beginning.
Step 802: receiver module 506 receives image data IMG.
Step 804: visual direction judgment means 508 is judged the visual direction of user with respect to screen 500.
Step 806: adjusting module 510 is adjusted the pairing display unit of pixel data of image data IMG according to the visual direction of visual direction judgment means 508 gained.
Step 808: display module 512 drives screen 500 and shows adjusted pixel data, with the pairing picture of image data displaying IMG.
Step 810: finish.
Image processing flow process 80 is in order to the function mode of explanation image processor 504, and detailed description can not given unnecessary details at this with reference to aforementioned.
Above stated specification do not have particularly point out visual direction really butt to, main cause is that visual direction is relevant with many factors, and the present invention is the visual direction of normally looking thing based on most of people, promptly eyes are looked squarely and are looked thing.In addition, be noted that display device 50 shown in Figure 5 is embodiments of the invention, those skilled in the art can do different modifications according to this, and are not limited thereto.For instance, for fear of the too frequent or wrong adjustment of adjusting module 510, the deviser also can increase the threshold value (Threshold) of time or angle.For example, the result who is judged when visual direction judgment means 508 represent user's face orientation and display direction continue a Preset Time and (or) both gap is during greater than predetermined angle, 510 beginnings of adjusting module are adjusted.In addition, when adjusting, adjusting module 510 also can only limit a few kinds of adjustment modes, to simplify the required resource of running.For example, be example explanation with Fig. 6 A: when angle δ between between 45 to 135 degree time, picture revolved turn 90 degrees, the angle of promptly setting the desire compensation is 90 degree; When angle δ between 135 to 225 the degree between the time, with picture Rotate 180 degree; When angle δ between between 225 to 315 degree time, with picture rotation 270 degree; And when angle δ between 315 to 45 the degree between the time, do not rotate picture.
In addition, when pick-up image, may identify several users' image of face, then visual direction judgment means 508 can be chosen one of them user, as hithermost or middle user.Otherwise if can't identify user's image of face, then adjusting module 510 can use default display direction.
On the other hand, because screen 500 is generally rectangle, if directly carry out the coordinate conversion of image data IMG, may have the part picture is cut out, then adjusting module 510 can add zoom function, with the indication range according to screen 500, further adjusts image data IMG.Moreover, display device 50 may show control menu (when being Touch Screen as screen 500) on screen 500, then adjusting module 510 also can be adjusted position and angle that menu is shown in screen 500 according to visual direction, and corresponding adjustment is also wanted in the position of touch-control instruction certainly.In addition, face feature used in the present invention, also extendible is human body contour outline, as the relative position of head and health, and is not limited thereto.
Be noted that display device 50 shown in Figure 5 is embodiments of the invention, those skilled in the art does suitable modification according to system is required.For example, when display device 50 is implemented in the intelligent handheld device, can utilize the original or newly-increased camera of intelligent handheld device, acquisition user's image of face, and then judge face orientation, with the display direction of suitable adjustment screen.Illustrate below in conjunction with difference.
Please refer to Fig. 9 A to Fig. 9 G, Fig. 9 A to Fig. 9 G is the running synoptic diagram of the embodiment of the invention one intelligent handheld device 90.Intelligent handheld device 90 disposes a camera 900, and employing display device 50 as shown in Figure 5 is its display interface.In Fig. 9 A to Fig. 9 G, direction DT represents the direction of user's eyes central authorities to chin central authorities, i.e. face's vertical direction, and "+", "-" represent the control menu that amplifies and dwindle picture respectively.If the user is in the mode shown in Fig. 9 A at the beginning, browse a picture by intelligent handheld device 90, then work as the user intelligent handheld device 90 is turned to or change the position, when causing face orientation to change, the present invention can be adjusted to intelligent handheld device 90 shown pictures the example of Fig. 9 B or Fig. 9 C automatically.Wherein, Fig. 9 B is not with the picture convergent-divergent, therefore has the part picture to be cut, and Fig. 9 C has then carried out the picture convergent-divergent, can show complete picture.In like manner, if the user is in the mode shown in Fig. 9 D, browse another picture by intelligent handheld device 90, then when the user turns to intelligent handheld device 90 or changes the position, the present invention can be adjusted to intelligent handheld device 90 shown pictures the example of (without the picture convergent-divergent) Fig. 9 E or (picture convergent-divergent) Fig. 9 F automatically.At Fig. 9 A, if the user rotates 45 degree, but also corresponding rotation display direction and adjust size of the present invention, shown in Fig. 9 G; Certainly,, can not adjust, keep the display mode of Fig. 9 A, can be adjusted to the example of Fig. 9 B or Fig. 9 C yet for reducing computational burden.
In addition, shown in Fig. 9 A to Fig. 9 G, when display direction changed, the position and the words direction of the position of "+", "-" and working line menu (i.e. " beginning ", " message registration ", " contact man ") also changed.Simultaneously, corresponding adjustment is also wanted in the position of touch-control instruction.For example, in Fig. 9 A, when the user clicked the menu of " message registration ", intelligent handheld device 90 can produce the instruction that shows message registration.When picture is adjusted to Fig. 9 B, " message registration " menu has changed to horizontal " contact man " menu, at this moment, if the user clicks the menu of " contact man ", then the instruction that produced of intelligent handheld device 90 should be changed to by demonstration message registration correspondence originally and show contact man's tabulation.
Intelligent handheld device 90 is because of its screen is a rectangle, so need carry out image-zooming.If be to be the image output interface,, and need not to carry out image-zooming as long as then carry out coordinate conversion with circular screen in other is used.Moreover the judgement of visual direction does not relate to " thing is looked in the front " whether judgement in the above stated specification, that is, look face's front image of thing (i.e. stravismus) or non-acquisition measured even the measured is non-with the front, but the present invention still can judge its visual direction.That is to say, with Fig. 9 A is example, if the user uses intelligent handheld device 90 with squint mode, or camera 900 can horizontally rotate but when the user uses not will go back to the front fully, then the present invention still can correctly judge user's visual angle, and suitably adjusts the display mode of intelligent handheld device 90.Certainly, in certain embodiments, also can comprise the function of correction " thing is looked in non-front ", not influence running of the present invention.
Prior art is the change according to gravity, judges user's visual direction, therefore, if can't sense the change of gravity, then can't judge visual direction.In comparison, the present invention is the face feature according to the beholder, judges its face orientation, and then judges its visual direction.Because the foundation of judging is beholder's a face feature, so its result do not influence by gravity factor, can significantly improve the fiduciary level and the correctness of judgement.If be used for the display direction handover mechanism of mancarried device such as intelligent handheld device, can effectively improve convenience and interest.
In sum, the present invention is the face feature according to the beholder, judges its face orientation, and then judges its visual direction.Because the face feature position when deterministic process is only merely looked thing with the beholder is relevant, is not subjected to gravity effect, thereby can improves the accuracy of judgement, and improve the usefulness of related application (as the display direction handover mechanism).
The above only is preferred embodiment of the present invention, and all equalizations of doing according to claim of the present invention change and modify, and all should belong to covering scope of the present invention.
Claims (41)
1. a visual direction determination process is used for judging the visual direction a when measured observes an object, includes:
Image of face when obtaining this measured and observing this object;
Discern a plurality of face features in this image of face, to produce a recognition result; And
According to this recognition result, judge the face orientation when this measured observes this object, to judge this visual direction.
2. visual direction determination process as claimed in claim 1, the step of this image of face when wherein obtaining this measured and observing this object includes:
Obtain an image, this image of face that this image comprises this measured when observing this object; And
According to the image characteristics value of a plurality of pixels that this image comprised, discern the face mask of this measured in this image, this image of face when observing this object to obtain this measured.
3. visual direction determination process as claimed in claim 1, wherein discern the step of these a plurality of face features in this image of face, it is the image characteristics value of a plurality of pixels of comprising according to this image of face, discern the profile of these a plurality of face features in this image of face, with these a plurality of face features of identification.
4. visual direction determination process as claimed in claim 1 wherein according to this recognition result, is judged this face orientation when this measured observes this object, to judge the step of this visual direction, includes:
According to this recognition result, judge a plurality of positions of these a plurality of face features with respect to this image of face; And
According to these a plurality of positions, judge this face orientation when this measured observes this object, to judge this visual direction.
5. visual direction determination process as claimed in claim 1, wherein this face orientation is a vertical direction of this measured's eyes central authorities to chin central authorities.
6. visual direction determination process as claimed in claim 1, wherein this face orientation is the horizontal direction of a glance of this measured to another.
7. a visual direction judgment means is used for judging the visual direction a when measured observes an object, includes:
One image of face acquisition module, the image of face when being used for obtaining this measured and observing this object;
One face feature identification module is used for discerning a plurality of face features in this image of face, to produce a recognition result; And
One judge module is used for according to this recognition result, judges the face orientation when this measured observes this object, to judge the visual direction of this measured with respect to this object.
8. visual direction judgment means as claimed in claim 7, wherein this image of face acquisition module includes:
One image acquisition unit is used for obtaining an image, this image of face that this image comprises this measured when observing this object; And
One arithmetic element is used for the image characteristics value of a plurality of pixels of comprising according to this image, discerns the face mask of this measured in this image, to obtain this image of face.
9. visual direction judgment means as claimed in claim 7, wherein this face feature identification module is the image characteristics value of a plurality of pixels of comprising according to this image of face, discern the profile of these a plurality of face features in this image of face, with these a plurality of face features of identification.
10. visual direction judgment means as claimed in claim 7, wherein this judge module includes:
One position judgment unit is used for according to this recognition result, judges a plurality of positions of these a plurality of face features with respect to this image of face; And
One direction judging unit is used for judging this face orientation when this measured observes this object according to these a plurality of positions, to judge this visual direction.
11. visual direction judgment means as claimed in claim 7, wherein this face orientation is a vertical direction of this measured's eyes central authorities to chin central authorities.
12. visual direction judgment means as claimed in claim 7, wherein this face orientation is the horizontal direction of a glance of this measured to another.
13. an image treatment method is used for a display device, this display device comprises a screen, and this method includes:
Receive an image data, this image data comprises a plurality of pixel datas, corresponding to a plurality of display units of this screen;
Judge the visual direction a when user observes this screen;
According to this visual direction, adjust the pairing display unit of these a plurality of pixel datas; And
Show adjusted these a plurality of pixel datas by these a plurality of display units, to show the pairing picture of this image data.
14. image treatment method as claimed in claim 13 is wherein judged to include the step of this visual direction when this user observes this screen:
Image of face when obtaining this user and observing this screen;
Discern a plurality of face features in this image of face, to produce a recognition result; And
According to this recognition result, judge the face orientation when this user observes this screen, to judge this visual direction.
15. image treatment method as claimed in claim 14, the step of this image of face when wherein obtaining this user and observing this screen includes:
Obtain an image, this image of face that this image comprises this user when observing this screen; And
According to the image characteristics value of a plurality of pixels that this image comprised, discern the face mask of this user in this image, this image of face when observing this screen to obtain this user.
16. image treatment method as claimed in claim 15, wherein the image characteristics value of these a plurality of pixels is selected from following group: GTG value, contrast, chroma, brightness.
17. image treatment method as claimed in claim 14, wherein discern the step of these a plurality of face features in this image of face, it is the image characteristics value of a plurality of pixels of comprising according to this image of face, discern the profile of these a plurality of face features in this image of face, with these a plurality of face features of identification.
18. image treatment method as claimed in claim 17, wherein the image characteristics value of these a plurality of pixels is selected from following group: GTG value, contrast, chroma, brightness.
19. image treatment method as claimed in claim 14 wherein according to this recognition result, is judged this face orientation when this user observes this screen, to judge the step of this visual direction, includes:
According to this recognition result, judge a plurality of positions of these a plurality of face features with respect to this image of face; And
According to these a plurality of positions, judge this face orientation when this user observes this screen, to judge this visual direction.
20. image treatment method as claimed in claim 14, wherein this face orientation is a vertical direction of this user's eyes central authorities to chin central authorities.
21. image treatment method as claimed in claim 14, wherein this face orientation is the horizontal direction of a glance of this user to another.
22. image treatment method as claimed in claim 14, wherein these a plurality of face features are selected from following group: eyes, nose, face, ear, eyebrow, glasses, earrings, chin.
23. image treatment method as claimed in claim 13, wherein according to this visual direction, adjust the step of the pairing display unit of these a plurality of pixel datas, be according to this visual direction, adjust the pairing display unit of these a plurality of pixel datas, make these a plurality of display units show that the directional correlation of this picture is in this visual direction.
24. image treatment method as claimed in claim 13, it also comprises the indication range according to this screen, adjusts the size of this picture.
25. image treatment method as claimed in claim 13, it also comprises according to this visual direction, and a plurality of menus of adjusting this display device are shown in the position and the angle of this screen.
26. an image processor is used for a display device, this display device comprises a screen, and this image processor includes:
One receiver module is used for receiving an image data, and this image data comprises a plurality of pixel datas, corresponding to a plurality of display units of this screen;
One visual direction judgment means is used for judging the visual direction of a user with respect to this screen;
One adjusting module is used for adjusting the pairing display unit of these a plurality of pixel datas according to this visual direction; And
One display module is used for driving these a plurality of display units and shows adjusted these a plurality of pixel datas, to show the pairing picture of this image data.
27. image processor as claimed in claim 26, wherein this visual direction judgment means includes:
One image of face acquisition module, the image of face when being used for obtaining this user and observing this screen;
One face feature identification module is used for discerning a plurality of face features in this image of face, to produce a recognition result; And
One judge module is used for according to this recognition result, judges the face orientation when this user observes this screen, to judge this visual direction.
28. image processor as claimed in claim 27, wherein this image of face acquisition module includes:
One image acquisition unit is used for obtaining an image, this image of face that this image comprises this user when observing this screen; And
One arithmetic element is used for the image characteristics value of a plurality of pixels of comprising according to this image, discerns the face mask of this user in this image, to obtain this image of face.
29. image processor as claimed in claim 28, wherein the image characteristics value of these a plurality of pixels is selected from following group: GTG value, contrast, chroma, brightness.
30. image processor as claimed in claim 27, wherein this face feature identification module is the image characteristics value of a plurality of pixels of comprising according to this image of face, discern the profile of these a plurality of face features in this image of face, with these a plurality of face features of identification.
31. image processor as claimed in claim 30, wherein the image characteristics value of these a plurality of pixels is selected from following group: GTG value, contrast, chroma, brightness.
32. image processor as claimed in claim 27, wherein this judge module includes:
One position judgment unit is used for according to this recognition result, judges a plurality of positions of these a plurality of face features with respect to this image of face; And
One direction judging unit is used for judging this face orientation when this user observes this screen according to these a plurality of positions, to judge this visual direction.
33. image processor as claimed in claim 27, wherein this face orientation is a vertical direction of this user's eyes central authorities to chin central authorities.
34. image processor as claimed in claim 27, wherein this face orientation is the horizontal direction of a glance of this user to another.
35. image processor as claimed in claim 27, wherein these a plurality of face features are selected from following group: eyes, nose, face, ear, eyebrow, glasses, earrings, chin.
36. image processor as claimed in claim 26, wherein this adjusting module is to be used for adjusting the pairing display unit of these a plurality of pixel datas according to this visual direction, makes these a plurality of display units show that the direction of this picture is to be relevant to this visual direction.
37. image processor as claimed in claim 26, wherein this adjusting module also is used for the indication range according to this screen, adjusts the size of this picture.
38. image processor as claimed in claim 26, wherein this adjusting module also is used for according to this visual direction, and a plurality of menus of adjusting this display device are shown in the position and the angle of this screen.
39. a display device, the display direction that can automatically switch includes:
One screen includes a plurality of display units;
One image data generation device is used for producing an image data, and this image data comprises a plurality of pixel datas, corresponding to these a plurality of display units of this screen; And
One image processor is used for handling this image data, and by the result after this screen playback process, this image processor includes:
One receiver module is used for receiving this image data;
One visual direction judgment means is used for judging the visual direction of a user with respect to this screen;
One adjusting module is used for adjusting the pairing display unit of these a plurality of pixel datas according to this visual direction; And
One display module is used for driving these a plurality of display units and shows adjusted these a plurality of pixel datas, to show the pairing picture of this image data.
40. display device as claimed in claim 39, wherein this visual direction judgment means includes:
One image of face acquisition module, the image of face when being used for obtaining this user and observing this screen;
One face feature identification module is used for discerning a plurality of face features in this image of face, to produce a recognition result; And
One judge module is used for according to this recognition result, judges the face orientation when this user observes this object, to judge this visual direction.
41. an electronic installation has Presentation Function, includes:
One screen includes a plurality of display units; And
One image processor includes:
One receiver module is used for receiving an image data, and this image data comprises a plurality of pixel datas, corresponding to these a plurality of display units of this screen;
One visual direction judgment means is used for judging the visual direction of a user with respect to this screen;
One adjusting module is used for adjusting the pairing display unit of these a plurality of pixel datas according to the visual direction of this user with respect to this screen; And
One display module is used for driving these a plurality of display units and shows adjusted these a plurality of pixel datas, to show the pairing picture of this image data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2009101802719A CN102043942A (en) | 2009-10-12 | 2009-10-12 | Visual direction judging method, image processing method, image processing device and display device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2009101802719A CN102043942A (en) | 2009-10-12 | 2009-10-12 | Visual direction judging method, image processing method, image processing device and display device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102043942A true CN102043942A (en) | 2011-05-04 |
Family
ID=43910072
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2009101802719A Pending CN102043942A (en) | 2009-10-12 | 2009-10-12 | Visual direction judging method, image processing method, image processing device and display device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102043942A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102841725A (en) * | 2011-06-21 | 2012-12-26 | 鸿富锦精密工业（深圳）有限公司 | Electronic device and screen information adjusting method thereof |
| CN103413467A (en) * | 2013-08-01 | 2013-11-27 | 袁苗达 | Controllable compelling guide type self-reliance study system |
| CN105759968A (en) * | 2016-02-22 | 2016-07-13 | 深圳市金立通信设备有限公司 | Display interface adjusting method and terminal |
| CN105808180A (en) * | 2014-12-30 | 2016-07-27 | 深圳富泰宏精密工业有限公司 | Picture adjustment method and system |
| CN107831904A (en) * | 2012-05-02 | 2018-03-23 | 三星电子株式会社 | Electronic equipment and its operating method |
| CN108416322A (en) * | 2018-03-27 | 2018-08-17 | 吉林大学 | Visual action identification method in a kind of Virtual assemble seat type operation |
| CN109634418A (en) * | 2018-12-14 | 2019-04-16 | 维沃移动通信有限公司 | A kind of display methods and terminal |
| WO2019128450A1 (en) * | 2017-12-25 | 2019-07-04 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Capturing method and related products |
| CN114527865A (en) * | 2020-11-23 | 2022-05-24 | 瑞昱半导体股份有限公司 | Device interaction method based on attention direction |
-
2009
- 2009-10-12 CN CN2009101802719A patent/CN102043942A/en active Pending
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102841725A (en) * | 2011-06-21 | 2012-12-26 | 鸿富锦精密工业（深圳）有限公司 | Electronic device and screen information adjusting method thereof |
| CN107831904A (en) * | 2012-05-02 | 2018-03-23 | 三星电子株式会社 | Electronic equipment and its operating method |
| CN103413467A (en) * | 2013-08-01 | 2013-11-27 | 袁苗达 | Controllable compelling guide type self-reliance study system |
| CN105808180A (en) * | 2014-12-30 | 2016-07-27 | 深圳富泰宏精密工业有限公司 | Picture adjustment method and system |
| CN105808180B (en) * | 2014-12-30 | 2020-08-18 | 深圳富泰宏精密工业有限公司 | Picture adjusting method and system |
| CN105759968A (en) * | 2016-02-22 | 2016-07-13 | 深圳市金立通信设备有限公司 | Display interface adjusting method and terminal |
| WO2019128450A1 (en) * | 2017-12-25 | 2019-07-04 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Capturing method and related products |
| US10798302B2 (en) | 2017-12-25 | 2020-10-06 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method of capturing based on usage status of electronic device and related products |
| CN108416322A (en) * | 2018-03-27 | 2018-08-17 | 吉林大学 | Visual action identification method in a kind of Virtual assemble seat type operation |
| CN108416322B (en) * | 2018-03-27 | 2019-05-17 | 吉林大学 | Visual action identification method in a kind of Virtual assemble seat type operation |
| CN109634418A (en) * | 2018-12-14 | 2019-04-16 | 维沃移动通信有限公司 | A kind of display methods and terminal |
| CN114527865A (en) * | 2020-11-23 | 2022-05-24 | 瑞昱半导体股份有限公司 | Device interaction method based on attention direction |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102043942A (en) | Visual direction judging method, image processing method, image processing device and display device | |
| US20230333377A1 (en) | Display System | |
| US9846304B2 (en) | Display method and display apparatus in which a part of a screen area is in a through-state | |
| CN101165538B (en) | Imaging display apparatus and method | |
| US9372348B2 (en) | Apparatus and method for a bioptic real time video system | |
| US11294203B2 (en) | Enhanced optical and perceptual digital eyewear | |
| US20110074822A1 (en) | Viewing Direction Determination Method, Viewing Direction Determination Apparatus, Image Processing Method, Image Processing Apparatus, Display Device and Electronic Device | |
| US8696113B2 (en) | Enhanced optical and perceptual digital eyewear | |
| CN108028957A (en) | Information processor, information processing method and program | |
| CN106797460A (en) | The reconstruction of 3 D video | |
| JP2011258191A (en) | Selection of view orientation in portable device using image analysis | |
| KR20150102026A (en) | Display update time reduction for a near-eye display | |
| CN107037592B (en) | Wear vision optimization system, intelligent terminal and the helmet of display equipment | |
| CA2875261C (en) | Apparatus and method for a bioptic real time video system | |
| US11487354B2 (en) | Information processing apparatus, information processing method, and program | |
| CN109002164A (en) | It wears the display methods for showing equipment, device and wears display equipment | |
| CN110352033A (en) | Eyes degree of opening is determined with eye tracks device | |
| CN109461124A (en) | A kind of image processing method and terminal device | |
| CN107835404A (en) | Method for displaying image, equipment and system based on wear-type virtual reality device | |
| CN111213375A (en) | Information processing apparatus, information processing method, and program | |
| WO2020044916A1 (en) | Information processing device, information processing method, and program | |
| CN112907702A (en) | Image processing method, image processing device, computer equipment and storage medium | |
| JP2021124520A (en) | Image display device, program for image display, and image display method | |
| CN117032612B (en) | Interactive teaching method, device, terminal and medium based on high beam imaging learning machine | |
| WO2020211057A1 (en) | Portable electronic device and use method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20110504 |