CN102591505A - Electronic device and touch position correction method thereof - Google Patents
Electronic device and touch position correction method thereof Download PDFInfo
- Publication number
- CN102591505A CN102591505A CN2011100230989A CN201110023098A CN102591505A CN 102591505 A CN102591505 A CN 102591505A CN 2011100230989 A CN2011100230989 A CN 2011100230989A CN 201110023098 A CN201110023098 A CN 201110023098A CN 102591505 A CN102591505 A CN 102591505A
- Authority
- CN
- China
- Prior art keywords
- face
- coordinate
- people
- image
- touch
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 11
- 238000001514 detection method Methods 0.000 claims abstract description 9
- 238000009434 installation Methods 0.000 claims description 33
- 239000000758 substrate Substances 0.000 claims description 23
- 238000010586 diagram Methods 0.000 description 10
- 239000004973 liquid crystal related substance Substances 0.000 description 7
- 230000008569 process Effects 0.000 description 4
- -1 acryl Chemical group 0.000 description 2
- 230000009471 action Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 239000004033 plastic Substances 0.000 description 2
- 229920003023 plastic Polymers 0.000 description 2
- 208000004350 Strabismus Diseases 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000002250 progressing effect Effects 0.000 description 1
- 230000001915 proofreading effect Effects 0.000 description 1
- 239000012780 transparent material Substances 0.000 description 1
Images
Abstract
An electronic device and a method for correcting a touch position thereof are provided. The electronic device comprises a touch screen and a first camera unit. In the method, a first image is shot through a first camera unit, and face detection processing is carried out on the first image to determine face position information. And calculating coordinate offset according to the face position information, and correcting a two-dimensional touch coordinate corresponding to the touch detected by the touch screen by using the coordinate offset.
Description
Technical field
The invention relates to a kind of touch control operation technology, and particularly relevant for a kind of method of touch position and electronic installation that uses the method proofreaied and correct.
Background technology
Along with progressing greatly of touch technology, Touch Screen also replaces conventional screen gradually and becomes the input and the output instrument of electronic installation.Many consumer electronic product are to meet user's requirement light and handy to outward appearance, also utilize the space of Touch Screen with the saving physical button one after another, and place large-sized Touch Screen with bigger zone.
The synoptic diagram of light refraction when Fig. 1 person of being to use is positioned at Touch Screen the place ahead diverse location.As shown in Figure 1, general Touch Screen comprises the substrate 120 that makes in order to the touch-control sensing layer 110 that detects the touching operation, by materials such as glass, plastics or acryl, and the liquid crystal that can emit beam (liquid crystal) display dielectric layer 130.The light that sends when liquid crystal display dielectric layer 130 is through substrate 120, when touch-control sensing layer 110 gets in the air, and because of substrate 120, touch-control sensing layer 110 and air all belong to different medium, so light can produce twice refraction.But, therefore in Fig. 1, ignored light and got into the refraction effect that touch-control sensing layer 110 is taken place by substrate 120 because touch-control sensing layer 110 is thin completely.
When the user is in position C and when facing Touch Screen and operating, because the angle ∠ FAC that user's sight line and Touch Screen constitute levels off to and 90 spend, so the side-play amount of display dielectric layer 130 light that A is sent from the position is very small.That is, angle ∠ ABC level off to 180 the degree.
Yet, if the user with Touch Screen pendulum in the side operation, the meeting that the user sees is through the light behind the deviation by a relatively large margin, when therefore causing the user to go to touch the position that eyes see easily, but is not the position that touches actual sensed point.For instance, when the user in the position during E because substrate 120 is a different medium with air, so liquid crystal display dielectric layer 130 light that A sends from the position needs penetrate substrate 120 reaches the user again via air eyes via route ADGE.And after the user sees image, because of brain assert that light is that straight line carries out, therefore can produce image and be by position F through route FDGE and the illusion of coming.Just because of this, when the user wants seeing image image is touched when operation, can remove touch position I because of above-mentioned illusion.Yet in fact position H is only the corresponding touch points that truly emits beam.
Summary of the invention
In view of this, the present invention provides a kind of bearing calibration of touch position, can promote the user touches when operation to electronic installation accuracy to touch coordinate correction.
The present invention provides a kind of electronic installation, can when the operating position skew of judging the user, revise touch coordinate, thereby reduce the input error that vision offset caused.
The present invention proposes a kind of bearing calibration of touch position, is used to comprise the electronic installation of the Touch Screen and first image unit.The method comprises through first image unit takes first image, and first image is carried out people's face detect processing with decider's face positional information.Again according to people's face positional information calculation coordinate offset amount, and the corresponding two-dimentional touch coordinate of touching of utilizing coordinate offset amount correction Touch Screen to be detected.
In one embodiment of this invention, wherein first image being carried out people's face detect to handle step with decider's face positional information and comprises first image is divided into a plurality of predeterminable areas.Wherein each predeterminable area is distinguished a corresponding preset coordinate side-play amount.Then, first image is carried out people's face detect to handle obtaining the people's face block in first image, and with people's face block respectively the area ratio in each predeterminable area as people's face positional information.
In one embodiment of this invention, wherein comprise according to people's face block area ratio in each predeterminable area respectively, and the preset coordinate side-play amount of each predeterminable area is come the coordinates computed side-play amount according to the step of people's face positional information calculation coordinate offset amount.
In one embodiment of this invention, wherein electronic installation also comprises second image unit.Detect to handle step with decider's face positional information and also comprise through second image unit and take second image and first image is carried out people's face.First image and second image are carried out people's face detection processing; In first image and second image, obtaining the two-dimension human face coordinate of people's face block of corresponding same people respectively, and utilize two two-dimension human face coordinates that belong to first image and second image respectively to come Calculation of Three Dimensional people face coordinate with as people's face positional information.
In one embodiment of this invention, wherein comprise and obtain the auxiliary coordinate of the pairing three-dimensional touching of two-dimentional touch coordinate according to the step of people's face positional information calculation coordinate offset amount.Whether the angle of line and Touch Screen of judging three-dimensional face coordinate and the auxiliary coordinate of three-dimensional touching is more than or equal to an angle threshold.If not, then according to refractive index, three-dimensional face coordinate and the auxiliary coordinate Calculation coordinate offset amount of three-dimensional touching of the substrate of Touch Screen.
From another viewpoint, the present invention proposes a kind of electronic installation, comprises that Touch Screen, first image unit, people's face position obtain module, and the touch position correction module.Touch Screen is in order to detect touching, and first image unit is in order to take first image.People's face position is obtained module and is coupled to first image unit, detects processing with decider's face positional information in order to first image is carried out people's face.The touch position correction module is coupled to Touch Screen and module is obtained in people's face position, in order to according to people's face positional information calculation one coordinate offset amount, and utilizes the correction of coordinate offset amount to touch pairing two-dimentional touch coordinate.
In one embodiment of this invention, wherein people's face position is obtained module first image is divided into a plurality of predeterminable areas, wherein the corresponding preset coordinate side-play amount of each predeterminable area difference.People's face position is obtained module and first image is carried out people's face detect to be handled obtaining the people's face block in first image, and with people's face block respectively the area ratio in each predeterminable area as people's face positional information.
In one embodiment of this invention, wherein the touch position correction module according to people's face block respectively the preset coordinate side-play amount of the area ratio in each predeterminable area and each predeterminable area come the coordinates computed side-play amount.
In one embodiment of this invention, electronic installation also comprises second image unit, and it is coupled to people's face position and obtains module, in order to take second image.People's face position is obtained module first image and second image is carried out people's face detection processing; In first image and second image, obtaining the two-dimension human face coordinate of people's face block of corresponding same people respectively, and utilize the two-dimension human face coordinate Calculation three-dimensional face coordinate that belongs to first image and second image respectively with as people's face positional information.
In one embodiment of this invention; The touch position correction module is obtained the auxiliary coordinate of the pairing three-dimensional touching of two-dimentional touch coordinate, and judges that whether the angle of line and Touch Screen that three-dimensional face coordinate and three-dimensional touching assist coordinate is more than or equal to angle threshold.If not, the touch position correction module is according to refractive index, three-dimensional face coordinate and the auxiliary coordinate Calculation coordinate offset amount of three-dimensional touching of the substrate of Touch Screen.
Based on above-mentioned, the present invention comprises through shooting user's image judges whether user's operating position squints, and when the operating position skew of judging the user, suitably comes touch coordinate is revised according to degrees of offset.Can avoid causing the situation of touch position mistake in view of the above because of light refraction.
For letting the above-mentioned feature and advantage of the present invention can be more obviously understandable, hereinafter is special lifts embodiment, and cooperates appended graphic elaborating as follows.
Description of drawings
The synoptic diagram of light refraction when Fig. 1 person of being to use is positioned at Touch Screen the place ahead diverse location.
Fig. 2 is the calcspar according to the electronic installation that one embodiment of the invention illustrated.
Fig. 3 is the process flow diagram according to the bearing calibration of the touch position that one embodiment of the invention illustrated.
Fig. 4 is the synoptic diagram according to the predeterminable area of first image that one embodiment of the invention illustrated.
Fig. 5 is the calcspar according to the electronic installation that another embodiment of the present invention illustrated.
Fig. 6 is the process flow diagram according to the bearing calibration of the touch position that another embodiment of the present invention illustrated.
Fig. 7 is user and the synoptic diagram of Touch Screen in three dimensions according to one embodiment of the invention illustrated.
[main element label declaration]
110: the touch-control sensing layer
120: substrate
130: the liquid crystal display dielectric layer
A, B, C, D, E, F, G, H, I: position
200,500: electronic installation
210,510: Touch Screen
220,520: the first image units
230,530: module is obtained in people's face position
240,540: the touch position correction module
S310～S350: each step of the bearing calibration of the described touch position of one embodiment of the invention
400: the first images
A1, A2, A3, A4, A5, A6, A7, A8, A9, A10, A11, A12, A13, A14, A15, A16, A17: predeterminable area
550: the second image units
S610～S690: each step of the bearing calibration of the described touch position of another embodiment of the present invention
700: three dimensions
U: three-dimensional face coordinate
S: three-dimensional touch coordinate
S ': the auxiliary coordinate of three-dimensional touching
W: substrate thickness
θ 1: angle
V, v ', q: three-dimensional coordinate
θ
2: the refraction angle
θ
3: incident angle
Embodiment
Fig. 2 is the calcspar according to the electronic installation that one embodiment of the invention illustrated.See also Fig. 2, electronic installation 200 comprises that Touch Screen 210, first image unit 220, people's face position obtain module 230, and touch position correction module 240.
Touch Screen 210 for example is resistance touch screen or capacitance touch control screen, and the present invention does not limit the kind of Touch Screen 210.Touch Screen 210 detects user's touching through the touch-control sensing layer with touch sensing element, and presents various picture through for example liquid crystal display dielectric layers such as (liquid crystal).In the present embodiment, the controller of Touch Screen 210 can convert each touching into comprise X axial coordinate and Y axial coordinate two-dimentional touch coordinate.
First image unit 220 can be camera or video camera, in order to take one first image.In the present embodiment, first image unit 220 is to be configured on the same plane of electronic installation 200 shells with Touch Screen 210.
People's face position is obtained module 230 and is coupled to first image unit 220.After first image unit 220 was taken first image, module 230 is obtained in people's face position can carry out people's face detection processing to first image, and after detecting people's face block, determines people's face positional information.The present invention does not limit the technological means that people's face detection processing is adopted.
Touch position correction module 240 is coupled to Touch Screen 210 and obtains module 230 with people's face position.Offset situation when touch position correction module 240 can learn that the user touches operation according to people's face positional information; And then calculate a coordinate offset amount accordingly, and pairing two-dimentional touch coordinate when utilizing the coordinate offset amount to revise the user to touch Touch Screen 210.
In order to further specify the detailed mode of proofreading and correct touch position, below special another embodiment of act come that the present invention will be described.Fig. 3 is according to the process flow diagram of the bearing calibration of the touch position that one embodiment of the invention illustrated, and please consults Fig. 2 and Fig. 3 simultaneously.
At first shown in step S310, take first image through first image unit 220.In one embodiment, first image unit 220 can come regular filmed image according to predetermined period.In another embodiment, electronic installation 200 also comprises a distance sensing device (not illustrating), and first image unit 220 can the distance sensing device detected object near the time filmed image.
Then in step S320, people's face position is obtained module 230 first image is divided into a plurality of predeterminable areas, wherein the corresponding preset coordinate side-play amount of each predeterminable area difference.Fig. 4 is the synoptic diagram according to the predeterminable area of first image that one embodiment of the invention illustrated.See also Fig. 4, people's face position is obtained module 230 first image 400 is divided into 17 predeterminable areas (being predeterminable area A1 to A17) in the present embodiment, and the corresponding separately preset coordinate side-play amount of each predeterminable area.In detail, the preset coordinate side-play amount comprises X axle offset amount and Y axle offset amount.Because predeterminable area 9 is the middle positions that are positioned at first image 400, so the X axle offset amount of its preset coordinate side-play amount and Y axle offset amount are 0.The preset coordinate side-play amount of other each predeterminable area can be set according to the numerical value of experiment statistics.What must specify is that the present invention does not limit the quantity and the shape of predeterminable area.
Shown in step S330, people's face position is obtained 230 pairs first images of module and is carried out people's face and detect to handle obtaining the people's face block in first image, and with people's face block respectively the area ratio in each predeterminable area as people's face positional information.Particularly, people's face position is obtained module 230 and is being carried out can judging whether first image comprises people's face block after people's face detect to be handled.If judge that then people's face block is which or which predeterminable area that is arranged in first image.If people's face block is positioned within a certain predeterminable area fully, people's face block is absolutely at the area ratio of this predeterminable area.And when people's face block during across several predeterminable areas, people's face position obtain module 230 can acquisitor's face blocks the area ratio in each predeterminable area respectively.In another embodiment, in first image, detect a plurality of people's face blocks if module 230 is obtained in people's face position, expression has several users the place ahead at electronic installation 200.Owing to should have big more area the closer to the user of electronic installation 200 corresponding people's face block in first image, so to obtain module 230 can serve as main people's face positional information that decides with the people's face block with maximum area in people's face position.
Next shown in step S340, touch position correction module 240 according to people's face block respectively the preset coordinate side-play amount of the area ratio in each predeterminable area and each predeterminable area come the coordinates computed side-play amount.For instance, if people's face block is positioned within the predeterminable area, touch position correction module 240 can directly be used as the coordinate offset amount with the pairing preset coordinate side-play amount of this predeterminable area.Yet, if people's face block across several predeterminable areas, touch position correction module 240 can be obtained the predeterminable area of corresponding maximum area ratio, and is used as the coordinate offset amount with the preset coordinate side-play amount of the predeterminable area obtained.Perhaps, touch position correction module 240 can according to people's face block respectively the area ratio in each predeterminable area calculate each predeterminable area the statistical value of preset coordinate side-play amount with as the coordinate offset amount.For instance, touch position correction module 240 can be regarded as weighted value at the area ratio of each predeterminable area with people's face block, thereby the weighted mean value of preset coordinate side-play amount that calculates each predeterminable area is with as the coordinate offset amount.
In step S350, touch position correction module 240 utilizes the correction of coordinate offset amount to touch pairing two-dimentional touch coordinate at last.For example; X axle offset amount that touch position correction module 240 adds the coordinate offset amount respectively with the X axial coordinate and the Y axial coordinate of touch coordinate and Y axle offset amount then send the two-dimentional touch coordinate through overcorrect to corresponding application program to carry out associative operation again to produce the two-dimentional touch coordinate through overcorrect.
In the above-described embodiments; Electronic installation 200 is to judge through first image unit, 220 filmed images the user in which direction with respect to electronic installation 200 operates, and the two-dimentional touch coordinate when obtaining the coordinate offset amount and come that the user touched Touch Screen 210 according to this direction is revised.Thus, be not when operating the user facing to the centre of Touch Screen 210, can revise touch coordinate through above-mentioned mechanism, to reduce the possibility that can't obtain expected execution result because of the touching errors present.
Fig. 5 is the calcspar according to the electronic installation that another embodiment of the present invention illustrated.See also Fig. 5, electronic installation 500 comprises that Touch Screen 510, first image unit 520, people's face position obtain module 530, touch position correction module 540, and second image unit 550.Because the Touch Screen 210 and first image unit 220 in Touch Screen 510 and first image unit 520 and the electronic installation 200 have same or analogous function, so repeat no more at this.
In the present embodiment, people's face position is obtained module 530 and is coupled to first image unit 520 and second image unit 550.People's face position obtain module 530 first image unit 520 and second image unit 550 take comprise same user's image after, can utilize two image units institute respectively the image of shooting try to achieve the three-dimensional coordinate of user in the space with as people's face positional information.
Touch position correction module 540 is coupled to Touch Screen 510 and obtains module 530 with people's face position.In the present embodiment, touch position correction module 540 will judge whether and will proofread and correct touch coordinate according to the position that three-dimensional coordinate and the user of user in the space touches Touch Screen 510.
Fig. 6 is the process flow diagram according to the bearing calibration of the touch position that another embodiment of the present invention illustrated.Below will come the detailed operation mode of each member in the electronic installation 500 is described, please consult Fig. 5 and Fig. 6 simultaneously with Fig. 6.
At first shown in step S610, take first image through first image unit 520.And in step S620, take second image through second image unit 550.In the present embodiment, first image unit 520 and second image unit 550 be filmed image regularly, or when object is arranged near electronic installation 500, just removes filmed image.
Then shown in step S630; People's face position is obtained module 530 and respectively first image and second image is carried out people's face detection processing; With the two-dimension human face coordinate of acquisitor's face block in first image, and in second image, obtain the two-dimension human face coordinate of people's face block of mutually same people.That is to say that module 530 is obtained in people's face position will obtain the same position user coordinate position in two captured images of two image units respectively.For instance; Module 530 is obtained after first image and second image being carried out people's face detect to be handled and judging people's face block that in two images, all can find corresponding same user in people's face position, people's face position obtain module 530 will with people's face block respectively the center point coordinate in two images be used as the two-dimension human face coordinate.
Next in step S640, people's face position is obtained module 530 and is utilized the two-dimension human face coordinate that belongs to first image and second image respectively to come Calculation of Three Dimensional people face coordinate, and with this three-dimensional face coordinate as people's face positional information.In detail; Geometric relationship known between module 530 first image units 520 capable of using and second image unit 550 (for example distance, angle) and the people's face block two-dimension human face coordinate in first image and second image is respectively obtained in people's face position; Be aided with again trigonometric function concern push away user's locus (that is three-dimensional face coordinate).People's face position is obtained module 530 and can be adopted any mode with many image reconstructions three-dimensional coordinate to come the let others have a look at three-dimensional face coordinate of face positional information of reckoner, and the present invention does not limit this.
Then shown in step S650, touch position correction module 540 is obtained the auxiliary coordinate of the pairing three-dimensional touching of two-dimentional touch coordinate.The acquisition mode of the auxiliary coordinate of three-dimensional touching below will be described with Fig. 7.
Fig. 7 is user and the synoptic diagram of Touch Screen in three dimensions according to one embodiment of the invention illustrated.See also Fig. 7, in three dimensions 700, the u point is user's position (being the three-dimensional face coordinate), and the surface of supposing Touch Screen 510 is positioned at the XY plane that X axle and Y axle are constituted.In general, have the touch-control sensing layer under the surface of Touch Screen 510, and the below of touch-control sensing layer is substrate (for example being any transparent materials such as glass, plastics or acryl), the below of substrate then is a display dielectric layer.But, therefore in Fig. 7, only illustrate the substrate portion of Touch Screen 510 because the touch-control sensing layer is thin completely, and explains for ease.
Touch position correction module 540 can increase a Z axial coordinate (coordinate figure is 0) with the two-dimentional touch coordinate that originally includes only X axial coordinate and Y axial coordinate and produce three-dimensional touch coordinate s.In the present embodiment; The auxiliary coordinate s ' of three-dimensional touching has identical X axial coordinate value and Y axial coordinate value with three-dimensional touch coordinate s, and touch position correction module 540 can be set at the Z axial coordinate value of the auxiliary coordinate s ' of three-dimensional touching the negative value of the substrate thickness w of Touch Screen 510.
After obtaining the auxiliary coordinate of three-dimensional touching, then shown in step S660, touch position correction module 540 judges that whether the angle of line and Touch Screen 510 that three-dimensional face coordinate and three-dimensional touching assist coordinate is more than or equal to an angle threshold.Above-mentioned judgement is because when the line of user's sight line and touch points is not parallel to Touch Screen 510 normals to a surface more, and the easier light that sends because of display dielectric layer of user produces significantly that deviation touches errors present.Base this, touch position correction module 540 can have or not more than or equal to angle threshold according to above-mentioned angle and determines whether and will revise the position of user's touching.Yet what must specify is that the light that display dielectric layer sends can get into air again through substrate, touch-control sensing layer, therefore twice refraction can take place.But,, describe and only get into the refraction that air took place through substrate to light so the following light that omits gets into the slight refraction that the touch-control sensing layer is taken place by substrate because the touch-control sensing layer is extremely thin.
With Fig. 7 is example, and when touch position correction module 540 will carry out the judgement of step S660, touch position correction module 540 utilized the auxiliary coordinate s ' of three-dimensional touching to determine a straight line with three-dimensional face coordinate u earlier.Because the surface of Touch Screen 510 is the XY planes that are positioned at X axle and Y axle formation, so the angle on this straight line and XY plane is three-dimensional face coordinate u and the line
of the auxiliary coordinate s ' of three-dimensional touching and the angle theta 1 of Touch Screen 510.
Suppose that angle threshold is 85 degree (the present invention is not limited thereto); If angle theta 1 is more than or equal to angle threshold, expression line
is almost perpendicular to the surface of Touch Screen 510.This moment, touch position correction module 540 is judged need not revise the pairing two-dimentional touch coordinate of touching shown in step S670.Otherwise if angle theta 1 is less than angle threshold; Therefore the degree of light refraction is bigger the time; So shown in step S680, touch position correction module 540 will be according to refractive index, three-dimensional face coordinate and the auxiliary coordinate Calculation coordinate offset amount of three-dimensional touching of the substrate of Touch Screen 510.
Be example again with Fig. 7; When Touch Screen 510 is watched in the position that the user is in three-dimensional face coordinate u; Because the cause of deflection of light; In fact it is to send from the auxiliary coordinate s ' of three-dimensional touching that the light that is sent by three-dimensional coordinate v ' place can the person of being used takes for, and causes the user can go to touch the position of three-dimensional touch coordinate s.Yet what in fact the user should touch is the position of three-dimensional coordinate v.In order to revise the position to user touching, touch position correction module 540 is at first according to this law (Snell ' s Law) and the incident angle θ of the light that sent with formula Calculation of Three Dimensional coordinate v ' like this
3:
N
B×sinθ
3＝N
A×sin?θ
2
Wherein, N
BRefractive index, the N of the substrate of expression Touch Screen 510
AThe refractive index of expression air, and refraction angle θ
2Be 90 degree and angle theta
1Difference.Then, touch position correction module 540 utilizes thickness w, the incident angle θ of the substrate of Touch Screen 510
3And the tangent in the trigonometric function (tangent) function calculation line segment
Length.And utilize thickness w, the refraction angle θ of the substrate of Touch Screen 510
2And tan calculates line segment
Length.In view of the above, just can be regarded as out the length of line segment
.Touch position correction module 540 will be with the length of line segment
as the coordinate offset amount.
In step S670, touch position correction module 540 utilizes coordinate offset amount correction two dimension touch coordinate at last.Particularly; As shown in Figure 7; Because the auxiliary coordinate s ' of three-dimensional touching has identical Y axial coordinate value and Z axial coordinate value with three-dimensional coordinate v ', therefore the X axial coordinate value of the length of line segment capable of using
and the auxiliary coordinate s ' of three-dimensional touching is to obtain the X axial coordinate value of three-dimensional coordinate v '.After obtaining X axial coordinate value, Y axial coordinate value and the Z axial coordinate value of three-dimensional coordinate v '; Because of three-dimensional coordinate v is the subpoint that three-dimensional coordinate v ' is projected to the XY plane; Therefore three-dimensional coordinate v has identical X axial coordinate value and Y axial coordinate value with three-dimensional coordinate v ', and touch position correction module 540 will be with the X axial coordinate value of three-dimensional coordinate v and Y axial coordinate value as revised two-dimentional touch coordinate.
Thus; When the user watches Touch Screen 510 in the position of three-dimensional face coordinate u; Even if the user will think it is to send from three-dimensional coordinate s ' by mistake from the light that three-dimensional coordinate v ' is sent; Then remove to touch three-dimensional touch coordinate s; Touch position correction module 540 also can be obtained the two-dimentional touch coordinate of corresponding three-dimensional coordinate v behind above-mentioned corrective action, and two-dimentional touch coordinate is sent to relevant application program carries out action to order about application program according to revised two-dimentional touch coordinate.
In the above-described embodiments, the position of the three-dimensional face coordinate person of being to use in the space, the position of finger (or input tool) when touching Touch Screen 510 that the auxiliary coordinate of three-dimensional touching then can corresponding user.Through each step shown in Figure 6,, also can produce accurate touching effect through the correction of touch coordinate even if do not level off to 90 when spending at the line of user face and finger (or input tool) and the angle between the Touch Screen 510.
In sum, the bearing calibration of electronic installation of the present invention and touch position thereof is to judge through the image unit filmed image whether the user has the situation of offset when Touch Screen is operated.If then obtain corresponding coordinate offset amount and proofread and correct touch coordinate according to the degrees of offset of operating.So can revise, and then promote the correctness of touching operation to the errors present of user's touching.
Though the present invention discloses as above with embodiment; Right its is not in order to limit the present invention; Has common knowledge the knowledgeable in the technical field under any; Do not breaking away from the spirit and scope of the present invention, when doing a little change and retouching, so protection scope of the present invention is as the criterion when looking appended the claim scope person of defining.
Claims (10)
1. the bearing calibration of a touch position is used to comprise the electronic installation of the Touch Screen and first image unit, and this method comprises:
Take first image through this first image unit;
This first image is carried out people's face detect processing with decider's face positional information;
According to this people's face positional information calculation coordinate offset amount; And
The corresponding two-dimentional touch coordinate of touching of utilizing this this Touch Screen of coordinate offset amount correction to be detected.
2. the bearing calibration of touch position according to claim 1, wherein this first image is carried out this people's face detection processing and comprise with the step that determines this people's face positional information:
Dividing this first image is a plurality of predeterminable areas, and wherein respectively these a plurality of predeterminable areas are distinguished a corresponding preset coordinate side-play amount;
This first image is carried out this people's face detect processing to obtain the people's face block in this first image; And
With this people's face block respectively the area ratio in these a plurality of predeterminable areas respectively as this people's face positional information.
3. the bearing calibration of touch position according to claim 2, wherein the step according to this this coordinate offset amount of people's face positional information calculation comprises:
According to this people's face block respectively this area ratio in these a plurality of predeterminable areas respectively and respectively this preset coordinate side-play amount of these a plurality of predeterminable areas calculate this coordinate offset amount.
4. the bearing calibration of touch position according to claim 1, wherein this electronic installation also comprises one second image unit, also comprises with the step that determines this people's face positional information and this first image is carried out this people's face detection processing:
Take one second image through this second image unit;
This first image and this second image are carried out this people's face detect and handle, in this first image and this second image, to obtain a two-dimension human face coordinate of people's face block of corresponding same people respectively; And
Utilize this two-dimension human face coordinate Calculation one three-dimensional face coordinate belong to this first image and this second image respectively with as this people's face positional information.
5. the bearing calibration of touch position according to claim 4, wherein the step according to this this coordinate offset amount of people's face positional information calculation comprises:
Obtain the auxiliary coordinate of this two dimension touch coordinate pairing one three-dimensional touching;
Whether the angle of line and this Touch Screen of judging the auxiliary coordinate of this three-dimensional face coordinate and this three-dimensional touching is more than or equal to an angle threshold; And
If not, then according to the refractive index of a substrate of this Touch Screen, this three-dimensional face coordinate and should auxiliary this coordinate offset amount of coordinate Calculation of three-dimensional touching.
6. electronic installation comprises:
Touch Screen is to detect touching;
First image unit is to take first image;
Module is obtained in people's face position, couples this first image unit, and this people's face position is obtained module this first image is carried out people's face detection processing with decider's face positional information; And
The touch position correction module couples this Touch Screen and module is obtained in this people's face position, and this touch position correction module is according to this people's face positional information calculation coordinate offset amount, and utilizes the corresponding two-dimentional touch coordinate of this touching of this coordinate offset amount correction.
7. electronic installation according to claim 6; Wherein to obtain this first image of Module Division be a plurality of predeterminable areas in this people's face position; Wherein respectively these a plurality of predeterminable areas are distinguished a corresponding preset coordinate side-play amount; This first image is carried out this people's face detects and handle obtaining the people's face block in this first image, and with this people's face block respectively the area ratio in these a plurality of predeterminable areas respectively as this people's face positional information.
8. electronic installation according to claim 7, wherein this touch position correction module according to this people's face block respectively this area ratio in these a plurality of predeterminable areas respectively and respectively this preset coordinate side-play amount of these a plurality of predeterminable areas calculate this coordinate offset amount.
9. electronic installation according to claim 6 also comprises:
One second image unit couples this people's face position and obtains module, taking one second image,
Wherein this people's face position is obtained module and this first image and this second image are carried out this people's face is detected and handle; In this first image and this second image, obtaining a two-dimension human face coordinate of people's face block of corresponding same people respectively, and utilize this two-dimension human face coordinate Calculation one three-dimensional face coordinate of belonging to this first image and this second image respectively with as this people's face positional information.
10. electronic installation according to claim 9; Wherein this touch position correction module is obtained the auxiliary coordinate of this two dimension touch coordinate pairing one three-dimensional touching; And whether the angle of line and this Touch Screen of judging the auxiliary coordinate of this three-dimensional face coordinate and this three-dimensional touching is more than or equal to an angle threshold
If not, this touch position correction module is according to the refractive index of a substrate of this Touch Screen, this three-dimensional face coordinate and should auxiliary this coordinate offset amount of coordinate Calculation of three-dimensional touching.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW100101133 | 2011-01-12 | ||
| TW100101133A TWI461975B (en) | 2011-01-12 | 2011-01-12 | Electronic device and method for correcting touch position |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102591505A true CN102591505A (en) | 2012-07-18 |
| CN102591505B CN102591505B (en) | 2015-02-18 |
Family
ID=46480295
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110023098.9A Active CN102591505B (en) | 2011-01-12 | 2011-01-20 | Electronic device and touch position correction method thereof |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN102591505B (en) |
| TW (1) | TWI461975B (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103793080A (en) * | 2012-10-31 | 2014-05-14 | 株式会社东芝 | Electronic apparatus and drawing method |
| CN103809782A (en) * | 2012-11-05 | 2014-05-21 | 宏碁股份有限公司 | Compensation method and device for touch positions |
| CN104662499A (en) * | 2012-10-01 | 2015-05-27 | 阿尔卡特朗讯 | Touchscreen device with parallax error compensation |
| CN106843602A (en) * | 2016-10-11 | 2017-06-13 | 南京仁光电子科技有限公司 | A kind of giant-screen remote control interactive system and its exchange method |
| CN107272960A (en) * | 2017-06-29 | 2017-10-20 | 上海与德科技有限公司 | A kind of display methods and display system |
| CN107357456A (en) * | 2017-06-29 | 2017-11-17 | 上海与德科技有限公司 | A kind of display methods and display system |
| CN107357457A (en) * | 2017-06-29 | 2017-11-17 | 上海与德科技有限公司 | A kind of display methods and display system |
| CN108845713A (en) * | 2018-07-31 | 2018-11-20 | 广东美的制冷设备有限公司 | Show equipment and its method of toch control and computer readable storage medium |
| CN113867562A (en) * | 2021-08-18 | 2021-12-31 | 荣耀终端有限公司 | Touch screen point reporting correction method and device and electronic equipment |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI485582B (en) * | 2012-11-21 | 2015-05-21 | Asustek Comp Inc | Method for correcting touch position |
| JP2015141526A (en) * | 2014-01-28 | 2015-08-03 | ソニー株式会社 | Information processor, information processing method and program |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101393497A (en) * | 2008-10-30 | 2009-03-25 | 上海交通大学 | Multi-point touch method based on binocular stereo vision |
| CN101526848A (en) * | 2008-03-05 | 2009-09-09 | 广达电脑股份有限公司 | Coordinate judging system and method |
| WO2010023887A1 (en) * | 2008-08-27 | 2010-03-04 | 富士フイルム株式会社 | Device and method for setting instruction position during three-dimensional display, and program |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0618528B1 (en) * | 1993-04-01 | 1999-12-29 | International Business Machines Corporation | Dynamic touchscreen button adjustment mechanism |
| US8681093B2 (en) * | 2008-02-11 | 2014-03-25 | Apple Inc. | Motion compensation for screens |
| TWI399676B (en) * | 2009-06-30 | 2013-06-21 | Pixart Imaging Inc | Object detection calibration system of an optical touch screen and method thereof |
-
2011
- 2011-01-12 TW TW100101133A patent/TWI461975B/en active
- 2011-01-20 CN CN201110023098.9A patent/CN102591505B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101526848A (en) * | 2008-03-05 | 2009-09-09 | 广达电脑股份有限公司 | Coordinate judging system and method |
| WO2010023887A1 (en) * | 2008-08-27 | 2010-03-04 | 富士フイルム株式会社 | Device and method for setting instruction position during three-dimensional display, and program |
| CN101393497A (en) * | 2008-10-30 | 2009-03-25 | 上海交通大学 | Multi-point touch method based on binocular stereo vision |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104662499A (en) * | 2012-10-01 | 2015-05-27 | 阿尔卡特朗讯 | Touchscreen device with parallax error compensation |
| CN103793080A (en) * | 2012-10-31 | 2014-05-14 | 株式会社东芝 | Electronic apparatus and drawing method |
| CN103809782A (en) * | 2012-11-05 | 2014-05-21 | 宏碁股份有限公司 | Compensation method and device for touch positions |
| CN103809782B (en) * | 2012-11-05 | 2016-11-23 | 宏碁股份有限公司 | touch position compensation method and device |
| CN106843602A (en) * | 2016-10-11 | 2017-06-13 | 南京仁光电子科技有限公司 | A kind of giant-screen remote control interactive system and its exchange method |
| CN106843602B (en) * | 2016-10-11 | 2022-01-28 | 南京仁光电子科技有限公司 | Large-screen remote control interaction system and interaction method thereof |
| CN107272960A (en) * | 2017-06-29 | 2017-10-20 | 上海与德科技有限公司 | A kind of display methods and display system |
| CN107357456A (en) * | 2017-06-29 | 2017-11-17 | 上海与德科技有限公司 | A kind of display methods and display system |
| CN107357457A (en) * | 2017-06-29 | 2017-11-17 | 上海与德科技有限公司 | A kind of display methods and display system |
| CN108845713A (en) * | 2018-07-31 | 2018-11-20 | 广东美的制冷设备有限公司 | Show equipment and its method of toch control and computer readable storage medium |
| CN108845713B (en) * | 2018-07-31 | 2021-08-31 | 广东美的制冷设备有限公司 | Display device, touch control method thereof, and computer-readable storage medium |
| CN113867562A (en) * | 2021-08-18 | 2021-12-31 | 荣耀终端有限公司 | Touch screen point reporting correction method and device and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| TW201229844A (en) | 2012-07-16 |
| TWI461975B (en) | 2014-11-21 |
| CN102591505B (en) | 2015-02-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102591505B (en) | Electronic device and touch position correction method thereof | |
| US10365752B2 (en) | Touch-control display panel and touch-control display device | |
| US9207801B2 (en) | Force sensing input device and method for determining force information | |
| US20120113062A1 (en) | Display with an optical sensor | |
| US20140210748A1 (en) | Information processing apparatus, system and method | |
| US20100149122A1 (en) | Touch Panel with Multi-Touch Function and Method for Detecting Multi-Touch Thereof | |
| US20080259050A1 (en) | Optical touch control apparatus and method thereof | |
| US20080259052A1 (en) | Optical touch control apparatus and method thereof | |
| US20110261016A1 (en) | Optical touch screen system and method for recognizing a relative distance of objects | |
| US20140098030A1 (en) | Touch module | |
| US9454260B2 (en) | System and method for enabling multi-display input | |
| KR20100036850A (en) | Touch panel apparatus using tactile sensor | |
| US20120224093A1 (en) | Optical imaging device | |
| US20120319945A1 (en) | System and method for reporting data in a computer vision system | |
| TWI484386B (en) | Display with an optical sensor | |
| JP2015064724A (en) | Information processor | |
| US20100259507A1 (en) | Optical touch apparatus and operating method thereof | |
| US10037107B2 (en) | Optical touch device and sensing method thereof | |
| US20150220207A1 (en) | Touchscreen device with parallax error compensation | |
| US9110588B2 (en) | Optical touch device and method for detecting touch point | |
| Bae et al. | 14.4: Integrating Multi‐Touch Function with a Large‐Sized LCD | |
| US8564570B2 (en) | Optical touch apparatus and operating method thereof | |
| TWI553531B (en) | Optical touch device and method for calculating coordinate of touch point | |
| JP5273676B2 (en) | Wide-area infrared light source multi-touch screen | |
| KR20190074335A (en) | An electronic device including a stylus and a method of operating the same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |