CN103150020A - Three-dimensional finger control operation method and system - Google Patents

Three-dimensional finger control operation method and system Download PDF

Info

Publication number
CN103150020A
CN103150020A CN2013100822355A CN201310082235A CN103150020A CN 103150020 A CN103150020 A CN 103150020A CN 2013100822355 A CN2013100822355 A CN 2013100822355A CN 201310082235 A CN201310082235 A CN 201310082235A CN 103150020 A CN103150020 A CN 103150020A
Authority
CN
China
Prior art keywords
dimensional
finger
module
display surface
head
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2013100822355A
Other languages
Chinese (zh)
Inventor
赵风景
赵阳
计春雷
范光宇
迟冬祥
胡静
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Dianji University
Original Assignee
Shanghai Dianji University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Dianji University filed Critical Shanghai Dianji University
Priority to CN2013100822355A priority Critical patent/CN103150020A/en
Publication of CN103150020A publication Critical patent/CN103150020A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)

Abstract

The invention provides a three-dimensional finger control operation method and a system. The method comprises the steps of obtaining three-dimensional information of finger motion in designated spaces on the surface and in front of a display device, identifying three-dimensional coordinate values and motion trail information of center points of heads of fingers from the three-dimensional information, displaying the three-dimensional coordinate values and motion trails with a display module, and executing operation commands according to the three-dimensional coordinate values and the motion trail information, so that the accurate positioning and visual degree of finger control of a computer are realized.

Description

A kind of three-dimensional method of operating and system of accusing
Technical field
The present invention relates to areas of information technology, particularly a kind of three-dimensional method of operating and system of accusing.
Background technology
Along with the fast development of information society, the mankind have higher requirement to the convenience of information processing operation.Compare with mouse with keyboard, touch screen has further been simplified information equipment structure and the operations such as smart mobile phone, panel computer, notebook computer, for the convenience of information processing operation provides new room for improvement.
But existing touch screen need to carry out touch operation with finger or pointer on display screen.When carrying out touch control operation with finger, stain can be stayed, in the situation that public use (for example, the ATM in street corner) also can be arrived finger, communicate illness with filth and the bacteria contamination of display screen on display screen; On the other hand, when touching with finger, can hide the displaying contents under finger, cause eyes can't see exact position and the surrounding information thereof of finger touch point, cause the puzzlement of subsequent operation.Use the pointer operation can not carry out multi-point touch, picking up by and taking in of pointer is also rather bothersome, and nib also can bring certain scuffing to screen surface; Especially, when being equipped with at the same time the enterprising line operate of computer (for example Microsoft Surface) of touch screen and physical keyboard, need to conversion repeatedly between keyboard operation and touch control operation, if use pointer to carry out touch control operation, the meeting of taking and placing repeatedly of pointer affects work efficiency.
In order to overcome above-mentioned the deficiencies in the prior art, the invention provides a kind of three-dimensional method of operating and system of accusing, to realize that finger controls the accurate location of computer and visual, improve precision, efficient, visual that computer is controlled, be one of present areas of information technology problem demanding prompt solution.
Summary of the invention
In view of this, the embodiment of the present invention has proposed a kind of three-dimensional method of operating and system of accusing, by obtaining the three-dimensional information of finger motion in display device surface and the place ahead designated space, then identify D coordinates value and the motion track information of finger head central point from three-dimensional information, then D coordinates value and movement locus are shown by the demonstration module, finally according to D coordinates value and motion track information operation command, realized pointing accurate location and the visualization thereof of controlling computer.
For solving the problems of the technologies described above, the purpose of the embodiment of the present invention is achieved through the following technical solutions:
A kind of three-dimensional method of operating of accusing comprises:
Step 1, obtain the three-dimensional information of finger head movement in display device surface and the place ahead designated space;
Step 2, identify D coordinates value and the motion track information of finger head central point from three-dimensional information;
Step 3, will point head D coordinates value and movement locus by showing that module shows;
Step 4, foundation finger head D coordinates value and motion track information operation command.
Preferably, in above-mentioned steps one, be to obtain the three-dimensional information of finger head movement by two cameras.
Preferably, above-mentioned two cameras are arranged on respectively near adjacent two jiaos or two jiaos of display screen.
Preferably, above-mentioned two camera optical axises mutually vertical and with the ground sensing of display screen almost parallel to the angular direction.
Preferably, when the finger head when entering in effective image pickup scope, described camera will be respectively gathers the bidimensional image of finger motion in the belt-like zone of mutually perpendicular direction.
Preferably, in above-mentioned steps two, be to identify the D coordinates value of finger head central point and other noises in the shielding three-dimensional information from the three-dimensional information that obtains according to the size characteristic of finger and shape facility.
Preferably, in above-mentioned steps three, described demonstration module shows, is to point the head central point apart from the distance of display surface by the shape representation of cursor.
Preferably, in above-mentioned steps four, can comprise according to finger head D coordinates value and motion track information operation command:
(1) mobile cursor: when finger head one enters in effective identification range, cursor just appears in display screen, wherein cursor shape represents to point the head central point apart from the distance of display surface, and cursor is the normal direction projection of finger head central point at display surface in the position of display surface.When finger was mobile, the corresponding variation occured according to the coordinate figure of finger head central point in the shape of cursor and position in real time.
(2) press/upspring: in some special scenes (for example top of button), the finger head enters in identification range, dwindles/increase certain size with the display surface distance in the short time, but in the substantially change of display surface parallel direction position.
(3) enter/extract out: in some special scenes (for example game and 3 D anatomical), the finger head enters in identification range, the size of dwindling/increasing with the display surface distance in the short time has surpassed the distance of " press/upspring ", but in the substantially change of display surface parallel direction position.
(4) scratch: in some special scenes (for example game and 3 D anatomical), after " entering ", the finger head position changes in the display surface parallel direction, and almost constant at the display surface normal distance.
(5) rive: in some special scenes (for example game and 3 D anatomical), the finger head enters in identification range, and the finger head position constantly changes in the display surface parallel direction, and diminishes in the display surface normal distance short time.
(6) click: " upspring " immediately after " pressing ".
(7) double-clicking/three hits: double/three time " clicking ".
(8) confirm: the finger head is in identification range, and its movement locus plane parallel with display surface at short notice presents " √ ".
(9) deny: the finger head presents " X " on the plane parallel with display surface in its movement locus short time in identification range.
A kind of three-dimensional operating system of accusing, comprise three-dimensional sensing module, three-dimensional charge IO processing module, three-dimensional demonstration module and the three-dimensional charge main frame module of accusing of accusing, by obtaining the three-dimensional information of finger motion in display device surface and the place ahead designated space, then identify D coordinates value and the motion track information of finger central point from three-dimensional information, then D coordinates value and movement locus are shown by the demonstration module, finally according to D coordinates value and motion track information operation command.
Preferably, above-mentioned three-dimensional charge sensing module is used for obtaining the three-dimensional information of finger motion in display device surface and the place ahead designated space.
Preferably, the above-mentioned three-dimensional IO of charge processes D coordinates value and the motion track information that module is used for identifying from three-dimensional information finger head central point.
Preferably, above-mentioned three-dimensional the charge shows that module is used for pointing head central point D coordinates value and movement locus shows by the demonstration module.
Preferably, above-mentioned three-dimensional charge main frame module is used for according to finger head central point D coordinates value and motion track information operation command.
Preferably, above-mentioned three-dimensional charge sensing module is to be arranged on the front framework of display screen, and surrounding parallel arrangement two row's infrared emission tube and infrared receiver tubes in framework form the two-layer parallel infrared ray matrix that anyhow intersects.
In sum, the invention provides a kind of three-dimensional method of operating and system of accusing, by obtaining the three-dimensional information of finger motion in display device surface and the place ahead designated space, then identify D coordinates value and the motion track information of finger central point from three-dimensional information, then D coordinates value and movement locus are shown by the demonstration module, finally according to D coordinates value and motion track information operation command, realized pointing accurate location and the visualization thereof of controlling computer.
Description of drawings
Fig. 1 is a kind of three-dimensional method of operating schematic diagram of accusing of the embodiment of the present invention;
Fig. 2 is a kind of three-dimensional system logic structure schematic diagram of accusing of the embodiment of the present invention;
Fig. 3 is the camera installation site schematic diagram of the embodiment of the present invention.
Embodiment
A kind of three-dimensional method of operating and the system of accusing that the embodiment of the present invention provides, by obtaining the three-dimensional information of finger motion in display device surface and the place ahead designated space, then identify D coordinates value and the motion track information of finger central point from three-dimensional information, then D coordinates value and movement locus are shown by the demonstration module, finally according to D coordinates value and motion track information operation command, realized pointing accurate location and the visualization thereof of controlling computer.
For making purpose of the present invention, technical scheme and advantage clearer, the embodiment that develops simultaneously with reference to the accompanying drawings, the present invention is described in more detail.
The embodiment of the present invention provides a kind of three-dimensional method of operating of accusing, as shown in Figure 1, concrete steps comprise:
Step 1, obtain the three-dimensional information of finger motion in display device surface and the place ahead designated space;
Particularly, in embodiments of the present invention, can obtain by image acquisition equipment the three-dimensional information of finger motion in display device surface and the place ahead designated space.In this programme, image acquisition equipment can be accused the sensing module by three-dimensional, forms as two cameras and related device, is arranged on respectively near adjacent two jiaos or two jiaos of display screen.When launch computer or when waking up, two cameras are opened, optical axis mutually vertical and with the ground sensing of display screen almost parallel to the angular direction.The effective image pickup scope of each camera all is limited to the effective display surface of display screen and approaches distance interior (for example in 100mm), when the finger head enters in effective image pickup scope, two cameras gather respectively the bidimensional image of finger motion in the belt-like zone of mutually perpendicular direction, pass to the three-dimensional IO of charge processing module to obtain D coordinates value and the motion track information of finger head.Camera is closed when computer sleep or when closing.
In addition, image acquisition equipment can be accused the sensing module by three-dimensional, as is arranged on the framework before display screen, and surrounding parallel arrangement two row's infrared emission tube and infrared receiver tubes in framework form the two-layer parallel infrared ray matrix that anyhow intersects.Two-layer parallel infrared ray matrix phase is (for example 20mm) across a certain distance, when entering infrared ray matrix, finger will block the infrared ray anyhow through this position, through the ultrared accurate location that can determine by two-layer infrared ray matrix scanning to intercept, calculate accordingly the D coordinates value of finger head.
Step 2, identify from three-dimensional information the finger central point D coordinates value and motion track information;
Particularly, in embodiments of the present invention, can include a three-dimensional IO of charge and process module, the three-dimensional IO of charge processing module identifies the D coordinates value of finger head central point according to size characteristic and the shape facility of finger from the information that three-dimensional charge sensing module transmits, and shielding sensing module transmits other noises in information, and the D coordinates value that then will point the head central point is sent to three-dimensional the charge and shows module and three-dimensional charge main frame module.
Step 3, will point head central point D coordinates value and movement locus by showing that module shows;
Particularly, in embodiments of the present invention, comprise three-dimensional a charge and show module, be used for receiving from three-dimensional and accuse that IO processes finger head central point D coordinates value and motion track information that module sends, and show finger head three-dimensional coordinate position and movement locus and other information that need show by display device.
Further, in this case, the three-dimensional charge shows that module passes through the shape representation finger head central point of cursor apart from the distance of display surface.
Step 4, foundation finger head central point D coordinates value and motion track information operation command.
Particularly, in embodiments of the present invention, comprise a three-dimensional main frame module of accusing, be used for according to the operation intention of pointing the three-dimensional running orbit decision operation person of head, carry out operation accordingly.
Further, in this programme, can operate accordingly by the identification of the three-dimensional running orbit of following finger head:
(1) mobile cursor: when finger (perhaps pointer, down together) head enters in identification range, cursor appears in display screen, and wherein the shape representation of cursor is pointed the size of head center point coordinate value z value, and cursor position represents to point the size of head central point x, y value; When finger was mobile, the corresponding variation occured according to the coordinate figure of finger head central point in the shape of cursor and position in real time.
(2) press/upspring: when the finger head when entering in identification range, in the z value short time (for example<0.1s) diminish/large (for example the z value has reduced/increased 5-18mm), but the substantially change of x, y (for example variation range less than ± 3mm)
(3) enter/extract out: when pointing head in identification range, (for example<0.1s) diminish/large (more than for example the z value has reduced/increased 18mm) in the z value short time, but substantially the becoming of x, y (for example variation range less than ± 3mm), this operation is multiplex in game and 3 D anatomical
(4) scratch: x, y value change after " entering ", but z value almost constant (for example variation range less than ± 3mm), this operates multiplex in playing and 3 D anatomical
(5) rive: the finger head is in identification range, and x, y, z value change, and in the z value short time, (for example<0.2s) diminish (more than for example the z value reduces 18mm), this operation is multiplex in game and 3 D anatomical
(6) click: " upspring " immediately after " pressing "
(7) double-clicking/three hits: double/three time " clicking "
(8) confirm: the finger head is in identification range, and (for example<0.1s), its movement locus presents " √ " on x, y plane in the short time
(9) deny: the finger head is in identification range, and (for example<0.1s), its movement locus presents " X " on x, y plane in the short time
(10) other: the touch control operation of " windows " of Microsoft or Apple " IOS " operating system roughly the same.
In addition, the embodiment of the present invention also provides a kind of three-dimensional operating system of accusing.As shown in Figure 2, a kind of three-dimensional operating system schematic diagram of accusing that provides for the embodiment of the present invention.
A kind of three-dimensional operating system of accusing comprises that three-dimensional charge sensing module 11, the three-dimensional IO of charge process module 12, three-dimensional charge shows module 13 and the three-dimensional main frame module 14 of accusing.
The three-dimensional sensing module 11 of accusing is for the three-dimensional information that obtains finger motion in display device surface and the place ahead designated space;
Particularly, in embodiments of the present invention, can obtain by image acquisition equipment the three-dimensional information of finger motion in display device surface and the place ahead designated space.In this programme, image acquisition equipment can be accused the sensing module by three-dimensional, forms as two cameras and related device, is arranged on respectively near adjacent two jiaos or two jiaos of display screen.When launch computer or when waking up, two cameras are opened, optical axis mutually vertical and with the ground sensing of display screen almost parallel to the angular direction.The effective image pickup scope of each camera all is limited to the effective display surface of display screen and approaches distance interior (for example in 100mm), when the finger head enters in effective image pickup scope, two cameras gather respectively the bidimensional image of finger motion in the belt-like zone of mutually perpendicular direction, pass to the three-dimensional IO of charge processing module to obtain D coordinates value and the motion track information of finger head.Camera is closed when computer sleep or when closing.
In addition, image acquisition equipment can be accused the sensing module by three-dimensional, as is arranged on the framework before display screen, and surrounding parallel arrangement two row's infrared emission tube and infrared receiver tubes in framework form the two-layer parallel infrared ray matrix that anyhow intersects.Two-layer parallel infrared ray matrix phase is (for example 20mm) across a certain distance, when entering infrared ray matrix, finger will block the infrared ray anyhow through this position, through the ultrared accurate location that can determine by two-layer infrared ray matrix scanning to intercept, calculate accordingly the D coordinates value of finger head.
The three-dimensional IO of charge processes module 12, is used for identifying from three-dimensional information D coordinates value and the motion track information of finger head central point;
Particularly, in embodiments of the present invention, can include a three-dimensional IO of charge and process module, the three-dimensional IO of charge processing module identifies the D coordinates value of finger head central point according to size characteristic and the shape facility of finger from the information that three-dimensional charge sensing module transmits, and shielding sensing module transmits other noises in information, and the D coordinates value that then will point the head central point is sent to three-dimensional the charge and shows module and three-dimensional charge main frame module.
The three-dimensional charge shows module 13, is used for D coordinates value and movement locus are shown by the demonstration module;
Particularly, in embodiments of the present invention, comprise three-dimensional a charge and show module, be used for receiving from three-dimensional and accuse that IO processes finger head central point D coordinates value and motion track information that module sends, and show finger head three-dimensional coordinate position and movement locus and other information that need show by display device.
Further, in this case, the three-dimensional charge shows that module passes through the shape representation finger head central point of cursor apart from the distance of display surface.
The three-dimensional main frame module 14 of accusing is used for according to D coordinates value and motion track information operation command.
Particularly, in embodiments of the present invention, comprise a three-dimensional main frame module of accusing, be used for carrying out corresponding operation according to the three-dimensional running orbit decision operation person's of finger head operation intention.
Further, in this programme, can operate accordingly by the identification of the three-dimensional running orbit of following finger head:
(1) mobile cursor: when finger (perhaps pointer, down together) head enters in identification range, cursor appears in display screen, and wherein the shape representation of cursor is pointed the size of head center point coordinate value z value, and cursor position represents to point the size of head central point x, y value; When finger was mobile, the corresponding variation occured according to the coordinate figure of finger head central point in the shape of cursor and position in real time.
(2) press/upspring: when the finger head when entering in identification range, in the z value short time (for example<0.1s) diminish/large (for example the z value has reduced/increased 5-18mm), but the substantially change of x, y (for example variation range less than ± 3mm)
(3) enter/extract out: when pointing head in identification range, (for example<0.1s) diminish/large (more than for example the z value has reduced/increased 18mm) in the z value short time, but substantially the becoming of x, y (for example variation range less than ± 3mm), this operation is multiplex in game and 3 D anatomical
(4) scratch: x, y value change after " entering ", but z value almost constant (for example variation range less than ± 3mm), this operates multiplex in playing and 3 D anatomical
(5) rive: the finger head is in identification range, and x, y, z value change, and in the z value short time, (for example<0.2s) diminish (more than for example the z value reduces 18mm), this operation is multiplex in game and 3 D anatomical
(6) click: " upspring " immediately after " pressing "
(7) double-clicking/three hits: double/three time " clicking "
(8) confirm: the finger head is in identification range, and (for example<0.1s), its movement locus presents " √ " on x, y plane in the short time
(9) deny: the finger head is in identification range, and (for example<0.1s), its movement locus presents " X " on x, y plane in the short time
(10) other: the touch control operation of " windows " of Microsoft or Apple " IOS " operating system roughly the same.
That is, be intended to carry out corresponding operational order according to the three-dimensional running orbit decision operation person of finger head central point, the multiple method of operating such as comprise mobile cursor, enter, scratch, rive.
In a kind of three-dimensional charge system logic structure schematic diagram shown in Figure 2, the three-dimensional charge shows that module 13 is comprised of display screen and other display device, is used for demonstration information and the finger head three-dimensional coordinate position of demonstration computer output.Wherein, display screen is the plane, its effective display area territory is in display screen, with three-dimensional cartesian coordinate system (x, y, z), effective display area territory and front space are described, wherein the upper left corner, effective display area territory is true origin, initial point is to the right x axle direction, and initial point is downwards y axle direction, and the place ahead in effective display area territory is z axle direction.
Describedly three-dimensional accuse that sensing module 11 is comprised of two cameras, referring to the camera 21,22 in Fig. 3, be arranged on respectively the three-dimensional display module 13 display screen upper left corner and the upper right corner of accusing.When launch computer or when waking up, two cameras eject and open from left and right two jiaos respectively, and its optical axis 24,25 is mutually vertical, respectively towards the lower right corner and the lower left corner, with the display screen almost parallel; The effective image pickup scope of each camera is all accused in the effective display surface 23 the place ahead 50mm of display screen of display module 13 in three-dimensional.When the finger head enters in identification range, can point the image two-dimensional picture from the belt-like zone collection of mutually perpendicular direction simultaneously, and be sent to the three-dimensional IO of charge processing module 12.Camera is closed and is regained when computer sleep or when closing.
Demonstration information and sensing module 11 that the described three-dimensional IO of charge processing module 12 is exported mainly for the treatment of computer send photographing information, demonstration information in result is sent to demonstration module 13, the operation information in result is sent to main frame module 14.The bidimensional picture that to be two video cameras take from mutually perpendicular direction that sends due to sensing module 11, IO processing module 12 can therefrom extract according to human finger's size characteristic and shape facility the D coordinates value of pointing the head central point, and shield other noises that sensing module 11 transmits in information, then this D coordinates value is sent to demonstration module 13 and main frame module 14.Show that module 13 by its z value size of shape representation of cursor, represents its x, y value size by cursor position.
Described three-dimensional charge main frame module 14 is carried out corresponding operation according to the movement locus decision operation person's of finger head central point D coordinates value intention.
In another embodiment of the present invention, three-dimensional charge sensing module is the framework before display screen, be designed with circuit board in framework, surrounding parallel arrangement two row's infrared emission tube and infrared receiver tubes in framework, form the two-layer parallel infrared ray matrix that anyhow intersects, the two-layer infrared ray matrix 20mm of being separated by.When finger or pointer when entering in infrared ray matrix, finger or pointer will be blocked the infrared ray anyhow through this position, can determine the ultrared accurate location that intercepts through infrared ray matrix scanning, according to human finger's size and dimension feature, through the IO processing module calculate can judge the touch point on screen x, y coordinate position and shield other noises; Can obtain pointing two discrete values of head coordinate z value by two-layer infrared ray matrix.
As seen, than prior art, a kind of three-dimensional charge of the present invention system accuses that by three-dimensional sensing module, the three-dimensional IO of charge process module, the three-dimensional charge shows module and three-dimensional mutual cooperation of accusing between the main frame module, make the enough fingers of user's energy carry out noncontact and control computer, realized that simultaneously finger controls the accurate location of computer and visual, and realized that noncontact is controlled and with the joint operation of touch-control, enlarge the range of application of controlling, improved precision, dimension, efficient and the visualization controlled.
One of ordinary skill in the art will appreciate that and realize that all or part of step that above-described embodiment method is carried is to come the relevant hardware of instruction to complete by program, described program can be stored in a kind of computer-readable recording medium, this program comprises step of embodiment of the method one or a combination set of when carrying out.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing module, can be also that the independent physics of unit exists, and also can be integrated in a module two or more unit.Above-mentioned integrated module both can adopt the form of hardware to realize, also can adopt the form of software function module to realize.If described integrated module realizes with the form of software function module and during as independently production marketing or use, also can be stored in a computer read/write memory medium.
In sum, this paper provides a kind of three-dimensional method of operating and system of accusing, by obtaining the three-dimensional information of finger motion in display device surface and the place ahead designated space, then identify D coordinates value and the motion track information of finger central point from three-dimensional information, then D coordinates value and movement locus are shown by the demonstration module, finally according to D coordinates value and motion track information operation command, realized pointing accurate location and the visualization thereof of controlling computer.
Abovely a kind ofly three-dimensional accuse that method of operating and system are described in detail to provided by the present invention, used specific case herein principle of the present invention and embodiment are set forth, the explanation of above embodiment just is used for helping to understand the solution of the present invention; Simultaneously, for one of ordinary skill in the art, according to thought of the present invention, all will change in specific embodiments and applications, in sum, this description should not be construed as limitation of the present invention.

Claims (14)

1. the three-dimensional method of operating of accusing, is characterized in that, described method comprises:
Step 1, obtain the three-dimensional information of finger motion in display device surface and the place ahead designated space;
Step 2, identify D coordinates value and the motion track information of finger head central point from three-dimensional information;
Step 3, will point head D coordinates value and movement locus by showing that module shows;
Step 4, foundation finger head D coordinates value and motion track information operation command.
2. method according to claim 1, is characterized in that, in described step 1, is to obtain the three-dimensional information of finger head movement by camera.
3. method according to claim 2, is characterized in that, described camera is arranged near adjacent two jiaos or two jiaos of display screen.
4. method according to claim 2, is characterized in that, described camera optical axis mutually vertical and with the ground sensing of display screen almost parallel to the angular direction.
5. method according to claim 2, is characterized in that, when the finger head when entering in effective image pickup scope, described camera will be respectively gathers the bidimensional image of finger motion in the belt-like zone of mutually perpendicular direction.
6. method according to claim 1, it is characterized in that, in described step 2, be to identify the D coordinates value of finger head central point and other noises in the shielding three-dimensional information from the three-dimensional information that obtains according to the size characteristic of finger and shape facility.
7. method according to claim 1, is characterized in that, in described step 3, described demonstration module shows, is to point the head central point apart from the distance of display surface by the shape representation of cursor.
8. method according to claim 1, is characterized in that, in described step 4, comprises according to D coordinates value and motion track information operation command:
(1) mobile cursor: when finger head one enters in effective identification range, cursor just appears in display screen, wherein cursor shape represents to point the head central point apart from the distance of display surface, and cursor is the normal direction projection of finger head central point at display surface in the position of display surface.When finger was mobile, the corresponding variation occured according to the coordinate figure of finger head central point in the shape of cursor and position in real time;
(2) press/upspring: in some special scenes (for example top of button), the finger head enters in identification range, dwindles/increase certain size with the display surface distance in the short time, but in the substantially change of display surface parallel direction position;
(3) enter/extract out: in some special scenes (for example game and 3 D anatomical), the finger head enters in identification range, the size of dwindling/increasing with the display surface distance in the short time has surpassed the distance of " press/upspring ", but in the substantially change of display surface parallel direction position;
(4) scratch: in some special scenes (for example game and 3 D anatomical), after " entering ", the finger head position changes in the display surface parallel direction, and almost constant at the display surface normal distance;
(5) rive: in some special scenes (for example game and 3 D anatomical), the finger head enters in identification range, and the finger head position constantly changes in the display surface parallel direction, and diminishes in the display surface normal distance short time;
(6) click: " upspring " immediately after " pressing ";
(7) double-clicking/three hits: double/three time " clicking ";
(8) confirm: the finger head is in identification range, and its movement locus plane parallel with display surface at short notice presents " √ ";
(9) deny: the finger head presents " X " on the plane parallel with display surface in its movement locus short time in identification range.
9. a three-dimensional is accused operating system, it is characterized in that, described system comprises three-dimensional sensing module, three-dimensional charge IO processing module, three-dimensional demonstration module and the three-dimensional charge main frame module of accusing of accusing, by obtaining the three-dimensional information of finger motion in display device surface and the place ahead designated space, then identify D coordinates value and the motion track information of finger central point from three-dimensional information, then D coordinates value and movement locus are shown by the demonstration module, finally according to D coordinates value and motion track information operation command.
10. system according to claim 9, is characterized in that, described three-dimensional charge sensing module is used for obtaining the three-dimensional information of finger motion in display device surface and the place ahead designated space.
11. system according to claim 9 is characterized in that, the described three-dimensional IO of charge processes D coordinates value and the motion track information that module is used for identifying from three-dimensional information the finger central point.
12. system according to claim 9 is characterized in that, described three-dimensional the charge shows that module is used for D coordinates value and movement locus are shown by the demonstration module.
13. system according to claim 9 is characterized in that, described three-dimensional charge main frame module is used for according to D coordinates value and motion track information operation command.
14. system according to claim 9, it is characterized in that, described three-dimensional charge sensing module is to be arranged on the front framework of display screen, and surrounding parallel arrangement two row's infrared emission tube and infrared receiver tubes in framework form the two-layer parallel infrared ray matrix that anyhow intersects.
CN2013100822355A 2013-03-14 2013-03-14 Three-dimensional finger control operation method and system Pending CN103150020A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2013100822355A CN103150020A (en) 2013-03-14 2013-03-14 Three-dimensional finger control operation method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2013100822355A CN103150020A (en) 2013-03-14 2013-03-14 Three-dimensional finger control operation method and system

Publications (1)

Publication Number Publication Date
CN103150020A true CN103150020A (en) 2013-06-12

Family

ID=48548146

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2013100822355A Pending CN103150020A (en) 2013-03-14 2013-03-14 Three-dimensional finger control operation method and system

Country Status (1)

Country Link
CN (1) CN103150020A (en)

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103823554A (en) * 2014-01-12 2014-05-28 青岛科技大学 Digital virtual-real interaction system and digital virtual-real interaction method
CN104159137A (en) * 2014-09-01 2014-11-19 深圳悠易阅科技有限公司 Remote control of touch screen for smart television and control method thereof
CN104331154A (en) * 2014-08-21 2015-02-04 周谆 Man-machine interaction method and system for realizing non-contact mouse control
CN104360736A (en) * 2014-10-30 2015-02-18 广东美的制冷设备有限公司 Gesture-based terminal control method and system
CN104423578A (en) * 2013-08-25 2015-03-18 何安莉 Interactive Input System And Method
CN105159539A (en) * 2015-09-10 2015-12-16 京东方科技集团股份有限公司 Touch control response method of wearable equipment, touch control response device of wearable equipment and wearable equipment
CN105373213A (en) * 2014-08-25 2016-03-02 乐视致新电子科技(天津)有限公司 Operation identification method and device in human-computer interaction
CN105945945A (en) * 2016-05-20 2016-09-21 哈尔滨工业大学 Finger module dividing method based on analysis of moving functions of human hand
CN106020712A (en) * 2016-07-29 2016-10-12 青岛海信移动通信技术股份有限公司 Touch control gesture recognition method and device
CN106774935A (en) * 2017-01-09 2017-05-31 京东方科技集团股份有限公司 A kind of display device
CN107407994A (en) * 2015-03-27 2017-11-28 精工爱普生株式会社 Interactive projector and interactive projection system
CN107844204A (en) * 2017-10-31 2018-03-27 宁波视睿迪光电有限公司 Alignment system and method
CN107911686A (en) * 2017-12-29 2018-04-13 盎锐(上海)信息科技有限公司 Control method and camera shooting terminal
CN108563332A (en) * 2017-03-31 2018-09-21 王三秀 The method accused 3-D wireless mouse and its manipulate smart machine
US10203765B2 (en) 2013-04-12 2019-02-12 Usens, Inc. Interactive input system and method
CN110968195A (en) * 2019-11-29 2020-04-07 深圳朗特智能控制股份有限公司 Cursor control method, terminal and storage medium
CN111625297A (en) * 2020-05-28 2020-09-04 Oppo广东移动通信有限公司 Application program display method, terminal and computer readable storage medium
CN116860153A (en) * 2022-12-30 2023-10-10 北京津发科技股份有限公司 Finger interaction track analysis method, system and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030132913A1 (en) * 2002-01-11 2003-07-17 Anton Issinski Touchless computer input device to control display cursor mark position by using stereovision input from two video cameras
US20080062257A1 (en) * 2006-09-07 2008-03-13 Sony Computer Entertainment Inc. Touch screen-like user interface that does not require actual touching
US7961173B2 (en) * 2006-09-05 2011-06-14 Navisense Method and apparatus for touchless calibration

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030132913A1 (en) * 2002-01-11 2003-07-17 Anton Issinski Touchless computer input device to control display cursor mark position by using stereovision input from two video cameras
US7961173B2 (en) * 2006-09-05 2011-06-14 Navisense Method and apparatus for touchless calibration
US20080062257A1 (en) * 2006-09-07 2008-03-13 Sony Computer Entertainment Inc. Touch screen-like user interface that does not require actual touching

Cited By (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10203765B2 (en) 2013-04-12 2019-02-12 Usens, Inc. Interactive input system and method
CN104423578B (en) * 2013-08-25 2019-08-06 杭州凌感科技有限公司 Interactive input system and method
CN104423578A (en) * 2013-08-25 2015-03-18 何安莉 Interactive Input System And Method
CN103823554A (en) * 2014-01-12 2014-05-28 青岛科技大学 Digital virtual-real interaction system and digital virtual-real interaction method
WO2016026365A1 (en) * 2014-08-20 2016-02-25 周谆 Man-machine interaction method and system for achieving contactless mouse control
CN104331154A (en) * 2014-08-21 2015-02-04 周谆 Man-machine interaction method and system for realizing non-contact mouse control
CN104331154B (en) * 2014-08-21 2017-11-17 周谆 Realize the man-machine interaction method and system of non-contact type mouse control
CN105373213A (en) * 2014-08-25 2016-03-02 乐视致新电子科技(天津)有限公司 Operation identification method and device in human-computer interaction
CN104159137A (en) * 2014-09-01 2014-11-19 深圳悠易阅科技有限公司 Remote control of touch screen for smart television and control method thereof
CN104360736A (en) * 2014-10-30 2015-02-18 广东美的制冷设备有限公司 Gesture-based terminal control method and system
CN104360736B (en) * 2014-10-30 2017-06-30 广东美的制冷设备有限公司 terminal control method and system based on gesture
CN107407994A (en) * 2015-03-27 2017-11-28 精工爱普生株式会社 Interactive projector and interactive projection system
US10185433B2 (en) 2015-09-10 2019-01-22 Boe Technology Group Co., Ltd. Method and apparatus for touch responding of wearable device as well as wearable device
CN105159539B (en) * 2015-09-10 2018-06-01 京东方科技集团股份有限公司 Touch-control response method, device and the wearable device of wearable device
CN105159539A (en) * 2015-09-10 2015-12-16 京东方科技集团股份有限公司 Touch control response method of wearable equipment, touch control response device of wearable equipment and wearable equipment
CN105945945A (en) * 2016-05-20 2016-09-21 哈尔滨工业大学 Finger module dividing method based on analysis of moving functions of human hand
CN106020712B (en) * 2016-07-29 2020-03-27 青岛海信移动通信技术股份有限公司 Touch gesture recognition method and device
CN106020712A (en) * 2016-07-29 2016-10-12 青岛海信移动通信技术股份有限公司 Touch control gesture recognition method and device
CN106774935A (en) * 2017-01-09 2017-05-31 京东方科技集团股份有限公司 A kind of display device
CN106774935B (en) * 2017-01-09 2020-03-31 京东方科技集团股份有限公司 Display device
CN108563332A (en) * 2017-03-31 2018-09-21 王三秀 The method accused 3-D wireless mouse and its manipulate smart machine
CN107844204A (en) * 2017-10-31 2018-03-27 宁波视睿迪光电有限公司 Alignment system and method
CN107911686A (en) * 2017-12-29 2018-04-13 盎锐(上海)信息科技有限公司 Control method and camera shooting terminal
CN107911686B (en) * 2017-12-29 2019-07-05 盎锐(上海)信息科技有限公司 Control method and camera shooting terminal
CN110968195A (en) * 2019-11-29 2020-04-07 深圳朗特智能控制股份有限公司 Cursor control method, terminal and storage medium
CN111625297A (en) * 2020-05-28 2020-09-04 Oppo广东移动通信有限公司 Application program display method, terminal and computer readable storage medium
CN116860153A (en) * 2022-12-30 2023-10-10 北京津发科技股份有限公司 Finger interaction track analysis method, system and storage medium
CN116860153B (en) * 2022-12-30 2024-08-27 北京津发科技股份有限公司 Finger interaction track analysis method, system and storage medium

Similar Documents

Publication Publication Date Title
CN103150020A (en) Three-dimensional finger control operation method and system
JP5237847B2 (en) Gesture recognition method and touch system incorporating the same
CN103809733B (en) Man-machine interactive system and method
CN103135883B (en) Control the method and system of window
CN101278251B (en) Interactive large scale touch surface system
CN104808788B (en) A kind of method that non-contact gesture manipulates user interface
US9619042B2 (en) Systems and methods for remapping three-dimensional gestures onto a finite-size two-dimensional surface
CN103440033B (en) A kind of method and apparatus realizing man-machine interaction based on free-hand and monocular cam
CN101847057A (en) Method for touchpad to acquire input information
CN102880304A (en) Character inputting method and device for portable device
CN106468917B (en) A kind of long-range presentation exchange method and system of tangible live real-time video image
US20210072818A1 (en) Interaction method, device, system, electronic device and storage medium
CN101714044B (en) Camera positioning-based touch screen system
CN106774938A (en) Man-machine interaction integrating device based on somatosensory device
US20180260031A1 (en) Method for controlling distribution of multiple sub-screens and device using the same
CN102033656B (en) Gesture identification method and interaction system using same
CN105138131B (en) A kind of general gesture command transmitting and operational approach
CN106383583A (en) Method and system capable of controlling virtual object to be accurately located and used for air man-machine interaction
CN105630134A (en) Operation event identification method and apparatus
CN105373329A (en) Interactive method and system for display and booth
JP7351130B2 (en) Robust gesture recognition device and system for projector-camera interactive displays using depth cameras and deep neural networks
CN106774995A (en) A kind of three-dimensional style of brushwork recognition methods based on localization by ultrasonic
CN202749066U (en) Non-contact object-showing interactive system
CN103218124B (en) Based on menu control method and the system of depth camera
CN103389793A (en) Human-computer interaction method and human-computer interaction system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20130612