CN107506133B - Operation track response method and system of projection touch system - Google Patents
Operation track response method and system of projection touch system Download PDFInfo
- Publication number
- CN107506133B CN107506133B CN201710735370.3A CN201710735370A CN107506133B CN 107506133 B CN107506133 B CN 107506133B CN 201710735370 A CN201710735370 A CN 201710735370A CN 107506133 B CN107506133 B CN 107506133B
- Authority
- CN
- China
- Prior art keywords
- depth maps
- group
- depth
- touch point
- response
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses an operation track response method and system of a projection touch system, wherein the method comprises the following steps: projecting the picture on a projection screen; collecting a depth map of a space range above the projection screen; acquiring the depth value of each target in the depth map, judging whether a touch point exists according to the depth value of each target, and calculating the coordinate of the touch point if the touch point exists; judging an operation track according to the touch point coordinates calculated in the continuous multiple groups of depth maps, and making corresponding response according to the operation track, wherein one group of depth maps are formed by continuous multiple frames of depth maps, and the number of depth map frames contained in one group of depth maps is determined by the frame rate of the collected depth maps; and if the operation track corresponding to the click, double click or page sliding response is judged in the set time period after the page sliding, zooming or rotating response is made, ignoring the operation track. The invention can avoid the data processing module from making wrong response to a certain extent due to the frame drop phenomenon of the depth module, particularly the low frame rate depth module.
Description
Technical Field
The invention relates to the technical field of projection. And more particularly, to a method and system for responding to an operation trajectory of a projected touch system.
Background
The conventional projection touch system comprises a projection module, a depth module and a data processing module, wherein the data processing module calculates touch point coordinates based on depth values of targets in a depth map of a projection screen acquired by the depth module (namely, the data processing module analyzes the depth values of the targets in the depth map, and when the data processing module judges that the targets with the same depth values as the projection screen exist, the coordinates of the targets on the projection screen are used as the touch point coordinates), an operation track is judged according to the touch point coordinates calculated from continuous multi-frame depth maps, a corresponding response is made according to the operation track, and common responses comprise clicking, double clicking, page sliding, zooming, rotating and the like.
The depth module typically includes at least one depth camera, which is defined as a device that can acquire depth information for objects within the field of view of the camera. In the process of acquiring the depth map, the depth module may have a frame drop phenomenon, that is, effective data of a certain frame of depth map or a certain continuous several frames of depth maps are not acquired. For a depth module in a projection touch system, a depth map of a projection surface acquired by the depth module is the basis for a data processing module to finally respond, and a result of a frame drop phenomenon of the depth module is that the data processing module does not calculate a touch point which should exist, so that the data processing module may make a misjudgment when judging an operation track according to coordinates of the touch point calculated from continuous multi-frame depth maps, and an incorrect response condition is made.
Particularly for a depth module with a lower frame rate, the data processing module may determine the operation trajectory according to several consecutive frames of depth maps with relatively fewer frames as the analysis object, for example, for a same sliding page operation of a touch operator, the number of frames of the depth map including the touch point acquired by the low frame rate depth module is 6, while the number of frames of the depth map including the touch point acquired by the high frame rate depth module may reach 20 frames or even more. Therefore, for a depth module with a lower frame rate, the probability of the data processing module making an incorrect response after the frame drop phenomenon occurs is higher, and the detection and correction through simple data processing are more difficult.
Therefore, it is desirable to provide an operation trajectory response method and system for a projection touch system, which can prevent the data processing module from making an erroneous response to a certain extent due to a frame drop phenomenon occurring in the depth module (especially in the low frame rate depth module).
Disclosure of Invention
The invention aims to provide an operation track response method and system of a projection touch system, so as to avoid the phenomenon that a data processing module makes wrong response due to frame drop of a depth module, particularly a low-frame-rate depth module, to a certain extent.
In order to achieve the purpose, the invention adopts the following technical scheme:
the invention discloses an operation track response method of a projection touch system, which comprises the following steps:
projecting the picture on a projection screen;
collecting a depth map of a space range above the projection screen;
acquiring the depth value of each target in the depth map, judging whether a touch point exists according to the depth value of each target, and calculating the coordinate of the touch point if the touch point exists;
judging an operation track according to the touch point coordinates calculated in the continuous multiple groups of depth maps, and making corresponding response according to the operation track, wherein one group of depth maps are formed by continuous multiple frames of depth maps, and the number of depth map frames contained in one group of depth maps is determined by the frame rate of the collected depth maps; if the operation track corresponding to the single click, the double click or the page sliding response is judged within the set time period after the page sliding, zooming or rotating response is made, the operation track corresponding to the single click, the double click or the page sliding response is ignored (namely, the response of the single click, the double click or the page sliding is not made even if the operation track corresponding to the single click, the double click or the page sliding response is judged within the set time period).
Preferably, in the method, the operation tracks corresponding to the page sliding, zooming and rotating responses are respectively judged according to the change of the coordinates of the touch point calculated by two groups of continuous depth maps, and the operation tracks corresponding to the single click and double click responses are respectively judged according to the change of the coordinates of the touch point calculated by the depth maps continuously collected within the length of the set time period.
Preferably, in the method, the length of the set period is greater than the time length for continuously acquiring two sets of depth maps and less than the time length for continuously acquiring four sets of depth maps.
Preferably, in the method, the first and second reaction conditions,
the operation track corresponding to the page sliding response is as follows: calculating a touch point according to the continuous first group and second group of depth maps, wherein the touch point calculated according to the first group of depth maps and the touch point calculated according to the second group of depth maps have displacement exceeding a set slide page displacement critical value in an X-axis coordinate direction (the X-axis coordinate direction is the horizontal direction);
the operation trajectory corresponding to the zoom response is: calculating two touch points according to the continuous first group and second group of depth maps, wherein the length difference between the vector formed by the two touch points calculated according to the second group of depth maps and the vector formed by the two touch points calculated according to the first group of depth maps exceeds a preset zoom length difference threshold value (wherein, if the length of the vector formed by the two touch points calculated according to the second group of depth maps is smaller than that of the vector formed by the two touch points calculated according to the first group of depth maps, the zoom response corresponding to the operation track is reduced, and if not, the zoom response is increased);
the operation trajectory corresponding to the rotation response is: calculating two touch points according to the continuous first group and second group of depth maps, and calculating an included angle between a vector formed by the two touch points and a vector formed by the two touch points according to the second group of depth maps, wherein the included angle exceeds a set rotation included angle critical value (if the included angle is formed clockwise, the rotation response corresponding to the operation track is clockwise rotation, and if the included angle is not clockwise);
the operation trajectory corresponding to the double click response is: within the length of the set time period, respectively calculating the existence of a touch point, the nonexistence of the touch point and the existence of a touch point according to the continuous first group of depth maps, the interval time period and the second group of depth maps, wherein the distance between the touch point calculated according to the second group of depth maps and the touch point calculated according to the first group of depth maps does not exceed the set double-click distance critical value;
the operation track corresponding to the click response is as follows: and within the length of the set time period, respectively calculating the existence of a touch point, the nonexistence of the touch point and the nonexistence of the touch point according to the continuous first group of depth maps, the interval time period and the second group of depth maps.
The invention also discloses an operation track response system of the projection touch system, which comprises the following components:
the projection module is used for projecting the picture onto a projection screen;
the depth module is used for collecting a depth map of a space range above the projection screen;
the data processing module is used for acquiring the depth value of each target in the depth map, judging whether a touch point exists according to the depth value of each target, and calculating the coordinate of the touch point if the touch point exists; judging an operation track according to touch point coordinates calculated from multiple continuous groups of depth maps, and making corresponding response according to the operation track, wherein one group of depth maps are formed by multiple continuous frames of depth maps, and the number of frames of the depth maps contained in one group of depth maps is determined by the frame rate of the depth map acquired by the depth module; if the data processing module judges the operation track corresponding to the single click, the double click or the page sliding response in the set time period after the data processing module makes the page sliding, zooming or rotating response, the operation track corresponding to the single click, the double click or the page sliding response is ignored (namely, the data processing module does not make the response of the single click, the double click or the page sliding again even if the data processing module judges the operation track corresponding to the single click, the double click or the page sliding response in the set time period).
Preferably, in the system, the operation tracks corresponding to the page sliding, zooming and rotating responses are respectively judged according to the change of the coordinates of the touch point calculated by two groups of continuous depth maps, and the operation tracks corresponding to the single click and double click responses are respectively judged according to the change of the coordinates of the touch point calculated by the depth maps continuously collected within the length of the set time period.
Preferably, in the system, the length of the set period is greater than the time length for continuously acquiring two sets of depth maps and less than the time length for continuously acquiring four sets of depth maps.
Preferably, in the system, the first and second sensors are,
the operation track corresponding to the page sliding response made by the data processing module is as follows: calculating a touch point according to the continuous first group and second group of depth maps, wherein the touch point calculated according to the second group of depth maps and the touch point calculated according to the first group of depth maps have displacement exceeding a set slide page displacement critical value in the X-axis coordinate direction (the X-axis coordinate direction is the horizontal direction);
the operation track corresponding to the zooming response made by the data processing module is as follows: calculating two touch points according to the continuous first group and second group of depth maps, wherein the length difference between the vector formed by the two touch points calculated according to the second group of depth maps and the vector formed by the two touch points calculated according to the first group of depth maps exceeds a preset zoom length difference threshold value (wherein, if the length of the vector formed by the two touch points calculated according to the second group of depth maps is smaller than that of the vector formed by the two touch points calculated according to the first group of depth maps, the zoom response corresponding to the operation track is reduced, and if not, the zoom response is increased);
the operation track corresponding to the rotation response made by the data processing module is as follows: calculating two touch points according to the continuous first group and second group of depth maps, and calculating an included angle between a vector formed by the two touch points and a vector formed by the two touch points according to the second group of depth maps, wherein the included angle exceeds a set rotation included angle critical value (if the included angle is formed clockwise, the rotation response corresponding to the operation track is clockwise rotation, and if the included angle is not clockwise);
the operation track corresponding to the double-click response made by the data processing module is as follows: within the length of the set time period, respectively calculating the existence of a touch point, the nonexistence of the touch point and the existence of a touch point according to the continuous first group of depth maps, the interval time period and the second group of depth maps, wherein the distance between the touch point calculated according to the second group of depth maps and the touch point calculated according to the first group of depth maps does not exceed the set double-click distance critical value;
the operation track corresponding to the click response made by the data processing module is as follows: and within the length of the set time period, respectively calculating the existence of a touch point, the nonexistence of the touch point and the nonexistence of the touch point according to the continuous first group of depth maps, the interval time period and the second group of depth maps.
Preferably, the system further comprises a timer defining a set period of time, the timer starting to count when the data processing module makes a page sliding, zooming or rotating response, and notifying the data processing module of the end of the count after the set period of time has elapsed.
The invention has the following beneficial effects:
the technical scheme of the invention can avoid the data processing module from making wrong response due to the frame drop phenomenon of the depth module, particularly the low frame rate depth module, and can also avoid the data processing module from making continuous page sliding response to one page sliding operation by mistake.
Drawings
The following describes embodiments of the present invention in further detail with reference to the accompanying drawings;
fig. 1 shows a flowchart of an operation trajectory response method of a projected touch system.
Fig. 2 shows a schematic diagram of an operation trajectory response system of a projected touch system.
Detailed Description
In order to more clearly illustrate the invention, the invention is further described below with reference to preferred embodiments and the accompanying drawings. Similar parts in the figures are denoted by the same reference numerals. It is to be understood by persons skilled in the art that the following detailed description is illustrative and not restrictive, and is not to be taken as limiting the scope of the invention.
Example 1
As shown in fig. 1, the operation track response method of the projection touch system provided in this embodiment includes the following steps:
projecting the picture on a projection screen;
collecting a depth map of a space range above the projection screen;
acquiring the depth value of each target in the depth map, judging whether a touch point exists according to the depth value of each target, and calculating the coordinate of the touch point if the touch point exists;
judging an operation track according to the touch point coordinates calculated in the continuous multiple groups of depth maps, and making corresponding response according to the operation track, wherein one group of depth maps are formed by continuous multiple frames of depth maps, and the number of depth map frames contained in one group of depth maps is determined by the frame rate of the collected depth maps; in this embodiment, if the operation trajectory corresponding to the click, double click, or slide page response is determined within the set time period after the slide page, zoom, or rotation response is made, the operation trajectory corresponding to the click, double click, or slide page response is ignored (i.e., even if the operation trajectory corresponding to the click, double click, or slide page response is determined within the set time period, no click, double click, or slide page response is made), so as to avoid making an erroneous response to a certain extent.
The description of the relationship between the number of depth map frames contained in a set of depth maps and the frame rate at which the depth maps are acquired is: the number of depth map frames included in a set of depth maps is determined by the frame rate at which the depth maps are acquired, i.e., the number of depth map frames included in a set of depth maps is the number of frames corresponding to one relatively instantaneous operation of the operator (i.e., the operator places a finger or pen touch on the projection screen) based on the frame rate at which the depth maps are acquired. Since the number of depth map frames included in a set of depth maps is the number of frames corresponding to one instantaneous operation of the operator, the number and coordinates of touch points included in each depth map in a set of depth maps should be relatively consistent. For example: when the depth map is acquired at a low frame rate, one relative instantaneous operation of an operator corresponds to 3 frames or 5 frames of depth maps, and the number of the depth map frames contained in one group of depth maps is 3 frames or 5 frames; when the high frame rate is used for acquiring the depth map, one relative instantaneous operation of an operator corresponds to 10 frames or 20 frames of the depth map, and the number of the depth map frames contained in one group of the depth map is 10 frames or 20 frames. The frame rate at which the depth maps are acquired corresponds to the number of depth map frames contained in a set of depth maps.
In specific implementation, the operation tracks corresponding to the page sliding, zooming and rotating responses are respectively judged according to the change of the coordinates of the touch points calculated by two groups of continuous depth maps, the operation tracks corresponding to the clicking and double-clicking responses are respectively judged according to the change of the coordinates of the touch points calculated by the depth maps continuously collected within the length of the set time period, and the length of the set time period is greater than the time length of continuously collecting the two groups of depth maps and less than the time length of continuously collecting the four groups of depth maps. The operation tracks corresponding to the click response and the double click response respectively judge that the length value of the set time interval is corresponding to the length value of the touch point according to the change of the coordinate of the touch point calculated by the depth maps continuously collected by a plurality of frames, because the number of the depth map frames contained in one group of depth maps is the number of the frames corresponding to a relative instantaneous operation of an operator obtained according to the frame rate of the collected depth maps, and the number of the frames corresponding to the 'lifting' action of the operator in the double click operation when the operation tracks corresponding to the double click response are judged is possibly less than or more than the number of the depth map frames contained in one group of depth maps, but usually does not exceed the number of the depth map frames contained in the two groups of depth maps, the specific value of the operation tracks can be selected according to the actual situation, and the selection mode of the.
In fact, in this embodiment, the length of the time period is set to be the sum of the time length of continuously acquiring the two sets of depth maps and the time length of acquiring the depth map of the number of frames corresponding to the "raising" action of the operator in the double-click operation when the operation trajectory corresponding to the double-click response is judged. If the number of frames corresponding to the 'lifting' action is less than the number of frames of the depth maps contained in one group of depth maps, the length of the set time interval is greater than or equal to the time length for continuously acquiring the two groups of depth maps and less than the time length for continuously acquiring the three groups of depth maps; if the number of frames corresponding to the lifting action is equal to the number of frames of the depth maps contained in the group of depth maps, setting the length of a time period to be equal to the time length for continuously acquiring the three groups of depth maps; if the number of frames corresponding to the above-mentioned "lift-off" action is greater than the number of depth maps contained in one group of depth maps and less than the number of depth maps contained in two groups of depth maps, the length of the set period is greater than the time length for continuously acquiring three groups of depth maps and less than the time length for continuously acquiring four groups of depth maps.
As can be seen from the above, after the page sliding, zooming or rotating response is made, when a wrong page sliding response is made, which may be caused by a frame drop phenomenon occurring in the collected depth map, the operation trajectory corresponding to the page sliding response is judged according to the change of the coordinates of the touch points calculated by the two consecutive sets of depth maps; when a click or double-click page sliding response is made, which may be caused by a frame dropping phenomenon occurring in the acquired depth map, the operation tracks corresponding to the click and double-click responses are judged according to the change of the touch point coordinate calculated by the depth map continuously acquired within the length of the set time period.
Because the length of the set time interval is longer than the time length of continuously acquiring the two groups of depth maps, if the operation track corresponding to the single click, the double click or the page sliding response is judged in the set time interval after the page sliding, zooming or rotating response is made, the operation track corresponding to the single click, the double click or the page sliding response is ignored, and the wrong single click, the double click or the page sliding response can be avoided.
It should be noted that the operation tracks corresponding to the page sliding, zooming and rotating responses represented by the two consecutive sets of depth maps and the operation tracks corresponding to the single-click and double-click responses represented by the set time periods are only a most preferable mode adopted by the embodiment. In practical operation, a person skilled in the art may adopt, according to different needs, two or more consecutive depth maps to represent operation trajectories corresponding to the slide page, zoom, and rotate responses, operation trajectories corresponding to the single click and the double click responses in different time periods, and operation trajectories corresponding to the single click, the double click, or the slide page response if omitted in different set time periods after the slide page, the zoom, or the rotate responses are made.
In the case of the specific implementation thereof,
the operation track corresponding to the page sliding response is as follows: calculating a touch point according to the continuous first group and second group of depth maps, and calculating the touch point according to the first group of depth maps and the touch point according to the second group of depth maps, wherein the touch point and the touch point calculated according to the first group of depth maps have displacements exceeding a set slide displacement critical value in an X-axis coordinate direction (the X-axis coordinate direction is a horizontal direction), the slide displacement critical value can be set according to an actual condition, and a specific setting mode of the slide displacement critical value in the prior art is also disclosed;
the operation trajectory corresponding to the zoom response is: calculating two touch points according to the continuous first and second sets of depth maps, and the length difference between the vector formed by the two touch points calculated according to the second set of depth maps and the vector formed by the two touch points calculated according to the first set of depth maps exceeds the preset zoom length difference threshold value (wherein, the zoom response corresponding to the operation track is reduced if the length of the vector formed by the two touch points calculated according to the second set of depth maps is smaller than the length of the vector formed by the two touch points calculated according to the first set of depth maps, and is increased if the length of the vector formed by the two touch points calculated according to the first set of depth maps is smaller than the length of the vector formed by the two touch points calculated according to the first set of depth maps), wherein the zoom length difference threshold value can be set according to actual conditions;
the operation trajectory corresponding to the rotation response is: calculating two touch points according to the continuous first group and second group of depth maps, and calculating an included angle between a vector formed by the two touch points and a vector formed by the two touch points according to the second group of depth maps, wherein the included angle exceeds a set rotation included angle critical value (wherein, if the included angle is formed clockwise, the rotation response corresponding to the operation track is clockwise rotation, and vice versa, the included angle critical value can be set according to actual conditions, and a specific setting mode of the included angle critical value in the prior art is also disclosed;
the operation trajectory corresponding to the double click response is: within the length of a set time period, respectively calculating a touch point, an absence touch point and a touch point according to a first group of continuous depth maps, an interval time period and a second group of continuous depth maps, wherein the distance between the touch point calculated according to the second group of depth maps and the touch point calculated according to the first group of depth maps does not exceed a set double-click distance critical value, the interval time period is the time length required by the depth maps of the frame number corresponding to the 'lifting' action of an operator in double-click operation when continuously acquiring and judging the operation track corresponding to double-click response, and the sum of the time length for acquiring the first group of depth maps, the interval time period and the time length for acquiring the second group of depth maps is equal to the length of the set time period; the double-click distance critical value can be set according to the actual situation, and the specific setting mode of the double-click distance critical value in the prior art is also disclosed;
the operation track corresponding to the click response is as follows: and within the length of the set time period, respectively calculating the existence of a touch point, the nonexistence of the touch point and the nonexistence of the touch point according to the continuous first group of depth maps, the interval time period and the second group of depth maps.
With the precondition that the length of the set time period is greater than or equal to the time length for continuously acquiring the three groups of depth maps and less than the time length for continuously acquiring the four groups of depth maps, how to avoid making an erroneous response by adopting the "if the operation trajectory corresponding to the click, double click or slide page response is determined within the set time period after the slide page, zoom or rotation response is made, the operation trajectory corresponding to the click, double click or slide page response is ignored" in this embodiment is further described:
firstly, if the operation track corresponding to the single click, double click or page sliding response is judged in the set time period after the page sliding response is made, ignoring the operation track corresponding to the single click, double click or page sliding response:
the operation track corresponding to the slide page response is that a touch point is calculated according to the continuous first group and the second group of depth maps, and the touch point calculated according to the second group of depth maps and the touch point calculated according to the first group of depth maps have displacement exceeding a set slide page displacement critical value in the X-axis coordinate direction. When the touch operator actually operates, it is likely that the operator has a long operation time when performing one page sliding operation, that is, the depth maps acquired in a long time period all show that there is one touch point. After a page-sliding response is made from the touch points embodied in the first and second sets of depth maps:
(1) if no frame drop phenomenon occurs in the third to fifth groups of depth maps, no frame drop phenomenon occurs in the third group of depth maps, or no frame drop phenomenon occurs in the fifth group of depth maps (the number of touch points represented in each group of depth maps can be represented by a data string: 11111, 11011, or 11110), a page sliding response is made again according to the operation track determined by the touch points represented in the third to fifth groups of depth maps, and a page sliding operation should not be continuously responded, so that the operation track corresponding to the page sliding response is ignored if the operation track corresponding to the page sliding response is determined in the set period after the page sliding response is made, and the continuous page sliding response to one page sliding operation can be avoided;
(2) if a frame dropping phenomenon occurs in an interval period between the third group of depth maps and the fourth group of depth maps within a set period (the number of touch points represented in each group of depth maps and interval period is 11101 by using a data string), an erroneous double-click response may be made according to an operation trajectory determined by the touch points represented by the third group of depth maps, the interval period and the fourth group of depth maps, so that the operation trajectory corresponding to the double-click response is ignored if the operation trajectory corresponding to the double-click response is determined within the set period after the page sliding response is made, and the erroneous double-click response caused by the frame dropping phenomenon can be avoided;
(3) if the frame dropping phenomenon occurs in the interval period between the third group of depth maps and the fourth group of depth maps within the set period (the number of touch points represented in each group of depth maps and interval period is 11100, which can be represented by a data string), the operation trajectory determined according to the touch points represented in the interval period and the fourth group of depth maps makes an erroneous click response.
Secondly, if the operation track corresponding to the single click, double click or page sliding response is judged in the set time period after the zooming or rotating response is made, ignoring the operation track corresponding to the single click, double click or page sliding response:
the operation tracks corresponding to the zooming or rotating responses all comprise: the presence of two touch points is calculated from the successive first and second sets of depth maps. When the touch operator actually operates, it is likely that the operator lifts one finger (or pen, etc.) first but lifts the other finger (or pen, etc.) later when performing a zoom or rotation operation, that is, depth maps acquired in a longer period of time both show the existence of one touch point, the first two sets of depth maps show the existence of two touch points, and the later acquired depth maps show the existence of one touch point. After a zoom or rotation response is made to the touch points embodied from the first and second sets of depth maps:
(1) if no frame drop phenomenon occurs in the third to fifth groups of depth maps, no frame drop phenomenon occurs in the third group of depth maps, or no frame drop phenomenon occurs in the fifth group of depth maps (the number of touch points represented in each group of depth maps can be represented by a data string as 22111, 22011 or 22110), an erroneous page sliding response may be made according to the operation trajectory determined by the touch points represented by the third to fifth groups of depth maps, so that the operation trajectory of the corresponding page sliding response is ignored if the operation trajectory of the corresponding page sliding response is determined in the set period after the zooming or rotating response is made, and the erroneous page sliding response caused by the frame drop phenomenon can be avoided;
(2) if a frame drop phenomenon occurs in an interval period between the third group of depth maps and the fourth group of depth maps within a set period (22101 is represented by a data string only by the number of touch points embodied in each group of depth maps and interval period), an erroneous double-click response may be made according to an operation trajectory determined by the touch points embodied by the third group of depth maps, the interval period and the fourth group of depth maps, so that the operation trajectory corresponding to the double-click response is ignored if the operation trajectory corresponding to the double-click response is determined within the set period after the zoom or rotation response is made, and the erroneous double-click response caused by the frame drop phenomenon can be avoided;
(3) if frame dropping occurs in the interval period between the third group of depth maps and the fourth group of depth maps within the set period (22100 is represented by the data string only by the number of touch points embodied in each group of depth maps and interval period), an erroneous click response can be made according to the operation trajectory determined by the touch points embodied by the interval period and the fourth group of depth maps.
Under the premise that the length of the set time period is longer than the time length for continuously acquiring the two groups of depth maps and shorter than the time length for continuously acquiring the three groups of depth maps, the reason why the operation trajectory corresponding to the click, double click or slide page response is ignored if the operation trajectory corresponding to the click, double click or slide page response is judged in the set time period after the slide page, zoom or rotation response is made is similar to the above description, and details are not repeated here.
Example 2
As shown in fig. 2, an operation trajectory response system of a projection touch system for executing the method provided in embodiment 1 includes:
the projection module 1 projects the picture on a projection screen;
the depth module 2 is used for collecting a depth map of a space range above the projection screen, namely collecting the depth map of the space range from the depth module 2 to the projection screen;
the data processing module 3 is used for acquiring the depth value of each target in the depth map, judging whether a touch point exists according to the depth value of each target, and calculating the coordinate of the touch point if the touch point exists; judging an operation track according to touch point coordinates calculated from multiple continuous groups of depth maps, and making corresponding response according to the operation track, wherein one group of depth maps are formed by multiple continuous frames of depth maps, and the number of frames of the depth maps contained in one group of depth maps is determined by the frame rate of the depth map acquired by the depth module; in this embodiment, if the data processing module 3 determines the operation trajectory corresponding to the single-click, double-click or sliding page response within the set time period after the data processing module 3 makes the sliding page, zooming or rotating response, the operation trajectory corresponding to the single-click, double-click or sliding page response is ignored (i.e., even if the data processing module determines the operation trajectory corresponding to the single-click, double-click or sliding page response within the set time period, the single-click, double-click or sliding page response is not made).
Regarding the function and configuration of the data processing module 3, in embodiment 1, specific description is given to how to determine an operation trajectory according to touch point coordinates calculated from multiple consecutive sets of depth maps, how to make a corresponding response according to the operation trajectory, and why to ignore the operation trajectory corresponding to a click, double click, or slide page response if the operation trajectory corresponding to the click, double click, or slide page response is determined within a set time period after the slide page, zoom, or rotation response is made, which is not described herein again.
In practical implementation, the operation trajectory response system of the projection touch system provided by this embodiment further includes a timer (the timer is not shown in fig. 2) defining a set time period, the timer starts to count time when the data processing module 3 makes a page sliding, zooming or rotating response, and notifies the data processing module 3 of the end of the time count after the set time period elapses. The function of the timer is to strip off the function defining the set period of time from the data processing module 3 so that the function can be implemented independently. Of course, it is also possible to integrate the function of defining the set period of time in the data processing module 3.
It should be understood that the above-mentioned embodiments of the present invention are only examples for clearly illustrating the present invention, and are not intended to limit the embodiments of the present invention, and it will be obvious to those skilled in the art that other variations or modifications may be made on the basis of the above description, and all embodiments may not be exhaustive, and all obvious variations or modifications may be included within the scope of the present invention.
Claims (3)
1. An operation track response method of a projection touch system is characterized by comprising the following steps:
projecting the picture on a projection screen;
collecting a depth map of a space range above the projection screen;
acquiring the depth value of each target in the depth map, judging whether a touch point exists according to the depth value of each target, and calculating the coordinate of the touch point if the touch point exists;
judging an operation track according to the touch point coordinates calculated in the continuous multiple groups of depth maps, and making corresponding response according to the operation track, wherein one group of depth maps are formed by continuous multiple frames of depth maps, and the number of depth map frames contained in one group of depth maps is determined by the frame rate of the collected depth maps; if the operation track corresponding to the single click, double click or page sliding response is judged in the set time period after the page sliding, zooming or rotating response is made, the operation track corresponding to the single click, double click or page sliding response is ignored;
the operation tracks corresponding to page sliding, zooming and rotating responses are judged according to the change of coordinates of touch points calculated by two groups of continuous depth maps respectively, the operation tracks corresponding to single click and double click responses are judged according to the change of coordinates of touch points calculated by the depth maps continuously collected within the length of a set time period, and the length of the set time period is greater than the time length of continuously collecting the two groups of depth maps and less than the time length of continuously collecting the four groups of depth maps;
the operation track corresponding to the page sliding response is as follows: calculating a touch point according to the continuous first group and second group of depth maps, wherein the touch point calculated according to the first group of depth maps and the touch point calculated according to the second group of depth maps have displacement exceeding a set slide page displacement critical value in the X-axis coordinate direction;
the operation trajectory corresponding to the zoom response is: calculating two touch points according to the continuous first group and second group of depth maps, wherein the length difference between the vector formed by the two touch points calculated according to the second group of depth maps and the vector formed by the two touch points calculated according to the first group of depth maps exceeds the preset zoom length difference critical value;
the operation trajectory corresponding to the rotation response is: calculating two touch points according to the continuous first group of depth maps and the continuous second group of depth maps, wherein an included angle exceeding a set rotation included angle critical value exists between a vector formed by the two touch points calculated according to the second group of depth maps and a vector formed by the two touch points calculated according to the first group of depth maps;
the operation trajectory corresponding to the double click response is: within the length of the set time period, respectively calculating the existence of a touch point, the nonexistence of the touch point and the existence of a touch point according to the continuous first group of depth maps, the interval time period and the second group of depth maps, wherein the distance between the touch point calculated according to the second group of depth maps and the touch point calculated according to the first group of depth maps does not exceed the set double-click distance critical value;
the operation track corresponding to the click response is as follows: and within the length of the set time period, respectively calculating the existence of a touch point, the nonexistence of the touch point and the nonexistence of the touch point according to the continuous first group of depth maps, the interval time period and the second group of depth maps.
2. An operation trajectory response system of a projection touch system, comprising:
the projection module is used for projecting the picture onto a projection screen;
the depth module is used for collecting a depth map of a space range above the projection screen;
the data processing module is used for acquiring the depth value of each target in the depth map, judging whether a touch point exists according to the depth value of each target, and calculating the coordinate of the touch point if the touch point exists; judging an operation track according to touch point coordinates calculated from multiple continuous groups of depth maps, and making corresponding response according to the operation track, wherein one group of depth maps are formed by multiple continuous frames of depth maps, and the number of frames of the depth maps contained in one group of depth maps is determined by the frame rate of the depth map acquired by the depth module; if the data processing module judges the operation track corresponding to the single click, double click or page sliding response in the set time period after the data processing module makes page sliding, zooming or rotating response, neglecting the operation track corresponding to the single click, double click or page sliding response;
the operation tracks corresponding to page sliding, zooming and rotating responses are judged according to the change of coordinates of touch points calculated by two groups of continuous depth maps respectively, the operation tracks corresponding to single click and double click responses are judged according to the change of coordinates of touch points calculated by the depth maps continuously collected within the length of a set time period, and the length of the set time period is greater than the time length of continuously collecting the two groups of depth maps and less than the time length of continuously collecting the four groups of depth maps;
the operation track corresponding to the page sliding response made by the data processing module is as follows: calculating a touch point according to the continuous first group and second group of depth maps, wherein the touch point calculated according to the second group of depth maps and the touch point calculated according to the first group of depth maps have displacement exceeding a set slide page displacement critical value in the X-axis coordinate direction;
the operation track corresponding to the zooming response made by the data processing module is as follows: calculating two touch points according to the continuous first group and second group of depth maps, wherein the length difference between the vector formed by the two touch points calculated according to the second group of depth maps and the vector formed by the two touch points calculated according to the first group of depth maps exceeds the preset zoom length difference critical value;
the operation track corresponding to the rotation response made by the data processing module is as follows: calculating two touch points according to the continuous first group of depth maps and the continuous second group of depth maps, wherein an included angle exceeding a set rotation included angle critical value exists between a vector formed by the two touch points calculated according to the second group of depth maps and a vector formed by the two touch points calculated according to the first group of depth maps;
the operation track corresponding to the double-click response made by the data processing module is as follows: within the length of the set time period, respectively calculating the existence of a touch point, the nonexistence of the touch point and the existence of a touch point according to the continuous first group of depth maps, the interval time period and the second group of depth maps, wherein the distance between the touch point calculated according to the second group of depth maps and the touch point calculated according to the first group of depth maps does not exceed the set double-click distance critical value;
the operation track corresponding to the click response made by the data processing module is as follows: and within the length of the set time period, respectively calculating the existence of a touch point, the nonexistence of the touch point and the nonexistence of the touch point according to the continuous first group of depth maps, the interval time period and the second group of depth maps.
3. The system of claim 2, further comprising a timer defining a set period of time.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710735370.3A CN107506133B (en) | 2017-08-24 | 2017-08-24 | Operation track response method and system of projection touch system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710735370.3A CN107506133B (en) | 2017-08-24 | 2017-08-24 | Operation track response method and system of projection touch system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107506133A CN107506133A (en) | 2017-12-22 |
| CN107506133B true CN107506133B (en) | 2020-09-18 |
Family
ID=60692739
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710735370.3A Active CN107506133B (en) | 2017-08-24 | 2017-08-24 | Operation track response method and system of projection touch system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107506133B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109725804B (en) * | 2018-12-21 | 2020-11-17 | 歌尔科技有限公司 | Projection-based track identification method, projection equipment and storage medium |
| CN113489906B (en) * | 2021-07-14 | 2022-11-15 | 长沙克莱自动化设备有限公司 | Method and device for controlling shooting equipment, computer equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104750250A (en) * | 2015-03-04 | 2015-07-01 | 深圳市祈锦通信技术有限公司 | Gesture-interaction-supported projection method and system |
| WO2016018393A1 (en) * | 2014-07-31 | 2016-02-04 | Hewlett-Packard Development Company, Lp | Touch region projection onto a touch-sensitive surface |
| CN105589552A (en) * | 2014-10-30 | 2016-05-18 | 联想(北京)有限公司 | Projection interaction method and projection interaction device based on gestures |
| CN106095199A (en) * | 2016-05-23 | 2016-11-09 | 广州华欣电子科技有限公司 | A kind of touch-control localization method based on projection screen and system |
| CN106125984A (en) * | 2016-06-28 | 2016-11-16 | 维沃移动通信有限公司 | The touch-control processing method of a kind of mobile terminal and mobile terminal |
| CN106951871A (en) * | 2017-03-24 | 2017-07-14 | 北京地平线机器人技术研发有限公司 | Movement locus recognition methods, device and the electronic equipment of operating body |
-
2017
- 2017-08-24 CN CN201710735370.3A patent/CN107506133B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2016018393A1 (en) * | 2014-07-31 | 2016-02-04 | Hewlett-Packard Development Company, Lp | Touch region projection onto a touch-sensitive surface |
| CN105589552A (en) * | 2014-10-30 | 2016-05-18 | 联想(北京)有限公司 | Projection interaction method and projection interaction device based on gestures |
| CN104750250A (en) * | 2015-03-04 | 2015-07-01 | 深圳市祈锦通信技术有限公司 | Gesture-interaction-supported projection method and system |
| CN106095199A (en) * | 2016-05-23 | 2016-11-09 | 广州华欣电子科技有限公司 | A kind of touch-control localization method based on projection screen and system |
| CN106125984A (en) * | 2016-06-28 | 2016-11-16 | 维沃移动通信有限公司 | The touch-control processing method of a kind of mobile terminal and mobile terminal |
| CN106951871A (en) * | 2017-03-24 | 2017-07-14 | 北京地平线机器人技术研发有限公司 | Movement locus recognition methods, device and the electronic equipment of operating body |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107506133A (en) | 2017-12-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9418320B2 (en) | Apparatus and method for detecting object using PTZ camera | |
| CN108596092B (en) | Gesture recognition method, device, equipment and storage medium | |
| US9019239B2 (en) | Creative design systems and methods | |
| JP5484184B2 (en) | Image processing apparatus, image processing method, and program | |
| CN102509088B (en) | Hand motion detecting method, hand motion detecting device and human-computer interaction system | |
| EP2846308A2 (en) | Pointing direction detecting device and its method, program and computer readable-medium | |
| JP6356266B2 (en) | Crowd monitoring system | |
| CN109446942A (en) | Method for tracking target, device and system | |
| CN109325456B (en) | Target identification method, target identification device, target identification equipment and storage medium | |
| CN111767888A (en) | Object state detection method, computer device, storage medium, and electronic device | |
| CN103092334B (en) | Virtual mouse driving device and virtual mouse simulation method | |
| KR20170133269A (en) | Video processing apparatus, video processing method, and program | |
| CN105745687A (en) | Context aware moving object detection | |
| CN107506133B (en) | Operation track response method and system of projection touch system | |
| CN105302467B (en) | Touch control operation identifies and response method, device and game control method, device | |
| CN102819403A (en) | Terminal equipment and man-machine interaction method thereof | |
| CN109712167A (en) | Target detecting and method for tracing and system | |
| US20200242800A1 (en) | Determination apparatus and method for gaze angle | |
| JP2008287691A5 (en) | ||
| CN103646242A (en) | Maximally stable extremal region characteristic-based extended target tracking method | |
| CN111986229A (en) | Video target detection method, device and computer system | |
| JP4717445B2 (en) | Image processing system, image processing device, game device, program, information storage medium, and image processing method | |
| CN103400395A (en) | Light stream tracking method based on HAAR feature detection | |
| CN108280425A (en) | A kind of quick survey light implementation method based on screen following formula optical fingerprint sensor | |
| CN106527817B (en) | Touch operation identification method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20201016 Address after: 261031 north of Yuqing street, east of Dongming Road, high tech Zone, Weifang City, Shandong Province (Room 502, Geer electronic office building) Patentee after: GoerTek Optical Technology Co.,Ltd. Address before: 261031 No. 268 Dongfang Road, Weifang hi tech Development Zone, Shandong, Weifang Patentee before: GOERTEK Inc. |
|
| TR01 | Transfer of patent right |