WO2017096792A1 - 一种用于体感控制的click响应处理方法、装置和系统 - Google Patents

一种用于体感控制的click响应处理方法、装置和系统 Download PDF

Info

Publication number
WO2017096792A1
WO2017096792A1 PCT/CN2016/088311 CN2016088311W WO2017096792A1 WO 2017096792 A1 WO2017096792 A1 WO 2017096792A1 CN 2016088311 W CN2016088311 W CN 2016088311W WO 2017096792 A1 WO2017096792 A1 WO 2017096792A1
Authority
WO
WIPO (PCT)
Prior art keywords
gesture
delivery point
information
click
response processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2016/088311
Other languages
English (en)
French (fr)
Inventor
许端
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Le Holdings Beijing Co Ltd
Leshi Zhixin Electronic Technology Tianjin Co Ltd
Original Assignee
Le Holdings Beijing Co Ltd
Leshi Zhixin Electronic Technology Tianjin Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Le Holdings Beijing Co Ltd, Leshi Zhixin Electronic Technology Tianjin Co Ltd filed Critical Le Holdings Beijing Co Ltd
Priority to US15/249,525 priority Critical patent/US20170168582A1/en
Publication of WO2017096792A1 publication Critical patent/WO2017096792A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces

Definitions

  • Embodiments of the present invention relate to the field of somatosensory control technologies, and in particular, to a click response processing method, apparatus, and system for somatosensory control.
  • the somatosensory control is that the user interacts with the surrounding device devices through the limb movements to realize the corresponding control function, and the user can interact with the content in an immersive manner without using the control device.
  • the user stands in front of the display, and the somatosensory device (such as the camera) above the display can detect the user's hand movements. When the user swings the hand up, down, left, and right, respectively.
  • the function of displaying the fast forward, reverse, pause and terminate of the video content can be controlled, and the display device is controlled by the sense of body.
  • the above four hand movements can be matched with the reaction of the game characters, so that the user can get an immersive game experience.
  • Somatosensory control can be applied to 3D virtual reality, space mouse, gamepad, motion monitoring, health care and other technologies.
  • a click event refers to clicking on a desktop icon of a device (such as the display screen of FIG. 1) or an icon in an application using a human gesture. Completing a click event requires the user to push forward and pull back two gestures to the target icon. When the camera captures the two gestures, respectively, triggers the down event and the up event of the corresponding position to complete a click event.
  • the click on the target icon is easy to control. Among them, the click event requires that the gesture point of the down event and the up event cannot deviate too far, that is, the stop position of the user's hand push forward and the start position of the pull back need to be within the valid range, so that the icon click can be realized.
  • the click event is often invalidated.
  • the point of the up event may deviate too far from the position of the down event, and the up event sent will be invalid; if the point of the up event and/or the point of the down event are away The target icon is too far away, and the up event and/or down event sent at this time will also be invalid. It cannot generate a valid click event and requires repeated gestures, resulting in poor user experience.
  • the embodiment of the present invention provides a click response processing method, apparatus, and system for somatosensory control. Both the down event and the up event adopt a delivery point of a down event, which can avoid the occurrence of an invalid click event.
  • An embodiment of the present invention provides a click response processing method for somatosensory control, including: S101, when receiving a forward push gesture instruction for the target content, acquiring a delivery point corresponding to the forward push gesture instruction; S102, triggering a down event corresponding to the forward push gesture instruction according to the delivery point, determining and saving The information of the delivery point; S103, when receiving the pullback gesture instruction, directly calling the information of the delivery point, and triggering an up event corresponding to the pullback gesture instruction based on the information of the delivery point; S104, A click event for the target content is completed and the result is output.
  • the information of the delivery point includes the location of the delivery point.
  • the information of the delivery point further includes an instruction type corresponding to the delivery point.
  • the method further comprises: recognizing the captured gesture, and issuing the push gesture instruction when the captured gesture is a push gesture.
  • the determining, according to the delivery point, the down event corresponding to the push gesture instruction, determining and saving the information of the delivery point includes: when the delivery point triggers the down corresponding to the push gesture instruction At the time of the event, it is determined that the delivery point that triggers the down event is the delivery point and the information of the delivery point is saved.
  • the method further comprises: recognizing the captured gesture, and issuing the pull-back gesture instruction when the captured gesture is a pull-back gesture.
  • the embodiment of the present invention further provides a click response processing apparatus for the somatosensory control, comprising: a delivery point acquisition module, configured to acquire a delivery corresponding to the forward push gesture instruction when receiving a forward push gesture instruction for the target content a down event triggering module, configured to trigger a down event corresponding to the forward push gesture instruction according to the delivery point; a delivery point information determining module, configured to determine and save information of the delivery point; and transmit a point information calling module For directly receiving the information of the delivery point when receiving the pullback gesture instruction; the up event triggering module is configured to trigger an up event corresponding to the pullback gesture instruction based on the information of the delivery point; the result output a module for completing a click event for the target content and outputting the result.
  • a delivery point acquisition module configured to acquire a delivery corresponding to the forward push gesture instruction when receiving a forward push gesture instruction for the target content
  • a down event triggering module configured to trigger a down event corresponding to the forward push gesture instruction according to the delivery point
  • An embodiment of the present invention further provides a somatosensory control system, including: a camera and a somatosensory control device, wherein the camera is used to capture a gesture; and the somatosensory control device includes a click response processing device for somatosensory control as described above. .
  • the embodiment of the present invention also records the information of the delivery point when triggering the down event of a delivery point.
  • the information of the delivery point can be directly invoked, the up event of the delivery point is triggered, and the click click is completed.
  • the click click can be completed in time and accurately. Avoid invalid click events, improve click click accuracy, and improve user experience.
  • FIG. 1 is a schematic diagram of a somatosensory control gesture capture.
  • FIG. 2 is a flow chart of a click response processing method for somatosensory control according to an embodiment of the present invention.
  • FIG. 3 is a flow chart of a click response processing method for somatosensory control according to another embodiment of the present invention.
  • FIG. 4 is a block diagram showing the structure of a click response processing apparatus for somatosensory control according to an embodiment of the present invention.
  • Fig. 5 is a block diagram showing the structure of a body feeling control system according to an embodiment of the present invention.
  • FIG. 1 exemplarily shows a schematic diagram of a somatosensory control gesture capture.
  • the user stands in front of the display screen of the somatosensory control system and the camera, and the camera captures a human gesture made by the user to the display screen, wherein the push gesture triggers a down event, a pull gesture
  • the up event, the down event, and the up event are triggered to form a click event.
  • FIG. 2 is a flow chart showing a click response processing method for somatosensory control according to an embodiment of the present invention, which includes the following steps:
  • S102 Trigger a down event corresponding to the push gesture command according to the transfer point, and determine and save the information of the transfer point.
  • the embodiment of the present invention optimizes the mechanism for triggering the corresponding event based on the delivery point, and obtains a down event delivery point triggering down event by pushing the gesture, and saves the down event.
  • the event delivery point information when the up event is triggered, can directly call the saved delivery point, and no longer care about the orientation of the pull-back gesture. It can be seen that using the embodiment of the present invention to trigger the down event and the up event only need to mark a delivery point. , there is no distance or range limit, so you can avoid invalid click events and improve the click accuracy of the target content.
  • the information of the above-mentioned delivery point should contain at least the location of the delivery point.
  • the user stands in front of the display screen of the somatosensory control system and the camera, and the camera captures the human gesture made by the user to the display screen, wherein the push gesture triggers the down event, and the pull gesture triggers the up gesture. Events, down events, and up events make up a click event.
  • the human body gesture captured by the camera is recognized by the somatosensory control system. The following describes the processing procedure by taking a certain icon on the desktop of the display screen by the user through a human gesture, and referring to FIG. 3, specifically as follows :
  • the somatosensory control system recognizes the gesture according to the image collected by the camera, and if the gesture is recognized as the push gesture, sends a push gesture instruction, where the target content of the push gesture is an icon that the user wants to click;
  • S203 triggering a down event corresponding to the delivery point, and determining and saving information of the delivery point, where the information includes at least a location of the delivery point, and further including an instruction type corresponding to the delivery point;
  • the position of the transfer point is: the position of the point pointed by the forward push gesture when the user's push gesture is closest to the display screen.
  • the delivery point triggers the down event corresponding to the push gesture it is determined that the delivery point of the trigger down event is the delivery point and the information of the delivery point is saved.
  • the human body gesture collected by the camera is a series of motion curves.
  • the motion curve L of the forward push gesture does not change any more, and the motion curve L is displayed.
  • Point A with the smallest screen surface distance, and point B on the display screen at the same horizontal line as point A are the points pointed by the forward push gesture. It can be understood that the position of point B should fall within the range of icons that the user wants to click.
  • the position of point B is the position of the transfer point, and the position of point B is recorded, which is convenient for the subsequent up event to be called.
  • the information of the delivery point may further include an instruction type corresponding to the delivery point.
  • the instruction type corresponding to the delivery point in the embodiment of FIG. 3 is a “push forward gesture” instruction type, and the system may obtain The type of event executed at different times.
  • the somatosensory control system continues to recognize the captured gesture, and when the post-pull gesture is captured, issues a pull-back gesture.
  • the down event and the up event of the delivery point constitute a click event, and the click on the target icon is implemented, and the output result is that the target icon is selected.
  • the embodiment of the present invention does not need to record the delivery point of the pull-back gesture, and does not use the delivery point of the pull-back gesture to trigger the up event, but triggers the down event based on the same delivery point (the delivery point of the push gesture). Up event, complete the click of the target content, the user can perform the next gesture operation.
  • the embodiment of the present invention further provides a click response processing apparatus 100 for the somatosensory control.
  • the method includes:
  • a delivery point obtaining module 10 configured to acquire a delivery point corresponding to the forward push gesture instruction when receiving a forward push gesture instruction for the target content
  • the down event triggering module 12 is configured to trigger a down event corresponding to the forward push gesture instruction according to the delivery point;
  • a delivery point information determining module 14 for determining and saving information of the delivery point
  • the delivery point information calling module 16 is configured to directly invoke the information of the delivery point when receiving the pullback gesture instruction;
  • the up event triggering module 18 is configured to trigger an up event corresponding to the pullback gesture instruction based on the information of the delivery point;
  • the result output module 20 is configured to complete a click event for the target content and output the result.
  • the device 100 of the embodiment of FIG. 4 may further include a forward gesture recognition processing module, configured to identify the captured gesture, and send the module to the delivery point when the captured gesture is a forward gesture The push gesture instruction.
  • a forward gesture recognition processing module configured to identify the captured gesture, and send the module to the delivery point when the captured gesture is a forward gesture The push gesture instruction.
  • the device 100 of the embodiment of FIG. 4 may further include a pull-back gesture recognition processing module for recognizing the captured gesture, and calling the module to the transfer point information when the captured gesture is a pull-back gesture Issue the pull gesture command.
  • a pull-back gesture recognition processing module for recognizing the captured gesture, and calling the module to the transfer point information when the captured gesture is a pull-back gesture Issue the pull gesture command.
  • the embodiment of the present invention further provides a somatosensory control system, as shown in FIG. 5, including a camera and a somatosensory control device, the camera captures a gesture, and the somatosensory control device includes a plurality of modules in the above embodiment.
  • the forward gesture recognition processing module recognizes the captured gesture.
  • the delivery point acquisition module acquires a delivery point of the forward push gesture
  • the down event trigger module triggers the forward push gesture.
  • the down event the delivery point information determining module determines and saves the information of the delivery point; and the pull-back gesture recognition processing module issues a pull-back gesture command when recognizing the pull-back gesture.
  • the transfer point information calling module directly calls the information of the transfer point
  • the up event trigger module triggers the up event of the pull-back gesture instruction to complete the click of the target content.
  • the somatosensory control system uses the delivery point of the down event and the up event of the up event to solve the problem of the invalid click event caused by the mismatch of the trigger point of the down event and the up event in the conventional technology, and the icon content is improved. Click accuracy.
  • An embodiment of the present invention provides a click response processing apparatus for somatosensory control, where the apparatus includes:
  • One or more processors are One or more processors;
  • One or more programs the one or more programs being stored in the memory, when executed by the one or more processors:
  • the information of the delivery point is directly invoked when the pullback gesture instruction is received, and the up event corresponding to the pullback gesture instruction is triggered based on the information of the delivery point; the click for the target content is completed.
  • the event outputs the result.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Multimedia (AREA)
  • Position Input By Displaying (AREA)

Abstract

一种用于体感控制的click响应处理方法、处理装置以及一种体感控制系统。其中的方法包括：当接收到针对目标内容的前推手势时，获取所述前推手势指令对应的传递点(101)；根据传递点触发前推手势指令所对应的 down事件，确定并保存所述传递点的信息(102)；当接收到后拉手势指令时，直接调用所述传递点的信息，并基于所述传递点的信息触发后拉手势指令所对应的up事件(103)；完成针对所述目标内容的click事件并将结果输出(104)。

Description

一种用于体感控制的click响应处理方法、装置和系统
本申请要求在2015年12月09日提交中国专利局、申请号为201510903724.1、发明名称为“一种用于体感控制的click响应处理方法、装置和系统”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本发明实施例涉及体感控制技术领域，具体涉及一种用于体感控制的click响应处理方法、装置和系统。
 背景技术
体感控制是用户通过肢体动作与周边的装置设备互动，实现相应的控制功能，用户可身历其境地与内容做互动，而无需使用控制设备。如图1，用户站在显示屏前方，显示屏上方的体感设备（如摄像头）可侦测到用户的手部动作，当用户将手部分别向上、向下、向左和向右挥动时，可控制显示视频内容的快进、倒退、暂停和终止的功能，实现了以体感操控显示屏装置。类似地的应用有很多，例如在游戏应用中可将上述四个手部动作与游戏角色的反应对应起来，可让用户得到身临其境的游戏体验。体感控制可应用于3D虚拟现实、空间鼠标、游戏手柄、运动监测、健康医疗照护等技术中。
在体感控制技术中，一个click事件是指采用人体手势对装置（例如图1的显示屏）的桌面图标或某个应用中的图标进行点击。完成一次click事件需要用户对目标图标依次做出前推和后拉两个手势，当摄像头先后捕捉到这两个手势时，分别触发相应位置的down事件和up事件，完成一个click事件，可实现对目标图标的点击，操控方便。其中，click事件要求down事件和up事件的手势点不能偏离太远，也就是用户手部前推的停止位置和后拉的起始位置需在有效范围内，才能实现图标点击。
但是，由于体感控制主要依赖用户手势实现，而用户手势不容易统一动作或幅度，因而经常导致click事件无效。例如，当用户手势不标准时，在up事件的点有可能与down事件的点的位置偏离过远，这时发送的up事件就会无效了；如果up事件的点和/或down事件的点离目标图标太远，这时发送的up事件和/或down事件也会无效，不能产生有效的click事件，需要重复手势，造成用户体验差。
 技术问题
有鉴于此，本发明实施例提出一种用于体感控制的click响应处理方法、装置和系统，down事件和up事件均采用down事件的传递点，可避免无效click事件的发生。
 技术解决方案
本发明实施例提供一种用于体感控制的click响应处理方法，包括： S101，当接收到针对目标内容的前推手势指令时，获取所述前推手势指令对应的传递点；S102，根据所述传递点触发所述前推手势指令所对应的down事件，确定并保存所述传递点的信息；S103，当接收到后拉手势指令时，直接调用所述传递点的信息，并基于所述传递点的信息触发所述后拉手势指令所对应的up事件；S104，完成针对所述目标内容的click事件并将结果输出。
优选地，所述传递点的信息包括所述传递点的位置。
优选地，所述传递点的信息进一步包括所述传递点对应的指令类型。
优选地，在S101之前，所述方法还包括：对捕捉到的手势进行识别，当捕捉到的手势为前推手势时，发出所述前推手势指令。
优选地，所述根据所述传递点触发所述前推手势指令所对应的down事件，确定并保存所述传递点的信息包括：当所述传递点触发所述前推手势指令所对应的down事件时，确定触发down事件的传递点为所述传递点并保存所述传递点的信息。
优选地，在S102和S103之间，所述方法还包括：对捕捉到的手势进行识别，当捕捉到的手势为后拉手势时，发出所述后拉手势指令。
本发明实施例还提供一种用于体感控制的click响应处理装置，包括：传递点获取模块，用于当接收到针对目标内容的前推手势指令时，获取所述前推手势指令对应的传递点；down事件触发模块，用于根据所述传递点触发所述前推手势指令所对应的down事件；传递点信息确定模块，用于确定并保存所述传递点的信息；传递点信息调用模块，用于当接收到后拉手势指令时，直接调用所述传递点的信息；up事件触发模块，用于基于所述传递点的信息触发所述后拉手势指令所对应的up事件；结果输出模块，用于完成针对所述目标内容的click事件并将结果输出。
本发明实施例还提供一种体感控制系统，包括：摄像头和体感控制装置，其中，所述摄像头用于捕捉手势；所述体感控制装置包括如前所述的用于体感控制的click响应处理装置。
 有益效果
本发明的实施例在触发某个传递点的down事件时还记录该传递点的信息，当需要触发up事件时，可直接调用该传递点的信息，触发该传递点的up事件，完成click点击。由于down事件和up事件的触发基于同一个传递点，因此即使用户在体感控制时手势不标准，出现后拉手势和前推手势相隔距离过远等情况，也能及时、准确地完成click点击，避免无效click事件的发生，提高click点击的准确率，改善用户体验。
附图说明
图1是体感控制手势捕捉示意图。
图2是本发明一个实施例的用于体感控制的click响应处理方法的流程图。
图3是本发明另一实施例的用于体感控制的click响应处理方法的流程图。
图4是本发明实施例的用于体感控制的click响应处理装置结构框图。
图5是本发明实施例的体感控制系统的结构框图。
 本发明的实施方式
以下结合附图以及具体实施例，对本发明的技术方案进行详细描述。
图1示例性地示出了体感控制手势捕捉示意图，用户站在体感控制系统的显示屏和摄像头前方，摄像头采集用户向显示屏做出的人体手势，其中前推手势触发down事件，后拉手势触发up事件，down事件和up事件组成click事件。
图2示出了本发明实施例的用于体感控制的click响应处理方法的流程图，其包括以下步骤：
S101，当接收到针对目标内容的前推手势指令时，获取该前推手势指令对应的传递点；
S102，根据该传递点触发该前推手势指令所对应的down事件，确定并保存该传递点的信息；
S103，当接收到后拉手势指令时，直接调用该传递点的信息，并基于该传递点的信息触发该后拉手势指令所对应的up事件；
S104，完成针对该目标内容的click事件并将结果输出。
相对于以往的完成一个click事件需要获取两个传递点的方案，本发明实施例对基于传递点触发相应事件的机制进行了优化，通过前推手势获得down事件传递点触发down事件，并保存down事件传递点的信息，之后触发up事件时可直接调用已保存的传递点，而不再关心后拉手势的方位，可见，利用本发明的实施例触发down事件和up事件只需标记一个传递点，没有距离或范围限制，因此可避免无效click事件的发生，提高目标内容的点击准确率。
在本发明的实施例中，为了满足在down事件之后触发up事件所需要的条件，上述传递点的信息应该至少含有该传递点的位置。
在实际应用场景中，如图1所示，用户站在体感控制系统的显示屏和摄像头前方，摄像头采集用户向显示屏做出的人体手势，其中前推手势触发down事件，后拉手势触发up事件，down事件和up事件组成click事件。在本发明的实施例中，由体感控制系统对摄像头捕捉到的人体手势进行识别，以下以用户通过人体手势点击显示屏桌面上的某一图标为例，描述处理过程，参考图3，具体如下：
S201，体感控制系统根据摄像头采集到的图像对手势进行识别，如果识别为前推手势，则发出前推手势指令，其中前推手势的目标内容是用户想要点击的图标；
S202，当接收到该前推手势指令时，获取该前推手势指令在显示屏中对应的传递点；
S203，触发该传递点对应的down事件，同时确定并保存该传递点的信息，该信息至少包括该传递点的位置，进一步地还可包括该传递点对应的指令类型；
其中，传递点的位置为：用户的前推手势与显示屏的距离最近时，前推手势所指向的点的位置。当传递点触发前推手势指令所对应的down事件时，确定触发down事件的传递点为该传递点并保存该传递点的信息。具体来看，用户在做人体手势时，摄像头采集到的人体手势为一系列的运动曲线，当前推手势完成时，前推手势的运动曲线L不再变化，找出该运动曲线L中离显示屏表面距离最小的点A，与点A处在同一水平线上的显示屏上的点B就是前推手势指向的点。可以理解，点B的位置应落在用户想要点击的图标范围内。点B的位置即为传递点的位置，记录点B的位置，便于后续up事件时调用。
此外，在本发明的实施例中，传递点的信息还可以包括传递点对应的指令类型，例如图3实施例中传递点对应的指令类型为“前推手势”指令类型，据此系统可获取不同时刻下所执行的事件类型。
S204，体感控制系统对捕捉到的手势继续进行识别，当捕捉到后拉手势时，发出后拉手势指令。
S205，当接收到后拉手势指令时，直接调用上述已保存的传递点的信息，并基于该传递点的信息触发up事件。
S206，传递点的down事件和up事件组成了click事件，实现对目标图标的点击，输出结果为目标图标被选中。
本发明实施例不需要对后拉手势的传递点进行记录，也就不会采用后拉手势的传递点来触发up事件，而是基于同一传递点（前推手势的传递点）触发down事件和up事件，完成目标内容的点击，用户可以进行下一步的手势操作。
与本发明实施例的处理流程相对应地，本发明实施例还提供一种用于体感控制的click响应处理装置100，如图4所示，包括：
传递点获取模块10，用于当接收到针对目标内容的前推手势指令时，获取该前推手势指令对应的传递点；
down事件触发模块12，用于根据该传递点触发该前推手势指令所对应的down事件；
传递点信息确定模块14，用于确定并保存该传递点的信息；
传递点信息调用模块16，用于当接收到后拉手势指令时，直接调用该传递点的信息；
up事件触发模块18，用于基于该传递点的信息触发该后拉手势指令所对应的up事件；
结果输出模块20，用于完成针对该目标内容的click事件并将结果输出。
进一步地，在图4实施例的装置100中还可包括前推手势识别处理模块，用于对捕捉到的手势进行识别，当捕捉到的手势为前推手势时，向该传递点获取模块发出该前推手势指令。
进一步地，在图4实施例的装置100中还可包括后拉手势识别处理模块，用于对捕捉到的手势进行识别，当捕捉到的手势为后拉手势时，向该传递点信息调用模块发出该后拉手势指令。
此外，本发明实施例还提供一种体感控制系统，如图5所示，包括摄像头和体感控制装置，摄像头捕捉手势，体感控制装置包括上述实施例中的多个模块。其中，前推手势识别处理模块对捕捉到的手势进行识别，当捕捉到的手势识别为前推手势时，传递点获取模块获取前推手势的传递点，down事件触发模块触发该前推手势的down事件，传递点信息确定模块确定并保存传递点的信息；后拉手势识别处理模块识别到后拉手势时，发出后拉手势指令。接收到后拉手势指令时，传递点信息调用模块直接调用传递点的信息，up事件触发模块触发该后拉手势指令的up事件，完成实现目标内容的点击。
该体感控制系统将触发down事件和up事件的传递点均采用down事件的传递点，解决了往常技术中由于down事件和up事件的触发点不匹配导致的无效click事件的发生，提高了图标内容的点击准确性。
本发明实施例提供一种用于体感控制的click响应处理装置，所述装置包括：
一个或者多个处理器；
存储器；
一个或者多个程序，所述一个或者多个程序存储在所述存储器中，当被所述一个或者多个处理器执行时：
当接收到针对目标内容的前推手势指令时，获取所述前推手势指令对应的传递点；根据所述传递点触发所述前推手势指令所对应的down事件，确定并保存所述传递点的信息；当接收到后拉手势指令时，直接调用所述传递点的信息，并基于所述传递点的信息触发所述后拉手势指令所对应的up事件；完成针对所述目标内容的click事件并将结果输出。
本发明实施例的未尽描述细节，请参见前述各实施例的描述。
以上，结合具体实施例对本发明的技术方案进行了详细介绍，所描述的具体实施例用于帮助理解本发明的思想。本领域技术人员在本发明具体实施例的基础上做出的推导和变型也属于本发明保护范围之内。

Claims (14)

  1. 一种用于体感控制的click响应处理方法，其特征在于，包括：
    S101，当接收到针对目标内容的前推手势指令时，获取所述前推手势指令对应的传递点；
    S102，根据所述传递点触发所述前推手势指令所对应的down事件，确定并保存所述传递点的信息；
    S103，当接收到后拉手势指令时，直接调用所述传递点的信息，并基于所述传递点的信息触发所述后拉手势指令所对应的up事件；
    S104，完成针对所述目标内容的click事件并将结果输出。
  2. 根据权利要求1所述的用于体感控制的click响应处理方法，其特征在于，其中，所述传递点的信息包括所述传递点的位置。
  3. 根据权利要求2所述的用于体感控制的click响应处理方法，其特征在于，所述传递点的信息进一步包括所述传递点对应的指令类型。
  4. 根据权利要求1所述的用于体感控制的click响应处理方法，其特征在于，在S101之前，所述方法还包括：
    对捕捉到的手势进行识别，当捕捉到的手势为前推手势时，发出所述前推手势指令。
  5. 根据权利要求4所述的用于体感控制的click响应处理方法，其特征在于，其中，所述根据所述传递点触发所述前推手势指令所对应的down事件，确定并保存所述传递点的信息包括：
    当所述传递点触发所述前推手势指令所对应的down事件时，确定触发down事件的传递点为所述传递点并保存所述传递点的信息。
  6. 根据权利要求1所述的用于体感控制的click响应处理方法，其特征在于，在S102和S103之间，所述方法还包括：
    对捕捉到的手势进行识别，当捕捉到的手势为后拉手势时，发出所述后拉手势指令。
  7. 一种用于体感控制的click响应处理装置，其特征在于，包括：
    传递点获取模块，用于当接收到针对目标内容的前推手势指令时，获取所述前推手势指令对应的传递点；
    down事件触发模块，用于根据所述传递点触发所述前推手势指令所对应的down事件；
    传递点信息确定模块，用于确定并保存所述传递点的信息；
    传递点信息调用模块，用于当接收到后拉手势指令时，直接调用所述传递点的信息；
    up事件触发模块，用于基于所述传递点的信息触发所述后拉手势指令所对应的up事件；
    结果输出模块，用于完成针对所述目标内容的click事件并将结果输出。
  8. 根据权利要求7所述的用于体感控制的click响应处理装置，其特征在于，其中，所述传递点的信息包括所述传递点的位置。
  9. 根据权利要求8所述的用于体感控制的click响应处理装置，其特征在于，所述传递点的信息进一步包括所述传递点对应的指令类型。
  10. 根据权利要求7所述的用于体感控制的click响应处理装置，其特征在于，所述装置还包括：
    前推手势识别处理模块，用于对捕捉到的手势进行识别，当捕捉到的手势为前推手势时，向所述传递点获取模块发出所述前推手势指令。
  11. 根据权利要求10所述的用于体感控制的click响应处理装置，其特征在于，其中，
    当所述传递点触发所述前推手势指令所对应的down事件时，所述传递点信息确定模块确定触发down事件的传递点为所述传递点并保存所述传递点的信息。
  12. 根据权利要求7所述的用于体感控制的click响应处理装置，其特征在于，所述装置还包括：
    后拉手势识别处理模块，用于对捕捉到的手势进行识别，当捕捉到的手势为后拉手势时，向所述传递点信息调用模块发出所述后拉手势指令。
  13. 一种体感控制系统，其特征在于，包括：摄像头和体感控制装置，其中，所述摄像头用于捕捉手势；所述体感控制装置包括如权利要求7-12中任一项所述的用于体感控制的click响应处理装置。
  14. 一种用于体感控制的click响应处理装置，其特征在于，所述装置包括：
    一个或者多个处理器；
    存储器；
    一个或者多个程序，所述一个或者多个程序存储在所述存储器中，当被所述一个或者多个处理器执行时：
    当接收到针对目标内容的前推手势指令时，获取所述前推手势指令对应的传递点；
    根据所述传递点触发所述前推手势指令所对应的down事件，确定并保存所述传递点的信息；
    当接收到后拉手势指令时，直接调用所述传递点的信息，并基于所述传递点的信息触发所述后拉手势指令所对应的up事件；
    完成针对所述目标内容的click事件并将结果输出。
PCT/CN2016/088311 2015-12-09 2016-07-04 一种用于体感控制的click响应处理方法、装置和系统 Ceased WO2017096792A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/249,525 US20170168582A1 (en) 2015-12-09 2016-08-29 Click response processing method, electronic device and system for motion sensing control

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510903724.1A CN105892641A (zh) 2015-12-09 2015-12-09 一种用于体感控制的click响应处理方法、装置和系统
CN201510903724.1 2015-12-09

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/249,525 Continuation US20170168582A1 (en) 2015-12-09 2016-08-29 Click response processing method, electronic device and system for motion sensing control

Publications (1)

Publication Number Publication Date
WO2017096792A1 true WO2017096792A1 (zh) 2017-06-15

Family

ID=57002963

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/088311 Ceased WO2017096792A1 (zh) 2015-12-09 2016-07-04 一种用于体感控制的click响应处理方法、装置和系统

Country Status (3)

Country Link
US (1) US20170168582A1 (zh)
CN (1) CN105892641A (zh)
WO (1) WO2017096792A1 (zh)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2020052681A (ja) * 2018-09-26 2020-04-02 シュナイダーエレクトリックホールディングス株式会社 操作処理装置
CN111221406B (zh) * 2018-11-23 2023-10-13 杭州萤石软件有限公司 一种信息交互方法及装置
CN113449298B (zh) * 2020-03-24 2023-09-05 百度在线网络技术（北京）有限公司 一种反弹shell进程的检测方法、装置、设备和介质
CN113760659A (zh) * 2021-09-07 2021-12-07 联想(北京)有限公司 一种控制方法及控制装置

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100164891A1 (en) * 2003-09-16 2010-07-01 Smart Technologies Ulc Gesture recognition method and touch system incorporating the same
CN102822773A (zh) * 2010-03-24 2012-12-12 惠普开发有限公司 用于显示设备的手势映射
CN103347108A (zh) * 2013-07-05 2013-10-09 中科创达软件股份有限公司 一种侧面安装可编程快捷触控板的手机及实现方法
CN104571482A (zh) * 2013-10-22 2015-04-29 中国传媒大学 一种基于体感识别的数字设备操控方法
CN104679400A (zh) * 2013-12-03 2015-06-03 华为终端有限公司 一种非接触式输入信息的方法及终端

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102566744A (zh) * 2010-12-22 2012-07-11 康佳集团股份有限公司 一种鼠标控制方法、装置及终端
US8589950B2 (en) * 2011-01-05 2013-11-19 Blackberry Limited Processing user input events in a web browser
CN102520794B (zh) * 2011-12-06 2014-11-19 华映视讯（吴江）有限公司 手势辨识系统及方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100164891A1 (en) * 2003-09-16 2010-07-01 Smart Technologies Ulc Gesture recognition method and touch system incorporating the same
CN102822773A (zh) * 2010-03-24 2012-12-12 惠普开发有限公司 用于显示设备的手势映射
CN103347108A (zh) * 2013-07-05 2013-10-09 中科创达软件股份有限公司 一种侧面安装可编程快捷触控板的手机及实现方法
CN104571482A (zh) * 2013-10-22 2015-04-29 中国传媒大学 一种基于体感识别的数字设备操控方法
CN104679400A (zh) * 2013-12-03 2015-06-03 华为终端有限公司 一种非接触式输入信息的方法及终端

Also Published As

Publication number Publication date
CN105892641A (zh) 2016-08-24
US20170168582A1 (en) 2017-06-15

Similar Documents

Publication Publication Date Title
WO2017096792A1 (zh) 一种用于体感控制的click响应处理方法、装置和系统
CN103475849B (zh) 在视频通话时对摄像头拍摄角度进行调节的方法及装置
WO2014003365A1 (en) Method and apparatus for processing multiple inputs
CN104011628B (zh) 用于识别姿势的方法和姿势检测器
WO2014135023A1 (zh) 一种智能终端的人机交互方法及系统
WO2020177585A1 (zh) 一种手势处理方法及设备
WO2021000803A1 (zh) 一种控制屏幕小窗口的方法及相关设备
WO2015099293A1 (en) Device and method for displaying user interface of virtual input device based on motion recognition
WO2020078319A1 (zh) 基于手势的操控方法及终端设备
WO2017101441A1 (zh) 远程批注移动、缩放的同步方法与系统
WO2013163920A1 (zh) 插入或删除电子表格中单元格或行列的方法及其装置
WO2019184499A1 (zh) 一种视频通话的方法、设备和计算机存储介质
US20190286255A1 (en) Electronic whiteboard, image display method, and recording medium
WO2015046837A1 (ko) 컨텐츠 공유 장치 및 방법
WO2015161697A1 (zh) 应用于人机交互的运动物体跟踪方法及系统
US20190096130A1 (en) Virtual mobile terminal implementing system in mixed reality and control method thereof
WO2021136080A1 (zh) 触摸数据处理方法、装置、智能设备和存储介质
WO2014086145A1 (zh) 一种文件的共享方法及手持设备
WO2014178693A1 (ko) 복수의 디바이스를 매칭시키는 방법, 그리고 상기 매칭이 가능하게끔 하여 주는 디바이스 및 서버 시스템
WO2023224433A1 (en) Information generation method and device
CN104851134A (zh) 虚拟触发与真实物体触发相结合的扩增实境系统及其方法
WO2021244650A1 (zh) 控制方法、装置、终端及存储介质
TWI505135B (zh) 顯示畫面的控制系統、輸入裝置及控制方法
WO2012092770A1 (zh) 触控绘画处理系统及方法
CN206411612U (zh) 一种虚拟现实系统的交互控制装置及虚拟现实设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16871996

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16871996

Country of ref document: EP

Kind code of ref document: A1