WO2013149476A1 - 一种用户界面的操作控制方法及装置 - Google Patents

一种用户界面的操作控制方法及装置 Download PDF

Info

Publication number
WO2013149476A1
WO2013149476A1 PCT/CN2012/086002 CN2012086002W WO2013149476A1 WO 2013149476 A1 WO2013149476 A1 WO 2013149476A1 CN 2012086002 W CN2012086002 W CN 2012086002W WO 2013149476 A1 WO2013149476 A1 WO 2013149476A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
user interface
hand
dimensional virtual
virtual hand
Prior art date
Application number
PCT/CN2012/086002
Other languages
English (en)
French (fr)
Inventor
赵健章
蔡越
宋本民
Original Assignee
深圳创维数字技术股份有限公司
深圳市创维软件有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳创维数字技术股份有限公司, 深圳市创维软件有限公司 filed Critical 深圳创维数字技术股份有限公司
Publication of WO2013149476A1 publication Critical patent/WO2013149476A1/zh

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/044—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/04101—2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup

Definitions

  • the present invention relates to the field of touch control, and in particular, to an operation control method and apparatus for a user interface. Background technique
  • the touch-based user interface control methods are roughly classified into two types: one is that the user directly touches the touch point on the user interface display through the finger, and the other is that the user remotely controls the user interface by performing a touch operation on the touch sensing device. Both of these methods only allow the user to make simple touch operations such as clicking and sliding through one or two fingers, and the operation method is too single, and the interaction between the user and the user interface is lacking, and the user experience is not good.
  • the technical problem to be solved by the embodiments of the present invention is to provide a user interface operation control method and device, which can enable the user to flexibly and conveniently control the user interface and improve the user experience.
  • an operation control method for a user interface including:
  • the operation of the three-dimensional virtual hand on the user interface includes: at least one of an operation of rotating the user interface, an operation of dragging the user interface, an operation of reducing the user interface, and an operation of enlarging the user interface. item.
  • the user interface further includes: at least one three-dimensional function option;
  • the operation of the three-dimensional virtual hand-to-user interface further includes: an operation for requesting execution of a function corresponding to the function option.
  • the three-dimensional virtual hand is consistent with or proportional to the size and shape of the user's hand.
  • a three-dimensional virtual hand that conforms to the size, shape, or scale of the user's hand is constructed on the user interface.
  • an embodiment of the present invention further provides an operation control device for a user interface, including: an acquisition module, configured to collect a capacitance change signal generated by a change in a user's hand motion; a three-dimensional virtual hand control module, configured to The collected capacitance change signal controls a three-dimensional virtual hand of the user interface, so that the action of the three-dimensional virtual hand is consistent with the user's hand motion;
  • a processing module configured to perform a corresponding operation according to the operation of the three-dimensional virtual hand on the user interface.
  • the operation of the three-dimensional virtual hand on the user interface includes: at least one of an operation of rotating the user interface, an operation of dragging the user interface, an operation of reducing the user interface, and an operation of enlarging the user interface. item.
  • the user interface further includes: at least one three-dimensional function option;
  • the operation of the three-dimensional virtual hand-to-user interface further includes: an operation for requesting execution of a function corresponding to the function option.
  • the three-dimensional virtual hand is consistent with or proportional to the size and shape of the user's hand.
  • the collection module is further configured to collect a capacitance signal when the user's hand is at a standstill, the device further includes: a configuration module, where the configuration module is configured to use the capacitance signal collected by the collection module, A three-dimensional virtual hand that conforms to the size, shape, or scale of the user's hand is constructed on the user interface.
  • the embodiment of the present invention constructs a three-dimensional virtual hand consistent with the user's hand motion on the user interface, so that the user can directly control the user interface through the three-dimensional virtual hand in the user interface; since the user controls the user interface through the three-dimensional virtual hand operation, Therefore, the realism of the user's vision and touch can be improved at the same time, and the user experience is improved.
  • FIG. 1 is a schematic flow chart of a first embodiment of an operation control method of a user interface according to the present invention
  • FIG. 2 is a schematic flowchart of a second embodiment of an operation control method of a user interface according to the present invention
  • FIG. 3 is a user interface of the present invention
  • FIG. 4 is a schematic structural view of a first embodiment of an operation control device for a user interface of the present invention
  • FIG. 5 is a second embodiment of an operation control device for a user interface of the present invention
  • FIG. 6 is a schematic structural view of an embodiment of the processing module of FIG. 4.
  • FIG. 1 there is shown a flow chart of a first embodiment of an operation control method of a user interface of the present invention.
  • the method includes:
  • Step S11 collecting a capacitance change signal generated by a change in the motion of the user's hand.
  • the collection of the user's hand motion in step S11 can be implemented by a capacitive touch sensor, for example: by a capacitive touch panel having a large acquisition area, and generally the area of the capacitive touch panel is larger than the area of an ordinary human hand. And a rest area for the user's hand to rest can be placed on the capacitive touch panel.
  • the capacitance change signal generated by the change in the user's hand motion can reflect the change in the user's hand motion.
  • Step S12 Control a three-dimensional virtual hand of the user interface according to the collected capacitance change signal, so that the action of the three-dimensional virtual hand is consistent with the user's hand motion.
  • the user interface can be designed to be virtual three-dimensional. It should be noted that the motion amplitude of the three-dimensional virtual hand in the virtual three-dimensional user interface is consistent with or proportional to the magnitude of the user's hand motion. Wherein, since the capacitance change signal collected in step S1 l can reflect the change of the user's hand motion, step S12 can obtain the change of the user's hand motion by analyzing the collected capacitance change signal, thereby changing the user's hand motion. It is represented by a three-dimensional virtual hand in the user interface.
  • the capacitance signal on the touch panel changes more, and the user's hand moves away from the touch panel.
  • the smaller the change of the capacitance signal on the touch panel the displacement and direction of the user's hand in the vertical direction (down or upward) can be determined according to the degree of change of the capacitance signal and the changing trend (large or small). ), then you can control the 3D virtual hand to make the same motion in the virtual 3D user interface.
  • the capacitance state of the area through which the user's hand moves on the touchpad changes, by confirming that the states of the capacitors change.
  • the position coordinates of the point on the touchpad can be used to know the movement trajectory of the user's hand on the plane parallel to the touchpad, and then the three-dimensional virtual hand can be controlled to have the same motion trajectory in the virtual three-dimensional user interface. exercise.
  • Step S13 Perform a corresponding operation according to the operation of the three-dimensional virtual hand on the user interface.
  • the operation of the user interface by the three-dimensional virtual hand is implemented by the step S11 - step S12.
  • the operation of the three-dimensional virtual hand on the user interface includes: rotating the operation of the user interface, dragging and dropping the operation of the user interface, reducing the operation of the user interface, and zooming in. At least one of the operations of the user interface.
  • the operation of the three-dimensional virtual hand rotation user interface may be that the five fingers rotate an angle around the palm of the hand, and the corresponding operation may be performed according to the rotation direction and the rotation arc of the five fingers, and the operation of the user interface may be five fingers.
  • perform the corresponding operation may be based on the dragging direction and dragging displacement of the three-dimensional virtual hand, moving the entire user interface; reducing the user interface operation may be five fingers gathering, performing corresponding
  • the operation may be based on the extent of the three-dimensional virtual hand five fingers folding, reducing the entire user interface; the operation of zooming in the user interface may be five fingers open, and the corresponding operation may be performed according to the extent of the three-dimensional virtual hand five fingers opening, and the entire user interface is enlarged.
  • the user interface includes: At least one three-dimensional function option.
  • the operation of the three-dimensional virtual hand to the user interface further includes: an operation of rotating the three-dimensional function option, an operation of dragging and dropping the three-dimensional function option, an operation of reducing the three-dimensional function option, an operation of enlarging the three-dimensional function option, and Request to perform the operation of the function corresponding to the function option.
  • the three-dimensional function option can be three Dimensional graphics, each of which can correspond to one or more functional options.
  • the operations for requesting the function corresponding to the execution of the function option include: dragging, clicking, pressing, and the like.
  • the operation of the three-dimensional virtual hand rotation three-dimensional function option may be that the five fingers rotate an angle around the three-dimensional function option, and the corresponding operation may be performed according to the rotation direction and the rotation arc of the five fingers, and the entire three-dimensional function option is rotated;
  • the operation of the function option may be that the five fingers hold or pinch or grasp the three-dimensional function option to move in a certain direction, and the corresponding operation may be performed according to the drag direction and the drag displacement of the three-dimensional virtual hand, and the three-dimensional function option is moved.
  • the function of reducing the three-dimensional function option may be that the five fingers are centered on the three-dimensional function option, and the corresponding operation may be performed according to the range of the three-dimensional virtual hand five fingers, and the entire three-dimensional function option is reduced; the operation of enlarging the three-dimensional function option
  • the five fingers can be opened outwardly around the three-dimensional function option, and the corresponding operation can be performed according to the amplitude of the three-dimensional virtual hand five fingers, and the entire three-dimensional function option is enlarged.
  • the embodiment of the present invention constructs a three-dimensional virtual hand consistent with the user's hand motion on the user interface, so that the user can directly control the user interface through the three-dimensional virtual hand in the user interface; since the user controls the user interface through the three-dimensional virtual hand operation, Therefore, the realism of the user's vision and touch can be improved at the same time, and the user experience is improved.
  • FIG. 2 there is shown a flow chart of a second embodiment of the operation control method of the user interface of the present invention.
  • the method includes:
  • Step S21 Collect a capacitance signal when the user's hand is at rest.
  • the user In order to better obtain the size and shape information of the user's hand, the user needs to open the finger on the touch panel.
  • Step S22 constructing a three-dimensional virtual hand that is consistent with or proportional to the size and shape of the user's hand on the user interface according to the capacitance signal.
  • the capacitance state of the area covered by the user's hand on the touch panel changes, and according to the shape of the area, the overall contour information of the user's hand can be obtained, thereby constructing A three-dimensional virtual hand with a consistent shape of the user's hand.
  • the joint position information of the user's hand and the position information of the palm recess may be acquired.
  • the palm recess and the finger joint are more distant from the touchpad, and the other parts of the palm are more closely attached to the touchpad.
  • the capacitance of the area covered by the finger joint and the palm of the palm of the touchpad is correspondingly smaller than the capacitance of the area covered by the finger and the palm of the touchpad. It is confirmed that the position of the finger joint and the area corresponding to the palm depression in the area covered by the user's hand can be used to know the joint position of the user's hand and the position of the palm depression.
  • Step S23 Acquire a capacitance change signal generated by a change in the motion of the user's hand.
  • Step S24 Control a three-dimensional virtual hand of the user interface according to the collected capacitance change signal, so that the action of the three-dimensional virtual hand is consistent with the user's hand motion.
  • Step S25 Perform a corresponding operation according to the operation of the three-dimensional virtual hand on the user interface.
  • Steps S23 to S25 are the same as steps S1 1 to S13 in the first embodiment of the operation control method of the user interface of the present invention, and therefore are not described in detail.
  • the embodiment of the present invention constructs a three-dimensional virtual hand consistent with the user's hand motion on the user interface, so that the user can directly control the user interface through the three-dimensional virtual hand in the user interface; since the user controls the user interface through the three-dimensional virtual hand operation, Therefore, the realism of the user's vision and touch can be improved at the same time, and the user experience is improved.
  • FIG. 3 there is shown a flow chart of a third embodiment of the operation control method of the user interface of the present invention.
  • the method includes:
  • Step S31 Collect a capacitance change signal generated by a change in the motion of the user's hand.
  • Step S32 Control a three-dimensional virtual hand of the user interface according to the collected capacitance change signal, so that the action of the three-dimensional virtual hand is consistent with the user's hand motion.
  • Steps S31 to S32 are the same as steps S1 1 to S12 in the first embodiment of the operation control method of the user interface of the present invention, and therefore are not described herein.
  • Step S33 Determine a control command issued by the user to the user interface by detecting an operation of the user interface by the user through the three-dimensional virtual hand.
  • the operation of the three-dimensional virtual hand to the user interface includes: at least one of an operation of rotating the user interface, an operation of dragging the user interface, an operation of narrowing the user interface, and an operation of enlarging the user interface.
  • the user interface includes: At least one three-dimensional function option.
  • the operation of the three-dimensional virtual hand to the user interface further includes: an operation of rotating the three-dimensional function option, an operation of dragging and dropping the three-dimensional function option, an operation of reducing the three-dimensional function option, an operation of enlarging the three-dimensional function option, and Request to perform the operation of the function corresponding to the function option.
  • the three-dimensional function option can be three-dimensional graphics, each three-dimensional graphics can be Should have one or more feature options.
  • the operations for requesting the function corresponding to the function option include: click, press, and so on.
  • the user's various operations on the user interface through the three-dimensional virtual hand will have its own unique action characteristics, by extracting the action feature information of the current operation of the three-dimensional virtual hand, and pre-existing the action features in the database (in the database) Each action feature is matched against a control command to determine the control command issued by the user to the user interface.
  • the user's hand when the user's hand is rotated on the touchpad, its unique action characteristics are usually: The palm of the hand is raised, and the fingertips of the five fingers are turned around the palm of the hand (or close to the touchpad). According to the change of the capacitance on the touch panel, the information of the movement of the five-finger fingertip on the touchpad can be obtained. By analyzing the trajectory of a fingertip (or a comprehensive analysis of multiple fingertips) on the touchpad, the direction of rotation and the arc of rotation of the fingertip can be obtained, and then the direction and curvature of the user's desired user interface can be determined.
  • the palm is raised, the fingertips of the five fingers are folded on the touchpad (or close to the touchpad), and the five-finger fingertips are on the touchpad accordingly.
  • the motion trajectory is five straight line segments, and the straight lines of the five line segments are all at one point. By obtaining the length of any one of the line segments, it can be determined that the user desires to reduce the radiance of the user interface.
  • the user's hand When the user's hand is zoomed on the touchpad, its unique motion characteristics will usually be: The palm is raised, and the fingertips of the five fingers are opened outward on the touchpad (or close to the touchpad), and the fingertips are touched accordingly.
  • the motion trajectory on the board is five straight lines, and the straight lines of the five line segments are all at one point. By obtaining the length of any one of the line segments, the user desires to enlarge the radiance of the user interface.
  • the user When the user needs to operate a certain three-dimensional function option in the user interface, usually, the user puts the three-dimensional virtual hand in the user interface in the position of the three-dimensional function option by hand motion, so that It is possible to determine which one of the three-dimensional function options that the user desires to operate.
  • the user's operation for requesting the function corresponding to the three-dimensional function option includes: clicking, pressing, and the like.
  • its unique action characteristics are: The index finger or the middle finger is lifted up and then lowered, which correspondingly causes the capacitance of the area clicked by the user's finger on the touchpad to become smaller first and then become smaller. Big. Therefore, according to the change of the capacitance on the touch panel, the function corresponding to the three-dimensional function option that the user desires to perform is determined, and combined with the position of the three-dimensional virtual hand in the user interface, it is determined which function option the user desires to perform. .
  • the capacitance of the area pressed by the user's finger on the touch panel may be greater than the capacitance of other areas on the touch panel, thereby determining that the user desires to perform according to the state of the capacitance on the touch panel.
  • the function corresponding to the 3D function option combined with the position of the 3D virtual hand in the user interface, determines which function option the user desires to perform.
  • the user's operation of rotating, dragging, enlarging, and reducing the 3D function options is roughly the same as the user's operation of rotating, dragging, zooming in, and reducing the user interface.
  • the only difference is the magnitude of the motion, which can be differentiated according to the magnitude of the motion. Is the operation of the entire user interface or just a certain three-dimensional function option. For example, when the user rotates the user interface, the five-finger opening is usually larger, and when the user rotates a certain three-dimensional function option in the user interface, the five-finger opening is usually smaller, and the same five-finger fingertip is analyzed.
  • the motion track on the touchpad can accurately obtain the amplitude of the five-finger opening of the user, so that the amplitude value can be compared with the preset amplitude value.
  • the value is greater than the preset amplitude value, the user is expected to rotate the entire user interface. ;
  • it is less than the preset amplitude value the user is expected to rotate the 3D function option.
  • Step S34 Perform a corresponding operation according to the determined control command issued by the user to the user interface.
  • the embodiment of the present invention constructs a three-dimensional virtual hand consistent with the user's hand motion on the user interface, so that the user can directly control the user interface through the three-dimensional virtual hand in the user interface; since the user controls the user interface through the three-dimensional virtual hand operation, Therefore, the realism of the user's vision and touch can be improved at the same time, and the user experience is improved.
  • FIG. 4 there is shown a schematic configuration of a first embodiment of an operation control device for a user interface of the present invention.
  • the device includes:
  • the acquisition module 110 is configured to collect a capacitance change signal generated by a change in the motion of the user's hand.
  • the function of the acquisition module can be implemented by a capacitive touch sensor, for example: by a capacitive touch panel having a large acquisition area. Generally, the area of the capacitive touch panel is larger than that of an ordinary human hand, and can be capacitive. A rest area for the user's hand rest is set on the touchpad.
  • the capacitive touch panel when the user's hand moves in the capacitive touch panel, it will cause a change in the surface capacitance of the capacitive touch panel.
  • the capacitance change signal generated by the change in the user's hand motion can reflect the change in the user's hand motion.
  • the higher the sensitivity of the capacitive touch panel the better the acquisition effect when the user's hand is in compact contact with the capacitive touch panel.
  • the three-dimensional virtual hand control module 120 controls the three-dimensional virtual hand of the user interface according to the collected capacitance change signal, so that the action of the three-dimensional virtual hand is consistent with the user's hand motion.
  • the user interface can be designed to be virtual three-dimensional. It should be noted that the motion amplitude of the three-dimensional virtual hand in the virtual three-dimensional user interface is consistent with or proportional to the magnitude of the user's hand motion.
  • the capacitance change signal collected by the acquisition module 110 can reflect the change of the user's hand motion. Therefore, the three-dimensional virtual hand control module 120 can obtain the change of the user's hand motion by analyzing the collected capacitance change signal, and then the user hand The change in the action is represented by a three-dimensional virtual hand in the user interface.
  • the capacitance signal on the touch panel changes more, and the user's hand moves away from the touch panel.
  • the smaller the change of the capacitance signal on the touch panel the displacement and direction of the user's hand in the vertical direction (down or upward) can be determined according to the degree of change of the capacitance signal and the changing trend (large or small). ), then you can control the 3D virtual hand to make the same motion in the virtual 3D user interface.
  • the capacitance state of the area through which the user's hand moves on the touchpad changes, by confirming that the states of the capacitors change.
  • the position coordinates of the point on the touchpad can be used to know the movement trajectory of the user's hand on the plane parallel to the touchpad, and then the three-dimensional virtual hand can be controlled to have the same motion trajectory in the virtual three-dimensional user interface. exercise.
  • the processing module 130 is configured to perform a corresponding operation according to the operation of the three-dimensional virtual hand on the user interface.
  • the operation of the three-dimensional virtual hand to the user interface includes: at least one of an operation of rotating the user interface, an operation of dragging the user interface, an operation of narrowing the user interface, and an operation of enlarging the user interface.
  • the operation of the three-dimensional virtual hand rotation user interface may be that the five fingers rotate an angle around the palm of the hand, and the corresponding operation may be performed according to the rotation direction and the rotation arc of the five fingers, and the operation of the user interface may be five fingers.
  • perform the corresponding operation may be based on the dragging direction and dragging displacement of the three-dimensional virtual hand, moving the entire user interface; reducing the user interface operation may be five fingers gathering, performing corresponding The operation can be based on three The dimension of the virtual finger is narrowed down, and the entire user interface is reduced; the operation of zooming in the user interface can be five fingers open, and the corresponding operation can be performed according to the extent of the three-dimensional virtual hand five fingers opening, and the entire user interface is enlarged.
  • the user interface includes: At least one three-dimensional function option.
  • the operation of the three-dimensional virtual hand to the user interface further includes: an operation of rotating the three-dimensional function option, an operation of dragging and dropping the three-dimensional function option, an operation of reducing the three-dimensional function option, an operation of enlarging the three-dimensional function option, and Request to perform the operation of the function corresponding to the function option.
  • the three-dimensional function options may be three-dimensional solid graphics, and each three-dimensional solid graphics may correspond to one or more functional options.
  • the operations for requesting the function corresponding to the function option include: drag, click, press, and so on.
  • the operation of the three-dimensional virtual hand rotation three-dimensional function option may be that the five fingers rotate an angle around the three-dimensional function option, and the corresponding operation may be performed according to the rotation direction and the rotation arc of the five fingers, and the entire three-dimensional function option is rotated;
  • the operation of the function option may be that the five fingers hold or pinch or grasp the three-dimensional function option to move in a certain direction, and the corresponding operation may be performed according to the drag direction and the drag displacement of the three-dimensional virtual hand, and the three-dimensional function option is moved.
  • the function of reducing the three-dimensional function option may be that the five fingers are centered on the three-dimensional function option, and the corresponding operation may be performed according to the range of the three-dimensional virtual hand five fingers, and the entire three-dimensional function option is reduced; the operation of enlarging the three-dimensional function option
  • the five fingers can be opened outwardly around the three-dimensional function option, and the corresponding operation can be performed according to the amplitude of the three-dimensional virtual hand five fingers, and the entire three-dimensional function option is enlarged.
  • the embodiment of the present invention constructs a three-dimensional virtual hand consistent with the user's hand motion on the user interface, so that the user can directly control the user interface through the three-dimensional virtual hand in the user interface; since the user controls the user interface through the three-dimensional virtual hand operation, Therefore, the realism of the user's vision and touch can be improved at the same time, and the user experience is improved.
  • the device 100 includes:
  • the acquisition module 110 is configured to collect a capacitance signal when the user's hand is stationary, and to collect a capacitance change signal generated by a change in the user's hand motion.
  • the acquisition module 110 needs to open the finger five fingers on the touch panel when collecting the capacitance signal.
  • the three-dimensional virtual hand construction module 140 is configured to construct a three-dimensional virtual hand on the user interface that is consistent with or equal to the size and shape of the user's hand according to the capacitance signal.
  • the capacitance state of the area covered by the user's hand on the touch panel changes, and according to the shape of the area, the overall contour information of the user's hand can be obtained, thereby constructing A three-dimensional virtual hand with a consistent shape of the user's hand.
  • the joint position information of the user's hand and the position information of the palm recess may be acquired. Specifically, when the user puts the five fingers apart on the touchpad, the palm recess and the finger joint are more distant from the touchpad, and the other parts of the palm are more closely attached to the touchpad.
  • the capacitance corresponding to the area covered by the finger joint and the palm recess on the touchpad is smaller than the capacitance of the area covered by the finger and the palm of the touchpad, so as to confirm that the area corresponding to the finger joint and the palm recess is in the user's hand.
  • the position of the covered area can be used to know the position of the joint of the user's hand and the position of the palm recess.
  • a three-dimensional virtual hand that is exactly the same as the shape and size of the user's hand can be constructed, or a three-dimensional virtual hand that is appropriately scaled according to the size of the user interface can be constructed.
  • the three-dimensional virtual hand control module 120 controls the three-dimensional virtual hand of the user interface according to the collected capacitance change signal, so that the action of the three-dimensional virtual hand is consistent with the user's hand motion.
  • the processing module 130 performs a corresponding operation according to the operation of the three-dimensional virtual hand on the user interface.
  • the three-dimensional virtual hand control module 120 and the processing module 130 have been described in detail in the first embodiment of the operation control device of the user interface of the present invention, and thus will not be described herein.
  • the embodiment of the present invention constructs a three-dimensional virtual hand consistent with the user's hand motion on the user interface, so that the user can directly control the user interface through the three-dimensional virtual hand in the user interface; since the user controls the user interface through the three-dimensional virtual hand operation, Therefore, the realism of the user's vision and touch can be improved at the same time, and the user experience is improved.
  • FIG. 6, is a schematic structural diagram of an embodiment of the processing module in FIG.
  • the processing module 130 includes:
  • the control command detecting unit 131 is configured to determine a control command issued by the user to the user interface by detecting an operation of the user interface by the user through the three-dimensional virtual hand.
  • the user's various operations on the user interface through the three-dimensional virtual hand will have its own unique action characteristics, by extracting the action feature information of the current operation of the three-dimensional virtual hand, and pre-existing the action features in the database (in the database) Each action feature is matched against a control command to determine the control command issued by the user to the user interface.
  • the movement track information of the fingertip on the touchpad can be obtained.
  • the direction of rotation and the arc of rotation of the fingertip can be obtained, and then the direction and curvature of the user's desired user interface can be determined.
  • the palm is raised, the fingertips of the five fingers are folded on the touchpad (or close to the touchpad), and the five-finger fingertips are on the touchpad accordingly.
  • the motion trajectory is five straight line segments, and the straight lines of the five line segments are all at one point. By obtaining the length of any one of the line segments, it can be determined that the user desires to reduce the radiance of the user interface.
  • the user's hand When the user's hand is zoomed on the touchpad, its unique motion characteristics will usually be: The palm is raised, and the fingertips of the five fingers are opened outward on the touchpad (or close to the touchpad), and the fingertips are touched accordingly.
  • the motion trajectory on the board is five straight lines, and the straight lines of the five line segments are all at one point. By obtaining the length of any one of the line segments, the user desires to enlarge the radiance of the user interface.
  • the user When the user needs to operate a certain three-dimensional function option in the user interface, usually, the user puts the three-dimensional virtual hand in the user interface in the position of the three-dimensional function option by hand motion, so that It is possible to determine which one of the three-dimensional function options that the user desires to operate.
  • the user's operation for requesting the function corresponding to the three-dimensional function option includes: clicking, pressing, and the like.
  • the unique action feature is: The index finger or the middle finger is lifted up and then lowered, which correspondingly causes the capacitance of the area clicked by the user's finger on the touch panel to become smaller and then larger. Therefore, according to the change of the capacitance on the touch panel, the function corresponding to the three-dimensional function option that the user desires to perform is determined, and combined with the position of the three-dimensional virtual hand in the user interface, it is determined which function option the user desires to perform. .
  • the capacitance of the area pressed by the user's finger on the touch panel may be greater than the capacitance of other areas on the touch panel, thereby determining that the user desires to perform according to the state of the capacitance on the touch panel.
  • the function corresponding to the 3D function option combined with the position of the 3D virtual hand in the user interface, determines which function option the user desires to perform.
  • the user's operation of rotating, dragging, enlarging, and reducing the 3D function options is roughly the same as the user's operation of rotating, dragging, zooming in, and reducing the user interface. The only difference is the magnitude of the motion, which can be differentiated according to the magnitude of the motion.
  • the five-finger opening is usually larger, and when the user rotates a certain three-dimensional function option in the user interface, the five-finger opening is usually smaller, and the same five-finger fingertip is analyzed.
  • the motion track on the touchpad can accurately obtain the amplitude of the five-finger opening of the user, so that the amplitude value can be compared with the preset amplitude value.
  • the value is greater than the preset amplitude value, the user is expected to rotate the entire user interface. ; When it is less than the preset amplitude value, the user is expected to rotate the 3D function option.
  • the executing unit 132 is configured to perform a corresponding operation according to the determined control command issued by the user to the user interface.
  • the storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本发明实施例公开了一种用户界面的操作控制方法，包括：采集由用户手部动作的变化而产生的电容变化信号；根据采集的电容变化信号，控制用户界面的三维虚拟手，使三维虚拟手的动作与用户手部动作一致；根据三维虚拟手对用户界面的操作，执行相应的操作。本发明实施例还公开了一种用户界面的操作控制装置。采用本发明，可以让用户灵活和方便的控制用户界面，提高用户体验。

Description

一种用户界面的操作控制方法及装置 技术领域
本发明涉及触摸控制领域， 尤其涉及一种用户界面的操作控制方法及装置。 背景技术
目前， 触摸式的用户界面控制方法大致分为两类： 一是用户通过手指直接 在用户界面显示屏上进行触摸点选， 二是用户通过在触摸感应装置上进行触摸 操作来远程遥控用户界面， 这两类方法都只能让用户通过一两个手指作出点击、 滑动等简单的触摸操作、 操作方法过于单一， 缺乏用户和用户界面的之间互动， 用户体验不佳。 发明内容
本发明实施例所要解决的技术问题在于， 提供一种用户界面的操作控制方 法及装置， 可以让用户灵活和方便的控制用户界面， 提高用户体验。
为了解决上述技术问题， 本发明实施例提供了一种用户界面的操作控制方 法， 包括：
采集由用户手部动作的变化而产生的电容变化信号；
根据所述采集的电容变化信号， 控制用户界面的三维虚拟手， 使所述三维 虚拟手的动作与所述用户手部动作一致；
根据所述三维虚拟手对所述用户界面的操作， 执行相应的操作。
其中， 所述三维虚拟手对用户界面的操作包括： 旋转所述用户界面的操作、 拖拽所述用户界面的操作、 缩小所述用户界面的操作和放大所述用户界面的操 作中的至少一项。
其中， 所述用户界面还包括： 至少一个三维式的功能选项；
所述三维虚拟手对用户界面的操作还包括： 用于请求执行所述功能选项所 对应的功能的操作。
其中， 所述三维虚拟手与所述用户手部的大小、 形状一致或者等比例缩放。 其中， 所述采集由用户手部动作的变化而产生的电容变化信号之前， 还包 采集当所述用户手部静止时的电容信号；
根据所述电容信号， 在所述用户界面上构造与所述用户手部的大小、 形状 一致或者等比例缩放的三维虚拟手。
相应地， 本发明实施例还提供了一种用户界面的操作控制装置， 包括： 采集模块， 用于采集由用户手部动作的变化而产生的电容变化信号； 三维虚拟手控制模块， 用于根据所述采集的电容变化信号， 控制用户界面 的三维虚拟手， 使所述三维虚拟手的动作与所述用户手部动作一致；
处理模块， 用于根据所述三维虚拟手对所述用户界面的操作， 执行相应的 操作。
其中， 所述三维虚拟手对用户界面的操作包括： 旋转所述用户界面的操作、 拖拽所述用户界面的操作、 缩小所述用户界面的操作和放大所述用户界面的操 作中的至少一项。
其中， 所述用户界面还包括： 至少一个三维式的功能选项；
所述三维虚拟手对用户界面的操作还包括： 用于请求执行所述功能选项所 对应的功能的操作。
其中， 所述三维虚拟手与所述用户手部的大小、 形状一致或者等比例缩放。 其中， 所述采集模块还用于采集当所述用户手部静止时的电容信号， 所述 装置还包括： 构造模块， 所述构造模块用于根据所述采集模块采集的电容信号， 在所述用户界面上构造与所述用户手部的大小、 形状一致或者等比例缩放的三 维虚拟手。
实施本发明实施例， 具有如下有益效果：
本发明的实施例通过在用户界面上构建出与用户手部动作一致的三维虚拟 手， 使得用户可以通过用户界面中的三维虚拟手直接控制用户界面； 由于用户 通过三维虚拟手操作控制用户界面， 因此可以同时提高用户视觉和触觉的真实 度， 提高用户体验度。 附图说明
为了更清楚地说明本发明实施例或现有技术中的技术方案， 下面将对实施 例或现有技术描述中所需要使用的附图作简单地介绍， 显而易见地， 下面描述 中的附图仅仅是本发明的一些实施例， 对于本领域普通技术人员来讲， 在不付 出创造性劳动的前提下， 还可以根据这些附图获得其他的附图。
图 1是本发明的用户界面的操作控制方法的第一实施例的流程示意图； 图 2是本发明的用户界面的操作控制方法的第二实施例的流程示意图； 图 3是本发明的用户界面的操作控制方法的第三实施例的流程示意图； 图 4是本发明的用户界面的操作控制装置的第一实施例的结构示意图； 图 5是本发明的用户界面的操作控制装置的第二实施例的结构示意图； 图 6是图 4中的处理模块的实施例的结构示意图。 具体实施方式
下面将结合本发明实施例中的附图， 对本发明实施例中的技术方案进行清 楚、 完整地描述， 显然， 所描述的实施例仅仅是本发明一部分实施例， 而不是 全部的实施例。 基于本发明中的实施例， 本领域普通技术人员在没有作出创造 性劳动前提下所获得的所有其他实施例， 都属于本发明保护的范围。
请参照图 1 ,是本发明的用户界面的操作控制方法的第一实施例的流程示意 图。 所述方法包括：
步骤 S 11 , 采集由用户手部动作的变化而产生的电容变化信号。
其中， 步骤 S11 中用户手部动作的采集可以由电容式的触摸感应器实现， 例如： 由具有较大采集面积的电容式触摸板实现， 通常电容式触摸板的面积大 于普通人手部的面积， 并且可以在电容式触摸板上设置供用户手部休息的休息 区。
具体地， 当用户的手部在电容式触摸板中动作时， 将引起电容式触摸板表 面电容的变化。 由用户手部动作的变化而产生的电容变化信号， 可以反映用户 的手部动作的变化。
通常情况下， 电容式触摸板的灵敏度越高、 用户手部与电容式触摸板接触 起紧凑时， 采集效果越好。
步骤 S12, 根据采集的电容变化信号， 控制用户界面的三维虚拟手， 使所述 三维虚拟手的动作与用户手部动作一致。
为了更好的提高用户的视觉体验， 用户界面可以设计成为虚拟三维式的。 应该注意的是， 三维虚拟手在虚拟三维式的用户界面中动作幅度与用户手部动 作幅度一致或是等比例缩放。 其中， 由于步骤 Sl l 中采集的电容变化信号能够反映用户手部动作的变化 情况， 因此步骤 S12通过分析采集的电容变化信号， 可以得到用户手部动作的 变化， 进而将用户手部动作的变化通过用户界面中的三维虚拟手表示出来。
具体地， 当用户的手部在垂直于触摸板的方向上发生位置改变时， 由于用 户手部越靠近触摸板， 相应地触摸板上的电容信号变化越大， 用户手部越发远 离触摸板， 相应地触摸板上的电容信号变化越小， 那么就可以根据电容信号的 变化程度和变化趋势（变大或变小） 来确定用户手部在垂直方向上发生的位移 及方向 （向下或向上） ， 然后便可以控制三维虚拟手在虚拟三维式的用户界面 中做出相同的运动。
当用户的手部在平行于触摸板的某一平面上发生位置改变时， 触摸板上用 户手部移动时所经过的区域的电容状态均会发生改变， 通过确认这些电容状态 发生改变的区域上的点在触摸板上的位置坐标， 便可以得知用户手部在平行于 触摸板的平面上的运动轨迹， 然后就可以控制三维虚拟手在虚拟三维式的用户 界面中做出具有相同运动轨迹的运动。
步骤 S13 , 根据三维虚拟手对用户界面的操作， 执行相应的操作。
通过步骤 S11 -步骤 S12实现了用户通过三维虚拟手对用户界面的操作，通 常三维虚拟手对用户界面的操作包括： 旋转用户界面的操作、 拖拽用户界面的 操作、 缩小用户界面的操作和放大用户界面的操作中的至少一项。
其中， 三维虚拟手旋转用户界面的操作可以是五指绕着手掌心转动一个角 度， 执行相应的操作可以是根据五指的旋转方向及旋转弧度， 旋转整个用户界 面； 拖拽用户界面的操作可以是五指按住或捏住或抓住用户界面朝某个方向移 动， 执行相应的操作可以是根据三维虚拟手的拖拽方向及拖拽位移， 移动整个 用户界面； 缩小用户界面操作可以是五指收拢， 执行相应的操作可以是根据三 维虚拟手五指收拢的幅度， 缩小整个用户界面； 放大用户界面的操作可以是五 指张开， 执行相应的操作可以是根据三维虚拟手五指张开的幅度， 放大整个用 户界面。
此外， 用户界面还包括： 至少一个三维式的功能选项。 相应地， 三维虚拟 手对用户界面的操作还包括： 旋转三维式功能选项的操作、 拖拽三维式功能选 项的操作、 缩小三维式功能选项的操作和放大三维式功能选项的操作、 以及用 于请求执行功能选项所对应的功能的操作。 其中， 三维式的功能选项可以是三 维立体图形， 每个三维立体图形可以对应一个或多个功能选项。 用于请求执行 功能选项所对应的功能的操作包括： 拖拽、 点击、 按等。
三维虚拟手旋转三维式功能选项的操作可以是五指绕着该三维式功能选项 转动一个角度， 执行相应的操作可以是根据五指的旋转方向及旋转弧度， 旋转 整个三维式功能选项； 拖拽三维式功能选项的操作可以是五指按住或捏住或抓 住三维式功能选项朝某个方向移动， 执行相应的操作可以是根据三维虚拟手的 拖拽方向及拖拽位移， 移动该三维式功能选项； 缩小三维式功能选项操作可以 是五指以该三维式功能选项为中心朝里收拢， 执行相应的操作可以是根据三维 虚拟手五指收拢的幅度， 缩小整个三维式功能选项； 放大三维式功能选项的操 作可以是五指以该三维式功能选项为中心向外张开， 执行相应的操作可以是根 据三维虚拟手五指张开的幅度， 放大整个三维式功能选项。
本发明的实施例通过在用户界面上构建出与用户手部动作一致的三维虚拟 手， 使得用户可以通过用户界面中的三维虚拟手直接控制用户界面； 由于用户 通过三维虚拟手操作控制用户界面， 因此可以同时提高用户视觉和触觉的真实 度， 提高用户体验度。
请参照图 2,是本发明的用户界面的操作控制方法的第二实施例的流程示意 图。 所述方法包括：
步骤 S21 , 采集当用户手部静止时的电容信号。
为了更好的获取用户的手部的大小、 及形状信息， 需要用户将手五指张开 平放在触摸板上。
步骤 S22, 根据电容信号， 在用户界面上构造与所述用户手部的大小、 形状 一致或者等比例缩放的三维虚拟手。
当用户将手五指张开平放在触摸板上时， 触摸板上用户手部所覆盖区域的 电容状态会发生改变， 根据该区域的形状， 便能得到用户手部的整体轮廓信息， 从而构造出与用户手部形状一致的三维虚拟手。
进一步地， 为了提高三维虚拟手的逼真度， 还可以获取用户手部的关节位 置信息及掌心凹陷处的位置信息。 具体地， 通常当用户将手五指分开平放在触 摸板时掌心凹陷处和手指关节处与触摸板则会贴得较为疏远， 而手掌其它部位 则会与触摸板贴得较为紧密， 这就会导致触摸板上手指关节处和掌心凹陷处所 覆盖区域相应地电容要比触摸板上手指、 手掌所覆盖区域的电容要小， 以此来 确认手指关节处和掌心凹陷处所对应的区域在用户手部所覆盖区域的位置， 便 能得知用户手部的关节位置及掌心凹陷处位置。 利用以上获取的掌心凹陷处位 置和各手指关节位置， 便可以构建出与用户手部形状、 大小完全一致的三维虚 拟手， 或者构建出根据用户界面的大小适当比例缩放的三维虚拟手。
步骤 S23 , 采集由用户手部动作的变化而产生的电容变化信号。
步骤 S24, 根据采集的电容变化信号， 控制用户界面的三维虚拟手， 使所述 三维虚拟手的动作与用户手部动作一致。
步骤 S25 , 根据三维虚拟手对用户界面的操作， 执行相应的操作。
步骤 S23至步骤 S25与本发明用户界面的操作控制方法的第一实施例中的 步骤 S1 1至步骤 S13相同， 故在些不做赞述。
本发明的实施例通过在用户界面上构建出与用户手部动作一致的三维虚拟 手， 使得用户可以通过用户界面中的三维虚拟手直接控制用户界面； 由于用户 通过三维虚拟手操作控制用户界面， 因此可以同时提高用户视觉和触觉的真实 度， 提高用户体验度。
请参照图 3 ,是本发明的用户界面的操作控制方法的第三实施例的流程示意 图。 所述方法包括：
步骤 S31 , 采集由用户手部动作的变化而产生的电容变化信号。
步骤 S32, 根据采集的电容变化信号， 控制用户界面的三维虚拟手， 使所述 三维虚拟手的动作与用户手部动作一致。
步骤 S31至步骤 S32与本发明用户界面的操作控制方法的第一实施例中的 步骤 S1 1至步骤 S12相同， 故在此不做赞述。
步骤 S33 ,通过检测用户通过三维虚拟手对用户界面的操作，确定用户对用 户界面下达的控制命令。
通常三维虚拟手对用户界面的操作包括： 旋转用户界面的操作、 拖拽用户 界面的操作、 缩小用户界面的操作和放大用户界面的操作中的至少一项。
此外， 用户界面还包括： 至少一个三维式的功能选项。 相应地， 三维虚拟 手对用户界面的操作还包括： 旋转三维式功能选项的操作、 拖拽三维式功能选 项的操作、 缩小三维式功能选项的操作和放大三维式功能选项的操作、 以及用 于请求执行功能选项所对应的功能的操作。
其中， 三维式的功能选项可以是三维立体图形， 每个三维立体图形可以对 应一个或多个功能选项。 用于请求执行功能选项所对应的功能的操作包括： 点 击、 按等。
通常情况下， 用户通过三维虚拟手对用户界面的各种操作都会有其特有的 动作特征， 通过提取三维虚拟手的当前操作的动作特征信息， 并将其与数据库 中预存的动作特征（数据库中每一动作特征都会对应一控制命令）进行匹配， 从而确定用户对用户界面下达的控制命令。
例如 ， 用户手部在触摸板上做旋转操作时， 其特有的动作特征通常会是： 手掌心抬起， 五指指尖在触摸板上 (或贴近触摸板)绕着手掌心转动。 可以根据触 摸板上电容的变化， 获取五指指尖在触摸板上的运动轨迹信息。 通过分析某一 指尖 （或者综合分析多根指尖）在触摸板上的运动轨迹便可以获取该指尖的旋 转方向及旋转弧度， 进而便能确定用户期望旋转用户界面的方向及弧度。
用户手部在触摸板上做拖拽操作时， 其特有的动作特征通常会是： 一根或 几根手指指尖按在触摸板上朝某一方向直线移动。 同样的根据触摸板上电容的 变化， 获取指尖在触摸板上的运动轨迹信息 （通常该运动轨迹趋向于直线） ， 通过分析直线运动轨迹的长度及方向， 便能确定用户期望用户界面移动的方向 及距离。
用户手部在触摸板上做缩小操作时， 其特有的动作特征通常会是： 掌心抬 起， 五指指尖在触摸板上 (或贴近触摸板)收拢， 相应地五指指尖在触摸板上的运 动轨迹则是五条直线段， 且五条线段所在的直线均交于一点， 通过获取其中任 一条线段的长度， 便能确定用户期望缩小用户界面的辐度。
用户手部在触摸板上做放大操作时， 其特有的动作特征通常会是： 掌心抬 起， 五指指尖在触摸板上 (或贴近触摸板)向外张开， 相应地五指指尖在触摸板上 的运动轨迹则是五条直线段， 且五条线段所在的直线均交于一点， 通过获取其 中任一条线段的长度， 便能确定用户期望放大用户界面的辐度。
当用户需要对用户界面中的某一三维式功能选项做出操作时， 通常情况下， 用户会通过手部动作将用户界面中的三维虚拟手放在该三维式功能选项所在的 位置， 如此便能确定用户期望操作的三维式功能选项具体是哪一个。
通常用户在请求执行三维式功能选项所对应的功能的操作包括： 点击、 按 等。 当用户在触摸板上做出点击动作时， 其特有的动作特征是： 食指或中指抬 起再放下， 相应地会导致触摸板上用户手指所点击的区域的电容会先变小后变 大。 由此根据触摸板上电容的变化， 确定用户期望执行的三维式功能选项所对 应的功能， 再结合三维虚拟手在用户界面中所点击的位置， 便能确定用户期望 执行的是哪一个功能选项。 当用户在触摸板上做出按动作时， 相应地触摸板上 用户手指所按的区域的电容会大于触摸板上其它区域的电容， 由此通过根据触 摸板上电容的状态， 确定用户期望执行的三维式功能选项所对应的功能， 再结 合三维虚拟手在用户界面中所按的位置， 便能确定用户期望执行的是哪一个功 能选项。
用户旋转、 拖拽、 放大、 缩小三维式功能选项的操作与用户旋转、 拖拽、 放大、 缩小用户界面的操作大致相同， 不同之处只在于动作幅度的大小， 可以 根据动作幅度的大小来区分是对整个用户界面或只是某一三维式功能选项的操 作。 例如， 用户在旋转用户界面时， 通常五指张开的幅度较大， 而用户在旋转 用户界面中的某一三维式功能选项时， 通常五指张开的幅度较小， 同样的通过 分析五指指尖在触摸板上的运动轨迹便能准确获取用户五指张开的幅度， 如此 可以将该幅度值与预设的幅度值进行比较， 大于预设幅度值时， 则认为用户期 望的是旋转整个用户界面； 小于预设幅度值时， 则认为用户期望的是旋转三维 式功能选项。
步骤 S34, 根据确定的用户对用户界面下达的控制命令， 执行相应的操作。 本发明的实施例通过在用户界面上构建出与用户手部动作一致的三维虚拟 手， 使得用户可以通过用户界面中的三维虚拟手直接控制用户界面； 由于用户 通过三维虚拟手操作控制用户界面， 因此可以同时提高用户视觉和触觉的真实 度， 提高用户体验度。
请参照图 4,是本发明的用户界面的操作控制装置的第一实施例的结构示意 图。 所述装置包括：
采集模块 110, 用于采集由用户手部动作的变化而产生的电容变化信号。 其中， 采集模块的功能可以由电容式的触摸感应器实现， 例如： 由具有较 大采集面积的电容式触摸板实现， 通常电容式触摸板的面积大于普通人手部的 面积， 并且可以在电容式触摸板上设置供用户手部休息的休息区。
具体地， 当用户的手部在电容式触摸板中动作时， 将引起电容式触摸板表 面电容的变化。 由用户手部动作的变化而产生的电容变化信号， 可以反映用户 的手部动作的变化。 通常情况下， 电容式触摸板的灵敏度越高、 用户手部与电容式触摸板接触 起紧凑时， 采集效果越好。
三维虚拟手控制模块 120, 根据采集的电容变化信号， 控制用户界面的三维 虚拟手， 使所述三维虚拟手的动作与用户手部动作一致。
为了更好的提高用户的视觉体验， 用户界面可以设计成为虚拟三维式的。 应该注意的是， 三维虚拟手在虚拟三维式的用户界面中动作幅度与用户手部动 作幅度一致或是等比例缩放。
其中， 由采集模块 110 中采集的电容变化信号能够反映用户手部动作的变 化情况， 因此三维虚拟手控制模块 120通过分析采集的电容变化信号， 可以得 到用户手部动作的变化， 进而将用户手部动作的变化通过用户界面中的三维虚 拟手表示出来。
具体地， 当用户的手部在垂直于触摸板的方向上发生位置改变时， 由于用 户手部越靠近触摸板， 相应地触摸板上的电容信号变化越大， 用户手部越发远 离触摸板， 相应地触摸板上的电容信号变化越小， 那么就可以根据电容信号的 变化程度和变化趋势（变大或变小） 来确定用户手部在垂直方向上发生的位移 及方向 （向下或向上） ， 然后便可以控制三维虚拟手在虚拟三维式的用户界面 中做出相同的运动。
当用户的手部在平行于触摸板的某一平面上发生位置改变时， 触摸板上用 户手部移动时所经过的区域的电容状态均会发生改变， 通过确认这些电容状态 发生改变的区域上的点在触摸板上的位置坐标， 便可以得知用户手部在平行于 触摸板的平面上的运动轨迹， 然后就可以控制三维虚拟手在虚拟三维式的用户 界面中做出具有相同运动轨迹的运动。
处理模块 130, 用于根据三维虚拟手对用户界面的操作， 执行相应的操作。 通常三维虚拟手对用户界面的操作包括： 旋转用户界面的操作、 拖拽用户 界面的操作、 缩小用户界面的操作和放大用户界面的操作中的至少一项。
其中， 三维虚拟手旋转用户界面的操作可以是五指绕着手掌心转动一个角 度， 执行相应的操作可以是根据五指的旋转方向及旋转弧度， 旋转整个用户界 面； 拖拽用户界面的操作可以是五指按住或捏住或抓住用户界面朝某个方向移 动， 执行相应的操作可以是根据三维虚拟手的拖拽方向及拖拽位移， 移动整个 用户界面； 缩小用户界面操作可以是五指收拢， 执行相应的操作可以是根据三 维虚拟手五指收拢的幅度， 缩小整个用户界面； 放大用户界面的操作可以是五 指张开， 执行相应的操作可以是根据三维虚拟手五指张开的幅度， 放大整个用 户界面。
此外， 用户界面还包括： 至少一个三维式的功能选项。 相应地， 三维虚拟 手对用户界面的操作还包括： 旋转三维式功能选项的操作、 拖拽三维式功能选 项的操作、 缩小三维式功能选项的操作和放大三维式功能选项的操作、 以及用 于请求执行功能选项所对应的功能的操作。 其中， 三维式的功能选项可以是三 维立体图形， 每个三维立体图形可以对应一个或多个功能选项。 用于请求执行 功能选项所对应的功能的操作包括： 拖拽、 点击、 按等。
三维虚拟手旋转三维式功能选项的操作可以是五指绕着该三维式功能选项 转动一个角度， 执行相应的操作可以是根据五指的旋转方向及旋转弧度， 旋转 整个三维式功能选项； 拖拽三维式功能选项的操作可以是五指按住或捏住或抓 住三维式功能选项朝某个方向移动， 执行相应的操作可以是根据三维虚拟手的 拖拽方向及拖拽位移， 移动该三维式功能选项； 缩小三维式功能选项操作可以 是五指以该三维式功能选项为中心朝里收拢， 执行相应的操作可以是根据三维 虚拟手五指收拢的幅度， 缩小整个三维式功能选项； 放大三维式功能选项的操 作可以是五指以该三维式功能选项为中心向外张开， 执行相应的操作可以是根 据三维虚拟手五指张开的幅度， 放大整个三维式功能选项。
本发明的实施例通过在用户界面上构建出与用户手部动作一致的三维虚拟 手， 使得用户可以通过用户界面中的三维虚拟手直接控制用户界面； 由于用户 通过三维虚拟手操作控制用户界面， 因此可以同时提高用户视觉和触觉的真实 度， 提高用户体验度。
请参照图 5 ,是本发明的用户界面的操作控制装置的第二实施例的结构示意 图。 所述装置 100包括：
采集模块 110, 用于采集当用户手部静止时的电容信号， 以及用于采集由用 户手部动作的变化而产生的电容变化信号。
为了更好的获取用户的手部的大小、 及形状信息， 采集模块 110在采集电 容信号时需要用户将手五指张开平放在触摸板上。
三维虚拟手构造模块 140, 用于根据电容信号， 在用户界面上构造与所述用 户手部的大小、 形状一致或者等比例 放的三维虚拟手。 当用户将手五指张开平放在触摸板上时， 触摸板上用户手部所覆盖区域的 电容状态会发生改变， 根据该区域的形状， 便能得到用户手部的整体轮廓信息， 从而构造出与用户手部形状一致的三维虚拟手。
进一步地， 为了提高三维虚拟手的逼真度， 还可以获取用户手部的关节位 置信息及掌心凹陷处的位置信息。 具体地， 通常当用户将手五指分开平放在触 摸板时掌心凹陷处和手指关节处与触摸板则会贴得较为疏远， 而手掌其它部位 则会与触摸板贴得较为紧密， 这就会导致触摸板上手指关节处和掌心凹陷处所 覆盖区域相应地电容要比触摸板上手指、 手掌所覆盖区域的电容要小， 以此来 确认手指关节处和掌心凹陷处所对应的区域在用户手部所覆盖区域的位置， 便 能得知用户手部的关节位置及掌心凹陷处位置。 利用以上获取的掌心凹陷处位 置和各手指关节位置， 便可以构建出与用户手部形状、 大小完全一致的三维虚 拟手， 或者构建出根据用户界面的大小适当比例缩放的三维虚拟手。
三维虚拟手控制模块 120, 根据采集的电容变化信号， 控制用户界面的三维 虚拟手， 使所述三维虚拟手的动作与用户手部动作一致。
处理模块 130, 根据三维虚拟手对用户界面的操作， 执行相应的操作。
三维虚拟手控制模块 120和处理模块 130已在本发明用户界面的操作控制 装置的第一实施例作了详细的介绍， 故在此不作贅述。
本发明的实施例通过在用户界面上构建出与用户手部动作一致的三维虚拟 手， 使得用户可以通过用户界面中的三维虚拟手直接控制用户界面； 由于用户 通过三维虚拟手操作控制用户界面， 因此可以同时提高用户视觉和触觉的真实 度， 提高用户体验度。
请参照图 6, 是图 4中处理模块的实施例的结构示意图。 所述处理模块 130 包括：
控制命令检测单元 131 ,用于通过检测用户通过三维虚拟手对用户界面的操 作， 确定用户对用户界面下达的控制命令。
通常情况下， 用户通过三维虚拟手对用户界面的各种操作都会有其特有的 动作特征， 通过提取三维虚拟手的当前操作的动作特征信息， 并将其与数据库 中预存的动作特征（数据库中每一动作特征都会对应一控制命令）进行匹配， 从而确定用户对用户界面下达的控制命令。
例如 ， 用户手部在触摸板上做旋转操作时， 其特有的动作特征通常会是： 手掌心抬起， 五指指尖在触摸板上 (或贴近触摸板)绕着手掌心转动。 可以根据 触摸板上电容的变化， 获取五指指尖在触摸板上的运动轨迹信息。 通过分析某 一指尖 （或者综合分析多根指尖）在触摸板上的运动轨迹便可以获取该指尖的 旋转方向及旋转弧度， 进而便能确定用户期望旋转用户界面的方向及弧度。
用户手部在触摸板上做拖拽操作时， 其特有的动作特征通常会是： 一根或 几根手指指尖按在触摸板上朝某一方向直线移动。 同样的根据触摸板上电容的 变化， 获取指尖在触摸板上的运动轨迹信息 （通常该运动轨迹趋向于直线） ， 通过分析直线运动轨迹的长度及方向， 便能确定用户期望用户界面移动的方向 及距离。
用户手部在触摸板上做缩小操作时， 其特有的动作特征通常会是： 掌心抬 起， 五指指尖在触摸板上 (或贴近触摸板)收拢， 相应地五指指尖在触摸板上的运 动轨迹则是五条直线段， 且五条线段所在的直线均交于一点， 通过获取其中任 一条线段的长度， 便能确定用户期望缩小用户界面的辐度。
用户手部在触摸板上做放大操作时， 其特有的动作特征通常会是： 掌心抬 起， 五指指尖在触摸板上 (或贴近触摸板)向外张开， 相应地五指指尖在触摸板上 的运动轨迹则是五条直线段， 且五条线段所在的直线均交于一点， 通过获取其 中任一条线段的长度， 便能确定用户期望放大用户界面的辐度。
当用户需要对用户界面中的某一三维式功能选项做出操作时， 通常情况下， 用户会通过手部动作将用户界面中的三维虚拟手放在该三维式功能选项所在的 位置， 如此便能确定用户期望操作的三维式功能选项具体是哪一个。
通常用户在请求执行三维式功能选项所对应的功能的操作包括： 点击、 按 等。 当用户在触摸板上做出点击动作时， 其特有的动作特征是： 食指或中指抬 起再放下， 相应地会导致触摸板上用户手指所点击的区域的电容会先变小后变 大。 由此根据触摸板上电容的变化， 确定用户期望执行的三维式功能选项所对 应的功能， 再结合三维虚拟手在用户界面中所点击的位置， 便能确定用户期望 执行的是哪一个功能选项。 当用户在触摸板上做出按动作时， 相应地触摸板上 用户手指所按的区域的电容会大于触摸板上其它区域的电容， 由此通过根据触 摸板上电容的状态， 确定用户期望执行的三维式功能选项所对应的功能， 再结 合三维虚拟手在用户界面中所按的位置， 便能确定用户期望执行的是哪一个功 能选项。 用户旋转、 拖拽、 放大、 缩小三维式功能选项的操作与用户旋转、 拖拽、 放大、 缩小用户界面的操作大致相同， 不同之处只在于动作幅度的大小， 可以 根据动作幅度的大小来区分是对整个用户界面或只是某一三维式功能选项的操 作。 例如， 用户在旋转用户界面时， 通常五指张开的幅度较大， 而用户在旋转 用户界面中的某一三维式功能选项时， 通常五指张开的幅度较小， 同样的通过 分析五指指尖在触摸板上的运动轨迹便能准确获取用户五指张开的幅度， 如此 可以将该幅度值与预设的幅度值进行比较， 大于预设幅度值时， 则认为用户期 望的是旋转整个用户界面； 小于预设幅度值时， 则认为用户期望的是旋转三维 式功能选项。
执行单元 132, 用于根据确定的用户对用户界面下达的控制命令，执行相应 的操作。
本发明在上述实施例中所提及的旋转、 拖拽、 缩小、 放大、 点击等操作都 只是作为举例说明， 在本发明的实施例中， 还可以包括其它界面操作。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程， 是可以通过计算机程序来指令相关的硬件来完成， 所述的程序可存储于一计算 机可读取存储介质中， 该程序在执行时， 可包括如上述各方法的实施例的流程。 其中， 所述的存储介质可为磁碟、 光盘、 只读存储记忆体（Read-Only Memory, ROM )或随机存储记忆体（Random Access Memory, RAM )等。
以上所揭露的仅为本发明一种较佳实施例而已， 当然不能以此来限定本发 明之权利范围， 本领域普通技术人员可以理解实现上述实施例的全部或部分流 程， 并依本发明权利要求所作的等同变化， 仍属于发明所涵盖的范围。

Claims

1、 一种用户界面的操作控制方法， 其特征在于， 包括：
采集由用户手部动作的变化而产生的电容变化信号；
根据所述采集的电容变化信号， 控制用户界面的三维虚拟手， 使所述三维 虚拟手的动作与所述用户手部动作一致；
根据所述三维虚拟手对所述用户界面的操作， 执行相应的操作。
2、 如权利要求 1所述的方法， 其特征在于， 所述三维虚拟手对用户界面的 操作包括： 旋转所述用户界面的操作、 拖拽所述用户界面的操作、 缩小所述用 户界面的操作和放大所述用户界面的操作中的至少一项。
3、 如权利要求 2所述的方法， 其特征在于， 所述用户界面还包括： 至少一 个三维式的功能选项；
所述三维虚拟手对用户界面的操作还包括： 用于请求执行所述功能选项所 对应的功能的操作。
4、 如权利要求 1-3中任一项所述的方法， 其特征在于， 所述三维虚拟手与 所述用户手部的大小、 形状一致或者等比例缩放。
5、 如权利要求 4所述的方法， 其特征在于， 所述采集由用户手部动作的变 化而产生的电容变化信号之前， 还包括：
采集当所述用户手部静止时的电容信号；
根据所述电容信号， 在所述用户界面上构造与所述用户手部的大小、 形状 一致或者等比例缩放的三维虚拟手。
6、 一种用户界面的操作控制装置， 其特征在于， 包括：
采集模块， 用于采集由用户手部动作的变化而产生的电容变化信号； 三维虚拟手控制模块， 用于根据所述采集的电容变化信号， 控制用户界面 的三维虚拟手， 使所述三维虚拟手的动作与所述用户手部动作一致； 处理模块， 用于根据所述三维虚拟手对所述用户界面的操作， 执行相应的 操作。
7、 如权利要求 6所述的装置， 其特征在于， 所述三维虚拟手对用户界面的 操作包括： 旋转所述用户界面的操作、 拖拽所述用户界面的操作、 缩小所述用 户界面的操作和放大所述用户界面的操作中的至少一项。
8、 如权利要求 6所述的装置， 其特征在于， 所述用户界面还包括： 至少一 个三维式的功能选项；
所述三维虚拟手对用户界面的操作还包括： 用于请求执行所述功能选项所 对应的功能的操作。
9、 如权利要求 6-8中任一项所述的装置， 其特征在于， 所述三维虚拟手与 所述用户手部的大小、 形状一致或者等比例缩放。
10、 如权利要求 9所述的装置， 其特征在于， 所述采集模块还用于采集当 所述用户手部静止时的电容信号， 所述装置还包括： 构造模块， 所述构造模块 用于根据所述采集模块采集的电容信号， 在所述用户界面上构造与所述用户手 部的大小、 形状一致或者等比例缩放的三维虚拟手。
PCT/CN2012/086002 2012-04-06 2012-12-06 一种用户界面的操作控制方法及装置 WO2013149476A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201210098933.X 2012-04-06
CN201210098933XA CN102707878A (zh) 2012-04-06 2012-04-06 一种用户界面的操作控制方法及装置

Publications (1)

Publication Number Publication Date
WO2013149476A1 true WO2013149476A1 (zh) 2013-10-10

Family

ID=46900723

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2012/086002 WO2013149476A1 (zh) 2012-04-06 2012-12-06 一种用户界面的操作控制方法及装置

Country Status (2)

Country Link
CN (1) CN102707878A (zh)
WO (1) WO2013149476A1 (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102707878A (zh) * 2012-04-06 2012-10-03 深圳创维数字技术股份有限公司 一种用户界面的操作控制方法及装置
CN104298438B (zh) * 2013-07-17 2017-11-21 宏碁股份有限公司 电子装置及其触控操作方法
CN106293293A (zh) * 2016-07-29 2017-01-04 维沃移动通信有限公司 一种物体距离状态的检测方法及移动终端

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1462929A (zh) * 2002-05-20 2003-12-24 许旻 一种计算机输入系统
CN101739208A (zh) * 2008-11-25 2010-06-16 三星电子株式会社 提供用户界面的设备和方法
CN102707878A (zh) * 2012-04-06 2012-10-03 深圳创维数字技术股份有限公司 一种用户界面的操作控制方法及装置

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101666995B1 (ko) * 2009-03-23 2016-10-17 삼성전자주식회사 멀티 텔레포인터, 가상 객체 표시 장치, 및 가상 객체 제어 방법
TWI405104B (zh) * 2009-11-16 2013-08-11 Quanta Comp Inc 利用觸碰感測輸入裝置來翻轉三維圖形物件之方法
CN101866243A (zh) * 2010-07-09 2010-10-20 苏州瀚瑞微电子有限公司 三维空间触控操作的方法及其手势
CN102253713B (zh) * 2011-06-23 2016-10-12 康佳集团股份有限公司 面向三维立体影像显示系统

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1462929A (zh) * 2002-05-20 2003-12-24 许旻 一种计算机输入系统
CN101739208A (zh) * 2008-11-25 2010-06-16 三星电子株式会社 提供用户界面的设备和方法
CN102707878A (zh) * 2012-04-06 2012-10-03 深圳创维数字技术股份有限公司 一种用户界面的操作控制方法及装置

Also Published As

Publication number Publication date
CN102707878A (zh) 2012-10-03

Similar Documents

Publication Publication Date Title
US11816329B2 (en) Multitouch data fusion
US9348458B2 (en) Gestures for touch sensitive input devices
CN105117056B (zh) 一种操作触摸屏的方法和设备
US20120105367A1 (en) Methods of using tactile force sensing for intuitive user interface
KR101019128B1 (ko) 터치 패널 입력 장치, 방법 및 이를 이용한 모바일 기기
CN102662462A (zh) 电子装置、手势识别方法及手势应用方法
KR20160005656A (ko) 터치 감지 디바이스에서 터치 동작을 수행하는 방법
WO2015196703A1 (zh) 一种应用程序图标显示方法及装置
TW201248491A (en) Method of identifying palm area of a touch panel and a updating method thereof
TW201205417A (en) Method and device for determining a user's touch gesture
US20140160054A1 (en) Anchor-drag touch symbol recognition
KR20110066880A (ko) 터치-감지형 디스플레이를 사용하여 오브젝트를 복제하는 방법 및 시스템
WO2016026365A1 (zh) 实现非接触式鼠标控制的人机交互方法和系统
WO2013149475A1 (zh) 一种用户界面的控制方法及装置
Radhakrishnan et al. Finger-based multitouch interface for performing 3D CAD operations
CN107346206A (zh) 一种移动终端的操控方法及移动终端
CN103455262A (zh) 一种基于移动计算平台的笔式交互方法及系统
WO2013149476A1 (zh) 一种用户界面的操作控制方法及装置
JP2012022458A (ja) 情報処理装置およびその制御方法
CN104346095B (zh) 一种信息处理方法及电子设备
WO2012027014A1 (en) Single touch process to achieve dual touch experience field
WO2017101340A1 (zh) 多点触控调整视频窗口的方法及设备
CN103257724B (zh) 一种非接触式鼠标及其操作方法
CN106484175A (zh) 电子设备的用户接口、输入的处理方法以及电子设备
CN109144387A (zh) 一种光标触控方法及光标触控装置、数字示波器

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12873746

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205N DATED 04/03/2015)

122 Ep: pct application non-entry in european phase

Ref document number: 12873746

Country of ref document: EP

Kind code of ref document: A1