WO2015062017A1 - Procédé et appareil de traitement d'opération suspendue ou distante - Google Patents

Procédé et appareil de traitement d'opération suspendue ou distante Download PDF

Info

Publication number
WO2015062017A1
WO2015062017A1 PCT/CN2013/086309 CN2013086309W WO2015062017A1 WO 2015062017 A1 WO2015062017 A1 WO 2015062017A1 CN 2013086309 W CN2013086309 W CN 2013086309W WO 2015062017 A1 WO2015062017 A1 WO 2015062017A1
Authority
WO
WIPO (PCT)
Prior art keywords
operating object
terminal
screen
floating
air
Prior art date
Application number
PCT/CN2013/086309
Other languages
English (en)
Chinese (zh)
Inventor
甘元莉
孔建永
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to PCT/CN2013/086309 priority Critical patent/WO2015062017A1/fr
Priority to CN201380003120.0A priority patent/CN103858085A/zh
Priority to KR1020167013544A priority patent/KR20160077122A/ko
Priority to JP2016527395A priority patent/JP2016539413A/ja
Priority to EP13896370.7A priority patent/EP3054373A4/fr
Priority to US15/033,514 priority patent/US20160246383A1/en
Publication of WO2015062017A1 publication Critical patent/WO2015062017A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416—Control or interface arrangements specially adapted for digitisers
    • G06F3/04166—Details of scanning methods, e.g. sampling time, grouping of sub areas or time sharing with display driving
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1694—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/04108—Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04806—Zoom, i.e. interaction techniques or interactors for controlling the zooming operation

Definitions

  • the present invention relates to the field of terminal equipment technologies, and in particular, to a processing method and apparatus for a floating or air gap operation. Background technique
  • touch screens have greatly improved the interaction experience between users and terminals, and have been widely used.
  • a finger cannot touch the screen or is inconvenient to touch the screen or can only touch the screen with one hand.
  • the hand is not convenient to touch the screen, but when you need to view the webpage or picture, both hands cannot touch the screen.
  • Hover touch is a technology that allows the user's finger to touch the screen without touching the terminal screen.
  • capacitive sensors There are two types of capacitive sensors, mutual capacitance sensors and self-capacitance sensors on touch screens that support floating touch.
  • Self-capacitance sensors produce a more powerful signal than mutual-capacitance sensors to detect farther finger sensing with a range of up to 20 inches.
  • the electric field of the mutual capacitance sensor is so small that the signal strength is very low and it is impossible to detect those very weak signals. Therefore, when the user's finger hovers over the screen, the mutual capacitance sensor cannot detect the signal.
  • the self-capacitance sensor can detect signals larger than the mutual capacitance sensor, allowing the device to detect a finger at 20 inches above the screen.
  • the gap operation is to recognize and judge the proximity gesture through sensors such as a touch screen, a camera, an ultrasonic sensor, an infrared sensor, etc., and the longitudinal area (distance from the touch screen) that can be sensed is farther than the floating operation.
  • sensors such as a touch screen, a camera, an ultrasonic sensor, an infrared sensor, etc.
  • the longitudinal area (distance from the touch screen) that can be sensed is farther than the floating operation.
  • the hands are unable to touch the screen, it is more appropriate to use the space-saving operation.
  • Summary of the invention is to provide a processing method and device for suspending or emptying operation, which can realize zooming and viewing of display objects such as webpages and pictures in a floating operation or an empty space, instead of the existing multi-touch function, operation Flexible and convenient.
  • a first aspect of the present invention provides a processing method for a floating or air gap operation, the method comprising:
  • the terminal detects whether the floating or emptying operation of the operating object in the floating or air-sensing area of the terminal satisfies a predefined condition; if satisfied, the terminal detects a moving trajectory of the operating object; Moving the track, the terminal zooms or rotates the content displayed on the screen of the terminal.
  • the terminal detects whether a floating or air gap operation of the operating object in the floating or air-sensing area of the terminal meets a predefined condition, including: The terminal detects whether the suspension or empty operation of the operating object is a hovering operation in which the operating object is in the same position within the first time threshold or the offset of the position is within a tolerance range; if yes, the terminal is suspended or separated The suspension or emptying operation within the null sensing region satisfies the predefined conditions.
  • the detecting, by the terminal, whether the suspension or the air gap operation of the operation object is a hovering operation specifically includes:
  • the current position of the operator is set to be suspended Stop the initial position and restart the timer
  • the timer counts up to the first time threshold, it is determined that the hovering or emptying operation is a hovering operation, and the current position of the operating object is set to a hovering initial position, and the timer is restarted.
  • the performing, by the terminal, the scaling or rotating operation on the content displayed on the screen of the terminal includes: Determining, in the content displayed on the screen of the terminal, an area corresponding to the second position as a central area of the zooming or rotating operation, and determining the second position as a starting position of the zooming or rotating operation, And performing a zooming or rotating operation on the content displayed on the screen of the terminal; the second location is a floating position of the operating object when the terminal detects that the floating or empty operation of the operating object is a hovering operation;
  • the detecting, by the terminal, the movement trajectory of the operator includes:
  • An offset of the current floating position of the operator from the starting position is calculated and recorded as a movement trajectory of the operator.
  • the method further includes: when the terminal detects again When the suspension or the empty operation of the operating object is a hovering operation, the terminal will again detect the floating position of the operating object when the hovering operation of the operating object is updated to the zooming or rotating operation.
  • the start position, the content displayed on the screen of the terminal corresponding to the floating position of the operator when the hovering operation of the operator is detected again is determined as the center area of the zooming or rotating operation.
  • the movement trajectory of the operator includes one of the following or Any combination:
  • a movement locus of the operator in the y-axis direction of the rectangular coordinate system or a movement locus of the operator in the z direction perpendicular to the screen of the terminal.
  • the terminal according to a movement trajectory of the operation object, is used by the terminal to scale content displayed on a screen of the terminal or
  • the rotation operation specifically includes one or any combination of the following:
  • the terminal When the movement trajectory of the operator in the z direction is close to the screen of the terminal, The terminal performs an enlargement operation on the content displayed on the screen of the terminal;
  • the terminal When the moving track of the operator in the Z direction is a screen away from the terminal, the terminal performs a zooming operation on the content displayed on the screen of the terminal;
  • the terminal When the moving track of the operator in the X-axis direction exceeds a predetermined range, the terminal performs a rotating operation on the content displayed on the screen of the terminal;
  • the terminal When the movement trajectory of the operator in the y-axis direction exceeds a predetermined range, the terminal performs a rotation operation on the content displayed on the screen of the terminal.
  • the present invention also provides a processing apparatus for floating or empty operation, the apparatus comprising: an inductor and a processor;
  • the inductor is configured to detect a floating or empty operation of an operating object in a floating or air-sensing area of the inductor;
  • the processor is configured to determine whether a floating or empty operation of the operating object detected by the sensor meets a predefined condition; and the processor is configured to determine, at the processor, the operating object When the floating or emptying operation satisfies the predefined condition, the moving track of the operating object is detected by the inductor;
  • the processor is further configured to scale or rotate the content displayed on the screen according to the movement trajectory of the operator.
  • the determining, by the processor, whether the floating or emptying operation of the operating object detected by the sensor meets a predefined condition is: The processor determines whether the suspension or the gap operation of the operator detected by the sensor is a hovering operation in which the operator is in the same position within the first time threshold or the offset of the position is within a tolerance range; Then, the suspension or empty operation in the suspension or space sensing area of the terminal satisfies the predefined conditions.
  • the determining, by the processor, whether the suspension or the air gap operation of the operation object is a hovering operation specifically: the processing When the sensor detects the operator, the current position of the operator is hovered Initial position, and start a timer;
  • the processor determines that the offset of the operator detected by the sensor relative to the hovering initial position exceeds the tolerance range, and the timer is not up to the first time threshold And the processor sets the current position of the operating object to the hover initial position and restarts the timer; if the timer counts the first time threshold, the processor determines the floating or separating The idle operation is a hovering operation, and the current position of the operating object is set to the hover initial position, and the timer is restarted.
  • the processor performs a scaling or rotating operation on the content displayed on the screen of the terminal, including :
  • the processor determines an area corresponding to the second position among the content displayed on the screen of the terminal as a central area of the zooming or rotating operation, and determining the second position as the zooming or rotating operation a starting position, performing a zooming or rotating operation on the content displayed on the screen of the terminal; the second position is when the terminal detects that the floating or empty operation of the operating object is a hovering operation Suspension position
  • the processor detecting a movement trajectory of the operator includes:
  • the processor calculates and records an offset of the current floating position of the operator detected by the sensor and the starting position as a moving trajectory of the operating object.
  • the processor is further configured to: after performing the scaling or rotating operation on the content displayed on the screen, When the suspension or the empty operation of the operating object detected by the sensor is a hovering operation, the floating position of the operating object when the hovering operation of the operating object is again determined to be updated to the zooming or rotating The starting position of the operation, the content displayed on the screen corresponding to the floating position of the operating object when the hovering operation of the operating object is determined again is determined as the central area of the zooming or rotating operation.
  • the movement trajectory of the operation object includes one or any combination of the following:
  • the processor is specifically configured to: when the moving track of the operating object in the z direction is approaching the sensor Amplifying the content displayed on the screen;
  • the processor is specifically configured to perform a zoom-out operation on the content displayed on the screen when the movement track of the operator in the z direction is far away from the sensor;
  • the processor is specifically configured to perform a rotation operation on the content displayed on the screen when the movement track of the operator in the X-axis direction exceeds a predetermined range;
  • the processor is specifically configured to perform a rotation operation on the content displayed on the screen when the movement trajectory of the operator in the y-axis direction exceeds a predetermined range.
  • the method and device for processing suspension or space operation processes the floating or empty operation during the movement of the user, determines the movement trajectory and trend of the user, and performs corresponding scaling/rotation processing according to the movement trajectory of the user. It can realize zooming and viewing of display objects such as web pages and pictures during floating or empty operation, which replaces the existing multi-touch function and is flexible and convenient to operate.
  • FIG. 1 is a flow chart of a method for processing a suspension or an air gap operation according to Embodiment 1 of the present invention
  • FIG. 2 is a schematic view showing a suspension or space position of an operator provided by the present invention
  • FIG. 3 is a schematic diagram of an effect of scaling display content according to the present invention.
  • FIG. 4 is a schematic diagram of an effect of rotating a display content according to the present invention
  • FIG. 5 is a schematic diagram of a processing device for a floating or empty operation according to Embodiment 2 of the present invention. detailed description
  • the invention provides a method and a device for processing a suspension or an empty space operation, which are suitable for a touch screen and a terminal device capable of sensing suspension or space operation, and can zoom in on display contents such as web pages and pictures displayed on the screen when the screen is not touched. , rotation, etc.
  • FIG. 1 is a flow chart of a processing method for a floating or air gap operation provided by this embodiment. As shown in FIG. 1, the processing method of the floating or air gap operation of the present invention includes:
  • the terminal detects whether the suspension or isolation operation of the operator in the floating or air-sensing area of the terminal satisfies a predefined condition.
  • the operator is generally an object that can be sensed by the touch screen of the terminal, such as a user's finger.
  • the floating or empty operation refers to an operation that the touch screen of the terminal can sense when the operator does not touch the touch screen of the terminal.
  • the terminal uses a touch screen or other sensor to detect a floating or empty operation of the operating object, and senses a change in the hovering position of the operating object. Specifically, it includes one or any combination of the following: a change in the X-axis direction of the orthogonal coordinate system in the plane parallel to the screen of the terminal; the y-axis of the operator in the rectangular coordinate system A change in direction; or, a change in the z direction perpendicular to the screen of the terminal.
  • the terminal detects that the floating or empty operation of the operating object in the floating or air-sensing area of the terminal satisfies a predefined condition, then S102 is performed. Otherwise, the terminal does not enter the rotary or zoom mode, ie S1 02 is not executed.
  • the terminal detects whether the suspension or the empty operation of the operating object is a hovering operation in which the operating object is in the same position within the first time threshold or the offset of the position is within a tolerance range; if yes, the terminal The suspension or emptying operation in the suspension or space sensing area satisfies the predefined strip Pieces.
  • the preset first time threshold can be set according to actual usage, for example, 1 second.
  • the offset can be a vector, including both the direction and the length.
  • the tolerance range is a distance range that is set in advance in consideration of possible jitter in the user operation, and the operator can be approximated to be in the same position when moving within the distance range. That is, when it is judged that the offset of the operator in the X-axis direction, the y-axis direction, and the z-direction is smaller than the tolerance range, it means that the movement of the operator belongs to the jitter, and the terminal thinks that the operator is at the same position.
  • the detecting, by the terminal, whether the suspension or the air-vacuation operation of the operation object is a hovering operation includes: when the terminal detects the operation object in a floating or air-space sensing area of the terminal, The current position of the object is set to the hover initial position, and a timer is started; if it is detected that the offset of the operator relative to the hovering initial position exceeds the tolerance range and the timer is not up to timing Determining, by the first time threshold, a current position of the operating object as a hovering initial position and restarting the timer; if the timer is timed to reach the first time threshold, determining the floating or emptying operation For hovering operation, set the current position of the operator to the hover initial position and restart the timer.
  • the terminal detects a movement trajectory of the operation object.
  • the terminal enters the zoom/rotation mode.
  • the movement trajectory of the operator includes one or any combination of the following: a movement trajectory of the operator in the X-axis direction of a rectangular coordinate system in a plane parallel to the screen of the terminal, or a movement locus of the operator in a y-axis direction of the orthogonal coordinate system, or a movement locus of the operator in a z direction perpendicular to a screen of the terminal.
  • the terminal calculates an offset of the hovering position of the operator and the starting position in the X-axis direction or the y-axis direction or the z-direction, respectively.
  • the moving trajectory of the operating object may be a continuously changing trajectory line, or may be a changing point, that is, detecting one or more points of the operating object, and calculating, by calculation, a signal waveform change caused by a change of the point.
  • S 1 03. The terminal performs a scaling or rotating operation on the content displayed on the screen of the terminal according to the movement trajectory of the operation object.
  • an area corresponding to the second position in the content displayed on the screen of the terminal is determined as a central area of the zooming or rotating operation, and the second position is determined as the starting of the zooming or rotating operation a starting position, zooming or rotating the content displayed on the screen of the terminal; the second position is when the terminal detects that the floating or empty operation of the operating object is a hovering operation Suspended position.
  • the detecting, by the terminal, the movement trajectory of the operator includes: calculating and recording an offset of the current suspension position of the operator from the starting position, as a movement trajectory of the operator.
  • the terminal scales or rotates the content displayed on the screen of the terminal, and specifically includes one or any combination of the following:
  • the terminal When the movement trajectory of the operator in the z direction is close to the screen of the terminal, the terminal performs an enlargement operation on the content displayed on the screen of the terminal.
  • the terminal when the movement trajectory of the operator in the z direction is a screen away from the terminal, the terminal performs a reduction operation on the content displayed on the screen of the terminal.
  • the terminal when the movement trajectory of the operator in the X-axis direction exceeds a predetermined range, the terminal performs a rotation operation on the content displayed on the screen of the terminal.
  • the terminal when the movement trajectory of the operator in the y-axis direction exceeds a predetermined range, the terminal performs a rotation operation on the content displayed on the screen of the terminal.
  • the scaling control is performed according to the change of the offset from the starting position in the z direction, for example, the scaling value in the z direction of 0.5 units is 4 times, and the forward direction (the distance from the screen is increased) is amplified. 4 times, the negative direction (the distance from the screen is reduced) is reduced to 1 / 4. That is, when ⁇ ⁇ ⁇ 0, it means that the screen is zoomed out, and a reduction command is generated to perform the reduction operation. When ⁇ ⁇ > 0, it means that the screen is close to the screen, and an enlarged command is generated to perform the enlargement operation.
  • the rotation is controlled in accordance with the change in the amount of shift from the start position in the X-axis direction or the y-axis direction.
  • the hover position offset exceeds the predetermined range (such as SAFE _X and SAFE_Y preset)
  • the distance is calculated based on the distance exceeded, the content on the screen is rotated.
  • the service for detecting the floating or empty operation gesture may send a message to allow the sub-interface to continuously rotate, or rotate a degree or a trajectory according to the gesture. Rotation, if both are 0, indicating that the operator is active within the predetermined range (SAFE_X and SAFE_Y), cancels the original rotation process, and stops the rotation.
  • the direction of rotation is determined based on the direction and distance of the current finger position and the starting position (when the timer is turned on): For example, if the finger position is on the right side of the center point, the interface is rotated to the right, which is the center of the distance. The length of the position can affect the speed of rotation, and the longer the specific rotation, the faster. If the finger is in the upper right corner of the center store, the interface is rotated to the right and up at the same time. The speed of this rotation is also determined by the position of the center point. If the user moves the finger back to the center point position, the interface stops rotating.
  • the method further includes:
  • the terminal When the terminal detects that the suspension or the air-vacuation operation of the operator is a hovering operation, the terminal will detect the hovering position of the operator when the hovering operation of the operator is detected again to the zoom or The starting position of the rotating operation, the content displayed on the screen of the terminal corresponding to the floating position of the operating object when the hovering operation of the operating object is detected again is determined as the central area of the zooming or rotating operation.
  • FIG. 2 is a schematic diagram of the hovering position of the operator provided by the present invention.
  • the operator eg, finger
  • the content change speed on the screen may also be set.
  • the content change speed is less than the moving speed of the operating object.
  • the terminal may exit the detecting the moving track of the operating object after detecting that the operating object leaves the floating or air-sensing area of the touch screen for a period of time.
  • FIG. 5 is a schematic diagram of a processing apparatus for a floating or empty operation provided by the embodiment.
  • the processing apparatus for the floating or empty operation of the present invention includes: an inductor 501 and a processor 502.
  • the sensor 501 is for detecting an operation of the suspension or the space in the floating or air-sensing area of the sensor 501.
  • the sensor 501 can be a sensor of a touch screen, a camera, an ultrasonic sensor, an infrared sensor, or the like, or a combination of a touch screen and a sensor such as a camera or an ultrasonic sensor or an infrared sensor.
  • a touch screen is taken as an example, and sensors such as a camera, an ultrasonic sensor, an infrared sensor, and the like are similar thereto.
  • the operator is generally an object that can be sensed by the sensor 501, such as a user's finger.
  • the suspending or emptying operation refers to an operation that the sensor 501 can sense without the operator touching the sensor 501.
  • the sensor 501 senses a change in the hovering position of the operator, and specifically includes one or any combination of the following: a change in the X-axis direction of the operator in a plane parallel to the screen in which the operator is located; A change in the y-axis direction of the operator in a plane parallel to the screen in which the operator is located; or a change in the z direction perpendicular to the sensor 501.
  • the processor 502 is configured to determine whether the floating or empty operation of the operator detected by the sensor 501 satisfies a predefined condition.
  • the processor 502 is configured to detect, by the sensor 501, a movement trajectory of the operation object when the processor 502 determines that the suspension or the air gap operation of the operation object satisfies the predefined condition. At this point, the terminal triggers to enter the zoom/rotate mode.
  • the processor 502 determines whether the floating or empty operation of the operating object detected by the sensor meets a predefined condition: the processor 502 determines whether the floating or empty operation of the operating object is an operating object.
  • the offset at the same position or position within a time threshold is hovered within the tolerance; if so, the floating or empty operation within the floating or air-sensing region of the terminal satisfies the predefined condition.
  • the preset first time threshold can be set according to the actual usage, for example, 1 second.
  • the offset can be a vector, including both the direction and the length.
  • the tolerance range is a distance range that is set in advance in consideration of possible jitter in the user operation, and the operator can be approximated to be in the same position when moving within the distance range. That is, when it is judged that the offset of the operator in the X-axis direction, the y-axis direction, and the z-direction is smaller than the tolerance range, it means that the movement of the operator belongs to the jitter, and the terminal thinks that the operator is at the same position.
  • the processor 502 determines whether the hovering or emptying operation of the operating object is a hovering operation, and specifically includes: the processor 502 sets the current position of the operating object to the hovering initial position when the sensor 501 detects the operating object. And starting a timer; if the processor 502 determines that the offset of the operator detected by the sensor 501 relative to the hovering initial position exceeds the tolerance range and the timer timing does not reach the stated The first time threshold, the processor sets the current position of the operator to the hover initial position and restarts the timer; if the timer counts the first time threshold, the processor 502 determines the The floating or empty operation is a hovering operation, and the current position of the operating object is set to the hover initial position, and the timer is restarted.
  • the processor 502 is configured to detect the movement trajectory of the operator using the sensor 501.
  • the movement trajectory of the operator includes one or any combination of the following: a movement locus of the orthogonal coordinate system in the X-axis direction in a plane parallel to the screen of the terminal, or a movement locus of the operator in the y-axis direction of the operator in the rectangular coordinate system, or The movement trajectory of the operator in the z direction perpendicular to the screen.
  • the processor 502 calculates an offset of the hovering position of the operator and the starting position in the X-axis direction or the y-axis direction or the z-direction, respectively.
  • the moving trajectory of the operating object may be a continuously changing trajectory line, or may be a changing point, that is, detecting one or more points of the operating object, and calculating, by calculation, a signal waveform change caused by a change of the point. The change in the hovering position of the operator.
  • the processor 502 is further configured to scale or rotate the content displayed on the screen according to the movement trajectory of the operator.
  • the processor 502 determines an area corresponding to the second position among the content displayed on the screen of the terminal as a central area of the zooming or rotating operation, and determines the second position as a start of the zooming or rotating operation a starting position, zooming or rotating the content displayed on the screen of the terminal; the second position is when the terminal detects that the floating or empty operation of the operating object is a hovering operation Suspended position.
  • the processor 502 detects a movement trajectory of the operator including:
  • the processor 502 calculates and records an offset of the current floating position of the operator detected by the sensor from the starting position as a movement trajectory of the operator.
  • the processor 502 is configured to perform an enlargement operation on the content displayed on the screen when the movement track of the operator in the z direction is close to the sensor 501.
  • the processor 502 is configured to perform a zoom-out operation on the content displayed on the screen when the movement track of the operator in the z direction is away from the sensor 501.
  • the processor 502 is configured to perform a rotation operation on the content displayed on the screen when the movement trajectory of the operator in the X-axis direction exceeds a predetermined range.
  • the processor 502 is configured to perform a rotation operation on the content displayed on the screen when the movement trajectory of the operator in the y-axis direction exceeds a predetermined range.
  • the scaling control is performed according to the change of the offset from the starting position in the Z direction, for example, the scaling value in the z direction of 0.5 units is 4 times, and the forward direction (the distance from the screen is increased) is amplified. 4 times, the negative direction (the distance from the screen is reduced) is reduced to 1 / 4.
  • ⁇ ⁇ ⁇ 0 it means that the screen is zoomed out and the zoom-out operation is performed.
  • ⁇ ⁇ >0 it means that the screen is close to the screen, and an enlarged command is generated to perform the zoom-in operation.
  • the rotation is controlled according to the change in the offset from the start position in the X-axis direction or the y-axis direction.
  • the offset of the hover position exceeds the predetermined range (such as SAFE _X and SAFE_Y in advance)
  • the speed of the rotation is calculated based on the distance exceeded, and the content on the screen is rotated. If the rotation speed in the X-axis direction or the y-axis direction has a value greater than 0, the service for detecting the floating or empty operation gesture may send a message to allow the sub-interface to continuously rotate, or rotate a degree or a trajectory according to the gesture. Rotation, if both are 0, indicating that the operator is active within the predetermined range (SAFE_X and SAFE_Y), cancels the original rotation process, and stops the rotation.
  • the direction of rotation is determined based on the direction and distance of the current finger position and the starting position (when the timer is turned on): For example, if the finger position is on the right side of the center point, the interface is rotated to the right, which is the center of the distance. The length of the position can affect the speed of rotation, and the longer the specific rotation, the faster. If the finger is in the upper right corner of the center store, the interface is rotated to the right and up at the same time. The speed of this rotation is also determined by the position of the center point. If the user moves the finger back to the center point position, the interface stops rotating.
  • the processor 502 is further configured to: after determining, by the zooming or rotating operation on the content displayed on the screen, when it is determined that the floating or emptying operation of the operating object detected by the sensor is During the hovering operation, it will be determined again that the hovering position of the operating object is updated to the starting position of the zooming or rotating operation when the hovering operation of the operating object is performed, and the hovering operation of the operating object will be judged again.
  • the content displayed on the screen corresponding to the floating position of the operator is determined as a central area of the zooming or rotating operation.
  • the method and device for processing suspension or space-vacuation operations process the suspension or space-storing operation during the movement of the user, determine the movement trajectory and trend of the user, and according to the user movement track
  • the track performs corresponding scaling/rotation processing, which can realize zooming and viewing of display objects such as webpages and pictures during floating or empty operation, and replace the existing multi-touch function, and the operation is flexible and convenient.
  • RAM random access memory
  • ROM read-only memory
  • EEPROM electrically programmable ROM
  • EEPROM electrically erasable programmable ROM
  • registers hard disk, removable disk, CD-ROM, or technical field Any other form of storage medium known.

Abstract

La présente invention concerne un procédé et un appareil permettant de traiter une opération suspendue ou distante. Le procédé comprend les étapes suivantes : lorsqu'un terminal détecte qu'une opération d'un objet d'opération dans une zone d'induction suspendue ou distante du terminal satisfait les conditions prédéfinies, le terminal est déclenché pour entrer dans un mode zoom/rotation; le terminal détecte un suivi de mouvement de l'objet d'opération; et le terminal génère une instruction pour réaliser une opération de zoom ou de rotation sur le contenu affiché sur un écran du terminal. Le procédé et l'appareil de traitement d'une opération suspendue ou distante proposés par la présente invention peuvent effectuer un zoom sur des objets affichés et visualiser lesdits objets, tels qu'une page web et une image, au moment d'une opération suspendue ou distante, afin de remplacer la fonction courante de commande tactile multipoint, et le fonctionnement est flexible et commode.
PCT/CN2013/086309 2013-10-31 2013-10-31 Procédé et appareil de traitement d'opération suspendue ou distante WO2015062017A1 (fr)

Priority Applications (6)

Application Number Priority Date Filing Date Title
PCT/CN2013/086309 WO2015062017A1 (fr) 2013-10-31 2013-10-31 Procédé et appareil de traitement d'opération suspendue ou distante
CN201380003120.0A CN103858085A (zh) 2013-10-31 2013-10-31 悬浮或隔空操作的处理方法及装置
KR1020167013544A KR20160077122A (ko) 2013-10-31 2013-10-31 부동 또는 공중 조작 처리 방법 및 장치
JP2016527395A JP2016539413A (ja) 2013-10-31 2013-10-31 フローティング又は空中操作処理方法及び装置
EP13896370.7A EP3054373A4 (fr) 2013-10-31 2013-10-31 Procédé et appareil de traitement d'opération suspendue ou distante
US15/033,514 US20160246383A1 (en) 2013-10-31 2013-10-31 Floating or mid-air operation processing method and apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2013/086309 WO2015062017A1 (fr) 2013-10-31 2013-10-31 Procédé et appareil de traitement d'opération suspendue ou distante

Publications (1)

Publication Number Publication Date
WO2015062017A1 true WO2015062017A1 (fr) 2015-05-07

Family

ID=50864330

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2013/086309 WO2015062017A1 (fr) 2013-10-31 2013-10-31 Procédé et appareil de traitement d'opération suspendue ou distante

Country Status (6)

Country Link
US (1) US20160246383A1 (fr)
EP (1) EP3054373A4 (fr)
JP (1) JP2016539413A (fr)
KR (1) KR20160077122A (fr)
CN (1) CN103858085A (fr)
WO (1) WO2015062017A1 (fr)

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9594489B2 (en) 2014-08-12 2017-03-14 Microsoft Technology Licensing, Llc Hover-based interaction with rendered content
CN105630815A (zh) * 2014-10-31 2016-06-01 广州市动景计算机科技有限公司 网页重排版方法及装置
CN105278668A (zh) * 2014-12-16 2016-01-27 维沃移动通信有限公司 移动终端的控制方法及移动终端
EP3255523B1 (fr) * 2015-03-13 2022-05-04 Huawei Technologies Co., Ltd. Dispositif électronique, procédé de photographie et appareil de photographie
KR102344045B1 (ko) * 2015-04-21 2021-12-28 삼성전자주식회사 화면을 표시하는 전자 장치 및 그 제어 방법
CN104898972A (zh) * 2015-05-19 2015-09-09 青岛海信移动通信技术股份有限公司 一种调整电子图像的方法及设备
US10372268B2 (en) * 2015-07-21 2019-08-06 Sony Corporation Spatial image display apparatus and spatial image display method
US10216405B2 (en) * 2015-10-24 2019-02-26 Microsoft Technology Licensing, Llc Presenting control interface based on multi-input command
CN105430158A (zh) * 2015-10-28 2016-03-23 努比亚技术有限公司 一种隔空操作的处理方法及终端
CN105759961A (zh) * 2016-02-03 2016-07-13 林勇 智能设备以及智能设备控制方法
CN106371512A (zh) * 2016-08-29 2017-02-01 胡镇洪 一种可悬浮空中的平板电脑
CN106547367A (zh) * 2016-10-31 2017-03-29 努比亚技术有限公司 一种输入法控制装置及方法
CN106681612A (zh) * 2016-12-29 2017-05-17 宇龙计算机通信科技(深圳)有限公司 一种应用于移动终端的调节方法及移动终端
CN108427531A (zh) * 2017-02-15 2018-08-21 上海箩箕技术有限公司 终端及其可阅读内容的查阅方法、装置
CN106997258A (zh) * 2017-03-02 2017-08-01 惠州Tcl移动通信有限公司 一种移动终端界面旋转控制方法及系统
CN107515700A (zh) * 2017-09-05 2017-12-26 电子科技大学中山学院 一种用于智能镜子的非接触式触屏效果模拟方法
CN107908313B (zh) * 2017-11-22 2021-04-13 Oppo广东移动通信有限公司 电子装置的控制方法及电子装置
CN108427534B (zh) * 2018-03-23 2020-11-24 北京硬壳科技有限公司 控制屏幕返回桌面的方法和装置
CN110389800A (zh) * 2018-04-23 2019-10-29 广州小鹏汽车科技有限公司 一种车载大屏上显示内容处理方法、装置、介质和设备
CN109450426A (zh) * 2018-10-31 2019-03-08 西安中颖电子有限公司 一种利用多感应电极实现隔空触摸的方法
CN109785442B (zh) * 2018-12-11 2023-07-11 平安科技（深圳）有限公司 图像旋转的控制方法及装置、图像旋转的显示方法及系统

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050156876A1 (en) * 2004-01-21 2005-07-21 Microsoft Corporation Data input device and method for detecting lift-off from a tracking surface by electrical impedance measurement
CN102467344A (zh) * 2010-11-17 2012-05-23 索尼公司 用于触摸屏用户界面的基于显示器接近控制的系统和方法
CN102937832A (zh) * 2012-10-12 2013-02-20 广东欧珀移动通信有限公司 一种移动终端的手势捕捉方法及装置

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8086971B2 (en) * 2006-06-28 2011-12-27 Nokia Corporation Apparatus, methods and computer program products providing finger-based and hand-based gesture commands for portable electronic device applications
US7956847B2 (en) * 2007-01-05 2011-06-07 Apple Inc. Gestures for controlling, manipulating, and editing of media files using touch sensitive devices
KR101513023B1 (ko) * 2008-03-25 2015-04-22 엘지전자 주식회사 단말기 및 이것의 정보 디스플레이 방법
US8237666B2 (en) * 2008-10-10 2012-08-07 At&T Intellectual Property I, L.P. Augmented I/O for limited form factor user-interfaces
CN102736757A (zh) * 2011-03-31 2012-10-17 比亚迪股份有限公司 触控识别方法及触控识别装置
US8654076B2 (en) * 2012-03-15 2014-02-18 Nokia Corporation Touch screen hover input handling
JP5852050B2 (ja) * 2013-05-27 2016-02-03 株式会社ジャパンディスプレイ タッチ検出装置、タッチ検出機能付き表示装置、及び電子機器
US20150042580A1 (en) * 2013-08-08 2015-02-12 Lg Electronics Inc. Mobile terminal and a method of controlling the mobile terminal

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050156876A1 (en) * 2004-01-21 2005-07-21 Microsoft Corporation Data input device and method for detecting lift-off from a tracking surface by electrical impedance measurement
CN102467344A (zh) * 2010-11-17 2012-05-23 索尼公司 用于触摸屏用户界面的基于显示器接近控制的系统和方法
CN102937832A (zh) * 2012-10-12 2013-02-20 广东欧珀移动通信有限公司 一种移动终端的手势捕捉方法及装置

Also Published As

Publication number Publication date
JP2016539413A (ja) 2016-12-15
CN103858085A (zh) 2014-06-11
US20160246383A1 (en) 2016-08-25
EP3054373A1 (fr) 2016-08-10
KR20160077122A (ko) 2016-07-01
EP3054373A4 (fr) 2016-10-19

Similar Documents

Publication Publication Date Title
WO2015062017A1 (fr) Procédé et appareil de traitement d'opération suspendue ou distante
TWI514248B (zh) 防止誤觸發邊緣滑動手勢之方法及手勢觸發方法
KR102113674B1 (ko) 다중 터치를 이용한 객체 선택 장치, 방법 및 컴퓨터 판독 가능한 기록 매체
EP3055762B1 (fr) Appareil et procédé pour copier et coller un contenu dans un dispositif informatique
JP5639489B2 (ja) 情報処理装置及びその制御方法、プログラム、並びに記憶媒体
CN103988159A (zh) 显示控制装置、显示控制方法以及计算机程序
WO2014114114A1 (fr) Procédé de déplacement d'une icône sur un terminal, et terminal
CN108874284B (zh) 手势触发方法
KR20100136578A (ko) 터치 입력 수단 및 스타일러스 펜, 이를 이용한 터치스크린 장치, 및 터치스크린 제어방법
WO2012119548A1 (fr) Procédé de commande, dispositif de commande, dispositif de visualisation et dispositif électronique
JP2016128992A (ja) 電子機器、その制御方法及びプログラム並びに記録媒体
US20140118276A1 (en) Touch system adapted to touch control and hover control, and operating method thereof
JP2014182652A (ja) 情報処理装置およびその制御方法、ならびにプログラム
CN106406578B (zh) 信息处理装置、输入控制方法、信息处理装置的控制方法
US20140320430A1 (en) Input device
CN104020956A (zh) 一种实现移动终端单手握持拍照的方法及系统
JP6255321B2 (ja) 情報処理装置とその指先操作識別方法並びにプログラム
JP2015032095A5 (fr)
WO2014117619A1 (fr) Procédé et appareil de commande de déplacement d'interface d'application et dispositif terminal
KR20100132572A (ko) 사용자 인터페이스 제어 장치 및 구현 방법
TW201441914A (zh) 調整圖片顯示比例的電子裝置及方法
KR101936250B1 (ko) 전자책을 제공하는 단말 및 그 제어방법
JP2012048485A (ja) 表示装置、情報処理装置およびタッチイベント管理方法
JP2017062712A (ja) 電子機器
JP2015111341A (ja) 情報処理装置、情報処理方法、及びコンピュータプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13896370

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2016527395

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 15033514

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

REEP Request for entry into the european phase

Ref document number: 2013896370

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2013896370

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 20167013544

Country of ref document: KR

Kind code of ref document: A