WO2023016372A1 - 控制方法、装置、电子设备和存储介质 - Google Patents

控制方法、装置、电子设备和存储介质 Download PDF

Info

Publication number
WO2023016372A1
WO2023016372A1 PCT/CN2022/110567 CN2022110567W WO2023016372A1 WO 2023016372 A1 WO2023016372 A1 WO 2023016372A1 CN 2022110567 W CN2022110567 W CN 2022110567W WO 2023016372 A1 WO2023016372 A1 WO 2023016372A1
Authority
WO
WIPO (PCT)
Prior art keywords
display screen
function
area
display
operating body
Prior art date
Application number
PCT/CN2022/110567
Other languages
English (en)
French (fr)
Inventor
谷素军
Original Assignee
维沃移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 维沃移动通信有限公司 filed Critical 维沃移动通信有限公司
Publication of WO2023016372A1 publication Critical patent/WO2023016372A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482Interaction with lists of selectable items, e.g. menus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text

Definitions

  • the present application belongs to the technical field of communication, and specifically relates to a control method, device, electronic equipment and storage medium.
  • the display screens of electronic devices are getting bigger and bigger, and scenes such as painting, office work, and learning are more and more widely used on electronic devices.
  • users use large-screen electronic devices for painting, office work, and study, they often use both hands to operate, mainly using one hand to click sequentially.
  • the index finger if the user wants to insert a form, use the index finger first First select the insert function, then select the chart function, and finally select a few rows and columns to complete an operation.
  • the other hand of the user is often only used to hold the device, which is not fully utilized, thus greatly hindering the operation efficiency.
  • the existing method of sequentially clicking with one hand mainly has the following problems: it takes a long time to click sequentially with one hand, and the overall operation efficiency is low.
  • the purpose of the embodiments of the present application is to provide a control method, device, electronic equipment and storage medium, which can solve the problem of low operating efficiency of existing electronic equipment.
  • the embodiment of the present application provides a control method, which is applied to an electronic device with a display screen, and the method includes:
  • an N associated with the first function option is displayed in a second area of the display screen.
  • a second function option the position of the second area in the display screen is associated with the positional relationship between the second operating body and the display screen;
  • a function corresponding to the target function option is executed.
  • the embodiment of the present application provides a control device, which is applied to an electronic device with a display screen, and the device includes:
  • a first display module configured to display a first function option in a first area of the display screen
  • a first receiving module configured to receive a first input from a first operator on the first function option
  • the second display module is configured to, in the case that the distance between the second operating body and the display screen satisfies a preset condition, respond to the first input, and display on the second area of the display screen the For the N second function options associated with the first function option, the position of the second area in the display screen is associated with the positional relationship between the second operating body and the display screen;
  • a second receiving module configured to receive a second input from the second operator to a target function option among the N second function options
  • a function executing module configured to execute a function corresponding to the target function option in response to the second input.
  • the embodiment of the present application provides an electronic device, the electronic device includes: a processor, a memory, and a program or instruction stored in the memory and operable on the processor, the program or the When the instructions are executed by the processor, the steps of the control method according to the first aspect are implemented.
  • an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the control method described in the first aspect are implemented .
  • the embodiment of the present application provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used to run programs or instructions, so as to implement the first aspect the method described.
  • an embodiment of the present application provides a computer program product, the computer program product is stored in a non-volatile storage medium, and the program product is executed by at least one processor to implement the computer program product described in the first aspect. steps of the method.
  • an embodiment of the present application provides an electronic device configured to execute the method described in the first aspect.
  • the first function option is displayed on the first area of the display screen of the electronic device, and when the distance between the second operating body and the display screen satisfies the preset condition, in response to the first operating body
  • N second function options associated with the first function option are displayed in the second area of the display screen, the position of the second area in the display screen, and the second operating body and the display screen
  • the electronic device is controlled to execute the function corresponding to the target function option.
  • the electronic device can realize the cooperative manipulation of the first operating body and the second operating body, so that the user can conveniently and quickly use the functions of the electronic device, thereby greatly improving the operating efficiency of the electronic device and improving user experience.
  • Fig. 1 is one of the schematic flow charts of the control method provided by the embodiment of the present application.
  • FIG. 2 is a schematic structural diagram of an ultrasonic sensor installed on an electronic device provided in an embodiment of the present application
  • Fig. 3A is a schematic diagram of holding with one hand and operating with different hands
  • Fig. 3B is a schematic diagram of holding with both hands and operating with both hands;
  • Fig. 4 is one of the schematic diagrams of the interface of the electronic device provided by an embodiment of the present application.
  • Fig. 5 is the second schematic diagram of the interface of the electronic device provided by an embodiment of the present application.
  • Fig. 6 is the second schematic flow diagram of the control method provided by the embodiment of the present application.
  • Fig. 7 is the third schematic flow diagram of the control method provided by the embodiment of the present application.
  • Fig. 8 is the fourth schematic flow diagram of the control method provided by the embodiment of the present application.
  • Fig. 9 is one of the schematic diagrams of the interface of the electronic device provided by another embodiment of the present application.
  • Fig. 10 is the second schematic diagram of the interface of the electronic device provided by another embodiment of the present application.
  • Fig. 11 is a schematic structural diagram of a control device provided by an embodiment of the present application.
  • Fig. 12 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
  • FIG. 13 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
  • FIG. 1 is one of the schematic flow charts of the control method provided by the embodiment of the present application.
  • the method is applied to an electronic device with a display screen and includes the following steps:
  • the first operating body is a holding hand holding the electronic device.
  • the first input may be a click operation, a long press operation, or a slide operation.
  • the user may select the first function option for further operation by long-pressing the first function option with one finger of the holding hand.
  • the first area is an area within a predetermined range corresponding to the first operating body.
  • the first functional option is displayed near the first operating body, that is, the distance between the first functional option and the first operating body is less than a predetermined distance threshold, for example, the distance threshold can be set to 3 cm, so that the user can pass The first operating body further operates the first function option.
  • the second operating body includes an operating hand or an operating tool controlled by the operating hand.
  • the user can operate the electronic device not only by operating fingers of the operating hand, but also by operating the operating tool held by the hand.
  • the operating tool includes a stylus, a ruler, and the like.
  • N second function options associated with the first function options are displayed in the second area of the display screen.
  • the N second function options can be selected as the next-level function options of the first function option.
  • Said N is a natural number greater than or equal to 1.
  • the second function option is displayed in a second area, and the second area is an area within a predetermined range corresponding to the second operating body.
  • the second function option is displayed below the operating hand, so that the user can further operate the second function option through the operating hand.
  • the electronic device may acquire the position, shape, action or movement track of the second operating body.
  • the sensing device of the electronic device can perceive the position and movement of the user's finger outside the display screen at a medium or short distance.
  • the user can operate the electronic device without directly touching the display screen. Not only the frame and back of the entire electronic device can be Realize operations such as clicking and sliding, and users can also operate electronic devices through air gestures.
  • a space coordinate system is established with the center point of the display screen of the electronic device as the origin.
  • the trajectory points (Xn, Yn, Zn) of each finger of the user are obtained, and the operating finger of the user's operating hand can be further identified, and the position of the operating finger at each time point can be obtained.
  • the moving direction and track of the operating finger can be judged.
  • S103 Receive a second input of a target function option among the N second function options by the second operator.
  • the second input may be a click operation, a long press operation, or a slide operation.
  • the functions corresponding to the target function options include, but are not limited to, launching applications, executing specific functions in applications, closing applications, and the like.
  • the first operating body is a holding hand for holding the electronic device
  • the second operating body includes the operating hand or an operating tool controlled by the operating hand. For example, if the user holds the electronic device with his left hand and operates the electronic device with his right hand, then the first operating body is the user's left hand, and the second operating body is the user's right hand.
  • the electronic device can perceive the position, movement and shape of the object to be measured through sensing devices such as ultrasonic sensors and laser sensors, so as to recognize the user's holding hand, operating hand or operating tool.
  • the operating tool includes a stylus, a ruler, etc., and the user can control the operating tool by hand to perform touch operations on the display screen of the electronic device.
  • the sensing device may be an ultrasonic sensor.
  • Ultrasonic waves will produce significant reflections when they encounter impurities or interfaces to form reflected echoes, and can produce Doppler effects when they encounter moving objects. Therefore, ultrasonic waves have the ability to perceive the position, movement, and shape of objects.
  • Ultrasonic sensors have been widely used in electronic devices such as gaming phones. For example, gaming phones can customize the position and method of operations on the phone to provide a better gaming experience.
  • the electronic devices include, but are not limited to, mobile phones, tablet computers, notebook computers, palmtop computers, vehicle electronic devices, wearable devices, netbooks, or personal digital assistants.
  • multiple ultrasonic sensors may be installed on the electronic device.
  • eight ultrasonic sensors arranged symmetrically are installed on the electronic device.
  • the eight ultrasonic sensors can transmit ultrasonic waves to the object to be measured respectively to improve the accuracy of sensing the object. It is worth reminding that the number of ultrasonic sensors installed in the electronic device is not limited, and the user can set one or any number of ultrasonic sensors according to actual needs.
  • the sensing device can also be a laser sensor, which senses the position, movement and shape of the object to be measured by using the laser beam emitted and received by the laser sensor, thereby identifying the user's holding hand and operating hand Or operate an operating tool that is controlled by hand.
  • a laser sensor which senses the position, movement and shape of the object to be measured by using the laser beam emitted and received by the laser sensor, thereby identifying the user's holding hand and operating hand Or operate an operating tool that is controlled by hand.
  • the electronic device of the present application can perceive the position, movement and shape of the object to be measured, and can recognize the user's holding hand, operating hand, or operating tool controlled by the operating hand, so as to further realize the cooperative manipulation of both hands.
  • the electronic device when the electronic device executes a predetermined application, it will automatically start the sensing device. For example, after the electronic device starts a target application such as a painting application, an office application or a learning application, the background will automatically start the sensing device.
  • the electronic device can also be activated by a user inputting an instruction; or, the electronic device is always on the sensing device.
  • One-handed holding, different-handed operation can also include left-handed holding (that is, the left hand is the holding hand), right thumb or index finger manipulation (that is, the right hand is the operating hand) ).
  • left-handed holding that is, the left hand is the holding hand
  • right thumb or index finger manipulation that is, the right hand is the operating hand
  • the user can also use the right hand to hold (that is, the right hand is used for holding), and the left thumb or index finger to control (that is, the left hand is used for operation), etc., which are not shown in the figure.
  • Two-handed holding and two-handed operation as shown in FIG. 3B , it may specifically include two-handed horizontal holding and two-handed thumb manipulation; or two-handed vertical holding and two-handed thumb manipulation.
  • the two-handed operation gesture can be selected as one-handed holding and different-handed operation.
  • the position, action and/or shape of the object to be measured is acquired by ultrasonic waves; according to the position, action and/or shape of the object to be measured, it is recognized and judged whether the object to be tested conforms to a predetermined grip hand elements or operating body elements; if the object to be measured conforms to the gripping hand element, then identify the object to be measured as the gripping hand; if the object to be measured conforms to the operating body elements, it is identified that the object to be measured is an operating body.
  • the user's operation can be judged according to the number of contact points between the fingers and the frame of the electronic device.
  • the gesture can determine which hand the user is holding the device and which hand is controlling it. Specifically, according to the position, action and/or shape of the object to be measured, it is judged whether the contact points between the object to be measured and the frame of the electronic device are greater than or equal to three; if the contact points are greater than or equal to If there are three, the object to be measured is identified as the first operating body; if the contact points are less than three, the object to be measured is identified as the second operating body.
  • the sensing device may be turned off, so as to reduce the consumption of system resources by the sensing device.
  • the electronic device can also always turn on the sensing device.
  • the holding hand in this application can also operate the electronic device, but as long as the hand is used to hold the electronic device, even if the hand is also used for operation, it is still defined as the holding hand.
  • the operating hand is only used to operate electronic equipment with fingers or operating tools, and does not have a holding function.
  • Figures 4 to 5 show the interface of the electronic device provided by an embodiment of the present application.
  • a menu bar containing three functions of brushes, colors, and tools is displayed near the thumb of the holding hand ,As shown in Figure 4.
  • determine the function selected by the user that is, the first function option. For example, if the ultrasonic sensor detects that the long-pressed position of the holding thumb is on the paintbrush function, it means that the user has selected the paintbrush function, that is, the first function option is the paintbrush function.
  • various brush type options corresponding to the brush function are displayed on the display area below the operating hand, that is, the Nth Two function options.
  • the electronic device senses that the long-pressed position of the holding thumb is on the color function, it means that the user has selected the color function.
  • various color options corresponding to the color function are displayed on the display screen area below the operating hand. If the user wants to select a color, the next step of color selection is performed according to the position of the operating finger (such as the index finger) of the obtained operation hand.
  • the electronic device can realize the cooperative manipulation of the first operating body and the second operating body, so that the user can conveniently and quickly use the functions of the electronic device, thereby greatly improving the operating efficiency of the electronic device and improving user experience.
  • this embodiment uses ultrasonic or laser positioning principles to obtain the user's finger position and displacement direction, judge the user's holding hand, operating hand, or operating tool controlled by the operating hand, and use both hands to cooperate. Operation, realize the shortcut touch of the function. Recognize the responsibilities of the user's left and right hands, which is in line with the user's usage habits, and through the operation of both hands, the user can quickly select the desired function, thereby improving the efficiency of large-screen electronic devices in target scenarios, such as painting, office, and learning scenarios. operational efficiency.
  • FIG. 6 is the second schematic flow diagram of the control method provided by the embodiment of the present application. The method is applied to an electronic device with a display screen and includes the following steps:
  • the first operating body is a holding hand that holds the electronic device.
  • the pressing operation is a pressing operation performed by the first operating body (such as a holding finger of a holding hand) on a predetermined trigger area of the electronic device, and the trigger area includes the frame, display screen or back of the electronic device wait.
  • the user's first operating body long presses the frame of the electronic device, which will trigger the generation of a press operation.
  • the first operating body is mainly used to trigger an instruction to enter a two-handed operation mode. This can avoid affecting the operation of the operating hand, and ensure that the original interaction logic will not be affected when the two-handed operation is realized.
  • this step includes: acquiring the pressure of the pressing operation, judging whether the pressure of the pressing operation is greater than a predetermined pressure value, and if so, displaying the first function option in the first area of the display screen, otherwise returning to S601.
  • the two-handed operation mode is entered and the sensing device is activated at the same time.
  • the sensing device is always on, the step of activating the sensing device can be omitted.
  • the two-handed operation mode is triggered, that is, the two-handed operation can be coordinated, and the first function option is displayed.
  • the first function option is displayed in a first area, and the first area is an area within a predetermined range corresponding to the holding hand.
  • the first function option is displayed near the holding hand, that is, the distance between the first function option and the holding finger of the holding hand is less than a predetermined distance value, for example, the distance value can be set to 3 cm, In order to facilitate the user to further operate the first function option through the holding finger of the holding hand.
  • the second operating body includes an operating hand or an operating tool controlled by the operating hand.
  • S605. Receive a second input of a target function option among the N second function options by the second operator.
  • the electronic device recognizes that the holding finger is removed from the trigger area, the two-hand operation mode is turned off, and the display of the first function option is canceled.
  • the electronic device will exit the two-handed operation mode.
  • the sensing device can be turned off, and the whole process ends.
  • the user can use the first operating body to press the electronic device and the first input, and the second operating body to make the second input to the electronic device, so that the electronic device can realize the operation of the first operating body and the second operating body.
  • the user can conveniently and quickly use the functions of the electronic device, thereby greatly improving the operating efficiency of the electronic device.
  • FIG. 7 is the third schematic flow diagram of the control method provided by the embodiment of the present application.
  • the method is applied to an electronic device with a display screen and includes the following steps:
  • the first operating body includes a holding hand of a user.
  • the second operating body includes a user's operating hand or an operating tool controlled by the operating hand.
  • the current distance between the second operating body and the display screen includes: the current distance between the user's operating hand and the display screen; or, the current distance between the operating tool and the display screen.
  • the electronic device can perceive the position, movement and shape of the object to be measured through sensing devices such as ultrasonic sensors and laser sensors, so as to recognize the difference between the operating hand or the operating tool controlled by the operating hand and the display screen. distance between values.
  • sensing devices such as ultrasonic sensors and laser sensors
  • the second area of the control display screen cancels the display of N second function options associated with the first function options, and displays the N second function options on the display screen
  • the third area displays N second function options associated with the first function option.
  • the above steps also include:
  • control the display screen When the first movement of the second operating body occurs in the horizontal direction parallel to the display screen, and the distance value between the second operating body and the display screen is less than the first distance value and greater than the second distance value, control the display screen The second area of the display screen cancels displaying the N second function options associated with the first function option, and displays the N second function options associated with the first function option in the third area of the display screen.
  • the user operates by hand, and the first distance value is set to 20mm.
  • the first distance value is set to 20mm.
  • the distance between the operating finger of the user's operating hand and the display screen is less than 20 mm. If the distance is greater than or equal to 20mm, the second function option will not be displayed on the display screen. If the distance is less than 20mm, the display screen displays the corresponding N second function options at the position below the operating finger.
  • the user can make a first input to the electronic device through the first operating body, and a second input to the electronic device through the second operating body, so that the electronic device can realize cooperative manipulation of the first operating body and the second operating body,
  • the user can use the functions of the electronic equipment conveniently and quickly, thereby greatly improving the operation efficiency of the electronic equipment.
  • the distance value between the second operating body and the display screen is smaller than the first distance value
  • display in the second area of the display screen There are N second function options associated with the first function option, so the user can operate the electronic device without directly touching the display screen.
  • the position of the second area in the display screen is associated with the positional relationship between the second operating body and the display screen, so as to facilitate user operations.
  • FIG. 8 is the fourth schematic flow diagram of the control method provided by the embodiment of the present application.
  • the method is applied to an electronic device with a display screen and includes the following steps:
  • a first function option is displayed in the first area of the display screen.
  • the first operating body includes a holding hand of a user.
  • the second operating body includes a user's operating hand or an operating tool controlled by the operating hand.
  • the electronic device can perceive the position, action and shape of the object to be measured through sensing devices such as ultrasonic sensors and laser sensors, so that it can recognize that the second operating body is in the horizontal direction parallel to the display screen. A mobile situation.
  • the S804 further includes:
  • control the display screen When the first movement of the second operating body occurs in the horizontal direction parallel to the display screen, and the distance value between the second operating body and the display screen is less than the first distance value and greater than the second distance value, control the display screen The second area of the display screen cancels displaying the N second function options associated with the first function option, and displays the N second function options associated with the first function option in the third area of the display screen.
  • the user operates by hand, and the first distance value is set to 20 mm, and the second distance value is set to 5 mm.
  • the first distance value is set to 20 mm
  • the second distance value is set to 5 mm.
  • the user moves the operating finger, and the corresponding N second function options will also move following the movement of the operating finger. If the distance between the operating finger and the display screen is less than 5mm, the N second function options will be fixed on the display screen and will no longer move with the finger, which is convenient for the user to perform click operations.
  • Fig. 9 is one of the schematic diagrams of the interface of the electronic device provided by another embodiment of the present application, which is applied to the painting scene, except for recognizing the operating finger of the operating hand, so as to display the second function according to the position of the operating finger option.
  • the user can also operate through the first operating body, such as the stylus shown in FIG. 9 .
  • a second function option appears nearby.
  • the second function option is function sub-option information.
  • Figure 10 is the second schematic diagram of the interface of the electronic device provided by another embodiment of the present application.
  • the recognition curve ruler will be displayed The position on the screen, the function sub-option information appears next to the curve ruler.
  • the function sub-option information can be set to move with the position of the first operating body or the second operating body.
  • the second operating body When the second operating body is placed on the display screen, the second operating body will be moved.
  • the function sub-option information will also be moved.
  • the two-handed operation mode can also customize shortcut operation gestures, and the shortcut operation gestures correspond to specific operation functions.
  • Start the two-handed operation mode and you can perform the options of inserting pictures, inserting shapes, and inserting tables (function options). If the user places the thumb and forefinger of the holding hand on the border at the same time, the function of inserting the table can be quickly started, and the user can also perform several rows and several rows of the table according to the two-finger kneading action formed by the thumb and forefinger of the holding hand. Column selection.
  • the user's operation uses the operating finger (such as the index finger) to move the position, and the preview image of the table will be inserted into the position where the operating finger stays, and it can be inserted into the text file by clicking the display screen. In this way, the user can realize quick control of the electronic device through the shortcut operation gesture.
  • the operating finger such as the index finger
  • the electronic device can realize the cooperative control of the first operating body and the second operating body, so that the user can use the functions of the electronic device conveniently and quickly, thereby greatly improving the operating efficiency of the electronic device and improving the user experience. experience.
  • the execution subject may be an electronic device, a control device, or a control module in the control device for executing the control method.
  • the control device provided in the embodiment of the present application is described by taking the control device executing the control method as an example.
  • FIG. 11 is a schematic structural diagram of a control device provided in an embodiment of the present application.
  • the control device 1100 is applied to an electronic device with a display screen.
  • the control device 1100 includes:
  • the first display module 1101 is configured to display the first function option in the first area of the display screen.
  • the first receiving module 1102 is used for the first input of the first function option by the first operating body.
  • the second display module 1103 is configured to display N associated with the first function option in the second area of the display screen in response to the first input when the distance between the second operating body and the display screen satisfies a preset condition.
  • the position of the second area in the display screen is associated with the positional relationship between the second operating body and the display screen.
  • the second receiving module 1104 is configured to receive a second input of a target function option among the N second function options by the second operator.
  • a function executing module 1105 configured to execute the function corresponding to the target function option in response to the second input.
  • control device 1100 further includes:
  • a third receiving module configured to receive a pressing operation of the electronic device by the first operating body before the first function option is displayed in the first area of the display screen;
  • the first display module 1101 is specifically configured to display a first function option in the first area of the display screen when the pressure value of the pressing operation is greater than a predetermined pressure value;
  • control device 1100 further includes:
  • the cancel display module is configured to cancel the display of the first function option when the first operating body cancels the pressing operation on the electronic device after the first function option is displayed in the first area.
  • the second display module 1103 includes:
  • the distance acquisition sub-module is configured to acquire the distance value between the second operating body and the display screen.
  • the display submodule is configured to display N second function options associated with the first function options in the second area of the display screen in response to the first input if the distance value is smaller than the first distance value.
  • control device 1100 further includes:
  • the third display module is configured to control the second area of the display screen to cancel the display of N second functions associated with the first function option when the second operating body moves in the horizontal direction parallel to the display screen for the first time. option, and display N second function options associated with the first function option in the third area of the display screen.
  • the third display module is specifically configured to perform the first movement of the second operating body in a horizontal direction parallel to the display screen, and the distance between the second operating body and the display screen is smaller than the first distance value And when it is greater than the second distance value, the second area of the control display screen cancels displaying the N second function options associated with the first function option, and displays the N number associated with the first function option in the third area of the display screen. a secondary function option.
  • the first operating body is a holding hand for holding the electronic device
  • the second operating body includes the operating hand or an operating tool controlled by the operating hand.
  • the control device 1100 in the embodiment of the present application may be a device, and may also be a component, an integrated circuit, or a chip in a terminal.
  • the device may be a mobile electronic device or a non-mobile electronic device.
  • the mobile electronic device can be a mobile phone, a tablet computer, a notebook computer, a palmtop computer, a vehicle electronic device, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant).
  • non-mobile electronic equipment can be server, network attached storage (NetworkAttached Storage, NAS), personal computer (personal computer, PC), television (television, TV), teller machine or self-service machine, etc., the embodiment of the present application Not specifically limited.
  • NetworkAttached Storage NetworkAttached Storage, NAS
  • personal computer personal computer, PC
  • television television
  • teller machine or self-service machine etc.
  • the control device 1100 in the embodiment of the present application may be a device with an operating system.
  • the operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, which are not specifically limited in this embodiment of the present application.
  • the control device 1100 provided in the embodiment of the present application can implement various processes implemented in the embodiment of the method for the operation of the electronic equipment in FIGS. 1 to 10 . To avoid repetition, details are not repeated here.
  • the control device 1100 of the embodiment of the present application can realize the coordinated control of the first operating body and the second operating body on the electronic device, so that the user can use the functions of the electronic device conveniently and quickly, thereby greatly improving the operating efficiency of the electronic device and improving user experience.
  • the embodiment of the present application further provides an electronic device 500, including a processor 501, a memory 502, and programs or instructions stored in the memory 502 and operable on the processor 501,
  • an electronic device 500 including a processor 501, a memory 502, and programs or instructions stored in the memory 502 and operable on the processor 501,
  • the program or instruction is executed by the processor 501, each process of the above-mentioned control method embodiment can be realized, and the same technical effect can be achieved. To avoid repetition, details are not repeated here.
  • the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.
  • FIG. 13 is a schematic structural diagram of an electronic device implementing an embodiment of the present application.
  • the electronic device 600 includes but is not limited to: a radio frequency unit 601, a network module 602, an audio output unit 603, an input unit 604, a sensor 605, a display unit 606, a user input unit 607, an interface unit 608, a memory 609, and a processor 610, etc. part.
  • processor 610 is configured to:
  • N second function options associated with the first function option are displayed in the second area of the display screen, and the second The position of the area on the display screen is associated with the positional relationship between the second operating body and the display screen.
  • a function corresponding to the target function option is executed.
  • the processor 610 is further configured to:
  • the displaying the first function option in the first area of the display screen includes:
  • the processor 610 is further configured to:
  • N second functional options associated with one functional option including:
  • N second function options associated with the first function options are displayed in a second area of the display screen.
  • processor 610 is further configured to:
  • controlling the second area of the display screen to cancel the display of the first function option Associated N second function options, and display N second function options associated with the first function options in the third area of the display screen including:
  • the first operating body is a holding hand for holding the electronic device
  • the second operating body includes an operating hand or an operating tool controlled by the operating hand.
  • the radio frequency unit 601 can be used for receiving and sending signals during sending and receiving information or during a call. Specifically, the downlink data from the base station is received and processed by the processor 610; in addition, the Uplink data is sent to the base station.
  • the radio frequency unit 601 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like.
  • the radio frequency unit 601 can also communicate with the network and other devices through a wireless communication system.
  • the electronic device provides users with wireless broadband Internet access through the network module 602, such as helping users send and receive emails, browse web pages, and access streaming media.
  • the audio output unit 603 may convert audio data received by the radio frequency unit 601 or the network module 602 or stored in the memory 609 into an audio signal and output as sound. Also, the audio output unit 603 may also provide audio output related to a specific function performed by the electronic device 600 (eg, call signal reception sound, message reception sound, etc.).
  • the audio output unit 603 includes a speaker, a buzzer, a receiver, and the like.
  • the input unit 604 is used for receiving audio or video signals. It should be understood that, in the embodiment of the present application, the input unit 604 may include a graphics processing unit (Graphics Processing Unit, GPU) 6041 and a microphone 6042, and the graphics processing unit 6041 is compatible with an image capture device (such as Camera) to process the image data of still pictures or videos.
  • a graphics processing unit Graphics Processing Unit, GPU
  • an image capture device such as Camera
  • the electronic device 600 also includes at least one sensor 605, such as a light sensor, a motion sensor, and other sensors.
  • the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 6061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 6061 and the / or backlighting.
  • the accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is still, and can be used to identify the posture of electronic equipment (such as horizontal and vertical screen switching, related games) , magnetometer posture calibration), vibration recognition-related functions (such as pedometer, knocking), etc.; the sensor 605 can also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, Infrared sensors, etc., will not be repeated here.
  • the display unit 606 is used to display information input by the user or information provided to the user.
  • the display unit 606 may include a display panel 6061, and the display panel 6061 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an organic light-emitting diode (Organic Light-Emitting Diode, OLED), or the like.
  • LCD Liquid Crystal Display
  • OLED Organic Light-Emitting Diode
  • the user input unit 607 can be used to receive input numbers or character information, and generate key signal input related to user settings and function control of the electronic device.
  • the user input unit 607 includes a touch panel 6071 and other input devices 6072 .
  • the touch panel 6071 also referred to as a touch screen, can collect the user's touch operations on or near it (for example, the user uses any suitable object or accessory such as a finger or a stylus on the touch panel 6071 or near the touch panel 6071). operate).
  • the touch panel 6071 may include two parts, a touch detection device and a touch controller.
  • Other input devices 6072 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, and joysticks, which will not be repeated here.
  • the interface unit 608 is an interface for connecting an external device to the electronic device 600 .
  • an external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, audio input/output (I/O) ports, video I/O ports, headphone ports, and more.
  • the interface unit 608 can be used to receive input from an external device (for example, data information, power, etc.) transfer data between devices.
  • the memory 609 can be used to store software programs as well as various data.
  • the memory 609 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, at least one application program required by a function (such as a sound playback function, an image playback function, etc.); Data created by the use of mobile phones (such as audio data, phonebook, etc.), etc.
  • the memory 609 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices.
  • the processor 610 is the control center of the electronic device, and uses various interfaces and lines to connect various parts of the entire electronic device, by running or executing software programs and/or modules stored in the memory 609, and calling data stored in the memory 609 , to perform various functions of the electronic equipment and process data, so as to monitor the electronic equipment as a whole.
  • the processor 610 may include one or more processing units; preferably, the processor 610 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface and application programs, etc., and the modem
  • the processor mainly handles wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 610 .
  • the electronic device 600 can also include a power supply (such as a battery) for supplying power to various components, and the power supply can be logically connected to the processor 610 through the power management system, so that the management of charging, discharging, and function can be realized through the power management system. Consumption management and other functions.
  • the structure of the electronic device shown in FIG. 13 does not constitute a limitation to the electronic device.
  • the electronic device may include more or fewer components than shown in the figure, or combine some components, or arrange different components, and details will not be repeated here.
  • electronic devices include but are not limited to mobile phones, tablet computers, notebook computers, palmtop computers, vehicle terminals, wearable devices (such as bracelets, glasses), and pedometers.
  • the embodiment of the present application also provides a readable storage medium.
  • the readable storage medium stores programs or instructions.
  • the program or instructions are executed by the processor, the various processes of the above-mentioned control method embodiments can be achieved, and the same Technical effects, in order to avoid repetition, will not be repeated here.
  • the processor is the processor in the electronic device described in the above embodiments.
  • the readable storage medium includes computer readable storage medium, such as computer read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk, etc.
  • the embodiment of the present application further provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement each of the above control method embodiments process, and can achieve the same technical effect, in order to avoid repetition, it will not be repeated here.
  • chips mentioned in the embodiments of the present application may also be called system-on-chip, system-on-chip, system-on-a-chip, or system-on-a-chip.
  • the embodiment of the present application further provides a computer program product, the computer program product is stored in a non-volatile storage medium, and the computer program product is executed by at least one processor to implement the various processes of the above method embodiments, And can achieve the same technical effect, in order to avoid repetition, no more details here.
  • the term “comprising”, “comprising” or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, method, article, or device. Without further limitations, an element defined by the phrase “comprising a " does not preclude the presence of additional identical elements in the process, method, article, or apparatus comprising that element.
  • the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved. Functions are performed, for example, the described methods may be performed in an order different from that described, and various steps may also be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.
  • the methods of the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is better implementation.
  • the technical solution of the present application can be embodied in the form of a software product in essence or the part that contributes to the prior art, and the computer software product is stored in a storage medium (such as ROM/RAM, disk, CD) contains several instructions to enable a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in various embodiments of the present application.
  • a terminal which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请涉及通信技术领域,公开了一种控制方法、装置、电子设备和存储介质。方法包括:在显示屏的第一区域显示第一功能选项,并接收第一操作体对第一功能选项的第一输入;在第二操作体与显示屏之间的距离满足预设条件的情况下,响应于第一输入,在显示屏的第二区域显示与第一功能选项关联的N个第二功能选项,第二区域在显示屏中的位置,与第二操作体和显示屏之间的位置关系相关联;接收第二操作体对第二功能选项中目标功能选项的第二输入;响应于第二输入,执行与目标功能选项对应的功能。

Description

控制方法、装置、电子设备和存储介质
相关申请的交叉引用
本申请主张在2021年08月11日在中国提交的中国专利申请No.202110918533.8的优先权,其全部内容通过引用包含于此。
技术领域
本申请属于通信技术领域,具体涉及一种控制方法、装置、电子设备和存储介质。
背景技术
当前,电子设备的显示屏越来越大,绘画、办公、学习等场景在电子设备的上应用也越来越广泛。用户在使用大屏电子设备进行绘画、办公、学习等时,往往会使用双手进行操作,主要是使用单手依次点击进行操作,例如在办公软件WPS中,若用户想要插入表格,先使用食指先选择插入功能,再选择图表功能,最后选择插入几行几列,才能完成一次操作。在进行这类操作时,用户的另一只手往往只是用于握持设备,没有得到充分利用,因此极大拖累操作效率。
可见,现有使用单手依次点击进行操控的方法,主要存在以下问题:单手依次点击所需时间长,整体操作效率低。
发明内容
本申请实施例的目的是提供一种控制方法、装置、电子设备和存储介质,能够解决现有电子设备的操作效率过低的问题。
为了解决上述技术问题,本申请是这样实现的:
第一方面,本申请实施例提供了一种控制方法,应用于具有显示屏的电子设备,所述方法包括:
在所述显示屏的第一区域显示第一功能选项,并接收第一操作体对所述第一功能选项的第一输入;
在第二操作体与所述显示屏之间的距离满足预设条件的情况下,响应于所述第一输入,在所述显示屏的第二区域显示与所述第一功能选项关联的N个第二功能选项,所述第二区域在所述显示屏中的位置,与所述第二操作体和所述显示屏之间的位置关系相关联;
接收所述第二操作体对所述N个第二功能选项中目标功能选项的第二输入;
响应于所述第二输入,执行与所述目标功能选项对应的功能。
第二方面,本申请实施例提供了一种控制装置,应用于具有显示屏的电子设备,所述装置包括:
第一显示模块,用于在所述显示屏的第一区域显示第一功能选项;
第一接收模块,用于接收第一操作体对所述第一功能选项的第一输入;
第二显示模块,用于在第二操作体与所述显示屏之间的距离满足预设条件的情况下,响应于所述第一输入,在所述显示屏的第二区域显示与所述第一功能选项关联的N个第二功能选项,所述第二区域在所述显示屏中的位置,与所述第二操作体和所述显示屏之间的位置关系相关联;
第二接收模块,用于接收所述第二操作体对所述N个第二功能选项中目标功能选项的第二输入;
功能执行模块,用于响应于所述第二输入,执行与所述目标功能选项对应的功能。
第三方面,本申请实施例提供了一种电子设备,该电子设备包括:处理器,存储器及存储在所述存储器上并可在所述处理器上运行的程序或指令,所述程序或所述指令被所述处理器执行时实现如第一方面所述控制方法的步骤。
第四方面,本申请实施例提供了一种可读存储介质,所述可读存储介质上存储程序或指令,所述程序或指令被处理器执行时实现如第一方面所述控制方法的步骤。
第五方面,本申请实施例提供了一种芯片,所述芯片包括处理器和通信接口,所述通信接口和所述处理器耦合,所述处理器用于运行程序或指令,实现如第一方面所述的方法。
第六方面,本申请实施例提供了一种计算机程序产品,所述计算机程序产品被存储在非易失的存储介质中,所述程序产品被至少一个处理器执行以实现如第一方面所述的方法的步骤。
第七方面,本申请实施例提供了一种电子设备,所述电子设备被配置成用于执行如第一方面所述的方法。
在本申请实施例中,首先在电子设备的显示屏的第一区域显示第一功能选项,在第二操作体与显示屏之间的距离满足预设条件的情况下,响应于第一操作体对第一功能选项的第一输入,在显示屏的第二区域显示与第一功能选项关联的N个第二功能选项,第二区域在显示屏中的位置,与第二操作体和显示屏之间的位置关系相关联;响应于第二操作体对第二功能选项中目标功能选项的第二输入,控制电子设备执行与目标功能选项对应的功能。借此,电子设备能够实现第一操作体和第二操作体配合操控,使得用户可方便、快速地使用电子设备的功能,从而大幅提高了电子设备的操作效率,提升了用户体验。
附图说明
图1是本申请实施例提供的控制方法的流程示意图之一;
图2是本申请实施例提供的电子设备安装超声波传感器的结构示意图;
图3A是双手操作手势之单手握持,异手操作的示意图;
图3B是双手操作手势之双手握持,双手操作的示意图;
图4是本申请一实施例提供的电子设备的界面示意图之一;
图5是本申请一实施例提供的电子设备的界面示意图之二;
图6是本申请实施例提供的控制方法的流程示意图之二;
图7是本申请实施例提供的控制方法的流程示意图之三;
图8是本申请实施例提供的控制方法的流程示意图之四;
图9是本申请又一实施例提供的电子设备的界面示意图之一;
图10是本申请又一实施例提供的电子设备的界面示意图之二;
图11是本申请实施例提供的控制装置的结构示意图;
图12是本申请实施例提供的电子设备的结构示意图;
图13是本申请实施例提供的电子设备的结构示意图。
具体实施方式
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。
本申请的说明书和权利要求书中的术语“第一”、“第二”等是用于区别类似的对象,而不用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便本申请的实施例能够以除了在这里图示或描述的那些以外的顺序实施。此外,说明书以及权利要求中“和/或”表示所连接对象的至少其中之一,字符“/”,一般表示前后关联对象是一种“或”的关系。
下面结合附图,通过具体的实施例及其应用场景,对本申请实施例提供的控制方法进行详细地说明。
参见图1,图1是本申请实施例提供的控制方法的流程示意图之一,所述方法应用于具有显示屏的电子设备,包括以下步骤:
S101,在显示屏的第一区域显示第一功能选项,并接收第一操作体对第一功能选项的第一输入。
可选地,所述第一操作体为握持电子设备的握持用手。所述第一输入可以是点击操作、长按操作或者滑动操作等。例如,用户可通过握持用手的一个握持手指长按第一功能选项,来选中所述第一功能选项以便进一步操作。
可选地,所述第一区域为所述第一操作体对应的预定范围内的区域。可选地,第一功能选项显示于第一操作体的附近,即第一功能选项与第一操作体之间的距离小于预定的距离阈值,例如距离阈值可设为3厘米,以便于用户通过第一操作体进一步操作第一功能选项。
S102,在第二操作体与显示屏之间的距离满足预设条件的情况下,响应 于第一输入,在显示屏的第二区域显示与第一功能选项关联的N个第二功能选项,第二区域在显示屏中的位置,与第二操作体和显示屏之间的位置关系相关联。
可选地,所述第二操作体包括操作用手或操作用手控制的操作工具。本申请中用户不仅可通过操作用手的操作手指来操作电子设备,还可以通过操作用手握持的操作工具来操作电子设备。可选地,所述操作工具包括手写笔、尺子等。
可选地,当第二操作体与显示屏之间的距离值小于第一距离值时,在显示屏的第二区域显示与第一功能选项关联的N个第二功能选项。所述N个第二功能选项可选为第一功能选项的下一级功能选项。所述N为大于或等于1的自然数。
可选地,所述第二功能选项显示于第二区域,所述第二区域为所述第二操作体对应的预定范围内的区域。例如,第二功能选项显示于操作用手的下方,以便于用户通过操作用手进一步操作第二功能选项。
可选地,所述电子设备可获取第二操作体的位置、形状、动作或者移动轨迹。而且,电子设备的感测设备能够中近距离感知显示屏之外用户的手指位置和动作,用户无需直接接触显示屏,即可实现对电子设备的操作,不仅整个电子设备的边框和背面都可实现点击、滑动等操作,而且用户也可以通过隔空手势实现对电子设备的操作。
可选地,以电子设备的显示屏的中心点为原点,建立空间坐标系。获取用户各个手指的轨迹点(Xn,Yn,Zn),进一步可识别用户操作用手的操作手指,获取该操作手指在各个时间点的位置。从而可判断出操作手指的移动方向和轨迹。
S103,接收第二操作体对N个第二功能选项中目标功能选项的第二输入。
所述第二输入可以是点击操作、长按操作或者滑动操作等。
S104,响应于第二输入,执行与目标功能选项对应的功能。
可选地,所述目标功能选项对应的功能,包括但不限于启动应用、执行 应用中特定功能、关闭应用等。
可选地,所述第一操作体为握持电子设备的握持用手,第二操作体包括操作用手或操作用手控制的操作工具。例如,用户左手握持电子设备,右手操作电子设备,那么第一操作体为用户的左手,第二操作体为用户的右手。
可选地,所述电子设备可通过超声传感器、激光传感器等感测设备来感知待测对象的位置、动作以及形状,从而识别出用户的握持用手、操作用手或操作工具。所述操作工具包括手写笔、尺子等,用户可以通过操作用手控制操作工具,在电子设备的显示屏上进行触控操作。
其中,所述感测设备可选为超声波传感器。超声波碰到杂质或分界面会产生显著反射形成反射回波,而且碰到活动物体能产生多普勒效应,因此超声波具有感知物体的位置、动作以及形状的能力。超声波传感器已被广泛利用在游戏手机等电子设备上,例如游戏手机即可实现在手机上自定义操作的位置和方式,以提供更好的游戏体验。所述电子设备包括但不限于手机、平板电脑、笔记本电脑、掌上电脑、车载电子设备、可穿戴设备、上网本或者个人数字助理等。
可选地,所述电子设备上可安装有多个超声波传感器,如图2所示,在电子设备上安装了呈对称排列的八个超声波传感器。八个超声波传感器可分别向待测对象发射超声波,提高感应物体的准确度。值得提醒的是,所述电子设备安装的超声波传感器的个数不受限制,用户可以根据实际需求设置一个或任意多个超声波传感器。
可选地,所述感测设备还可以是激光传感器,利用激光传感器发出和接收的激光束,来感知待测对象的位置、动作以及形状,从而识别出用户的握持用手、操作用手或操作用手控制的操作工具。
本申请电子设备能够感知待测对象的位置、动作以及形状,能够识别出用户的握持用手、操作用手或操作用手控制的操作工具,进一步实现双手配合操控。
可选地,所述电子设备在执行预定的应用时,会自动启动感测设备。例 如,电子设备在启动目标应用如绘画应用、办公应用或学习应用等后,后台会自动启动感测设备。当然,所述电子设备也可以由用户输入指令来启动感测设备;或者,所述电子设备始终开启感测设备。
目前主流的双手操作手势主要有以下两种:
(1)单手握持,异手操作方式:如图3A中所示,具体又可包括左手握持(即左手为握持用手),右手大拇指或食指操控(即右手为操作用手)。当然,用户也可以采用右手握持(即右手为握持用手),左手大拇指或食指操控(即左手为操作用手)等,图中未示。
(2)双手握持,双手操作方式:如图3B所示,具体又可包括双手水平握持,双手拇指操控;或者双手竖向握持,双手拇指操控。
本申请双手操作手势可选为单手握持,异手操作方式。
可选地,通过超声波获取所述待测对象的位置、动作和/或形状;根据所述待测对象的位置、动作和/或形状,识别判断出所述待测对象是否符合预定的握持用手要素或操作体要素;若所述待测对象符合所述握持用手要素,则识别出所述待测对象为所述握持用手;若所述待测对象符合所述操作体要素,则识别出所述待测对象为操作体。
可选地,用户在握持电子设备时,用户的握持用手最少有三根手指与电子设备的边框相接触,进一步,可根据手指与电子设备的边框的接触点个数,来判断用户的操作姿势,即可判断用户是哪只手握持设备,哪只手进行操控。具体而言,根据所述待测对象的位置、动作和/或形状,判断所述待测对象与所述电子设备的边框的接触点是否大于或等于三个;若所述接触点大于或等于三个,则识别出所述待测对象为所述第一操作体;若所述接触点小于三个,则识别出所述待测对象为所述第二操作体。
上述判断完成后,可关闭感测设备,以减少感测设备对系统资源的损耗。当然,所述电子设备也可始终开启感测设备。
值得提醒的是,本申请中的握持用手也可以对电子设备进行操作,但只要该手用于握持电子设备,即使该手也用于操作,依然定义为握持用手。而 操作用手仅仅用于通过手指或操作工具来操作电子设备,不具有握持功能。
图4~图5示出本申请一实施例提供的电子设备的界面,本实施例应用于绘画场景时,在握持用手的大拇指附近显示出包含画笔、颜色、工具三种功能的菜单栏,如图4所示。接下来,判断用户选中的功能,也即第一功能选项。例如,通过超声波感知到握持用手的拇指的长按位置在画笔功能上,说明用户选中的是画笔功能,也即第一功能选项为画笔功能。若通过电子设备识别出用户的操作用手与显示屏之间的距离小于预定的距离阈值时,在操作用手下方的显示屏区域显示画笔功能对应的各种画笔类型选项,也即N个第二功能选项。如图5所示,若电子设备感知到握持用手的拇指的长按位置在颜色功能上,说明用户选中的是颜色功能。若电子设备识别到用户的操作用手与显示屏之间的距离小于预定的距离阈值时,在操作用手下方的显示屏区域显示颜色功能对应的各种颜色选项。若用户要选中颜色,则根据获取的操作用手的操作手指(如食指)位置,进行下一步的颜色选中。
本实施例中,电子设备能够实现第一操作体和第二操作体配合操控,使得用户可方便、快速地使用电子设备的功能,从而大幅提高了电子设备的操作效率,提升了用户体验。
尤其是,本实施例通过利用超声波或激光等的定位原理,实现获取用户的手指位置和位移方向,判断用户的握持用手、操作用手或操作用手控制的操作工具,并且通过双手配合操作,实现功能的快捷触控。识别用户左右手承担的职责,符合用户的使用习惯,并且通过双手配合操作的方式,让用户可快捷地选择想要的功能,从而提高大屏电子设备在目标场景,例如绘画、办公、学习场景的操作效率。
参见图6,图6是本申请实施例提供的控制方法的流程示意图之二,所述方法应用于具有显示屏的电子设备,包括以下步骤:
S601,接收第一操作体对电子设备的按压操作。
可选地,第一操作体为握持电子设备的握持用手。
可选地,所述按压操作为第一操作体(如握持用手的握持手指)对电子 设备的预定的触发区域的按压操作,所述触发区域包括电子设备的边框、显示屏或背面等。
例如,用户的第一操作体长按电子设备的边框,会触发生成按压操作。所述第一操作体主要用于触发指令,进入双手操作模式。这样可避免影响操作用手的操作,保证在实现双手配合操作时,不会对原有的交互逻辑造成影响。
S602,在按压操作的压力值大于预定的压力值的情况下,在显示屏的第一区域显示第一功能选项。
可选地,本步骤包括:获取按压操作的压力,判断按压操作的压力是否大于预定的压力值,若是则在显示屏的第一区域显示第一功能选项,否则返回S601。
可选地,用户的握持用手的握持手指长按电子设备的边框,且按压压力大于压力值时,进入双手操作模式,同时启动感测设备。当然,若感测设备始终是开启状态,则可省略启动感测设备的步骤。若大于压力值,则触发双手操作模式,即可以双手配合操控,并显示第一功能选项。
可选地,所述第一功能选项显示于第一区域,所述第一区域为所述握持用手对应的预定范围内的区域。可选地,第一功能选项显示于握持用手的附近,即第一功能选项与握持用手的握持手指之间的距离小于预定的距离值,例如距离值可设为3厘米,以便于用户通过握持用手的握持手指进一步操作第一功能选项。
S603,接收第一操作体对第一功能选项的第一输入。
S604,在第二操作体与显示屏之间的距离满足预设条件的情况下,响应于第一输入,在显示屏的第二区域显示与第一功能选项关联的N个第二功能选项,第二区域在显示屏中的位置,与第二操作体和显示屏之间的位置关系相关联。
可选地,第二操作体包括操作用手或操作用手控制的操作工具。
S605,接收第二操作体对N个第二功能选项中目标功能选项的第二输入。
S606,响应于第二输入,执行与目标功能选项对应的功能。
S607,在第一操作体取消对电子设备的按压操作的情况下,取消显示第一功能选项。
可选地,若电子设备识别出握持手指从触发区域移开,则关闭双手操作模式,并取消显示第一功能选项。其中,握持用手的拇指移开触发区域,不再按压时,电子设备将退出双手操作模式。同时可关闭感测设备,整个流程结束。
其中,所述S603~S606的具体实施方式可以参见S101~S104中的描述,此处不再赘述。
本实施例中,用户可以通过第一操作体对电子设备的按压操作和第一输入,以及第二操作体对电子设备的第二输入,进而电子设备能实现第一操作体和第二操作体配合操控,使得用户可方便、快速地使用电子设备的功能,从而大幅提高了电子设备的操作效率。
参见图7,图7是本申请实施例提供的控制方法的流程示意图之三,所述方法应用于具有显示屏的电子设备,包括以下步骤:
S701,在显示屏的第一区域显示第一功能选项。
S702,接收第一操作体对第一功能选项的第一输入。
可选地,所述第一操作体包括用户的握持用手。
S703,获取第二操作体与显示屏之间的距离值。
可选地,所述第二操作体包括用户的操作用手或操作用手控制的操作工具。所述第二操作体与显示屏之间的当前距离包括:用户的操作用手与显示屏之间的当前距离;或者,操作工具与显示屏之间的当前距离。
可选地,所述电子设备可通过超声传感器、激光传感器等感测设备来感知待测对象的位置、动作以及形状,从而可识别出操作用手或操作用手控制的操作工具与显示屏之间的距离值。
S704,判断若距离值是否小于第一距离值,若是则执行S705,否则继续执行S703。
S705,若距离值小于第一距离值,则响应于第一输入,在显示屏的第二区域显示与第一功能选项关联的N个第二功能选项。所述第二区域在显示屏中的位置,与第二操作体和显示屏之间的位置关系相关联。
可选地,所述S705之后还包括:
在第二操作体在与显示屏平行的水平方向上发生第一移动的情况下,控制显示屏的第二区域取消显示与第一功能选项关联的N个第二功能选项,并在显示屏的第三区域显示与第一功能选项关联的N个第二功能选项。
可选地,上述步骤还包括:
在第二操作体在与显示屏平行的水平方向上发生第一移动、以及第二操作体与显示屏之间的距离值小于第一距离值且大于第二距离值的情况下,控制显示屏的第二区域取消显示与第一功能选项关联的N个第二功能选项,并在显示屏的第三区域显示与第一功能选项关联的N个第二功能选项。
S706,接收第二操作体对N个第二功能选项中目标功能选项的第二输入。
S707,响应于第二输入,执行与目标功能选项对应的功能。
其中,所述S701~S803、S706~S707的具体实施方式可以参见S101~S105中的描述,此处不再赘述。
在一具体实施例中,用户通过操作用手来操作,且第一距离值被设定为20mm。首先,判断用户的操作用手的操作手指距离显示屏是否小于20mm。若距离大于或等于20mm时,显示屏上不显示第二功能选项。若距离小于20mm,显示屏在操作手指下方的位置显示对应的N个第二功能选项。
本实施例中,用户可以通过第一操作体对电子设备的第一输入,以及第二操作体对电子设备的第二输入,进而电子设备能实现第一操作体和第二操作体配合操控,使得用户可方便、快速地使用电子设备的功能,从而大幅提高了电子设备的操作效率。尤其是,本实施例中在第二操作体与显示屏之间的距离值小于第一距离值的情况下,响应于用户对第一功能选项的第一输入,在显示屏的第二区域显示与第一功能选项关联的N个第二功能选项,因此用户可以无需直接接触显示屏即可实现对电子设备的操作。其次,另外,第二 区域在显示屏中的位置,与第二操作体和显示屏之间的位置关系相关联,以方便用户操作。
参见图8,图8是本申请实施例提供的控制方法的流程示意图之四,所述方法应用于具有显示屏的电子设备,包括以下步骤:
S801,显示屏的第一区域显示第一功能选项。
S802,接收第一操作体对第一功能选项的第一输入。
可选地,所述第一操作体包括用户的握持用手。
S803,在第二操作体与显示屏之间的距离满足预设条件的情况下,响应于第一输入,在显示屏的第二区域显示与第一功能选项关联的N个第二功能选项,第二区域在显示屏中的位置,与第二操作体和显示屏之间的位置关系相关联。
可选地,所述第二操作体包括用户的操作用手或操作用手控制的操作工具。
S804,在第二操作体在与显示屏平行的水平方向上发生第一移动的情况下,控制显示屏的第二区域取消显示与第一功能选项关联的N个第二功能选项,并在显示屏的第三区域显示与第一功能选项关联的N个第二功能选项。
可选地,所述电子设备可通过超声传感器、激光传感器等感测设备来感知待测对象的位置、动作以及形状,从而可识别出第二操作体在与显示屏平行的水平方向上发生第一移动的情况。
可选地,所述S804进一步包括:
在第二操作体在与显示屏平行的水平方向上发生第一移动、以及第二操作体与显示屏之间的距离值小于第一距离值且大于第二距离值的情况下,控制显示屏的第二区域取消显示与第一功能选项关联的N个第二功能选项,并在显示屏的第三区域显示与第一功能选项关联的N个第二功能选项。
S805,接收第二操作体对N个第二功能选项中目标功能选项的第二输入。
S806,响应于第二输入,执行与目标功能选项对应的功能。
其中,所述S801~S803、S805~S806的具体实施方式可以参见S101~S105 中的描述,此处不再赘述。
在另一具体实施例中,用户通过操作用手来操作,且第一距离值被设定为20mm,第二距离值被设定为5mm。首先,判断用户的操作用手的操作手指距离显示屏是否小于20mm。若距离大于或等于20mm时,显示屏上不显示第二功能选项。若距离小于20mm,显示屏在操作手指下方的位置显示对应的N个第二功能选项。进一步地,判断用户的操作用手的操作手指距离显示屏是否小于5mm。若操作手指和显示屏的距离在5mm~20mm之间,则用户移动操作手指,对应的N个第二功能选项也会跟随操作手指的移动而移动。若操作手指和显示屏的距离小于5mm,则N个第二功能选项将固定在显示屏上,不再随手指进行移动,便于用户进行点击操作等。
现有技术中,用户在操作电子设备时,显示屏无法感知显示屏外用户的手指动作,且无法进行双手配合进行操控。而本申请通过在电子设备感知物体距离、形状的能力,使电子设备的整个边框、背面都可操作,并且能感知显示屏外用户的手指动作、位置,来完成双手配合操作,以提高用户整体操作效率。而且,用户无需直接接触显示屏即可实现对电子设备的操作。
为了便于理解本方案,以下结合电子设备的界面示意图对本申请的具体实施例进行举例说明。
图9是本申请又一实施例提供的电子设备的界面示意图之一,该又一实施例应用于绘画场景中,除了识别操作用手的操作手指,以便根据操作手指的位置来显示第二功能选项。用户还可通过第一操作体进行操作,例如图9所示的手写笔。根据第一操作体的位置,在附近出现第二功能选项,本实例中第二功能选项为功能子选项信息。图10是本申请又一实施例提供的电子设备的界面示意图之二,除此之外,用户在大屏设备上使用第二操作体进行辅助作画时,例如曲线尺,将识别曲线尺在显示屏上的位置,在曲线尺旁边出现功能子选项信息。
若第一操作体和第二操作体同时使用时,可设定功能子选项信息将跟随第一操作体或第二操作体的位置进行移动,在第二操作体放置显示屏上时, 移动第二操作体,功能子选项信息也将进行移动。借此,用户可以电子设备能够实现第一操作体和第二操作体配合操控,使得用户可方便、快速地使用电子设备的绘画功能,从而大幅提高了电子设备的绘画操作效率。
再一实施例应用于文本编辑场景中,双手操作模式还可自定义快捷操作手势,而快捷操作手势对应具体的操作功能。启动双手操作模式,可执行插入图片、插入形状、插入表格选项(功能选项)。若用户使用握持用手的拇指和食指同时放置于边框位置时,则可快速启动插入表格功能,用户还可根据握持用手的拇指和食指组合成的双指捏合动作进行表格几行几列的选中。用户的操作用手的操作手指(如食指)移动位置,会将表格的预览图插入到操作手指停留的位置,点击显示屏便可插入到文本文件中。借此,用户可以通过快捷操作手势,实现对电子设备的快速控制。
本申请实施例的控制方法,电子设备能够实现第一操作体和第二操作体配合操控,使得用户可方便、快速地使用电子设备的功能,从而大幅提高了电子设备的操作效率,提升了用户体验。
需要说明的是,本申请实施例提供的控制方法,执行主体可以为电子设备、控制装置,或者该控制装置中的用于执行控制方法的控制模块。本申请实施例中以控制装置执行控制方法为例,说明本申请实施例提供的控制装置。
参见图11,图11是本申请实施例提供的控制装置的结构示意图,所述控制装置1100应用于具有显示屏的电子设备,所述控制装置1100包括:
第一显示模块1101,用于在显示屏的第一区域显示第一功能选项。
第一接收模块1102,用于第一操作体对第一功能选项的第一输入。
第二显示模块1103,用于在第二操作体与显示屏之间的距离满足预设条件的情况下,响应于第一输入,在显示屏的第二区域显示与第一功能选项关联的N个第二功能选项,第二区域在显示屏中的位置,与第二操作体和显示屏之间的位置关系相关联。
第二接收模块1104,用于接收第二操作体对N个第二功能选项中目标功能选项的第二输入。
功能执行模块1105,用于响应于第二输入,执行与目标功能选项对应的功能。
可选地,所述控制装置1100还包括:
第三接收模块,用于在所述显示屏的第一区域显示所述第一功能选项之前,接收所述第一操作体对所述电子设备的按压操作;
所述第一显示模块1101,具体用于在所述按压操作的压力值大于预定的压力值的情况下,在所述显示屏的第一区域显示第一功能选项;
可选地,所述控制装置1100还包括:
取消显示模块,用于在第一区域显示所述第一功能选项之后,在所述第一操作体取消对所述电子设备的按压操作的情况下,取消显示所述第一功能选项。
可选地,所述第二显示模块1103包括:
距离获取子模块,用于获取第二操作体与显示屏之间的距离值。
显示子模块,用于若距离值小于第一距离值,则响应于第一输入,在显示屏的第二区域显示与第一功能选项关联的N个第二功能选项。
可选地,所述控制装置1100还包括:
第三显示模块,用于在第二操作体在与显示屏平行的水平方向上发生第一移动的情况下,控制显示屏的第二区域取消显示与第一功能选项关联的N个第二功能选项,并在显示屏的第三区域显示与第一功能选项关联的N个第二功能选项。
可选地,所述第三显示模块具体用于在第二操作体在与显示屏平行的水平方向上发生第一移动、以及第二操作体与显示屏之间的距离值小于第一距离值且大于第二距离值的情况下,控制显示屏的第二区域取消显示与第一功能选项关联的N个第二功能选项,并在显示屏的第三区域显示与第一功能选项关联的N个第二功能选项。
可选地,所述第一操作体为握持电子设备的握持用手,第二操作体包括操作用手或操作用手控制的操作工具。
本申请实施例中的控制装置1100可以是装置,也可以是终端中的部件、集成电路、或芯片。该装置可以是移动电子设备,也可以为非移动电子设备。示例性的,移动电子设备可以为手机、平板电脑、笔记本电脑、掌上电脑、车载电子设备、可穿戴设备、超级移动个人计算机(ultra-mobile personal computer,UMPC)、上网本或者个人数字助理(personaldigital assistant,PDA)等,非移动电子设备可以为服务器、网络附属存储器(NetworkAttached Storage,NAS)、个人计算机(personal computer,PC)、电视机(television,TV)、柜员机或者自助机等,本申请实施例不作具体限定。
本申请实施例中的控制装置1100可以为具有操作系统的装置。该操作系统可以为安卓(Android)操作系统,可以为ios操作系统,还可以为其他可能的操作系统,本申请实施例不作具体限定。
本申请实施例提供的控制装置1100能够实现图1~图10电子设备的操作的方法实施例实现的各个过程,为避免重复,这里不再赘述。
本申请实施例的控制装置1100,能够电子设备能够实现第一操作体和第二操作体配合操控,使得用户可方便、快速地使用电子设备的功能,从而大幅提高了电子设备的操作效率,提升了用户体验。
可选地,如图12所示,本申请实施例还提供一种电子设备500,包括处理器501,存储器502,存储在存储器502上并可在所述处理器501上运行的程序或指令,该程序或指令被处理器501执行时实现上述控制方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。
需要注意的是,本申请实施例中的电子设备包括上述的移动电子设备和非移动电子设备。
图13是实现本申请实施例的一种电子设备的结构示意图。
该电子设备600包括但不限于:射频单元601、网络模块602、音频输出单元603、输入单元604、传感器605、显示单元606、用户输入单元607、接口单元608、存储器609、以及处理器610等部件。
其中,所述处理器610,用于:
在显示屏的第一区域显示第一功能选项;
接收第一操作体对第一功能选项的第一输入;
在第二操作体与显示屏之间的距离满足预设条件的情况下,响应于第一输入,在显示屏的第二区域显示与第一功能选项关联的N个第二功能选项,第二区域在显示屏中的位置,与第二操作体和显示屏之间的位置关系相关联。
接收第二操作体对N个第二功能选项中目标功能选项的第二输入;
响应于第二输入,执行与目标功能选项对应的功能。
可选地,所述在所述显示屏的第一区域显示第一功能选项之前,所述处理器610,还用于:
接收所述第一操作体对所述电子设备的按压操作;
所述在所述显示屏的第一区域显示第一功能选项,包括:
在所述按压操作的压力值大于预定的压力值的情况下,在所述显示屏的第一区域显示第一功能选项;
所述在所述显示屏的第一区域显示第一功能选项之后,所述处理器610,还用于:
在所述第一操作体取消对所述电子设备的按压操作的情况下,取消显示所述第一功能选项。
可选地,所述在第二操作体与所述显示屏之间的距离满足预设条件的情况下,响应于所述第一输入,在所述显示屏的第二区域显示与所述第一功能选项关联的N个第二功能选项,包括:
获取所述第二操作体与所述显示屏之间的距离值;
若所述距离值小于第一距离值,则响应于所述第一输入,在所述显示屏的第二区域显示与所述第一功能选项关联的N个第二功能选项。
可选地,所述处理器610,还用于:
在所述第二操作体在与所述显示屏平行的水平方向上发生第一移动的情况下,控制所述显示屏的第二区域取消显示与所述第一功能选项关联的N个第二功能选项,并在所述显示屏的第三区域显示与所述第一功能选项关联的 N个第二功能选项。
可选地,所述在所述第二操作体在与所述显示屏平行的水平方向上发生第一移动的情况下,控制所述显示屏的第二区域取消显示与所述第一功能选项关联的N个第二功能选项,并在所述显示屏的第三区域显示与所述第一功能选项关联的N个第二功能选项,包括:
在所述第二操作体在与所述显示屏平行的水平方向上发生第一移动、以及所述第二操作体与所述显示屏之间的距离值小于第一距离值且大于第二距离值的情况下,控制所述显示屏的第二区域取消显示与所述第一功能选项关联的N个第二功能选项,并在所述显示屏的第三区域显示与所述第一功能选项关联的N个第二功能选项。
可选地,所述第一操作体为握持所述电子设备的握持用手,所述第二操作体包括操作用手或所述操作用手控制的操作工具。
应理解的是,本申请实施例中,射频单元601可用于收发信息或通话过程中,信号的接收和发送,具体的,将来自基站的下行数据接收后,给处理器610处理;另外,将上行的数据发送给基站。通常,射频单元601包括但不限于天线、至少一个放大器、收发信机、耦合器、低噪声放大器、双工器等。此外,射频单元601还可以通过无线通信系统与网络和其他设备通信。
电子设备通过网络模块602为用户提供了无线的宽带互联网访问,如帮助用户收发电子邮件、浏览网页和访问流式媒体等。
音频输出单元603可以将射频单元601或网络模块602接收的或者在存储器609中存储的音频数据转换成音频信号并且输出为声音。而且,音频输出单元603还可以提供与电子设备600执行的特定功能相关的音频输出(例如,呼叫信号接收声音、消息接收声音等等)。音频输出单元603包括扬声器、蜂鸣器以及受话器等。
输入单元604用于接收音频或视频信号。应理解的是,本申请实施例中,输入单元604可以包括图形处理器(GraphicsProcessing Unit,GPU)6041和麦克风6042,图形处理器6041对在视频捕获模式或图像捕获模式中由图像 捕获装置(如摄像头)获得的静态图片或视频的图像数据进行处理。
电子设备600还包括至少一种传感器605,比如光传感器、运动传感器以及其他传感器。具体地,光传感器包括环境光传感器及接近传感器,其中,环境光传感器可根据环境光线的明暗来调节显示面板6061的亮度,接近传感器可在电子设备600移动到耳边时,关闭显示面板6061和/或背光。作为运动传感器的一种,加速计传感器可检测各个方向上(一般为三轴)加速度的大小,静止时可检测出重力的大小及方向,可用于识别电子设备姿态(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等;传感器605还可以包括指纹传感器、压力传感器、虹膜传感器、分子传感器、陀螺仪、气压计、湿度计、温度计、红外线传感器等,在此不再赘述。
显示单元606用于显示由用户输入的信息或提供给用户的信息。显示单元606可包括显示面板6061,可以采用液晶显示器(Liquid Crystal Display,LCD)、有机发光二极管(Organic Light-Emitting Diode,OLED)等形式来配置显示面板6061。
用户输入单元607可用于接收输入的数字或字符信息,以及产生与电子设备的用户设置以及功能控制有关的键信号输入。具体地,用户输入单元607包括触控面板6071以及其他输入设备6072。触控面板6071,也称为触摸屏,可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触控面板6071上或在触控面板6071附近的操作)。触控面板6071可包括触摸检测装置和触摸控制器两个部分。其他输入设备6072可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆,在此不再赘述。
接口单元608为外部装置与电子设备600连接的接口。例如,外部装置可以包括有线或无线头戴式耳机端口、外部电源(或电池充电器)端口、有线或无线数据端口、存储卡端口、用于连接具有识别模块的装置的端口、音频输入/输出(I/O)端口、视频I/O端口、耳机端口等等。接口单元608可以 用于接收来自外部装置的输入(例如,数据信息、电力等等)并且将接收到的输入传输到电子设备600内的一个或多个元件或者可以用于在电子设备600和外部装置之间传输数据。
存储器609可用于存储软件程序以及各种数据。存储器609可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等;存储数据区可存储根据手机的使用所创建的数据(比如音频数据、电话本等)等。此外,存储器609可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。
处理器610是电子设备的控制中心,利用各种接口和线路连接整个电子设备的各个部分,通过运行或执行存储在存储器609内的软件程序和/或模块,以及调用存储在存储器609内的数据,执行电子设备的各种功能和处理数据,从而对电子设备进行整体监控。处理器610可包括一个或多个处理单元;优选的,处理器610可集成应用处理器和调制解调处理器,其中,应用处理器主要处理操作系统、用户界面和应用程序等,调制解调处理器主要处理无线通信。可以理解的是,上述调制解调处理器也可以不集成到处理器610中。
本领域技术人员可以理解,电子设备600还可以包括给各个部件供电的电源(比如电池),电源可以通过电源管理系统与处理器610逻辑相连,从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。图13中示出的电子设备结构并不构成对电子设备的限定,电子设备可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置,在此不再赘述。在本申请实施例中,电子设备包括但不限于手机、平板电脑、笔记本电脑、掌上电脑、车载终端、可穿戴设备(例如手环、眼镜)、以及计步器等。
本申请实施例还提供一种可读存储介质,所述可读存储介质上存储有程序或指令,该程序或指令被处理器执行时实现上述控制方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。
其中,所述处理器为上述实施例中所述的电子设备中的处理器。所述可 读存储介质,包括计算机可读存储介质,如计算机只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等。
本申请实施例另提供了一种芯片,所述芯片包括处理器和通信接口,所述通信接口和所述处理器耦合,所述处理器用于运行程序或指令,实现上述控制方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。
应理解,本申请实施例提到的芯片还可以称为系统级芯片、系统芯片、芯片系统或片上系统芯片等。
本申请实施例另提供了一种计算机程序产品,所述计算机程序产品被存储在非易失的存储介质中,所述计算机程序产品被至少一个处理器执行以实现上述方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。此外,需要指出的是,本申请实施方式中的方法和装置的范围不限按示出或讨论的顺序来执行功能,还可包括根据所涉及的功能按基本同时的方式或按相反的顺序来执行功能,例如,可以按不同于所描述的次序来执行所描述的方法,并且还可以添加、省去、或组合各种步骤。另外,参照某些示例所描述的特征可在其他示例中被组合。
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本申请的 技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端(可以是手机,计算机,服务器,空调器,或者网络设备等)执行本申请各个实施例所述的方法。
上面结合附图对本申请的实施例进行了描述,但是本申请并不局限于上述的具体实施方式,上述的具体实施方式仅仅是示意性的,而不是限制性的,本领域的普通技术人员在本申请的启示下,在不脱离本申请宗旨和权利要求所保护的范围情况下,还可做出很多形式,均属于本申请的保护之内。

Claims (17)

  1. 一种控制方法,应用于具有显示屏的电子设备,所述方法包括:
    在所述显示屏的第一区域显示第一功能选项,并接收第一操作体对所述第一功能选项的第一输入;
    在第二操作体与所述显示屏之间的距离满足预设条件的情况下,响应于所述第一输入,在所述显示屏的第二区域显示与所述第一功能选项关联的N个第二功能选项,所述第二区域在所述显示屏中的位置,与所述第二操作体和所述显示屏之间的位置关系相关联;
    接收所述第二操作体对所述N个第二功能选项中目标功能选项的第二输入;
    响应于所述第二输入,执行与所述目标功能选项对应的功能。
  2. 根据权利要求1所述的方法,其中,所述在所述显示屏的第一区域显示第一功能选项之前,所述方法还包括:
    接收所述第一操作体对所述电子设备的按压操作;
    所述在所述显示屏的第一区域显示第一功能选项,包括:
    在所述按压操作的压力值大于预定的压力值的情况下,在所述显示屏的第一区域显示第一功能选项;
    所述在所述显示屏的第一区域显示第一功能选项之后,所述方法还包括:
    在所述第一操作体取消对所述电子设备的按压操作的情况下,取消显示所述第一功能选项。
  3. 根据权利要求1所述的方法,其中,所述在第二操作体与所述显示屏之间的距离满足预设条件的情况下,响应于所述第一输入,在所述显示屏的第二区域显示与所述第一功能选项关联的N个第二功能选项,包括:
    获取所述第二操作体与所述显示屏之间的距离值;
    若所述距离值小于第一距离值,则响应于所述第一输入,在所述显示屏的第二区域显示与所述第一功能选项关联的N个第二功能选项。
  4. 根据权利要求1所述的方法,所述方法还包括:
    在所述第二操作体在与所述显示屏平行的水平方向上发生第一移动的情 况下,控制所述显示屏的第二区域取消显示与所述第一功能选项关联的N个第二功能选项,并在所述显示屏的第三区域显示与所述第一功能选项关联的N个第二功能选项。
  5. 根据权利要求4所述的方法,其中,所述在所述第二操作体在与所述显示屏平行的水平方向上发生第一移动的情况下,控制所述显示屏的第二区域取消显示与所述第一功能选项关联的N个第二功能选项,并在所述显示屏的第三区域显示与所述第一功能选项关联的N个第二功能选项,包括:
    在所述第二操作体在与所述显示屏平行的水平方向上发生第一移动、以及所述第二操作体与所述显示屏之间的距离值小于第一距离值且大于第二距离值的情况下,控制所述显示屏的第二区域取消显示与所述第一功能选项关联的N个第二功能选项,并在所述显示屏的第三区域显示与所述第一功能选项关联的N个第二功能选项。
  6. 根据权利要求1所述的方法,其中,所述第一操作体为握持所述电子设备的握持用手,所述第二操作体包括操作用手或所述操作用手控制的操作工具。
  7. 一种控制装置,应用于具有显示屏的电子设备,所述装置包括:
    第一显示模块,用于在所述显示屏的第一区域显示第一功能选项;
    第一接收模块,用于接收第一操作体对所述第一功能选项的第一输入;
    第二显示模块,用于在第二操作体与所述显示屏之间的距离满足预设条件的情况下,响应于所述第一输入,在所述显示屏的第二区域显示与所述第一功能选项关联的N个第二功能选项,所述第二区域在所述显示屏中的位置,与所述第二操作体和所述显示屏之间的位置关系相关联;
    第二接收模块,用于接收所述第二操作体对所述N个第二功能选项中目标功能选项的第二输入;
    功能执行模块,用于响应于所述第二输入,执行与所述目标功能选项对应的功能。
  8. 根据权利要求7所述的装置,所述装置还包括:
    第三接收模块,用于在所述显示屏的第一区域显示所述第一功能选项之前,接收所述第一操作体对所述电子设备的按压操作;
    所述第一显示模块,具体用于在所述按压操作的压力值大于预定的压力值的情况下,在所述显示屏的第一区域显示第一功能选项;
    所述装置还包括:
    取消显示模块,用于在第一区域显示所述第一功能选项之后,在所述第一操作体取消对所述电子设备的按压操作的情况下,取消显示所述第一功能选项。
  9. 根据权利要求7所述的装置,其中,所述第二显示模块包括:
    距离获取子模块,用于获取所述第二操作体与所述显示屏之间的距离值;
    显示子模块,用于若所述距离值小于第一距离值,则响应于所述第一输入,在所述显示屏的第二区域显示与所述第一功能选项关联的N个第二功能选项。
  10. 根据权利要求7所述的装置,所述装置还包括:
    第三显示模块,用于在所述第二操作体在与所述显示屏平行的水平方向上发生第一移动的情况下,控制所述显示屏的第二区域取消显示与所述第一功能选项关联的N个第二功能选项,并在所述显示屏的第三区域显示与所述第一功能选项关联的N个第二功能选项。
  11. 根据权利要求10所述的装置,其中,所述第三显示模块,具体用于在所述第二操作体在与所述显示屏平行的水平方向上发生第一移动、以及所述第二操作体与所述显示屏之间的距离值小于第一距离值且大于第二距离值的情况下,控制所述显示屏的第二区域取消显示与所述第一功能选项关联的N个第二功能选项,并在所述显示屏的第三区域显示与所述第一功能选项关联的N个第二功能选项。
  12. 根据权利要求7所述的装置,其中,所述第一操作体为握持所述电子设备的握持用手,所述第二操作体包括操作用手或所述操作用手控制的操作工具。
  13. 一种电子设备,包括处理器,存储器及存储在所述存储器上并可在所述处理器上运行的程序或指令,所述程序或所述指令被所述处理器执行时实现如权利要求1至6中任一项所述控制方法的步骤。
  14. 一种可读存储介质,所述可读存储介质上存储程序或指令,所述程 序或指令被处理器执行时实现如权利要求1至6中任一项所述控制方法的步骤。
  15. 一种芯片,包括处理器和通信接口,所述通信接口和所述处理器耦合,所述处理器用于运行程序或指令,实现如权利要求1至6中任一项所述的方法。
  16. 一种计算机程序产品,所述程序产品被存储在非易失的存储介质中,所述程序产品被至少一个处理器执行以实现如权利要求1至6中任一项所述的方法。
  17. 一种电子设备,所述电子设备被配置成用于执行如权利要求1至6中任一项所述的方法。
PCT/CN2022/110567 2021-08-11 2022-08-05 控制方法、装置、电子设备和存储介质 WO2023016372A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110918533.8A CN113641278A (zh) 2021-08-11 2021-08-11 控制方法、装置、电子设备和存储介质
CN202110918533.8 2021-08-11

Publications (1)

Publication Number Publication Date
WO2023016372A1 true WO2023016372A1 (zh) 2023-02-16

Family

ID=78420783

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/110567 WO2023016372A1 (zh) 2021-08-11 2022-08-05 控制方法、装置、电子设备和存储介质

Country Status (2)

Country Link
CN (1) CN113641278A (zh)
WO (1) WO2023016372A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113641278A (zh) * 2021-08-11 2021-11-12 维沃移动通信有限公司 控制方法、装置、电子设备和存储介质
CN114816626A (zh) * 2022-04-08 2022-07-29 北京达佳互联信息技术有限公司 一种操作控制方法、装置、电子设备及存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103019577A (zh) * 2011-09-26 2013-04-03 联想(北京)有限公司 选择对象的方法及装置、控制方法和控制装置
CN105334991A (zh) * 2014-07-15 2016-02-17 联想(北京)有限公司 一种触屏输入方法及电子设备
US10353570B1 (en) * 2013-04-04 2019-07-16 Amazon Technologies, Inc. Thumb touch interface
CN111158553A (zh) * 2019-12-31 2020-05-15 联想(北京)有限公司 一种处理方法、装置及电子设备
CN111221453A (zh) * 2019-10-31 2020-06-02 华为技术有限公司 启动功能的方法及电子设备
CN113641278A (zh) * 2021-08-11 2021-11-12 维沃移动通信有限公司 控制方法、装置、电子设备和存储介质

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015052982A (ja) * 2013-09-09 2015-03-19 パイオニア株式会社 表示制御装置
KR20160022550A (ko) * 2014-08-20 2016-03-02 엘지전자 주식회사 이동 단말기
JP2016115208A (ja) * 2014-12-16 2016-06-23 シャープ株式会社 入力装置、ウェアラブル端末、携帯端末、入力装置の制御方法、および入力装置の動作を制御するための制御プログラム
CN106708374A (zh) * 2016-12-08 2017-05-24 北京小米移动软件有限公司 菜单显示方法及装置
CN113157376B (zh) * 2021-05-19 2023-06-27 字出印象(北京)科技有限公司 项目名称的显示方法、装置、电子设备及存储介质

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103019577A (zh) * 2011-09-26 2013-04-03 联想(北京)有限公司 选择对象的方法及装置、控制方法和控制装置
US10353570B1 (en) * 2013-04-04 2019-07-16 Amazon Technologies, Inc. Thumb touch interface
CN105334991A (zh) * 2014-07-15 2016-02-17 联想(北京)有限公司 一种触屏输入方法及电子设备
CN111221453A (zh) * 2019-10-31 2020-06-02 华为技术有限公司 启动功能的方法及电子设备
CN111158553A (zh) * 2019-12-31 2020-05-15 联想(北京)有限公司 一种处理方法、装置及电子设备
CN113641278A (zh) * 2021-08-11 2021-11-12 维沃移动通信有限公司 控制方法、装置、电子设备和存储介质

Also Published As

Publication number Publication date
CN113641278A (zh) 2021-11-12

Similar Documents

Publication Publication Date Title
CN108762954B (zh) 一种对象分享方法及移动终端
WO2023016372A1 (zh) 控制方法、装置、电子设备和存储介质
WO2020258929A1 (zh) 文件夹界面切换方法及终端设备
EP3525075B1 (en) Method for lighting up screen of double-screen terminal, and terminal
JP7331245B2 (ja) 対象位置調整方法及び電子機器
WO2020181955A1 (zh) 界面控制方法及终端设备
CN110531915B (zh) 屏幕操作方法及终端设备
WO2021004426A1 (zh) 内容选择方法及终端
CN108108113B (zh) 网页切换方法及装置
CN107741814B (zh) 一种显示控制方法及移动终端
CN111064848B (zh) 图片显示方法及电子设备
CN110795189A (zh) 一种应用启动方法及电子设备
WO2020125405A1 (zh) 终端设备的控制方法及终端设备
CN108509108B (zh) 一种应用程序图标排列方法及移动终端
CN111522613B (zh) 截屏方法及电子设备
CN109819102A (zh) 一种导航栏控制方法及移动终端、计算机可读存储介质
CN110780751B (zh) 一种信息处理方法及电子设备
JP7408627B2 (ja) 文字入力方法及び端末
CN110333803B (zh) 一种多媒体对象选择方法及终端设备
CN104461366A (zh) 激活移动终端的操作状态的方法及装置
CN111443860B (zh) 触控方法和电子设备
KR20220130171A (ko) 촬영 방법 및 전자 장치
CN109445656B (zh) 一种屏幕操控方法和终端设备
CN110007821B (zh) 一种操作方法及终端设备
CN108897467B (zh) 一种显示控制方法及终端设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22855353

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE