CN114205447A - Rapid setting method and device of electronic equipment, storage medium and electronic equipment - Google Patents
Rapid setting method and device of electronic equipment, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN114205447A CN114205447A CN202111546735.0A CN202111546735A CN114205447A CN 114205447 A CN114205447 A CN 114205447A CN 202111546735 A CN202111546735 A CN 202111546735A CN 114205447 A CN114205447 A CN 114205447A
- Authority
- CN
- China
- Prior art keywords
- touch
- shortcut
- instruction
- display interface
- recording video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
- H04M1/72439—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the application discloses a quick setting method and device of electronic equipment, a storage medium and the electronic equipment, wherein the quick setting method and device respond to a creation instruction triggered based on a screen recording video, and the screen recording video is analyzed to obtain an operation path of touch operation, wherein the target screen recording video records the touch operation; and generating a first shortcut operation instruction corresponding to the touch operation according to the operation path. By adopting the scheme of the embodiment of the application, the user can establish the shortcut operation instruction without entering the establishment page of the shortcut operation instruction to carry out complex setting, and the setting efficiency of the shortcut instruction is improved.
Description
Technical Field
The application relates to the technical field of electronic equipment, in particular to a quick setting method and device of electronic equipment, a storage medium and the electronic equipment.
Background
With the popularization of intelligent devices, intelligent electronic devices have become a necessary article for daily life, and users can perform various functions such as social contact, games, payment and the like through the intelligent electronic devices. In order to improve the operating efficiency of the electronic device, a user may set some automatic shortcut instructions, that is, a series of touch operations are triggered by one instruction, but in the current implementation scheme, the implementation of such a function generally requires a complicated setting process in advance, and in a creation interface of the automatic shortcut instructions, the automatic shortcut instructions can be generated by setting multiple steps, which results in low setting efficiency of the shortcut instructions.
Disclosure of Invention
The embodiment of the application provides a shortcut setting method and device for electronic equipment, a storage medium and the electronic equipment, and can improve the setting efficiency of a shortcut instruction.
In a first aspect, an embodiment of the present application provides a method for quickly setting an electronic device, including:
responding to a creation instruction triggered based on a screen recording video, analyzing the screen recording video to acquire an operation path of touch operation, wherein the target screen recording video records the touch operation;
and generating a first shortcut operation instruction corresponding to the touch operation according to the operation path.
In a second aspect, an embodiment of the present application further provides a shortcut setting apparatus for an electronic device, including:
the video analysis module is used for responding to a creation instruction triggered based on the screen recording video, analyzing the screen recording video to acquire an operation path of touch operation, wherein the target screen recording video records the touch operation;
and the instruction generating module is used for generating a first shortcut operation instruction corresponding to the touch operation according to the operation path.
In a third aspect, an embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored, and when the computer program runs on a computer, the computer is caused to execute the shortcut setting method for an electronic device as provided in any embodiment of the present application.
In a fourth aspect, an embodiment of the present application further provides an electronic device, which includes a processor and a memory, where the memory has a computer program, and the processor is configured to execute the shortcut setting method of the electronic device according to any embodiment of the present application by calling the computer program.
According to the technical scheme, the screen recording video recorded with the touch operation is analyzed in response to the creation instruction triggered based on the screen recording video, so that the operation path of the touch operation is obtained, and then the first shortcut operation instruction corresponding to the touch operation is generated according to the operation path.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a first flowchart illustrating a shortcut setting method of an electronic device according to an embodiment of the present application.
Fig. 2 is a schematic view of an application scenario of touch operation in the shortcut setting method of an electronic device according to the embodiment of the present application.
Fig. 3 is a schematic view of a display interface in the shortcut setting method of the electronic device according to the embodiment of the present application.
Fig. 4 is a schematic structural diagram of a shortcut setting apparatus of an electronic device according to an embodiment of the present application.
Fig. 5 is a schematic structural diagram of a first electronic device according to an embodiment of the present application.
Fig. 6 is a schematic structural diagram of a second electronic device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. It is to be understood that the embodiments described are only a few embodiments of the present application and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without inventive step, are within the scope of the present application.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
Some electronic devices provide a user-defined function of a shortcut operation instruction for a user, and the user can create a series of operations as one shortcut operation instruction according to needs, and then trigger a series of operations through one instruction. For example, some electronic devices provide the user with the function of creating a custom shortcut instruction as follows: and (3) the user enters a shortcut instruction editor interface, sets a shortcut instruction name, clicks 'adding operation' after the name setting is completed, then selects the required operation in the list to add, and continues to add subsequent operations after the addition of the first operation is completed, and sets one by one until the setting of all operations in the flow is completed. This setup procedure is complicated and requires the user to be familiar with each operational setup. For an unfamiliar user, it may take a lot of time to make multiple attempts to successfully create a shortcut operation command. Leading to inefficient setting of shortcut operation instructions.
In order to solve the problem, an execution main body of the shortcut setting method of the electronic device may be the shortcut setting device of the electronic device provided in the embodiment of the present application, or the electronic device integrated with the shortcut setting device of the electronic device, where the shortcut setting device of the electronic device may be implemented in a hardware or software manner. The electronic device may be a smart phone, a tablet computer, a palm computer, a notebook computer, or a desktop computer.
Referring to fig. 1, fig. 1 is a first flowchart illustrating a shortcut setup method of an electronic device according to an embodiment of the present disclosure. The specific process of the shortcut setting method for the electronic device provided by the embodiment of the application can be as follows:
101. and responding to a creation instruction triggered based on the screen recording video, and analyzing the screen recording video to acquire an operation path of touch operation, wherein the touch operation is recorded in the target screen recording video.
In the embodiment of the application, the screen recording video can be recorded by the user through the electronic equipment, or can be locally stored after screen recording videos received from other electronic equipment are received.
For example, in an embodiment, before step 101, the method further includes: and receiving the screen recording video sent by the external equipment. After receiving the screen recording video sent by the external equipment, the electronic equipment stores the screen recording video serving as the screen recording video into the photo album. The target screen recording device may be obtained by recording the external device when a user of the external device performs a touch operation on the screen. When a user views the screen recording video, a creation instruction is triggered based on an option of 'generating a shortcut operation instruction' in a plurality of operation options of the screen recording video, and the electronic equipment responds to the creation instruction to analyze the screen recording video.
For another example, in another embodiment, before step 101, the method further comprises: and responding to a screen recording instruction, and recording screen display contents in the touch operation execution process to obtain a screen recording video.
After the screen recording video is started, the electronic equipment records the display content of the screen. In the process of screen recording, if a user performs a touch operation on the display screen, information such as an object of the touch operation and a result of the touch operation is also recorded in the screen recording video. For example, after the user starts the screen recording, the user enters a volume setting interface of the electronic device to adjust the volume of the incoming call ringtone of the device to 30, and then the touch objects "the volume of the incoming call ringtone", "30", and the like are recorded in the screen recording video.
In the embodiment of the application, the touch operation of the user on the screen is recorded in the screen recording video. And the user recording the screen recording video executes a specific operation process through the electronic equipment according to the quick operation to be realized so as to obtain the screen recording video recorded with the touch operation as the screen recording video. And before the specific operation process is started to be executed, triggering a screen recording instruction to start screen recording, and after the touch operation is finished, stopping screen recording.
The shortcut operation command is a control command capable of quickly implementing a certain function or a certain operation. When the set shortcut operation instruction is executed, the electronic device can be controlled according to a specific operation path. The specific operation path is the user's executed operation path recorded by the screen recording video. It should be noted that the touch operation of the screen recording video recording may be one touch operation or multiple touch operations. The touch operation may include a click, a slide, an information input, etc. to the display screen.
Next, in order to facilitate the reader to understand the present solution, a detailed description will be given in the following description by taking a specific application scenario as an example. The number of touch operations in the screen recording video in the scene is multiple.
For example, the user wants to implement the following: the font of the electronic device is set to maximum. Referring to fig. 2, fig. 2 is a schematic view of an application scenario of touch operation in a shortcut setting method of an electronic device according to an embodiment of the present application. Under the condition that the shortcut instruction of the operation is not available, when the user realizes the above process, the user needs to enter a setting interface through a "setting" control on the desktop, and then click a "display setting" control on the setting interface to enter a display setting interface, wherein the display setting interface includes settings of a plurality of display items of the electronic device, such as font size and the like. And on the display setting interface, adjusting the size of the font by operating the control corresponding to the size of the font. According to the scheme of the embodiment, a user sets the operation of setting the font of the electronic equipment to be the maximum as the shortcut operation instruction, only needs to execute the process once, starts the screen recording in the execution process of the process, automatically records the process through the screen recording video, analyzes the screen recording video to obtain the operation path, and then generates the corresponding shortcut operation instruction based on the operation path.
The above describes the acquisition process of the screen recording video in detail. After the screen recording video is acquired, a user can trigger a creation instruction based on the screen recording video, wherein the creation instruction is used for instructing the electronic equipment to analyze the screen recording video.
For example, after completing a screen recording operation according to an operation of a user, the electronic device displays a recorded video on an interface, the user clicks a video option control, a creation instruction is triggered based on a control of a "creation shortcut operation instruction" in the option interface, and after detecting the creation instruction, the electronic device analyzes the screen recording video to identify an operation path, wherein the operation path refers to path information formed by all touch objects corresponding to the touch operation of the user according to the sequence of the operation, and represents a series of control objects of the touch operation.
The screen recording video comprises a plurality of frames of continuous images, and a plurality of display interfaces contained in the screen recording video are determined by analyzing the images. Referring to fig. 3, fig. 3 is a schematic view of a display interface in a shortcut setting method of an electronic device according to an embodiment of the present application. The display interface may be a system interface or an interface of an application program, and the interface of the application program may be an interface of a system native application program or an interface of a third party application program. For example, the user enters the settings interface through a "settings" control on the desktop, and then clicks on a "display settings" control on the settings interface to enter the display settings interface, on the display settings interface. The setting interface and the display setting interface in the above process are two different display interfaces. For example, in an embodiment, the similarity between every two adjacent video frames may be calculated, and then the display interfaces corresponding to the video frames with the similarity greater than the preset threshold may be determined as the same display interface. In this way, all the display interfaces included in the screen recording video can be determined from the screen recording video, and the number of the display interfaces is generally multiple or one.
After the display interfaces are determined, each display interface may be analyzed to determine a touch object of the touch operation on the display interface.
For example, in an embodiment, a corresponding touch area is determined according to a touch position on a display interface by a user's touch operation, and then character recognition and/or image recognition are performed on the touch area to determine interface elements such as characters or icons at the touch position, so as to determine a touch object corresponding to the touch area.
Generally, on a display interface, a user clicks a certain selection item, a control, an icon, or the like on the display interface, and the display interface performs feedback according to a specific display effect, for example, changing the color of the selection item clicked by the user to be darker than the color of other selection items not clicked in the display interface, or changing the brightness of the selection item clicked by the user to be brighter than the brightness of other selection items not clicked in the display interface, and the like. Based on this characteristic, a touch position of the touch operation on the display interface can be determined. After the touch position is determined, image recognition or character recognition may be performed on the area where the touch position is located, for example, interface elements such as characters or icons at the touch position are recognized, so as to determine a touch object of the user on the interface.
Or, in another embodiment, the touch position may be recorded according to a preset mark in the screen recording process. In this way, each display interface has a corresponding mark of the touch position, the touch position on each display interface can be determined directly through a target detection algorithm, and after the touch position is determined, image recognition or character recognition and the like can be performed on the area where the touch position is located, for example, interface elements such as characters or icons at the touch position are recognized, so that a touch object of a user on the interface is determined.
Or, in another embodiment, a preset display interface matched with the display interface is recognized according to a pre-trained image recognition model, and then a touch object corresponding to the touch operation on the display interface is determined according to the touch position of the touch operation on the display interface. For example, the display interface is a display effect setting interface, and a user adjusts the display size of the characters to be extra large on the interface through touch operation, wherein the display size of the characters comprises four display effects of small, medium, large and extra large. Firstly, a preset display interface, namely a display setting interface, is identified according to a pre-trained image identification model, and for a known preset display interface, the positions of interface elements on the preset display interface are also known. Therefore, after the touch position of the touch operation on the display interface is determined, interface elements consistent with the touch position can be matched according to the positions of the interface elements on the display interface, and the interface elements are determined as touch objects. In this way, in the above touch operation, it can be identified that the touch position corresponds to the position of the "extra large" selection item.
The image recognition model can be a non-classification model constructed based on a convolutional neural network, and a sample image carrying interface name labels is used for training the model in advance to determine model parameters.
The identified touch objects form an operation path according to the sequence from first to last in time.
102. And generating a first shortcut operation instruction corresponding to the touch operation according to the operation path.
After the operation path is obtained, a first shortcut operation instruction corresponding to the touch operation is generated based on the operation path. For example, according to a touch object of touch operation on each display interface in the operation path, generating a sub shortcut operation instruction corresponding to each display interface; and packaging the sub-shortcut operation instructions corresponding to the display interfaces according to the sequence of the display interfaces, and generating a first shortcut operation instruction corresponding to the touch operation.
Each touch object in the operation path can be written into a corresponding instruction by calling a corresponding bottom layer interface or component. For example, on a desktop, entering a setting interface based on an opening instruction triggered by a control of "setting"; and entering a display effect setting interface based on a confirmation instruction triggered by the selection item of 'display effect setting' on the setting interface. Therefore, after the operation path is obtained, a plurality of continuous sub shortcut operation instructions can be generated according to the operation path, the plurality of continuous sub shortcut operation instructions are packaged into one shortcut operation instruction, and the shortcut operation instruction is recorded as a first shortcut operation instruction.
After the electronic device generates the first shortcut operation instruction, the first shortcut operation instruction may be stored in an automatic instruction list. After the first shortcut operation instruction is generated, an icon of the first shortcut operation instruction can be created and displayed on a desktop or a shortcut bar. And clicking the icon of the first shortcut operation instruction by the user to realize a series of corresponding touch operations. And complicated setting is not required to be carried out by entering a setting interface.
In particular implementation, the present application is not limited by the execution sequence of the described steps, and some steps may be performed in other sequences or simultaneously without conflict.
According to the method for quickly setting the electronic equipment, the screen recording video recorded with the touch operation is analyzed in response to the creation instruction triggered by the screen recording video, so that the operation path of the touch operation is obtained, the first quick operation instruction corresponding to the touch operation is generated according to the operation path, according to the method, when a user needs to set some touch operations as an automatic quick operation instruction, the screen recording operation is started in the process of executing the touch operation once to obtain the screen recording video recorded with the touch operation, the screen recording video is analyzed, the corresponding quick operation instruction can be generated, the user does not need to enter the creation page of the quick operation instruction to perform complex setting, and the setting efficiency and the setting convenience of the quick operation instruction are improved.
In some embodiments, in response to a creation instruction triggered based on a screen recording video, parsing the screen recording video to obtain an operation path of a touch operation includes: determining a plurality of display interfaces contained in the screen recording video in response to a creation instruction triggered based on the screen recording video; for each display interface, analyzing the display interface to determine a touch object of the touch operation on the display interface; and according to the sequence of the display interfaces, forming an operation path of touch operation by the touch object of the touch operation on each display interface.
In this embodiment, in response to a creation instruction triggered based on a screen recording video, an electronic device first determines a plurality of display interfaces included in the screen recording video, then analyzes each display interface to determine a touch object operated on the display interface, the order of the display interfaces in the screen recording video determines the order of the touch objects, and the touch objects and the corresponding display interfaces form an operation path based on the order of the display interfaces from first to last in the screen recording video.
The method for identifying the touch object on each display interface can be realized in various ways.
For example, for each display interface, parsing the display interface to determine a touch object of a touch operation on the display interface includes: for each display interface, determining a touch area from the display interface according to the position of the touch operation; and performing character recognition processing on the touch area according to a character recognition algorithm to determine a touch object of the touch operation on the display interface.
In this embodiment, a corresponding touch area is determined according to a touch position of a user on a display interface, and then character recognition and/or image recognition is performed on the touch area to determine interface elements such as characters or icons at the touch position, so as to determine a touch object corresponding to the touch area. For determining the touch position, please refer to the above embodiments, which are not described herein.
For another example, for each display interface, determining a touch position of the touch operation on the display interface; identifying the display interface according to a preset image identification algorithm to determine the position of each interface element on the display interface; and determining a touch object of the touch operation on the display interface according to the touch position and the position of each interface element on the display interface.
The image recognition algorithm in this embodiment may be a pre-trained image recognition model, where the image recognition model may be a non-classified model constructed based on a convolutional neural network, and the model is trained in advance using a sample image carrying an interface name label to determine model parameters.
The method comprises the steps of firstly identifying a preset display interface matched with the display interface according to a pre-trained image identification model, wherein for a known preset display interface, the positions of interface elements on the preset display interface are also known. After the touch position of the touch operation on the display interface is determined, interface elements consistent with the touch position can be matched according to the positions of the interface elements on the display interface, and the interface elements are determined as touch objects.
In some embodiments, after generating the first shortcut operation instruction corresponding to the touch operation, the method further includes: responding to a sharing instruction triggered based on the first shortcut operation instruction, and displaying a sharing interface; determining a sharing path and a sharing object selected by a user based on a sharing interface; and sending the first shortcut operation instruction to the sharing object according to the sharing path.
In this embodiment, the user may also share the first shortcut operation instruction with other users through some sharing approaches, such as wechat, email, and QQ, so as to help some users who do not use the creation function of the shortcut instruction or do not use the screen recording function to create the shortcut operation instruction. For example, the user a triggers a sharing instruction based on a first shortcut operation instruction in the automatic shortcut instruction list, the electronic device displays a sharing interface after detecting the sharing instruction, the user a selects a sharing path and a sharing object on the sharing interface, for example, the user selects to share the first shortcut operation instruction to a friend B in the WeChat friend list through the sharing interface by using a WeChat, the electronic device determines the sharing path and the sharing object selected by the user based on the sharing interface, and sends a message to the friend B through the WeChat, where the content of the message includes the first shortcut operation instruction. After receiving the WeChat message, the friend B clicks the instruction to generate two options of an operation instruction and a storage instruction, and if the friend B clicks the operation instruction, the electronic equipment of the friend B can directly operate the first shortcut operation instruction under the condition that the operating system of the electronic equipment of the friend B is consistent with or compatible with the operating system of the electronic equipment of the user A, namely the font size of the system is adjusted to be extra large.
In some embodiments, the method further comprises: responding to an editing instruction triggered based on the first shortcut operation instruction, and displaying an editing interface of the first shortcut operation instruction; determining an operation object updated by a user based on an editing interface; and updating the first shortcut operation instruction based on the updated operation object.
In this embodiment, the user may also edit the information in the stored first shortcut operation instruction as needed. For example, the user triggers an editing instruction based on the first shortcut operation instruction, the electronic device displays an editing interface of the first shortcut operation instruction in response to the editing instruction, the user edits the touch object on the editing interface, for example, the font size is changed from "extra large" to "large", and after the user finishes editing, the electronic device updates the first shortcut operation instruction based on the updated operation object. The updated first shortcut operation instruction can realize that the font of the electronic equipment is set to be large by one key.
In some embodiments, a deletion option may also be set for the first shortcut instruction, and when the user does not need to use the first shortcut instruction, the first shortcut instruction may be deleted from the electronic device.
In some embodiments, the method further comprises: receiving instant information with a second shortcut operation instruction based on the instant communication application program; and responding to an operation instruction triggered based on the second shortcut operation instruction, and operating the second shortcut operation instruction.
In this embodiment, the electronic device may further receive a shortcut operation instruction sent by an external device, and in order to distinguish the shortcut operation instruction generated by the local device from the shortcut operation instruction sent by the external device, the shortcut operation instruction generated by the local device is recorded as a "first shortcut operation instruction", and the shortcut operation instruction sent by the external device is recorded as a "second shortcut operation instruction". Corresponding to the above embodiment in which the first shortcut operation instruction is shared with the external device, the electronic device may further serve as a receiver to receive a second shortcut operation instruction sent by the external device, for example, the electronic device receives instant information with the second shortcut operation instruction sent by the external device through an instant messaging application program, a user clicks the second shortcut operation instruction to trigger an operation instruction, and the electronic device responds to the operation instruction to operate the second shortcut operation instruction, thereby completing a series of complex operations and achieving the purpose of implementing the operation by one key.
Through the scheme of the embodiment, on the basis of improving the creating efficiency of the shortcut operation instruction, the function of sharing the existing shortcut operation instruction with other people is realized, so that the problem that an old user cannot carry out a complex operation system and relevant settings is solved, and the old user is helped to use the intelligent electronic equipment more conveniently.
In an embodiment, a shortcut setting apparatus for an electronic device is also provided. Referring to fig. 4, fig. 4 is a schematic structural diagram of a shortcut setting apparatus 300 of an electronic device according to an embodiment of the present disclosure. The shortcut setting apparatus 300 of the electronic device is applied to the electronic device, and the shortcut setting apparatus 300 of the electronic device includes a video parsing module 301 and an instruction generating module 302, which are as follows:
the video analysis module 301 is configured to, in response to a creation instruction triggered based on a screen recording video, analyze the screen recording video to obtain an operation path of a touch operation, where the target screen recording video records the touch operation;
the instruction generating module 302 is configured to generate a first shortcut operation instruction corresponding to the touch operation according to the operation path.
In some embodiments, the shortcut setting apparatus 300 of the electronic device further includes:
and the screen recording module is used for responding to a screen recording instruction, recording the screen display content in the touch operation execution process and obtaining the screen recording video.
In some embodiments, the video parsing module 301 is configured to determine, in response to a creation instruction triggered based on a screen recording video, a plurality of display interfaces included in the screen recording video;
for each display interface, analyzing the display interface to determine a touch object of the touch operation on the display interface;
and according to the sequence of the display interfaces, forming an operation path of the touch operation by the touch object of the touch operation on each display interface.
In some embodiments, the video parsing module 301 is configured to, for each display interface, determine a touch area from the display interface according to a position of a touch operation;
and performing character recognition processing on the touch area according to a character recognition algorithm to determine a touch object of the touch operation on the display interface.
In some embodiments, the video parsing module 301 is configured to determine, for each display interface, a touch position of the touch operation on the display interface;
identifying the display interface according to a preset image identification algorithm to determine the position of each interface element on the display interface;
and determining a touch object of the touch operation on the display interface according to the touch position and the position of each interface element on the display interface.
In some embodiments, the instruction generating module 302 is configured to generate a sub shortcut operation instruction corresponding to each display interface according to a touch object of the touch operation on each display interface in the operation path;
and according to the sequence of the plurality of display interfaces, packaging the sub shortcut operation instructions corresponding to the plurality of display interfaces respectively, and generating a first shortcut operation instruction corresponding to the touch operation.
The shortcut setting apparatus 300 of the electronic device further includes:
the instruction sharing module is used for responding to a sharing instruction triggered based on the first shortcut operation instruction and displaying a sharing interface;
determining a sharing path and a sharing object selected by a user based on the sharing interface;
and sending the first shortcut operation instruction to the sharing object according to the sharing path.
In some embodiments, the shortcut setting apparatus 300 of the electronic device further comprises
The instruction editing module is used for responding to an editing instruction triggered based on the first shortcut operation instruction and displaying an editing interface of the first shortcut operation instruction;
determining an operation object updated by a user based on the editing interface;
and updating the first shortcut operation instruction based on the updated operation object.
In some embodiments, the shortcut setting apparatus 300 of the electronic device further includes:
the instruction sharing module is used for receiving instant information with a second shortcut operation instruction based on the instant communication application program;
and responding to an operation instruction triggered based on the second shortcut operation instruction, and operating the second shortcut operation instruction.
It should be noted that the shortcut setting apparatus of the electronic device provided in the embodiment of the present application and the shortcut setting method of the electronic device in the foregoing embodiments belong to the same concept, and any method provided in the shortcut setting method embodiment of the electronic device can be implemented by the shortcut setting apparatus of the electronic device, and a specific implementation process thereof is described in detail in the shortcut setting method embodiment of the electronic device, and is not described herein again.
According to the method, when a user needs to set some touch operations as an automatic shortcut operation instruction, the screen recording operation is started only in the process of executing the touch operations once to obtain the screen recording video recorded with the touch operations, the screen recording video is analyzed, the corresponding shortcut operation instruction can be generated, complex setting is not needed to be carried out on a creation page of the shortcut operation instruction, and the setting efficiency and the setting convenience of the shortcut instruction are improved.
The embodiment of the application also provides the electronic equipment. The electronic device can be a smart phone, a tablet computer and the like. Referring to fig. 5, fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure. The electronic device 400 comprises a processor 401 and a memory 402. The processor 401 is electrically connected to the memory 402.
The processor 401 is a control center of the electronic device 400, connects various parts of the entire electronic device using various interfaces and lines, and performs various functions of the electronic device and processes data by running or calling a computer program stored in the memory 402 and calling data stored in the memory 402, thereby performing overall monitoring of the electronic device.
In this embodiment, the processor 401 in the electronic device 400 loads instructions corresponding to one or more processes of the computer program into the memory 402 according to the following steps, and the processor 401 runs the computer program stored in the memory 402, so as to implement various functions:
responding to a creation instruction triggered based on a screen recording video, analyzing the screen recording video to acquire an operation path of touch operation, wherein the target screen recording video records the touch operation;
and generating a first shortcut operation instruction corresponding to the touch operation according to the operation path.
In some embodiments, please refer to fig. 6, and fig. 6 is a second structural diagram of an electronic device according to an embodiment of the present disclosure. The electronic device 400 further comprises: radio frequency circuit 403, display 404, control circuit 405, input unit 406, audio circuit 407, sensor 408, and power supply 409. The processor 401 is electrically connected to the radio frequency circuit 403, the display 404, the control circuit 405, the input unit 406, the audio circuit 407, the sensor 408, and the power source 409.
The radio frequency circuit 403 is used for transceiving radio frequency signals to communicate with a network device or other electronic devices through wireless communication.
The display screen 404 may be used to display information entered by or provided to the user as well as various graphical user interfaces of the electronic device, which may be comprised of images, text, icons, video, and any combination thereof.
The control circuit 405 is electrically connected to the display screen 404, and is configured to control the display screen 404 to display information.
The input unit 406 may be used to receive input numbers, character information, or user characteristic information (e.g., fingerprint), and to generate keyboard, mouse, joystick, optical, or trackball signal inputs related to user settings and function control. The input unit 406 may include a fingerprint recognition module.
The audio circuit 407 may provide an audio interface between the user and the electronic device through a speaker, microphone. Wherein the audio circuit 407 comprises a microphone. The microphone is electrically connected to the processor 401. The microphone is used for receiving voice information input by a user.
The sensor 408 is used to collect external environmental information. The sensors 408 may include one or more of ambient light sensors, acceleration sensors, gyroscopes, etc.
The power supply 409 is used to power the various components of the electronic device 400. In some embodiments, the power source 409 may be logically connected to the processor 401 through a power management system, so that functions of managing charging, discharging, and power consumption are implemented through the power management system.
Although not shown in the drawings, the electronic device 400 may further include a camera, a bluetooth module, and the like, which are not described in detail herein.
In this embodiment, the processor 401 in the electronic device 400 loads instructions corresponding to one or more processes of the computer program into the memory 402 according to the following steps, and the processor 401 runs the computer program stored in the memory 402, so as to implement various functions:
responding to a creation instruction triggered based on a screen recording video, analyzing the screen recording video to acquire an operation path of touch operation, wherein the target screen recording video records the touch operation;
and generating a first shortcut operation instruction corresponding to the touch operation according to the operation path.
According to the above, the embodiment of the application provides an electronic device, the electronic device responds to a creation instruction triggered based on a screen recording video, analyzes the screen recording video recorded with touch operation to obtain an operation path of the touch operation, and then generates a first shortcut operation instruction corresponding to the touch operation according to the operation path.
An embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program runs on a computer, the computer executes the shortcut setting method for an electronic device according to any of the above embodiments.
It should be noted that, all or part of the steps in the methods of the above embodiments may be implemented by hardware related to instructions of a computer program, which may be stored in a computer readable storage medium, which may include, but is not limited to: read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, and the like.
Furthermore, the terms "first", "second", and "third", etc. in this application are used to distinguish different objects, and are not used to describe a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or modules is not limited to only those steps or modules listed, but rather, some embodiments may include other steps or modules not listed or inherent to such process, method, article, or apparatus.
The method, the apparatus, the storage medium, and the electronic device for quickly setting the electronic device provided in the embodiments of the present application are described in detail above. The principle and the implementation of the present application are explained herein by applying specific examples, and the above description of the embodiments is only used to help understand the method and the core idea of the present application; meanwhile, for those skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.
Claims (12)
1. A shortcut setting method of an electronic device is characterized by comprising the following steps:
responding to a creation instruction triggered based on a screen recording video, analyzing the screen recording video to acquire an operation path of touch operation, wherein the touch operation is recorded in the screen recording video;
and generating a first shortcut operation instruction corresponding to the touch operation according to the operation path.
2. The method of claim 1, wherein before the parsing the screen-recording video to obtain the operation path of the touch operation in response to the creation instruction triggered based on the screen-recording video, the method further comprises:
and responding to a screen recording instruction, and recording screen display contents in the touch operation execution process to obtain the screen recording video.
3. The method of claim 1, wherein the parsing the screen recording video to obtain an operation path of a touch operation in response to a creation instruction triggered based on the screen recording video comprises:
in response to a creation instruction triggered based on a screen recording video, determining a plurality of display interfaces contained in the screen recording video;
for each display interface, analyzing the display interface to determine a touch object of the touch operation on the display interface;
and according to the sequence of the display interfaces, forming an operation path of the touch operation by the touch object of the touch operation on each display interface.
4. The method of claim 3, wherein the parsing the display interface to determine the touch object of the touch operation on the display interface for each display interface comprises:
for each display interface, determining a touch area from the display interface according to the position of touch operation;
and performing character recognition processing on the touch area according to a character recognition algorithm to determine a touch object of the touch operation on the display interface.
5. The method of claim 3, wherein the parsing the display interface to determine the touch object of the touch operation on the display interface for each display interface comprises:
for each display interface, determining a touch position of the touch operation on the display interface;
identifying the display interface according to a preset image identification algorithm to determine the position of each interface element on the display interface;
and determining a touch object of the touch operation on the display interface according to the touch position and the position of each interface element on the display interface.
6. The method of claim 3, wherein the generating a first shortcut operation instruction corresponding to the touch operation according to the operation path comprises:
generating a sub shortcut operation instruction corresponding to each display interface according to the touch object of the touch operation on each display interface in the operation path;
and according to the sequence of the plurality of display interfaces, packaging the sub shortcut operation instructions corresponding to the plurality of display interfaces respectively, and generating a first shortcut operation instruction corresponding to the touch operation.
7. The method of claim 1, wherein after generating the first shortcut operation instruction corresponding to the touch operation according to the operation path, the method further comprises:
responding to a sharing instruction triggered based on the first shortcut operation instruction, and displaying a sharing interface;
determining a sharing path and a sharing object selected by a user based on the sharing interface;
and sending the first shortcut operation instruction to the sharing object according to the sharing path.
8. The method of claim 1, wherein the method further comprises:
responding to an editing instruction triggered based on the first shortcut operation instruction, and displaying an editing interface of the first shortcut operation instruction;
determining an operation object updated by a user based on the editing interface;
and updating the first shortcut operation instruction based on the updated operation object.
9. The method of any of claims 1 to 8, further comprising:
receiving instant information with a second shortcut operation instruction based on the instant communication application program;
and responding to an operation instruction triggered based on the second shortcut operation instruction, and operating the second shortcut operation instruction.
10. A shortcut setting apparatus of an electronic device, comprising:
the video analysis module is used for responding to a creation instruction triggered based on the screen recording video, analyzing the screen recording video to acquire an operation path of touch operation, wherein the target screen recording video records the touch operation;
and the instruction generating module is used for generating a first shortcut operation instruction corresponding to the touch operation according to the operation path.
11. A computer-readable storage medium having stored thereon a computer program, characterized in that, when the computer program runs on a computer, the computer is caused to execute a shortcut setting method of an electronic device according to any one of claims 1 to 9.
12. An electronic device comprising a processor and a memory, the memory storing a computer program, wherein the processor is configured to execute the shortcut setting method of the electronic device according to any one of claims 1 to 9 by calling the computer program.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111546735.0A CN114205447B (en) | 2021-12-16 | 2021-12-16 | Shortcut setting method and device of electronic equipment, storage medium and electronic equipment |
| PCT/CN2022/136006 WO2023109525A1 (en) | 2021-12-16 | 2022-12-01 | Quick setting method and apparatus for electronic device, and storage medium and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111546735.0A CN114205447B (en) | 2021-12-16 | 2021-12-16 | Shortcut setting method and device of electronic equipment, storage medium and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114205447A true CN114205447A (en) | 2022-03-18 |
| CN114205447B CN114205447B (en) | 2023-09-12 |
Family
ID=80654758
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111546735.0A Active CN114205447B (en) | 2021-12-16 | 2021-12-16 | Shortcut setting method and device of electronic equipment, storage medium and electronic equipment |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN114205447B (en) |
| WO (1) | WO2023109525A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115314333A (en) * | 2022-07-14 | 2022-11-08 | 青岛海尔科技有限公司 | Data sharing method and device, storage medium and electronic device |
| WO2023109525A1 (en) * | 2021-12-16 | 2023-06-22 | Oppo广东移动通信有限公司 | Quick setting method and apparatus for electronic device, and storage medium and electronic device |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107870725A (en) * | 2017-11-30 | 2018-04-03 | 广东欧珀移动通信有限公司 | Record screen method, apparatus and terminal |
| CN108323239A (en) * | 2016-11-29 | 2018-07-24 | 华为技术有限公司 | Recording, playback method, record screen terminal and the playback terminal of film recording |
| CN108646968A (en) * | 2018-04-20 | 2018-10-12 | 苏州蜗牛数字科技股份有限公司 | A kind of method and system for reappearing scene based on image analysis |
| CN109521935A (en) * | 2018-10-24 | 2019-03-26 | 维沃移动通信有限公司 | It is a kind of to record screen, the reproducing method based on record screen, terminal |
| CN110908584A (en) * | 2019-11-29 | 2020-03-24 | 网易（杭州）网络有限公司 | Playback display control method and device for screen recording data |
| CN112153436A (en) * | 2020-09-03 | 2020-12-29 | Oppo广东移动通信有限公司 | Screen recording method, device, equipment and storage medium |
| CN112558826A (en) * | 2020-12-04 | 2021-03-26 | 深圳传音控股股份有限公司 | Shortcut operation method, mobile terminal and storage medium |
| WO2021134240A1 (en) * | 2019-12-30 | 2021-07-08 | 深圳市欢太科技有限公司 | Game screen recording method and apparatus, and computer-readable storage medium |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110515533B (en) * | 2019-08-20 | 2021-09-14 | Oppo（重庆）智能科技有限公司 | Electronic equipment shortcut operation method and device, electronic equipment and storage medium |
| CN114205447B (en) * | 2021-12-16 | 2023-09-12 | Oppo广东移动通信有限公司 | Shortcut setting method and device of electronic equipment, storage medium and electronic equipment |
-
2021
- 2021-12-16 CN CN202111546735.0A patent/CN114205447B/en active Active
-
2022
- 2022-12-01 WO PCT/CN2022/136006 patent/WO2023109525A1/en unknown
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108323239A (en) * | 2016-11-29 | 2018-07-24 | 华为技术有限公司 | Recording, playback method, record screen terminal and the playback terminal of film recording |
| CN107870725A (en) * | 2017-11-30 | 2018-04-03 | 广东欧珀移动通信有限公司 | Record screen method, apparatus and terminal |
| CN108646968A (en) * | 2018-04-20 | 2018-10-12 | 苏州蜗牛数字科技股份有限公司 | A kind of method and system for reappearing scene based on image analysis |
| CN109521935A (en) * | 2018-10-24 | 2019-03-26 | 维沃移动通信有限公司 | It is a kind of to record screen, the reproducing method based on record screen, terminal |
| CN110908584A (en) * | 2019-11-29 | 2020-03-24 | 网易（杭州）网络有限公司 | Playback display control method and device for screen recording data |
| WO2021134240A1 (en) * | 2019-12-30 | 2021-07-08 | 深圳市欢太科技有限公司 | Game screen recording method and apparatus, and computer-readable storage medium |
| CN112153436A (en) * | 2020-09-03 | 2020-12-29 | Oppo广东移动通信有限公司 | Screen recording method, device, equipment and storage medium |
| CN112558826A (en) * | 2020-12-04 | 2021-03-26 | 深圳传音控股股份有限公司 | Shortcut operation method, mobile terminal and storage medium |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023109525A1 (en) * | 2021-12-16 | 2023-06-22 | Oppo广东移动通信有限公司 | Quick setting method and apparatus for electronic device, and storage medium and electronic device |
| CN115314333A (en) * | 2022-07-14 | 2022-11-08 | 青岛海尔科技有限公司 | Data sharing method and device, storage medium and electronic device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114205447B (en) | 2023-09-12 |
| WO2023109525A1 (en) | 2023-06-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109062479B (en) | Split screen application switching method and device, storage medium and electronic equipment | |
| WO2021077897A1 (en) | File sending method and apparatus, and electronic device | |
| CN108549519B (en) | Split screen processing method and device, storage medium and electronic equipment | |
| CN108614655B (en) | Split screen display method and device, storage medium and electronic equipment | |
| CN111884908B (en) | Contact person identification display method and device and electronic equipment | |
| CN114205447B (en) | Shortcut setting method and device of electronic equipment, storage medium and electronic equipment | |
| US20230229286A1 (en) | Interface display method and apparatus, and electronic device | |
| CN107704190B (en) | Gesture recognition method and device, terminal and storage medium | |
| CN111506245A (en) | Terminal control method and device | |
| CN106775202A (en) | A kind of method and device of information transfer | |
| CN107562356B (en) | Fingerprint identification positioning method and device, storage medium and electronic equipment | |
| CN112817676A (en) | Information processing method and electronic device | |
| CN111367457A (en) | Content sharing method and device and electronic equipment | |
| CN107544740B (en) | Application processing method and device, storage medium and electronic equipment | |
| CN114064173A (en) | Method, device, medium and equipment for creating instant session page | |
| CN112764600B (en) | Resource processing method, device, storage medium and computer equipment | |
| CN113596529A (en) | Terminal control method and device, computer equipment and storage medium | |
| CN111324262B (en) | Application interface control method, device, terminal and medium | |
| CN112381091A (en) | Video content identification method and device, electronic equipment and storage medium | |
| CN108052506A (en) | Natural language processing method, apparatus, storage medium and electronic equipment | |
| CN107402756A (en) | For drawing the method, apparatus and terminal of the page | |
| CN115412634B (en) | Message display method and device | |
| CN112181351A (en) | Voice input method and device and electronic equipment | |
| CN115379113B (en) | Shooting processing method, device, equipment and storage medium | |
| CN115016710B (en) | Application program recommendation method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |