CN115562772A - Scene recognition and preprocessing method and electronic equipment - Google Patents

Scene recognition and preprocessing method and electronic equipment Download PDF

Info

Publication number
CN115562772A
CN115562772A CN202210336392.3A CN202210336392A CN115562772A CN 115562772 A CN115562772 A CN 115562772A CN 202210336392 A CN202210336392 A CN 202210336392A CN 115562772 A CN115562772 A CN 115562772A
Authority
CN
China
Prior art keywords
application
application icon
user
preset
interface
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210336392.3A
Other languages
Chinese (zh)
Other versions
CN115562772B (en
Inventor
孙文涌
李美君
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honor Device Co Ltd
Original Assignee
Honor Device Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Honor Device Co Ltd filed Critical Honor Device Co Ltd
Priority to CN202210336392.3A priority Critical patent/CN115562772B/en
Publication of CN115562772A publication Critical patent/CN115562772A/en
Application granted granted Critical
Publication of CN115562772B publication Critical patent/CN115562772B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04817Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/445Program loading or initiating
    • G06F9/44505Configuring for program initiating, e.g. using registry, configuration files

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Telephone Function (AREA)

Abstract

The embodiment of the application provides a scene recognition and preprocessing method and electronic equipment, and relates to the field of terminals. The electronic equipment displays a first interface; the first interface includes a plurality of application icons. The electronic equipment receives starting operation of a user on an application program corresponding to the application icon on the first interface according to a preset rule. And if the number of the application programs receiving the starting operation is larger than or equal to the preset value, responding to the starting operation of the user on the application program corresponding to the application icon on the first interface according to the preset rule, and executing a preset instruction. The method can accurately identify the specific scene of the electronic equipment used by the user for preprocessing, and improves the performance of the electronic equipment. For example, if a sequence starting scene is recognized, some application programs are preloaded to the virtual screen, and the starting efficiency of the application programs is improved.

Description

Scene recognition and preprocessing method and electronic equipment
Technical Field
The present application relates to the field of terminals, and in particular, to a scene recognition and preprocessing method and an electronic device.
Background
The scenes of the user using the electronic devices such as the mobile phone and the like usually have certain rules. For example, when testing the performance of the mobile phone, the user can sequentially run a plurality of application programs on the desktop of the mobile phone; for example, a user may turn on navigation software on a cell phone on a daily commute. How to more accurately identify a specific scene of the user using the electronic device for performing corresponding preprocessing is a problem to be solved.
Disclosure of Invention
The embodiment of the application provides a scene recognition and preprocessing method and electronic equipment, which can accurately recognize a specific scene of an electronic equipment used by a user so as to carry out preprocessing and improve the performance of the electronic equipment.
In order to achieve the above purpose, the embodiment of the present application adopts the following technical solutions:
in a first aspect, a scene recognition and preprocessing method is provided, which is applied to an electronic device, and includes: the electronic equipment displays a first interface; the first interface comprises a plurality of application icons; and receiving the starting operation of the user on the application program corresponding to the application icon on the first interface according to a preset rule. And if the number of the application programs receiving the starting operation is larger than or equal to the preset value, responding to the starting operation of the user on the application program corresponding to the application icon on the first interface according to the preset rule, and executing a preset instruction.
In the method, if the operation that a user starts an application program on a first interface (such as a desktop) according to a preset rule in sequence is detected, a preset instruction is executed. The sequence starting scene (also called a small white starting scene) can be accurately identified for preprocessing.
In one example, executing the preset instructions comprises: loading interfaces of one or more application programs meeting preset conditions to a virtual screen of the electronic equipment; the virtual screen is a simulated screen corresponding to the display screen of the electronic equipment, and the interface loaded to the virtual screen is not displayed for the user. The preset conditions include: the application icon of the application program is arranged after the application icon of the starting operation is received this time, and the application program is not started.
That is, if the sequence starting scene is detected, the application program corresponding to the application icon behind the current application icon on the desktop is preloaded to the virtual screen. Therefore, when the user starts the application program corresponding to the application icon behind the current application icon in sequence, the main interface of the application program stored on the virtual screen can be directly loaded to the main screen (display screen) for displaying. When the preloaded application program is started, the generation process of the main interface is not needed, so that the starting speed is improved.
Wherein the preset conditions include: the application type of the application program is a preset application type; the application types include: game, live, chat, navigation or conversation.
In another example, executing the preset instructions includes: and allocating resources for one or more application programs meeting the preset conditions. Wherein the preset conditions include: the application icon of the application program is arranged after the application icon of the starting operation is received this time, and the application program is not started.
That is, if the sequence starting scene is detected, resources are allocated in advance for the application program corresponding to the application icon behind the current application icon on the desktop. Therefore, resources occupied by the application program which does not meet the preset condition can be reduced as much as possible, resources are freed for the application program which is started or meets the preset condition (to be started), and the resource utilization rate is improved. And when the application program is started, the process of allocating resources is not required to be waited, and the starting efficiency is improved.
With reference to the first aspect, in an embodiment, the preset rule includes: and clicking the next adjacent application icon in sequence from left to right and from top to bottom of different rows according to the first row and the second row.
With reference to the first aspect, in another embodiment, the preset rule includes: and sequentially clicking the next adjacent application icon from top to bottom in each column and from left to right in different columns according to the sequence of the first column and the second row.
Wherein, clicking in sequence comprises: after receiving the clicking operation of the user on the first application icon, receiving the clicking operation of the user on the second application icon within a preset time length; the first application icon is adjacent to the second application icon in position on the first interface. In an implementation manner of the embodiment of the present application, the last application icon in one row and the first application icon in the next row are adjacent application icons; the last application icon in a column is an adjacent application icon to the first application icon in the next column.
In one embodiment, the position of the first application icon and the second application icon on the first interface being adjacent comprises: there is no application icon or folder or empty location between the first application icon and the second application icon.
In one embodiment, the position of the first application icon and the second application icon on the first interface being adjacent comprises: one or more empty locations are between the first application icon and the second application icon.
In one embodiment, the position of the first application icon and the second application icon on the first interface being adjacent comprises: between the first application icon and the second application icon are one or more folders.
With reference to the first aspect, in one embodiment, the method further includes: and if the user stops the starting operation of the application program corresponding to the application icon on the first interface according to the preset rule, stopping executing the preset instruction.
In one implementation manner, determining that a user stops starting an application program corresponding to an application icon on a first interface according to a preset rule includes: and determining that the starting operation of the user on the application program corresponding to the application icon on the first interface is not received within the preset time length. For example, the user stops clicking on the application icon on the first interface.
In another implementation manner, determining that the user stops starting the application program corresponding to the application icon on the first interface according to the preset rule includes: and receiving starting operation of a user on an application program corresponding to the application icon on the first interface, and determining that the preset rule is not met. For example, the user does not click on the application icon on the first interface according to the preset rule.
In a second aspect, a scene recognition and preprocessing method is provided, which is applied to an electronic device, and includes: the electronic equipment acquires a current date and a current time; and detects a network state and a motion state of the electronic device. The electronic equipment determines whether the electronic equipment enters a preset scene or exits the preset scene according to the current date, the current time, the network state and the motion state of the electronic equipment. Wherein the network state of the electronic device may be a Wi-Fi connection state, including connected or unconnected; the motion state of the electronic device includes moving or stationary.
In the method, the scene of the electronic equipment is identified by combining the network state and the motion state of the electronic equipment, so that the specific scene (such as an on-duty scene and an off-duty scene) can be identified more accurately. The application program corresponding to the specific scene is preprocessed, and the use performance of the electronic equipment is improved.
With reference to the second aspect, in one embodiment, if it is determined that a specific scenario is entered, a preset range of applications is preloaded. For example, if an entry to a work scene (a scene in which the user is on the way to work) is detected, the first type of application program is preloaded. For example, the first type of application program includes a navigation application, an attendance application, a video application, and the like. For example, if the user detects a scene entering work (a scene in the process of the user leaving work), the second type of application program is preloaded.
With reference to the second aspect, in one embodiment, the electronic device determines that the current system date is within a preset date range and the current system time is within a preset time range, and monitors the Wi-Fi connection status and the motion status of the handset. And if the connection state of the electronic equipment and the preset first Wi-Fi network is switched from connected to unconnected and the motion state of the electronic equipment is mobile, determining to enter a first scene.
In one embodiment, if the connection state of the electronic device and the preset second Wi-Fi network is switched from unconnected to connected, the first scene is determined to be exited.
In a third aspect, an electronic device is provided, which has a function of implementing the method of the first aspect. The function can be realized by hardware, and can also be realized by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the functions described above.
In a fourth aspect, an electronic device is provided, which has the function of implementing the method of the second aspect. The function can be realized by hardware, and can also be realized by executing corresponding software by hardware. The hardware or software includes one or more modules corresponding to the functions described above.
In a fifth aspect, an electronic device is provided, comprising: a processor and a memory; the memory is used for storing computer execution instructions, and when the electronic device runs, the processor executes the computer execution instructions stored by the memory to make the electronic device execute:
the electronic equipment displays a first interface; the first interface comprises a plurality of application icons; and receiving the starting operation of the user on the application program corresponding to the application icon on the first interface according to a preset rule. And if the number of the application programs receiving the starting operation is larger than or equal to the preset value, responding to the starting operation of the user on the application program corresponding to the application icon on the first interface according to the preset rule, and executing a preset instruction.
In one example, executing the preset instructions comprises: loading interfaces of one or more application programs meeting preset conditions to a virtual screen of the electronic equipment; the virtual screen is a simulated screen corresponding to the display screen of the electronic equipment, and the interface loaded to the virtual screen is not displayed for the user. The preset conditions include: and arranging the application icons of the application programs after the application icons of the starting operation are received at this time, wherein the application programs are not started.
Wherein the preset conditions include: the application type of the application program is a preset application type; the application types include: game, live, chat, navigation or conversation.
In another example, executing the preset instructions includes: and allocating resources for one or more application programs meeting preset conditions. Wherein the preset conditions include: the application icon of the application program is arranged after the application icon of the starting operation is received this time, and the application program is not started.
With reference to the fifth aspect, in one embodiment, the preset rule includes: and clicking the next adjacent application icon in sequence from left to right and from top to bottom of different rows according to the first row and the second row.
With reference to the fifth aspect, in another embodiment, the preset rule includes: and clicking the next adjacent application icon in sequence from top to bottom in each column and from left to right in different columns according to the sequence of the first column and the second row.
Wherein, clicking in sequence comprises: after receiving the clicking operation of the user on the first application icon, receiving the clicking operation of the user on the second application icon within a preset time length; the first application icon is adjacent to the second application icon in position on the first interface. In one implementation manner of the embodiment of the present application, the last application icon in one row and the first application icon in the next row are adjacent application icons; the last application icon in a column is adjacent to the first application icon in the next column.
In one embodiment, the position of the first application icon and the second application icon on the first interface being adjacent comprises: there is no application icon or folder or empty location between the first application icon and the second application icon.
In one embodiment, the position of the first application icon and the second application icon on the first interface being adjacent comprises: one or more empty locations are between the first application icon and the second application icon.
In one embodiment, the position of the first application icon and the second application icon on the first interface being adjacent comprises: between the first application icon and the second application icon are one or more folders.
With reference to the fifth aspect, in one embodiment, the method further comprises: and if the user stops the starting operation of the application program corresponding to the application icon on the first interface according to the preset rule, stopping executing the preset instruction.
In one implementation manner, determining that a user stops starting an application program corresponding to an application icon on a first interface according to a preset rule includes: and determining that the starting operation of the user on the application program corresponding to the application icon on the first interface is not received within the preset time length. For example, the user stops clicking on the application icon on the first interface.
In another implementation manner, determining that the user stops starting the application program corresponding to the application icon on the first interface according to the preset rule includes: and receiving starting operation of a user on an application program corresponding to the application icon on the first interface, and determining that the preset rule is not met. For example, the user does not click on the application icon on the first interface according to the preset rule.
In a sixth aspect, an electronic device is provided, comprising: a processor and a memory; the memory is used for storing computer-executable instructions, and when the electronic device is running, the processor executes the computer-executable instructions stored in the memory, so as to make the electronic device execute the method according to any one of the second aspect.
In a seventh aspect, an electronic device is provided, including: a processor; the processor is configured to be coupled to the memory and to perform the method according to any of the first aspect or the second aspect according to the instructions after reading the instructions in the memory.
In an eighth aspect, there is provided a computer-readable storage medium having stored therein instructions, which when run on a computer, cause the computer to perform the method of any of the above first aspects, or to perform the method of any of the above second aspects.
In a ninth aspect, there is provided a computer program product comprising instructions which, when run on a computer, cause the computer to perform the method of any one of the first aspects above, or to perform the method of any one of the second aspects above.
In a tenth aspect, there is provided an apparatus (which may be a system-on-a-chip, for example) comprising a processor for enabling an electronic device to implement the functionality referred to in the first or second aspect above. In one possible design, the apparatus further includes a memory for storing program instructions and data necessary for the electronic device. When the device is a chip system, the device may be formed by a chip, and may also include a chip and other discrete devices.
The technical effects brought by any one of the embodiments in the third aspect to the tenth aspect may be referred to the technical effects brought by different embodiments in the first aspect or the second aspect, and are not described herein again.
Drawings
Fig. 1 is a schematic hardware structure diagram of an electronic device according to an embodiment of the present disclosure;
fig. 2 is a schematic diagram of a software architecture of an electronic device according to an embodiment of the present disclosure;
fig. 3 is a schematic diagram of an example of an interface to which the scene recognition and preprocessing method provided in the embodiment of the present application is applied;
fig. 4 is a schematic flowchart of a scene recognition and preprocessing method according to an embodiment of the present application;
fig. 5 is a schematic diagram of an example of an interface to which the scene recognition and preprocessing method provided in the embodiment of the present application is applied;
fig. 6 is a schematic diagram of an example interface to which the scene recognition and preprocessing method provided in the embodiment of the present application is applied;
fig. 7 is a schematic diagram of an example interface to which the scene recognition and preprocessing method provided in the embodiment of the present application is applied;
fig. 8 is a schematic diagram of an example of an interface to which the scene recognition and preprocessing method provided in the embodiment of the present application is applied;
fig. 9 is a schematic diagram of an example interface to which the scene recognition and preprocessing method provided in the embodiment of the present application is applied;
fig. 10 is a schematic diagram of an example interface to which the scene recognition and preprocessing method provided in the embodiment of the present application is applied;
fig. 11 is a schematic diagram of an example interface to which the scene recognition and preprocessing method provided in the embodiment of the present application is applied;
fig. 12 is a schematic diagram of an example interface to which the scene recognition and preprocessing method provided in the embodiment of the present application is applied;
fig. 13 is a schematic diagram of an example interface to which the scene recognition and preprocessing method provided in the embodiment of the present application is applied;
fig. 14 is a schematic diagram of an example interface to which the scene recognition and preprocessing method provided in the embodiment of the present application is applied;
fig. 15 is a schematic flowchart of a scene recognition and preprocessing method according to an embodiment of the present application;
fig. 16 is an architecture diagram of an electronic device according to an embodiment of the present application.
Detailed Description
In describing embodiments of the present application, the terminology used in the following embodiments is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the specification of this application and the appended claims, the singular forms "a", "an", "the", and "the" are intended to include the plural forms as well, such as "one or more", unless the context clearly indicates otherwise. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" means one or more than two (including two). The term "and/or" is used to describe an association relationship that associates objects, meaning that three relationships may exist; for example, a and/or B, may represent: a exists singly, A and B exist simultaneously, and B exists singly, wherein A and B can be singular or plural. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.
Reference throughout this specification to "one embodiment" or "some embodiments," or the like, means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," or the like, in various places throughout this specification are not necessarily all referring to the same embodiment, but rather mean "one or more but not all embodiments" unless specifically stated otherwise. The terms "comprising," "including," "having," and variations thereof mean "including, but not limited to," unless expressly specified otherwise. The term "coupled" includes direct coupling and indirect coupling, unless otherwise noted. "first" and "second" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated.
In the embodiments of the present application, words such as "exemplary" or "for example" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "e.g.," is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the word "exemplary" or "such as" is intended to present concepts related in a concrete fashion.
The scene recognition and preprocessing method provided by the embodiment of the application can be applied to electronic equipment comprising a display screen. The electronic device may include a mobile phone, a tablet computer, a notebook computer, a Personal Computer (PC), an ultra-mobile personal computer (UMPC), a handheld computer, a netbook, a smart home device (e.g., a smart television, a smart screen, a large screen, a smart speaker, a smart air conditioner, etc.), a Personal Digital Assistant (PDA), a wearable device (e.g., a smart watch, a smart bracelet, etc.), an in-vehicle device, a virtual reality device, etc., which is not limited in this embodiment.
In this embodiment, the electronic device is an electronic device that can run an operating system and install an application program. Alternatively, the operating system run by the electronic device may be
Figure BDA0003576792160000051
The system is provided with a plurality of sensors,
Figure BDA0003576792160000052
the system is characterized in that the system comprises a plurality of systems,
Figure BDA0003576792160000053
systems, and the like.
Exemplarily, taking an electronic device as a mobile phone as an example, fig. 1 shows a schematic structural diagram of an electronic device provided in an embodiment of the present application. That is, the electronic device shown in fig. 1 may be, for example, a cellular phone.
As shown in fig. 1, the mobile phone 100 may include a processor 110, an external memory interface 120, an internal memory 121, a Universal Serial Bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and the like.
Optionally, the mobile phone may further include a mobile communication module 150, a Subscriber Identity Module (SIM) card interface 195, and the like.
The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.
It is to be understood that the structure shown in fig. 1 does not constitute a specific limitation of the cellular phone. In some embodiments, the handset may also include more or fewer components than shown in fig. 1, or combine certain components, or split certain components, or a different arrangement of components, etc. Alternatively still, some of the components shown in FIG. 1 may be implemented in hardware, software, or a combination of software and hardware.
Processor 110 may include one or more processing units, such as: the processor 110 may include an Application Processor (AP), a modem processor, a Graphics Processor (GPU), an Image Signal Processor (ISP), a controller, a memory, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), among others. Wherein, the different processing units may be independent devices or may be integrated in one or more processors. The controller can be the neural center and the command center of the mobile phone. The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution.
A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Avoiding repeated accesses reduces the latency of the processor 110, thereby increasing the efficiency of the system.
In some embodiments, processor 110 may include one or more interfaces. The interface may include an integrated circuit (I2C) interface, an integrated circuit built-in audio (I2S) interface, a Pulse Code Modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a general-purpose input/output (GPIO) interface, a SIM interface, and/or a USB interface, etc.
The charging management module 140 is configured to receive charging input from a charger. The charging management module 140 may also supply power to the mobile phone through the power management module 141 while charging the battery 142. The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 may also receive input from the battery 142 to power the mobile phone.
The wireless communication function of the mobile phone can be realized by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, the baseband processor, and the like.
The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the handset may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.
When the handset includes the mobile communication module 150, the mobile communication module 150 may provide a solution including 2G/3G/4G/5G wireless communication applied on the handset. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like. The mobile communication module 150 may receive the electromagnetic wave from the antenna 1, filter, amplify, etc. the received electromagnetic wave, and transmit the electromagnetic wave to the modem processor for demodulation. The mobile communication module 150 may also amplify the signal modulated by the modem processor, and convert the signal into electromagnetic wave through the antenna 1 to radiate the electromagnetic wave. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the same device as at least some of the modules of the processor 110.
The modem processor may include a modulator and a demodulator. The modulator is used for modulating a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then passes the demodulated low frequency baseband signal to a baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 150 or other functional modules, independent of the processor 110.
The wireless communication module 160 may provide solutions for wireless communication applied to a mobile phone, including Wireless Local Area Networks (WLANs) (e.g., wi-Fi networks), bluetooth (BT), global Navigation Satellite System (GNSS), frequency Modulation (FM), NFC, infrared (IR), and the like. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, perform frequency modulation and amplification on the signal, and convert the signal into electromagnetic waves through the antenna 2 to radiate the electromagnetic waves.
In some embodiments, the handset antenna 1 is coupled to the mobile communication module 150 and the handset antenna 2 is coupled to the wireless communication module 160 so that the handset can communicate with the network and other devices via wireless communication techniques. The wireless communication technology may include global system for mobile communications (GSM), general Packet Radio Service (GPRS), code division multiple access (code division multiple access, CDMA), wideband Code Division Multiple Access (WCDMA), time-division code division multiple access (time-division code division multiple access, TD-SCDMA), long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and/or IR technologies, etc. The GNSS may include a Global Positioning System (GPS), a global navigation satellite system (GLONASS), a beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and/or a Satellite Based Augmentation System (SBAS).
The mobile phone realizes the display function through the GPU, the display screen 194, the application processor and the like. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.
The display screen 194 is used to display images, video, and the like. The display screen 194 includes a display panel. The display panel may adopt a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a miniature, a Micro-oeld, a quantum dot light-emitting diode (QLED), and the like. In some embodiments, the cell phone may include 1 or N display screens 194, N being a positive integer greater than 1.
The mobile phone can realize shooting functions through the ISP, the camera 193, the video codec, the GPU, the display screen 194, the application processor and the like. In some embodiments, the handset may include 1 or N cameras 193, N being a positive integer greater than 1.
The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to extend the storage capability of the mobile phone. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music, video, etc. are saved in an external memory card.
The internal memory 121 may be used to store computer-executable program code, which includes instructions. The processor 110 executes various functional applications of the cellular phone and data processing by executing instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. The storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like. The data storage area can store data (such as audio data, phone book and the like) created in the use process of the mobile phone. In addition, the internal memory 121 may include a high speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a Universal Flash Storage (UFS), and the like.
The mobile phone can implement an audio function through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. Such as music playing, recording, etc.
Of course, it should be understood that the above-mentioned fig. 1 is only an exemplary illustration of the electronic device in the form of a mobile phone. If the electronic device is a tablet computer, a handheld computer, a PC, a PDA, a wearable device (e.g., a smart watch, a smart bracelet), a smart home device (e.g., a television), a vehicle machine (e.g., a vehicle-mounted computer), a smart screen, a game machine, and an AR/VR device, the structure of the electronic device may include fewer structures than those shown in fig. 1, or may include more structures than those shown in fig. 1, which is not limited herein.
The methods in the following embodiments may be implemented in an electronic device having the above hardware structure. For example, in the embodiment of the present application, in order to implement the above-described scene recognition and preprocessing method, the electronic device may adopt a system architecture as shown in fig. 2. As shown in fig. 2, the system architecture of the electronic device may include an application layer, a system framework layer (framework layer), a native framework (native), and a hardware layer. The application layer may be used to deploy one or more application programs that can run on the electronic device, for example, in the embodiment of the present application, a desktop application, a file management application, an email application, a music application, a calculator application, and the like may be deployed in the application layer. The system framework layer can be deployed with a real-time system (such as a first system), a non-real-time system (such as a second system), a three-party feature library and the like. The local framework may deploy acquisition systems and performance radars. The hardware layer may include hardware such as a CPU, a memory, and a storage, wherein the storage may include a Random Access Memory (RAM), an external storage, and the like.
The non-real-time system is used for processing operations which have low real-time requirements, namely, operations which can be processed in an independent process. Therefore, the problem that all functions are operated on the system process to cause blocking due to overhigh load is avoided. Optionally, the non-real-time system may include a preloading module configured to check and construct parameters required for preloading a corresponding application program, a virtual screen management module configured to create and manage relevant parameters of a virtual screen required for preloading the application program, a configuration management module configured to maintain preset configuration parameters, a decision module configured to decide whether to preload an application, a scene recognition module configured to recognize a scene where the current electronic device is located, a load monitoring module configured to monitor a load of the electronic device, and an application management module configured to manage relevant attributes of the application program installed in the electronic device (e.g., a starting mode of the application program, a process to be started, a starting parameter of an interface to be started, a loading feature of the application program, etc.).
The real-time system is used for processing operations strongly related to the running state of an application program and a process, operations with a relatively high requirement on real-time performance (for example, predicting the application program to be preloaded, executing the preloading operation of the application program, and the like), and operations strongly related to system services such as a process management service (AMS), a Window Management Service (WMS), a Package Management Service (PMS), and the like. The real-time system may run in a system process (system server). Optionally, based on the functions that can be realized by the real-time system, the real-time system may include a window management module for managing a display window, an agent module for acting on a message related to the preloaded application program, a prediction module for predicting the application program that needs to be preloaded, a resource management and control module for managing and controlling resources used by the preloaded application program, a preload management module for performing application program preloading, and a maintenance and test module for maintaining and testing an application program preloading function.
As an example, based on the system architecture as shown in fig. 2. A three-party feature library including relevant attribute features for a plurality of applications may be pre-established. The three-party feature library may include application types (e.g., application types such as games, instant messaging, videos, payments, news, and the like) corresponding to the application programs, system resources consumed by loading the application programs (e.g., CPU load, memory usage, power consumption, and the like), time consumed by loading the application programs to an expected interface (i.e., an operational interface) (i.e., application program loading duration), and the like. Optionally, a corresponding feature library may be established in a cloud server, and then synchronized into a three-party feature library of the electronic device in a cloud push manner.
The technical solutions in the embodiments of the present application will be described in detail below with reference to the accompanying drawings in the embodiments of the present application.
At present, many electronic devices can perform statistical analysis according to a large amount of historical data of the electronic devices used by users to identify different scenes; corresponding processing can be carried out according to scenes; such as preloading applications, pre-allocating resources, etc. However, in some specific scenarios, for example, when a user evaluates a mobile phone or takes a new phone for experience, because the time for the user to use the electronic device is short, the electronic device cannot obtain the habit of the user to use the electronic device, and cannot perform corresponding processing according to the habit of the user.
In one example, when a user evaluates a mobile phone or takes a new phone for experience, the applications are sequentially started according to the arrangement sequence of the applications on the desktop. Illustratively, as shown in fig. 3, application icons of a plurality of application programs are arranged on the desktop of the mobile phone. The application icons on the desktop are arranged into 4 rows; line 1 is, from left to right, "file management" 301, "email" 302, "music" 303, and "calculator" 304, respectively; line 2, from left to right, is "video" 305, "health" 306, "Game 1"307, and "browser" 308, respectively; line 3 is, from left to right, "Game 2"309 and "settings" 310, respectively. When the user evaluates the mobile phone, the user may sequentially click the application icons of the application programs in order to sequentially start the application programs. For example, the user clicks the application icons "email" 302, "music" 303, "calculator" 304, "video" 305, and "health" 306 in sequence; in response to the user clicking the application icon "email" 302, the cell phone launches an "email" application; in response to the user clicking the application icon "music" 303, the mobile phone starts a "music" application; in response to the user clicking on the application icon "calculator" 304, the handset launches a "calculator" application; in response to the user clicking on the application icon "video" 305, the cell phone launches the "video" application; in response to the user clicking the application icon "healthy" 306, the handset launches the "healthy" application. For another example, the user clicks the application icons "video" 305, "game 2"309, "email" 302, and "health" 306 in sequence; in response to the user clicking on the application icon "video" 305, the cell phone launches the "video" application; in response to the user clicking the application icon "game 2"309, the cell phone starts the "game 2" application; in response to the user clicking the application icon "email" 302, the cell phone launches the "email" application; in response to the user clicking the application icon "healthy" 306, the handset launches the "healthy" application. In the embodiment of the present application, a scene in which a user sequentially clicks an application icon to sequentially start a plurality of application programs is referred to as a sequential start scene (also referred to as a whitelet start scene).
The embodiment of the application provides a scene identification and preprocessing method, which can accurately identify the sequence starting scene so as to perform corresponding processing. The scene recognition and preprocessing method provided by the embodiment of the application can be applied to the electronic equipment shown in fig. 1. The embodiment of the present application takes an electronic device as an example for explanation. As shown in fig. 4, the method may include:
s401, displaying a first interface by the mobile phone, wherein the first interface comprises a plurality of application icons.
Take the first interface as the desktop of the mobile phone as an example. The desktop of the cell phone may display one or more display objects. The display object may be an application icon of an application program, a folder including one or more application icons, or a plug-in (widget), etc. The desktop of the mobile phone can only comprise one page or can be divided into a plurality of pages for display. Generally, page 0 is referred to as the main desktop. In the embodiment of the present application, if not specifically described, the main desktop is taken as an example. Illustratively, as shown in fig. 5, the desktop of the handset 100 includes application icons "file management" 301, "email" 302, "music" 303, "video" 305, "health" 306, "game 1"307, "browser" 308, "game 2"309, and "settings" 310; also included is folder "folder 1"311; an insert 312 is also included. It is understood that the first interface may not include folders and plug-ins; illustratively, as shown in FIG. 3, the desktop of the cell phone 100 includes a plurality of application icons, excluding folders and plug-ins.
The layout of the display objects on the desktop of the mobile phone needs to meet the preset (or user-set) grid specification. The layout of the display objects, i.e. the position occupied by each display object on the desktop. For example, the grid specification is "4x6", which means that there are 4x6 positions for arranging the display objects in each page of the desktop, wherein there are 4 positions in each row and 6 positions in each column. One display object may occupy one or more positions. If each display object occupies one position and the grid specification is '4 x 6', at most 4 display objects are arranged in each row and at most 6 display objects are arranged in each column on the main desktop. In the embodiment of the present application, an example is described in which one application icon or folder occupies one position.
Generally, the cell phone desktop is laid out in a compact arrangement by default. There is no place (empty place) between application icons (or folders) that is not occupied by any application icon (or folder). In one example, the application icons and folders are arranged in a left-to-right, leading-to-trailing manner; after the positions of the previous row are occupied, the positions of the next row are arranged from left to right. As shown in fig. 5, there are 4 positions per row of the cell phone 100 desktop; "file management" 301, "email" 302, "music" 303, and "folder 1"311 are arranged in the first row; "video" 305, "health" 306, "game 1"307, and "browser" 308 are ranked in the second row; "Game 2"309 and "settings" 310 are arranged in the third row; there are no empty locations between the various application icons. In another example, the application icons and folders are arranged from top to bottom, column to row; after the positions of the previous column are occupied, the next column starts to be arranged from top to bottom. Illustratively, as shown in FIG. 6, there are 6 positions in each column of the desktop of the cell phone 100; "file management" 301, "email" 302, "music" 303, "folder 1"311, "video" 305, and "health" 306 are arranged in the first column; "game 1"307, "browser" 308, "game 2"309, and "settings" 310 are arranged in the second column; there are no empty positions between the respective application icons. Of course, the application icons and the folders may also be arranged in other manners, which is not limited in this embodiment of the application.
In other embodiments, there are empty locations between application icons (or folders). For example, after the user drags the application icon and moves the position of the application icon; or after the user deletes the application icon; the application icon appears empty at the home position. Illustratively, as shown in FIG. 7, there is an empty location between the row 2 app icon "video" 305 and the app icon "Games 1"307.
The mobile phone can record the information of each display object in a database; for example, the information of the display object includes a name, a starting point of the occupied position, the number of occupied positions, and the like. Illustratively, the information of the display objects in the database is shown in table 1.
TABLE 1
title container screen cellX cellY spanX spanY
File management -100 0 0 0 1 1
Electronic mail -100 0 1 0 1 1
Music -100 0 2 0 1 1
Calculator -100 0 3 0 1 1
Video -100 0 0 1 1 1
Health care -100 0 1 1 1 1
Game 1 -100 0 2 1 1 1
Browser -100 0 3 1 1 1
Game 2 -100 0 0 2 1 1
Is provided with -100 0 1 2 1 1
Wherein, title is the name of the display object. container indicates the container type; for example, -100 indicates that the display object is displayed on the desktop. screen indicates that the display object is displayed on the page number of the desktop; for example, 0 indicates that the display object is displayed on page 0 of the desktop, i.e., on the main desktop. cellX represents the starting point of the abscissa (namely, the abscissa is displayed in the several columns) of a certain page of the desktop of the display object; for example, the cellX corresponding to "file management" is 0, and the starting point of the position of the application icon "file management" is column 1; the cellX corresponding to the "email" is 1, indicating that the starting point of the position of the application icon "email" is column 2. cellY represents the starting point of the ordinate (i.e. displayed in the several rows) of the display object; for example, the cellY corresponding to the "file management" is 0, and the starting point of the position indicating the application icon "file management" is line 1; cell Y for "video" is 1, indicating that the starting point of the position of the application icon "video" is line 2. spanX represents the number of positions laterally occupied by the display object; for example, the spanX corresponding to the application icon "file management" is 1, which indicates that the application icon "file management" occupies 1 position horizontally. spanY represents the number of positions occupied by the display object longitudinally; for example, the span corresponding to the application icon "file management" is 1, which indicates that the application icon "file management" vertically occupies 1 position.
S402, receiving the starting operation of the user on the first interface to the application program according to the preset rule.
Take the first interface as the desktop of the mobile phone as an example. In the sequence starting scene, a user sequentially clicks the next adjacent application icon on the desktop of the mobile phone according to a preset sequence so as to sequentially start the corresponding application programs. The mobile phone receives the starting operation of the user on the desktop of the mobile phone according to the preset rule. The launch operation may include operations such as clicking (e.g., single-or double-clicking) on an application icon of the application, right-clicking on an application icon of the application and selecting an "open" option, etc.
The mobile phone receives the starting operation of the user on the application program, and determines the position of the application icon of the application program on the desktop. Take the launch operation as an example of clicking an application icon of an application program. In one implementation mode, the mobile phone collects click input of a user on a display screen of the mobile phone, and determines an application icon clicked by the user according to the position of the click input. The specific implementation manner may refer to the prior art, and details are not described in the embodiments of the present application. The mobile phone saves the position of each application icon on the desktop. Illustratively, the location of the application icon on the desktop is shown in Table 1. Therefore, the mobile phone can determine the position of the application icon of the application program on the desktop according to the starting operation of the user on the application program.
In some embodiments, the user clicks the next adjacent application icon in sequence from left to right for each row and from top to bottom for different rows, after first and then last. Namely, the preset rules include: and clicking the next adjacent application icon in sequence from left to right and from top to bottom of different rows according to the first row and the second row. It should be noted that, in the embodiment of the present application, the last application icon in the first row is adjacent to the first application icon in the second row.
In one example, as shown in FIG. 8, the user clicks the application icons "File management" 301, "email" 302, "music" 303, "calculator" 304, "video" 305, and "health" 306 in sequence. Note that, an arrow in fig. 8 is used to illustrate the sequence in which the user clicks the application icon, and the arrow may not be displayed.
The mobile phone receives the operation that a user clicks an application icon 'file management' 301, and starts application program file management; the coordinate of the application icon "file management" 301 is determined to be (0, 0), indicating the first column and the first row. The mobile phone receives the operation that a user clicks an application icon 'e-mail' 302, and starts an application program e-mail; the coordinate of the application icon "email" 302 is determined to be (1, 0), indicating the second column, first row. The mobile phone receives an operation that a user clicks an application icon 'music' 303, and starts application program music; the coordinate of the application icon "music" 303 is determined to be (2,0), indicating the third column, first row. The mobile phone receives the operation that a user clicks an application icon 'calculator' 304, and starts an application program calculator; the coordinate of the application icon "calculator" 304 is determined to be (3, 0), indicating the fourth column, the first row. The mobile phone receives the operation that the user clicks the application icon 'video' 305, and starts an application program video; the coordinates of the application icon "video" 305 are determined to be (0, 1), representing the first column and the second row. The mobile phone receives the operation that the user clicks the application icon 'healthy' 306, and starts application program health; the coordinates of the application icon "healthy" 306 are determined to be (1, 1), indicating a second column and a second row. The mobile phone determines that at most 4 application icons are arranged on each row of the desktop, and according to the coordinates (0, 0) of the 'file management' 301, the coordinates (1, 0) of the 'e-mail' 302, the coordinates (2, 0) of the 'music' 303, the coordinates (3, 0) of the 'calculator' 304, the coordinates (0, 1) of the 'video' 305 and the coordinates (1, 1) of the 'health' 306, the next application icon adjacent to the 'file management' 301 is determined to be the 'e-mail' 302, the next application icon adjacent to the 'e-mail' 302 is determined to be the 'music' 303, the next application icon adjacent to the 'music' 303 is determined to be the 'calculator' 304, the next application icon adjacent to the 'calculator' 304 is determined to be the 'video' 305, and the next application icon adjacent to the 'video' 305 is determined to be the 'health' 306; determining to receive the operation that the user clicks the next adjacent application icon in sequence from left to right and from top to bottom of each row according to the front row and the back row; that is, the operation that the user starts the next application program in sequence from left to right and from top to bottom of each row according to the sequence of the first row and the second row is received.
In other examples, the user may not click from the first row and the first column. For example, when the mobile phone receives a user's click operation on "music" 303, "calculator" 304, "video" 305, "health" 306, "game 1"307, and "browser" 308, it is determined that the user's start operation of the application program according to the preset rule is received.
In one implementation, sequentially clicking the next adjacent application icon includes that after receiving a click operation of the first application icon by the user, the mobile phone receives a click operation of the second application icon (the second application icon is the next adjacent application icon) by the user within a preset time length. The preset time period is a preset value, for example, 500 milliseconds. Illustratively, the user clicks the application icons "file management" 301, "email" 302, "music" 303, "calculator" 304, "video" 305, and "health" 306 in sequence, which means that the time interval between the user clicking on "file management" 301 and "email" 302 is less than or equal to a preset time period, the time interval between the user clicking on "email" 302 and "music" 303 is less than or equal to a preset time period, the time interval between the user clicking on "music" 303 and "calculator" 304 is less than or equal to a preset time period, the time interval between the user clicking on "calculator" 304 and "video" 305 is less than or equal to a preset time period, and the time interval between the user clicking on "video" 305 and "health" 306 is less than or equal to a preset time period.
In one example, as shown in fig. 9, the coordinates of the app icon "video" 305 are (0, 1), "game 1"307 are (2, 1), and there is an empty position between "video" 305 and "game 1"307. The user sequentially clicks the application icons "file management" 301, "email" 302, "music" 303, "calculator" 304, "video" 305, and "game 1"307. The cellular phone receives a user's click operation on the application icons "file management" 301, "email" 302, "music" 303, "calculator" 304, "video" 305, and "game 1"307. In one implementation, the mobile phone determines that the next application icon adjacent to the "file management" 301 is "email" 302, the next application icon adjacent to the "email" 302 is "music" 303, the next application icon adjacent to the "music" 303 is "calculator" 304, and the next application icon adjacent to the "calculator" 304 is "video" 305 according to the coordinates (0, 0) of the "file management" 301, the coordinates (1, 0) of the "email" 302, the coordinates (2, 0) of the "music" 303, the coordinates (3, 0) of the "calculator" 304, and the coordinates (0, 1) of the "video" 305; namely, the operation that the user starts 5 application programs according to the preset rule is determined to be received. The handset determines that the "video" 305 and the "game 1"307 are not adjacent, that is, it is determined that the preset rule is not satisfied, based on the coordinates (0, 1) of the "video" 305 and the coordinates (2, 1) of the "game 1"307. In another implementation manner, the mobile phone determines that an empty position exists between coordinates (0, 1) of "video" 305 and coordinates (2, 1) of "game 1"307 according to the stored position information of each application icon, and determines that the next application icon adjacent to "video" 305 is "game 1"307; namely, it is determined that the operation of starting 6 applications (file management, e-mail, music, calculator, video, and game 1) by the user according to the preset rule is received.
In another example, as shown in FIG. 10, the application icons and folders are arranged in a top-down, column-first-row fashion; there are no application icons or folders in the third and fourth columns on the desktop. The user sequentially clicks the app icons "file management" 301, "game 1"307, "email" 302, "browser" 308, "music" 303, and "game 2"309. The cellular phone receives a user's click operation on the application icons "file management" 301, "game 1"307, "email" 302, "browser" 308, "music" 303, and "game 2"309. In one implementation, the mobile phone determines that the next application icon adjacent to the "file management" 301 is "game 1"307, that is, determines that the operation of starting application file management and game 1 by the user according to the preset rule is received. The mobile phone determines that two empty positions exist between the coordinates (1, 0) of the game 1 307 and the coordinates (1, 1) of the E-mail 302, and determines that the game 1 307 and the E-mail 302 are not adjacent, namely that the preset rule is not met. Similarly, the mobile phone determines that the operation that the user starts an application program e-mail and a browser according to a preset rule is received; determining that the operation of starting the browser and the music does not meet a preset rule; and determining to receive the operation of starting the application program music and game 2 by the user according to the preset rule. In another implementation manner, the mobile phone determines that the next application icon adjacent to the "file management" 301 is "game 1"307, that is, determines that the operation of starting application file management and game 1 by the user according to the preset rule is received. If the mobile phone determines that no application icon exists between the coordinates (1, 0) of the game 1 307 and the coordinates (1, 1) of the email 302, the mobile phone determines that the game 1 307 is adjacent to the email 302, namely, the mobile phone determines that the operation of starting the application game 1 and the email by the user according to the preset rule is received. Similarly, the mobile phone determines to receive the operation of 6 applications of the user starting file management, game 1, e-mail, browser, music and game 2 according to the preset rule.
In one example, as shown in fig. 11, the user clicks application icons "file management" 301, "email" 302, "music" 303, "video" 305, "health" 306, and "game 1"307 in order. The mobile phone receives the operation that the user clicks the application icons of 'file management' 301, 'e-mail' 302 and 'music' 303, and determines to receive the operation that the user starts the application program file management, the e-mail and the music according to the preset rule. Then, the handset receives an operation of the user clicking the application icon "video" 305. In one implementation, the mobile phone determines that the "music" 303 and the "video" 305 are not adjacent according to the coordinates (2, 0) of the application icon "music" 303 and the coordinates (0, 1) of the "video" 305, that is, the operation of the user to launch the application program music and video does not meet the preset rule. In another implementation mode, if the mobile phone determines that not the application icon but the folder is arranged at the position of the coordinate (3, 0) between the coordinates (2, 0) and the coordinates (0, 1), the next application icon adjacent to the music icon 303 is determined as the video 305, that is, the operation of starting the music and the video by the user according to the preset rule is determined to be received; namely, it is determined that the receiving user starts the operation of the 6 applications of file management, e-mail, music, video, health, and game 1 according to the preset rule.
In some embodiments, the user clicks the next adjacent application icon in sequence column first followed by row, with each column from top to bottom, and with different columns from left to right. Namely, the preset rules include: and clicking the next adjacent application icon in sequence from top to bottom in each column and from left to right in different columns according to the sequence of the first column and the second row. It should be noted that, in the embodiment of the present application, the last application icon in the first column is adjacent to the first application icon in the second column.
In one example, as shown in FIG. 12, the user clicks the application icons "video" 305, "health" 306, "Game 1"307, "browser" 308, "Game 2"309, and "settings" 310 in sequence. The mobile phone receives an operation that a user clicks an application icon 'video' 305, and starts an application program video; the coordinates of the application icon "video" 305 are determined to be (0, 4), indicating the first column, the fifth row. The mobile phone receives the operation that the user clicks the application icon 'healthy' 306, and starts application program health; the coordinates of the application icon "healthy" 306 are determined to be (0, 5), representing the first column and the sixth row. The mobile phone receives the operation that the user clicks an application icon 'game 1' 307, and starts an application program game 1; the coordinate of the application icon "game 1"307 is determined to be (1, 0), indicating the second column and the first row. The mobile phone receives the operation that the user clicks an application icon 'browser' 308, and starts an application program browser; the application icon "browser" 308 is determined to have coordinates of (1, 1), indicating a second column and a second row. The mobile phone receives the operation that the user clicks an application icon, namely game 2 309, and starts an application program game 2; the coordinates of the application icon "game 2"309 are determined to be (1, 2), indicating the second column and the third row. The mobile phone receives the operation that the user clicks the application icon 'setting' 310, and starts application program setting; the coordinates of the application icon "set" 310 are determined to be (1, 3), indicating the second column and the fourth row. The mobile phone determines that at most 6 application icons are arranged on each column of the desktop, and according to the coordinates (0, 4) of the video 305, the coordinates (0, 5) of the health 306, the coordinates (1, 0) of the game 1 307, the coordinates (1, 1) of the browser 308, the coordinates (1, 2) of the game 2 309 and the coordinates (1, 3) of the setting 310, the next application icon adjacent to the video 305 is determined to be the health 306, the next application icon adjacent to the health 306 is determined to be the game 1 307, the next application icon adjacent to the game 1 307 is determined to be the browser 308, the next application icon adjacent to the browser 308 is determined to be the game 2 309, and the next application icon adjacent to the game 2 309 is determined to be the setting 310; namely, the operation that the user clicks the next adjacent application icon in sequence from top to bottom in the sequence from top to bottom in each column and from left to right in different columns is determined to be received, namely, the operation that the user starts the next adjacent application program in sequence from top to bottom in the sequence from top to right in each column and from left to right in the sequence from first column to back in each column is received.
In one example, as shown in fig. 13, the user clicks the app icons "email" 302, "health" 306, "settings" 310, "music" 303, "game 1"307, and "calculator" 304 in sequence. The cell phone receives an operation of the user clicking on the application icons "email" 302, "health" 306, "settings" 310, "music" 303, "game 1"307, and "calculator" 304. The mobile phone determines according to the stored position information of each application icon, and the plug-ins 312 are arranged in a first row and a second row; the application icon "email" 302 has coordinates of (1, 2), indicating the second column, third row; "healthy" 306 has coordinates of (1, 3), representing the second column and fourth row; the coordinates of "set" 310 are (1, 4), indicating the second column, the fifth row; the coordinates of "music" 303 is (2, 2), indicating the third row of the third column; "Game 1"307 has coordinates (2, 3) indicating the fourth row of the third column; the "calculator" 304 has the coordinates (3, 2) indicating the fourth column and the third row. The mobile phone determines the next application icon adjacent to the "e-mail" 302 is "healthy" 306, and the next application icon adjacent to the "healthy" 306 is "setting" 310 according to the coordinates (1, 2) of the "e-mail" 302, the coordinates (1, 3) of the "healthy" 306, and the coordinates (1, 4) of the "setting" 310. In one implementation, the mobile phone determines that the application icons (which are plug-ins) are not arranged in the first row and the second row on the desktop according to the stored position information of each application icon, the last application icon in the second column is "set" 310, the first application icon in the third column is "music" 303, and the next application icon adjacent to the "set" 310 is determined to be "music" 303; similarly, the next application icon next to "Game 1"307 is determined to be "calculator" 304. Namely, the operation that the user clicks the next adjacent application icon in sequence from top to bottom in the sequence from top to bottom in each column and from left to right in different columns is determined to be received, namely, the operation that the user starts the next adjacent application program in sequence from top to bottom in the sequence from top to right in each column and from left to right in the sequence from first column to back in each column is received.
It should be noted that in other embodiments, different preset rules may be set according to actual situations. Illustratively, the preset rule is shown in fig. 14.
And S403, if the number of the application programs receiving the starting operation is larger than or equal to N, responding to the starting operation of the user on the first interface to the application programs according to the preset rule, and executing a preset instruction.
N is a preset value, e.g., N =6.
In some embodiments, the pre-set instructions include pre-loading the application that satisfies the pre-load condition. In one example, the virtual screen is a simulated screen (e.g., a display instance) and the interface on the virtual screen is not displayed to the user. The display screen is a physical screen. The virtual screen corresponds to the display screen, namely the size and the resolution of the virtual screen and the display screen are the same. And the main interface is the first interface displayed after the application program is started. When the preloaded application program is started, the main interface saved on the virtual screen can be directly loaded to the main screen (display screen) for displaying. When the pre-loaded application program is started, the generation process of the main interface is not needed, and the starting speed is improved.
In one implementation, the preload condition includes: the application icons of the application programs are arranged after the application icons of the starting operation are received, and the application programs are not started in the foreground and are not preloaded.
For example, referring to fig. 8, the mobile phone receives a user's click operation on application icons "file management" 301, "email" 302, "music" 303, "calculator" 304, "video" 305, and "health" 306, the number of application programs that receive the start operation is equal to 6 (N = 6), and the application programs that satisfy the preload condition are preloaded. The mobile phone determines, according to the application icons of the received startup operation, that the application icons are "file management" 301, "email" 302, "music" 303, "calculator" 304, "video" 305, and "health" 306, and the application programs of which the application icons are arranged after the application icons of the received startup operation include: game 1, browser, game 2, and settings.
For example, referring to fig. 13, the mobile phone receives a click operation of the user on the application icons "email" 302, "health" 306, "setting" 310, "music" 303, "game 1"307, and "calculator" 304, the number of applications receiving a start operation is equal to 6 (N = 6), and the applications meeting the preload condition are preloaded. The mobile phone determines the application program with the application icon arranged behind the application icon receiving the startup operation according to the application icons of "email" 302, "health" 306, "setting" 310, "music" 303, "game 1"307 and "calculator" 304 of the application icon receiving the startup operation, and the application program comprises: a browser.
In one implementation, the preload condition further comprises: the application type of the application program is a preset application type. Wherein the application types include: game, live, chat, navigation or conversation, etc. For example, the predetermined application type is a game. For example, referring to fig. 8, the app icon is arranged after the app icon for the launch operation is received, and the un-launched and un-preloaded application programs include: game 1, browser, game 2, and settings, wherein the application type of game 1 and game 2 is game; i.e., applications that satisfy the preload condition include game 1 and game 2.
And if a plurality of application programs meeting the preloading condition exist, sequentially preloading the application programs. In one example, a plurality of application programs are preloaded sequentially from front to back or from back to front according to the arrangement sequence of the application icons; for example, according to the arrangement sequence of the application icons, from front to back, the game 1 is preloaded, and then the game 2 is preloaded; for example, game 2 is preloaded first and then game 1 is preloaded in the order of application icon arrangement from back to front. In another example, a plurality of application programs are preloaded in sequence from long to short or from short to long according to the average starting time length; for example, the mobile phone stores the average starting time of the game 1 and the average starting time of the game 2, determines that the average starting time of the game 2 is longer than the average starting time of the game 1, and preloads the game 2 and then the game 1 in sequence from long to short according to the average starting time. It is understood that the preloading order may also be determined in other manners, which is not limited in the embodiments of the present application.
In one implementation, after each application program is preloaded, the application programs meeting the preloading condition are determined again. Illustratively, with continued reference to FIG. 8, after the user clicks on the app icons "File management" 301, "email" 302, "music" 303, "calculator" 304, "video" 305, and "health" 306, the user also continues to click on the app icons "Games 1"301, "browsers" 308, "Games 2"309, and "settings 310". After the mobile phone receives the click operation of the user on the "healthy" 306, it is determined that the start operation of the user on the application program on the first interface according to the preset rule is received, the number of the application programs receiving the start operation is equal to N (N = 6), and the application programs meeting the pre-loading condition are pre-loaded. The handset determines the applications that satisfy the pre-loaded condition to be games 1 and 2. The game 1 is preloaded in the order of the average starting time length from long to short. For example, the duration of the mobile phone preloading game 1 is the first duration. In one example, during the first time period, game 2 is not started and not preloaded. For example, when the preloading of the game 1 is completed, the mobile phone does not receive the click operation of the user on the game 2 309, after the preloading of the game 1 is completed, it is determined that the game 2 is not started and is not preloaded, and it is determined that the game 2 meets the preloading condition, the game 2 is preloaded. In another example, game 2 has been started for a first duration. For example, before the preloading of game 1 is completed, the mobile phone receives the click operation of the user on "game 2"309, and starts game 2. When the preloading of the game 1 is finished, the mobile phone determines that the game 2 is started, the preloading condition is not met, and the preloading of the game 2 is not carried out.
It will be appreciated that the preset instructions may include other instructions. For example, in other embodiments, the preset instructions include: and pre-allocating resources, such as allocating CPU resources and the like, for the application program which does not receive the starting operation.
In some embodiments, the scene recognition and preprocessing method provided in the embodiments of the present application may further include:
s404, if the user stops starting the application program on the first interface according to the preset rule, the execution of the preset instruction is stopped.
Continuing with FIG. 8, in one example, after clicking the application icons "File management" 301, "email" 302, "music" 303, "calculator" 304, "video" 305, and "health" 306 in sequence, the user clicks "browser" 308. The mobile phone receives an operation of clicking an application icon 'healthy' 306 by a user, determines that a starting operation of the user on an application program on a first interface according to a preset rule is received, and the number of the application programs receiving the starting operation is equal to N (N = 6); execute a preset instruction, for example, preload the game 1. The mobile phone receives an operation that a user clicks an application icon 'browser' 308, and determines that the 'browser' 308 is not adjacent to the 'health' 306, and then determines that the user stops starting an application program on a first interface according to a preset rule; the mobile phone stops executing the preset instruction, for example, the mobile phone does not preload the game 2.
In another example, after the user sequentially clicks the application icons "file management" 301, "email" 302, "music" 303, "calculator" 304, "video" 305, and "health" 306, the user stops clicking the application icons on the first interface. The mobile phone receives an operation of clicking the application icon 'healthy' 306 by a user, determines that a starting operation of the user on the application program on the first interface according to a preset rule is received, and the number of the application programs receiving the starting operation is equal to N (N = 6); execute a preset instruction, e.g., preload game 1. After the mobile phone receives the operation of clicking 'health' 306 by the user for a preset time length and does not receive the operation of clicking the application icon on the first interface by the user, determining that the user stops starting the application program on the first interface according to a preset rule; the mobile phone stops executing the preset instruction, for example, the mobile phone does not preload the game 2.
The following describes the scene recognition and preprocessing method provided in the embodiments of the present application in detail with reference to specific examples.
Fig. 15 is a schematic flowchart of a scene recognition and preprocessing method according to an embodiment of the present disclosure. Continuing to take the example of displaying the first interface (desktop) shown in fig. 8 by the mobile phone, the user sequentially clicks the next adjacent application icon according to the sequence of first row and second row, from left to right of each row and from top to bottom of different rows.
Referring to fig. 15, the method may include:
s1401, a collection module of the desktop application collects click operations of a user on a mobile phone desktop, and generates a corresponding click event.
The desktop application of the application layer comprises an acquisition module and a sequence scene recognition module. The acquisition module is used for acquiring the clicking operation of a user on a desktop.
Illustratively, the collection module detects a user's clicking operation on the "file management" 301, and generates a click event, which includes the package name (such as the name "file management") and coordinates (0, 0) of the "file management" 301.
The collection module detects the user's clicking operation on the "e-mail" 302, and generates a clicking event, which includes the package name (such as the name "e-mail") and the coordinates (1, 0) of the "e-mail" 302.
Similarly, the capture module detects a click operation of the user on "music" 303, "calculator" 304, "video" 305, and generates click events, wherein each click event includes a package name and a coordinate (2, 0) of "music" 303, a package name and a coordinate (3, 0) of "calculator" 304, and a package name and a coordinate (0, 1) of "video" 305.
The collection module detects a user click operation on "healthy" 306 and generates a click event including the package name (e.g., the name "healthy") and coordinates (1, 1) of "healthy" 306.
S1402, the acquisition module of the desktop application sends a click event to the sequence scene recognition module.
The acquisition module generates a click event each time, namely sends the click event to the sequence scene recognition module.
And S1403, the sequence scene recognition module receives the click event and judges whether a sequence starting scene is met.
The sequence start scenario is also called a small white start scenario. The sequence starting scene is a scene of receiving the starting operation of the user on the application program on the first interface according to the preset rule.
And each time the sequence scene identification module receives a click event, storing the package name and the coordinates of the application program included in the event. For example, the sequence scene recognition module stores the package names and coordinates of a maximum of N (e.g., N = 6) applications.
And each time the sequence scene recognition module receives a click event, judging whether the time interval between the current time of receiving the click event and the last time of receiving the click event is less than the preset time length. And if the time interval between the current time of receiving the click event and the last time of receiving the click event is larger than the preset time length, determining that the sequence starting scene is not met. And if the time interval between the current time of receiving the click event and the last time of receiving the click event is smaller than or equal to the preset time length, judging whether the sequence starting scene is met according to the stored packet name and coordinates of the application program and the stored position information of the application icon.
Illustratively, the sequence scenario recognition module receives the click event, and obtains and saves the package name and coordinates of "file management" 301. The sequence scene recognition module determines that the receiving of the starting operation of the user on the first interface to the application program according to the preset rule is not satisfied after the click event is received for the first time.
Illustratively, the sequence scenario recognition module receives the click event, retrieves and saves the package name and coordinates (1, 0) of "email" 302. The sequence scene recognition module determines that the time interval between the current time and the last time of receiving the click event is smaller than a preset time length, determines that the starting operation of the user on the first interface according to a preset rule is received according to the stored coordinates (0, 0) and (1, 0) and the stored position information of the application icon, and determines that the number (2) of the application programs receiving the starting operation is smaller than N.
Similarly, the capture module detects a click operation of the user on "music" 303, "calculator" 304, "video" 305, and sends the package name and coordinates (2, 0) of "music" 303, the package name and coordinates (3, 0) of "calculator" 304, and the package name and coordinates (0, 1) of "video" 305 to the sequence scene recognition module. The sequence scene recognition module obtains and stores coordinates (2, 0) of 'music' 303, coordinates (3, 0) of 'calculator' 304 and coordinates (0, 1) of 'video' 305, determines that starting operation of a user on a first interface for an application program according to a preset rule is received, and determines that the number of the application programs receiving the starting operation is smaller than N.
Illustratively, the collection module detects a user click operation on "healthy" 306 and sends a click event to the sequence context identification module. The sequence scenario recognition module receives the click event, obtains and saves the package name and coordinates (1, 1) of "healthy" 306. And the sequence scene recognition module determines that the starting operation of the user on the application program on the first interface according to the preset rule is received according to the stored coordinates (0, 0), (1, 0), (2, 0), (3, 0), (0, 1) and (1, 1) and the stored position information of the application icons, determines that the number (6) of the application programs receiving the starting operation is equal to N, and then determines to enter a sequence starting scene.
S1404, the sequence scene recognition module sends a starting event to a process management module of the AMS. And if the condition that the sequence starting scene is met is determined, the starting event comprises a sequence starting scene entering identifier and a package name of an application icon arranged behind the application icon which receives the starting operation at this time.
And the sequence scene recognition module sends a starting event to the process management module of the AMS every time the click event is received, and the starting event is used for informing the starting of the application program, wherein the packet name of the application program is included. Illustratively, the sequence scene recognition module notifies the process management module to initiate application file management, email, music, calculator, video, and health in sequence.
Illustratively, the sequence scene recognition module receives a click event corresponding to a click operation of the user on the "healthy" 306, determines that the sequence starting scene is satisfied, and obtains, according to the stored position information of the application icon, the application icon on the desktop, which is arranged behind the application icon ("healthy" 306) receiving the starting operation, including: "game 1"307, "browser" 308, "game 2"309, and "settings" 310. The start event sent by the sequence scene recognition module to the process management module of the AMS includes an entry sequence start scene identifier and package names of application icons (e.g., "game 1", "browser", "game 2", and "setting") arranged after the application icon for which the start operation is currently received. The entry sequence starting scene identification is used for indicating an entry sequence starting scene.
S1405, the process management module of the AMS receives the starting event and starts the corresponding application program.
The process management module is used for managing processes running on the electronic device, such as starting the processes, killing the processes and the like. And the process management module of the AMS receives the starting event, acquires the package name of the application program and starts the corresponding application program according to the package name of the application program.
Illustratively, the process management module receives a start event corresponding to a click operation of the "file management" 301 by the user, and starts the application file management according to the package name of the "file management" 301. The process management module receives a starting event corresponding to the clicking operation of the user on the 'e-mail' 302, and starts the application e-mail according to the package name of the 'e-mail' 302. The process management module receives a starting event corresponding to the clicking operation of the music 303 by the user, and starts application music according to the package name of the music 303. The process management module receives a starting event corresponding to the clicking operation of the user on the calculator 304, and starts the application calculator according to the package name of the calculator 304. The process management module receives a starting event corresponding to the clicking operation of the video 305 by the user, and starts the application program video according to the package name of the video 305.
Illustratively, the process management module receives a start event corresponding to the click operation of the user on the "health" 306, and starts the application program health according to the package name of the "health" 306.
And S1406, if the starting event comprises a sequence starting scene identifier, the process management module sends the sequence starting scene identifier and the packet name of the application icon arranged behind the application icon which receives the starting operation at this time to the scene recognition unit in the prediction module.
And the process management module determines an entry sequence starting scene according to the entry sequence starting scene identifier, namely determines that the starting operation of the user on the first interface according to a preset rule is received, and the number of the application programs receiving the starting operation is greater than or equal to N. And the process management module sends an entering sequence starting scene identifier and the packet name of the application icon arranged behind the application icon receiving the starting operation to a scene recognition unit in the prediction module. Illustratively, the process management module receives a start event corresponding to a click operation of the user on "healthy" 306, and determines an entry sequence start scenario according to the entry sequence start scenario identifier. In one implementation, the process management module determines that the application game 1, browser, game 2, and settings are not launched, and sends the package names for "game 1"307, "browser" 308, "game 2"309, and "settings" 310 to the scene recognition unit in the prediction module.
And S1407, the scene recognition unit in the prediction module sends the sequence starting scene identifier and the package name of the application icon arranged behind the application icon which receives the starting operation at this time to the rule matching unit.
Illustratively, the scene recognition unit receives the entry sequence start scene identifier and determines an entry sequence start scene. The scene recognition unit sends the entry sequence start scene identification, and the package names of "game 1"307, "browser" 308, "game 2"309, and "setting" 310 to the rule matching unit.
And S1408, the rule matching unit in the prediction module receives the entering sequence starting scene identifier, and starts to execute a preset instruction according to a preset matching rule.
The rule matching unit receives an entering sequence starting scene identification and determines an entering sequence starting scene; and determining to execute a preset instruction according to a preset matching rule. The matching rule is used for specifying the corresponding relation between the scene and the instruction. Illustratively, the matching rules include: the instruction corresponding to the sequence starting scene is a pre-loading application, or the instruction corresponding to the sequence starting scene is pre-allocated resources.
Take the instruction corresponding to the sequence starting scene as the pre-loading application as an example. In one example, the rule matching unit sends preload instructions to the preload management module, including package names for "game 1"307, "browser" 308, "game 2"309, and "settings" 310. And the preloading management module receives the preloading instruction, and determines the application types of the game 1 and the game 2 to be preset application types (games) according to the application programs of the game 1, the browser, the game 2 and the set application types. In one implementation, the preload management module stores package names of application programs meeting the preload condition; such as the package name for game 1 and the package name for game 2. The preloading management module preloads the game 2 in the order of average starting time length from long to short. The preload management module notifies the preload module to preload game 2. After the game 2 is preloaded, the preloading module sends a preloading completion indication message to the preloading management module. The preload management module deletes the package name of the game 2 from the package names of the saved applications that satisfy the preload condition. The preloading management module continues to acquire the package names of the application programs meeting the preloading conditions. In one example, the preload management module determines that the application program currently satisfying the preload condition is the game 1 according to the saved package name of the application program satisfying the preload condition. The preload management module notifies the preload module to preload the game 1. The preload module preloads the game 1. In another example, the package name of the saved application program meeting the preloading condition is updated, and the preloading management module stops preloading if the application program meeting the preloading condition does not exist. For example, if game 1 is already started when game 2 is preloaded, game 1 is not preloaded.
It will be appreciated that in some embodiments, the user will continue to click on the application icon on the desktop. Illustratively, referring to FIG. 8, after the user has clicked "health" 306, the user continues to click "Game 1"307. The acquisition module detects the click operation of a user on the game 1 307 to generate a click event; the click event is sent to the sequence scene recognition module, which includes the package name (such as the name "game 1") and coordinates (2, 1) of "game 1"307. The sequence scene recognition module receives the click event and obtains the package name and coordinates of "game 1"307. In one implementation, the sequence scenario recognition module stores (e.g., 6) coordinate information of the last N application icons that received the click event. Illustratively, the saved coordinates (0, 0), (1, 0), (2, 0), (3, 0), (0, 1), and (1, 1) are updated to (1, 0), (2, 0), (3, 0), (0, 1), (1, 1), and (2, 1). The sequence scene recognition module determines to receive the starting operation of the user on the first interface to the application program according to the preset rule according to the stored coordinates (1, 0), (2, 0), (3, 0), (0, 1), (1, 1) and (2, 1) of the application icon receiving the clicking operation and the stored position information of the application icon, and determines to enter a sequence starting scene. The sequence scene recognition module acquires the application icons on the desktop, which are arranged behind the application icon ("game 1" 307) receiving the start operation, according to the position information of the saved application icons, and comprises the following steps: "browser" 308, "Game 2"309, and "settings" 310. The sequence scene recognition module transmits a start event including a package name of "game 1"307, an entry sequence start scene identification, and a package name of an application icon (e.g., "browser", "game 2", and "settings") arranged after receiving the application icon of the start operation to the progress management module of the AMS in the framework layer. The process management module receives the start event and starts application game 1 according to the package name of "game 1"307. And the process management module sends an entering sequence starting scene identifier to a scene identification unit in the prediction module. In one implementation, the process management module determines that the application browser, game 2, and settings are not active, and also sends package names for "browser" 308, "game 2"309, and "settings" 310 to the scene recognition unit in the prediction module. The scene recognition unit receives the entry sequence start scene identification, and sends the entry sequence start scene identification, and package names of "browser" 308, "game 2"309, and "settings" 310 to the rule matching unit. The rule matching unit sends a preload instruction to the preload management module, including package names of "browser" 308, "game 2"309, and "settings" 310. The preloading management module receives the preloading instruction, and determines the application type of the game 2 to be a preset application type (game) according to the application program browser, the game 2 and the set application type; the package name of the application program that satisfies the preload condition that is saved is updated to game 2. When the preloading of the game 2 is finished, the preloading management module deletes the package name of the game 2 from the stored package names of the application programs meeting the preloading condition; there is no application that satisfies the preload condition. The preload management module stops preloading.
In some embodiments, the user stops starting the application program on the first interface according to the preset rule, and then stops executing the preset instruction. Illustratively, referring to fig. 8, the user clicks on the application icons "file management" 301, "email" 302, "music" 303, "calculator" 304, "video" 305, and "health" 306 in order. The mobile phone starts to perform preloading in response to clicking operations of a user on 'file management' 301, 'email' 302, 'music' 303, 'calculator' 304, 'video' 305 and 'health' 306; for example, start preloading game 1. The user then clicks on the application icon "browser" 308.
The acquisition module detects the click operation of a user on the browser 308 and generates a click event; the click event is sent to the sequence scenario recognition module, which includes the package name (such as the name "browser") and coordinates (3, 1) of "browser" 308. The sequence scenario recognition module receives the click event and obtains the package name and coordinates of the "browser" 308. The sequence scene recognition module updates the saved coordinates (0, 0), (1, 0), (2, 0), (3, 0), (0, 1), and (1, 1) to (1, 0), (2, 0), (3, 0), (0, 1), (1, 1), and (3, 1). And the sequence scene recognition module determines that the received starting operation of the user on the first interface to the application program according to the preset rule is not satisfied according to the stored coordinates (1, 0), (2, 0), (3, 0), (0, 1), (1, 1) and (3, 1) of the application icon receiving the clicking operation and the stored position information of the application icon. The sequence scene recognition module sends a starting event to a process management module of the AMS in the framework layer, wherein the starting event comprises a package name of the 'browser' 308; and also comprises an exit sequence starting scene identification.
The process management module receives the start event and starts the application browser based on the package name of "browser" 308. And the process management module sends an exit sequence starting scene identifier to a scene recognition unit in the prediction module. The scene recognition unit sends an exit sequence starting scene identifier to the rule matching unit. The rule matching unit receives the exit sequence starting scene identification and determines an exit sequence starting scene; and determining to quit executing the preset instruction according to a preset matching rule. In one example, the rule matching unit sends a stop preload instruction to the preload management module. And the preloading management module receives the preloading stopping instruction and empties the stored package names of the application programs meeting the preloading conditions. Thus, preloading is stopped.
According to the scene recognition and preprocessing method provided by the embodiment of the application, if the starting operation of a user on a first interface according to a preset rule is received, and the number of the application programs receiving the starting operation is larger than or equal to N; a preset instruction is executed, such as preloading an application satisfying a preload condition, etc. The scene identification and preprocessing method provided by the embodiment of the application can accurately identify the sequence starting scene of the electronic equipment used by the user so as to perform preprocessing. For example, if it is detected that the user clicks N application icons in a preset order, one or more of the application programs corresponding to the remaining application icons on the interface are preloaded. Therefore, when the user clicks the rest application icons on the interface, the application programs which are already preloaded can be quickly started, the starting waiting time is shortened, and the performance of the electronic equipment is improved.
Generally, a habit of using an electronic device by a user has a certain rule. For example, the time of the user on work and off work is fixed, and the application programs commonly used on the way of work and off work are also basically fixed. The embodiment of the application further provides a scene recognition and preprocessing method, which can accurately recognize a specific scene (for example, during the user's work on the way or during the user's work off the way), preprocess an application program corresponding to the specific scene, and improve the service performance of the electronic device.
The scene recognition and preprocessing method provided by the embodiment of the present application can be applied to the electronic device 100 in fig. 1. The embodiment of the present application takes the electronic device 100 as a mobile phone as an example for description.
In some embodiments, the mobile phone may identify the scene of the user on the way to work or the user on the way to work based on the current date, time, network status of the mobile phone, and motion status of the mobile phone.
In one implementation, the handset reads the system date and system time. And if the current system date is determined to be in the preset date range and the current system time is determined to be in the preset time range, monitoring the Wi-Fi connection state and the motion state of the mobile phone. For example, the predetermined date range is legal weekdays (e.g., monday through friday). The preset first time range is from 8 to 11 in the morning; corresponding to the user on the way to work. The preset second time range is 17 hours to 20 hours; corresponding to the user on the way to work. Wi-Fi connection status includes connected or disconnected and motion status includes moving or stationary.
In one implementation, the mobile phone monitors the Wi-Fi connection state and the movement state of the mobile phone if it is determined that the current system date is within a preset date range and the current system time is within a preset first time range. For a specific method for detecting the connection state of the mobile phone with the Wi-Fi network, reference may be made to the prior art, which is not described herein again. The specific method for judging the motion state of the mobile phone can refer to the prior art; the mobile phone can monitor the motion state of the mobile phone through a gyroscope sensor, an acceleration sensor and the like. In one implementation, the sensor reports the motion state of the mobile phone to the prediction module, and the Wi-Fi module reports the connection state of the Wi-Fi network to the prediction module. And the prediction module carries out scene recognition according to the motion state of the mobile phone and the connection state of the Wi-Fi network.
In one example, if it is determined that the connection status of the handset to the Wi-Fi network in the user's home is switched from connected to unconnected, i.e., it is detected that the handset is disconnected from the Wi-Fi network in the user's home, it is determined that the user is away from home. And if the situation that the mobile phone is disconnected from the Wi-Fi network in the home of the user and the motion state of the mobile phone is mobile is detected, determining that the mobile phone enters a scene on the way of the user on work.
In one example, in a scene during the user working process, if the scene identification unit determines that the connection state of the mobile phone and the Wi-Fi network of the company is switched from unconnected to connected, namely the mobile phone is detected to be connected to the Wi-Fi network of the company, the scene identification unit determines that the user arrives at the company; namely, determining the scene that the user exits the user on the way to work.
In one implementation, the mobile phone monitors the Wi-Fi connection state and the movement state of the mobile phone if it is determined that the current system date is within a preset date range and the current system time is within a preset second time range.
In one example, if it is determined that the connection status of the handset to the company's Wi-Fi network is switched from connected to unconnected, i.e., the handset is detected to be disconnected from the company's Wi-Fi network, it is determined that the user is away from the company. And if the mobile phone is disconnected from the Wi-Fi network of the company and the motion state of the mobile phone is mobile, determining to enter a scene of the user on the way to work.
In one example, in a scene that a user is on the way to work, if the connection state of the mobile phone and the Wi-Fi network in the home of the user is determined to be switched from unconnected to connected, namely the mobile phone is detected to be accessed to the Wi-Fi network in the home of the user, the user is determined to arrive at home; namely determining the scene of exiting the user on the way to work.
In some embodiments, the mobile phone performs statistical analysis according to historical data of the mobile phone used by the user, obtains a first type of application program of which the scene starting probability of the user in the work trip is greater than a first preset threshold, and obtains a second type of application program of which the scene starting probability of the user in the work trip is greater than a second preset threshold.
In one example, the mobile phone detects a scene entering the user on the way to work, and then the first type of application program is preloaded. For example, the first type of application program includes a navigation application, an attendance application, a video application, and the like. When the mobile phone detects that the user leaves the scene on the way to work, the resources of the application program which is already preloaded (such as a user interface saved on a virtual screen) can be cleared. In one implementation, the time point for each application program to be preloaded, the preloading sequence, etc. may be determined according to historical data. For example, the navigation application is preloaded after a scene entering the user on the way to work is detected; after entering a scene on the way of the user to work for a first preset time (for example, 30 minutes), the attendance application is preloaded.
In one example, the mobile phone detects a scene entering the user on the way to work, and then the second type of application program is preloaded. For example, the second type of application program includes a navigation application, an attendance application, a video application, and the like. When the mobile phone detects that the user leaves the scene on the way to work, the resources (such as the user interface saved in the virtual screen) of the preloaded application program can be cleared.
In one implementation, the preset date range includes a first preset date range and a second preset date range. For example, the first preset date range is monday, and the user generally takes a taxi to work; the second preset date range is Tuesday to Friday, and the user generally drives to work. In one example, if a scene that a user is entering on the way to work is determined, and the current system date belongs to a first preset date range, a taxi calling application is preloaded; and if the scene entering the user on the way to work is determined and the current system date belongs to a second preset date range, preloading the navigation application.
The scene recognition and preprocessing method provided by the embodiment of the application can accurately recognize the user on-the-way scene and the user off-the-work on-the-way scene, and pre-load the corresponding application program after determining to enter the user on-the-way scene or the user off-the-work on-the-way scene according to the historical data of the electronic equipment used by the user; therefore, when the user starts the application programs, resources do not need to be loaded (such as generating a user interface), the starting time length is shortened, and the starting efficiency is improved.
It is understood that the electronic device provided in the embodiments of the present application includes a hardware structure and/or a software module for performing the above functions. Those of skill in the art will readily appreciate that the various illustrative components and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the embodiments of the present application.
In the embodiment of the present application, the electronic device may be divided into the functional modules according to the method example, for example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. It should be noted that, in the embodiment of the present application, the division of the module is schematic, and is only one logic function division, and there may be another division manner in actual implementation.
In an example, please refer to fig. 16, which shows a schematic structural diagram of a possible electronic device involved in the above embodiment. The electronic device 1500 includes: a processing unit 1510, a storage unit 1520, and a display unit 1530.
The processing unit 1510 is configured to control and manage an operation of the electronic device 1500. The storage unit 1520 is used to store program codes and data of the electronic device 1500. The processing unit 1510 calls the program code stored by the storage unit 1520 to perform the respective steps in the above method embodiments. For example, a click operation of the user on an application icon on the desktop is received, and a corresponding application program is started. For example, scene recognition is performed. For example, a pretreatment is performed.
The display unit 1530 is used to display an interface of the electronic device 1500. For example, a first interface is displayed.
Of course, the unit modules in the electronic device 1500 include, but are not limited to, the processing unit 1510, the storage unit 1520, and the display unit 1530.
Optionally, the electronic device 1500 may further include a detecting unit 1540. The detecting unit 1540 is configured to detect data, status, and the like during operation of the electronic device 1500. For example, user input is detected.
Optionally, a communication unit 1550 may also be included in the electronic device 1500. The communication unit 1550 is used to support the electronic device 1500 to communicate with other devices.
The processing unit 1510 may be a processor or a controller, and may be, for example, a Central Processing Unit (CPU), a Digital Signal Processor (DSP), an application-specific integrated circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, a transistor logic device, a hardware component, or any combination thereof. The storage unit 1520 may be a memory. The display unit 1530 may be a display screen or the like. The detection unit 1540 may be a sensor, such as a pressure sensor. The communication unit 1550 may include a mobile communication unit and/or a wireless communication unit.
For example, the processing unit 1510 is a processor (e.g., the processor 110 shown in fig. 1), the storage unit 1520 is a memory (e.g., the internal memory 121 shown in fig. 1), and the display unit 1530 is a display screen (e.g., the display screen 194 shown in fig. 1). The detection unit 1540 can be a sensor (e.g., the sensor module 180 shown in FIG. 1). The communication unit 1550 may include a mobile communication unit (e.g., the mobile communication module 150 shown in fig. 1) and a wireless communication unit (e.g., the wireless communication module 160 shown in fig. 1). The electronic device 1500 provided in the embodiment of the present application may be the electronic device shown in fig. 1. Wherein the above processors, memories, display screens, mobile communication units, wireless communication units, sensors, etc. may be connected together, e.g. by a bus. The processor calls the program code stored in the memory to perform the various steps in the above method embodiments.
Embodiments of the present application further provide a chip system, where the chip system includes at least one processor and at least one interface circuit. The processor and the interface circuit may be interconnected by wires. For example, the interface circuit may be used to receive signals from other devices (e.g., a memory of an electronic device). As another example, the interface circuit may be used to send signals to other devices (e.g., a processor). Illustratively, the interface circuit may read instructions stored in the memory and send the instructions to the processor. The instructions, when executed by the processor, may cause the electronic device to perform the various steps in the embodiments described above. Of course, the chip system may further include other discrete devices, which is not specifically limited in this embodiment of the present application.
An embodiment of the present application further provides a computer-readable storage medium, where the computer-readable storage medium includes computer instructions, and when the computer instructions are run on the electronic device, the electronic device is caused to perform various functions or steps performed by the mobile phone in the foregoing method embodiment.
The embodiment of the present application further provides a computer program product, which when running on a computer, causes the computer to execute each function or step executed by the mobile phone in the above method embodiments.
Through the description of the above embodiments, it is clear to those skilled in the art that, for convenience and simplicity of description, the foregoing division of the functional modules is merely used as an example, and in practical applications, the above function distribution may be completed by different functional modules according to needs, that is, the internal structure of the device may be divided into different functional modules to complete all or part of the above described functions.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the above-described device embodiments are merely illustrative, and for example, the division of the modules or units is only one type of logical functional division, and other divisions may be realized in practice, for example, multiple units or components may be combined or integrated into another device, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may be one physical unit or a plurality of physical units, that is, may be located in one place, or may be distributed in a plurality of different places. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in the form of hardware, or may also be implemented in the form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application may be essentially or partially contributed to by the prior art, or all or part of the technical solutions may be embodied in the form of a software product, where the software product is stored in a storage medium and includes several instructions to enable a device (which may be a single chip, a chip, or the like) or a processor (processor) to execute all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a variety of media that can store program codes, such as a usb disk, a removable hard disk, a Read Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The above description is only an embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (15)

1. A scene recognition and preprocessing method applied to electronic equipment is characterized by comprising the following steps:
the electronic equipment displays a first interface; the first interface comprises a plurality of application icons;
receiving a starting operation of a user on an application program corresponding to the application icon on the first interface according to a preset rule;
and if the number of the application programs receiving the starting operation is larger than or equal to a preset value, responding to the starting operation of the user on the application program corresponding to the application icon on the first interface according to a preset rule, and executing a preset instruction.
2. The method of claim 1, wherein the preset rules comprise:
and clicking the next adjacent application icon in sequence from left to right and from top to bottom of different rows according to the first row and the second row.
3. The method of claim 1, wherein the preset rules comprise:
and clicking the next adjacent application icon in sequence from top to bottom in each column and from left to right in different columns according to the sequence of the first column and the second row.
4. The method of claim 2 or 3, wherein the sequentially clicking comprises:
after receiving the clicking operation of the user on the first application icon, receiving the clicking operation of the user on the second application icon within a preset time length; the first application icon is adjacent to the second application icon in position on the first interface.
5. The method of claim 4, wherein the first application icon being adjacent to the second application icon in position on the first interface comprises:
there is no application icon or folder or empty location between the first application icon and the second application icon.
6. The method of claim 4, wherein the first application icon and the second application icon being adjacent in position on the first interface comprises:
one or more empty positions are between the first application icon and the second application icon.
7. The method of claim 4, wherein the first application icon being adjacent to the second application icon in position on the first interface comprises:
one or more folders are between the first application icon and the second application icon.
8. The method according to any one of claims 1-3, wherein executing the preset instruction comprises:
loading interfaces of one or more application programs meeting preset conditions to a virtual screen of the electronic equipment; the virtual screen is a simulation screen corresponding to the display screen of the electronic equipment, and an interface loaded to the virtual screen is not displayed for a user;
the preset conditions include: the application icon of the application program is arranged after the application icon of the starting operation is received this time, and the application program is not started.
9. The method of claim 8,
the preset conditions include: the application type of the application program is a preset application type;
the application types include: game, live, chat, navigation or conversation.
10. The method according to any one of claims 1-3, wherein executing the preset instruction comprises:
allocating resources for one or more application programs meeting preset conditions;
the preset conditions include: the application icon of the application program is arranged after the application icon of the starting operation is received this time, and the application program is not started.
11. The method according to any one of claims 1-3, further comprising:
and if the user stops the starting operation of the application program corresponding to the application icon on the first interface according to the preset rule, stopping executing the preset instruction.
12. The method of claim 11, wherein the determining that the user stops starting the application program corresponding to the application icon on the first interface according to the preset rule comprises:
and determining that the starting operation of the user on the application program corresponding to the application icon on the first interface is not received within a preset time length.
13. The method of claim 11, wherein the determining that the user stops starting the application program corresponding to the application icon on the first interface according to the preset rule comprises:
and receiving starting operation of the user on the application program corresponding to the application icon on the first interface, and determining that the preset rule is not met.
14. An electronic device, characterized in that the electronic device comprises: a processor, a memory and a display screen; the processor is coupled with the memory and the display screen; the memory for storing computer program code; the computer program code comprising computer instructions which, when executed by the processor, cause the electronic device to perform the method of any of claims 1-13.
15. A computer-readable storage medium comprising computer instructions that, when executed on an electronic device, cause the electronic device to perform the method of any of claims 1-13.
CN202210336392.3A 2022-03-31 2022-03-31 Scene recognition and preprocessing method and electronic equipment Active CN115562772B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210336392.3A CN115562772B (en) 2022-03-31 2022-03-31 Scene recognition and preprocessing method and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210336392.3A CN115562772B (en) 2022-03-31 2022-03-31 Scene recognition and preprocessing method and electronic equipment

Publications (2)

Publication Number Publication Date
CN115562772A true CN115562772A (en) 2023-01-03
CN115562772B CN115562772B (en) 2023-10-27

Family

ID=84736949

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210336392.3A Active CN115562772B (en) 2022-03-31 2022-03-31 Scene recognition and preprocessing method and electronic equipment

Country Status (1)

Country Link
CN (1) CN115562772B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117827302A (en) * 2023-11-22 2024-04-05 荣耀终端有限公司 Resource preloading method and electronic equipment

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103034516A (en) * 2012-12-13 2013-04-10 东莞宇龙通信科技有限公司 Terminal and method for opening application program
CN106557238A (en) * 2016-11-09 2017-04-05 珠海市魅族科技有限公司 Using startup method and device
CN107783801A (en) * 2017-11-06 2018-03-09 广东欧珀移动通信有限公司 Application program forecast model is established, preloads method, apparatus, medium and terminal
CN108595230A (en) * 2018-05-15 2018-09-28 Oppo广东移动通信有限公司 Application program preloads method, apparatus, storage medium and terminal
CN108628645A (en) * 2018-04-28 2018-10-09 Oppo广东移动通信有限公司 Application program preloads method, apparatus, storage medium and terminal
CN108920202A (en) * 2018-05-15 2018-11-30 Oppo广东移动通信有限公司 Using preloading management method, device, storage medium and intelligent terminal
CN108958830A (en) * 2018-06-06 2018-12-07 Oppo广东移动通信有限公司 Application program launching method, device, storage medium and terminal
CN109240763A (en) * 2018-08-20 2019-01-18 奇酷互联网络科技(深圳)有限公司 Application program accelerates method, mobile terminal and the storage medium of starting
US20190065031A1 (en) * 2017-08-22 2019-02-28 Samsung Electronics Co., Ltd. Electronic device and method for operating applications
CN109976821A (en) * 2017-12-14 2019-07-05 广东欧珀移动通信有限公司 Application program loading method, device, terminal and storage medium
US20190370022A1 (en) * 2018-06-05 2019-12-05 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Application preloading method and device, storage medium and terminal
CN111611027A (en) * 2020-05-28 2020-09-01 Oppo广东移动通信有限公司 Method for starting application program, terminal equipment and readable storage medium
WO2022052776A1 (en) * 2020-09-10 2022-03-17 华为技术有限公司 Human-computer interaction method, and electronic device and system

Patent Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103034516A (en) * 2012-12-13 2013-04-10 东莞宇龙通信科技有限公司 Terminal and method for opening application program
CN106557238A (en) * 2016-11-09 2017-04-05 珠海市魅族科技有限公司 Using startup method and device
US20190065031A1 (en) * 2017-08-22 2019-02-28 Samsung Electronics Co., Ltd. Electronic device and method for operating applications
CN107783801A (en) * 2017-11-06 2018-03-09 广东欧珀移动通信有限公司 Application program forecast model is established, preloads method, apparatus, medium and terminal
WO2019086043A1 (en) * 2017-11-06 2019-05-09 Guangdong Oppo Mobile Telecommunications Corp., Ltd. M ethods and systems for preloading applications and generating prediction models
CN109976821A (en) * 2017-12-14 2019-07-05 广东欧珀移动通信有限公司 Application program loading method, device, terminal and storage medium
CN108628645A (en) * 2018-04-28 2018-10-09 Oppo广东移动通信有限公司 Application program preloads method, apparatus, storage medium and terminal
CN108595230A (en) * 2018-05-15 2018-09-28 Oppo广东移动通信有限公司 Application program preloads method, apparatus, storage medium and terminal
CN108920202A (en) * 2018-05-15 2018-11-30 Oppo广东移动通信有限公司 Using preloading management method, device, storage medium and intelligent terminal
US20190370022A1 (en) * 2018-06-05 2019-12-05 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Application preloading method and device, storage medium and terminal
CN108958830A (en) * 2018-06-06 2018-12-07 Oppo广东移动通信有限公司 Application program launching method, device, storage medium and terminal
WO2019233241A1 (en) * 2018-06-06 2019-12-12 Oppo广东移动通信有限公司 Method and apparatus for starting application program, and storage medium and terminal
CN109240763A (en) * 2018-08-20 2019-01-18 奇酷互联网络科技(深圳)有限公司 Application program accelerates method, mobile terminal and the storage medium of starting
CN111611027A (en) * 2020-05-28 2020-09-01 Oppo广东移动通信有限公司 Method for starting application program, terminal equipment and readable storage medium
WO2022052776A1 (en) * 2020-09-10 2022-03-17 华为技术有限公司 Human-computer interaction method, and electronic device and system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117827302A (en) * 2023-11-22 2024-04-05 荣耀终端有限公司 Resource preloading method and electronic equipment

Also Published As

Publication number Publication date
CN115562772B (en) 2023-10-27

Similar Documents

Publication Publication Date Title
WO2021115007A1 (en) Network switching method and electronic device
CN114554005B (en) Notification message management method and electronic equipment
CN110225176B (en) Contact person recommendation method and electronic device
CN110837343B (en) Snapshot processing method and device and terminal
CN112732434A (en) Application management method and device
WO2022247446A1 (en) Performance optimization method and related device
CN115562772B (en) Scene recognition and preprocessing method and electronic equipment
CN112231077B (en) Application scheduling method and electronic equipment
CN114257502B (en) Log reporting method and device
CN114911400A (en) Method for sharing pictures and electronic equipment
CN114745468A (en) Electronic device, theme setting method and medium thereof
CN115061740B (en) Application processing method and device
CN115729684B (en) Input/output request processing method and electronic equipment
CN116668580A (en) Scene recognition method, electronic device and readable storage medium
CN112866983B (en) Control method, control device and electronic equipment
CN115705143A (en) Card information display method and electronic equipment
CN114079642B (en) Mail processing method and electronic equipment
CN109992379B (en) Application freezing method and device, storage medium and terminal
CN115706753B (en) Application management method and device, electronic equipment and storage medium
CN116049478B (en) Application program recommendation method and device and user equipment
CN115712745B (en) Method, system and electronic device for acquiring user annotation data
CN116916093B (en) Method for identifying clamping, electronic equipment and storage medium
CN116437293B (en) Geofence establishment method, server and communication system
CN116668951B (en) Method for generating geofence, electronic equipment and storage medium
CN116028707B (en) Service recommendation method, device and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant