WO2021196980A1

WO2021196980A1 - Multi-screen interaction method, electronic device, and computer-readable storage medium

Info

Publication number: WO2021196980A1
Application number: PCT/CN2021/079475
Authority: WO
Inventors: 陈文军; 王雷; 刘霖
Original assignee: 华为技术有限公司
Priority date: 2020-04-01
Filing date: 2021-03-08
Publication date: 2021-10-07
Also published as: CN113497835B; CN113497835A

Abstract

The present application is applied to the technical field of multi-screen terminals, and provided therein are a multi-screen interaction method, an electronic device, and a computer-readable storage medium. The method comprises: when an electronic device receives a touch operation on an application interface currently displayed in a first screen area, same determines a view element corresponding to the touch operation, the first screen area being any one screen area among multiple screens, and the view element being an element in the application interface currently displayed in the first screen area; and in response to the touch operation, the electronic device displays an application associated with the view element in at least one screen area other than the first screen area among the multiple screens, or: an application currently displayed in the first screen area is transferred to the background to run, and the application associated with the view element is displayed in several screen areas among the multiple screens. By displaying application interfaces of multiple application programs in multiple screen areas of an electronic device, users can conveniently view, which improves user experience.

Description

Multi-screen interaction method, electronic equipment and computer readable storage medium

This application claims the priority of a Chinese patent application filed with the State Intellectual Property Office on April 1, 2020, the application number is 202010250263.3, and the application name is "Multi-screen interactive method, electronic equipment, and computer-readable storage medium", and its entire content Incorporated in this application by reference.

Technical field

This application belongs to the field of terminal technology, and in particular relates to a multi-screen interaction method, electronic equipment, and computer-readable storage media.

Background technique

With the rapid development of terminal technology and Internet technology, terminal products represented by smart phones have greatly changed people's daily life styles and work methods, and have become indispensable items in people's lives. As the application functions of smart phones are becoming more and more extensive, people’s requirements for the size of the smart phone’s screen will also change with the change of usage scenarios. Large-screen phones, especially phones with foldable displays, are increasingly appearing in people’s lives. in life. How to effectively use the screen to display multiple applications and improve the user experience in different usage scenarios has a large room for improvement.

Summary of the invention

This application provides a multi-screen interaction method, electronic equipment, and computer-readable storage medium, which can display application interfaces of multiple applications on the screen of a terminal for users to view.

In the first aspect, this application provides a multi-screen interaction method, which is applied to an electronic device equipped with a foldable display screen, and the method includes:

In a possible implementation manner, when the foldable display screen of the electronic device is in a multi-screen display state, the foldable display screen includes at least two screen areas, and the electronic device determines when it receives a touch operation on the first screen area The view element corresponding to the touch operation, wherein the first screen area is any screen area of the multiple screens, and the view element is an element in the application interface currently displayed in the first screen area; the electronic device responds to the touch operation In the above-mentioned multi-screen, at least one screen area other than the above-mentioned first screen area displays the application associated with the above-mentioned view element, or: the application currently displayed in the first screen area is transferred to the background to run, and in several of the above-mentioned multi-screens Each screen area displays the applications associated with the above-mentioned view elements. On the one hand, displaying the application associated with the above-mentioned view element in at least one screen area except the first screen area can reduce the occlusion caused by displaying the application associated with the above-mentioned view element on the first screen area, and make full use of The display area of the screen displays the application interface of multiple applications on the screen, which is convenient for users to view. On the other hand, the application currently displayed in the first screen area is transferred to the background to run, and the application associated with the above view element is displayed on several screen areas in the above-mentioned multi-screen. Application, which is convenient for users to view the applications associated with the above-mentioned view elements at the same time.

Exemplarily, the aforementioned touch operations include, but are not limited to, pressing/long-pressing touch operations, dragging touch operations, sliding touch operations, double-tapping touch operations, and tapping touch operations. After determining the view element corresponding to the above-mentioned touch operation, the application associated with the above-mentioned view element can be obtained through the application index list. The above-mentioned application index list may be preset, and the association relationship between the preset keywords and the application is stored, so that the application corresponding to the above-mentioned keyword can be quickly indexed from the application index list through the keyword. The above-mentioned keywords may be keywords that are identified and extracted from the above-mentioned view elements.

Exemplarily, set the number of screen areas of the above-mentioned multi-screen to M, and set the number of applications associated with the above-mentioned view element to N, where M>1, N>1, and both M and N are integers; At least one screen area of the multi-screen except the first screen area displays the application associated with the view element, including: if the number of screen areas M-1 is greater than or equal to the number N of applications associated with the view element, Then, in M-1 screen areas, the top L applications selected from the N applications associated with the view elements are displayed, where 1≤L≤M-1, and L is an integer, the index weight It is the weight indexed to a certain application based on keywords. or:

Select M-2 screen areas from M-1 screen areas, and display the index weights selected from the N applications associated with the above-mentioned view elements in the selected M-2 screen areas. The top M-2 is ranked Applications, the last remaining screen area displays the top P applications selected from the remaining N-M+2 applications associated with the above-mentioned view elements, where 1≤P≤N-M+2, and P is an integer. or:

If the number of screen areas M-1 is greater than the number N of applications associated with the above-mentioned view elements, then the applications associated with the above-mentioned view elements are classified, and applications of the same type are allocated to the same screen area for display. or:

If the number of screen areas M-1 is less than the number N of applications associated with the above-mentioned view elements, then N screen areas are selected from the M-1 screen areas, and the above-mentioned view elements are displayed in the selected N screen areas. Applications.

In the embodiments of the present application, on the one hand, in order to reduce the screen area occupied by applications with lower index weights among the applications associated with the above-mentioned view elements, so as to facilitate users to quickly browse multiple applications of interest, the electronic device may be in M-1 The screen area displays the top L applications in index weights selected from the N applications associated with the above-mentioned view elements. On the other hand, in order to improve the user’s browsing experience and make it easier for the user to view all the applications associated with the above-mentioned view elements, the electronic device can select M-2 screen areas from the M-1 screen areas. A screen area displays the top M-2 apps in index weights selected from the applications associated with the N above-mentioned view elements, and the last remaining screen area displays the remaining N-M+2 above-mentioned view elements. The selected index ranked in the top P applications among the linked applications. On the other hand, in order to reduce the inconvenience of users’ browsing and poor user experience due to the display of too many applications in a certain screen area, the electronic device can classify the applications associated with the above-mentioned view elements and classify the applications of the same type. Allocate to the same screen area to display.

Exemplarily, the application currently displayed in the first screen area is turned to run in the background, and the application associated with the above-mentioned view element is displayed on several screen areas in the above-mentioned multi-screen, including:

If the number of screen areas M is greater than or equal to the number of applications associated with the above-mentioned view elements N, then the top Q applications selected from the N applications associated with the above-mentioned view elements are displayed in M screen areas, where , 1≤Q≤M, and Q is an integer; or:

Select M-1 screen regions from M screen regions, and display the top M-1 applications in index weights selected from the N applications associated with the above-mentioned view elements in the selected M-1 screen regions, In the last remaining screen area, the top R applications selected from the remaining N-M+1 view elements associated with the above-mentioned view elements are displayed, where 1≤R≤N-M+1, and R is Integer. or:

If the number M of screen areas is greater than or equal to the number N of applications associated with the above-mentioned view elements, then the applications associated with the above-mentioned view elements are classified, and applications of the same type are allocated to the same screen area for display.

In the embodiment of the present application, when the number N of applications associated with the above-mentioned view element is greater than or equal to the number M of the screen area of the multi-screen, on the one hand, in order to improve the display effect of the application associated with the above-mentioned view element, and fully Utilizing the display efficiency of the screen area, it is convenient for users to quickly browse multiple applications of interest. The electronic device can display the top Q applications selected from the N applications associated with the above view elements in M screen areas. . On the other hand, in order to improve the user’s browsing experience, display multiple applications that may be of interest to the user, and facilitate the user to view the applications associated with the above-mentioned view elements, the electronic device can select M-1 screen areas from the M screen areas. The selected M-1 screen areas display the top M-1 applications with index weights selected from the applications associated with the N above-mentioned view elements, and the remaining N-M+ from the remaining last screen area One of the applications associated with the above-mentioned view element is selected with an index ranking in the top R application. On the other hand, in order to reduce the problem of user browsing inconvenience caused by too many applications displayed in a certain screen area and the user’s low user experience, the electronic device can classify the applications associated with the above-mentioned view elements and classify the applications of the same type. Allocate to the same screen area to display.

Exemplarily, the application index list stores preset index weights corresponding to each application, that is, an application corresponds to an index weight. The higher the index weight, the probability that the application corresponding to the above index weight will be indexed and displayed is also Bigger. In some embodiments, the index weight can be adjusted according to the frequency of use of the application by the user, and the higher the frequency of use of the application, the higher the corresponding index weight. The frequency of use referred to here is the frequency with which the user clicks on the displayed application after the electronic device displays the application associated with the view element in the screen area. The electronic device can adjust the index weight corresponding to the application according to the frequency of the user clicking the application within a period of time.

In another possible implementation, when the foldable display screen is in the full-screen display state, when the electronic device receives a touch operation on the screen, it determines the view element corresponding to the touch operation, wherein the view element is the currently displayed view element. The element in the application interface, the above-mentioned screen includes multiple screen areas; the electronic device responds to the above-mentioned touch operation, selects a screen area from the above-mentioned multiple screen areas to display the interface currently displayed on the above-mentioned screen, except for the selected multiple screen areas At least one screen area outside of the screen area displays an application associated with the above-mentioned view element; or: displays an application associated with the above-mentioned view element in the above multiple screen areas.

In the embodiments of the present application, on the one hand, displaying the application associated with the above-mentioned view element in at least one screen area other than the selected screen area can reduce the cost of displaying the application associated with the above-mentioned view element on the selected screen area. It also makes full use of the display area of the screen, and displays the application interface of multiple applications on the screen, which is convenient for users to view. On the other hand, displaying the applications associated with the above-mentioned view elements on several screen areas of the above-mentioned multi-screens realizes that applications associated with multiple view elements are displayed on the screen, so that people can view the applications associated with the above-mentioned view elements at the same time. .

It should be understood that when a touch operation on the application interface currently displayed on the screen is detected, the electronic device switches the display state of the foldable display screen from the full-screen display state to the multi-screen display state, that is, the screen of the foldable display screen includes at least two Screen area.

Exemplarily, set the number of the above-mentioned multiple screen areas as M, and set the number of applications associated with the above-mentioned view elements as N, where M>1, N>1, and both M and N are integers; At least one screen area of the multiple screen areas other than the selected screen area displays the application associated with the view element, including:

If the number of screen areas M-1 is greater than or equal to the number N of applications associated with the above-mentioned view element, the corresponding index weights selected from the N applications associated with the above-mentioned view element will be displayed in the M-1 screen areas. Application of L, where 1≤L≤M-1, and L is an integer. or:

In the embodiments of the present application, on the one hand, in order to reduce the screen area occupied by applications with lower index weights among the applications associated with the above-mentioned view elements, so as to facilitate users to quickly browse multiple applications of interest, the electronic device can be used in M-1 The screen area displays the top L applications in index weights selected from the N applications associated with the above-mentioned view elements. On the other hand, in order to improve the user’s browsing experience and make it easier for the user to view all the applications associated with the above-mentioned view elements, the electronic device can select M-2 screen areas from the M-1 screen areas. A screen area displays the top M-2 applications in index weights selected from the applications associated with the N above-mentioned view elements, and the remaining last screen area displays the remaining N-M+2 above-mentioned view elements. The selected index ranked in the top P applications among the linked applications. On the other hand, in order to reduce the inconvenience of users’ browsing and poor user experience due to the display of too many applications in a certain screen area, the electronic device can classify the applications associated with the above-mentioned view elements and classify the applications of the same type. Allocate to the same screen area to display.

Exemplarily, displaying the application associated with the view element in the multiple screen areas includes:

Exemplarily, when the electronic device responds to a touch operation, it recognizes and extracts keywords from the view element that the above touch operation acts on, and obtains the first keyword corresponding to the above view element. After obtaining the first keyword corresponding to the above view element The electronic device displays the first keyword corresponding to the above-mentioned view element in the first screen area or the selected screen area, and determines the corresponding application according to the first keyword, and the determined application is the application associated with the above-mentioned view element.

In some embodiments, in order to improve the search efficiency and comprehensiveness of the application associated with the above-mentioned view element, after obtaining the first keyword corresponding to the above-mentioned view element, the electronic device may also classify the obtained first keyword according to The classification result determines the second keyword; according to the second keyword, the application associated with the above-mentioned view element is obtained from the application index list.

In some embodiments, the displayed screen area may be randomly allocated to the application associated with the above-mentioned view element, or after the application associated with the above-mentioned view element is obtained, the index weight corresponding to the application associated with the above-mentioned view element may be obtained, according to each The index weight corresponding to the application determines the screen area where the application associated with the above-mentioned view element is displayed. Each screen area is correspondingly set with a corresponding screen display priority. An application with a higher index weight has a higher screen display priority corresponding to the determined screen area.

Exemplarily, after determining the second keyword according to the classification result, the electronic device establishes an association relationship between the first keyword and the second keyword, so that the first keyword can be quickly found through the second keyword, so that the electronic device When the application associated with the view element is displayed in the screen area, the corresponding first keyword can be displayed on the interface of the displayed application, which improves the display efficiency of the first keyword.

In another possible implementation manner, after detecting the user's touch operation on the view element, the display state of the foldable display screen is acquired, where the display state includes a full-screen display state and a multi-screen display state, and the full-screen display state is available When the foldable display is in the unfolded state, the display area of the foldable display is displayed on the full screen, that is, the number of display areas of the foldable display is one; the multi-screen display state is that the foldable display is in two or more screen areas The display area of the foldable display screen is displayed, that is, the number of display areas of the foldable display screen is two or more. If the foldable display screen is in a full-screen display state, the display area of the foldable display screen is divided according to a preset division rule to obtain M screen areas. If the display state of the foldable display is the multi-screen display state, determine whether the foldable display is currently in the expanded state, if the foldable display is currently in the expanded state, obtain the number N of applications associated with the view element, If the number N of applications associated with the view element is greater than the number M of the screen area of the foldable display, the electronic device divides the display area of the foldable display according to a preset division rule, and updates the number of screen areas. The number M is the number of screen areas obtained after division.

Exemplarily, when the electronic device divides the display area of the foldable display screen according to a preset division rule, it compares the number of divisions corresponding to the preset division rule with the number N of applications associated with the view element, and determines the number of divisions. A preset division rule whose number is closest to the number N of applications associated with the view element, and then the display area of the foldable display screen is divided according to the determined preset division rule.

Exemplarily, the preset division rules may include the following three types: 1. The display area of the electronic device 100 is divided according to the number of divisions set by the user. 2. Determine the number of divisions of the display area according to the preset area threshold and the display area of the electronic device, and divide the display area of the electronic device according to the determined number of divisions. 3. Determine the number of divisions of the display area according to the preset area threshold, the display area of the electronic device 100, and the number of applications that need to be displayed, and divide the display area of the electronic device according to the determined number of divisions.

It should be understood that the purpose of dividing the display area of the foldable display screen is to facilitate the display of applications associated with view elements in other screen areas other than the screen area to which the current application interface belongs, so that users can quickly browse and view The application associated with the element and improves the user's visual experience.

In a possible implementation, after the electronic device has divided the screen areas, the above method further includes: setting the name of each screen area and the corresponding display priority, where the display priority is the priority of the screen area display application The higher the display priority of the screen area, the higher the priority of the above-mentioned screen area display application. When the display area is allocated to the application associated with the view element, the corresponding screen area is allocated to the application according to the preset allocation rule.

Exemplarily, the electronic device determines the corresponding screen area according to the index weight corresponding to the application associated with the view element. The higher the index weight corresponding to the application, the higher the screen display priority corresponding to the determined screen area.

Exemplarily, the preset allocation rule is to allocate the corresponding screen area to the application according to the corresponding relationship between the screen display priority and the index weight of the application. The higher the index weight corresponding to the application, the higher the screen display priority of the corresponding screen area.

In another possible implementation manner, an index weight corresponding to each application is stored in the application index list, where the index weight is specifically a weight indexed to a certain application according to a keyword. After the electronic device finds the application associated with the view element, the above method further includes: obtaining the index weight corresponding to the application associated with the view element, and determining the application displayed in each screen area according to the index weight corresponding to each application.

In another possible implementation manner, after determining the application corresponding to each screen area, the electronic device displays the first keyword and the corresponding search result on the interface displayed by the application startup, which reduces the user’s need to enter the first keyword. Operation improves the user experience.

In the second aspect, the present application provides an electronic device including one or more memories, a foldable display screen, and one or more memories. The one or more memories are coupled with one or more processors, the foldable display screen is in communication with the one or more processors, and the one or more memories are used to store computer program codes, and the computer program codes include computer instructions When the one or more processors execute the computer instructions, the electronic device is caused to execute the multi-screen interaction method in any one of the possible implementation manners of any one of the foregoing aspects.

In the third aspect, the embodiments of the present application provide a computer-readable storage medium, including computer instructions, which when the computer instructions run on an electronic device, cause the electronic device to execute any of the possible implementations of any of the foregoing aspects. Screen interaction method.

In a fourth aspect, the embodiments of the present application provide a computer program product that, when the computer program product runs on a computer, causes the computer to execute the multi-screen interaction method in any one of the possible implementations of any of the foregoing aspects.

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only of the present application. For some embodiments, for those of ordinary skill in the art, other drawings may be obtained based on these drawings without creative labor.

FIG. 1 is a schematic structural diagram of an electronic device 100 provided by an embodiment of the present application;

Figure 2 is a schematic diagram of a group of foldable display screens provided by an embodiment of the present application; in which:

2(A) is a schematic diagram of a foldable display screen with only one bending position in an unfolded state according to an embodiment of the present application;

2(B) is a schematic diagram of a foldable display screen with two bending positions in an unfolded state according to an embodiment of the present application;

2(C) and (D) are schematic diagrams of the foldable display screen as shown in FIG. 2(A), which is provided by an embodiment of the present application, is switched from a folded state to an unfolded state or from an unfolded state to a folded state;

Figures 2(E) and (F) are schematic diagrams of the foldable display screen as shown in Figure 2(B) switching from a folded state to an unfolded state or from an unfolded state to a folded state according to an embodiment of the present application;

3 is a block diagram of the software structure of the electronic device 100 according to an embodiment of the present application;

Fig. 4 is a schematic diagram of a set of screen display interfaces provided by an embodiment of the present application; among them:

FIG. 4(A) is a schematic diagram of a screen display interface in which a user touches a view element displayed on the screen display interface when the foldable display screen is in a folded state according to an embodiment of the present application;

FIG. 4(B) is a schematic diagram of a screen display interface when the foldable display screen shown in FIG. 4(A) is switched from a folded state to an unfolded state according to an embodiment of the present application;

FIG. 4(C) is a schematic diagram of a screen display interface when the foldable display screen shown in FIG. 4(A) is in an unfolded state according to an embodiment of the present application;

FIG. 4(D) is a schematic diagram of another screen display interface when the foldable display screen shown in FIG. 4(A) is switched from a folded state to an unfolded state according to an embodiment of the present application;

FIG. 4(E) is a schematic diagram of another screen display interface when the foldable display screen shown in FIG. 4(A) is in an unfolded state according to an embodiment of the present application;

FIG. 4(F) is a schematic diagram of another screen display interface when the foldable display screen shown in FIG. 4(A) is in an unfolded state according to an embodiment of the present application;

FIG. 4(G) is a schematic diagram of another screen display interface when the foldable display screen shown in FIG. 4(A) is in an unfolded state according to an embodiment of the present application;

FIG. 4(H) is a schematic diagram of another screen display interface when the foldable display screen shown in FIG. 4(A) is in an unfolded state according to an embodiment of the present application;

FIG. 4(I) is a schematic diagram of another screen display interface when the foldable display screen shown in FIG. 4(A) is in an unfolded state according to an embodiment of the present application;

FIG. 5 is a schematic flowchart of a method for determining an application based on view elements according to an embodiment of the present application;

6 is a schematic flowchart of another method for determining an application based on view elements provided by an embodiment of the present application;

FIG. 7 is a schematic flowchart of a method for determining an application displayed in a screen area according to an embodiment of the present application;

FIG. 8 is a schematic flowchart of a multi-screen interaction method provided by an embodiment of the present application;

FIG. 9 is a schematic flowchart of another multi-screen interaction method provided by an embodiment of the present application;

Fig. 10 is a schematic diagram of another set of screen display interfaces provided by an embodiment of the present application; among them:

FIG. 10(A) is a schematic diagram of a screen display interface when a user touches a view element when a foldable display screen is in an unfolded state and is in a multi-screen display state according to an embodiment of the present application;

FIG. 10(B) is a schematic diagram of a screen display interface correspondingly displayed after responding to the touch operation as shown in FIG. 10(A) according to an embodiment of the present application;

FIG. 10(C) is a schematic diagram of another screen display interface correspondingly displayed after responding to the touch operation as shown in FIG. 10(A) according to an embodiment of the present application;

FIG. 10(D) is a schematic diagram of a correspondingly displayed screen interface in response to a user's touch operation on a view element according to an embodiment of the present application; FIG.

FIG. 11 is a schematic diagram of another set of screen display interfaces provided by an embodiment of the present application; among them:

FIG. 11(A) is a screen interface corresponding to a touch operation when the user drags a view element in one screen area to another screen area when the foldable display screen is in an expanded state and is displayed on multiple screens according to an embodiment of the present application. Schematic diagram

FIG. 11(B) provides a schematic diagram of a screen display interface correspondingly displayed after responding to the touch operation as shown in FIG. 11(A) according to an embodiment of the present application;

Fig. 12 is a schematic diagram of another set of screen display interfaces provided by an embodiment of the present application; among them:

FIG. 12(A) is a schematic diagram of a screen display interface when a user touches a view element when a foldable display screen is in an expanded state and is displayed in a full screen according to an embodiment of the present application;

FIG. 12(B) is a schematic diagram of a screen display interface correspondingly displayed after responding to the touch operation as shown in FIG. 12(A) according to an embodiment of the present application;

FIG. 12(C) is a schematic diagram of another screen interface correspondingly displayed in response to a user's touch operation on a view element according to an embodiment of the present application.

Detailed ways

The embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. The terms used in the implementation part of the embodiments of the present application are only used to explain the specific embodiments of the present application, and are not intended to limit the present application.

First, the electronic equipment involved in the embodiments of the present application is introduced. Please refer to FIG. 1, which is a schematic structural diagram of an electronic device 100 provided by an embodiment of the present application.

It should be understood that the electronic device 100 shown in FIG. 1 is only an example, and the electronic device 100 may have more or fewer components than those shown in FIG. 1, two or more components may be combined, or Can have different component configurations. The various components shown in the figure may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and/or application specific integrated circuits.

The electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2. Mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor module 180, buttons 190, motor 191, indicator 192, camera 193, display 194, And subscriber identification module (subscriber identification module, SIM) card interface 195 and so on. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light Sensor 180L, bone conduction sensor 180M, etc.

It can be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than those shown in the figure, or combine certain components, or split certain components, or arrange different components. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), and an image signal processor ( image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU), etc. . Among them, the different processing units may be independent devices or integrated in one or more processors.

The controller may be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching instructions and executing instructions.

A memory may also be provided in the processor 110 to store instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory can store instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. Repeated accesses are avoided, the waiting time of the processor 110 is reduced, and the efficiency of the system is improved.

In some embodiments, the processor 110 may include one or more interfaces. The interface can include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuitsound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, and a universal asynchronous receiver /transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and/or Universal serial bus (USB) interface, etc.

The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple sets of I2C buses. The processor 110 may be coupled to the touch sensor 180K, charger, flash, camera 193, etc., respectively through different I2C bus interfaces. For example, the processor 110 may couple the touch sensor 180K through an I2C interface, so that the processor 110 and the touch sensor 180K communicate through the I2C bus interface to implement the touch function of the electronic device 100.

The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple sets of I2S buses. The processor 110 may be coupled with the audio module 170 through an I2S bus to implement communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 may transmit audio signals to the wireless communication module 160 through an I2S interface, so as to realize the function of answering calls through a Bluetooth headset.

The PCM interface can also be used for audio communication to sample, quantize and encode analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface. In some embodiments, the audio module 170 may also transmit audio signals to the wireless communication module 160 through the PCM interface, so as to realize the function of answering calls through the Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

The UART interface is a universal serial data bus used for asynchronous communication. The bus can be a two-way communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to realize the Bluetooth function. In some embodiments, the audio module 170 may transmit audio signals to the wireless communication module 160 through a UART interface, so as to realize the function of playing music through a Bluetooth headset.

The MIPI interface can be used to connect the processor 110 with the display screen 194, the camera 193 and other peripheral devices. The MIPI interface includes a camera serial interface (camera serial interface, CSI), a display serial interface (display serial interface, DSI), and so on. In some embodiments, the processor 110 and the camera 193 communicate through a CSI interface to implement the shooting function of the electronic device 100. The processor 110 and the display screen 194 communicate through a DSI interface to realize the display function of the electronic device 100.

The GPIO interface can be configured through software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, and so on. The GPIO interface can also be configured as an I2C interface, I2S interface, UART interface, MIPI interface, etc.

The USB interface 130 is an interface that complies with the USB standard specification, and specifically may be a Mini USB interface, a Micro USB interface, a USB Type C interface, and so on. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and peripheral devices. It can also be used to connect earphones and play audio through earphones. This interface can also be used to connect other electronic devices, such as AR devices.

It can be understood that the interface connection relationship between the modules illustrated in the embodiment of the present invention is merely a schematic description, and does not constitute a structural limitation of the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection modes in the foregoing embodiments, or a combination of multiple interface connection modes.

The charging management module 140 is used to receive charging input from the charger. Among them, the charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive the charging input of the wired charger through the USB interface 130. In some embodiments of wireless charging, the charging management module 140 may receive the wireless charging input through the wireless charging coil of the electronic device 100. While the charging management module 140 charges the battery 142, it can also supply power to the electronic device through the power management module 141.

The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle times, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 may also be provided in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may also be provided in the same device.

The wireless communication function of the electronic device 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor.

The antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example: Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna can be used in combination with a tuning switch.

The mobile communication module 150 can provide a wireless communication solution including 2G/3G/4G/5G and the like applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), and the like. The mobile communication module 150 can receive electromagnetic waves by the antenna 1, and perform processing such as filtering, amplifying and transmitting the received electromagnetic waves to the modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor, and convert it into electromagnetic waves for radiation via the antenna 1. In some embodiments, at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110. In some embodiments, at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be provided in the same device.

The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.), or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be provided in the same device as the mobile communication module 150 or other functional modules.

The wireless communication module 160 can provide applications on the electronic device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), and global navigation satellite systems. (global navigation satellite system, GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be sent from the processor 110, perform frequency modulation, amplify, and convert it into electromagnetic waves to radiate through the antenna 2.

In some embodiments, the antenna 1 of the electronic device 100 is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband code Wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM , And/or IR technology, etc. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou satellite navigation system (BDS), quasi-zenith satellite system (quasi- Zenith satellite system, QZSS) and/or satellite-based augmentation systems (SBAS).

The electronic device 100 implements a display function through a GPU, a display screen 194, an application processor, and the like. The GPU is an image processing microprocessor, which is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and is used for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos, and the like. The display screen 194 includes a display panel. The display panel can use liquid crystal display (LCD), organic light-emitting diode (organic light-emitting diode, OLED), active-matrix organic light-emitting diode or active-matrix organic light-emitting diode (active-matrix organic light-emitting diode). , AMOLED), flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or N display screens 194, and N is a positive integer greater than one.

In some embodiments of the present application, when the display panel adopts OLED, AMOLED, FLED and other materials, the display screen 194 in FIG. 1 may be bent. Here, the above-mentioned display screen 194 can be bent means that the display screen can be bent at any position to any angle, and can be maintained at that angle. For example, the display screen 194 can be folded in half from the center, or can be folded in half from the center. In the embodiments of the present application, the display screen that can be bent is referred to as a foldable display screen. Wherein, the foldable display screen may be one screen, or a display screen formed by patching together multiple screens, which is not limited here.

Exemplarily, referring to FIG. 2, the foldable display screen may include at least two physical forms: an expanded form and a folded form. As shown in Figure 2 (A), the foldable display is in an unfolded form, that is, the left and right ends of the middle bending part of the foldable display that can be folded in half from the middle (if the foldable display is folded up and down) , Is the upper and lower ends of the middle bending part of the foldable display screen) The included angle is between 180 degrees and the first angle, where the first angle is greater than 0 degrees and less than 180 degrees, for example, the first angle can be 90 degrees. As shown in Figure 2(B), the foldable display screen is in an unfolded form, which means that the folding display screen 2 can be folded in half from the left and right sides of 1/3 and 2/3 of the folding display screen 2. The left and right ends of the bending part (if the folding display is folded up and down, it is the upper and lower ends of the 1/3 and 2/3 of the folding part of the foldable display). The angle formed is 180 degrees and the first angle Among them, the first angle is greater than 0 degrees and less than 180 degrees, for example, the first angle may be 90 degrees. As shown in (C) and (D) in Figure 2, the foldable display screen can also be in a folded form, that is, the left and right ends of the middle bending part of the foldable display screen (if the foldable display screen is folded up and down, The angle formed by the upper and lower ends of the middle bending part of the foldable display screen is between 0 degrees and the first angle; as shown in (E) and (F) in Figure 2, the foldable display screen It can also be in a folded form, that is, the left and right ends of the 1/3 and 2/3 of the foldable display screen (if the folding display is folded up and down, it is 1/3 and 2 of the foldable display screen). The angle formed by the upper and lower ends of the /3 bending part) is between 0 degrees and the first angle.

As shown in (C) and (D) in Figure 2, the foldable display screen is a two-fold display screen, and the display area of the foldable display screen after entering the folded form can be divided into a first screen area and a second screen area. The foldable display screen can be folded in the direction facing the first screen area and the second screen area in the unfolded state, or it can be folded in the direction opposite to the first screen area and the second screen area; in some In an embodiment, the left and right ends of the middle bending part of the foldable display screen (if the foldable display screen is folded up and down, the upper and lower ends of the middle bending part of the foldable display screen) can form an angle of 0 degrees To +180 degrees. For example, the foldable display screen can be bent toward the direction facing the first screen area and the second screen area into a folded form with an angle of 30 degrees, or it can be turned toward the first screen area and the second screen area. The opposite direction is bent into a folded configuration with an included angle of 30 degrees.

As shown in (E) and (F) in Figure 2, the foldable display is a three-fold display. The display area of the foldable display after entering the folded form can be divided into a first screen area and a second screen. Area and third screen area. The foldable display screen can be folded in the direction in which the first screen area and the second screen area face each other, and the second screen area and the third screen area are opposite to each other in the unfolded form, or it can face the first screen area and the third screen area. The second screen area is opposite to each other, and the second screen area and the third screen area face each other.

In some embodiments, the electronic device 100 can use one or more of a gravity sensor, an acceleration sensor, and a gyroscope to determine whether the foldable display screen is in a folded configuration or an unfolded configuration, and can also determine whether the foldable display screen is in an unfolded configuration. Whether it is in portrait mode or landscape mode. The electronic device 100 can also detect the bending angle of the foldable display screen through a gravity sensor, an acceleration touch sensor, and a gyroscope. Then, the electronic device 100 can determine the foldable display according to the bending angle. Whether the screen is in a folded form or an expanded form. The electronic device 100 can also use one or more of a gravity sensor, an acceleration sensor, and a gyroscope to determine the orientation of the foldable display screen in the folded configuration, and then determine the display area of the interface content output by the display system. For example, when the first screen area of the foldable display screen faces upward with respect to the ground, the electronic device 100 may display the interface content output by the display system on the first screen area. When the second screen area of the foldable display screen faces upward with respect to the ground, the electronic device 100 can display the interface content output by the display system on the second screen area.

In some embodiments, the electronic device 100 may further include an angle sensor (not shown in FIG. 1). The angle sensor may be disposed at a bending position of the foldable display screen. The electronic device 100 can measure the angle formed by the two ends of the middle bending part of the foldable display screen through an angle sensor (not shown in FIG. 1) provided at the bending part of the foldable display screen. When the angle is greater than When the angle is equal to or equal to the first angle, the electronic device 100 can recognize through the angle sensor that the foldable display screen enters the unfolded state. When the included angle is less than or equal to the first angle, the electronic device 100 can recognize through the angle sensor that the foldable display screen enters the folded form.

In some other embodiments, the electronic device 100 can also recognize whether the foldable display screen is in a folded configuration through a physical switch provided at the bending part of the foldable display screen. For example, when the electronic device receives a user's folding operation on the foldable display screen, the physical switch provided on the electronic device is triggered to open, and the electronic device 100 can determine that the foldable display screen is in a folded state. When the electronic device 100 receives the user's unfolding operation of the foldable display screen, the physical switch provided on the electronic device is triggered to close, and the electronic device can determine that the foldable display screen is in the unfolded form. The above examples are only used to explain the application and should not constitute a limitation.

The following takes the foldable display as an example of two foldable displays. When the foldable display is in the unfolded form, the foldable display can display content in full screen or part of the area (such as the first screen area or the second screen area) Display content, you can also display content in two or more partial areas. In a possible implementation, when the foldable display screen displays the interface content in full screen, the interface content may occupy part of the display area of the foldable display screen. The middle part of the screen displays the interface content, and when one or both sides of the edge part are black, it can also be regarded as the foldable display screen displaying the interface content in full screen.

The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

The ISP is used to process the data fed back from the camera 193. For example, when taking a picture, the shutter is opened, the light is transmitted to the photosensitive element of the camera through the lens, the light signal is converted into an electrical signal, and the photosensitive element of the camera transmits the electrical signal to the ISP for processing and is converted into an image visible to the naked eye. ISP can also optimize the image noise, brightness, and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP may be provided in the camera 193.

The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and is projected to the photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transfers the electrical signal to the ISP to convert it into a digital image signal. ISP outputs digital image signals to DSP for processing. DSP converts digital image signals into standard RGB, YUV and other formats of image signals. In some embodiments, the electronic device 100 may include one or N cameras 193, and N is a positive integer greater than one.

Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the electronic device 100 selects the frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.

Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 can play or record videos in multiple encoding formats, such as: moving picture experts group (MPEG) 1, MPEG2, MPEG3, MPEG4, and so on.

NPU is a neural-network (NN) computing processor. By drawing on the structure of biological neural networks, for example, the transfer mode between human brain neurons, it can quickly process input information, and it can also continuously self-learn. Through the NPU, applications such as intelligent cognition of the electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, and so on.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example, save music, video and other files in an external memory card.

The internal memory 121 may be used to store computer executable program code, where the executable program code includes instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121. The internal memory 121 may include a storage program area and a storage data area. Among them, the storage program area can store an operating system, an application program (such as a sound playback function, an image playback function, etc.) required by at least one function, and the like. The data storage area can store data (such as audio data, phone book, etc.) created during the use of the electronic device 100. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), and the like.

The electronic device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. For example, music playback, recording, etc.

The audio module 170 is used to convert digital audio information into an analog audio signal for output, and is also used to convert an analog audio input into a digital audio signal. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be provided in the processor 110, or part of the functional modules of the audio module 170 may be provided in the processor 110.

The speaker 170A, also called "speaker", is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music through the speaker 170A, or listen to a hands-free call.

The receiver 170B, also called "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a call or voice message, it can receive the voice by bringing the receiver 170B close to the human ear.

The microphone 170C, also called "microphone", "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can make a sound by approaching the microphone 170C through the human mouth, and input the sound signal into the microphone 170C. The electronic device 100 may be provided with at least one microphone 170C. In other embodiments, the electronic device 100 may be provided with two microphones 170C, which can implement noise reduction functions in addition to collecting sound signals. In other embodiments, the electronic device 100 may also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, and realize directional recording functions.

The earphone interface 170D is used to connect wired earphones. The earphone interface 170D may be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface, and a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be provided on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors and so on. The capacitive pressure sensor may include at least two parallel plates with conductive materials. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The electronic device 100 may also calculate the touched position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations that act on the same touch position but have different touch operation strengths may correspond to different operation instructions. For example: when a touch operation whose intensity of the touch operation is less than the first pressure threshold is applied to the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.

The gyro sensor 180B may be used to determine the movement posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (ie, x, y, and z axes) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for image stabilization. Exemplarily, when the shutter is pressed, the gyro sensor 180B detects the shake angle of the electronic device 100, calculates the distance that the lens module needs to compensate according to the angle, and allows the lens to counteract the shake of the electronic device 100 through reverse movement to achieve anti-shake. The gyro sensor 180B can also be used for navigation and somatosensory game scenes.

The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude based on the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.

The magnetic sensor 180D includes a Hall sensor. The electronic device 100 may use the magnetic sensor 180D to detect the opening and closing of the flip holster. In some embodiments, when the electronic device 100 is a flip machine, the electronic device 100 can detect the opening and closing of the flip according to the magnetic sensor 180D. Furthermore, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, features such as automatic unlocking of the flip cover are set.

The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in various directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of electronic devices, and apply to applications such as horizontal and vertical screen switching, pedometers, and so on.

Distance sensor 180F, used to measure distance. The electronic device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 may use the distance sensor 180F to measure the distance to achieve fast focusing.

The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light to the outside through the light emitting diode. The electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 can use the proximity light sensor 180G to detect that the user holds the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode, and the pocket mode will automatically unlock and lock the screen.

The ambient light sensor 180L is used to sense the brightness of the ambient light. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived brightness of the ambient light. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in the pocket to prevent accidental touch.

The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photographs, fingerprint answering calls, and so on.

The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold value, the electronic device 100 reduces the performance of the processor located near the temperature sensor 180J, so as to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to avoid abnormal shutdown of the electronic device 100 due to low temperature. In some other embodiments, when the temperature is lower than another threshold, the electronic device 100 boosts the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.

Touch sensor 180K, also called "touch panel". The touch sensor 180K may be provided on the display screen 194, and the touch screen is composed of the touch sensor 180K and the display screen 194, which is also called a “touch screen”. The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. The visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K may also be disposed on the surface of the electronic device 100, which is different from the position of the display screen 194.

The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can obtain the vibration signal of the vibrating bone mass of the human voice. The bone conduction sensor 180M can also contact the human pulse and receive the blood pressure pulse signal. In some embodiments, the bone conduction sensor 180M may also be provided in the earphone, combined with the bone conduction earphone. The audio module 170 can parse the voice signal based on the vibration signal of the vibrating bone block of the voice obtained by the bone conduction sensor 180M, and realize the voice function. The application processor can analyze the heart rate information based on the blood pressure beating signal obtained by the bone conduction sensor 180M, and realize the heart rate detection function.

The button 190 includes a power-on button, a volume button, and so on. The button 190 may be a mechanical button. It can also be a touch button. The electronic device 100 may receive key input, and generate key signal input related to user settings and function control of the electronic device 100.

The motor 191 can generate vibration prompts. The motor 191 can be used for incoming call vibration notification, and can also be used for touch vibration feedback. For example, touch operations applied to different applications (such as photographing, audio playback, etc.) can correspond to different vibration feedback effects. Acting on touch operations in different areas of the display screen 194, the motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminding, receiving information, alarm clock, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

The indicator 192 may be an indicator light, which may be used to indicate the charging status, power change, or to indicate messages, missed calls, notifications, and so on.

The SIM card interface 195 is used to connect to the SIM card. The SIM card can be inserted into the SIM card interface 195 or pulled out from the SIM card interface 195 to achieve contact and separation with the electronic device 100. The electronic device 100 may support 1 or N SIM card interfaces, and N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. The same SIM card interface 195 can insert multiple cards at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 may also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as call and data communication. In some embodiments, the electronic device 100 adopts an eSIM, that is, an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. The embodiment of the present invention takes an Android system with a layered architecture as an example to illustrate the software structure of the electronic device 100.

FIG. 3 is a block diagram of the software structure of the electronic device 100 according to an embodiment of the present application.

The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Communication between layers through software interface. In some embodiments, the Android system is divided into four layers, from top to bottom, the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.

The application layer can include a series of application packages.

As shown in Figure 3, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

The application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

As shown in Figure 3, the application framework layer can include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and so on.

The window manager is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, take a screenshot, etc.

The content provider is used to store and retrieve data and make these data accessible to applications. The data may include videos, images, audios, phone calls made and received, browsing history and bookmarks, phone book, etc.

The view system includes visual controls, such as controls that display text, controls that display images, and so on. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface that includes a short message notification icon can include a view that displays text and a view that displays images.

The phone manager is used to provide the communication function of the electronic device 100. For example, the management of the call status (including connecting, hanging up, etc.).

The resource manager provides various resources for the application, such as localized strings, icons, images, layout files, video files, and so on.

The notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and it can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, and so on. The notification manager can also be a notification that appears in the status bar at the top of the system in the form of a chart or a scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, text messages are prompted in the status bar, prompt sounds, electronic devices vibrate, and indicator lights flash.

Android Runtime includes core libraries and virtual machines. Android runtime is responsible for the scheduling and management of the Android system.

The core library consists of two parts: one part is the function functions that the java language needs to call, and the other part is the core library of Android.

The application layer and application framework layer run in a virtual machine. The virtual machine executes the java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

The system library can include multiple functional modules. For example: surface manager (surface manager), media library (Media Libraries), three-dimensional graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), etc.

The surface manager is used to manage the display subsystem and provides a combination of 2D and 3D layers for multiple applications.

The media library supports playback and recording of a variety of commonly used audio and video formats, as well as still image files. The media library can support multiple audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing.

The 2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

The multi-screen interaction method provided by the embodiments of the present application will be described in detail below based on the electronic device 100 shown in FIG. 1 in conjunction with other drawings.

In some application scenarios of the present application, when the foldable display screen is in the folded state, the electronic device 100 may display a certain application interface (such as the application interface of the mailbox) on the display area (such as the first screen area) of the foldable display screen. , SMS application interface, calendar application interface, etc.). When the user acts on a certain view element of the application interface (for example, a message, an image, etc. displayed on the SMS application interface) through a touch operation, the electronic device 100 responds to the touch operation, and according to the view element that the touch operation acts on, Determine the application associated with the view element. If relevant information of the application is displayed in the current area, part of the display content of the current application interface will be blocked, and the user's visual experience will be reduced.

The touch operations mentioned in the embodiments of the present application include, but are not limited to, pressing/long-pressing touch operations, dragging touch operations, sliding touch operations, double-tap touch operations, tapping touch operations, and the like. In actual application scenarios, this touch operation is different from the touch operation currently used by the electronic device 100 to trigger other instructions, such as a touch operation used for text recognition when pressing the screen with two fingers. Long press a dialog box to select the dialog box coordinates. Touch operation of the text content displayed in the range.

In order to make full use of the display area of the foldable display screen and bring a better visual experience to the user, an embodiment of the present application provides a multi-screen interaction method.

When the foldable display screen is in the folded state, the electronic device 100 can display a certain application interface (such as the application interface of the mailbox, the application interface of the SMS, the application of the calendar) on the display area (such as the first screen area) of the foldable display. Interface, etc.). When the user acts on a certain view element of the application interface (for example, a message, an image, etc. displayed on the SMS application interface) through a touch operation, the electronic device 100 responds to the touch operation, and according to the view element that the touch operation acts on, Determine the application associated with the view element (for example, a browser that can search for information), and display all of them on other screen areas (for example, the second screen area, or the second screen and the third screen) except the first screen area. Determine the application associated with the view element.

Exemplarily, when the foldable display screen is in the unfolded state, the electronic device 100 may display a certain application interface on the full screen of the foldable display screen, or may display a certain application interface in a part of the display area (for example, the first screen area) of the foldable display screen. An application interface. When a user acts on a view element of the application interface through a touch operation, the electronic device 100 responds to the touch operation and determines the application associated with the view element according to the view element that the touch operation acts on, if The foldable display screen displays the application interface in full screen, then exits the full screen display, and displays the application interface when the electronic device 100 is displayed in full screen in the first screen area. Area) displays the determined application associated with the view element. If part of the display area of the foldable display screen (such as the first screen area) displays the application interface, the content of the first screen area remains unchanged, and the display area other than the first screen area (such as the second screen area) ) Displays the determined application associated with the view element.

The definitions of view elements and display areas are given below:

View elements: elements displayed in the view layer of the application interface, including but not limited to text, images, sound information, etc. There are two situations in which the user acts on a certain view element in the application interface through a touch operation: 1. The touch operation acts on one view element, that is, there is only one view element. 2. Touch operation acts on two or more view elements.

Display area: an area for displaying content. In the embodiment of the present application, the area for displaying different content obtained by dividing the display area of the electronic device 100 is called a screen area.

Exemplarily, in some embodiments, the electronic device 100 divides the display area of the electronic device 100 into two or more screen areas after detecting a user's touch operation on a view element, and displays them in different screen areas. Different applications. There are two situations in which different applications are displayed on different screen areas: 1. Each screen area corresponds to displaying one application. 2. At least one screen area correspondingly displays one application or more than one application.

Exemplarily, according to the number of divided screen areas M (M is an integer greater than 1), according to a preset naming rule (for example, from left to right, from top to bottom, from right to left, from bottom to top, etc.) Rule) The name of the set screen area corresponds to the first screen area, the second screen area,..., the Mth screen area.

It should be noted that, in order to give the user a better visual experience, when dividing the display area, it is necessary to ensure that the area corresponding to each screen area is not less than the preset area threshold. Specifically, when dividing the display area, the display area of the electronic device 100 is divided according to a preset dividing rule to obtain M screen areas.

Exemplarily, the preset division rules may include the following three types: 1. The display area of the electronic device 100 is divided according to the number of divisions set by the user. 2. Determine the number of divisions of the display area according to the preset area threshold and the display area of the electronic device 100, and divide the display area of the electronic device 100 according to the determined number of divisions. 3. Determine the number of divisions of the display area according to the preset area threshold, the display area of the electronic device 100, and the number of applications that need to be displayed, and divide the display area of the electronic device 100 according to the determined number of divisions.

In the embodiment of the present application, for the determined application associated with the view element, the electronic device 100 may be displayed in the form of an application icon, may also be displayed in the form of an application name, or may display both the application icon and the application The name can also be displayed in the form of the corresponding application interface after the application is started, which is not limited in the embodiment of the present application.

Please refer to FIG. 4, which is a schematic diagram of a set of screen display interfaces provided by an embodiment of the present application. As shown in FIG. 4(A), it is the screen interface 10 displayed when the foldable display screen is in the folded state. The screen interface 10 includes an application interface 101, a status bar 102, and a navigation bar 103. in:

The application interface 101 is a corresponding user interface when the application is running, and may include a view element 1011 displayed in a text form, a view element 1012 displayed in an image form, and a view element 1013 displayed in an audio or video form.

The status bar 102 may include the name of the operator (for example, China Mobile), signal strength, WI-FI icon, current remaining power and time.

The navigation bar 103 may include system navigation keys such as a return button 1031, a home screen button 1032, and a call out task history button 1033. The main interface is an interface displayed by the electronic device 100 after detecting a user operation on the main interface button 1032 on any user interface. When it is detected that the user clicks the return button 1031, the electronic device 100 may display the previous user interface of the current user interface. When it is detected that the user clicks the main interface button 1032, the electronic device 100 may display the main screen interface. When it is detected that the user clicks the outgoing task history button 1033, the electronic device 100 can display the task that the user has recently opened. The naming of each navigation key can also be other, for example, 1031 can be called Back Button, 1032 can be called Home button, and 1033 can be called Menu Button, which is not limited in this application. The navigation keys in the navigation bar 103 are not limited to virtual keys, and can also be implemented as physical keys.

The user can select the view element displayed in the application interface through a touch operation. When the electronic device 100 detects that the touch operation acts on the view element, it displays the first keyword corresponding to the view element, and determines that it is associated with the view element according to the first keyword. The application, the application interface 101 is displayed in the first screen area, and displayed in other display areas except the first screen area (for example, the second screen area, the second screen area is another screen area facing away from the first screen area) The determined application associated with the view element.

Exemplarily, as shown in Figure 4(A), when the foldable display screen is in a folded state (that is, the angle formed by the left and right ends or the upper and lower ends of the central bending part of the foldable display screen is 0 degrees) , The first keyword is displayed in the display area 104 to which the keyword of the screen interface 10 belongs, and the user is prompted to expand the foldable display or flip the screen to view the application associated with the view element. Specifically, the user can be prompted to expand the display by voice, text, etc. Fold the display or flip the screen to see the apps associated with the view element.

As shown in Figure 4 (B) and (C), when the angle between the left and right ends of the central bending part of the foldable display changes from 0 degrees to +180 degrees (not including 0 degrees), that is When the foldable display screen is switched from the folded state to the expanded state, the application interface 101 is displayed in the first screen area 203, and the recommended application 202 is displayed in the second screen area 204. The application 202 is an application associated with a view element.

As shown in (D) and (E) in Figure 4, when the angle between the upper and lower ends of the central bending part of the foldable display changes from 0 degrees to +180 degrees (not including 0 degrees), that is When the foldable display screen is switched from the folded state to the expanded state, the application interface 101 is displayed in the first screen area 303, and the recommended application 302 is displayed in the second screen area 304. The application 302 is an application associated with the view element.

It should be noted that when the angle between the left and right ends of the central bending part of the foldable display screen is 0 degrees, the foldable display screen is in a folded state. At this time, the first screen area and the second screen area are opposite to each other. For the two display areas, when the application associated with the view element is determined, a prompt message is displayed in the first screen area to prompt to expand the foldable display to display the application associated with the view element, or to prompt the user to flip the foldable The display screen is convenient for the user to view the application associated with the view element in the second screen area.

It can be understood that the foldable display screen is in an unfolded state when the angle formed by the left and right ends of the central bending part of the foldable display screen is greater than 0 degrees and less than or equal to +180 degrees.

It should be noted that the recommended application can be displayed in the form of a name, an icon, or a combination of the name and the icon. In some embodiments, the recommended application may be displayed in the form of an application interface.

It should also be noted that when the foldable display screen is in the folded state, the second screen area facing away from the first screen area can be in the off-screen state, or it can display the main screen interface or other application interfaces. After the application, the application associated with the view element can be displayed in the second screen area, and other applications previously displayed in the second screen area will jump to the background to run, and the view element-related applications displayed in the second screen area After the application exits, other applications that jump to the background to run can be displayed in the second screen area.

In some embodiments, the electronic device 100 divides the display area of the foldable display screen according to the bending position of the foldable display screen to obtain two or three screen areas. In other embodiments, the electronic device 100 divides the display area of the foldable display screen according to a preset division rule to obtain two or more screen areas. The area of the screen area can be fixed, or the area of the screen area can be adjusted according to the adjustment operation input by the user.

As shown in (F) in Figure 4, the display area of the foldable display screen is divided into three screen areas. The application interface 101 is displayed in the first screen area 403, and the display elements associated with the view elements are displayed in the second screen area 404. One application 4021 displays another application 4022 associated with the view element in the third screen area. In some embodiments, as shown in (F) of FIG. 4, when the foldable display screen is in the folded state, the electronic device 100 divides the display area facing away from the first screen area to update the second screen area 404 And the third screen area 405.

As shown in (G) and (H) in FIG. 4, when the foldable display screen is in an unfolded state, the display area of the foldable display screen is divided into three screen areas. As shown in (G) in Figure 4, an application interface 101 is displayed in the first screen area 403, an application 4021 associated with a view element is displayed in the second screen area 404, and an application 4021 associated with a view element is displayed in the third screen area 405. Connected to other applications other than application 4021. As shown in (H) in Figure 4, the application interface 101 is displayed in the first screen area 403, and the same type of application associated with the view element is displayed in the second screen area 404, for example, this type of application is a map application , Where application 4021 is Baidu map, application 4024 is Gaode map; the third screen area 405 displays other applications of the same type associated with view elements, for example, this type of application is a travel booking application, among which, Application 4022 is a 12306 booking application, and application 4023 is a Ctrip travel application.

As shown in (I) in Figure 4, the display area of the foldable display screen is divided into four screen areas, and the application to which the application interface 101 belongs jumps to the background to run in the first screen area 502, the second screen area 503, The third screen area 504 and the fourth screen area 505 each correspondingly display any application 501 associated with the view element. For example, the application 5011 is displayed in the first screen area 502, the application 5012 is displayed in the second screen area 503, and the application 5012 is displayed in the third screen area 503. The screen area 504 displays the application 5014, and the fourth screen area 505 displays the application 5013, where the application 5011, the application 5012, the application 5013, and the application 5014 are displayed in the form of an application interface.

It should be noted that when an application associated with a view element is displayed in the form of an application interface, the keyword corresponding to the view element and the search result corresponding to the keyword are displayed in the application interface.

In the embodiment of the present application, since the application associated with the view element is displayed in other screen areas except the screen area of the application interface to which the view element belongs, the application associated with the view element is reduced to block the application to which the view element belongs. The area of the screen area of the interface improves the user's browsing efficiency and increases the user's visual experience.

The following describes the process of the electronic device 100 determining the application according to the view element.

Please refer to FIG. 5, which is a schematic flowchart of a method for determining an application based on view elements according to an embodiment of the present application. As shown in Fig. 5, the method includes steps S101 to S106.

S101. The electronic device 100 displays a screen interface 10.

In the embodiment of the present application, the screen interface 10 displayed by the electronic device 100 may be as shown in (A) in FIG. , The displayed application interface 101 is the screen interface 10. Alternatively, as shown in Figure 8(A), the foldable display screen is in an unfolded state and is in a multi-screen display state. The application interface of chat applications (such as QQ, WeChat, etc.) is displayed on one of the screen areas, and the other One screen area displays the main screen interface, and the displayed application interface and the main screen interface constitute the screen interface displayed by the electronic device 100. Alternatively, as shown in (A) in FIG. 10, the foldable display screen is in an unfolded state and is in a full-screen display state, and the application interface for displaying the calendar on the foldable display screen constitutes the screen interface displayed by the electronic device 100.

S102. The electronic device 100 detects a user's touch operation on the view element on the application interface 101.

In the embodiment of the present application, when the electronic device 100 detects the user's touch operation on the view element on the application interface 101, it simultaneously obtains the display state of the foldable display screen, where the display state is the display state of the electronic device through the foldable display screen display interface. Status, including full-screen display status and multi-screen display status.

It should be noted that when the foldable display screen is in the folded state, the default display state of the foldable display screen is the multi-screen display state.

Exemplarily, if the display state of the foldable display screen is the full-screen display state, that is, the electronic device 100 displays the application interface 101 in the full screen area, the electronic device 100 will exit the full-screen display and divide the display area of the electronic device 100 into two One or more screen areas, the divided screen areas are used to display applications associated with view elements, so as to improve the display efficiency of the foldable display screen, so that users can quickly browse applications associated with view elements ; Or any one of the divided screen areas is used to display the application interface 101 zoomed in by a certain ratio, and the application associated with the view element is displayed in the remaining screen area.

If the display state of the foldable display is multi-screen display, that is, the electronic device 100 displays the application interface 101 in any one of the two or more screen areas, and displays the main screen interface or other applications on the remaining other screen interfaces Interface, after the electronic device 100 detects that the user touches the view element in the application interface 101, the number of screen areas remains unchanged, and the application associated with the view element is displayed in any screen area except the display application interface 101, except The application corresponding to the application interface 101 and the application associated with the view element keep running in the foreground, and other applications will jump to the background to run.

It should be understood that when the application associated with the view element is an application displayed on the foldable display screen when the user does not touch the view element, the application remains displayed on the original screen area.

S103. In response to the user's touch operation on the view element, the electronic device 100 displays the first keyword corresponding to the above-mentioned view element.

In the embodiment of the present application, in response to the user's touch operation on the view element as shown in (A) in FIG. 4, the electronic device 100 recognizes and extracts keywords from the view element that the touch operation acts on, that is, the view element corresponds to The first keyword.

Exemplarily, after the electronic device 100 obtains the view element through the graphical user interface interface, it can recognize the content of the view element through methods such as image recognition, text recognition, voice recognition, etc., and analyze and extract the first keyword from the recognized content.

It should be noted that there is at least one first keyword, including but not limited to words, words, and sentences. That is, semantic analysis is performed when the content of the view element is recognized to extract the first keyword, and at least one phrase is obtained.

Exemplarily, the electronic device 100 extracts the content of the area affected by the touch operation, and analyzes the extracted content to obtain the first keyword.

S104. The electronic device 100 stores the first keyword.

S105. The electronic device 100 classifies the first keyword, and determines the second keyword according to the classification result.

In the embodiments of the present application, the electronic device 100 can classify words with the same properties or features according to the attributes or characteristics of the words, etc., through semantic association or expansion, and then determine the second keyword according to the classification result, thereby reducing the key The number of words achieves the purpose of improving the efficiency of searching applications.

For example, when the feature of a word is an address, all words that can be classified as an address can be classified into the address category, such as keywords such as Beijing, Shanghai, Nanjing, etc., and the keyword determined after the classification is "address".

Exemplarily, the electronic device 100 classifies the first keyword through a classifier (for example, a neural network model based on deep learning), such as classifying Beijing, Shanghai, Guangzhou, etc. into addresses, and classifying Beijing Palace Museum, Shanghai Disneyland, etc. To scenic spots, classify weekends, Christmas, Spring Festival, etc. into dates, classify "Where to play" into activities, and classify the resulting category (such as address, date, etc.) as the second keyword.

Exemplarily, after the electronic device 100 classifies the first keyword and determines the second keyword, it establishes an association relationship between the second keyword and the first keyword, so that the electronic device 100 can determine the corresponding first keyword according to the second keyword. A keyword, so that after the application corresponding to the second keyword is determined, the related content of the first keyword can be displayed on the application interface corresponding to the application.

S106. The electronic device 100 determines an application corresponding to the first keyword according to the second keyword.

In the embodiment of the present application, the electronic device 100 stores an application index list as shown in Table 1. The application index list stores the association relationship between keywords and applications. Based on the association relationship between keywords and applications, the electronic device 100 according to the second The keyword can be indexed from the application index list to the application corresponding to the second keyword, that is, the application corresponding to the first keyword.

Table 1

It can be seen from Table 1 that each keyword is associated with at least one application, that is, the number of applications associated with the view element is N, and N is an integer greater than or equal to 1.

In some possible implementation manners, the electronic device 100 classifies keywords for which the corresponding category cannot be determined into the "other" category, and the correspondingly associated application of the "other" category is a browser.

It is understandable that the keys stored in the application index list are not limited to the keywords shown in Table 1, and can be further subdivided or summarized according to actual application requirements. For example, the keywords "address" and "scenic spot" can be summarized as "Location", the keyword "activity" can be subdivided into "tourism", "food sharing" and so on.

In some possible implementations, the application index list stores pre-set index weights corresponding to each application, that is, an application corresponds to an index weight. The index weight referred to here specifically refers to the index to a certain application according to the keyword The weight of is used to determine the probability of displaying the application according to the corresponding weight of the application. Generally, the higher the index weight corresponding to the top-ranked application, the higher the index weight, and the greater the probability that the application corresponding to the index weight will be indexed and displayed. As shown in Table 1, the index weight of application 1 is higher than that of application 2, and the index weight of application 2 is higher than that of application N. When the number of applications displayed in the screen area is limited, for example, when a screen area can only display one application, and the number of screen areas M is less than the number of applications associated with the view element, that is, when M is greater than N, the electronic device 100 will display the top M applications in the screen area of the electronic device 100 according to the index weight.

It should be noted that in some possible implementations, the index weight can be adjusted according to the frequency of use of the application by the user, and the higher the frequency of use of the application, the higher the corresponding index weight. The frequency of use referred to here is the frequency at which the user clicks on the displayed application after the electronic device 100 displays the application associated with the view element in the screen area. The electronic device 100 adjusts the index weight corresponding to the application according to the frequency of the user clicking the application within a period of time.

It should be noted that the application index list may be preset, that is, the association relationship between keywords and applications is preset, so that the corresponding applications can be quickly indexed through the keywords.

It should also be noted that, because different electronic devices 100 have different installed applications, and there are generally more than one applications with the same keyword, in order to improve indexing efficiency, the application index list of each electronic device 100 can be further optimized.

For example, the electronic device 100 compares and matches the names of the installed applications with the applications in the preset application index list, deletes applications that do not have matching items in the preset application index list, and obtains an updated application index list , The updated application index list is used as the index list of the electronic device 100.

Exemplarily, in a possible implementation manner, the application that the electronic device finds is an application that is not installed. At this time, the electronic device cannot directly start the application, and the user is prompted to install the application. Or the electronic device sets the name of the application as the third keyword, searches for the predetermined application according to the third keyword and displays the corresponding search result, so that the user can quickly install the application.

Exemplarily, there are at least two keywords corresponding to the view element. In some embodiments, in order to meet the personalized needs of the user, only the application corresponding to the keyword that the user pays attention to is searched, and the user can touch the displayed in the application interface The delete control corresponding to the keyword is used to delete the keywords that it is not interested in.

Please refer to FIG. 6, which is a schematic flowchart of another method for determining an application based on view elements according to an embodiment of the present application. As shown in Fig. 6, the method includes steps S201 to S208.

For S201 to S203, please refer to the description of steps S101 to S103 in the embodiment described in FIG. 5, which will not be repeated here.

S204. The electronic device 100 detects a user's touch operation on the delete control 2011.

S205. In response to the user's touch operation on the delete control 1041, the electronic device 100 deletes the corresponding first keyword on the application interface 101.

S206. The electronic device 100 stores the updated first keyword.

In the embodiment of the present application, the updated first keyword is the keyword retained after the user touches the delete control 1041 to delete the corresponding first keyword.

Optionally, the embodiment of the present application is not limited to deleting the first keyword corresponding to the view element through the delete control 1041. It can also be deleted in other ways, for example, by detecting a user's touch operation on the first keyword, such as a drag operation. After the dragged first keyword moves out of the area where the keyword belongs, the dragged first keyword is deleted.

For S207 to S208, please refer to the description of steps S105 to S106 in the embodiment described in FIG. 5, which will not be repeated here.

Please refer to FIG. 7, which is a schematic flowchart of a method for determining an application displayed in a screen area according to an embodiment of the present application. As shown in Fig. 7, the method includes steps S301 to S306.

For S301 to S303, please refer to the description of steps S101 to S103 in the embodiment described in FIG. 5, which will not be repeated here.

S304. In response to the user's touch operation on the view element, the electronic device 100 divides its display area to obtain M screen areas.

In the embodiment of the present application, the electronic device 100 obtains the display state of the foldable display screen after detecting the user's touch operation on the view element on the application interface 101, where the display state includes a full-screen display state and a multi-screen display state. When the display state is that the foldable display is in the unfolded state, the display area of the foldable display is displayed on the full screen, that is, the number of display areas of the foldable display is one; the multi-screen display state is that the foldable display is in two or two More than one screen area displays the display area of the foldable display, that is, the number of display areas of the foldable display is two or more. If the foldable display screen is in a full-screen display state, the display area of the foldable display screen is divided according to a preset division rule to obtain M screen areas.

In some embodiments, if the display state of the foldable display screen is the multi-screen display state, it is determined whether the foldable display screen is currently in the unfolded state, and if the foldable display screen is currently in the unfolded state, the information associated with the view element is obtained. The number of applications N, if the number N of applications associated with the view element is greater than the number M of the screen area of the foldable display screen, the electronic device 100 divides the display area of the foldable display screen according to a preset division rule , And update the number of screen areas M to be the number of screen areas obtained after division.

It should be noted that when the electronic device 100 divides the display area of the foldable display screen according to the preset dividing rule, it compares the number of divisions corresponding to the preset dividing rule with the number N of applications associated with the view element, and determines A preset division rule whose number of divisions is closest to the number N of applications associated with the view element is divided, and then the display area of the foldable display screen is divided according to the determined preset division rule.

S305. The electronic device 100 obtains an index weight corresponding to an application associated with the view element.

S306. The electronic device 100 determines the applications displayed in each screen area according to the aforementioned index weight.

In the embodiment of the present application, after the electronic device 100 obtains the applications associated with the view elements, it will allocate a screen area to the applications associated with the view elements to display the corresponding applications. Specifically, the electronic device 100 determines the application displayed in the screen area according to the determined number N of applications associated with the view element, the index weight corresponding to each application, and the number M of the screen area.

Please refer to FIG. 8. FIG. 8 is a schematic flowchart of a method for multi-screen interaction provided by an embodiment of the present application. As shown in Fig. 8, the method includes steps S401 to S404.

S401. The electronic device 100 displays the screen interface 10.

S402. The electronic device detects a user's touch operation on the first screen area.

S403. The electronic device 100 receives the user's touch operation on the first screen area, and determines the view element corresponding to the above touch operation.

Wherein, the first screen area is any screen area of the above-mentioned multiple screens, and the above-mentioned view element is an element in the application interface currently displayed in the above-mentioned first screen area;

S404. In response to the above-mentioned touch operation, the electronic device 100 displays the application associated with the above-mentioned view element in at least one screen area of the above-mentioned multi-screen except the above-mentioned first screen area, or: the application currently displayed in the above-mentioned first screen area is transferred to Running in the background, the application associated with the above-mentioned view element is displayed on several screen areas in the above-mentioned multi-screen.

In the embodiments of the present application, on the one hand, displaying the application associated with the view element in at least one screen area other than the first screen area can reduce the risk of displaying the application associated with the view element on the first screen area. It shields, and makes full use of the display area of the screen, and displays the application interface of multiple applications on the screen, which is convenient for users to view. On the other hand, the application currently displayed in the first screen area is transferred to the background to run, and the application associated with the view element is displayed on several screen areas in the multi-screen, so that the display of multiple view elements on the screen is associated with the application. Applications, so that people can view the applications associated with the view element at the same time. In some embodiments, when the foldable display screen is in the multi-screen display state, when the user touches any element in the currently displayed application interface in the first screen area (any screen area in the multi-screen display state), the electronic device 100 will Determine the view element corresponding to the touch operation, and obtain the application associated with the view element, display the application associated with the view element in at least one screen area other than the first screen area, or display the first screen area currently And/or applications currently displayed in other screen areas go to the background to run, and the applications associated with the view element are displayed in multiple screen areas. Specifically, the number of screen areas of the multi-screen is set to M, and the number of applications associated with the view element is set to N, where M>1, N>1, and both M and N are integers; At least one screen area outside a screen area displays the application associated with the view element, including the following four situations:

A1. If the number of screen areas M-1 is greater than or equal to the number N of applications associated with the view element, the index weights selected from the N applications associated with the view element will be displayed in M-1 screen areas. The application of the former L, where 1≤L≤M-1, and L is an integer.

As shown in (B) to (E) in FIG. 4, M is 2 and N is 4. When the user touches the element 1012 in the application interface currently displayed in the first screen area 203, the electronic device 100 determines the view corresponding to the touch operation Element, the applications associated with the view element are obtained as

applications

2021, 2022, 2023, and 2024. At this time, the electronic device 100 displays the application interface 101 in the first screen area 203, and displays the top four index weights in the second screen area 204 Four applications. As shown in FIG. 4(F), M is 3 and N is 3. When the user touches an element in the application interface currently displayed in the first screen area 403, the electronic device 100 determines the view element corresponding to the touch operation, and obtains the The applications associated with the view elements are

applications

4021, 4022, 4023, and 4024. At this time, the electronic device 100 displays the application interface 101 in the first screen area 403, and displays the application 4021 with the index weight ranking first in the second screen area 404. In the third screen area 405, the application 4022 with the second ranking in index weight is displayed.

A2. If the number of screen areas M-1 is greater than or equal to the number N of applications associated with the view element, select M-2 screen areas from M-1 screen areas, and select M-2 screen areas in the selected M-2 screen areas. The area displays the top M-2 applications in index weights selected from the N applications associated with the view element, and the last remaining screen area displays the remaining N-M+2 applications associated with the view element The index selected in the application ranks the top P applications, where 1≤P≤N-M+2, and P is an integer.

As shown in (G) in FIG. 4, M is 3 and N is 4. When the user touches an element in the application interface currently displayed in the first screen area 403, the electronic device 100 determines the view element corresponding to the touch operation, and obtains the view The applications associated with the element are

applications

4021, 4022, 4023, and 4024. At this time, the electronic device 100 displays the application interface 101 in the first screen area 403, and displays the application 4021 with the index weight ranking first in the second screen area 404. The third screen area 405 displays the top three

applications

4022, 4023, and 4024 with index weight rankings.

A3. If the number of screen areas M-1 is greater than the number of applications associated with the view element N, then the applications associated with the view element are classified, and applications of the same type are allocated to the same screen area for display.

As shown in (H) in FIG. 4, M is 3 and N is 4. When the user touches an element in the application interface currently displayed in the first screen area 403, the electronic device 100 determines the view element corresponding to the touch operation, and obtains the view The applications associated with the element are

applications

4021, 4022, 4023, and 4024. After the electronic device 100 classifies the applications associated with the view element, the application 4021 and the application 4024 are the same type of application, and the application 4022 and the application 4023 are the same. At this time, the electronic device 100 displays the application interface 101 in the first screen area 403, displays the same type of

applications

4021 and 4024 in the second screen area 404, and displays another of the same type in the third screen area 405 Application 4022 and application 4023.

A4. If the number of screen areas M-1 is less than the number N of applications associated with the view element, select N screen areas from M-1 screen areas, and display the view element in the selected N screen areas Associated applications.

Specifically, the application currently displayed in the first screen area is transferred to the background to run, and the application associated with the view element is displayed in several screen areas in the multi-screen, including the following three situations:

B1. If the number of screen areas M is greater than or equal to the number of applications associated with the view element N, then the top Q applications selected from the N applications associated with the view element will be displayed in the M screen areas. , Where 1≤Q≤M, and Q is an integer.

As shown in (I) in Figure 4, M is 4 and N is 5. When the user touches an element in the currently displayed application interface, the electronic device 100 determines the view element corresponding to the touch operation, and obtains the application associated with the view element For the applications 5021, 5022, 5023, 5024, and 5025, the electronic device 100 displays the application 5011 with the index weight ranking first in the first screen area 502, and displays the application 5012 with the index weight ranking second in the second screen area 503. The third screen area 504 displays the application 5014 ranked third in index weight, and the fourth screen area 505 displays the application 5013 ranked fourth in index weight.

B2. If the number of screen areas M is greater than or equal to the number of applications associated with the view element N, then select M-1 screen areas from the M screen areas, and display slaves in the selected M-1 screen areas The selected index weight of the N applications associated with the view element ranks the top M-1 applications, and the remaining last screen area displays the selected from the remaining N-M+1 applications associated with the view element Applications with index ranking in the top R, where 1≤R≤N-M+1, and R is an integer.

B3. If the number M of screen areas is greater than or equal to the number N of applications associated with the view element, then the applications associated with the view element are classified and the applications of the same type are allocated to the same screen area for display.

Please refer to FIG. 9, which is a schematic flowchart of a method for multi-screen interaction provided by an embodiment of the present application. As shown in Figure 9, the method includes steps S501 to S504.

S501. The electronic device 100 displays the screen interface 10 in a full screen.

S502. The electronic device detects a user's touch operation on the screen.

S503. The electronic device 100 receives a user's touch operation on the screen, and determines a view element corresponding to the above touch operation.

In the embodiment of the present application, the above-mentioned view element is an element on a screen, and the screen includes a plurality of screen areas.

S504. In response to the aforementioned touch operation, the electronic device 100 selects one screen area from the multiple screen areas to display the interface currently displayed on the screen, and at least one of the multiple screen areas except the selected screen area The screen area displays the application associated with the view element; or: displays the application associated with the view element in the multiple screen areas.

In the embodiments of the present application, on the one hand, displaying the application associated with the view element in at least one screen area other than the selected screen area can reduce the cost of displaying the application associated with the view element on the selected screen area. It also makes full use of the display area of the screen, and displays the application interface of multiple applications on the screen, which is convenient for users to view. On the other hand, the application associated with the view element is displayed on several screen areas in the multi-screen, which realizes that the application associated with multiple view elements is displayed on the screen, so that people can view the applications associated with the view element at the same time. . When the electronic device 100 receives a touch operation on the screen, the electronic device 100 switches the display state of the foldable display screen from the full-screen display state to the multi-screen display state, that is, the screen of the foldable display screen includes at least two screen areas. Before the display state of the foldable display screen is switched from the full-screen display state to the multi-screen display state, the electronic device 100 triggers a preset division rule to divide the display area of the foldable display screen.

Specifically, the number of the multiple screen areas is set to M, and the number of applications associated with the view element is set to N, where M>1, N>1, and both M and N are integers; At least one screen area in the screen area except the selected screen area displays the application associated with the view element, including the following four situations:

C1. If the number of screen areas M-1 is greater than or equal to the number N of applications associated with the view element, the index weight ranking selected from the N applications associated with the view element is correspondingly displayed in the M-1 screen areas In the application of the former L, where 1≤L≤M-1, and L is an integer. For details, please refer to the relevant descriptions of (B) to (F) in FIG. 4, which will not be repeated here.

C2. If the number of screen areas M-1 is greater than or equal to the number N of applications associated with the view element, select M-2 screen areas from the M-1 screen areas, and select M-2 screen areas in the selected M-2 screen areas. The area displays the top M-2 applications in index weights selected from the N applications associated with the view element, and the last remaining screen area displays the remaining N-M+2 applications associated with the view element The index selected in the application ranks the top P applications, where 1≤P≤N-M+2, and P is an integer.

C3. If the number of screen areas M-1 is greater than the number N of applications associated with the view element, then the applications associated with the view element are classified, and applications of the same type are allocated to the same screen area for display.

C4. If the number of screen areas M-1 is less than the number N of applications associated with the view element, select N screen areas from M-1 screen areas, and display the view element in the selected N screen areas Associated applications.

Specifically, the application currently displayed in the first screen area is transferred to the background to run, and the application associated with the view element is displayed in the above-mentioned multiple screen areas, including the following three situations:

D1. If the number of screen areas M is greater than or equal to the number of applications associated with the view element N, then the top Q applications selected from the N applications associated with the view element are displayed in the M screen areas. , Where 1≤Q≤M, and Q is an integer.

D2. If the number M of screen areas is greater than or equal to the number N of applications associated with the view element, select M-1 screen areas from the M screen areas, and display slaves in the selected M-1 screen areas The selected index weight of the N applications associated with the view element ranks the top M-1 applications, and the remaining last screen area displays the selected from the remaining N-M+1 applications associated with the view element Applications with index ranking in the top R, where 1≤R≤N-M+1, and R is an integer.

D3. If the number M of screen areas is greater than or equal to the number N of applications associated with the view element, then the applications associated with the view element are classified, and applications of the same type are allocated to the same screen area for display.

The embodiment of the present application realizes the display of multiple applications in multiple screen areas by displaying the associated effects of view elements in any screen area other than the screen area where the currently displayed application interface is located, so that the user can quickly browse or start the view. The application associated with the element improves the user's browsing experience.

It should be noted that when allocating the screen area to the application interface 101, keep the position of the screen area that the application interface 101 currently belongs to, or display the application interface 101 according to the screen area corresponding to the position of the display area where the application interface 101 is currently located, or The application index weight corresponding to the application interface 101 is set to the highest, and it is displayed in the screen area with the highest screen display priority.

It should also be noted that when allocating screen areas to applications, screen areas can be randomly allocated to each application, or screen areas can be allocated to each application according to a preset allocation rule.

Exemplarily, after the electronic device 100 obtains the screen areas by dividing it, the name of each screen area and the corresponding display priority will be set. The display priority referred to here is the priority of the display application of the screen area. The higher the display priority of the screen area, the higher the priority of the display application of the screen area. For example, the display priority of the first screen area is higher than that of the second screen. Area, when there is only one application that needs to be displayed, the first screen area is given priority to display the application; in the case that there are two or more applications that need to be displayed, the screen area is allocated to the application according to the preset allocation rules. In order to determine the corresponding screen area according to the index weight corresponding to the application, the higher the index weight corresponding to the application, the higher the screen display priority corresponding to the determined screen area.

Specifically, the preset allocation rule is to allocate the corresponding screen area to the application according to the corresponding relationship between the screen display priority and the index weight of the application. The higher the index weight corresponding to the application, the higher the screen display priority of the corresponding screen area.

Exemplarily, after step S206, step S207 is further included:

S207. The electronic device 100 obtains the first keywords corresponding to the applications displayed in each screen area, and after the above-mentioned application is started, the first keywords and search results corresponding to each application are correspondingly displayed in each screen area.

In the embodiment of the present application, when the application displayed in the screen area is the application name or application icon, after detecting the user's touch operation on the application name or application icon, the electronic device 100 responds to the user's touch on the application name or application icon Operate to obtain the keywords corresponding to the application corresponding to the application name or application icon. After the application corresponding to the application name or application icon is started, the corresponding keywords of each application are displayed on the corresponding screen area and the application is performed according to the keywords. The search results reduce user operations, improve the efficiency of user operations, and make user experience better.

Exemplarily, in a possible implementation manner, when the electronic device 100 determines the applications displayed in each screen area, it starts the determined application at the same time, and obtains the keywords corresponding to the determined application, and displays them in the corresponding screen area. Displays the application interface corresponding to the application after startup, and displays the keywords and search results corresponding to the application in the corresponding position of the application interface, which further reduces user operations, improves the efficiency of user operations, and makes user experience better .

Please refer to FIG. 10, which is a schematic diagram of another set of screen display interfaces provided by an embodiment of the present application. As shown in FIG. 10, the foldable display screen is in an unfolded state and includes at least two screen areas. As shown in (A) in Figure 10, the number of screen areas of the foldable display is 2, the dialogue interface 601 of an application is displayed in the first screen area 603, and the main interface of the screen is displayed in the second screen area 604. The user presses Touching the

dialog messages

6011 and 6012 displayed in the dialog interface 601, in response to the user's touch operation on the

dialog messages

6011 and 6012, the electronic device 100 displays the first key corresponding to the

dialog messages

6011 and 6012 on the first screen area 603 Words, such as "Quanjude" and "Wangfujing" in the keyword 602 as shown in (A) in FIG. 10; at the same time, the electronic device 100 classifies the first keyword and determines that the

dialog messages

6011 and 6012 correspond to each other according to the classification result The second keyword of is "dining" and "address". The corresponding application can be found from the application index list according to the second keyword. The found application is related to the

dialog messages

6011 and 6012, which are view elements Applications. As shown in (B) in Figure 10, the number of screen areas of the foldable display is 2, and the electronic device 100 displays the dialogue interface 601 in the first screen area 603, and displays all the searched and found in the second screen area 604.

Dialog messages

6011 and 6012 are associated with two applications. As shown in (C) in FIG. 10, the number of screen areas of the foldable display is 3, that is, the electronic device 100 divides the second screen area 604 into a screen area 704 and a screen area 705, and keeps the screen area 603 unchanged. And the divided screen areas are named the first screen area 703 (original screen area 603), the second screen area 704, and the third screen area 705 in sequence, and the dialogue interface 701 (the dialogue interface 701 and the dialogue Interface 601 is the same), an application interface corresponding to an application associated with

dialog messages

6011 and 6012 is displayed in the second screen area 704, and the keyword "Quanjude Wangfujing" corresponding to the application is displayed on the application interface. The three-screen area 705 displays an application interface corresponding to another application associated with the

dialog messages

6011 and 6012, and displays the keyword "Quanjude Wangfujing" corresponding to the application on the application interface.

It should be noted that, in some embodiments, the first keyword corresponding to the view element may not be displayed in the screen area, or the first keyword corresponding to the view element may be displayed in the screen area and cannot be deleted.

As shown in (D) in Figure 10, the foldable display screen is in an unfolded state, the number of screen areas of the foldable display screen is 3, the user touches the dialog messages 8011 and 8012 displayed in the dialog interface 801, and the dialog box When the message 8011 is dragged in the direction of the dialog message 8012, the electronic device 100, in response to the user's touch and drag operation, recognizes and extracts the keywords of the dialog message 8011 and the dialog message 8012, and obtains a set of keywords. During the extraction process Perform semantic recognition and analysis on the recognized text content to obtain at least one keyword, for example, obtain a keyword "weekend play paraglider", or two keywords "weekend play" and "paraglider". The electronic device 100 is based on After the corresponding application is found by the keyword, the dialog interface 801 is displayed in the first screen area 803, and the interface corresponding to the map application associated with the dialog messages 8011 and 8012 and the search results corresponding to the keywords are displayed in the second screen area 804. The browsing interface corresponding to the browser application associated with the dialog messages 8011 and 8012 and the search results corresponding to the keywords are displayed in the third screen area.

Exemplarily, the electronic device 100 performs semantic recognition and expansion on the extracted text content in the process of recognizing and extracting keywords from the view elements acted on by the touch operation, to obtain at least two keywords, as shown in FIG. 10 The keywords of the dialog box message 8011 and the dialog box message 8012 shown in (D) can be expanded to: weekend trips, weekend scenic spots recommendation, surrounding paragliding locations, etc.

Please refer to FIG. 11, which is a schematic diagram of another set of screen display interfaces provided by an embodiment of the present application. As shown in Figure 11, the foldable display is in an unfolded state and contains at least two screen areas. As shown in (A) in Figure 11, the number of screen areas of the foldable display is 2, and one of the screen areas displays shopping The interface of the application, the other screen area is the main screen interface or another application interface is displayed, the user touches the view element in the application interface, and the user touches the item image 9011 in the shopping interface 901 of an application displayed in the first screen area 902, And drag the item image 9011 to the direction of the second screen area 903, the electronic device 100, in response to the user’s touch and drag operation, recognizes and extracts the keyword "Huawei phone model" of the item image 9011, according to the keyword "Huawei phone model" "The corresponding application is found to be a "shopping application", and the electronic device 100 will display the found application in another screen area different from the screen area where the user's current application interface is located, as shown in (B) in FIG. 11 As shown, the searched application and the application displayed in the first screen area 901 are different applications of the same type. The electronic device 100 will display the shopping interface 903 of the application in the second screen area 904 and display the shopping interface 903 at the same time. The same or similar data as the item image 9011 facilitates the user to compare the price of the same item in different shopping applications, and at the same time reduces the operation of the user to find the application to compare prices, and improves the user experience.

It should be noted that the data that is the same as or similar to the item image 9011 displayed on the shopping interface 903 is a search result corresponding to the keyword "Huawei mobile phone model".

Please refer to FIG. 12, which is a schematic diagram of another set of screen display interfaces provided by an embodiment of the present application. As shown in (A) in Figure 12, the foldable display is in an unfolded state, and the calendar application interface is displayed on the full screen. When the user touches the date in the calendar application interface, the foldable display will exit the full screen display and display the foldable display The display area of the screen is divided to obtain 4 screen areas as shown in (B) and (C) in Figure 12. As shown in (B) and (C) in Figure 12, the full-screen calendar application interface will be Zoom to one of the screen areas to display according to a certain ratio, or the calendar application can also jump to the background to run, and applications associated with the view element (date) will be displayed in other screen areas.

As shown in Figure 12(A), the foldable display screen displays the calendar application interface 111 in full screen. The user touches any two dates displayed in the interface 111 and moves the finger to the middle of the two dates. At this time, touch The operation acts on the date within the range of the position moved by the user, that is, the keyword corresponding to the view element is at least two dates within the range of the touch operation. In response to this touch operation, the electronic device 120 exits the full-screen display, and the foldable display screen is Divided into four screen areas, the first screen area 1201 displays the interface 111 scaled according to a certain ratio, and the second screen area 1202 displays the alarm clock application associated with the date, so that the user can set the alarm clock corresponding to the date. The screen area 1203 displays the memo application associated with the date, so that the user can record the memo items of the corresponding date, and the browser application associated with the date is displayed in the third screen area, so that the user can browse related items of the corresponding date such as weather, Constellation etc.

Exemplarily, in a possible implementation manner, when the electronic device 120 recognizes that the keyword corresponding to the view element that the touch acts on is a date, it determines whether the recognized date is a preset holiday, and the preset holiday includes but not Limited to Children’s Day, Valentine’s Day, Christmas and other holidays, if the identified date is a preset holiday, the current first keyword is updated to the corresponding holiday, and the classification result is determined according to the updated first keyword The corresponding second keyword searches for applications associated with the view element according to the second keyword.

As shown in (C) in Figure 12, when the user touches the date "February 14" displayed on the calendar interface, the electronic device 120 determines that the date is Valentine's Day, and updates Valentine's Day to the key corresponding to the view element touched by the user. According to the keyword "Valentine's Day", the applications corresponding to the date "February 14" are APP1, APP2, and APP3. The calendar interface is displayed in the first screen area 1301, and APP1 and updated are displayed in the second screen area 1302. The search results corresponding to the keywords of, the search results corresponding to APP1 and the updated keywords are displayed in the third screen area 1303, and the search results corresponding to APP1 and the updated keywords are displayed in the second screen area 1304.

The embodiments of the present application also provide a computer-readable storage medium that stores instructions in the computer-readable storage medium, and when it runs on a computer or a processor, the computer or the processor executes any one of the above methods. Or multiple steps.

The embodiments of the present application also provide a computer program product containing instructions. When the computer program product runs on a computer or a processor, the computer or the processor is caused to execute one or more steps in any of the foregoing methods.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented by software, it can be implemented in the form of a computer program product in whole or in part. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium or transmitted through the computer-readable storage medium. The computer instructions can be sent from a website site, computer, server, or data center to another website site, computer, Server or data center for transmission. The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or data center integrated with one or more available media. The usable medium may be a magnetic medium (for example, a floppy disk, a hard disk, and a magnetic tape), an optical medium (for example, a DVD), or a semiconductor medium (for example, a solid state disk (SSD)).

A person of ordinary skill in the art can understand that all or part of the process in the above-mentioned embodiment method can be realized. The process can be completed by a computer program instructing relevant hardware. The program can be stored in a computer readable storage medium. , May include the processes of the above-mentioned method embodiments. The aforementioned storage media include: ROM or random storage RAM, magnetic disks or optical disks and other media that can store program codes.

The above are only specific implementations of the embodiments of the present application, but the protection scope of the embodiments of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the embodiments of the present application shall be covered by this application. Within the protection scope of the application embodiments. Therefore, the protection scope of the embodiments of the present application should be subject to the protection scope of the claims.

Claims

A multi-screen interaction method applied to electronic equipment, characterized in that it includes:

The electronic device receives a touch operation on a first screen area, and determines a view element corresponding to the touch operation, where the first screen area is any screen area in the multi-screen, and the view element is all Describe the elements in the application interface currently displayed in the first screen area;

In response to the touch operation, the electronic device displays the application associated with the view element on at least one screen area other than the first screen area in the multi-screen, or:

The application currently displayed in the first screen area is switched to run in the background, and the application associated with the view element is displayed in several screen areas in the multi-screen.
The multi-screen interaction method of claim 1, wherein the number of screen areas of the multi-screen is set to M, and the number of applications associated with the view element is set to N, wherein the M> 1. The N>1, and the M and the N are both integers; in the multi-screen, at least one screen area other than the first screen area displays information associated with the view element Applications, including:

If the number of screen areas M-1 is greater than or equal to the number N of applications associated with the view element, the index weights selected from the N applications associated with the view element are displayed in M-1 screen areas. The first L applications, where 1≤L≤M-1, and the L is an integer, and the index weight is the weight indexed to a certain application according to the keyword; or:

Select M-2 screen areas from M-1 screen areas, and display the index weights selected from the N applications associated with the view elements in the selected M-2 screen areas and rank in the top M-2 In the last remaining screen area, the top-P indexed applications selected from the remaining N-M+2 applications associated with the view elements are displayed, where 1≤P≤N-M+2 , And the P is an integer.
The multi-screen interaction method according to claim 2, wherein the displaying the application associated with the view element on at least one screen area other than the first screen area in the multi-screen comprises:

The applications associated with the view elements are classified, and the applications of the same type are allocated to the same screen area for display.
The multi-screen interaction method according to claim 2, wherein the displaying the application associated with the view element on at least one screen area other than the first screen area in the multi-screen comprises:

If the number of screen areas M-1 is less than the number N of applications associated with the view element, N screen areas are selected from M-1 screen areas, and the view element is displayed in the selected N screen areas Associated applications.
The multi-screen interaction method according to claim 2, wherein the application currently displayed in the first screen area is transferred to the background to run, and the view elements associated with the view element are displayed in several screen areas in the multi-screen. Applications, including:

If the number M of screen areas is greater than or equal to the number N of applications associated with the view element, the top Q applications selected from the N applications associated with the view element are displayed in the M screen areas. , Where 1≤Q≤M, and the Q is an integer; or:

Select M-1 screen areas from M screen areas, and display the top M-1 applications with index weights selected from the N applications associated with the view elements in the selected M-1 screen areas , In the last remaining screen area, display the top R applications selected from the remaining N-M+1 applications associated with the view elements, where 1≤R≤N-M+1, and The R is an integer.
The multi-screen interaction method according to claim 2, wherein the displaying of the application associated with the view element on the several screen areas in the multi-screen comprises:

If the number M of screen areas is greater than or equal to the number N of applications associated with the view element, then the applications associated with the view element are classified and the applications of the same type are allocated to the same screen area for display.
The multi-screen interaction method of claim 2, wherein when the electronic device responds to the touch operation, it comprises:

The electronic device recognizes and extracts keywords from the view element, and obtains the first keyword corresponding to the view element;

The electronic device classifies the first keyword, and determines the second keyword according to the classification result;

The electronic device obtains the application associated with the view element according to the second keyword.
8. The multi-screen interaction method of claim 7, wherein when the electronic device responds to the touch operation, it comprises:

Acquiring, by the electronic device, the index weight corresponding to the application associated with the view element;

According to the index weight corresponding to each application, the screen area for displaying the application associated with the view element is determined.
A multi-screen interaction method applied to electronic equipment, characterized in that it includes:

When the electronic device receives a touch operation on the screen, determining a view element corresponding to the touch operation, where the view element is an element on the screen, and the screen includes multiple screen areas;

In response to the touch operation, the electronic device selects a screen area from the plurality of screen areas to display the interface currently displayed on the screen, and at least one of the plurality of screen areas except the selected screen area The screen area displays the application associated with the view element; or:

The applications associated with the view elements are displayed in the multiple screen areas.
The multi-screen interaction method of claim 9, wherein the number of the multiple screen areas is set to M, and the number of applications associated with the view element is set to N, wherein the M> 1. The N>1, and the M and the N are both integers; the at least one screen area excluding the selected screen area in the plurality of screen areas displays that the view element is associated The applications include:

If the number of screen areas M-1 is greater than or equal to the number N of applications associated with the view element, the index weight rankings selected from the N applications associated with the view element are correspondingly displayed in the M-1 screen areas The first L applications, where 1≤L≤M-1, and the L is an integer, and the index weight is the weight indexed to a certain application according to the keyword; or:

Select M-2 screen areas from M-1 screen areas, and display the index weights selected from the N applications associated with the view elements in the selected M-2 screen areas and rank in the top M-2 In the last remaining screen area, the top-P indexed applications selected from the remaining N-M+2 applications associated with the view elements are displayed, where 1≤P≤N-M+2 , And the P is an integer.
The multi-screen interaction method according to claim 10, wherein said displaying the application associated with the view element in at least one screen area of the plurality of screen areas excluding the selected screen area comprises :

The applications associated with the view elements are classified, and the applications of the same type are allocated to the same screen area for display.
The multi-screen interaction method according to claim 10, wherein said displaying the application associated with the view element in at least one screen area of the plurality of screen areas excluding the selected screen area comprises :

If the number of screen areas M-1 is less than the number N of applications associated with the view element, N screen areas are selected from M-1 screen areas, and the view element is displayed in the selected N screen areas Associated applications.
10. The multi-screen interaction method of claim 10, wherein the displaying the application associated with the view element in the multiple screen areas comprises:

If the number M of screen areas is greater than or equal to the number N of applications associated with the view element, the top Q applications selected from the N applications associated with the view element are displayed in the M screen areas. , Where 1≤Q≤M, and the Q is an integer; or:

Select M-1 screen areas from M screen areas, and display the top M-1 applications with index weights selected from the N applications associated with the view elements in the selected M-1 screen areas , In the last remaining screen area, display the top R applications selected from the remaining N-M+1 applications associated with the view elements, where 1≤R≤N-M+1, and The R is an integer.
10. The multi-screen interaction method of claim 10, wherein the displaying the application associated with the view element in the multiple screen areas comprises:

If the number M of screen areas is greater than or equal to the number N of applications associated with the view element, then the applications associated with the view element are classified and the applications of the same type are allocated to the same screen area for display.
The multi-screen interaction method of claim 9, wherein when the electronic device responds to the touch operation, the method comprises:

The electronic device recognizes and extracts keywords from the view element, and obtains the first keyword corresponding to the view element;

The electronic device classifies the first keyword, and determines the second keyword according to the classification result;

The electronic device obtains the application associated with the view element according to the second keyword.
The multi-screen interaction method of claim 9, wherein when the electronic device responds to the touch operation, the method comprises:

Acquiring, by the electronic device, the index weight corresponding to the application associated with the view element;

According to the index weight corresponding to each application, the screen area for displaying the application associated with the view element is determined.
An electronic device, comprising a memory, a processor, and a computer program stored in the memory and capable of running on the processor, wherein the processor executes the computer program as claimed in claims 1 to 16. Any of the multi-screen interaction methods.
A computer-readable storage medium storing a computer program, wherein the computer program implements the multi-screen interaction method according to any one of claims 1 to 16 when the computer program is executed by a processor.
A computer program product, wherein when the computer program product runs on the electronic device, the electronic device executes the multi-screen interaction method according to any one of claims 1 to 16.