CN114401373B

CN114401373B - Method for displaying on two screens simultaneously, electronic equipment and readable storage medium

Info

Publication number: CN114401373B
Application number: CN202210292871.XA
Authority: CN
Inventors: 黄邦邦; 杜鸿雁
Original assignee: Honor Device Co Ltd
Current assignee: Shanghai Glory Smart Technology Development Co ltd
Priority date: 2022-03-24
Filing date: 2022-03-24
Publication date: 2022-09-02
Anticipated expiration: 2042-03-24
Also published as: CN114401373A

Abstract

The embodiment of the application provides a method for dual-screen simultaneous display, electronic equipment and a readable storage medium, wherein the method for dual-screen simultaneous display is applied to foldable electronic equipment, the foldable electronic equipment comprises a main screen and an auxiliary screen, and the method for dual-screen simultaneous display comprises the following steps: responding to a first operation, displaying a first interface on the main screen, wherein the first operation is used for starting a camera application, and the first interface is a camera preview interface; and responding to a second operation, displaying a second interface on the auxiliary screen, wherein the first interface is displayed on the main screen, the second operation is used for starting the double-screen simultaneous display, the second interface is a camera preview interface, and the second interface is the same as or different from the first interface. It can be seen that: the user inputs a first operation, and the foldable electronic equipment displays a first interface on the main screen. After the user inputs the second operation, the foldable electronic device displays the second interface on the auxiliary screen, so that the purpose that the foldable electronic device displays data on a plurality of display screens is achieved.

Description

Method for displaying on two screens simultaneously, electronic equipment and readable storage medium

Technical Field

The present application relates to the field of multimedia technologies, and in particular, to a method, an electronic device, and a computer-readable storage medium for dual-screen simultaneous display.

Background

When the foldable electronic device is unfolded, a large display screen displays data. When the foldable electronic device is folded, one screen formed by folding the display screen or an additional screen displays data.

During use of a foldable electronic device, data is typically displayed by one screen. For example, in the unfolded state of the foldable electronic device, a large display screen displays data, and in the folded state of the foldable electronic device, one screen or additional screens separated from the large display screen display data. However, in some application scenarios of the foldable electronic device, data needs to be displayed by multiple display screens, and therefore, a solution for realizing dual-screen simultaneous display of the foldable electronic device needs to be provided.

Disclosure of Invention

The application provides a method, an electronic device, a computer program product and a computer readable storage medium for simultaneous display of two screens, and aims to realize simultaneous display of data by utilizing a plurality of display screens of the electronic device.

In order to achieve the above object, the present application provides the following technical solutions:

in a first aspect, the present application provides a dual-screen simultaneous display method, applied to a foldable electronic device, where the foldable electronic device includes a main screen and an auxiliary screen, and the dual-screen simultaneous display method includes: responding to a first operation, displaying a first interface on the main screen, wherein the first operation is used for starting a camera application, and the first interface is a camera preview interface; and responding to a second operation, displaying a second interface on the auxiliary screen, wherein the first interface is displayed on the main screen, the second operation is used for starting the double-screen simultaneous display, the second interface is a camera preview interface, and the second interface is the same as or different from the first interface.

From the above, it can be seen that: the user inputs a first operation, and the foldable electronic device can respond to the first operation and display a first interface on the main screen. And after the user inputs the second operation, the foldable electronic device responds to the second operation and displays the second interface on the auxiliary screen, so that the first interface is displayed on the main screen of the foldable electronic device, and the second interface is displayed on the auxiliary screen, and the purpose that the foldable electronic device displays data on a plurality of display screens is achieved.

In one possible embodiment, the method for dual-screen simultaneous display further comprises: responding to a third operation, saving first data, wherein the first data comprise images or videos, the third operation is a touch operation of a first control of a first interface displayed on the main screen, and the first control is used for controlling the foldable electronic equipment to shoot the images or videos.

In one possible embodiment, the method for dual-screen simultaneous display further comprises: responding to a fourth operation, displaying a third interface on the main screen, and displaying a fourth interface on the auxiliary screen; the fourth operation is used for browsing images or videos saved by the foldable electronic equipment; the third interface is a browsing interface of the image or the video specified by the fourth operation, the fourth interface is a browsing interface of the image or the video specified by the fourth operation, and the fourth interface is the same as or different from the third interface.

In this possible embodiment, when the user wants to browse images or videos simultaneously using a plurality of display screens of the foldable electronic device, a fourth operation may be input. And responding to the fourth operation by the foldable electronic equipment, and displaying the third interface on the main screen and the fourth interface on the auxiliary screen. And the third interface is a browsing interface of the image or video specified by the fourth operation, the fourth interface is a browsing interface of the image or video specified by the fourth operation, and the fourth interface is the same as or different from the third interface. It can thus be seen that: multiple display screens of a foldable electronic device may simultaneously display a browsing interface for images or videos.

In one possible embodiment, the first interface includes a first image, the second interface includes a second image, the second image is the same as the first image, or the second image is an image of the first image after being processed, and the processing includes: horizontal mirror image, vertical mirror image, select certain angle along a direction.

In one possible embodiment, the first interface and the second interface each further comprise at least one control and at least one text.

In a possible embodiment, the third interface includes a third image, the fourth interface includes a fourth image, the fourth image is the same as the third image, or the fourth image is an image of the third image after a processing operation, and the processing operation includes: horizontal mirror image, vertical mirror image, select certain angle along a direction.

In one possible embodiment, the third interface and the fourth interface each further comprise at least one control and at least one text.

In one possible embodiment, before the sub-screen displays the fourth interface, the method for displaying the same dual-screen further includes: and receiving a fifth operation, wherein the fifth operation is used for starting the double-screen simultaneous display.

In one possible implementation, displaying a first interface on a home screen includes: the camera application calls a Surface flag to create a layer of a first interface, and a flag bit of the layer of the first interface is a default value; the Surface flicker sends a first message to the display driver to indicate the display driver to control the main screen to display a first interface; the display driver controls the home screen to display a first interface in response to the first message.

In one possible embodiment, displaying the second interface on the secondary screen includes: the camera application sends a second message to the Surface flag, and the second message is used for informing the Surface flag to control the secondary screen to be electrified; the camera application calls a Surface flag to modify the flag bit of the layer of the first interface into a first flag bit, and the first flag bit indicates a display mode of the layer of the first interface on the secondary screen; determining a layer to be displayed of the auxiliary screen by the Surface flag, wherein the layer to be displayed of the auxiliary screen at least comprises a layer of a second interface; the Surface flicker sends a third message to the display driver to indicate the display driver to control the auxiliary screen to display a layer to be displayed of the auxiliary screen; and the display driver responds to the third message and controls the auxiliary screen to display the layer to be displayed of the auxiliary screen in a display mode indicated by the first flag bit.

In this possible embodiment, the Surface flicker modifies the flag bit of the layer of the first interface to be the first flag bit, so that data is displayed on the main screen and the auxiliary screen of the foldable electronic device simultaneously.

In one possible embodiment, the camera application calls Surface flicker to create a layer of the first interface, including: the camera application sends a message to the Surface flag through a Surface flag API to inform the Surface flag to create a layer of a first interface; and creating the layer of the first interface by the Surface Flinger response message.

In one possible embodiment, the method for modifying the flag bit of the layer of the first interface into the first flag bit by the camera application calling the Surface flag, includes: the camera application sends a message to the Surface flag through a Surface flag API, wherein the message carries the identifier of the layer of the first interface; and modifying the zone bit of the layer of the first interface into a first zone bit by the Surface Flinger response message.

In one possible implementation, a third interface is displayed on the home screen, including: the camera application calls a Surface flag to create a layer of a third interface, and the flag bit of the layer of the third interface is a default value; the Surface flicker sends a fourth message to the display driver to indicate the display driver to control the main screen to display a third interface; the display driver controls the home screen to display a third interface in response to the fourth message.

In one possible embodiment, displaying a fourth interface on the secondary screen includes: the camera application sends a fifth message to the Surface flag, and the fifth message is used for informing the Surface flag to control the secondary screen to be electrified; the camera application calls a Surface flag to modify the flag bit of the layer of the third interface into a first flag bit, and the first flag bit indicates a display mode of the layer of the third interface on the secondary screen; determining a layer to be displayed of the auxiliary screen by the Surface flicker, wherein the layer to be displayed of the auxiliary screen at least comprises a layer of a fourth interface; the Surface flicker sends a sixth message to the display driver to indicate the display driver to control the auxiliary screen to display a layer to be displayed of the auxiliary screen; and the display driver responds to the sixth message and controls the auxiliary screen to display the layer to be displayed of the auxiliary screen in the display mode indicated by the first flag bit.

In a second aspect, the present application provides a foldable electronic device comprising: one or more processors, a memory, a camera, a primary screen and a secondary screen; the memory, the camera, the primary screen and the secondary screen are coupled to one or more processors, the memory for storing computer program code comprising computer instructions which, when executed by the one or more processors, cause the foldable electronic device to perform the method of dual-screen co-display as in any one of the first aspect.

In a third aspect, the present application provides a computer-readable storage medium for storing a computer program, which when executed by an electronic device, causes the electronic device to implement the method of dual-screen simultaneous display according to any one of the first aspect.

In a fourth aspect, the present application provides a computer program product for causing a computer to perform the method of dual screen co-display according to any one of the first aspect when the computer program product is run on the computer.

Drawings

Fig. 1 is a schematic view of an electronic device folded outward according to an embodiment of the present application;

fig. 2 is a schematic view of an inward-turned electronic device provided in an embodiment of the present application;

fig. 3 is an application scenario of a foldable electronic device according to an embodiment of the present application for implementing dual-screen simultaneous display;

fig. 4 is another application scenario of a foldable electronic device according to an embodiment of the present application for implementing dual-screen simultaneous display;

fig. 5 is a hardware structure diagram of an electronic device according to an embodiment of the present disclosure;

FIG. 6 is a diagram of a software architecture of an electronic device according to an embodiment of the present application;

FIGS. 7 to 9 are schematic diagrams of a GUI of a dual-screen simultaneous display method according to an embodiment of the present application;

fig. 10 to fig. 14 are application scenarios of a foldable electronic device to implement dual-screen simultaneous display according to an embodiment of the present application;

15-18 are another schematic diagrams of a GUI of a dual-screen simultaneous display method according to an embodiment of the present application;

FIGS. 19-22 are further schematic diagrams of a GUI illustrating a dual-screen co-display method according to an embodiment of the present application;

FIG. 23 is a signaling diagram of a dual-screen co-display provided in an embodiment of the present application;

fig. 24 is another signaling diagram of a method for dual-screen simultaneous display according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. The terminology used in the following examples is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the specification of this application and the appended claims, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, such as "one or more", unless the context clearly indicates otherwise. It should also be understood that in the embodiments of the present application, "one or more" means one, two, or more than two; "and/or" describes the association relationship of the associated objects, indicating that three relationships may exist; for example, a and/or B, may represent: a alone, both A and B, and B alone, where A, B may be singular or plural. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.

Reference throughout this specification to "one embodiment" or "some embodiments," or the like, means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," or the like, in various places throughout this specification are not necessarily all referring to the same embodiment, but rather "one or more but not all embodiments" unless specifically stated otherwise. The terms "comprising," "including," "having," and variations thereof mean "including, but not limited to," unless expressly specified otherwise.

The embodiments of the present application relate to a plurality of numbers greater than or equal to two. It should be noted that, in the description of the embodiments of the present application, the terms "first", "second", and the like are used for distinguishing the description, and are not to be construed as indicating or implying relative importance or order.

The foldable electronic device can be an electronic device folded outwards and an electronic device folded inwards according to the folding direction.

Fig. 1 shows an electronic device folded outwards. The electronic device shown in fig. 1 (a) is in an unfolded state, and data is displayed by a large display screen 100. The electronic apparatus is folded along the folding side in the folding direction shown in fig. 1 (a) to form a stand state, and the large display screen 100 forms the first screen 101 and the second screen 102 shown in fig. 1 (b). The electronic device continues to be folded in the folding direction, and may form a completely folded electronic device (i.e., a folded state) as shown in fig. 1 (c), where the first screen 101 and the second screen 102 are opposite to each other after the electronic device is completely folded.

Fig. 2 shows an electronic device folded inwards. The electronic device shown in fig. 2 (a) is in an unfolded state, and data is displayed by a large display screen 200. The electronic device may be folded in a folding direction shown in fig. 2 (a) to form a stand state, the display screen forms a first screen 201 and a second screen 202 shown in fig. 2 (b), the electronic device continues to be folded in the folding direction, and a form of the electronic device completely folded (i.e., a folded state) shown in fig. 2 (c) may be formed, the first screen 201 and the second screen 202 are opposite to each other when the electronic device is completely folded, and the first screen 201 and the second screen 202 are invisible to a user and generally do not display data any more. In addition, as shown in fig. 2 (c), the inward-folded electronic device may further include an additional third screen 210, where the third screen 210 is disposed at a back of the first screen or the second screen.

It is understood that, in general, for an electronic device that is turned outward, when the electronic device is in a folded state, data can be displayed on the first screen 101 or the second screen 102; when the electronic device is in the unfolded state, data can be displayed on the large display screen 100; when the electronic device is in the stand state, data may be displayed on the first screen 101, the second screen 102, or the large display screen 100. For an electronic device that is turned inside out, the third screen 210 is visible to the user when the electronic device is in the folded state, and data may be displayed on the third screen 210, and data may be displayed on the first screen 201 and the second screen 202 when the electronic device is in the unfolded state. When the electronic device is in the stand state, data may be displayed on the third screen 210 or the large display screen 200.

However, in some application scenarios of the foldable electronic device, multiple display screens of the foldable electronic device may simultaneously display data. For example, in the electronic device turned outwards, the first screen, the second screen and the third screen can simultaneously display data, and double-screen simultaneous display is realized (the first screen and the second screen are used as one display screen and can be called as a large display screen, and the third screen is used as another display screen). Under the normal condition, the electronic equipment which is folded outwards is in an unfolding state or a support state, and the first screen, the second screen and the third screen are visible for a user, so that the fact that the foldable electronic equipment is in the unfolding state or the support state and performs double-screen co-display is more practical.

The following embodiments will be described in detail by taking an electronic device folded inward as an example.

Fig. 3 shows an application scenario of the foldable electronic device for implementing dual-screen simultaneous display. In fig. 3, the foldable electronic device is a foldable mobile phone that is turned inward, the foldable mobile phone is in an unfolded state, and the camera is called to operate in a photographing mode. The user A holds the folding mobile phone to take a picture of the user B, the large display screen 200 of the folding mobile phone displays a preview interface when the camera takes the picture, and meanwhile, the third screen 210 of the folding mobile phone also synchronously displays the preview interface when the camera takes the picture. The image displayed on the third screen 210 is a horizontally mirrored image of the image displayed on the large screen 200. Based on this, the user a can refer to an image to be photographed by the camera of the mobile phone through the large display screen 200, and the user B can refer to the horizontal mirror image through the third screen 210. In fig. 3, the preview interface displayed on the third screen 210 when the camera takes an image is not displayed as a control of the preview interface displayed on the large display 200. Of course, the preview interface displayed on the third screen 210 when the camera takes an image may also display one or more controls, like the preview interface displayed on the large display 200, without limitation.

Fig. 4 shows another application scenario of the foldable electronic device to implement dual-screen simultaneous display. In fig. 4, the foldable electronic device is also a foldable mobile phone that is folded inwards, the foldable mobile phone is also in an unfolded state, and the camera is called to operate in a photographing mode. The user a holds the folding mobile phone to shoot the image, the large display screen 200 of the folding mobile phone displays a preview interface when the camera shoots the image, and meanwhile, the third screen 210 of the folding mobile phone also synchronously displays the preview interface when the camera shoots the image. The image displayed on the third screen 110 is an image that is rotated 180 ° clockwise for the image displayed on the large screen 200. Based on this, the user a can refer to the image photographed by the camera of the mobile phone through the large display screen 200, and the user B can refer to the image displayed by the third screen 210 after being rotated clockwise by 180 °. In fig. 4, as in the application scenario, the preview interface displayed on the third screen 210 when the camera takes an image is not displayed as a control of the preview interface displayed on the large display screen 200. Of course, the preview interface displayed on the third screen 210 when the camera takes an image may also display one or more controls, like the preview interface displayed on the large display 200, without limitation.

Two application scenarios can be seen from the two application scenarios illustrated in fig. 3 and 4: when the foldable electronic equipment is in a photographing mode, double-screen simultaneous display can be realized. And, the foldable electronic device in the photographing mode means: the foldable electronic equipment controls the camera to operate so as to shoot images, and the foldable electronic equipment realizes double-screen simultaneous display, namely: a plurality of display screens of folding electronic equipment show data simultaneously, to the electronic equipment who turns over inwards, specifically can be folding electronic equipment's big display screen display data, and the third screen also shows data. In general, the data displayed on the third screen of the foldable electronic device may be processed data displayed on a large display screen of the foldable electronic device, and the processing operation may include: and carrying out mirror image processing on the image, such as horizontal mirror image or vertical mirror image, and rotating the image by a certain angle, such as 45 degrees, 90 degrees, 180 degrees and the like. Of course, the data displayed on the third screen of the foldable electronic device may be identical to the data displayed on the large display screen.

Of course, for the electronic device turned outwards, the double-screen simultaneous display can be realized in the shooting mode. Specifically, the electronic device may be in a folded state, and the two folded display screens of the electronic device display data at the same time. Of course, the data displayed on the two display screens folded out by the electronic device folded out can be the same or different. One of the two folded display screens displays an image shot by the camera, and the other display screen displays an image after the image shot by the camera is processed, and the processing operation may also include: and (3) carrying out mirror image processing on the image, such as horizontal mirror image or vertical mirror image, and rotating the image by a certain angle, such as 45 degrees, 90 degrees, 180 degrees and the like.

It should be noted that the foldable electronic device is not limited to the dual-screen simultaneous display only in the photographing mode, and may also be configured to the dual-screen simultaneous display when a camera is called to record a video. And the double-screen simultaneous display can be realized when other applications are operated. The following embodiments of the present application are described by taking an example of implementing dual-screen simultaneous display in a shooting mode.

The foldable electronic device proposed in the foregoing may be understood as an electronic device having a foldable flexible screen, and is not limited to the foldable mobile phone shown in fig. 3 and 4. The foldable electronic device may also be a tablet Computer, desktop, laptop, notebook, Ultra-mobile Personal Computer (UMPC), handheld Computer, netbook, Personal Digital Assistant (PDA), wearable electronic device, smart watch, and the like.

Taking a foldable mobile phone as an example, fig. 5 is a composition example of a foldable electronic device provided in an embodiment of the present application. The foldable electronic device 400 may include a processor 410, an internal memory 420, a camera 430, buttons 440, an antenna 1, an antenna 2, a mobile communication module 450, a wireless communication module 460, an audio module 470, a sensor module 480, a display 490, and the like.

It is to be understood that the illustrated structure of the present embodiment does not constitute a specific limitation to the foldable electronic device. In other embodiments, the foldable electronic device may include more or fewer components than shown, or some components may be combined, some components may be separated, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Processor 410 may include one or more processing units, such as: the processor 410 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), among others. The different processing units may be separate devices or may be integrated into one or more processors.

Internal memory 420 may be used to store computer-executable program code, which includes instructions. Processor 410 executes instructions stored in internal memory 420 to perform various functional applications and data processing of foldable electronic device 400. The internal memory 420 may include a program storage area and a data storage area. The storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like. The data storage area can store data (such as audio data, phone book and the like) created in the using process of the electronic device. In addition, the internal memory 420 may include a high-speed random access memory, and may further include a nonvolatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (UFS), and the like. The processor 410 executes various functional applications and data processing of the foldable electronic device by executing instructions stored in the internal memory 420 and/or instructions stored in a memory provided in the processor.

In some embodiments, the internal memory 420 stores instructions for implementing a dual-screen co-display for the foldable electronic device. The processor 410 may control the foldable electronic device to perform dual-screen co-display by executing instructions stored in the internal memory 420.

The foldable electronic device 400 may implement a shooting function through the ISP, the camera 430, the video codec, the GPU, the display screen 490, the application processor, and the like.

The ISP is used to process the data fed back by the camera 430. For example, when a photo is taken, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converting into an image visible to naked eyes. The ISP can also carry out algorithm optimization on the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in camera 430.

The camera 430 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image to the photosensitive element. The photosensitive element may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The light sensing element converts the optical signal into an electrical signal, which is then passed to the ISP where it is converted into a digital image signal. And the ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into image signal in standard RGB, YUV and other formats. In some embodiments, the foldable electronic device 400 may include 1 or N cameras 430, N being a positive integer greater than 1.

In some embodiments, the camera 430 is used to capture images as mentioned in embodiments of the present application.

The digital signal processor is used for processing digital signals, and can process digital image signals and other digital signals. For example, when the foldable electronic device 400 is in frequency bin selection, the digital signal processor is used to perform fourier transform or the like on the frequency bin energy.

Video codecs are used to compress or decompress digital video. The foldable electronic device 400 may support one or more video codecs. As such, foldable electronic device 400 may play or record video in a variety of encoding formats, such as: moving Picture Experts Group (MPEG) 4, MPEG2, MPEG3, MPEG4, and the like.

The keys 440 include a power on key, a volume key, and the like. The keys 440 may be mechanical keys or touch keys. The foldable electronic device may receive key inputs, generating key signal inputs related to user settings and function controls of the foldable electronic device.

The wireless communication function of the foldable electronic device 400 can be realized by the antenna 1, the antenna 2, the mobile communication module 450, the wireless communication module 460, the modem processor, the baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals.

The mobile communication module 450 may provide a solution including 2G/3G/4G/5G wireless communication applied on the electronic device 400. The mobile communication module 450 may include at least one filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like. The mobile communication module 450 may receive the electromagnetic wave from the antenna 1, and filter, amplify, etc. the received electromagnetic wave, and transmit the electromagnetic wave to the modem processor for demodulation. The mobile communication module 450 can also amplify the signal modulated by the modem processor, and convert the signal into electromagnetic wave through the antenna 1 to radiate the electromagnetic wave.

The wireless communication module 460 may provide a solution for wireless communication applied to the electronic device 400, including Wireless Local Area Networks (WLANs) (e.g., wireless fidelity (Wi-Fi) networks), bluetooth (bluetooth, BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR), and the like. The wireless communication module 460 may be one or more devices integrating at least one communication processing module. The wireless communication module 460 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on electromagnetic wave signals, and transmits the processed signals to the processor 410. The wireless communication module 460 may also receive a signal to be transmitted from the processor 410, perform frequency modulation and amplification on the signal, and convert the signal into electromagnetic waves through the antenna 2 to radiate the electromagnetic waves.

The foldable electronic device 400 may implement audio functions through the audio module 470, the speaker 470A, the microphone 470C, and the application processor. Such as music playing, recording, etc.

The audio module 470 is used to convert digital audio information into analog audio signal output and also used to convert analog audio input into digital audio signal. The audio module 470 may also be used to encode and decode audio signals. In some embodiments, the audio module 470 may be disposed in the processor 410, or some functional modules of the audio module 470 may be disposed in the processor 410.

The speaker 470A, also called a "horn", is used to convert the audio electrical signals into sound signals. The foldable electronic device 400 can listen to music through the speaker 470A or listen to a hands-free conversation.

The receiver 470B, also called "earpiece", is used to convert the electrical audio signal into an acoustic signal. When the electronic device receives a call or voice information, it can receive voice by placing the receiver 470B close to the ear.

The microphone 470C, also referred to as a "microphone," is used to convert sound signals into electrical signals. When making a call or transmitting voice information, the user can input a voice signal into the microphone 470C by speaking the user's mouth near the microphone 470C.

The earphone interface 470D is used to connect a wired earphone. The headset interface 470D may be a USB interface, or may be a 3.5mm open mobile electronic device platform (OMTP) standard interface, a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

In the sensor module 480, the pressure sensor 480A is used for sensing a pressure signal, and converting the pressure signal into an electrical signal. In some embodiments, the pressure sensor 480A may be disposed on the display screen 490. The pressure sensor 480A may be of a variety of types, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, and the like. The capacitive pressure sensor may be a sensor comprising at least two parallel plates having an electrically conductive material. When a force acts on the pressure sensor 480A, the capacitance between the electrodes changes. The electronics determine the strength of the pressure from the change in capacitance. When a touch operation is applied to the display screen 490, the electronic apparatus detects the intensity of the touch operation based on the pressure sensor 480A. The electronic device may also calculate the position of the touch from the detection signal of the pressure sensor 480A. In some embodiments, the touch operations that are applied to the same touch position but different touch operation intensities may correspond to different operation instructions. For example: and when the touch operation with the touch operation intensity smaller than the first pressure threshold value acts on the short message application icon, executing an instruction for viewing the short message. And when the touch operation with the touch operation intensity larger than or equal to the first pressure threshold value acts on the short message application icon, executing an instruction of newly building the short message.

The touch sensor 480B is also referred to as a "touch device". The touch sensor 480B may be disposed on the display screen 490, and the touch sensor 480B and the display screen 490 form a touch screen, which is also called a "touch screen". The touch sensor 480B is used to detect a touch operation applied thereto or therearound. The touch sensor can communicate the detected touch operation to the application processor to determine the touch event type. Visual output associated with the touch operation may be provided through the display screen 490. In other embodiments, the touch sensor 480B may be disposed on the surface of the electronic device at a different position than the display screen 490.

The foldable electronic device implements the display function through the GPU, the display screen 490, and the application processor, etc. The GPU is a microprocessor for image processing, and is connected to the display screen 490 and an application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 410 may include one or more GPUs that execute program instructions to generate or alter display information.

The display screen 490 is used to display images, video, etc. The display screen 490 includes a display panel. The display panel may be a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a miniature, a Micro-OLED, a quantum dot light-emitting diode (QLED), or the like.

In some embodiments, the foldable electronic device may include 2 display screens 490, one large display screen as set forth above, and one third screen as set forth above, wherein the large display screen should also be a foldable flexible screen.

In addition, on top of the above components, the foldable electronic device runs an operating system. Such as an iOS operating system, an Android operating system, a Windows operating system, etc. A running application may be installed on the operating system.

Fig. 6 is a block diagram of a software structure of a foldable electronic device according to an embodiment of the present application.

The layered architecture divides the software into several layers, each layer having a clear role and division of labor. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, an application layer, an application framework layer, an Android runtime (Android runtime) and system library, and a kernel layer from top to bottom.

The application layer may include a series of application packages. As shown in fig. 6, the application packages may include camera, calendar, map, gallery, telephony, navigation, etc. applications. In some embodiments, a camera is used to capture the image.

The application framework layer provides an Application Programming Interface (API) and a programming framework for the application program of the application layer. The application framework layer includes a number of predefined functions. As shown in FIG. 6, the application framework layer may include a window manager, a content provider, a phone manager, a resource manager, a notification manager, a view system, a Surface Flinger API, and the like.

The window manager is used for managing window programs. The window manager can obtain the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like.

Content providers are used to store and retrieve data and make it accessible to applications. The data may include video, images, audio, calls made and answered, browsing history and bookmarks, phone books, etc.

The telephone manager is used for providing a communication function of the electronic equipment. Such as management of call status (including on, off, etc.).

The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and the like.

The notification manager enables the application to display notification information in the status bar, can be used to convey notification-type messages, can disappear automatically after a short dwell, and does not require user interaction. Such as a notification manager used to inform download completion, message alerts, etc. The notification manager may also be a notification that appears in the form of a chart or scroll bar text at the top status bar of the system, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, prompting text information in the status bar, sounding a prompt tone, vibrating the electronic device, flashing an indicator light, etc.

The view system includes visual controls such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, the display interface including the short message notification icon may include a view for displaying text and a view for displaying pictures.

The Surface flunger API is an interface of an image synthesizer (Surface flunger). An application of the application layer, such as a camera, can call the Surface flunger through the Surface flunger API and control the Surface flunger to run.

The Android Runtime comprises a core library and a virtual machine. The Android runtime is responsible for scheduling and managing an Android system. In some embodiments of the application, the application cold start may run in the Android runtime, and the Android runtime thus obtains the optimized file state parameter of the application, and then the Android runtime may determine whether the optimized file is outdated due to system upgrade through the optimized file state parameter, and return the determination result to the application management and control module.

The core library comprises two parts: one part is a function which needs to be called by java language, and the other part is a core library of android.

The application layer and the application framework layer run in a virtual machine. The virtual machine executes java files of the application layer and the application framework layer as binary files. The virtual machine is used for performing the functions of object life cycle management, stack management, thread management, safety and exception management, garbage collection and the like.

The system library may include a plurality of functional modules. For example: surface manager, three-dimensional graphics processing library (e.g., OpenGL ES), two-dimensional graphics engine (e.g., SGL), media library, and Surface Flinger, among others.

The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like.

The two-dimensional graphics engine is a drawing engine for 2D drawing.

The Surface flag is used for generating a layer of an application interface when the Surface flag is called by the application, and is also used for managing a flag bit of the layer.

The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, a sensor driver, an audio driver and the like. In some embodiments, the display driver is configured to control the display screen to display an image; the camera drive is used for controlling the camera to operate. The sensor driver is used to control the operation of a plurality of sensors, such as pressure sensors and touch sensors.

The hardware layer may comprise the foldable electronic device hardware components set forth above. Illustratively, fig. 6 shows three hardware components, a main screen, a secondary screen and a camera. It should be noted that the main screen and the sub-screen both belong to a display screen of a foldable electronic device. According to the configuration requirements of the foldable electronic device, the display screen of the foldable electronic device is divided into a main screen and an auxiliary screen.

Although the Android system is taken as an example in the embodiment of the present application for description, the basic principle is also applicable to electronic devices based on operating systems such as iOS and Windows.

For convenience of understanding, the following embodiments of the present application will specifically describe a dual-screen simultaneous display method provided by the embodiments of the present application by taking a foldable electronic device with a structure shown in fig. 5 as an example, with reference to an application scenario shown in fig. 3.

The method for displaying the two screens simultaneously is described in detail by taking foldable electronic equipment as an inwards folded mobile phone, installing a camera application in the folded mobile phone and taking an image by the camera application as an example.

In some embodiments of the present application, a user may manually turn on or off the "dual-screen simultaneous display" function provided by embodiments of the present application. The entry of the dual-screen simultaneous display function is described below with reference to fig. 7 to 13.

Fig. 7 and fig. 8 are schematic diagrams of a Graphical User Interface (GUI) of a dual-screen simultaneous display method according to an embodiment of the present application.

For example, the user may instruct the folding mobile phone to open the camera application by touching a specific control on the screen of the folding mobile phone, pressing a specific physical key or key combination, inputting voice, or a blank gesture. And after receiving an instruction of opening the camera by the user, folding the mobile phone to start the camera, and displaying a shooting interface shown in fig. 7 or fig. 8.

The shooting interface shown in fig. 7 and 8 includes a control 601 for setting shooting, a control 602 for turning on or off a flash, a control 603 for turning on or off a dual-screen simultaneous display, a control 604 for switching between front and rear cameras, a control 605 for controlling shooting, a control 606 for displaying an image shot at the previous time, and the like.

Wherein, the control 601 of the photographing setting can be used for setting the photographing parameters and the photographing function, for example, setting the photo scale, setting the gesture photographing, setting the smiling face snapshot, setting the video resolution, and the like.

The control 602 for turning on or off the flash is used for controlling whether the flash is started or not when the camera shoots.

The control 603 for turning on or off the dual-screen simultaneous display is used for realizing whether the image shot by the camera is displayed in the dual-screen mode. The user can open or close the dual-screen simultaneous display control 603 by touch control to realize opening the dual-screen simultaneous display function and closing the dual-screen simultaneous display function. Fig. 7 shows a diagram of the control 603 for turning on or off the dual-screen simultaneous display after turning on the dual-screen simultaneous display function, and fig. 8 shows a diagram of the control 603 for turning on or off the dual-screen simultaneous display after turning off the dual-screen simultaneous display function.

The control 604 for switching the front and rear cameras is used to implement switching operation of multiple cameras of the foldable electronic device. Generally, the foldable electronic device includes a camera (for short, a front camera) on the same side as the display screen and a camera (for short, a rear camera) on a housing of the foldable electronic device, and a user can switch the front camera and the rear camera of the foldable electronic device by touching a control 604 of the front camera and the rear camera.

A control 605 that controls shooting is a control that starts shooting. In a photographing mode of the foldable electronic device, a user touches the control 605 for controlling photographing once, and the camera can photograph a frame of image. Of course, the camera may capture multiple frames of images, and only one frame of image is selected for drawing. In the video mode of the foldable electronic device, the user touches the control 605 for controlling the shooting, and the camera starts to record video.

And a control 606 for displaying the image shot last time, which is used for controlling to display the image shot last time by the camera or the first frame image of the video. The control is typically associated with a gallery application, and a user may display an image or video previously captured by a camera stored by the gallery application via a display screen by touching the control 606 that displays the previously captured image. Wherein, the image or video that the camera shot last time means: the camera shoots images or videos which are shot before the shooting and have the shooting time closest to the shooting time.

It should be further noted that the shooting interfaces shown in fig. 7 and 8 further include a switching list of multiple modes of the camera, and a user can slide the switching list up and down to switch the multiple modes of the camera. The switching list shown in fig. 7 and 8 includes video, shooting, portrait and more, other modes not shown in fig. 7 and 8 belong to hidden display, and a user can display the mode in the hidden display by moving the switching list up and down.

In some embodiments, the dual-screen simultaneous display function implemented by the folding mobile phone is set to be that one display screen displays an image shot by the camera, and the other display screen displays an image shot by the camera after horizontal mirroring processing. Based on this, after the user starts the dual-screen simultaneous display function by triggering the control 603 shown in fig. 7, the large display screen and the third screen of the folding mobile phone respectively display the image shot by the camera and the image after the horizontal mirror image processing. In one example, a large display screen of a folding mobile phone displays an image shot by a camera, and a third screen displays the horizontally mirrored image. Of course, the horizontal mirror image is a processing manner set, and may also be set as a vertical mirror image, rotated by a certain angle in one direction, or the like.

In other embodiments, the dual-screen simultaneous display function implemented by the folding mobile phone may also be: in response to a user operation, one display screen displays an image captured by the camera, and the other display screen displays a processed image specified by the user operation. For example, referring to fig. 9 (a), a user clicks a control 603 in a shooting interface of a folding mobile phone, and the shooting interface of the folding mobile phone shows a double-screen co-display sub-menu, which may include four display modes, i.e., synchronous display, horizontal mirror image, vertical mirror image, and rotation angle, as shown in fig. 9 (b).

Wherein: the synchronous display means that: the two display screens of the folding mobile phone display the same image, namely, the large display screen and the third screen of the folding mobile phone both display the image shot by the camera. In the application scenario shown in fig. 3, the interface displayed by the large display screen and the third screen of the folding mobile phone synchronously may be as shown in fig. 10. Fig. 10 shows an example in which the large display screen 200 of the folding mobile phone displays a camera preview interface of the camera, the user a can view images in the camera preview interface through the large display screen, and the third screen 210 also synchronously displays images in the camera preview interface. In fig. 10, the camera preview interface displayed on the third screen 210 does not display the control of the camera preview interface displayed on the large display screen 200. Of course, the camera preview interface displayed on the third screen 210 may also display one or more controls, as with the camera preview interface displayed on the large display screen 200, without limitation.

Horizontal mirroring means: one display screen of the folding mobile phone displays an image shot by the camera, and the other display screen displays an image shot by the camera after horizontal mirror image processing. For example, the interface where the large display screen and the third screen of the folding mobile phone are displayed in a horizontal mirror image manner in a dual-screen simultaneous display manner may be an application scenario as shown in fig. 3.

Vertical mirror image means: one display screen of the folding mobile phone displays an image shot by the camera, and the other display screen displays an image shot by the camera after vertical mirror image processing. In the application scenario shown in fig. 3, an example of an interface in which the large display screen and the third screen of the folding mobile phone are displayed in a manner of vertical mirror image display and the two screens are displayed simultaneously may be shown in fig. 11. In the example shown in fig. 11, the large display screen 200 of the folding mobile phone displays a camera preview interface of the camera, and the user a can view images in the camera preview interface through the large display screen. Also, the third screen 210 displays a camera preview interface, and an image of the camera preview interface is a vertical mirror image of the image displayed in the large display screen 200. In fig. 11, the camera preview interface displayed on the third screen 210 is not displayed as a control of the camera preview interface displayed on the large display screen 200. Of course, the camera preview interface displayed on the third screen 210 may also display one or more controls, as with the camera preview interface displayed on the large display screen 200, without limitation.

The rotation angle is as follows: the image shot by the camera of one display screen of the folding mobile phone and the image shot by the camera of the other display screen are processed by rotating for a certain angle along one direction. Illustratively, as shown in fig. 9 (b), the user may slide the circular control between 0 ° and 360 ° by sliding the circular control left and right to select an angle at which the image captured by the camera is to be rotated clockwise. In addition, the angular range of 0 ° to 360 ° shown in fig. 9 (b) may be divided into a plurality of segments, each corresponding to one rotation angle. For example: the angular range of 0 ° to 360 ° is split into: four nodes of 0 °, 90 °, 180 ° and 270 °. And the user slides the circular control to a node left and right, so that the angle of clockwise rotation of the image shot by the camera is selected as the angle corresponding to the node.

In the application scenario shown in fig. 3, an interface where the large display screen and the third screen of the folding mobile phone perform dual-screen simultaneous display in a clockwise rotation manner by 90 ° may be as shown in fig. 12. In the example shown in fig. 12, the large display screen 200 of the folding mobile phone displays a camera preview interface of the camera, the user a can view images in the camera preview interface through the large display screen, and the third screen 210 also synchronously displays images in the camera preview interface. The image displayed on the third screen 210 is the image in the camera preview interface displayed on the large display screen 200, and is selected 90 ° clockwise.

In the application scenario shown in fig. 3, an interface where the large display screen and the third screen of the folding mobile phone perform dual-screen simultaneous display in a clockwise rotation 180 ° display manner may be as shown in fig. 13. Fig. 13 shows an example in which the large display 200 of the folding mobile phone displays a camera preview interface of the camera, the user a can view images in the camera preview interface through the large display, and the third screen 210 also synchronously displays images in the camera preview interface. The image displayed on the third screen 210 is the image in the camera preview interface displayed on the large display screen 200, and is selected 180 ° clockwise.

In the application scenario shown in fig. 3, an interface where the large display screen and the third screen of the folding mobile phone perform dual-screen simultaneous display in a clockwise rotation 270 ° display manner may be as shown in fig. 14. In the example shown in fig. 14, the large display screen 200 of the folding mobile phone displays a camera preview interface of the camera, the user a can view images in the camera preview interface through the large display screen, and the third screen 210 also synchronously displays images in the camera preview interface. The image displayed on the third screen 210 is the image in the camera preview interface displayed on the large display screen 200, and is 270 ° selected clockwise.

It should be further noted that, in fig. 12 to 14, the camera preview interface displayed on the third screen 210 does not display the control of the camera preview interface displayed on the large display screen 200. Of course, the camera preview interface displayed on the third screen 210 may also display one or more controls, as with the camera preview interface displayed on the large display screen 200, without limitation.

Fig. 15 and 16 are schematic diagrams of GUIs of another dual-screen simultaneous display method provided by an embodiment of the present application.

As shown in fig. 15 (a), the user clicks a control 601 for the photographing setting on the photographing interface of the folding mobile phone, and the display screen of the folding mobile phone displays the setting interface, which may be shown in fig. 15 (b), for example. In fig. 15 (b), the setting interface includes a photographed setting item, a video setting item, and a general setting item, the photographed setting item may include a photo ratio and a smiling face snapshot, the video setting item may include a video resolution, and the general setting item includes a dual-screen simultaneous display. The user can open or close the double-screen simultaneous display function by touching the opening and closing control of the double-screen simultaneous display.

In some embodiments, after the opening and closing control of the dual-screen simultaneous display shown in fig. 15 (b) is touched by a user to open the dual-screen simultaneous display function, one display screen of the folding mobile phone displays an image captured by the camera, and the other display screen displays an image captured by the camera after horizontal mirroring processing. In one example, a large display screen of a folding mobile phone displays an image shot by a camera, and a third screen displays the horizontally mirrored image. Of course, the horizontal mirror image can be modified into a vertical mirror image, rotated by a certain angle, and the like.

In other embodiments, the user can adjust the image displayed by the folding mobile phone when the user performs double-screen simultaneous display through input operation on the setting interface of the folding mobile phone. For example, the setting interface of the folding mobile phone may be as shown in fig. 16 (a), the submenu is carried by the setting item displayed on the same time in the double screens, the user clicks the control displayed on the same time in the double screens as shown in fig. 16 (a), and the submenu carried by the setting item displayed on the same time in the double screens is displayed on the setting interface. As shown in fig. 16 (b), the sub-menu carried by the setting item displayed on the same screen can include four display modes, i.e., synchronous display, horizontal mirror image, vertical mirror image, and rotation angle. The detailed descriptions of the four display modes of synchronous display, horizontal mirror image, vertical mirror image and rotation angle can be referred to the foregoing, and the description is not expanded here.

Fig. 17 and 18 are schematic diagrams of GUIs of another dual-screen simultaneous display method provided in an embodiment of the present application.

As shown in fig. 17 (a), the user clicks "more" on the shooting interface of the folding mobile phone, and the display screen of the folding mobile phone displays a multi-mode display interface of the camera included in the "more". For example, the presentation interface of multiple modes of "more" included cameras may be as shown in fig. 17 (b). In fig. 17 (b), the display interface includes three modes, i.e., a dual-screen simultaneous display mode, a panoramic mode, and a delayed camera mode. The user can open or close the double-screen simultaneous display function by touching the double-screen simultaneous display control.

In some embodiments, after the dual-screen simultaneous display control shown in fig. 17 (b) is touched by a user to start the dual-screen simultaneous display function, one display screen of the folding mobile phone displays an image captured by the camera, and the other display screen displays an image obtained by performing horizontal mirroring on the image captured by the camera. In one example, a large display screen of a folding mobile phone displays an image shot by a camera, and a third screen displays the horizontally mirrored image. Of course, the horizontal mirror image can be modified into a vertical mirror image, rotated by a certain angle, and the like.

In other embodiments, the dual-screen simultaneous display control may also be a portable submenu, and the user may display the portable submenu by triggering the dual-screen simultaneous display control. Illustratively, the user clicks the dual-screen simultaneous display control as shown in fig. 18 (a), and displays a sub-menu carried by the dual-screen simultaneous display control on the display interface. For example, the sub-menu carried by the control with dual-screen simultaneous display as shown in (b) in fig. 18 may include four display modes, i.e., synchronous display, horizontal mirror image, vertical mirror image, and rotation angle. The detailed descriptions of the four display modes of synchronous display, horizontal mirror image, vertical mirror image and rotation angle can be referred to the foregoing, and the descriptions are not expanded here.

The method for triggering the folding mobile phone to start the function of dual-screen simultaneous display is introduced above, but the application is not limited to starting the dual-screen simultaneous display in the camera. There are other ways that the user may turn on the "dual screen simultaneous display" function.

In some embodiments of the present application, the "dual-screen simultaneous display" function may also be configured as a system-level setting, and the setting of the folding mobile phone at the system level configures a control of the "dual-screen simultaneous display", and may further configure an application corresponding to the "dual-screen simultaneous display" function. The user can realize the function of starting the double-screen simultaneous display by clicking the control. Of course, the control of the "dual-screen simultaneous display" may also be configured with a sub-menu, and the sub-menu may include four display modes, i.e., synchronous display, horizontal mirror image, vertical mirror image, and rotation angle. The detailed descriptions of the four display modes of synchronous display, horizontal mirror image, vertical mirror image and rotation angle can be referred to the foregoing, and the description is not expanded here.

It should be noted that the "dual-screen simultaneous display" function is configured as a system level setting. After the folding mobile phone clicks the control of the double-screen simultaneous display to realize the function of opening the double-screen simultaneous display, the folding mobile phone can realize the double-screen simultaneous display when a plurality of applications are started.

After the double-screen simultaneous display is started, a user can control the folding mobile phone to start to shoot images, the folding mobile phone responds to the operation of the user, and the large display screen and the third screen of the folding mobile phone are used for displaying the camera preview interface and the shot images simultaneously.

Illustratively, fig. 19-22 are schematic diagrams of another GUI of a folding handset when implementing a dual-screen co-display. In this example, the dual-screen co-display of the folding mobile phone is started, the default large display screen displays normal data, and the third screen displays data after horizontal mirroring processing.

Referring to fig. 19, a user looking at the folding phone from the front of the folding phone sees the large display 200 of the folding phone. After the function of the dual-screen simultaneous display of the foldable mobile phone is started and the foldable mobile phone enters the photographing mode, the large display screen 200 displays a camera browsing interface. Meanwhile, because the dual-screen simultaneous display function is started, another user can look up the folding mobile phone from the reverse side of the folding mobile phone, and the user looks up the third screen 210 of the folding mobile phone from the reverse side. The third screen 210 synchronously displays a camera preview interface, and an image in the preview interface belongs to an image after horizontal mirroring processing.

The user can operate on the camera browsing interface displayed on the large display screen 200 of the folding mobile phone to control the folding mobile phone to shoot images. As shown in fig. 20, the user clicks a control 605 on the camera browsing interface displayed on the large display screen 200, and the folding phone captures and saves one frame of image in response to the user's clicking operation. Generally, the folder phone can store one frame of image in the gallery application, and after the folder phone is stored, the control 606 of the large display 200 of the folder phone can display a thumbnail of the one frame of image captured by the folder phone.

After the folded mobile phone stores the image, the user refers to the image. In some embodiments, the user may control the folding handset to present the saved image by clicking on control 606 shown in FIG. 20. In other embodiments, the user may also refer to the images saved by the folding phone through the gallery application.

It should be noted that the gallery application of the folding mobile phone can also be configured with the dual-screen simultaneous display function. When the folding mobile phone displays the interface of the gallery application in the double-screen simultaneous display mode, the display contents of the two display screens of the folding mobile phone can be the same or different. In one example, when the folding mobile phone displays the browsing interface of the image through the gallery application, the image displayed on the browsing interface of one display screen is a normally displayed image, and the image displayed on the browsing interface of the other display screen is a horizontal mirror image. Of course, the dual-screen simultaneous display function configured for the gallery application of the folding mobile phone can be realized by setting a control in the gallery application, or by configuring the dual-screen simultaneous display function as a system-level setting.

Referring to fig. 21, fig. 21 shows a front view and a back view of a folding handset, respectively. In fig. 21, (a) shows a front view of a folder phone in which a large display 200 of the folder phone shows an interface of photo tabs of a gallery application, which displays thumbnails of images 301 taken by a user with the folder phone, and thumbnails of images 1 to 5.

Fig. 21 (b) and (c) show the reverse side views of two folding cellular phones, respectively. In the reverse side view of the foldable phone shown in fig. 21 (b), the foldable phone configures a dual-screen simultaneous display function in the gallery application, and the third screen 210 of the foldable phone synchronously shows the interface of the photo tab. The interface of the photo tab displayed on the third screen 210 of the folding mobile phone is the same as the interface of the photo tab displayed on the large display 200 of the folding mobile phone. In the reverse view of the foldable phone shown in fig. 21 (c), the foldable phone is not configured with the dual-screen simultaneous display function in the gallery application, and the third screen 210 of the foldable phone is in a black screen state and does not display data.

On the interface of the photo tab of the folding phone shown in fig. 21 (a), the user clicks on a thumbnail of the image 301. In response to the click operation of the user, the folding phone displays a browsing page of the image 301 on the large display screen 200, and displays a browsing page of the image 302 on the third screen 210, as shown in fig. 22, where the image 302 is a horizontal mirror interface of the image 301.

A method for implementing dual-screen simultaneous display of foldable electronic devices such as a foldable mobile phone will be described with reference to fig. 23 and 24. The foldable electronic equipment executes the double-screen simultaneous display method, and can synchronously display images or videos shot by the cameras on a plurality of display screens of the foldable electronic equipment.

The following description will take the example of synchronous image display on multiple display screens of a folding mobile phone. And before the folded mobile phone captures an image by using the camera, a display screen of the folded mobile phone presents a camera preview interface. The camera preview interface can be synchronously displayed by a plurality of display screens of the folding mobile phone in a double-screen simultaneous display mode, and an image on the camera preview interface displayed by one display screen of the folding mobile phone belongs to a horizontal mirror image. Fig. 23 shows a signaling diagram of a method for previewing an interface on a dual-screen same-display camera of a folding mobile phone.

Referring to fig. 23, a method for dual-screen simultaneous display provided in an embodiment of the present application includes the following steps:

s2301, the camera application receives a first operation.

The folding mobile phone is in an unfolding state, and a user inputs a first operation to open the camera application. For example, the user may input the first operation by folding a specific control on the screen of the mobile phone, pressing a specific physical key or key combination, inputting voice, and performing a space gesture, and instruct the folding mobile phone to open the camera application. Based on this, the first operation may include a user's touch operation on a specific control on the screen of the foldable mobile phone, a pressing operation on a specific physical key or key combination of the foldable mobile phone, a voice input operation, and a specific gesture operation. And after the folded mobile phone responds to the received instruction of the user for opening the camera, the folded mobile phone starts the camera.

S2302, the camera application calls Surface flickers to create a layer of a camera Preview interface (Preview Activity) in response to the first operation.

As with the foregoing software framework, the application framework layer includes the Surface Flinger API. The camera application calls Surface flunger through the Surface flunger API to create a layer of the camera preview interface.

It is understood that the camera preview interface is a presentation interface after the camera application of the folding handset is launched. In some embodiments, the camera application is launched and then defaults to a capture mode, and the camera preview interface is a capture interface. Illustratively, the capture interface shown in fig. 7 is a preview interface.

In some embodiments, the camera application may send a message to the Surface flunger through the Surface flunger API to inform the Surface flunger to create the layer of the camera preview interface.

S2303, the Surface flag creates a layer of the camera preview interface, and a flag bit (flag) of the layer of the camera preview interface is a default value.

And a flag bit (flag) of the layer is used for indicating the display mode of the layer. One application of the folding mobile phone is operated, and the Surface flicker creates a layer of a display interface when the application is operated. And aiming at different display modes of the display interface during the operation of the application, different flag bits can be set on the layer of the display interface.

Illustratively, the flag bit default value of an image layer is 0x0, which represents that the image layer is to be displayed on a single screen; the default value of the flag bit of the layer is 0x1, which represents that the layer can be vertically mirrored; the default value of the flag bit of the layer is 0x2, which represents that the layer can be horizontally mirrored; the default value of the flag bit of the layer is 0x4, which means that the layer will rotate clockwise by 90 °; the default value of the flag bit of the layer is 0x8, which indicates that the layer will rotate 90 ° counterclockwise.

The Surface flag creates layers of the camera preview interface with default values of the flag bit (flag). Typically, the default value is set to 0x0, indicating that the layer is displayed by the home screen.

In some embodiments, the folded handset that is folded out sets the second screen 102 shown in fig. 1 as the primary screen and sets the first screen 101 as the secondary screen. The fold-out cell phone, which is folded out, sets the second screen 102 as the main screen by marking the configuration information display type of the second screen 102 as primary. Of course, the main screen of the fold-out cellular phone may be set as the first screen 101 and the second screen 102 may be set as the sub-screen.

In other embodiments, the folded mobile phone folded inwards sets the first screen 201 and the second screen 202 shown in fig. 2 as the main screens, and sets the third screen 210 as the sub-screen. The fold mobile phone folded inward may set the first screen 201 and the second screen 202 as the main screens by marking the configuration information display type of the first screen 201 and the second screen 202 as primary.

Of course, the main screen of the folding cellular phone may be set as the third screen, and the first screen and the second screen may be set as the sub-screens. The following description will be given taking the first screen and the second screen as the main screen, and the third screen as the sub-screen as an example.

It should be further noted that after the Surface flunger creates a layer of the camera preview interface, the identifier of the layer is returned to the camera application, so that the camera application can manage the layer created by the Surface flunger through the identifier of the layer.

S2304, the Surface flicker sends a first message to the display driver to instruct the display driver to control the main screen to display the camera preview interface.

When the folding mobile phone is in the unfolded state, the first message sent by the Surface flicker to the display driver indicates the display driver to control the layer of the large display screen of the folding mobile phone for displaying the camera preview interface, or may be understood as the layer indicating the display driver to control the main screen of the folding mobile phone for displaying the camera preview interface.

And S2305, displaying a camera preview interface on the driving control main screen.

The display driver may power up the home screen to illuminate the home screen and display a camera preview interface.

S2306, the camera application receives a second operation.

The second operation may be understood as an operation to start the dual-screen simultaneous display. In some examples, the second operation may include a click operation to open or close a dual-screen co-display control.

The user can input a second operation through the mode of starting the double-screen simultaneous display function provided by the content to start the double-screen simultaneous display function. The manner in which the user turns on the dual-screen simultaneous display function is shown in fig. 7 to 18 and the corresponding contents thereof, which will not be further described herein.

In this embodiment, a case where the user inputs the second operation and selects a preview interface displaying the image captured by the camera on one display screen and displays the horizontally mirrored image of the image captured by the camera on the other display screen is taken as an example for explanation.

And S2307, the camera application responds to the second operation and sends a second message to the Surface Flinger to inform the Surface Flinger of powering on the secondary screen.

And S2308, the camera application responds to the second operation, and sends a third message to the Surface Flinger, wherein the third message carries the identifier of the layer of the camera preview interface, and the third message is used for informing the Surface Flinger to display the camera preview interface after horizontal mirroring processing is performed on the secondary screen.

Wherein the camera application sends a third message to the Surface flunger through the Surface flunger API.

S2309, the Surface Flinger modifies the flag bit of the layer of the camera preview interface to be the flag bit corresponding to the horizontal mirror image.

And the Surface flanger receives the third message, screens out the layer of the camera preview interface by using the identifier of the layer of the camera preview interface carried in the third message, and adjusts the flag bit of the layer of the camera preview interface to be the flag bit corresponding to the horizontal mirror image. Illustratively, the flag bit of the layer of the camera preview interface is modified from 0x0 to 0x2 by Surface flunger.

S2310, the Surface Flinger determines a main screen display list and an auxiliary screen display list, the main screen display list comprises layers displayed by the main screen, and the auxiliary screen display list comprises layers displayed by the auxiliary screen.

And traversing the layer constructed by the Surface Flinger, and determining a main screen display list and an auxiliary screen display list by using the flag bit of the layer. As is exemplary. And storing the layer with the flag bit not equal to 0x0 into the secondary screen display list by the Surface flag, and storing the layer with the flag bit equal to 0x0 into the main screen display list by the Surface flag.

It should be further noted that the Surface flunger also needs to construct a rotation matrix for each layer. And aiming at the layer in the secondary screen display list, the Surface flag adjusts the rotation matrix of the layer. Illustratively, for the layer after the horizontal mirroring processing is displayed on the secondary screen, the rotation matrix of the layer is set to be Transform:: FLIP _ H.

And S2311, the Surface flicker sends a fourth message to the display driver to indicate the display driver to control the main screen to display the layer in the main screen display list, and the auxiliary screen to display the layer in the auxiliary screen display list.

The Surface flicker calls a display driver interface to send a fourth message to the display driver, where the fourth message may include two display layer lists and a rotation matrix of each layer in the list.

And S2312, displaying the layer in the driving control main screen display list, and displaying the layer in the auxiliary screen display list by the auxiliary screen.

The display driver powers on the auxiliary screen to light the auxiliary screen and display the layers in the auxiliary screen display list. And moreover, because the flag bit of the layer of the machine preview interface is adjusted to the flag bit corresponding to the horizontal mirror image, the secondary screen of the folding mobile phone can display the camera preview interface, and the image on the camera preview interface is the horizontal mirror image.

And clicking a control for controlling shooting on a camera preview interface by the folding mobile phone to shoot a frame of image. When the user looks up the shot image, the folding mobile phone can also display the image in a double-screen simultaneous display mode. The images shot by the folding mobile phone are stored in the gallery application, and the user can look up the shot images through the gallery application.

In the following embodiment, a gallery application is provided with a control with two screens displaying at the same time, the control can be used for controlling a display screen of a folding mobile phone to introduce images stored in a gallery by taking the example of double screens displaying at the same time, and the control with the double screens displaying at the same time can be configured on a setting interface of the gallery application. In this example, one display (e.g., a large display) of the folding mobile phone displays a browsing interface of the image, and the other display (e.g., a third display) displays a browsing interface of the horizontal mirror image. The image in the browsing interface of the horizontal mirror image is the image of the image stored in the gallery after horizontal mirror image processing, and the contents of characters, components and the like in the browsing interface of the horizontal mirror image are normally displayed. Of course, the other display screen of the folding mobile phone may also display a browsing interface of the image without operation or after other processing operations. Other processing operations may be to not process the text, such as to vertically mirror the image, rotate a certain angle in a fixed direction, and so on.

Fig. 24 shows a signaling diagram of a method for folding a browsing interface of a dual-screen co-display image of a mobile phone. Referring to fig. 24, another embodiment of the present application provides a method for browsing an interface with a dual-screen and a same-display image, including the following steps:

s2401, the camera application receives a third operation, the third operation for controlling capturing an image.

And the folding mobile phone is in an unfolding state, and the user inputs a third operation to control the camera of the folding mobile phone to shoot an image. For example, the third operation may be a touch operation of a specific control on a camera browsing interface displayed on a large display screen of the folding mobile phone by the user, where the specific control is generally a control for shooting by the control. The third operation may also be a pressing operation of a physical key or a key combination by the user, a voice input operation, and a specific gesture operation.

S2402, the camera application responds to the third operation and calls the camera to shoot the image.

And the user instructs the folding mobile phone to control the camera to shoot the image by inputting a third operation. And after the camera application responds to the received instruction of controlling the camera to shoot the image by the user, the camera application starts the camera to shoot the image.

S2403, the camera application saves the captured image to the gallery application.

S2404, the gallery application receives a fourth operation, and the fourth operation is used for controlling and browsing the images stored in the gallery.

The user can look up the images saved by the folding mobile phone in the gallery application. The user opens the gallery application and inputs a fourth operation on the interface of the gallery application, where the fourth operation may be a click operation of the user on an image thumbnail displayed on the interface of the gallery application. Fig. 21 (a) shows that the user clicks on a thumbnail of the image 301 displayed on the photo tab interface of the gallery application to input the fourth operation.

S2405, the gallery application responds to the fourth operation and calls Surface flickers to create a layer of the image browsing interface.

As with the foregoing software framework, the application framework layer includes the Surface Flinger API. And the gallery application calls the Surface flunger to create a layer of the image browsing interface through the Surface flunger API.

It can be understood that the image browsing interface is a display interface for folding images saved in a gallery of the mobile phone. Illustratively, fig. 22 (a) shows a browsing interface of the image 301.

In some embodiments, the gallery application may send a message to the Surface flunger through the Surface flunger API to inform the Surface flunger to create the layers of the image browsing interface. And the message sent by the gallery application may also carry an identification of the image to be displayed on the display screen of the folding handset.

S2406, creating a layer of the image browsing interface by the Surface Flinger, wherein a flag bit (flag) of the layer of the image browsing interface is a default value.

Like step S2303 in the previous embodiment, a flag bit (flag) of the layer is used to indicate a display mode of the layer. One application of the folding mobile phone is operated, and the Surface flicker creates a layer of a display interface when the application is operated. And aiming at different display modes of the display interface during application operation, different zone bits can be set on the layer of the display interface.

Illustratively, the flag bit default value of an image layer is 0x0, which represents that the image layer is to be displayed on a single screen; the default value of the flag bit of the layer is 0x1, which represents that the layer can be vertically mirrored; the default value of the flag bit of the layer is 0x2, which represents that the layer can be horizontally mirrored; the default value of the flag bit of the layer is 0x4, which means that the layer will rotate clockwise by 90 degrees; the default value of the flag bit of the layer is 0x8, which means that the layer will rotate 90 degrees counterclockwise, and the default value of the flag bit of the layer is 0x10, which means that the layer will be displayed synchronously.

The Surface flag creates a layer of the image browsing interface with a default value of a flag bit (flag). Typically, the default value is set to 0x0, indicating that the layer is displayed by the home screen. In this embodiment, the main screen refers to a large display screen of the folding mobile phone.

It should be further noted that after the Surface flunger creates a layer of the image browsing interface, the identifier of the layer is returned to the gallery application, so that the gallery application can manage the layer created by the Surface flunger through the identifier of the layer.

S2407, the Surface flicker sends a fifth message to the display driver to instruct the display driver to control the main screen to display the image browsing interface.

When the folding mobile phone is in the unfolded state, the fifth message sent by the Surface flicker to the display driver indicates the display driver to control the layer of the image browsing interface displayed on the large display screen of the folding mobile phone, or may be understood as the layer indicating the display driver to control the main screen of the folding mobile phone to display the image browsing interface.

S2408, displaying an image browsing interface on the main screen by the display drive control.

The display driver can power on the main screen to light the main screen and display the image browsing interface.

S2409, the gallery application receives a fifth operation.

The fifth operation may be understood as an operation of starting a dual screen simultaneous display in the gallery application. In some examples, the fifth operation may include a click operation to open or close a dual-screen co-display control. The double-screen simultaneous display control can be arranged on a setting interface of the gallery application.

In this embodiment, a case where a user inputs a fifth operation and selects one display screen to display an image captured by a camera and the other display screen to display an image obtained by performing horizontal mirroring on the image captured by the camera is described as an example.

S2410, in response to the fifth operation, the gallery application sends a sixth message to the Surface Flinger to notify the Surface Flinger to power on the secondary screen.

And S2411, responding to the fifth operation by the gallery application, sending a seventh message to the Surface Flinger, wherein the seventh message carries the identifier of the image layer of the image browsing interface, and the seventh message is used for informing the Surface Flinger to display the image browsing interface after horizontal mirror image processing is carried out on the secondary screen. Of course, the horizontal mirroring process described here means: and performing horizontal mirror image processing on the images in the image browsing interface, and performing horizontal mirror image processing on other contents such as characters and controls without performing horizontal mirror image processing.

Wherein the gallery application sends a seventh message to the Surface flunger through the Surface flunger API.

S2412, modifying the flag bit of the layer of the image browsing interface to the flag bit corresponding to the horizontal mirror image by the Surface Flinger.

And the Surface flicker receives the seventh message, screens out the layer of the image browsing interface by using the layer identifier of the image browsing interface carried in the seventh message, and adjusts the flag bit of the layer of the image browsing interface to be the flag bit corresponding to the horizontal mirror image. Illustratively, the flag bit of the layer of the image browsing interface is modified from 0x0 to 0x2 by Surface flunger.

S2413, determining a main screen display list and an auxiliary screen display list by the Surface Flinger, wherein the main screen display list comprises layers displayed by the main screen, and the auxiliary screen display list comprises layers displayed by the auxiliary screen.

And traversing the layer constructed by the Surface Flinger, and determining a main screen display list and an auxiliary screen display list by using the flag bit of the layer. As is exemplary. And storing the layer with the flag bit not equal to 0x0 into a secondary screen display list by the Surface Flinger, and storing the layer with the flag bit equal to 0x0 into a main screen display list by the Surface Flinger.

It should be further noted that the Surface Flinger further needs to construct a rotation matrix for each layer. And aiming at the layer in the secondary screen display list, the Surface flag adjusts the rotation matrix of the layer. Illustratively, for the layer after the horizontal mirror image processing is displayed on the secondary screen, the rotation matrix of the layer is set to Transform:: FLIP _ H.

And S2414, sending an eighth message to the display driver by the Surface Flinger to indicate the display driver to control the main screen to display the layer in the main screen display list, and display the layer in the auxiliary screen display list by the auxiliary screen.

The Surface flunger calls the display driver interface to send an eighth message to the display driver, where the eighth message may include two display layer lists and a rotation matrix of each layer in the lists.

And S2415, displaying the layer in the driving control main screen display list, and displaying the layer in the auxiliary screen display list on the auxiliary screen.

The display driver powers on the auxiliary screen to light the auxiliary screen and display the layers in the auxiliary screen display list. And because the flag bit of the layer of the browsing interface of the image is the flag bit of the horizontal mirror image, the secondary screen of the folding mobile phone displays the browsing interface of the image, and in the browsing interface of the image, the image is displayed in the horizontal mirror image, and the contents of the characters or the components are normally displayed.

It should be noted that the dual-screen simultaneous display control can also be configured in a system-level setting. Therefore, after the control of the double-screen simultaneous display is started, the started application of the folding mobile phone can respond to the control of the double-screen simultaneous display, and the interface of the started application is subjected to double-screen simultaneous display.

In a scenario where the dual-screen simultaneous display control is configured to be set at a system level, the flag bit of the layer of the image browsing interface created in step S2406 is set to the numerical value of the dual-screen simultaneous display. The steps S2407 to S2412 may not be executed, and the main screen and the sub screen of the foldable mobile phone are controlled to perform the dual-screen simultaneous display through the steps S2413 to S2415.

Another embodiment of the present application also provides a computer-readable storage medium having stored therein instructions, which when run on a computer or processor, cause the computer or processor to perform one or more steps of any of the methods described above.

The computer readable storage medium may be a non-transitory computer readable storage medium, for example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

Another embodiment of the present application also provides a computer program product containing instructions. The computer program product, when run on a computer or processor, causes the computer or processor to perform one or more steps of any of the methods described above.

Claims

1. A method for dual-screen simultaneous display is applied to a foldable electronic device, wherein the foldable electronic device comprises a main screen and an auxiliary screen, and the method for dual-screen simultaneous display comprises the following steps:

responding to a first operation, and displaying a first interface on the main screen, wherein the first operation is used for starting a camera application, and the first interface is a camera preview interface;

responding to a second operation, displaying a second interface on the secondary screen, wherein the second operation is used for starting the double-screen simultaneous display, and the second interface is a camera preview interface;

wherein: the displaying a second interface on the secondary screen includes:

the camera application sends a second message to the Surface flag, and the second message is used for informing the Surface flag to control the secondary screen to be electrified;

the camera application calls the Surface flag to modify the flag bit of the layer of the first interface into a first flag bit, and the first flag bit indicates a display mode of the layer of the first interface on the secondary screen; the first interface comprises a first image, the second interface comprises a second image, and the display mode of the layer of the first interface displayed on the secondary screen comprises: the second image is the same as the first image, or the second image is an image of the first image after processing operation, and the processing operation includes: the first image is an image shot by a camera of the foldable electronic equipment;

the Surface flag determines a layer to be displayed of the secondary screen, wherein the layer to be displayed of the secondary screen at least comprises a layer of the second interface;

the Surface flicker sends a third message to a display driver to indicate the display driver to control the auxiliary screen to display a layer to be displayed of the auxiliary screen;

and the display driver responds to a third message and controls the auxiliary screen to display the layer to be displayed of the auxiliary screen in a display mode indicated by the first flag bit.

2. The method of dual-screen simultaneous display according to claim 1, further comprising:

responding to a third operation, saving first data, wherein the first data comprise images or videos, the third operation is a touch operation of a first control of a first interface displayed on the main screen, and the first control is used for controlling the foldable electronic equipment to shoot the images or videos.

3. The method for dual-screen simultaneous display according to claim 1 or 2, further comprising:

responding to a fourth operation, displaying a third interface on the main screen, and displaying a fourth interface on the auxiliary screen; the fourth operation is used for browsing images or videos saved by the foldable electronic equipment; the third interface is a browsing interface of the image or the video specified by the fourth operation, and the fourth interface is a browsing interface of the image or the video specified by the fourth operation.

4. The method of claim 1, wherein the first interface and the second interface each further comprise at least one control and at least one text.

5. The method for dual-screen simultaneous display according to claim 3, wherein the third interface includes a third image, the fourth interface includes a fourth image, and the fourth image is the same as the third image, or the fourth image is an image of the third image after being processed, and the processing operation includes: horizontal mirror image, vertical mirror image, or rotated in one direction by a certain angle.

6. The dual-screen simultaneous display method according to claim 3, wherein each of the third interface and the fourth interface further comprises at least one control and at least one text.

7. The method of claim 3, wherein before the secondary screen displays the fourth interface, the method further comprises:

and receiving a fifth operation, wherein the fifth operation is used for starting the double-screen simultaneous display.

8. The method for displaying the dual-screen simultaneous display according to claim 1 or 2, wherein the displaying the first interface on the main screen comprises:

the camera application calls a Surface flag to create a layer of the first interface, and a flag bit of the layer of the first interface is a default value;

the Surface flunger sends a first message to a display driver to indicate the display driver to control the main screen to display the first interface;

the display driver controls the main screen to display the first interface in response to a first message.

9. The method for dual-screen simultaneous display according to claim 8, wherein the camera application calls Surface flicker to create the layer of the first interface, and the method comprises the following steps:

the camera application sends a message to the Surface Flinger through a Surface Flinger API so as to inform the Surface Flinger to create the layer of the first interface;

and the Surface Flinger responds to the message and creates the layer of the first interface.

10. The method for dual-screen simultaneous display according to claim 1, wherein the camera application calls Surface flicker to modify the flag bit of the layer of the first interface to be a first flag bit, and the method comprises:

the camera application sends a message to the Surface flag through a Surface flag API, wherein the message carries the identifier of the layer of the first interface;

and the Surface flag responds to the message and modifies the flag bit of the layer of the first interface into a first flag bit.

11. The method for dual-screen simultaneous display according to claim 3, wherein the displaying a third interface on the main screen comprises:

the camera application calls a Surface flag to create a layer of the third interface, and a flag bit of the layer of the third interface is a default value;

the Surface flunger sends a fourth message to a display driver to indicate the display driver to control the main screen to display the third interface;

the display driver controls the home screen to display the third interface in response to a fourth message.

12. The method for dual-screen simultaneous display according to claim 3, wherein the displaying a fourth interface on the secondary screen comprises:

the camera application sends a fifth message to the Surface flag, and the fifth message is used for informing the Surface flag to control the secondary screen to be electrified;

the camera application calls a Surface flag to modify the flag bit of the layer of the third interface into a first flag bit, and the first flag bit indicates the display mode of the layer of the third interface on the secondary screen;

determining a layer to be displayed of the auxiliary screen by the Surface flicker, wherein the layer to be displayed of the auxiliary screen at least comprises a layer of the fourth interface;

the Surface flicker sends a sixth message to a display driver to indicate the display driver to control the auxiliary screen to display a layer to be displayed of the auxiliary screen;

and the display driver responds to a sixth message and controls the auxiliary screen to display the layer to be displayed of the auxiliary screen in a display mode indicated by the first flag bit.

13. A foldable electronic device, comprising:

one or more processors, a memory, a camera, a primary screen and a secondary screen;

the memory, the camera, the primary screen, and the secondary screen are coupled to the one or more processors, the memory for storing computer program code comprising computer instructions which, when executed by the one or more processors, cause the foldable electronic device to perform the method of dual-screen co-display of any of claims 1-12.

14. A computer-readable storage medium storing a computer program which, when executed by an electronic device, causes the electronic device to implement the method of dual-screen simultaneous display of any one of claims 1 to 12.