WO2021018274A1

WO2021018274A1 - Screen projection method and electronic device

Info

Publication number: WO2021018274A1
Application number: PCT/CN2020/106096
Authority: WO
Inventors: 周星辰; 范振华
Original assignee: 华为技术有限公司
Priority date: 2019-07-31
Filing date: 2020-07-31
Publication date: 2021-02-04
Also published as: CN116185324A; CN112394891B; CN112394891A

Abstract

A screen projection method and an electronic device, which relate to the technical field of terminals, which are applied to a device having a folding screen, and which are conducive to implementing smart screen projection. The method is applied to a first electronic device, which comprises an internal screen and an external screen, the internal screen being a foldable screen. The method comprises: after receiving an operation of folding the internal screen from an unfolded state to a closed state, the first electronic device locking the internal screen in response to the operation of folding the internal screen from the unfolded state to the closed state, acquiring screen projection content of a target application program among at least one application program that is currently running, and then sending the screen projection content to a second electronic device. The described technical solution is conducive to triggering an electronic device to project a screen by means of a user performing only one operation, thus simplifying the means of operation of screen projection and improving the efficiency of screen projection.

Description

Screen projection method and electronic equipment

Cross references to related applications

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office, the application number is 201910704758.6, and the application name is "a projection method and electronic equipment" on July 31, 2019, the entire content of which is incorporated into this application by reference in.

Technical field

This application relates to the field of terminal technology, and in particular to a screen projection method and electronic equipment.

Background technique

Screen projection technology refers to the use of wireless communication technology to deliver the content on the electronic device A to the electronic device B, so that the electronic device B can display the content on the electronic device A. For example, through projection technology, content on electronic devices with smaller displays (such as mobile phones, tablet computers, etc.) can be delivered to electronic devices with larger displays (such as televisions, projectors, etc.), so that users The content on the electronic device with the smaller display screen can be viewed on the electronic device with the larger display screen, so as to achieve a better viewing effect.

With the continuous promotion of screen projection technology, the research on smart screen projection has important practical value.

Summary of the invention

The embodiments of the present application provide a screen projection method and electronic device, which help reduce the complexity of the operation mode for triggering the electronic device to initiate the screen projection, and improve the efficiency of triggering the source device to initiate the screen projection.

In a first aspect, a screen projection method according to an embodiment of the present application is applied to a first electronic device, the first electronic device includes a first display screen, and the method includes:

The first electronic device receives the first operation;

In response to the first operation, the first electronic device turns off the first display screen, and obtains screen projection content from a target application of at least one currently running application;

The first electronic device sends the projected content to the second electronic device.

In the embodiment of the application, since the first electronic device can initiate a screen projection in response to the first operation, the user can initiate a screen projection only by operating the first electronic device once, which helps to reduce the operation mode that triggers the electronic device to initiate a screen projection The complexity of triggering the first electronic device to initiate screen projection is improved.

In a possible design, the first operation is a screen-off operation. For example, the operation of clicking the power button, the operation of closing the cover of the smart cover. For another example, the first electronic device is a flip electronic device, and the first operation is an operation of the outer cover of the device. For another example, if the first display screen is a foldable display screen, the first operation may be an operation of folding the first display screen from an unfolded state to a closed state. For an externally foldable display screen, the first electronic device can turn off a part of the first display screen or turn off the entire first display screen in response to the operation of folding the first display screen from the unfolded state to the closed state. Turn off the screen. For another example, if the first display screen is a retractable display screen, the first operation may be an operation of shrinking the first display screen. For a retractable display screen, similar to an externally foldable display screen, the first electronic device can turn off a part of the first display screen (ie, the contracted part) in response to the operation of shrinking the first display screen, or Turn off the entire first display screen.

In a possible design, in response to the first operation, after turning off the first display screen, and before acquiring the projected content from the target application in at least one currently running application, the method further includes:

Make sure that the smart screen projection function is turned on; and/or,

Prompt the user whether to allow screen projection, and receive the user's permission to cast screen operation.

Through the above technical solutions, it is helpful to improve the interaction with users.

In another possible design, before the first electronic device sends the projected content to the second electronic device, the method further includes:

The environment where the first electronic device is located is determined to identify whether the user intends to cast a screen. For example, when the first electronic device determines whether the display screen is blocked, for example, the first electronic device includes a first display screen, the first display screen is a foldable display screen and an inner screen, and the first electronic device also includes an outer screen. , The first electronic device can determine whether the external screen is blocked. As another example, the first electronic device only includes the first display screen, and the first electronic device can determine whether the first display screen is blocked. When the display screen of the first electronic device is not blocked, the first electronic device sends the projected content to the second electronic device. By judging whether the display screen is blocked, it can be recognized whether the user puts the first electronic device in the bag or pocket, etc. Generally speaking, when the user puts the first electronic device in the bag or pocket, the first electronic device is no longer used The device may not need to cast the screen. Further, the first electronic device can also learn the user's behavior habit of using the electronic device through the user's history of using the device, and further determine whether to send the screened content to the second electronic device according to the user's behavior habit of using the electronic device.

In a possible design, after the first electronic device sends the projected content to the second electronic device, a control interface is displayed on the second display screen, and the control interface is used to implement quick operations on the target application. The second display screen may be a part or all of the display area of the first display screen, or a display screen different from the first display screen. Thus, it is convenient for users to control the content of the screen.

In a possible design, the first electronic device determines a control interface corresponding to the type of the target application from a preset control interface corresponding to the type of the application, and displays it in the second The control interface corresponding to the target application type is displayed on the screen. Help simplify the implementation.

In a possible design, the first electronic device recognizes the virtual button with touch function in the target application, and displays the virtual button with touch function on the second display screen according to the virtual button with touch function. The control interface for controlling the target application is displayed. It helps to improve the reliability of the displayed control interface.

In a possible design, when the first electronic device does not recognize the virtual button with touch function in the target application, it determines from the preset control interface corresponding to the type of application A control interface corresponding to the type of the target application, and a control interface corresponding to the type of the target application is displayed on the external screen. Help simplify the implementation.

In a possible design, the first electronic device determines the target application from at least one currently running application, including:

The first electronic device displays the identification of at least one application that supports the screen projection function among the currently running at least one application on the second display screen; receiving an operation of selecting the identification of the application displayed on the external screen by the user Then, in response to the operation of the user selecting the identifier of the application displayed on the external screen, it is determined that the target application is the application identified by the identifier of the application selected by the user. Help improve the interaction between the device and the user.

In a possible design, after the first electronic device turns off the first display screen, before sending the projected content to the second electronic device, the method further includes:

Acquiring the identification of at least one electronic device by the first electronic device;

The first electronic device determines the identification of the target electronic device from the identification of the at least one electronic device, and the identification of the target electronic device is used to identify the second electronic device.

In a possible design, the first electronic device determining the identification of the target electronic device from the identification of the at least one electronic device includes:

The first electronic device determines, from the identification of the at least one electronic device, the identification used to identify the private electronic device as the identification of the target electronic device. Help reduce user operations.

The first electronic device displays the identification of at least one electronic device on the second display screen; after receiving the user's operation to select the identification of the electronic device displayed on the second display screen, in response to the above operation, the The identification of the electronic device selected by the user is used as the identification of the target electronic device.

In a possible design, each of the identifications of the at least one electronic device is used to identify a public electronic device.

In a possible design, after the first electronic device sends the projected content to the second electronic device, the method further includes:

The first electronic device receives the second operation, and in response to the second operation, stops projection. For example, after stopping the screen projection, the first electronic device displays the user interface where the screen projection content is located on the first display screen. For example, the second operation may be an unlocking operation. Or, when the first display screen is a foldable display screen, the second operation may be an operation of unfolding the first display screen from a closed state to an unfolded state. Or, when the first display screen is a retractable display screen, the second operation may be an operation of extending the first display screen, or the like.

In a second aspect, an embodiment of the present application also provides a method for controlling projection, which is applied to a first electronic device, where the first electronic device includes a first application, and the method includes:

The first electronic device obtains the screencast content from the first application;

The first electronic device sends the projected content to the second electronic device;

The first electronic device determines a control interface corresponding to the type of the first application program from the preset control interface corresponding to the type of the application program after the screen projection is successful;

The first electronic device displays the determined control interface on a display screen, and the control interface includes a virtual button with a touch function. Wherein, after receiving an operation on a certain virtual button on the control interface, the first electronic device responds to the foregoing operation to realize the control of the projection content presented on the second electronic device.

In the embodiment of the present application, the control interface corresponding to the type of the application program is preset, which helps to simplify the way of displaying the control interface.

In a possible design, the first electronic device may configure a control interface corresponding to the type of application in the first electronic device before leaving the factory; or, the first electronic device may be installed in accordance with its own application Program, obtain the control interface corresponding to the type of application from the server.

In the third aspect, the embodiments of the present application also provide another method of projection control, which is applied to a first electronic device, the first electronic device includes a first application, and the method includes:

After the screen projection is successful, the first electronic device recognizes a virtual button with a touch function from the first application, and displays a control interface on the display screen according to the recognized virtual button.

For example, the icons of the virtual buttons included on the control interface may be obtained by the first electronic device re-arranging, cropping and/or scaling the virtual buttons recognized from the first application.

The control interface includes a virtual button with the same function as the virtual button recognized by the first electronic device from the first application.

It should be noted that, after the first electronic device receives an operation on a certain virtual button on the control interface, in response to the above operation, it realizes the control of the projection content presented on the second electronic device.

Through the above technical solutions, it is helpful to make the control interface displayed by the first electronic device more accurate and improve user experience.

In a possible design, the first electronic device recognizing the virtual button with touch function from the first application includes:

The first electronic device is based on the user's historical operation record of the first application, or a software development kit (SDK) interface provided by the first application, or a predefined in the first application The position coordinates of the virtual button on the user interface, and the virtual button with touch function is recognized from the first application. Alternatively, the first electronic device recognizes a virtual button with a touch function from the first application program by performing voice analysis on the first application program. Help simplify the implementation.

In a possible design, when the first electronic device does not recognize the virtual button with touch function from the first application, it determines from the preset control interface corresponding to the type of application A control interface corresponding to the type of the first application program, and the determined control interface is displayed on the display screen. It helps to simplify the implementation while meeting user needs.

In a possible design, the control interface further includes an identification of at least one alternative application program and an identification of at least one alternative screen projection device. It is helpful for users to switch screen-casting applications and/or screen-casting devices according to their needs.

In a possible design, the control interface further includes a virtual button for canceling screen projection. It helps users to actively stop screencasting according to their needs and improve the interaction between the device and the user.

In a fourth aspect, a chip provided by an embodiment of the present application is coupled with a memory in a device, so that the chip invokes program instructions stored in the memory during operation to implement the above-mentioned aspects and aspects of the embodiments of the present application. Any possible design method involved in all aspects.

In the fifth aspect, a computer storage medium of an embodiment of the present application, the computer storage medium stores program instructions, when the program instructions run on an electronic device, the device executes the above aspects of the embodiments of the present application and the various aspects related to Any possible design method.

In a sixth aspect, a computer program product of an embodiment of the present application, when the computer program product runs on an electronic device, causes the electronic device to execute and implement the above-mentioned aspects of the embodiments of the present application and any possible aspects involved in each aspect Design method.

In addition, the technical effects brought about by any of the possible design methods of the fourth aspect to the sixth aspect can be referred to the technical effects brought about by different design methods in the related method section, which will not be repeated here.

Description of the drawings

FIG. 1 is a schematic diagram of a scenario applied by an embodiment of this application;

2 is a schematic diagram of the hardware structure of an electronic device according to an embodiment of the application;

3A is a schematic diagram of the physical form of an electronic device according to an embodiment of the application;

3B is a schematic diagram of another physical form of the electronic device according to an embodiment of the application;

4A is a schematic diagram of another physical form of an electronic device according to an embodiment of the application;

4B is a schematic diagram of another physical form of the electronic device according to an embodiment of the application;

4C is a schematic diagram of another physical form of the electronic device according to an embodiment of the application;

5A is a schematic diagram of another physical form of an electronic device according to an embodiment of the application;

5B is a schematic diagram of another physical form of the electronic device according to an embodiment of the application;

5C is a schematic diagram of another physical form of the electronic device according to an embodiment of the application;

6A is a schematic diagram of another physical form of an electronic device according to an embodiment of the application;

6B is a schematic diagram of another physical form of the electronic device according to an embodiment of the application;

FIG. 7 is a schematic diagram of a software architecture of an electronic device according to an embodiment of the application;

FIG. 8 is a schematic flowchart of a screen projection method according to an embodiment of the application;

FIG. 9 is a schematic diagram of another scenario applied by an embodiment of this application;

FIG. 10 is a schematic diagram of a user interface according to an embodiment of the application;

11A is a schematic diagram of another user interface according to an embodiment of the application;

FIG. 11B is a schematic diagram of another user interface according to an embodiment of the application;

11C is a schematic diagram of another user interface according to an embodiment of the application;

11D is a schematic diagram of another user interface according to an embodiment of the application;

12A is a schematic diagram of another user interface according to an embodiment of the application;

12B is a schematic diagram of another user interface according to an embodiment of the application;

FIG. 13 is a schematic diagram of another user interface according to an embodiment of the application;

14A is a schematic diagram of a control interface according to an embodiment of the application;

14B is a schematic diagram of another control interface according to an embodiment of the application;

14C is a schematic diagram of another control interface according to an embodiment of the application;

14D is a schematic diagram of another control interface according to an embodiment of the application;

14E is a schematic diagram of another control interface according to an embodiment of the application;

14F is a schematic diagram of another control interface according to an embodiment of the application;

14G is a schematic diagram of another control interface according to an embodiment of the application;

15 is a schematic diagram of another user interface according to an embodiment of the application;

16 is a schematic flowchart of another screen projection method according to an embodiment of the application;

17 is a schematic diagram of the physical form of another electronic device according to an embodiment of the application;

FIG. 18 is a schematic flowchart of another screen projection method according to an embodiment of the application;

19 is a schematic diagram of the physical form of another electronic device according to an embodiment of the application;

20 is a schematic diagram of the physical form of another electronic device according to an embodiment of the application;

FIG. 21 is a schematic structural diagram of another electronic device according to an embodiment of the application;

FIG. 22 is a schematic structural diagram of another electronic device according to an embodiment of the application.

Detailed ways

It should be understood that unless otherwise specified in this application, "/" means or, for example, A/B can mean A or B; "and/or" in this application is merely an association relationship describing related objects , Indicates that there can be three relationships, for example, A and/or B, which can indicate: A alone exists, A and B exist at the same time, and B exists alone. "At least one" means one or more, and "plurality" means two or more.

In this application, "exemplary", "in some embodiments", "in other embodiments", etc. are used to represent examples, illustrations, or illustrations. Any embodiment or design solution described as an "example" in this application should not be construed as being more preferable or advantageous than other embodiments or design solutions. Rather, the term example is used to present the concept in a concrete way.

In addition, the terms "first" and "second" mentioned in this application are only used for the purpose of distinguishing description, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Not to be understood as indicating or implying order.

It should be understood that at least two electronic devices are involved in the embodiments of the present application. Specifically, the at least two electronic devices include a source device and a target device. Among them, the source device can also be referred to as the source device, which is an electronic device that initiates screen projection. For example, the source device is used to send screencast content. For example, the screencast content may be video, audio, image, document, game, etc., which is not limited. The target device can also be referred to as a client device (client device) or a peer device, etc., and is an electronic device that receives projected screen content. For example, after receiving the projected content, the target device can present or display the projected content in a corresponding layout. It should be noted that the layout of the projected content on the target device and the layout of the source device in the embodiment of the present application may be different or the same.

In some embodiments, the source device may be a portable electronic device, such as a mobile phone, a tablet computer, a laptop computer (Laptop), a wearable device (such as a smart watch), and the like. Exemplary embodiments of the aforementioned portable electronic devices include, but are not limited to, carrying

Or other operating systems. It should be noted that the embodiments of the present application do not limit the physical form of the portable electronic device. For example, the portable electronic device may be a foldable device, a candy bar device, a flip device, etc. It should also be noted that the portable electronic device in the embodiment of the present application may also be equipped with a smart protective cover. In other embodiments of the present application, the source device may also be an all-in-one computer, a desktop computer, or the like.

In some embodiments, the target device may be an electronic device such as a tablet computer, an all-in-one computer, a desktop computer, a television, a monitor, a projector, a speaker, etc., which can be used to receive and present or display projected content.

By way of example, Fig. 1 shows an application scenario of an embodiment of the present application. As shown in FIG. 1, the electronic device 10 is a source device, and the electronic device 20 is a target device. The electronic device 10 can send the projected content to the electronic device 20, so that the projected content can be presented or displayed by the electronic device 20, thereby achieving a better viewing effect. Wherein, the electronic device 10 and the electronic device 20 may establish a connection in a wired manner (such as through a power cord) and/or wireless (such as wireless fidelity (wi-fi), Bluetooth, etc.). It should be noted that FIG. 1 is only an example of an application scenario of the embodiment of the present application, and the embodiment of the present application does not limit the number of target end devices that receive the projection content sent by the source end device. Taking the source device as the electronic device 10 shown in FIG. 1 as an example, the electronic device 10 may send the screen content to two or more electronic devices including the electronic device 20, or it may only send the screen content给电子设备20。 To the electronic device 20.

However, since the current operation mode of triggering the source device to initiate a screen projection is cumbersome and the user experience is poor, the embodiment of the present application provides a screen projection method so that the source device can initiate a screen projection in response to the first operation. That is, the user can operate the source-end device once to enable the source-end device to perform screen projection, thereby helping to reduce the complexity of the operation mode that triggers the source-end device to initiate the screen-casting, and improve the efficiency of triggering the source-end device to initiate the screen-casting. In some embodiments, the first operation may be used to control the screen to turn off the electronic device. In this case, the first operation may be referred to as a screen turning off operation. It should be noted that, when the electronic device in the embodiment of the present application turns off the screen, it may display a black screen and not lock the screen, or display a black screen and lock the screen, or display the default user interface and not lock the screen, or display the default user interface and lock the screen , Or part of the black screen, part of the default user interface, etc., where the default user interface may include date and time information, and/or commonly used application icons, etc. For example, the content included in the default user interface can be set according to the user's needs, or the electronic device can be set before leaving the factory. For example, if the electronic device is in a locked screen state when the screen is turned off, the first operation may also be called a screen lock operation. Since the source device can actively initiate a screen projection when the screen is off, and send the projected content to the target device for presentation or display, the user can continue to view the corresponding content on the target device, which helps to improve the user experience . In addition, in other embodiments of the present application, the first operation may also be other operations. Specifically, the implementation of the first operation may be related to the physical form of the electronic device.

The source device and target device, and embodiments for using such source device and target device will be introduced in the following.

Take the source device as the electronic device 10 in the application scenario shown in FIG. 1 as an example. By way of example, FIG. 2 shows a schematic diagram of the hardware structure of an electronic device 10 according to an embodiment of the present application. As shown in FIG. 2, the electronic device 10 includes a processor 110, an internal memory 121, an external memory interface 122, a camera 131, a first display screen 141, a sensor module 150, an audio module 160, a speaker 161, a receiver 162, a microphone 163, and a headset. Interface 164, buttons 170, subscriber identification module (SIM) card interface 171, universal serial bus (USB) interface 172, charging management module 180, power management module 181, battery 182, mobile communication module 191 and wireless communication module 192. In other embodiments, the electronic device 10 further includes a second display screen 142. Wherein, the first display screen 141 and the second display screen 142 may be located on different faces of the electronic device 10. For example, the first display screen 141 is located on the first face of the electronic device 10 (for example, the front face of the electronic device 10), and the second The display screen 142 is located on the second side of the electronic device 10 (such as the back of the electronic device 10). In addition, the electronic device 10 in the embodiment of the present application may also include a motor, an indicator, a mechanical shaft, and the like.

It should be understood that the hardware structure shown in FIG. 2 is only an example. The source device of the embodiment of the present application may have more or fewer components than the electronic device 10 shown in the figure, may combine two or more components, or may have different component configurations. The various components shown in the figure may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and/or application specific integrated circuits. It can be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 10. In other embodiments of the present application, the electronic device 10 may include more or fewer components than those shown in the figure, or combine certain components, or split certain components, or arrange different components. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem, a graphics processing unit (GPU), and an image signal processor. , ISP), video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU), etc. Among them, the different processing units may be independent devices or integrated in one or more processors.

In some embodiments, the processor 110 may also be provided with a buffer for storing part of the program and/or data. For example, the buffer in the processor 110 may be a cache memory. The buffer may be used to store programs and/or data that have just been used, generated, or recycled by the processor 110. If the processor 110 needs to use the program and/or data, it can be directly called from the buffer. The time for the processor 110 to obtain programs and/or data is reduced, thereby helping to improve the efficiency of the system.

The internal memory 121 may be used to store programs and/or data. It should be noted that the program in the embodiment of the present application may also be referred to as a program instruction. In some embodiments, the internal memory 121 includes a program storage area and a data storage area. Among them, the storage program area can be used to store an operating system (such as Android, IOS, and other operating systems), a computer program required for at least one function (such as screen lock, screen projection), and the like. The storage data area may be used to store data created and/or acquired during the use of the electronic device (such as the identification and image of the target device). For example, the processor 110 may call the program and/or data stored in the internal memory 121 to enable the electronic device 10 to execute a corresponding method, thereby implementing one or more functions. For example, the processor 110 calls certain programs and/or data in the internal memory 121, so that the electronic device 10 executes the screen projection method provided in the embodiment of the present application, thereby improving the efficiency of the source device initiating the screen projection and improving the user experience . Among them, the internal memory 121 may be a high-speed random access memory, and/or a non-volatile memory. For example, the non-volatile memory may include at least one of one or more disk storage devices, flash memory devices, and/or universal flash storage (UFS).

The external memory interface 122 can be used to connect an external memory card (for example, a Micro SD card) to expand the storage capacity of the electronic device 10. The external memory card communicates with the processor 110 through the external memory interface 122 to realize the data storage function. For example, the electronic device 10 may save files such as images, music, and videos in an external memory card through the external memory interface 122.

The camera 131 can be used to capture or collect moving and static images. Generally, the camera 131 includes a lens and an image sensor. Among them, the optical image generated by the object through the lens is projected onto the image sensor, and then converted into an electrical signal for subsequent processing. For example, the image sensor may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The image sensor converts the light signal into an electrical signal, and then transfers the electrical signal to the ISP to convert it into a digital image signal. It should be noted that, in this embodiment of the present application, the camera 131 may include one or more cameras.

The first display screen 141 may include a display panel for displaying a graphical user interface (GUI). For convenience of description below, the graphical user interface is referred to as the user interface for short. The electronic device 10 displays a user interface on the first display screen 141 to present or display corresponding content to the user, such as videos, texts, images, virtual keys or virtual buttons for realizing interaction between the user and the electronic device 10, etc. In some embodiments, the display panel may adopt a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light-emitting diode, or an active matrix organic light-emitting diode. (active-matrix organic light emitting diode, AMOLED), flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diode (QLED), etc. For example, the electronic device 10 may implement a display function through a GPU, the first display screen 141, an application processor, and the like. It should be understood that the first display screen 141 in the embodiment of the present application may be a foldable screen or a non-foldable screen, which is not limited. It should be noted that the specific implementation manner of the second display screen 142 can be referred to the specific implementation manner of the first display screen 141, which is not repeated here.

For example, the electronic device 10 is an electronic device with a foldable screen, and includes a first display screen 141 and a second display screen 142, where the first display screen 141 is a foldable screen, and the second display screen 142 is a non-foldable screen. . The first display screen 141 is located on the first surface of the electronic device 10, the second display screen 142 is located on the second surface of the electronic device 10, and the first surface and the second surface are different. For example, the first side of the electronic device 10 may also be referred to as the front side of the electronic device 10. As shown in FIG. 3A, the first display screen 141 is located on the first surface of the electronic device 10. In FIG. The included angle of 141 is β. The second surface of the electronic device 10 can also be referred to as the back of the electronic device 10. As shown in FIG. 3B, the second display screen 142 is located on the second surface of the electronic device 10. In FIG. 3B, the first display screen 141 The included angle is α. It should be noted that the value of the included angle of the first display screen 141 can be in the range of [0°, 180°]. When the angle of the first display screen 141 is 0°, the first display screen 141 is in the folded or closed state, and when the angle of the first display screen 141 is 180°, the first display screen 141 is in the Expanded state. It should be noted that the first display screen 141 may also be referred to as an internal screen or a main screen, and the second display screen 142 may also be referred to as an external screen or an auxiliary screen.

In another example, the electronic device 10 is an electronic device with a non-foldable screen, and includes a first display screen 141. For example, the electronic device 10 includes a first surface and a second surface, and the first display screen 141 is located on the first surface of the electronic device. For example, the first side of the electronic device 10 is shown in FIG. 4A, and the second side of the electronic device 10 is shown in FIG. 4C. When the first side of the electronic device 10 is shown in FIG. 4A and the second side of the electronic device 10 is shown in FIG. 4C, the electronic device 10 only includes the first display screen 141. In other embodiments, the electronic device 10 may further include a second display screen 142. The first display screen 141 is located on the first surface of the electronic device 10, and the second display screen 142 is located on the second surface of the electronic device 10. For example, the first side of the electronic device 10 is shown in FIG. 4A. The second side of the electronic device 10 may be as shown in FIG. 4B. It should be understood that when the first side of the electronic device 10 is shown in FIG. 4A and the second side of the electronic device 10 is shown in FIG. 4B, the first display screen 141 may also be referred to as the main screen, and the second display screen 142 is again It can be called a secondary screen.

As another example, the electronic device 10 is an electronic device with a foldable screen, and includes a first display screen 141. Among them, the first display screen 141 is an electronic device with a foldable screen. When the first display screen 141 is in the unfolded state, it may be as shown in FIG. 5A, and the first display screen 141 in the closed state or the folded state may be as shown in FIG. 5B. 5C is a schematic diagram when the included angle of the first display screen 141 is folded to β.

As another example, the electronic device 10 is an electronic device with a retractable screen, and includes a first display screen 141. The state after the first display screen 141 is stretched may be as shown in FIG. 6A, and the state after the first display screen 141 is contracted may be as shown in FIG. 6B.

The sensor module 150 may include one or more sensors. For example, touch sensor 150A, pressure sensor 150B, distance sensor 150C, etc. In other embodiments, the sensor module 150 may also include a gyroscope, an acceleration sensor, a fingerprint sensor, an ambient light sensor, a proximity light sensor, a bone conduction sensor, a temperature sensor, and so on.

Among them, the touch sensor 150A may also be referred to as a “touch panel”. The touch sensor 150A may be provided on the first display screen 141 and/or the second display screen 142. Take the touch sensor 150A provided on the first display screen 141 as an example. The touch sensor 150A and the first display screen 141 form a first touch screen, also called "first touch screen". The touch sensor 150A is used to detect touch operations acting on or near it. The touch sensor 150A may transmit the detected touch operation to the application processor to determine the type of touch event. The electronic device 10 may provide visual output related to touch operations and the like through the first display screen 141. In other embodiments, the touch sensor 150A may also be disposed on the surface of the electronic device 10, which is different from the position of the first display screen 141.

The pressure sensor 150B is used to sense the pressure signal and can convert the pressure signal into an electrical signal. For example, the pressure sensor 150B may be provided on the first display screen 141 and/or the second display screen 142. Among them, touch operations that act on the same touch position but have different touch operation strengths can correspond to different operation instructions.

The distance sensor 150C, which can also be called a distance sensor 150C, etc., is used to measure distance. For example, in a shooting scene, the electronic device 10 may use the distance sensor 150C to measure the distance to achieve rapid focusing. For another example, after the first display screen 141 is locked, the distance sensor 150C may also be used to determine whether the first display screen 141 and/or the second display screen 142 is blocked. For example, when the first side of the electronic device 10 is shown in FIG. 3A and the second side of the electronic device 10 is shown in FIG. 3B, if the first display screen 141 is in the closed state or folded state, the distance sensor 150C can be used for It is determined whether the second display screen 142 is blocked. For another example, when the first side of the electronic device 10 is shown in FIG. 4A and the second side of the electronic device 10 is shown in FIG. 4B, the distance sensor 150C is used to determine whether the first display screen 141 and the second display screen 142 are Occlude. For another example, when the first side of the electronic device 10 is shown in FIG. 4A and the second side of the electronic device 10 is shown in FIG. 4C, the distance sensor 150C is used to determine whether the first display screen 141 is blocked.

The electronic device 10 may implement audio functions through the audio module 160, the speaker 161, the receiver 162, the microphone 163, the earphone interface 164, and the application processor. For example, audio playback function, recording function, voice wake-up function, etc.

The audio module 160 can be used to perform digital-to-analog conversion and/or analog-to-digital conversion on audio data, and can also be used to encode and/or decode audio data. For example, the audio module 160 may be provided in the processor 110, or part of the functional modules of the audio module 160 may be provided in the processor 110.

The speaker 161, also called a "speaker", is used to convert audio data into sound and play the sound. For example, the electronic device 100 may listen to music through the speaker 161, answer a hands-free call, or issue a voice prompt, etc.

The receiver 162, also called "earpiece", is used to convert audio data into sound and play the sound. For example, when the electronic device 100 answers a call, the receiver 162 may be brought close to the human ear to answer the call.

The microphone 163, also known as a "microphone" or a "microphone", is used to collect sounds (such as ambient sounds, including sounds made by people, sounds made by equipment, etc.), and convert the sounds into audio electrical data. When making a call or sending a voice, the user can approach the microphone 163 through the mouth to make a sound, and the microphone 163 collects the sound made by the user. It should be noted that the electronic device may be provided with at least one microphone 163. For example, two microphones 163 are provided in the electronic device, in addition to collecting sound, it can also achieve a noise reduction function. For another example, three, four or more microphones 163 may be provided in the electronic device, so that in addition to sound collection and noise reduction, sound source identification or directional recording functions can also be realized.

The earphone interface 164 is used to connect wired earphones. The earphone interface 164 may be a USB interface 170, or a 3.5mm open mobile terminal platform (OMTP) standard interface, a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface, etc. .

The button 170 may include a power button, a volume button, and the like. The button 170 may be a mechanical button or a virtual button. The electronic device 10 can generate signal inputs related to user settings and function control of the electronic device 10 in response to the operation of the keys. For example, the electronic device 10 may lock the screen of the first display screen 141 in response to pressing the power button, and trigger the execution of the screen projection method of the embodiment of the present application. It should be noted that the power button in the embodiment of the present application may also be referred to as a power-on button, a side button, etc., and the name of the power button is not limited.

The SIM card interface 171 is used to connect to a SIM card. The SIM card can be inserted into the SIM card interface 171 or pulled out from the SIM card interface 171 to achieve contact and separation with the electronic device 10. The electronic device 10 may support 1 or K SIM card interfaces 171, and K is a positive integer greater than 1. The SIM card interface 171 may support Nano SIM cards, Micro SIM cards, and/or SIM cards, etc. The same SIM card interface 171 can insert multiple SIM cards at the same time. The types of the multiple SIM cards can be the same or different. The SIM card interface 171 can also be compatible with different types of SIM cards. The SIM card interface 171 may also be compatible with external memory cards. The electronic device 10 interacts with the network through the SIM card to implement functions such as call and data communication. In some embodiments, the electronic device 10 may also adopt an eSIM card, that is, an embedded SIM card. The eSIM card can be embedded in the electronic device 10 and cannot be separated from the electronic device 10.

The USB interface 172 is an interface that complies with the USB standard specification, and specifically may be a Mini USB interface, a Micro USB interface, a USB Type C interface, and so on. The USB interface 172 can be used to connect a charger to charge the electronic device 10, and can also be used to connect the electronic device 10 to earphones and play sounds through the earphones. When the USB interface 172 can be connected to a headset, it can be understood that the USB interface 172 is used as a headset interface. For example, the USB interface 172 can be used as a headphone interface, and can also be used to connect to other electronic devices, such as AR devices, computers, and so on.

The charging management module 180 is used to receive charging input from the charger. Among them, the charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 180 may receive the charging input of the wired charger through the USB interface 170. In some embodiments of wireless charging, the charging management module 180 may receive the wireless charging input through the wireless charging coil of the electronic device 10. While the charging management module 180 charges the battery 182, it can also supply power to the electronic device 10 through the power management module 180.

The power management module 181 is used to connect the battery 182, the charging management module 180, and the processor 110. The power management module 181 receives input from the battery 182 and/or the charging management module 180, and supplies power to the processor 110, the internal memory 121, the first camera 131, the second camera 132, the first display screen 141, and the like. The power management module 181 can also be used to monitor parameters such as battery capacity, battery cycle times, and battery health status (leakage, impedance). In some other embodiments, the power management module 181 may also be provided in the processor 110. In other embodiments, the power management module 181 and the charging management module 180 may also be provided in the same device.

The mobile communication module 191 may provide a wireless communication solution including 2G/3G/4G/5G and the like applied to the electronic device 10. For example, the mobile communication module 191 may include a filter, a switch, a power amplifier, a low noise amplifier (LNA), and the like.

The wireless communication module 192 can provide applications on the electronic device 10 including WLAN (such as Wi-Fi network), Bluetooth (bluetooth, BT), global navigation satellite system (GNSS), frequency modulation (frequency modulation, FM) , Near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 192 may be one or more devices integrating at least one communication processing module. For example, the electronic device 10 may send screen projection content and/or screen projection instructions to the target device through the wireless communication module 192.

In some embodiments, the antenna 1 of the electronic device 10 is coupled with the mobile communication module 191, and the antenna 2 is coupled with the wireless communication module 192, so that the electronic device 10 can communicate with other devices. Specifically, the mobile communication module 191 may communicate with other devices through the antenna 1, and the wireless communication module 193 may communicate with other devices through the antenna 2.

It should be noted that, for the hardware architecture of the target device in the embodiment of the present application, refer to the related introduction of the hardware architecture of the electronic device 10 in FIG. 3, which is not repeated here.

By way of example, FIG. 7 shows a schematic diagram of the software architecture of a source device and a target device in an embodiment of the present application. As shown in FIG. 5, the source device includes an input module 710A, a processing module 720A, and an output module 730A.

The input module 710A is used to detect the user's operation and report the user's operation to the processing module 720A. It should be noted that, in the embodiments of the present application, the user's operation may be a touch operation or a non-touch operation. For example, the operation of displaying a certain user interface on the first display screen 141 or the second display screen 142, and folding the first display screen 142 The operation of a display screen 141, the operation of pressing the power button, the operation of closing the outer cover of the device, the operation of closing the cover of the smart protective cover, etc. Specifically, the input module 710A can detect the user's operation through a mechanical shaft, a touch sensor, a button, etc., which is not limited.

The processing module 720A is configured to receive the user's operation reported by the input module 710A, and identify the operation type of the user's operation reported by the input module 710A. For example, when the operation type of the user's operation is a screen-off operation, the screen is turned off on the first display screen 141, and after the screen is turned off on the first display screen 141, a screen projection is triggered. For example, the processing module 720A includes an operation recognition module 721A, a projection judgment module 722A, a content acquisition module 723A, a device acquisition module 724A, and the like. The operation recognition module 721A is used to recognize the operation type of the user operation reported by the input module 710A. The projection judgment module 722A is used to judge whether the smart projection function is turned on, or whether the first display screen 741 or the second display screen 742 is blocked, etc. The content acquisition module 723A is used to acquire the projected content. The device acquisition module 724A is used to determine the target device for receiving the screened content.

The output module 730A is used to establish a connection with the target device and send screen content to the target device. As another example, the output module 730A is also used to control the second display screen 742 or the first display screen 741 to display related information. For example, the output module 730A is used to control the second display screen 742 or the first display screen 741 to display a control interface.

For example, as shown in FIG. 7, the target device includes an input module 710B, a processing module 720B, and an output module 730B.

Wherein, the input module 710A is used to establish a connection with the source-end device and receive screen projection content or screen-casting instructions sent by the source device. For example, the input module 710B includes a device connection module 711B, a content interaction module 712B, and an instruction interaction module 713B. The device connection module 711B is used to establish a connection with the source device. The content interaction module 720B is configured to receive the screencast content sent by the source device, and send the screencast content to the processing module 720B. The instruction interaction module 713B is used to receive a screencasting instruction sent by the source device, for example, a screencasting cancellation instruction.

The processing module 720B is configured to, after receiving the projected content sent by the content interaction module 720B, re-layout or crop the projected content, and send the re-layout or cropped projected content to the output module 730B.

The output module 730B is configured to present or display the rearranged screencast content after receiving the rearranged screencast content sent by the processing module 720B.

The following embodiments can all be implemented in an electronic device having the above hardware structure and/or software structure. The screen projection method of the embodiment of the present application will be specifically introduced below in combination with source-end devices of different physical forms.

Example 1:

The source device is an electronic device with a foldable screen. Among them, the source device includes an internal screen and an external screen, the internal screen is a foldable screen, and the external screen is a non-foldable screen. For example, the inner screen of the source device may be the first display screen 141 shown in FIG. 3A or 3B, and the outer screen of the source device may be the second display screen 142 shown in FIG. 3B.

As an example, as shown in FIG. 8, it is a schematic flowchart of a screen projection method according to an embodiment of this application, which specifically includes the following steps.

In step 801, the inner screen of the source device is in use, and an operation of folding the inner screen from the unfolded state to the closed state is received.

Among them, the internal screen of the source device is in use, which can be understood as:

When the internal screen is in the expanded state and the screen is not locked, the source device displays the corresponding user interface on the internal screen, such as the main interface, one screen (-1 screen), the user interface of a certain application, etc. The user can perform corresponding operations as needed when the internal screen displays the corresponding user interface, so that the source device responds to the user's operation and performs corresponding display on the internal screen. That is, when the inner screen of the source device is in the expanded state and the screen is not locked, when a user interface is displayed, the user can perform corresponding operations on the source device and control the inner screen to display accordingly, so as to satisfy the user Demand.

For example, when the internal screen of the source device is expanded and the screen is not locked, when the internal screen displays the desktop (the desktop can also be called the main interface, including the icons of one or more applications), the source device Detecting that the user clicks on an icon of an application on the desktop (for example, the iQiyi icon), in response to the operation of clicking the iQiyi icon, the iQiyi user interface is displayed on the inner screen. For another example, when the internal screen of the source device is in the expanded state and the screen is not locked, when the internal screen displays the user interface of a certain application, the user can press the virtual buttons (or virtual keys) included in the user interface Perform corresponding operations to achieve corresponding control. For example, when the source device detects the user's operation on the iQiyi user interface when the internal screen displays the iQiyi user interface (for example, clicking the operation of the virtual button that controls the full-screen video display), it will respond to the above operation, The corresponding video is displayed in full screen on the internal screen and played, so that the user can watch the corresponding video. For another example, when the source device displays the user interface of Baidu Maps on the internal screen, it detects the user's operation of searching for routes on the user interface of Baidu Maps, and in response to the operation of searching for routes, displays the corresponding route search on the internal screen As a result, it is convenient for the user to reach the corresponding destination.

Normally, the user interface displayed on the internal screen of the source device is the user interface of the source device running the application in the foreground. Among them, the source device can run one or more applications in the foreground. In some embodiments, the source device can run one or more applications in the background while running one or more applications in the foreground. For example, if the application running in the foreground of the source device is iQiyi, the user interface of iQiyi is displayed on the internal screen. For example, when the user interface of iQiyi is displayed on the internal screen, the source device may also run other applications in the background, such as Alipay, WeChat, etc.

For example, when the internal screen of the source device is in use, the external screen is locked and the screen is black, or the external screen is locked but the default user interface is displayed. The default user interface can include information such as time and date. Specifically, the user can follow The information displayed on the default user interface needs to be set.

Take the source device as the electronic device 10 in the application scenario shown in FIG. 1 as an example. For example, the first display screen 141 is the inner screen of the electronic device 10, and the second display screen 142 is the outer screen of the electronic device 10. The processor 110 of the source device can detect the rotation angle of the mechanical shaft of the first display screen 141. Change to determine whether the operation of folding the inner screen from the unfolded state to the closed state is received. For example, when the mechanical shaft of the first display screen 141 of the source device rotates so that the included angle of the first display screen 141 is changed from 180° to 0°, the included angle of the first display screen 141 is changed from 180° to 0° The event reported to the processor 110, when the processor 110 receives the event that the angle of the first display screen 141 reported by the mechanical shaft changes from 180° to 0°, it determines to receive the folding of the inner screen from the unfolded state to the closed state Operation. For another example, the processor 110 of the source device may also collect data from other sensors for sensing the angle change of the first display screen 141 to determine whether an operation of folding the inner screen from the unfolded state to the closed state is received. It should be noted that the embodiment of the present application does not limit the manner in which the source device specifically determines whether the operation of folding the inner screen from the unfolded state to the closed state is received.

Step 802: In response to receiving the operation of folding the inner screen from the unfolded state to the closed state, the source device turns off the inner screen.

It should be noted that when the inner screen is folded into a closed state, the inner screen cannot display the user interface normally to the user. Therefore, in order to save the power consumption of the electronic device, turning off the inner screen can be understood as a black screen and The screen is locked, or the internal screen is black but the screen is not locked. In addition, when the source device folds the inner screen into a closed state, the user cannot use the inner screen normally, that is, the user cannot perform normal operations on the inner screen to achieve control of the source device. Taking the source device as the electronic device 10 in the application scenario shown in FIG. 1 as an example, when the first display screen 141 is the inner screen of the electronic device 10 and the second display screen 142 is the outer screen of the electronic device 10, When the processor 110 of the electronic device 10 determines that it has received the operation of folding the first display screen 141 from the unfolded state to the closed state, according to the operation of folding the first display screen 141 from the unfolded state to the closed state, it determines that the operation type is off. Screen operation, and then turn off the first display screen 141.

It should be noted that, in response to receiving the operation of folding the inner screen from the expanded state to the closed state, the source device can also automatically unlock the outer screen, and automatically map the user interface displayed on the inner screen to the outer screen for display. For example, when the user interface of iQiyi is displayed on the internal screen, in response to the operation of folding the internal screen from the expanded state to the closed state, the external screen is unlocked, and the iQiyi user interface displayed on the internal screen is automatically mapped Display on the external screen. Alternatively, the tablet responds to an operation of folding the inner screen from the unfolded state to the closed state, and the outer screen continues to remain black and/or locked, or the outer screen continues to remain locked and display the default user interface, etc., which is not limited.

Step 803: After turning off the inner screen in response to the operation of folding the inner screen from the expanded state to the closed state, the source device determines a target application from at least one currently running application.

It should be noted that the at least one currently running application program may include an application program currently running in the foreground and/or the background. For example, the target application program may be an application program that meets the first preset condition among at least one currently running application program. Among them, the first preset condition can be set according to actual conditions, which is not limited.

For example, the target application is an application identified in the whitelist among at least one currently running application. Among them, the whitelist includes the identification of the application that supports the projection function, which can be set by the user according to their own needs, or set by the source device before leaving the factory, or generated by the source device according to a preset strategy. . For example, the preset policy stipulates that the audio and video types, map types, reading types, and instant messaging (instant messaging, IM) types of applications are applications that support the screen projection function, and the source device can be based on the installed, and The identification of the type of application that meets the requirements of the preset policy generates a whitelist. For example, if iQiyi, WeChat, and Alipay are installed on the source device, the whitelist generated according to the preset strategy includes the logo of iQiyi and the logo of WeChat. It should be understood that when a new application is detected on the source device, it can be judged whether the application meets the type specified by the preset policy. When the application meets the type specified by the preset policy, the identification of the application Add to the whitelist. Or, in other embodiments, the whitelist includes the identifiers of applications that do not support the screen projection function. In this case, the target application program may be an application program identified in at least one currently running application program that does not belong to the whitelist.

It should be noted that, in the embodiment of the present application, the identifier of the application program may be the package name of the application program, or the icon of the application program, or customized according to needs, which is not limited.

For another example, the target application is an application whose service is in progress among currently running applications. Specifically, for video-type applications, such as iYiqi, Youku, Tencent Video, etc., the service is in progress, which can be understood as the video is being played; for music-playing applications, such as Xiami Music, NetEase Cloud Music Etc., the service is in progress, which can be understood as music is being played; for map-type applications, such as Baidu Maps, AutoNavi Maps, etc., the service is in progress, which can be understood as navigating, or searching, etc.; For game-type applications, such as Honor of Kings, Tetris, etc., the service is in progress, which can be understood as being in the game. For instant messaging applications, such as WeChat, QQ, etc., the service is in progress, which can be understood as inputting, or voice call, or video call, or file transfer, etc. It should be noted that the application program in which the service is in progress can be an application program running in the foreground or an application program running in the background.

For another example, the target application is an application that is identified in the whitelist and whose service is in progress among currently running applications. The white list includes the identification of the application that supports the projection function.

For another example, the target application is an application currently running in the foreground.

In some embodiments, the source device no longer casts a screen when at least one application program currently running does not meet the first preset condition. Or, the source device no longer casts a screen when the application is not currently running.

In step 804, the source device obtains the screencast content from the target application, and sends the screencast content to the target device.

For example, the source device may send the screencast content to the target device based on technologies such as Miracast, airplay, dlna, or Hicast.

The source device and the target device can establish the connection before receiving the user's operation to fold the inner screen from the expanded state to the closed state, or after receiving the user's operation to fold the inner screen from the expanded state to the closed state To establish a connection. For example, after turning off the internal screen, the source device determines the target device for receiving the projected content, and then initiates a connection establishment process to the target device. After the source device establishes a connection with the target device, when it obtains the screencast content from the target application, it sends the screencast content to the target device.

For example, the source device can determine the target device that receives the projected content based on the following methods:

After turning off the internal screen, the source device can obtain the identification of the surrounding electronic devices that support the projection function based on communication technologies such as Bluetooth and/or Wi-Fi, and according to the acquired identification of the surrounding electronic devices that support the projection function, Determine the target device ID. Wherein, the electronic device identified by the target device identifier is the target device for receiving the projected content. In some embodiments, in order to simplify the method of determining the target device identifier, the target device identifier may be an identifier that meets the second preset condition among the identifiers of surrounding electronic devices that support the screen projection function. The second preset condition can be set accordingly according to actual needs, which is not limited.

For example, the target device identifier is an identifier in the trusted list among the identifiers of surrounding electronic devices that support the screen projection function. The credited list includes the identification of at least one electronic device, which may be added by the user according to his own needs, or may be the identification of an electronic device that has been connected to the source device. Further, the identification of the electronic device included in the trusted list may be the identification of the private electronic device added by the user, or the identification of the private electronic device that has been connected to the source device. It should be noted that, in the embodiments of the present application, private electronic devices refer to electronic devices in non-public places, such as TVs at home, desktop computers in dormitories, etc., while electronic devices in public places may be displays in conference rooms.

In some embodiments, when the obtained identifications of the surrounding electronic devices that support the screen projection function are not in the trusted list, the source device can obtain its own geographic location information, and determine the current location based on its own geographic location information. Whether the place is a public place or not, when the geographical location of the place is not a public place, one of the obtained identifiers of the surrounding electronic devices that support the screen projection function is selected as the target device identifier.

For example, when the geographic location of the source device is a public place, it further determines whether the external screen of the source device is blocked. If the external screen is not blocked, the surrounding electronic devices that support the projection function are displayed on the external screen. Logo. The user can select an identifier as the target device identifier among the identifiers of the surrounding electronic devices that support the screen projection function displayed on the external screen according to their own needs. Taking the source device as the electronic device 10 as an example, as shown in FIG. 9, the identification of the surrounding electronic devices that support the screen projection function acquired by the electronic device 10 includes the identification of the electronic device 20, the identification of the electronic device 30, and the identification of the electronic device 40 , The electronic device 10 displays the identification of the electronic device 20, the identification of the electronic device 30, and the identification of the electronic device 40 on the external screen. For example, as shown in FIG. 10, the electronic device 10 displays the identification of the electronic device 20 and the electronic device on the external screen. The identification of the electronic device 30 and the identification of the electronic device 40. When the user selects the identification of the electronic device 30, the electronic device 10 determines that the target device identification is the identification of the electronic device 30. For example, the electronic device 10 responds to the operation of folding the inner screen from the unfolded state to the closed state, turns off the inner screen, and continues to lock the outer screen. Based on the above scenario, in order to enable the user to view the electronic device 20 displayed on the outer screen To operate the identification, the identification of the electronic device 30, and the identification of the electronic device 40, the user needs to unlock the external screen of the electronic device 10 first. For example, the electronic device 10 can unlock the external screen of the electronic device 10 by recognizing the user's face or fingerprint. Or, the user operates the identification of the electronic device 20, the identification of the electronic device 30, and the identification of the electronic device 40 displayed on the external screen without being restricted by the external screen lock screen, that is, in the case of the external screen lock screen, the electronic device When the device 10 is locked on the external screen, it displays the identity of the electronic device 20, the identity of the electronic device 30, and the identity of the electronic device 40. The user can check the identity of the electronic device 20, the identity of the electronic device 30, and the electronic device without unlocking the external screen. The identification of the device 40 performs corresponding operations.

In some other embodiments of the present application, the electronic device 10 also displays a virtual button for controlling the cancellation of the screen projection on the external screen. The user can click or touch the virtual button for controlling the cancellation of the screen projection to make the electronic device 10 cancel the screen projection. . This allows users to cancel the screencast according to their own needs. Alternatively, the electronic device 10 also displays on the external screen that the user has not selected a screen projection device for more than a preset time period, and the screen projection is automatically cancelled. For example, the preset duration can be 10s, 15s, etc., which can be set accordingly according to user needs. For example, the electronic device 10 may automatically black out the screen or display the default user interface after canceling the screen projection.

It should be noted that the identification of the electronic device in the embodiment of the present application may include the icon of the electronic device, the name of the electronic device, etc., which is not limited.

In other embodiments, when the external screen is blocked, for example, the source device is placed in a bag or the external screen is placed facing the desktop, the source device no longer casts the screen.

As another example, the source device can also refer to device capability information (such as whether it can include a display screen, whether it includes a speaker, touch), device attribute information (such as the resolution and sound effects of the device display screen), and the current operating status of the device ( For example, whether it is playing video, audio, or whether it is communicating with other devices, etc.), the target device identification is determined from the identifications of electronic devices that support the screen projection function obtained from the surroundings. The device capability information, device attribute information, and current operating status of the device may be obtained by the source device in the process of obtaining the identification of the electronic device that supports the screen projection function. For example, the electronic device identified by the target device identifier may be an electronic device that does not currently play a video, includes a display screen, and whose display screen resolution is greater than a first threshold. Wherein, the first threshold may be set according to actual needs.

In the embodiment of the present application, the source device may scan and acquire nearby connectable electronic devices based on Bluetooth, and/or Wi-Fi. Taking Bluetooth as an example, when the source device obtains the identities of multiple electronic devices based on Bluetooth scanning, one or more device identities can be determined from the identities of the multiple electronic devices, then the source device and the determined one or more The target device identified by the device identifier establishes a connection, and sends the screencast content to the target device identified by the one or more device identifiers. In particular, the source device may determine a device identifier from the device identifiers of multiple target devices, and send the screencast content to the target device identified by the determined device identifier.

In order to improve the interaction between the user and the electronic device, for example, after performing step 802, the source device determines whether the smart screen projection function is enabled, and when the smart screen projection function is enabled, steps 803 and 804 are executed again. When the smart screen projection function is not enabled, step 803 and step 804 are no longer executed. Among them, the smart screen projection function is turned on or off by the source device in response to the user's operation. For example, set a virtual button on the system settings interface to control turning on or off the smart screen projection function. When the user switches the virtual button from OFF to ON, the source device turns on the smart screen projection function. When the user turns the virtual button from ON When switched to OFF, the source device turns off the smart screen projection function. The system setting interface may be a user interface 1100 as shown in FIG. 11A. The user interface 1100 includes a virtual button 1101, where the virtual button 1101 is used to control turning on or off the smart screen projection function. As another example, the virtual button used to control turning on or off the smart screen projection function can also be set on other user interfaces. For example, the virtual button used to control turning on or off the smart screen projection function is set on the pull-up interface or the drop-down interface. Notification bar, or system toolbar, or control bar. For example, the pull-up interface may be displayed by the source device in response to the user's operation of sliding down on the external screen or the internal screen. For another example, the drop-down interface may be displayed by the source device in response to the user's operation of sliding up on the external screen or the internal screen.

In other embodiments, the source device prompts the user whether to cast the screen after performing step 802 or after determining that the smart screen projection function is enabled. For example, as shown in Figure 11B, the source device can display a prompt box 910 on the external screen, where the prompt box 1110 includes prompt information, and the confirmation option "Yes" and the denial option "No". The prompt information is used to prompt the user whether to vote or not. For example, the prompt message can be "Please confirm whether to cast the screen?" etc. The source device may continue to perform step 803 and step 804 in response to the user selecting the confirmation option "Yes", and the source device may not continue to perform step 803 and step 804 in response to the user selecting the denial option "No". In addition, in some examples, after the source device displays the prompt box 1110 on the external screen, if the user's operation is not detected after a preset period of time, the user may default to the user's consent to the screen, or the default user to reject the screen-casting. For example, the preset duration can be 10s, 15s, etc., which is not limited. In the case where the default user agrees to cast the screen, the source device can continue to perform step 803 and step 804. In addition, it should be noted that the source device displays a prompt box 1110 when the external screen is locked. In order to improve security, the user needs to pass fingerprint, password or facial recognition before operating the prompt box 1110 displayed by the source device. Unlock the external screen. Further, after the user agrees to cast the screen, the source device may also display the user interface shown in FIG. 11C or FIG. 11D on the external screen, so that the user can cancel the screen cast at any time. It should also be noted that, in the embodiment of the present application, the order of judging whether the smart screen projection function has been turned on and prompting the user whether to cast the screen may not be limited.

In some embodiments, when there is no connectable electronic device around or in the vicinity of the source device, that is, when the source device has not obtained the identification of at least one surrounding electronic device that supports the screen projection function, it no longer casts the screen.

In another embodiment, as an alternative to step 803 and step 804, after step 802, the method may further include:

Step 805: After the source device locks the internal screen in response to the operation of folding the internal screen from the unfolded state to the closed state, it determines whether the smart screen projection function has been turned on. If the smart screen projection function is turned on, step 806 is executed. If the smart screen projection function is not enabled, this process ends.

In step 806, the source device determines whether the external screen is blocked. If the external screen is not blocked, step 807 is executed. If the external screen is blocked, the process ends.

For example, the source device can judge whether the external screen is blocked by distance sensors, cameras, etc., for example, when the source device is placed in a bag or pocket, or the source device is placed on a table, the external screen faces down. The source device can detect that the external screen is blocked by a distance sensor or camera. For another example, when the source device is placed on a table with the external screen facing up, it can be determined that the external screen is not blocked by a camera on the same side as the external screen. It should be noted that the above is only an exemplary description for detecting whether the external screen is blocked. The source device can also determine whether the external screen is blocked by other means, for example, by artificial intelligence (AI). Whether it is blocked. The purpose of judging whether the external screen is blocked is to detect whether the user has the intention to cast the screen. If it is recognized that the source device is put in the pocket or bag, the source device thinks that the user no longer uses the device, and no longer triggers Cast screen. In addition, the embodiments of the present application can also combine other parameters (such as time, location, etc.) acquired by other sensors (such as positioning sensors) to learn the behavior habits of the user using the device, so as to more accurately determine whether the user has the intention to cast a screen. , Improve the reliability of the source device to trigger the screen.

In some embodiments, the source device may prompt the user whether to cast the screen after performing step 806. For example, the prompt box 1110 shown in FIG. 11B is displayed on the external screen. After the user agrees to cast the screen, the source device may obtain the current running The identification of at least one application program that supports the screen projection function and the identification of at least one electronic device used to receive screen projection content can prompt the user on the external screen of the current process, for example, the source device is currently running support When the identification of the application program of the screen projection function, the content acquisition can be displayed on the external screen, for example, as shown in Figure 11C. For another example, when the source device obtains the identification of the electronic device used to receive the screen content, it can be displayed on the external screen. In the acquisition of the upper display device, for example, as shown in FIG. 11D, after the source device acquires the identification of at least one currently running application that supports the screen projection function and the identification of at least one electronic device used to receive screen projection content , Go to step 807.

In step 807, the source device displays on the external screen the identification of at least one currently running application supporting the screen projection function; and displays on the external screen the identification of at least one electronic device for receiving screen projection content.

Wherein, the identifier of at least one currently running application that supports the screen projection function may be an identifier of the currently running application that identifies an application in the white list, and the white list includes the identification of at least one application that supports the projection function. . The identification of the at least one electronic device used to receive the projected content may be obtained by the source device based on a communication technology such as Bluetooth and/or Wi-Fi.

For example, the logo of at least one currently running application that supports the screen projection function includes the logo of iQiyi, the logo of Kugou Music, and the logo of Douyin, and the logo of at least one electronic device for receiving screen projection content is an electronic device 20, the logo of the electronic device 30, and the logo of the electronic device 40, the source device displays the iQiyi logo, the Kugou music logo, and the Douyin logo on the external screen, and displays the logo of the electronic device 20, The identification of the electronic device 30 and the identification of the electronic device 40. Wherein, the identification of at least one currently running application supporting the screen projection function and the identification of at least one electronic device used to receive screen projection content may be displayed on the same user interface, for example, as shown in FIG. 12A. The identification of at least one currently running application supporting the screen projection function and the identification of at least one electronic device for receiving screen projection content can be displayed on the same user interface or on different user interfaces, for example, as shown in the figure Shown in 12B.

In some embodiments, when the source device is currently running at least two applications that support the screen projection function, performing step 807 displays on the external screen one or more of the currently running at least two applications that support the screen projection function. ID of each application. For example, when the source device is currently running an application that supports the screen projection function, the screen projection content may be obtained from the application that supports the screen projection function without prompting the user of the identification of the application program. Or, when the source device is currently running an application that supports the screencasting function, the user can also be prompted with the identification of the application, but the user can select the identification of the application without operating, and the source device can download the application from the application. Get screencast content in.

In still other embodiments, in the case that the source device obtains the identifications of at least two electronic devices for receiving the projected content, perform step 807 to display at least two electronic devices for receiving the projected content on the external screen The ID of at least one electronic device in the ID. For example, if the source device only obtains the identification of an electronic device for receiving screencast content, there is no need to display the identification of the electronic device on the external screen, or display the identification of the electronic device on the external screen, but the user can No operation is required to select the identification of the electronic device.

It should be noted that in the case that none of the currently running applications on the source device support the screen projection function, or the application is not currently running, and/or the identification of the electronic device used to receive the screen content is not obtained, then No more screencasts.

Step 808: After the source device receives the user's selection of an application identifier from the identifiers of at least one currently running application that supports the screen projection function, it obtains the vote from the application identified by the identifier of the application selected by the user. Screen content, and send the screencast content to the electronic device identified by the identification of the electronic device selected by the user from the identifications of at least one electronic device for receiving the screencast content. It should be noted that the application identified by the identifier of the application selected by the user may be referred to as a target application.

Further, in step 807, when the source device receives the identifier of an application selected by the user from the identifiers of at least one currently running application supporting the screen projection function, and from at least one electronic device for receiving screen projection content After the identification of the electronic device selected in the identification, or after the source device determines the target device for receiving the screened content, the user interface during delivery is displayed on the external screen, for example, the user interface shown in Figure 13 .

It should be noted that this embodiment of the application does not limit the sequence in which the source device obtains the identification of the application that supports the screen projection function and the identification of the electronic device used to receive the screen content. The source device can simultaneously obtain the screen projection support. The identification of the functional application and the identification of the electronic device used to receive the screened content, or the identification of the application that supports the screen-casting function can be obtained first, and then the identification of the electronic device used to receive the screened content, or, First obtain the identification of the electronic device used to receive the screencast content, and then obtain the identification of the application that supports the screencast function.

Take the identification of an application that supports the screen projection function first, and then the identification of the electronic device used to receive the screen projection content as an example. The source device may display the content acquisition on the external screen when acquiring the identification of at least one currently running application that supports the projection function (for example, as shown in FIG. 11C), and after acquiring at least one currently running application that supports projection After the identification of the functional application, the identification of at least one application that supports the projection function is displayed on the external screen, and in response to the user selecting an application identification, the external screen displays the device acquisition (for example, as shown in the figure) 11D), and after acquiring the identification of at least one electronic device for receiving screencast content, the identification of at least one electronic device is displayed on the external screen, and in response to the user selecting a certain electronic device identification, the identification is displayed on the external screen Delivery (for example, as shown in Figure 13). In this case, the source device can simultaneously obtain the screencast content and the identification of at least one electronic device for receiving the screencast content.

For example, when the source device does not obtain the identification of the application that supports the screen projection function, it can prompt the user that the screen projection fails. Further, the source device can also prompt the user the reason for the screen projection failure. As another example, when the source device fails to obtain the identification of the electronic device used to receive the screened content, it can prompt the user that the screen has failed. Furthermore, the source device can also prompt the user the reason for the failed screen.

It should be noted that in the embodiment of the present application, step 806 can be located before step 805, after step 807, or after step 808, or step 806 can be executed simultaneously with step 807 or step 808, etc., which is not limited. However, once the source device detects that the external screen is blocked, it terminates the screen projection process.

Still further, based on steps 801 to 803, or based on

steps

801, 802 and steps 805 to 807, the source device displays the control interface on the external screen after successfully sending the projected content to the target device. Wherein, the control interface includes virtual buttons with touch function. Among them, for different applications, the virtual buttons with touch functions are different. Among them, after the source device receives the user's operation on the control interface, it responds to the operation on the control interface to realize the control of the target application, so as to achieve the purpose of controlling the projected content. The user's operation on the control interface can be an operation of a virtual button on the control interface for controlling a certain function, or can be a shortcut gesture operation on the control interface, etc., which is not limited.

For example, for a video-type application, such as iQiyi, when the content on the screen is the content on the user interface of iQiyi, the control interface can be as shown in Figure 14A, including a progress bar, a pause button, and a fast forward Button, selection button, and clarity button, etc. For example, if the source device receives the user's operation on the definition button and sets the resolution from SD to HD, the voting content presented on the target device is switched from SD to HD.

For another example, for audio applications, such as Kuwo Music, when the screen content is the content on the Kuwo Music user interface, the control interface may be as shown in Figure 14B, including a progress bar, a pause button, and a quick Enter button and menu button, etc. For example, if the source device receives the user's operation of clicking the pause button, the audio is paused on the target device.

For another example, for social video applications, such as Douyin, when the screen content is the content on the user interface of Douyin, the control interface may be as shown in Figure 14C, including function buttons such as touch area, favorites, comments, and sharing. . Among them, the user can switch videos by sliding up and down in the touch area, or click to pause or start playing the video in the touch area.

For another example, for game applications, such as Snake, when the screen content is the content on the user interface of Snake, the control interface may be as shown in FIG. 14D, including up, down, left, and right function buttons. Among them, the user can control the movement direction of the snake through the up, down, left, and right function buttons. Or, when the screencast content is the content on the user interface of Snakes, the control interface can also be as shown in Figure 14E, that is, the control interface is a gamepad to present the user with virtual buttons for controlling the game, which is more vivid And vivid.

For another example, for short message applications, such as WeChat, QQ, etc., when the screened content is content on the user interface of WeChat, the control interface may be as shown in FIG. 14F or FIG. 14G, including an input method. When text input is adopted on the user interface of WeChat, the control interface may be as shown in FIG. 14F. When voice input is adopted on the user interface of WeChat, the control interface may be as shown in FIG. 14G.

Specifically, after performing step 803, or, in step 808, when the source device receives the identifier of an application selected by the user from the identifiers of at least one currently running application supporting the screen projection function, step 808 The application identified by the identifier of the application selected by the user is used as the target application, and the source device can display a corresponding control interface on the external screen according to the target application.

Example 1: The source device can determine the control interface corresponding to the type of the target application from preset control interfaces corresponding to different types of applications, and then display the control interface corresponding to the target application on the external screen. For example, the target application is iQiyi, and the type of the application to which the target application belongs is the video type. The source device may determine the control interface corresponding to the video type application from the preset control interfaces corresponding to the different types of applications, and then display the control interface corresponding to the type of application to which iQiyi belongs on the external screen. Help simplify the implementation. It should be noted that the preset control interfaces for different types of applications may be different. For example, for video type applications, the preset control interface may be as shown in FIG. 14A. For audio type applications, the preset control interface may be different. The set control interface can be as shown in Figure 14B. Specifically, the control interface corresponding to different types of applications may be pre-set in the electronic device before the device leaves the factory, or the electronic device may obtain it from the server in advance according to the application installed by itself. The manner in which control interfaces corresponding to different types of application programs are preset in the electronic device is not limited.

As for some applications, there are personalized control buttons, such as some game-type applications, and the preset control interface may not meet the needs of users. Therefore, this embodiment of the present application also provides a method for displaying a control interface on an external screen. method.

Example 2: The source device recognizes a virtual button with touch function from the user interface of the target application (for example, a virtual button can also be called a user interface (UI) element, virtual button, or control, etc.), Among them, the virtual button with touch function can be clicked, touched or pressed by the user to realize the corresponding function (such as pause playback, fast forward, etc.). Then, the electronic device rearranges, cuts, and/or zooms the identified virtual buttons with touch functions, generates a control interface corresponding to the target application, and displays the control interface on the external screen. The control interface includes at least one virtual button, which is used to enable the user to implement shortcut operations on the target application.

It should be noted that the at least one virtual button may include a button with the same function as all the virtual buttons recognized by the source device from the user interface of the target application, or may include the same button as the source device from the user interface of the target application. Some of the recognized virtual buttons have the same functions.

Wherein, the control interface includes a virtual button with the same function as the virtual button recognized on the user interface of the target application, which can be implemented in the following ways:

1. By mapping the virtual buttons on the control interface to the user interface of the target application. For example, the position coordinates of the virtual button on the control interface that has the same function as the virtual button recognized on the user interface of the target application are mapped to the position coordinates of the virtual button recognized on the user interface of the target application.

2. Generate a control interface by directly changing the layout of virtual buttons with touch functions on the user interface of the target application, so that the control interface includes virtual buttons that have the same functions as the virtual buttons recognized on the user interface of the target application. Button.

3. By adapting the virtual button on the control interface to the general service interface of the target application, the function of the virtual button is the same as the virtual button recognized on the user interface of the target application.

In other embodiments, the at least one virtual button may also include other function buttons other than the button with the same function as the virtual button recognized on the user interface of the target application, such as a cancel projection button, a switch for receiving The button of the target device of the projected content and/or the button of switching the target application for projecting, etc. Taking the screen-casting cancel button as an example, the electronic device receives the user's operation of clicking the canceling screen-casting button, and in response to the user's clicking the screen-casting cancel button, ends the screen projection.

Taking the target application as the king of glory as an example, the user interface of the target application can be as shown in A in Figure 15. The source device recognizes the virtual button 1501 in A in Figure 15, and then performs the icon of the virtual button 1501. Re-cut and layout to obtain the virtual button 1502 shown in Figure 15 B, where the virtual button 1502 is a virtual button included on the control interface corresponding to the glory of the king, and its function is the same as that of the virtual button 1501. This allows the user to implement the same function when operating the virtual button 1502 as when operating the virtual button 1501. For example, the position coordinates of the virtual button 1502 are associated with the position coordinates of the virtual button 1501.

In some embodiments, the source device can identify the virtual button with touch function based on the related records of the historical usage of the target application (for example, the historical record of the user's click on the screen, etc.). Alternatively, the source device can identify a virtual button with a touch function according to a software development kit (SDK) interface provided by the target application. Alternatively, the source device may also use a location area for laying out virtual buttons with touch functions from the user interface of a predefined target application, and identify the virtual buttons with touch functions. In addition, the embodiments of the present application may also identify virtual buttons with touch functions in other ways. For example, the source device may perform semantic analysis on the user interface of the target application (for example, register information for virtual buttons with touch functions). Perform semantic analysis, etc.), perform image recognition on the user interface of the target application, and recognize virtual buttons with touch functions.

Further, limited by the capabilities of electronic devices, some applications may not be able to recognize virtual buttons with touch functions on the user interface. Therefore, in order to simplify the implementation of the display control interface on the external screen, the display on the external screen The user interface can meet the needs of users. If the source device does not recognize a virtual button with touch function on the user interface of the target application, it can be configured according to the control interface corresponding to different application types in advance. Determine the control interface corresponding to the target application type, and display the control interface on the external screen. For the specific implementation manner, refer to the related introduction in Example 1, which will not be repeated here.

Take the target application as an example. The user interface of the target application can be as shown in A in Figure 15. When the source device does not recognize the virtual button with touch function on the user interface shown in A in Figure 15, if the preset application The control interface corresponding to the game type is shown as C in Fig. 15, and the source device displays the control interface shown in C in Fig. 15 on the external screen. As shown in C in FIG. 15, the control interface includes a touch area. Users can swipe up, down, left, and right in the touch area to control the game.

The foregoing is only an example of the method for the source device to display the control interface corresponding to the target application on the external screen, and the specific implementation of the method for the source device to display the control interface corresponding to the target application on the external screen in the embodiment of the present application is not limited.

In some embodiments, based on steps 801 to 803, or based on

steps

801, 802, and steps 805 to 807, after the source device sends the screened content to the target device, if the user receives that the screen is closed from the closed state Expanded to expanded state, in response to receiving that the user expands the inner screen from the closed state to the expanded state, no more screen content is sent to the target device, and the user interface of the application where the screened content is displayed on the inner screen . For example, when the inner screen of the electronic device is in the closed state, the video on the user interface of iQiyi is sent to the smart TV. When the inner screen of the electronic device is expanded to the expanded state by the user, it responds to the user When the screen is expanded from the closed state to the expanded state, the screen projection is stopped, and the iQiyi user interface is mapped to the inner screen for display. Furthermore, the external screen no longer displays the control interface corresponding to iQiyi, for example, the external screen can be turned off.

Further, based on steps 801 to 803, or based on

steps

801, 802 and steps 805 to 807, after the target device receives the projected content sent by the source device, it can crop or re-layout the projected content, Present on the target device. For example, the source device can also crop or re-layout the content obtained from the target application according to the device attributes (such as resolution, touch capability, etc.) of the target device before sending the projected content In order to adapt to the projection content presented by the target device, the projection content is then sent to the target device. This helps to enable the target device to display the projected content normally.

It should be noted that the method for the source device to display the control interface corresponding to the target application on the external screen in the embodiment of this application can also be applied to other screen projection methods except the embodiment of this application. limited.

Example two:

The source device is an electronic device that only includes the first display screen, such as a tablet computer, a mobile phone, etc. For example, the first display screen of the source device may be the first display screen 141 shown in FIG. 4A, which is located on the front of the source device, and the back of the source device does not include a display screen.

As an example, as shown in FIG. 16, it is a schematic flowchart of another screen projection method according to an embodiment of this application, which specifically includes the following steps.

Step 1601: The first display screen of the source device is in use, and a screen-off operation on the first display screen is received. Among them, the first display screen of the source device is in use for specific introduction, please refer to the related introduction about the inner screen of the source device in use in step 1601, which will not be repeated here.

The screen-off operation of the first display screen may be an operation of the user pressing the power button, or a voice instruction of the user, or an operation of the user clicking a virtual button for controlling the screen-off, etc., which is not limited.

In step 1602, the source device turns off the first display screen in response to the turn-off operation on the first display screen.

Step 1603: After turning off the first display screen, the source device judges whether the smart screen projection function is turned on. If the smart screen projection function is turned on, step 1604 is executed. If the smart screen projection function is not turned on, the process ends .

Step 1604: The source device judges whether the first display screen is blocked. If the first display screen is blocked, the flow ends. If the first display screen is not blocked, step 1605 is executed.

Step 1605: The source device determines the target application from a currently running application. Among them, the source-end device determines the specific implementation manner of the target application from a currently running application, please refer to the related introduction in step 803, which will not be repeated here.

Step 1606: The source device obtains the screencast content from the target application, and sends the screencast content to the target device. For the relevant implementation of step 1606, refer to the relevant implementation of step 804, which will not be repeated here.

It should be noted that after performing step 1602, the source device may skip step 1603 and step 1604, and perform step 1605 and step 1606.

In other embodiments, as an alternative step of step 1605 and step 16076, after step 1602 or step 1604, the method may further include:

Step 1607: The source device displays the identification of at least one currently running application supporting the screen projection function and the identification of at least one electronic device for receiving screen projection content on a partial area of the first display screen.

It should be noted that, in the embodiment of the present application, the user can set on the first display screen as needed to display the identification of at least one currently running application that supports the projection function, and display at least one for receiving projection content. The size and position of the area of the identification of the electronic device, or, on the first display screen, used to display the identification of at least one currently running application program supporting the screen projection function, and display at least one electronic device for receiving screen projection content The size and location of the area identified by the device are set by the source device before leaving the factory, and there is no limitation on this. For example, as shown in FIG. 17, the source device displays the identification of at least one currently running application supporting the projection function on the area 1700 of the first display screen 141; and displays at least An identification of an electronic device used to receive screencast content. Specifically, the display of the identification of at least one currently running application supporting the screen projection function in a partial area of the first display screen, and the manner of displaying the identification of at least one electronic device for receiving screen projection content can be referred to in Example 1. Relevant introduction will not be repeated here.

Further, the source device may also display the identification of at least one currently running application supporting the screen projection function on a partial area of the first display screen, and when displaying the identification of at least one electronic device for receiving screen projection content, The time and date are also displayed on the first display screen.

Step 1608: After the source device receives the user’s selection of an application identifier from the identifiers of at least one currently running application that supports the screen projection function, it obtains the vote from the application identified by the identifier of the application selected by the user. Screen content, and send the screencast content to the electronic device identified by the identification of the electronic device selected by the user from the identifications of at least one electronic device for receiving the screencast content.

It should be noted that in this embodiment of the application, the user can perform corresponding operations on the identification of the application program and the identification of the electronic device displayed on a partial area of the first display screen when the first display screen is turned off, which is helpful To reduce the steps of user operation.

Further, in step 1608, when the source-end device receives the identifier of an application selected by the user from the identifiers of at least one currently running application supporting the screen projection function, and from at least one electronic device used to receive screen projection content After the identification of the electronic device selected in the identification of the device, or after the source device determines the target device for receiving the screened content, it displays the user interface being posted on a part of the first display screen, for example, The user interface shown in Figure 13.

Still further, based on steps 1601 to 1606, or based on

steps

1601, 1602, 1603, 1604, and steps 1607 to 1608, when the source device successfully sends the projected content to the target device, the first display screen The control interface is displayed on part of the area. Among them, for the specific introduction of displaying the control interface on a partial area of the first display screen, please refer to the related introduction of displaying the control interface on the external screen in Example 1.

It should also be noted that the area used to display the control interface on the first display screen and the area used to display the identification of the application program and the identification of the electronic device in step 1607 may be the same or different, which is not limited.

In some embodiments, based on steps 1601 to 1606, or, based on

steps

1601, 1602, 1603, 1604, and steps 1607 to 1608, after the source device sends the screened content to the target device, if the user receives Reuse the first display screen operation (for example, unlocking operation), in response to receiving the user's unlocking operation on the first display screen, the screen projection content is no longer sent to the target device, and the screen projection is displayed on the first display screen The user interface of the application where the content is located. The unlocking operation of the user on the first display screen may be an operation of inputting a fingerprint, an operation of inputting a password, etc., which is not limited.

For example, after the first display screen of the electronic device is turned off, the video on the user interface of iQiyi is sent to the smart TV. When the first display screen of the electronic device is unlocked, the screen projection is stopped and the love The user interface of Qiyi is mapped to the first display screen for display.

Further, based on steps 1601 to 1606, or based on

steps

1601, 1602, 1603, 1604, and steps 1607 to 1608, after the target device receives the screen content sent by the source device, it can crop the screen content Or after re-layout, it is presented on the target device. For example, the source device can also crop or re-layout the content obtained from the target application according to the device attributes (such as resolution, touch capability, etc.) of the target device before sending the projected content In order to adapt to the projection content presented by the target device, the projection content is then sent to the target device. This helps to enable the target device to display the projected content normally.

Example three:

Compared with the second embodiment, the source device is an electronic device including a first display screen and a second display screen. For example, the first display screen of the source device may be the first display screen 141 shown in FIG. 4A, which is located on the front of the source device, and the second display screen of the source device may be the second display screen 142 shown in FIG. 4B. Located on the back of the source device.

For example, as shown in FIG. 18, it is a schematic flowchart of another screen projection method according to an embodiment of this application, which specifically includes the following

steps

1601 and 1602, and after performing step 1602, the following steps are also performed:

Step 1803: After turning off the first display screen, the source device judges whether the smart screen projection function is turned on. If the smart screen projection function is turned on, step 1804 is executed. If the smart screen projection function is not turned on, the process ends .

Step 1804: The source device judges whether the first display screen and the second display screen are blocked. If both the first display screen and the second display screen are blocked, the flow ends. If one of the first display screen or the second display screen is not blocked, step 1805 is executed.

For example, the source device first determines whether the second display screen is blocked. If the second display screen is not blocked, then step 1805 is executed. If the second display screen is blocked, then it determines whether the first display screen is blocked. If the first display screen is not blocked, step 1805 is executed. If the first display screen is blocked, the process ends.

Step 1805: The source device determines the target application from a currently running application. Among them, the source-end device determines the specific implementation manner of the target application from a currently running application, please refer to the related introduction in step 803, which will not be repeated here.

Step 1806: The source device obtains the screencast content from the target application, and sends the screencast content to the target device. For the relevant implementation of step 1806, refer to the relevant implementation of step 604, which will not be repeated here.

It should be noted that after performing step 1602, the source device may skip step 1803 and step 1804, and perform step 1805 and step 1806.

In other embodiments, as an alternative step of step 1805 and step 1806, after step 1803 or step 1804, the method may further include:

Step 1807: When the second display screen is not blocked, the source device displays the identification of at least one currently running application program supporting the projection function on the second display screen, and displays at least one electronic device for receiving projection content. The identification of the device. When the second display screen of the source device is blocked and the first display screen is not blocked, a partial area of the first display screen displays the identification of at least one currently running application that supports the projection function, and displays at least one The identification of the electronic device that receives the projected content.

It should be noted that the specific implementation of displaying the identification of at least one currently running application supporting the screen projection function and displaying the identification of at least one electronic device for receiving screen projection content on the second display screen can be found in the example The related description of the first one will not be repeated here. In a partial area of the first display screen, the identification of at least one currently running application that supports the screen projection function is displayed, and the way of displaying the identification of at least one electronic device for receiving screen projection content can refer to the related introduction in Example 2. I will not repeat them here.

Step 1808: After the source device receives the user’s selection of an application identifier from the identifiers of at least one currently running application that supports the screen projection function, it obtains the vote from the application identified by the identifier of the application selected by the user. Screen content, and send the screencast content to the electronic device identified by the identification of the electronic device selected by the user from the identifications of at least one electronic device for receiving the screencast content.

Further, in step 1808, when the source-end device receives the identifier of an application selected by the user from the identifiers of at least one currently running application supporting the screen projection function, and from at least one electronic device for receiving screen projection content After the identification of the electronic device selected in the identification of the device, or after the source device determines the target device for receiving the screened content, it displays the user interface being posted on a part of the first display screen, for example, The user interface shown in Figure 13.

Furthermore, based on

steps

1601, 1602, and steps 1803 to 1806, or, based on

steps

1601, 1602, 1803, 1804, and steps 1807 to 1808, when the source device successfully sends the projected content to the target device, The control interface is displayed on a partial area of the first display screen or on the second display screen. Wherein, the control interface includes virtual buttons with touch function. It should be noted that, for the specific implementation of displaying the control interface on a partial area of the first display screen or on the second display screen, refer to the related introduction in Example 1.

It should also be noted that the area used to display the control interface on the first display screen and the area used to display the identification of the application program and the identification of the electronic device in step 1808 may be the same or different, which is not limited.

Example four:

The source device is an electronic device that includes a flip cover, such as a flip phone. As shown in Figure 19, it includes an inner screen and an outer screen. The inner screen is located inside the mobile phone cover, not shown in the figure, and the outer screen is located outside the mobile phone cover. The following takes the source device as a flip phone as an example. In this scenario, compared with the electronic device with a foldable screen in the example 1, the only difference in the projection method is that the source device is a flip phone. When using a mobile phone, the source device receives the user's operation to close the cover of the mobile phone and turns off the internal screen. After opening the cover of the mobile phone, the source device can unlock the internal screen in response to the user outputting a password or long pressing a preset key (for example, # key or * key or combination key, etc.). That is, in the scenario of a flip phone, when the source device receives the user's operation to close the phone cover when using the internal screen normally, it will respond to the user closing the phone cover to lock the internal screen, and then trigger the screen projection. Refer to Example 1, where the source device executes the steps after step 802, which will not be repeated here.

Example five:

The source device may also be an electronic device installed with a smart protective cover. Taking the source device as the electronic device 10 as an example, for example, as shown in FIG. 20, the electronic device 10 includes a first display screen 141, and the electronic device 10 is carded to the smart In the protective cover 20, the smart protective cover 20 includes a visualization area 18. Among them, after the user closes the cover 16 of the smart protective cover 20, it can be as shown in C in FIG. 20. After the user opens the cover 16 of the smart protective sleeve 20, it can be shown as B in FIG. 20.

In this scenario, compared with the electronic device with a foldable screen in the source device in Example 1, the only difference in the screen projection method is that in the scenario of an electronic device with a smart protective cover, the source device receives When the user closes the cover of the smart protective sleeve, the first display screen is turned off. After opening the cover of the smart protective cover, the source device can unlock the first display screen in response to the user's output of a password, fingerprint, etc. That is, in the scenario of an electronic device equipped with a smart protective cover, when the source device receives the user's operation to close the cover of the smart protective cover when using the first display screen normally, it will respond to the user's closing of the mobile phone cover. A screen locks the screen and then triggers screen projection. For details, please refer to Example 1, where the source device executes the steps after step 602, which will not be repeated here.

It should be noted that in this scenario, the identification of the application, the identification of the electronic device, and the control interface can be displayed in the visualization area 17 of the smart protective cover 20. For the specific display mode, please refer to the related introduction in Example 1. This will not be repeated here.

In addition, in other embodiments, when the source device does not need to prompt the user with the identification of the application program, the identification of the electronic device, or the control interface, the smart cover may not include the visualization area.

Example 6

The source device can also be another electronic device with a foldable screen. The source device includes a first display screen, and the first display screen is a foldable screen. For example, when the first display screen of the source device is in the unfolded state, the first display screen 141 as shown in FIG. 5A may be used, and when the first display screen of the source device is in the closed state, it may be as shown in FIG. 5B. When the first display screen shown in 5B is in the closed state, the source device can present a corresponding interface to the user through the area 500 in the first display screen 141. In this scenario, the first display screen of the source device is in the unfolded state and is in use, and an operation to fold the first display screen from the unfolded state to the closed state is received, triggering a screen projection to the target device. See the related introduction in Example 1 for the projection method of. For example, the source device receives an operation to fold the first display screen 141 from the unfolded state to the closed state. If the projection fails, it can map the content displayed on the first display screen 141 before receiving the operation to the folded state. It is displayed in the area 500 of the first display screen 141. If the projection is successful, the control interface can be displayed in the area 1500 of the first display screen 141. The control interface can be displayed in the area 1500 of the first display screen 141. See the related introduction in Example 1.

Further, in other embodiments, when the first display screen of the source device is in the closed state, it receives an operation to expand the first display screen from the closed state to the unfolded state, and in response to the foregoing operation, stops projection. For example, after the source device stops the screen projection, it can automatically display the user interface where the screen projection content is located on the first display screen.

Example Seven

The source device may also be an electronic device with a retractable screen, including a first display screen, where the first display screen is a retractable display screen. For example, the state of the first display screen of the source device after being stretched may be as shown in FIG. 6A, and the state of the first display screen after being contracted may be as shown in FIG. 6B. In this scenario, the first display screen of the source device is in the extended state and is in use, and the contraction operation of the first display screen is received, which triggers projection to the target device. For the specific projection method, see Related introduction in example one. For example, after the source device receives the shrinking operation on the first display screen 141, if the projection fails, it may map the content displayed on the first display screen 141 before receiving the operation to the shrinking first display screen 141 If the projection is successful, the control interface can be displayed in the area 600 of the first display screen 141. For the manner of displaying the control interface in the area 600 of the first display screen 141, see Example 1 Related introduction.

Further, in some other embodiments, the first display screen of the source device receives the stretching operation of the first display screen in the retracted state, and in response to the above operation, the screen projection is stopped. For example, after the source device stops the screen projection, it can automatically display the user interface where the screen projection content is located on the first display screen.

The above embodiments can be used alone or in combination with each other to achieve different functions.

In the above-mentioned embodiments provided in the present application, the method provided in the embodiments of the present application is introduced from the perspective of an electronic device as an execution subject. In order to realize the functions in the methods provided in the above embodiments of the present application, the electronic device may include a hardware structure and/or a software module, and realize the above functions in the form of a hardware structure, a software module, or a hardware structure plus a software module. Whether one of the above-mentioned functions is executed in a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraint conditions of the technical solution.

Based on the same concept, FIG. 21 shows a device 2100 provided by this application for executing the screen projection method shown in FIG. 8, FIG. 16, or FIG. 18. For example, the device 2100 includes a processing module 2101 and a transceiver module 2102.

For example, the processing module 2101 is configured to detect user operations, and in response to the user operations, trigger the transceiver module 2102 to send the screened content to the target device.

Based on the same concept, FIG. 22 shows a device 2200 provided in this application. The device 2200 includes at least one processor 2210, a memory 2220, and a transceiver 2230. The processor 2210 is coupled with the memory 2220 and the transceiver 2230. The coupling in the embodiment of the present application is an indirect coupling or a communication connection between devices, units or modules, which can be electrical, mechanical or other forms for the device , Information exchange between units or modules. The embodiment of the present application does not limit the connection medium between the transceiver 2230, the processor 2210, and the memory 2220. For example, in the embodiment of the present application in FIG. 22, the memory 2220, the processor 2210, and the transceiver 2230 may be connected by a bus, and the bus may be divided into an address bus, a data bus, and a control bus.

Specifically, the memory 2220 is used to store program instructions.

The transceiver 2230 is used to send screen content, control instructions, etc. to the target device.

The processor 2210 is configured to call program instructions stored in the memory 2220, so that the device 2200 executes the screen projection method shown in FIG. 8, FIG. 16, or FIG. 18.

In the embodiment of the present application, the processor 2210 may be a general-purpose processor, a digital signal processor, an application specific integrated circuit, a field programmable gate array or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component. Or execute the methods, steps, and logical block diagrams disclosed in the embodiments of the present application. The general-purpose processor may be a microprocessor or any conventional processor. The steps of the method disclosed in the embodiments of the present application may be directly embodied as being executed and completed by a hardware processor, or executed and completed by a combination of hardware and software modules in the processor.

In the embodiment of the present application, the memory 2220 may be a non-volatile memory, such as a hard disk drive (HDD) or a solid-state drive (SSD), etc., and may also be a volatile memory (volatile memory). For example, random-access memory (RAM). The memory is any other medium that can be used to carry or store desired program codes in the form of instructions or data structures and that can be accessed by a computer, but is not limited thereto. The memory in the embodiments of the present application may also be a circuit or any other device capable of realizing a storage function, for storing program instructions and/or data.

It should be understood that the device 1300 and the device 2200 may be used to implement the method shown in FIG. 8, FIG. 16, or FIG. 18 in the embodiment of the present application. For related features, refer to the above, and details are not described herein again.

Those skilled in the art can clearly understand that the embodiments of the present application can be implemented by hardware, firmware, or a combination of them. When implemented by software, the above functions can be stored in a computer-readable medium or transmitted as one or more instructions or codes on the computer-readable medium. The computer-readable medium includes a computer storage medium and a communication medium, where the communication medium includes any medium that facilitates the transfer of a computer program from one place to another. The storage medium may be any available medium that can be accessed by a computer. Take this as an example but not limited to: computer-readable media may include RAM, ROM, electrically erasable programmable read-only memory (EEPROM), compact disc read-only memory, CD- ROM) or other optical disk storage, magnetic disk storage media or other magnetic storage devices, or any other media that can be used to carry or store desired program codes in the form of instructions or data structures and that can be accessed by a computer. In addition. Any connection can suitably become a computer-readable medium. For example, if the software is transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technology such as infrared, radio, and microwave, Then coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, wireless and microwave are included in the fixing of the media. As used in the embodiments of this application, disks and discs include compact discs (CDs), laser discs, optical discs, digital video discs (digital video discs, DVDs), floppy discs, and Blu-ray discs. Disks usually copy data magnetically, while disks use lasers to copy data optically. The above combination should also be included in the protection scope of the computer-readable medium.

In short, the above descriptions are only examples of the present application, and are not used to limit the protection scope of the present application. Any modification, equivalent replacement, improvement, etc. made according to the disclosure of this application shall be included in the protection scope of this application.

Claims

A screen projection method, characterized in that the method is applied to a first electronic device, the first electronic device includes an inner screen and an outer screen, the inner screen is a foldable screen, and the method includes:

The first electronic device receives an operation of folding the inner screen from an unfolded state to a closed state;

In response to the operation of folding the inner screen from the expanded state to the closed state, the first electronic device locks the inner screen, and obtains the screencast content from the target application in at least one currently running application ；

The first electronic device sends the projected content to the second electronic device.
The method according to claim 1, wherein, in response to the operation of folding the inner screen from the unfolded state to the closed state, after the inner screen of the first electronic device is locked, the current running Before acquiring the screencast content in the target application of at least one application, the method further includes:

Make sure that the smart screen projection function is turned on; and/or

Prompt the user whether to allow screen projection, and receive the user's permission to cast screen; and/or,

It is determined that the external screen is not blocked.
The method of claim 2, wherein the method further comprises:

If the external screen is blocked, the first electronic device no longer casts a screen.
The method according to any one of claims 1 to 3, wherein, after the first electronic device sends the projected content to the second electronic device, the method further comprises:

The first electronic device displays a control interface on the external screen, and the control interface is used to implement shortcut operations on the target application.
The method according to claim 4, wherein the first electronic device displaying a control interface on the external screen comprises:

The first electronic device recognizes a virtual button with a touch function in the target application, and displays the control interface on the external screen according to the virtual button with a touch function; and/or,

The first electronic device determines the control interface corresponding to the type of the target application from the preset control interface corresponding to the type of the application, and displays the control interface corresponding to the target application on the external screen. The control interface corresponding to the type.
The method according to any one of claims 1 to 5, wherein before the first electronic device obtains the projected content from a target application in at least one currently running application, the method further comprises:

Displaying, on the external screen, the first electronic device an identifier of at least one application that supports a screen projection function among at least one currently running application;

The first electronic device receives the user's operation of selecting the identifier of the application program displayed on the external screen;

In response to the operation of the user selecting the identification of the application displayed on the external screen, it is determined that the target application is the application identified by the identification of the application selected by the user.
The method according to any one of claims 1 to 6, wherein after the first electronic device locks the inner screen of the first electronic device, the screen content is sent to the second electronic device. Before the device, the method further includes:

Acquiring the identification of at least one electronic device by the first electronic device;

The first electronic device determines the identification of the target electronic device from the identification of the at least one electronic device, and the identification of the target electronic device is used to identify the second electronic device.
8. The method of claim 7, wherein the first electronic device determines the identification of the target electronic device from the identification of the at least one electronic device, comprising:

The first electronic device determines, from the identification of the at least one electronic device, the identification used to identify the private electronic device as the identification of the target electronic device.
8. The method of claim 7, wherein the first electronic device determines the identification of the target electronic device from the identification of the at least one electronic device, comprising:

The first electronic device displays the identification of at least one electronic device on the external screen;

The first electronic device receives an operation that the user selects the identification of the electronic device displayed on the external screen;

The first electronic device uses the identification of the electronic device selected by the user as the identification of the target electronic device.
The method according to claim 9, wherein each of the identifications of the at least one electronic device is used to identify a public electronic device.
The method according to any one of claims 1 to 10, wherein after the first electronic device sends the screencast content to the second electronic device, the method further comprises:

The first electronic device receives an operation to expand the inner screen from a closed state to an expanded state;

In response to the operation of expanding the inner screen from the closed state to the expanded state, the first electronic device stops the screen projection, and displays the projection content on the inner screen.
A device, characterized in that the device includes a processor and a memory;

Program instructions are stored in the memory;

When the program instructions are executed, the device is caused to execute the method according to any one of claims 1 to 11.
A chip, characterized in that the chip is coupled with a memory in an electronic device, so that the chip invokes program instructions stored in the memory during operation to implement the method according to any one of claims 1 to 11.
A computer-readable storage medium, characterized in that, the computer-readable storage medium includes program instructions, when the program instructions run on a device, the device executes any one of claims 1 to 11 Methods.