CN112988102B

CN112988102B - Screen projection method and device

Info

Publication number: CN112988102B
Application number: CN202110513653.XA
Authority: CN
Inventors: 李创军
Original assignee: Honor Device Co Ltd
Current assignee: Honor Device Co Ltd
Priority date: 2021-05-11
Filing date: 2021-05-11
Publication date: 2021-09-14
Anticipated expiration: 2041-05-11
Also published as: CN112988102A

Abstract

The embodiment of the application provides a screen projection method and a screen projection device, wherein the method comprises the following steps: the method comprises the steps that first electronic equipment receives a first screen projection request from second electronic equipment, and screen projection content of the second electronic equipment is displayed at a first target position according to the first screen projection request; the third electronic equipment receives screen projection operation for triggering the second screen projection request sent to the first electronic equipment, and displays a first user interface; when the third electronic equipment receives an operation for indicating to acquire the master control right, a second screen projection request is sent to the first electronic equipment; the first electronic equipment displays the screen projection content of the third electronic equipment at the second target position according to the second screen projection request; the third electronic equipment sends adjustment indication information to the first electronic equipment; the first electronic device adjusts the display layout of the screen projection content of the electronic device to be adjusted according to the adjustment indication information, so that the first electronic device can receive requests of a plurality of screen projection devices at the same time and support personalized screen projection requirements of the plurality of screen projection devices.

Description

Screen projection method and device

Technical Field

The present application relates to the field of communications technologies, and in particular, to a screen projection method and apparatus.

Background

With the development of terminal technology, more and more terminals have a screen projection function, for example, in the scenes of family, work, teaching and game competition, the currently displayed picture of the electronic equipment can be projected to a large screen for display, so that people can conveniently watch the picture content.

In the prior art, a screen projection method adopted by a user may be to project display content of an electronic device onto a screen projected device, and the screen projected device generally has a larger display screen, for example, a user a may project a game interface 1 displayed in a mobile phone 1 into a television for display, and a user B may project a game interface 2 displayed in a mobile phone 2 into the television for display.

However, the currently adopted screen projection method is one-to-one screen projection, and the screen projection mode is not flexible enough.

Disclosure of Invention

The embodiment of the application provides a screen projection method and device, which are applied to a screen projection system, and a projected screen device can receive requests of a plurality of screen projection devices at the same time and support the personalized screen projection requirements of the plurality of screen projection devices.

In a first aspect, an embodiment of the present application provides a screen projection method, which is applied to a screen projection system, where the screen projection system includes a first electronic device, a second electronic device, and a third electronic device, and the method includes: the method comprises the steps that a first electronic device receives a first screen projection request from a second electronic device; the first electronic equipment displays screen projection content of the second electronic equipment at a first target position according to the first screen projection request; the third electronic equipment receives screen projection operation for triggering the second screen projection request sent to the first electronic equipment; responding to screen projection operation, and displaying a first user interface by the third electronic equipment, wherein the first user interface comprises information for prompting whether to acquire a master control right; when the third electronic equipment receives an operation for indicating to acquire the master control right, the third electronic equipment sends a second screen projection request to the first electronic equipment; the first electronic equipment displays the screen projection content of the third electronic equipment at the second target position according to the second screen projection request; the third electronic equipment sends adjustment indication information to the first electronic equipment, wherein the adjustment indication information is used for indicating and adjusting the display layout of the screen projection content of the electronic equipment to be adjusted; the electronic equipment to be adjusted comprises first electronic equipment, second electronic equipment and/or third electronic equipment; and the first electronic equipment adjusts the display layout of the screen projection content of the electronic equipment to be adjusted according to the adjustment indication information.

Based on this, in this embodiment of the application, the first electronic device may receive screen projection of the second electronic device and the third electronic device at the same time, and may support personalized screen projection requirements of the second electronic device and the third electronic device, further, a display layout of the second electronic device and the third electronic device on the first electronic device may be adjusted by the electronic device with the master control right, and the electronic device with the master control right may also be replaced, so that diversity of the display layout and operation flexibility of the first electronic device are improved.

In a possible implementation manner, before the third electronic device sends the instruction information for adjusting to the first electronic device, the method further includes: the third electronic device displays a second user interface including an option for selecting the electronic device to be adjusted and one or more of the following functional options: narrowing function options, enlarging function options, monopolizing function options, grading function options or equipment hanging function options; the third electronic equipment determines the electronic equipment to be adjusted according to the option for selecting the electronic equipment to be adjusted; the third electronic equipment obtains the adjustment mode of the electronic equipment to be adjusted according to the selected function option; the adjustment indication information includes an identifier of the electronic device to be adjusted and an adjustment mode of the electronic device to be adjusted. In this way, the third electronic device may select the option of the electronic device to be adjusted and the one or more function options in the second user interface displayed by the third electronic device to adjust the display layout of the screen projection content of the electronic device to be adjusted.

In a possible implementation manner, before the third electronic device sends the instruction information for adjusting to the first electronic device, the method further includes: the third electronic equipment displays the display state in the first electronic equipment, wherein the display state comprises the display position and the display area size of each screen projection content in the first electronic equipment; the third electronic equipment receives the dragging operation of the display position and/or the display area size of any screen-casting content by the input equipment; the third electronic equipment obtains an adjusting mode of the electronic equipment to be adjusted according to the dragging operation; the adjustment indication information includes an identifier of the electronic device to be adjusted and an adjustment mode of the electronic device to be adjusted. In this way, the third electronic device may receive a drag operation of the input device on a display position and/or a display area size of any screen-projected content in the third electronic device to adjust the display layout of the screen-projected content of the electronic device to be adjusted.

In a possible implementation manner, the adjusting, by the first electronic device, the display layout of the screen projection content of the electronic device to be adjusted according to the adjustment instruction information includes: the first electronic equipment responds to the adjustment indication information to transparently and suspendedly display screen projection content of the electronic equipment to be adjusted; when the screen projection content of the electronic equipment to be adjusted, which is displayed in a transparent suspension manner, is adjusted to accord with the adjustment mode by the first electronic equipment, the screen projection content of the electronic equipment to be adjusted is normally displayed at the adjusted position by the first electronic equipment. In this way, when the first electronic device adjusts the display layout of the screen projection content of the electronic device to be adjusted according to the adjustment indication information, the display layout of the first electronic device can be adjusted to the display layout according with the indication information in a manner of transparently displaying the screen projection content of the electronic device to be adjusted in a floating manner.

In a possible implementation, the method further includes: the method comprises the steps that the first electronic equipment receives remote control information from a remote controller, the remote control information is used for controlling display contents selected by the remote controller to achieve monopolization or equipment suspension, or the remote control information is used for controlling a display area of the first electronic equipment to be divided equally or the display area to be selected, or the remote control information is used for changing the number of the electronic equipment allowed to be accessed by the first electronic equipment; the first electronic device controls display of a plurality of screen-projected contents in the first electronic device according to the remote control information. In this way, the first electronic device can receive the remote control information of the remote controller to adjust the display layout of the screen projection content of the electronic device to be adjusted.

In a possible implementation manner, before the first electronic device receives the remote control information from the remote controller, the method further includes: the method comprises the steps that first electronic equipment receives indication information used for obtaining a master control right from a remote controller; the first electronic equipment sends a request for acquiring the master control right to the third electronic equipment; the first electronic device receives an agreement reply from the third electronic device. In this way, the remote controller may access the master control right of the first electronic device by sending a request for acquiring the master control right to the first electronic device, and the first electronic device sends the request to the third electronic device.

In one possible implementation manner, before the first electronic device receives the first screen-projection request from the second electronic device, the method further includes: the second electronic device displaying a third user interface, the third user interface including a display area option and/or a display location on the first electronic device; the second electronic equipment receives user operation for selecting the first display area option and/or user operation for selecting the first target position; and the second electronic equipment sends a first screen projection request to the first electronic equipment, wherein the first screen projection request comprises information of the first display area option and/or information of the first target position. In this way, the first electronic device may display the screen-projected content of the second electronic device at the first target location of the first electronic device by receiving a first screen-projection request from the second electronic device.

In one possible implementation manner, when any electronic device that realizes screen projection in the first electronic device sends a network failure or is suspended, the first electronic device adjusts a display layout of screen projection contents of other electronic devices that normally project screens. Therefore, when the screen projection content of any electronic device in the first electronic device has a network fault or is suspended, the first electronic device can intelligently regulate and control the display layout of the screen projection content of other electronic devices in the first electronic device.

In one possible implementation manner, when any electronic device that implements screen projection in a first electronic device sends a network failure or is suspended, the first electronic device adjusts a display layout of screen projection contents of other electronic devices that normally project screens, including: the first electronic equipment enlarges the display areas of the screen projection contents of other electronic equipment so as to jointly occupy the display areas in front of any electronic equipment; or the first electronic equipment enlarges the display area of the screen projection content of one or more of the other electronic equipment. Therefore, after the display layout of the screen projection content of other electronic equipment in the first electronic equipment is intelligently regulated and controlled by the first electronic equipment, the display layout of the first electronic equipment can have multiple display modes, and the diversity of the display layout of the first electronic equipment is improved.

In one possible implementation manner, the first electronic device communicates with the second electronic device and the third electronic device respectively by using a first screen projection protocol; in the first screen projection protocol, when the screen projection device is supported to initiate screen projection to the screen projected device, one or more of the following contents are specified: the channel number of the screen projection content when displayed in the screen projection device, the number of devices allowed to be accessed, a full-screen display mode or a split-screen display mode, the position of split-screen display in the screen projection device and the area of split-screen display in the screen projection device. In this way, the first electronic device, the second electronic device and the third electronic device can establish a screen-projecting connection path by using the first screen-projecting protocol to realize communication, and the screen-projected device can receive requests of a plurality of screen-projected devices at the same time.

In a possible implementation manner, in the first screen-casting protocol, when the screen-cast device replies a request for screen casting to the screen-casting device, the screen-cast device further indicates one or more of the following items: the screen projection device comprises an identification of the screen projection device, a display position of the screen projection device, a display area of the screen projection device, information for identifying whether the screen projection device is a main control device, and information for inquiring whether the screen projection device requests a main control right. In this way, the screen-projected device can support the personalized screen-projecting requirement of the screen-projecting device when replying a request for screen projection to the screen-projecting device.

In a second aspect, an embodiment of the present application provides a screen projection method, where the method includes: the method comprises the steps that a first electronic device receives a first screen projection request from a second electronic device; the first electronic equipment displays screen projection content of the second electronic equipment at a first target position according to the first screen projection request; the first electronic equipment receives a second screen projection request from the third electronic equipment; wherein the third electronic device has a master control right; the first electronic equipment displays the screen projection content of the third electronic equipment at the second target position according to the second screen projection request; the first electronic equipment receives adjustment indication information from the third electronic equipment, wherein the adjustment indication information is used for indicating and adjusting the display layout of screen projection content of the electronic equipment to be adjusted; the electronic equipment to be adjusted comprises first electronic equipment, second electronic equipment and/or third electronic equipment; and the first electronic equipment adjusts the display layout of the screen projection content of the electronic equipment to be adjusted according to the adjustment indication information.

In a possible implementation manner, the adjusting, by the first electronic device, the display layout of the screen projection content of the electronic device to be adjusted according to the adjustment instruction information includes: the first electronic equipment responds to the adjustment indication information to transparently and suspendedly display screen projection content of the electronic equipment to be adjusted; when the screen projection content of the electronic equipment to be adjusted, which is displayed in a transparent suspension manner, is adjusted to accord with the adjustment mode by the first electronic equipment, the screen projection content of the electronic equipment to be adjusted is normally displayed at the adjusted position by the first electronic equipment.

In a possible implementation, the method further includes: the method comprises the steps that the first electronic equipment receives remote control information from a remote controller, the remote control information is used for controlling display contents selected by the remote controller to achieve monopolization or equipment suspension, or the remote control information is used for controlling a display area of the first electronic equipment to be divided equally or the display area to be selected, or the remote control information is used for changing the number of the electronic equipment allowed to be accessed by the first electronic equipment; the first electronic device controls display of a plurality of screen-projected contents in the first electronic device according to the remote control information.

In a possible implementation manner, before the first electronic device receives the remote control information from the remote controller, the method further includes: the method comprises the steps that first electronic equipment receives indication information used for obtaining a master control right from a remote controller; the first electronic equipment sends a request for acquiring the master control right to the third electronic equipment; the first electronic device receives an agreement reply from the third electronic device.

In one possible implementation, the first screen-projection request includes information of the first display area option, and/or information of the first target location.

In one possible implementation manner, when any electronic device that realizes screen projection in the first electronic device sends a network failure or is suspended, the first electronic device adjusts a display layout of screen projection contents of other electronic devices that normally project screens.

In one possible implementation manner, when any electronic device that implements screen projection in a first electronic device sends a network failure or is suspended, the first electronic device adjusts a display layout of screen projection contents of other electronic devices that normally project screens, including: the first electronic equipment enlarges the display areas of the screen projection contents of other electronic equipment so as to jointly occupy the display areas in front of any electronic equipment; or the first electronic equipment enlarges the display area of the screen projection content of one or more of the other electronic equipment.

In one possible implementation manner, the first electronic device communicates with the second electronic device and the third electronic device respectively by using a first screen projection protocol; in the first screen projection protocol, when the screen projection device is supported to initiate screen projection to the screen projected device, one or more of the following contents are specified: the channel number of the screen projection content when displayed in the screen projection device, the number of devices allowed to be accessed, a full-screen display mode or a split-screen display mode, the position of split-screen display in the screen projection device and the area of split-screen display in the screen projection device.

In a possible implementation manner, in the first screen-casting protocol, when the screen-cast device replies a request for screen casting to the screen-casting device, the screen-cast device further indicates one or more of the following items: the screen projection device comprises an identification of the screen projection device, a display position of the screen projection device, a display area of the screen projection device, information for identifying whether the screen projection device is a main control device, and information for inquiring whether the screen projection device requests a main control right.

In a third aspect, an embodiment of the present application provides a screen projection method, where the method includes: the third electronic equipment receives screen projection operation for triggering the second screen projection request sent to the first electronic equipment; responding to screen projection operation, and displaying a first user interface by the third electronic equipment, wherein the first user interface comprises information for prompting whether to acquire a master control right; when the third electronic equipment receives an operation for indicating to acquire the master control right, the third electronic equipment sends a second screen projection request to the first electronic equipment; the third electronic equipment sends adjustment indication information to the first electronic equipment, wherein the adjustment indication information is used for indicating and adjusting the display layout of the screen projection content of the electronic equipment to be adjusted; the electronic equipment to be adjusted comprises first electronic equipment, second electronic equipment and/or third electronic equipment; the adjustment indication information includes an identifier of the electronic device to be adjusted and an adjustment mode of the electronic device to be adjusted.

In a possible implementation manner, before the third electronic device sends the instruction information for adjusting to the first electronic device, the method further includes: the third electronic device displays a second user interface including an option for selecting the electronic device to be adjusted and one or more of the following functional options: narrowing function options, enlarging function options, monopolizing function options, grading function options or equipment hanging function options; the third electronic equipment determines the electronic equipment to be adjusted according to the option for selecting the electronic equipment to be adjusted; and the third electronic equipment obtains the adjustment mode of the electronic equipment to be adjusted according to the selected function option.

In a possible implementation manner, before the third electronic device sends the instruction information for adjusting to the first electronic device, the method further includes: the third electronic equipment displays the display state in the first electronic equipment, wherein the display state comprises the display position and the display area size of each screen projection content in the first electronic equipment; the third electronic equipment receives the dragging operation of the display position and/or the display area size of any screen-casting content by the input equipment; and the third electronic equipment obtains the adjustment mode of the electronic equipment to be adjusted according to the dragging operation.

In one possible implementation manner, the first electronic device and the third electronic device implement communication by using a first screen projection protocol; in the first screen projection protocol, when the screen projection device is supported to initiate screen projection to the screen projected device, one or more of the following contents are specified: the channel number of the screen projection content when displayed in the screen projection device, the number of devices allowed to be accessed, a full-screen display mode or a split-screen display mode, the position of split-screen display in the screen projection device and the area of split-screen display in the screen projection device.

In a fourth aspect, an embodiment of the present application provides a screen projection system, which includes a first electronic device as described in the first aspect above, and a third electronic device as described in the first aspect above, and the system may perform the method of the first aspect above.

In a fifth aspect, an electronic device provided in an embodiment of the present application includes: a processor and a memory; the memory stores computer-executable instructions; the processor executes computer-executable instructions stored by the memory, causing the processor to perform the method of the second aspect.

In a sixth aspect, an embodiment of the present application provides an electronic device, including: a processor and a memory; the memory stores computer-executable instructions; the processor executes computer-executable instructions stored by the memory, causing the processor to perform the method according to the third aspect.

In a seventh aspect, an embodiment of the present application provides a chip, where the chip is coupled to a memory in an electronic device, and is configured to call a computer program stored in the memory and execute the method of the second aspect or the third aspect; "coupled" in the context of this application means that two elements are joined to each other either directly or indirectly.

In an eighth aspect, embodiments of the present application provide a computer-readable storage medium, which includes a computer program, when the computer program runs on an electronic device, causing the electronic device to execute the method of the second aspect or the third aspect.

In a ninth aspect, embodiments of the present application provide a computer program product, which includes instructions that, when executed on a computer, cause the computer to perform the method of the second or third aspect.

In a tenth aspect, embodiments of the present application provide a graphical user interface on an electronic device, the electronic device having a display screen, one or more memories, and one or more processors for executing one or more computer programs stored in the one or more memories, the graphical user interface comprising a graphical user interface displayed when the electronic device performs the method of the second or third aspect.

For the beneficial effects of the possible implementation manners of the second aspect to the tenth aspect, reference may be made to the beneficial effects brought by the possible implementation manners of the first aspect and the first aspect, and details are not repeated herein.

Drawings

Fig. 1 is a schematic view of a scenario provided in an embodiment of the present application;

fig. 2 is a schematic diagram of a hardware system architecture of an electronic device according to an embodiment of the present disclosure;

FIG. 3 is a schematic diagram of a screen shot interface in one possible implementation;

FIG. 4 is a flow chart of a typical screen projection protocol;

fig. 5 is a schematic flow chart of a screen projection protocol provided in an embodiment of the present application;

fig. 6 is a schematic view of a scenario provided by an embodiment of the present application;

FIG. 7 is a schematic diagram illustrating an interaction flow of a method provided by an embodiment of the present application;

fig. 8 is a schematic display interface diagram of a first electronic device according to an embodiment of the present disclosure;

fig. 9 is a schematic view of a mobile phone interface when a screen-casting connection is established between a mobile phone and a large screen according to an embodiment of the present application;

fig. 10 is a schematic interface diagram of another screen-projection connection between a mobile phone and a large screen according to an embodiment of the present application;

FIG. 11 is an interface diagram of a default layout mode of a large screen according to an embodiment of the present application;

fig. 12 is an interface diagram illustrating access to a master right of a first electronic device according to an embodiment of the present application;

fig. 13 is an interface schematic diagram of a third electronic device obtaining a master right to a first electronic device according to an embodiment of the present application;

fig. 14 is an interface diagram illustrating that a remote controller according to an embodiment of the present application obtains a master right to a first electronic device;

fig. 15 is an interface schematic diagram of three possible adjusted display layouts of the first electronic device according to the embodiment of the present application;

fig. 16 is an interface schematic diagram of an adjusted display layout of another electronic device in a large-screen interface according to an embodiment of the present application;

fig. 17 is a schematic view of a process interface when a large screen performs an operation of adjusting a display layout according to an embodiment of the present application;

FIG. 18 is a schematic diagram of an interface for adjusting a large-screen display layout according to an embodiment of the present application;

FIG. 19 is a schematic diagram of another interface for adjusting a large screen display layout according to an embodiment of the present application;

fig. 20 is an interface diagram illustrating adjustment of a display layout when any electronic device is abnormally disconnected according to an embodiment of the present disclosure;

fig. 21 is a schematic interface diagram illustrating another interface for adjusting a display layout when any electronic device is abnormally disconnected according to an embodiment of the present application;

FIG. 22 is a schematic view of an interface for a plurality of screen projection devices to project screens onto two large screens according to an embodiment of the present application;

fig. 23 is a schematic hardware structure diagram of a screen projection apparatus according to an embodiment of the present application.

Detailed Description

In the embodiments of the present application, terms such as "first" and "second" are used to distinguish the same or similar items having substantially the same function and action. For example, the interface of the first target function and the interface of the second target function are for distinguishing different response interfaces, and the order of the interfaces is not limited. Those skilled in the art will appreciate that the terms "first," "second," etc. do not denote any order or quantity, nor do the terms "first," "second," etc. denote any order or importance.

It is noted that, in the present application, words such as "exemplary" or "for example" are used to mean exemplary, illustrative, or descriptive. Any embodiment or design described herein as "exemplary" or "e.g.," is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the word "exemplary" or "such as" is intended to present concepts related in a concrete fashion.

It should be noted that "at … …" in the embodiment of the present application may be at the instant of a certain condition, or may be within a certain period of time after a certain condition occurs, and the embodiment of the present application is not particularly limited to this.

The screen projection method and device provided by the embodiment of the application can be applied to electronic equipment with equipment interconnection and display functions. The electronic device can be used for projecting pictures, playing videos and the like.

Specifically, the electronic device having the device interconnection and display functions may include two types of devices. For example, the electronic devices may include a second electronic device and a third electronic device having a screen-projection capability, and the first electronic device may implement a screen-projection display function by connecting the second electronic device or the third electronic device. The first electronic device may be understood as an electronic device with a screen projection capability, and may be configured to display screen projection content of the second electronic device or the third electronic device, where the screen projection content includes a main interface or a video, for example.

In the embodiment of the application, the first electronic device, the second electronic device and the third electronic device can be connected and communicate with each other through a wireless communication technology. Wireless communication techniques herein may include, but are not limited to: wireless Local Area Network (WLAN) technology, bluetooth (bluetooth), infrared, Near Field Communication (NFC), ZigBee, and other wireless communication technologies that emerge in later developments, and the like. For convenience of description, the following embodiments will be described by taking a plurality of first electronic devices and a plurality of second electronic devices as an example of communication via wireless fidelity direct (Wi-Fi direct) technology.

For example, the second electronic device or the third electronic device includes: a mobile phone (mobile phone), a tablet computer (Pad), a computer with a wireless transceiving function, a wireless terminal in industrial control (industrial control), a wireless terminal in self-driving (self-driving), a wireless terminal in remote medical supply (remote surgery), a wireless terminal in smart grid (smart grid), a wireless terminal in transportation safety (transportation safety), a wireless terminal in smart city (smart city), a wireless terminal in smart home (smart home), and the like. For example, the first electronic device includes: a large screen (or called as an intelligent screen), a mobile phone, a tablet computer, an electronic billboard or other terminal equipment with a large display screen. The embodiments of the present application do not limit the specific technologies and the specific device forms adopted by the first electronic device and the second electronic device.

Taking the second electronic device as a mobile phone, taking the first electronic device as a large screen as an example, and fig. 1 is a scene schematic diagram provided in the embodiment of the present application, as shown in fig. 1, a user can project a display picture of a device a on the large screen for playing, so that the user can browse the display picture of the device a on the large screen.

Fig. 2 is a schematic diagram of a hardware system architecture of an electronic device according to an embodiment of the present disclosure.

As shown in fig. 2, the electronic device includes a processor 210, a transceiver 220, and a display unit 270. The display unit 270 may include a display screen, among others.

Optionally, the electronic device may further include a memory 230. The processor 210, the transceiver 220, and the memory 230 may communicate with each other via internal connection paths to transfer control and/or data signals, the memory 230 may be used to store a computer program, and the processor 210 may be used to retrieve and execute the computer program from the memory 230.

Optionally, the electronic device may further include an antenna 240 for transmitting the wireless signal output by the transceiver 220.

The processor 210 may be combined with the memory 230 into a processing device, and more generally, separate components, and the processor 210 is configured to execute the program code stored in the memory 230 to implement the functions described above. In particular implementations, the memory 230 may be integrated into the processor 210 or may be separate from the processor 210.

In addition, in order to make the functions of the electronic device more complete, the electronic device may further include one or more of the input unit 260, the audio circuit 280, the camera 290, the sensor 201, and the like, and the audio circuit may further include a speaker 282, a microphone 284, and the like.

Optionally, the electronic device may further include a power supply 250 for supplying power to various devices or circuits in the terminal device.

It is understood that the operations and/or functions of the respective modules in the electronic device shown in fig. 2 are respectively for implementing the corresponding flows in the method embodiments described below. Specifically, reference may be made to the description of the method embodiments described below, and a detailed description is appropriately omitted herein to avoid redundancy.

It will be appreciated that the processor 210 in the electronic device shown in fig. 2 may include one or more processing units, such as: the processor 210 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), among others. The different processing units may be separate devices or may be integrated into one or more processors.

A memory may also be provided in processor 210 for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. The memory may hold instructions or data that have just been used or recycled by processor 210. If the processor 210 needs to reuse the instruction or data, it can be called directly from the memory. Avoiding repeated accesses reduces the latency of the processor 210, thereby increasing the efficiency of the system.

In some embodiments, processor 210 may include one or more interfaces. The interface may include an integrated circuit (I2C) interface, an integrated circuit built-in audio (I2S) interface, a Pulse Code Modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a general-purpose input/output (GPIO) interface, a Subscriber Identity Module (SIM) interface, and/or a Universal Serial Bus (USB) interface, etc.

The I2C interface is a bi-directional synchronous serial bus that includes a serial data line (SDA) and a Serial Clock Line (SCL). In some embodiments, processor 210 may include multiple sets of I2C buses. The processor 210 may be coupled to the touch sensor, the charger, the flash, the camera 290, etc. through different I2C bus interfaces, respectively. For example: the processor 210 may be coupled to the touch sensor through an I2C interface, such that the processor 210 and the touch sensor communicate through an I2C bus interface to implement a touch function of the electronic device.

The I2S interface may be used for audio communication. In some embodiments, processor 210 may include multiple sets of I2S buses. The processor 210 may be coupled to the audio circuitry 280 via an I2S bus to enable communication between the processor 210 and the audio circuitry 280. In some embodiments, the audio circuit 280 may communicate audio signals to the transceiver 220 via the I2S interface, enabling answering of voice calls via a bluetooth headset.

The PCM interface may also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, audio circuitry 280 and transceiver 220 may be coupled by a PCM bus interface. In some embodiments, the audio circuit 280 may also communicate audio signals to the transceiver 220 via the PCM interface, enabling answering of voice calls via a bluetooth headset. Both the I2S interface and the PCM interface may be used for audio communication.

The UART interface is a universal serial data bus used for asynchronous communications. The bus may be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is generally used to connect the processor 210 and the transceiver 220. For example: the processor 210 communicates with the bluetooth module in the transceiver 220 through the UART interface to implement the bluetooth function. In some embodiments, the audio circuit 280 may transmit the audio signal to the transceiver 220 through the UART interface, so as to realize the function of playing music through the bluetooth headset.

The MIPI interface may be used to connect the processor 210 with peripheral devices such as the display unit 270, the camera 290, and the like. The MIPI interface includes a Camera Serial Interface (CSI), a Display Serial Interface (DSI), and the like. In some embodiments, processor 210 and camera 290 communicate via a CSI interface to implement the capture functionality of the electronic device. The processor 210 and the display unit 270 communicate through the DSI interface to implement a display function of the electronic device.

The GPIO interface may be configured by software. The GPIO interface may be configured as a control signal and may also be configured as a data signal. In some embodiments, a GPIO interface may be used to connect the processor 210 with the camera 290, the display unit 270, the transceiver 220, the audio mode circuitry 280, the sensor 201, and the like. The GPIO interface may also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, and the like.

It should be understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is only an exemplary illustration, and does not constitute a limitation on the structure of the electronic device. In other embodiments of the present application, the electronic device may also adopt different interface connection manners or a combination of multiple interface connection manners in the above embodiments.

It will be appreciated that the power supply 250 shown in fig. 2 is used to power the processor 210, memory 230, display unit 270, camera 290, input unit 260, transceiver 220, etc.

The antenna 240 is used to transmit and receive electromagnetic wave signals. Each antenna in an electronic device may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: the antenna 240 may be multiplexed as a diversity antenna for a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The transceiver 220 may provide a solution for wireless communication applied to an electronic device, including Wireless Local Area Networks (WLANs) (e.g., wireless fidelity (Wi-Fi) networks), Bluetooth (BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR), and the like. The transceiver 220 may be one or more devices that integrate at least one communication processing module. The transceiver 220 receives electromagnetic waves via the antenna 240, frequency modulates and filters electromagnetic wave signals, and transmits the processed signals to the processor 210. The transceiver 220 may also receive signals to be transmitted from the processor 210, frequency modulate them, amplify them, and convert them into electromagnetic waves via the antenna 240 for radiation.

In some embodiments, the antenna 240 and the transceiver 220 of the electronic device are coupled such that the electronic device can communicate with the network and other devices through wireless communication techniques. The wireless communication technology may include global system for mobile communications (GSM), General Packet Radio Service (GPRS), code division multiple access (code division multiple access, CDMA), Wideband Code Division Multiple Access (WCDMA), time-division code division multiple access (time-division code division multiple access, TD-SCDMA), Long Term Evolution (LTE), LTE, BT, GNSS, WLAN, NFC, FM, and/or IR technologies, etc. The GNSS may include a Global Positioning System (GPS), a global navigation satellite system (GLONASS), a beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and/or a Satellite Based Augmentation System (SBAS).

The electronic device implements a display function through the GPU, the display unit 270, and the application processor, etc. The GPU is a microprocessor for image processing, and is connected to the display unit 270 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 210 may include one or more GPUs that execute program instructions to generate or alter display information.

The display unit 270 is used to display images, videos, and the like. The display unit 270 includes a display panel. The display panel may adopt a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a miniature, a Micro-oeld, a quantum dot light-emitting diode (QLED), and the like. In some embodiments, the electronic device may include 1 or N display units 270, N being a positive integer greater than 1.

The electronic device may implement a photographing function through the ISP, the camera 290, the video codec, the GPU, the display unit 270, the application processor, and the like.

The ISP is used to process the data fed back by the camera 290. For example, when a video is recorded, the camera is turned on, light is transmitted to the camera photosensitive element through the lens, an optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converting into an image visible to naked eyes. The ISP can also carry out algorithm optimization on the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be located in camera 290.

Camera 290 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image to the photosensitive element. The photosensitive element may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The light sensing element converts the optical signal into an electrical signal, which is then passed to the ISP where it is converted into a digital image signal. And the ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into image signal in standard RGB, YUV and other formats. In some embodiments, the electronic device may include 1 or N cameras 290, N being a positive integer greater than 1.

The digital signal processor is used for processing digital signals, and can process digital image signals and other digital signals. For example, when the electronic device selects a frequency point, the digital signal processor is used for performing fourier transform and the like on the frequency point energy.

Video codecs are used to compress or decompress digital video. The electronic device may support one or more video codecs. In this way, the electronic device can play or record video in a variety of encoding formats, such as: moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, and the like.

The NPU is a neural-network (NN) computing processor that processes input information quickly by using a biological neural network structure, for example, by using a transfer mode between neurons of a human brain, and can also learn by itself continuously. The NPU can realize applications such as intelligent cognition of electronic equipment, for example: image recognition, face recognition, speech recognition, text understanding, and the like.

Memory 230 may be used to store computer-executable program code, which includes instructions. The memory 230 may include a program storage area and a data storage area. The storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like. The data storage area can store data (such as audio data, phone book and the like) created in the using process of the electronic device. Further, the memory 230 may include a high-speed random access memory, and may further include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (UFS), and the like. The processor 210 executes various functional applications of the electronic device and data processing by executing instructions stored in the memory 230 and/or instructions stored in a memory provided in the processor.

The electronic device may implement audio functions through audio circuitry 280, speaker 282, microphone 284, and an application processor, among other things. Such as music playing, recording, etc.

Audio circuit 280 is used to convert digital audio information to an analog audio signal output and also to convert an analog audio input to a digital audio signal. The audio circuit 280 may also be used to encode and decode audio signals. In some embodiments, the audio circuit 280 may be disposed in the processor 210, or some functional blocks of the audio circuit 280 may be disposed in the processor 210.

The speaker 282, also referred to as a "horn", is used to convert electrical audio signals into sound signals. The electronic device can listen to music through the speaker 282 or listen to a hands-free conversation.

The microphone 284, also known as a "microphone," is used to convert acoustic signals into electrical signals. When making a call or transmitting voice information, the user can input a voice signal into the microphone 284 by sounding a sound near the microphone 284. The electronic device may be provided with at least one microphone 284. In other embodiments, the electronic device may be provided with two microphones 284, which may also implement noise reduction functions in addition to collecting sound signals. In other embodiments, the electronic device may further include three, four or more microphones 284 for collecting sound signals, reducing noise, identifying sound sources, implementing directional recording functions, and the like.

In some scenarios, it may be desirable to display the projected content of multiple projection devices in one projected device.

For example, fig. 3 is a schematic interface diagram of screen projection in a possible implementation, and in fig. 3, two screen projection devices are used for projecting screens to a large screen as an example. When the screen projecting device a, the screen projecting device B and the large screen 311 are in the same WiFi network, the screen projecting device a may send a screen projecting request to the large screen, and if the screen projecting device B also sends a screen projecting request to the large screen within a certain time, the large screen 311 executes a screen splitting operation according to the two screen projecting requests received successively, and displays the screen projecting content of the screen projecting device a and the screen projecting content of the screen projecting device B in the two screen splitting areas, respectively.

For example, the large screen 311 may include a first display region 310 and a second display region 320 after entering the split screen mode. The large screen 311 displays the screen-cast content "G1 game" of the screen-cast device a in the first display area 310, and displays the screen-cast content "S1 shopping application" of the screen-cast device B in the second display area 320.

It should be noted that, in this manner, it may be understood that the large screen receives the screen-casting request through a single path, and when the large screen receives a plurality of screen-casting requests successively, the large screen performs the screen splitting step according to the number of the screen-casting requests, so as to display the content corresponding to the plurality of screen-casting requests in the screen splitting area.

However, in this method, since the large screen adopts a single path to receive the screen projection request and then performs screen splitting and display in the split screen area, the response is slow, the split screen areas are divided by the large screen, the screen projection device has no option, the screen projection method is not flexible enough,

the single path is set to follow the specification in the normal screen projection protocol. For example, a typical screen projection protocol may include: a screen mirroring (AirPlay) protocol, a wireless display (Miracast) protocol, a Digital Living Network Alliance (DLNA) protocol, or a proprietary screen projection protocol.

For example, fig. 4 is a flowchart illustrating a general screen-projection protocol, and a process for performing screen projection between devices using the general screen-projection protocol may include the following steps:

step 1, a screen projection end device (or referred to as a screen projection device) identifies a DESCRIBE command based on a Real Time Streaming Protocol (RTSP), wherein the DESCRIBE command carries parameters.

Among them, RTSP is a text-based application layer protocol that defines how a one-to-many application can efficiently transmit multimedia data over an Internet Protocol (IP) network, and can be used for the established transmission of control media streams.

The DESCRIBE command carries parameters, and specifies media description information that can be received by the client through the Accept header, where the media description information may be Session Description Protocol (SDP) information, and may include information such as display content of the screen-casting device, duration of screen casting, and the like.

And 2, after receiving the description information of the media, the screen projection end equipment sends a request to the screen projection end equipment, wherein the request is used for establishing screen projection connection.

And 3, the screen-projected equipment (or called screen-projected equipment) sends a reply request to the screen-projected equipment, wherein the reply request indicates that the screen-projected connection path is established.

Wherein the reply request includes a Uniform Resource Identifier (URI) for specifying description information of the media.

And 4, the screen projection end equipment analyzes the reply request and establishes a screen projection connection path with the screen to be projected equipment.

In the conventional protocol, the screen projecting device does not have the capability of specifying the screen projecting position and the capability of controlling the split screen display of the screen projecting device, so that if the screen projecting device needs to display a plurality of screen projecting contents in the screen projecting device, the screen projecting device needs to determine the split screen after receiving the requests of the screen projecting devices, and the screen projecting contents of the screen projecting devices are displayed after the split screen, so that the response is slow, and the diversified screen projecting requirements of the screen projecting device cannot be met.

Based on this, an embodiment of the present application provides a screen projection protocol, where in the screen projection protocol of the embodiment of the present application, when a screen projection device initiates screen projection to a screen projected device, one or more of the following contents are specified: the channel number of the screen projection content when displayed in the screen projection device, the number of devices allowed to be accessed, a full-screen display mode or a split-screen display mode, the position of split-screen display in the screen projection device, and the area (or understood as the display size) of split-screen display in the screen projection device.

The channel number of the screen projection content displayed in the screen projection device may refer to a channel number when the screen projection device establishes a screen projection connection with the screen projection device, and the channel number may be a code existing in the screen projection request and used for distinguishing a channel when the screen projection device establishes a connection with the screen projection device.

In a possible implementation manner, when the screen projection device launches screen projection to the screen projected device, the number of devices allowed to be accessed may be specified, and the number of devices allowed to be accessed is used to limit the number of screen projected devices that can be accessed by the screen projected device. For example, when the screen projection device launches screen projection to the screen projected device, the number of devices which are specified to allow access is 5, the screen projected device can access 5 screen projection devices, and after the screen projected device accesses 5 screen projection devices, the screen projection device cannot be accessed again.

It can be understood that what the number of devices allowed to be accessed is, what the path of the connection between the screen projection device and the screen projection device is established can be.

In this way, the screen-projected devices can display the screen-projected content of each screen-projected device at the corresponding position based on the indication of the screen-projected device. The screen projection devices can respectively specify the display mode of each screen projection content in the screen projection device, namely the screen projection modes among the screen projection devices can be unrelated, and the screen projection devices do not need to make decisions after obtaining the requests of the screen projection devices, so that the screen projection devices can receive the requests of the screen projection devices at the same time and support the personalized screen projection requirements of the screen projection devices.

In a possible implementation manner, in the screen-casting protocol in the embodiment of the present application, when the screen-cast device replies a request for screen casting to the screen-casting device, the screen-cast device indicates one or more of the following items: an Identifier (ID) of the screen projection device, a display position of the screen projection device, a display area of the screen projection device, information identifying whether the screen projection device is a main control device, information inquiring whether the screen projection device requests a main control right, and the like.

The main control device refers to a device which can control the display layout in the projected screen device, and the main control device can be the projected screen device or the projected screen device, and the main control device has the main control right.

It should be noted that the display area in the embodiment of the present application may refer to a display size of the screen projection content of the screen projection device on the screen projection device interface, and the display position may refer to a specific display position of the screen projection content of the screen projection device on the screen projection device interface.

Illustratively, the screen-projected content of the screen-projecting device is projected onto the screen-projected device, and the screen-projecting device may specify a display size in the screen-projected device, which may be 1/4 of the area of the screen-projected device interface, i.e., the screen-projected device interface with a display area of 1/4. The screen projection device can also select a specific display position in the projected screen device, wherein the display position in the projected screen device can have an upper left part, a lower left part, an upper right part, a lower right part, and the like, and the specific display position that the screen projection device can select can be the upper left part of the interface of the projected screen device, that is, the display position is the upper left part of the interface of the projected screen device, and the like. The display interface layout for the screen projecting device may be the top left portion of the projected device interface with the display area occupying 1/4 of the projected device.

It should be noted that the display area and the display position may be set according to the user's needs and usage scenarios. In the embodiment of the present application, the display position in the projected device may have other display positions in a nine-grid format in addition to the specific positions of the upper left part, the lower left part, the upper right part, the lower right part, and the like described above, and the description of the following embodiment is specifically seen, and is not repeated here.

Illustratively, fig. 5 shows a screen projection protocol flow diagram according to an embodiment of the present application. The screen projection protocol of the embodiment of the application comprises the following steps:

step 1, the screen projection end device identifies a DESCRIBE command based on the RTSP protocol, which is similar to step 1 in fig. 4, and may specifically refer to the description of step 1 in fig. 4, and is not described herein again.

The DESCRIBE command carries parameters, specifies media description information that the client can Accept through an Accept header, and one or more of the following contents: the channel number of the screen projection content when displayed in the screen projection device, the number of devices allowed to be accessed, a full-screen display mode or a split-screen display mode, the position of split-screen display in the screen projection device and the area of split-screen display in the screen projection device.

And 2, the screen projection end equipment sends a request to the screen projection end equipment, wherein the request comprises the parameters.

And 3, the screen-thrown end equipment sends a reply request to the screen-throwing end equipment, wherein the reply request indicates that the multi-channel screen-throwing connection is established.

Wherein, the reply request can specify the description information of the media through the URI.

The reply request may further include one or more of the following items: the screen projection device comprises an ID of the screen projection device, a display position of the screen projection device, a display area of the screen projection device, information for identifying whether the screen projection device is a main control device, and information for inquiring whether the screen projection device requests a main control right.

It can be understood that the screen projection method in the embodiment of the present application can be implemented based on the screen projection protocol shown in fig. 5, and for better clarity of the embodiment of the present application, the embodiment of the present application is described below with reference to a scene diagram.

For example, fig. 6 is a scene schematic diagram provided in the embodiment of the present application, and as shown in fig. 6, taking a game and competition scene as an example, display pictures of electronic devices of multiple contestants may be projected to a large-screen TV end at the same time period, the large-screen TV end may receive dynamic concurrent screen projection of the electronic devices of the multiple contestants, so as to implement interconnection of multiple access devices, and an interface of the large-screen TV end may display interfaces of the electronic devices of the multiple contestants to a spectator, so as to facilitate the spectator to watch the competition pictures of each contestant.

As shown in fig. 6, in the scene, there are 7 electronic devices of the contestants, which are screen projection devices 1 to 7, respectively, where the screen projection devices 1 to 7 that have a master control right may be a screen projection device of the team leader, the screen projection device of the team leader is a screen projection device 4, the large screen TV end displays display interfaces of the screen projection devices 1 to 7, and each screen projection device interface may display an identity of the corresponding screen projection device, for example, the interfaces of the screen projection devices 1 to 7 may display "ID 1: UserName1 "-" ID 7: identity of UserName7 ".

The screen projection device 4 with the main control right can control the position and the size of the display interface of any one of the contestant devices, and also can adjust the position and the size of the display interface of the contestant device in real time during the course of the event so that other contestant can pay attention to the screen projection device 4.

It should be noted that the position and size of the display interface of the screen projection device 1-7 may be a default display interface or an interface adjusted by a user, and the embodiment of the present application is not particularly limited.

It can be understood that the application scenario of the embodiment of the present application may also be a conference scenario, for example, 4 persons are in a conference, the 4 persons need to explain respective issues, then the 4 persons screen-project subject contents that need to be explained on the screen-projected device through respective screen-projecting devices, when a first presenter explains their own issues, a display interface of the screen-projected content of the screen-projected device of the first presenter in the screen-projected device may be relatively larger, and screen-projected contents of the screen-projected devices of the other three persons are displayed in the screen-projected device respectively in relatively smaller display interfaces, where the screen-projected device of the first presenter has a master right of the screen-projected device.

If the first speaker needs to refer to the screen projection contents of the screen projection devices of the other three persons during explanation, the screen projection devices of the first speaker can adjust the positions and sizes of the screen projection contents of the screen projection devices of the other three persons.

The application scene of the embodiment of the application can also be a teaching scene, for example, when a teacher gives lessons in a classroom by using the screen projection device, the screen projection device of the teacher and the screen projection device of students can be projected onto the screen projection device, and each person can be guaranteed to participate in the activity.

When a teacher gives lessons, the display interface of the screen projection content of the screen projection equipment of the teacher in the screen projection equipment can be relatively larger, then the screen projection content of the screen projection equipment of the students is displayed in the screen projection equipment through relatively smaller display interfaces respectively, and the screen projection equipment of the teacher has the master control right of the screen projection equipment.

If the teacher needs a student to answer a question during teaching, the screen-throwing device of the teacher can adjust the position and the size of the screen-throwing content of the screen-throwing device of the student so that other students can pay attention to the screen-throwing content.

In a possible implementation manner, if the position and size of the screen projecting content of the screen projecting device of a certain student in the screen projecting device need to be adjusted, the teacher can also realize the function of expansion through the operation of dragging the screen projecting content of the screen projecting device of the certain student in the display interface of the screen projecting device, and if the dragging operation of the teacher is detected by the screen projecting device, the screen projecting device expands the screen projecting content of the screen projecting device of the certain student.

It can be understood that the embodiment of the application can be applied to any scene in which a plurality of electronic devices are required to simultaneously display related contents, and can be a scene such as a family, a work, a teaching, a game competition, and the like, and specifically, reference can be made to the description of the scene.

The screen projection method provided by the embodiment of the present application will be described in detail below with reference to the accompanying drawings. As shown in fig. 7, fig. 7 is a schematic diagram illustrating an interaction flow of a method provided in the embodiment of the present application.

S701, the second electronic equipment displays a third user interface, and the third user interface comprises display area options and/or display positions on the first electronic equipment.

In this embodiment, the second electronic device may refer to an electronic device having a screen projection requirement. For example, the second electronic device may be a mobile phone, in practical application, a video may be played in the mobile phone, but a display interface of the mobile phone is limited, so that the mobile phone may be subjected to screen projection operation in order to facilitate more users to view the video played in the mobile phone, and the specific content of the screen projection is not limited in the embodiment of the present application.

The third user interface may display a display area option and/or a location identifier of the first electronic device to be projected, where the first electronic device may refer to an electronic device with projected screen capability.

The display area option refers to an option that the second electronic device can specify the size of the display in the first electronic device when the screen-projected content of the second electronic device is projected to the first electronic device, and the display area option may be an option such as the first electronic device interface of 1/4, the first electronic device interface of 1/3, and the first electronic device interface of 1/2.

It should be noted that, the numerical size of the score of the area in the display area option is not specifically limited in this embodiment of the application, and the display area and the display position may be and/or in a relationship, which indicates that three relationships may exist, for example, the display area and/or the display position may indicate: the display area exists alone, the display area and the display position exist simultaneously, and the display position exists alone.

Illustratively, for example, the first electronic device is a large screen, the second electronic device is a mobile phone, when the mobile phone needs to be projected on the large screen, the mobile phone needs to open a third user interface, and accordingly, the mobile phone displays the third user interface, a display area option that the mobile phone can project the screen, such as the large screen interface of 1/4, the large screen interface of 1/3, the large screen interface of 1/2, and the like, and a display area option that the mobile phone can project the screen, such as the upper left portion of the large screen, the lower left portion of the large screen, the upper right portion of the large screen, the lower right portion of the large screen, and the like, can represent an identifier of a display position on the large screen, and the user can complete interaction between the mobile phone and the user by selecting the display area option that the mobile phone can project the screen and the identifier of the display position on the large screen in the third user interface.

S702, the second electronic device receives user operation for selecting the first display area option and/or user operation for selecting the first target position.

In this embodiment, the first display area option may refer to an option that the screen-projected content of the second electronic device needs to be projected to the size of the display area in the first electronic device, and the first display area option may be an option such as the first electronic device interface of 1/4, the first electronic device interface of 1/3, and the first electronic device interface of 1/2.

The first target position may refer to a specific display position in the first electronic device to which the screen-projected content of the second electronic device needs to be projected. For example, the screen-projected content of the second electronic device may be projected to the left portion in the first electronic device.

It should be noted that the first display area option and the first target location may be selected by the user according to the complaint and the usage scenario, and the application is not particularly limited, and in practical applications, if the user does not select the specific location, the first display area option and the first target location are a default full-screen mode, where the full-screen mode may refer to full-screen display of screen projection content of the second electronic device in the first electronic device.

For example, taking the second electronic device as a mobile phone as an example, when the user casts the screen casting content of the mobile phone, the first display area option may be selected as an interface area of 1/2 in the first electronic device and the first target position is a left portion in the first electronic device, and the user may perform the operation of selecting the specific position, and accordingly, the mobile phone receives the operation of the specific position selected by the user.

It should be noted that, the user operation for selecting the first display area option and the user operation for selecting the first target location may be and/or, and indicate that three relationships may exist, for example, the user operation for selecting the first display area option and/or the user operation for selecting the first target location may indicate: the user operation for selecting the first display area option exists separately, the user operation for selecting the first display area option and the user operation for selecting the first target position exist simultaneously, and the user operation for selecting the first target position exists separately.

S703, the second electronic device sends a first screen projection request to the first electronic device, wherein the first screen projection request comprises information of the first display area option and/or information of the first target position.

In this embodiment of the application, the first screen projection request may refer to a command for executing a screen projection operation, and may carry screen projection information of the second electronic device, where the screen projection information may carry screen projection parameters.

It should be noted that, the information of the first display area option and the information of the first target location may be and/or, and indicate that three relationships may exist, for example, the information of the first display area option and/or the information of the first target location may indicate: the information of the first display area option exists separately, the information of the first display area option and the information of the first target position exist simultaneously, and the information of the first target position exists separately.

It will be appreciated that the information of the first display area option, and/or the information of the first target location, may be represented in the form of a request code. For example, the request may be a code "setareaaandpos = { (0, 0), (0, 1), (1, 0), (1, 1) … … }", and the request code may indicate where the split-screen display location available for the first electronic device is, as shown in fig. 8, a display interface of the first electronic device may be displayed in nine-grid format, on which a horizontal-vertical coordinate system is established, each grid representing a unit of 1, wherein if the screen-casting parameter { (0, 0), (0, 1), (1, 0), (1, 1) } is selected, then a location a is indicated, if the screen-casting parameter { (0, 1), (0, 2), (1, 1), (1, 2) } is selected, then a location B is indicated, if the screen-casting parameter { (0, 0), (0, 1), (0, 2), (1, 0), (1, 2) }, it indicates the positions a and B, how large the display area that the second electronic device needs to occupy can be selected by the above-mentioned parameter selection means, and also can select specific position information by the above-mentioned parameter selection means.

For example, taking the first screen-casting request as an example code, the second electronic device sends the first screen-casting request to the first electronic device, where the request may be "setareandpos = { (0, 0), (0, 1), (1, 0), (1, 1) }", and then information of the first display area and information of the first target position that the first screen-casting request may represent are position a.

Optionally, the information that may be carried by the first screen-casting request may also include the number of devices allowed to be accessed. If the number of the electronic devices received by the subsequent first electronic device is larger than or equal to the threshold, the first electronic device can refuse to execute screen projection of the electronic device when receiving the screen projection request again.

S704, the first electronic device displays screen projection content of the second electronic device at the first target position according to the first screen projection request.

Illustratively, the first electronic device displays the screen projection content of the second electronic device at a first target position in the first electronic device according to a first screen projection request sent by the second electronic device. For example, after the second electronic device sends the first screen projection request, the first electronic device may display screen projection content of the second electronic device in a left portion of a 1/2 area of the first electronic device according to screen projection information of the second electronic device carried in the first screen projection request, where the screen projection information of the second electronic device may be information of a first display area option and first target location information, where the information of the first display area option may be the 1/2 area of the first electronic device, and the first target location information may be the left portion of the first electronic device.

S705, the third electronic device receives screen projection operation for triggering the second screen projection request to be sent to the first electronic device.

In this embodiment of the application, the third electronic device may also refer to an electronic device with a screen projection requirement, for example, the third electronic device may be a tablet computer, and during a game competition, a user performs a game competition through the tablet computer, so as to facilitate more users to view a game competition screen in the tablet computer, and may perform a screen projection operation on the tablet computer.

The second screen projection request may refer to a command for executing a screen projection operation, and may carry screen projection information of the third electronic device, where the screen projection information may carry screen projection parameters.

For example, taking the third electronic device as a mobile phone as an example, when a user casts screen projection content of the mobile phone, the display area and the display position in the first electronic device may be selected, where the display area information and the display position information in the first electronic device may be included in the second screen projection request, before the mobile phone sends the second screen projection request to the first electronic device, the user may trigger a screen projection operation of sending the second screen projection request to the first electronic device, and accordingly, the mobile phone may receive the screen projection operation of sending the second screen projection request to the first electronic device triggered by the user.

S706, responding to the screen projection operation, displaying a first user interface by the third electronic device, wherein the first user interface comprises information for prompting whether to acquire the master control right.

In this embodiment of the application, the first user interface may display a function button for obtaining a master control right, where the master control right may refer to that the position and size of the screen projection content of the electronic device to be adjusted have a control right.

For example, in response to the screen-casting operation of S705, the third electronic device may display a first user interface, and in the first user interface, a video application interface and a right-to-acquire button of the third electronic device may be displayed, where the right-to-acquire button may be used to apply for acquiring a right to acquire a position and a size of screen-casting content of the electronic device to be adjusted in the first electronic device.

And S707, the third electronic device receives an operation for indicating to acquire the master control right.

For example, when the user selects to trigger the operation of obtaining the master right by the third electronic device, the obtaining the master right button may be triggered on a first user interface displayed by the third electronic device, and accordingly, the third electronic device receives the operation of obtaining the master right indicated by the user.

And S708, the third electronic equipment sends a second screen projection request to the first electronic equipment.

For example, when the third electronic device receives an operation for instructing acquisition of the master right, the third electronic device may transmit a second screen projection request to the first electronic device.

And S709, the first electronic device displays the screen projection content of the third electronic device at the second target position according to the second screen projection request.

In this embodiment of the application, the second target position may refer to a specific display position where the screen projection content of the third electronic device needs to be projected into the first electronic device. For example, the screen-projected content of the third electronic device may be projected to the right portion in the first electronic device.

Optionally, a display area may also be specified in the second screen projection request, where the display area may refer to a size of a display that the screen projection content of the third electronic device needs to be projected into the first electronic device, and the display area option may be an option such as the first electronic device interface of 1/4, the first electronic device interface of 1/3, and the first electronic device interface of 1/2. It should be noted that the display area and the second target position may also be selected by the user according to the user's own appeal and use scenario, and the present application is not particularly limited thereto.

The default layout mode may have three possible ways, and specific contents will be described in detail in the following embodiments, which are not described herein.

Optionally, the number of devices allowed to be accessed may also be specified in the second screen-casting request, and then the third electronic device may change the number of devices allowed to be accessed, which is specified by the second electronic device before, and it should be noted that the specific number of the number of devices allowed to be accessed is not limited in the embodiment of the present application.

For example, the first electronic device may display the screen-casting content of the third electronic device at the second target location in the first electronic device according to the second screen-casting request sent by the third electronic device. For example, after the third electronic device sends the second screen projection request, the first electronic device may display screen projection content of the third electronic device in a default display area of the first electronic device according to screen projection information of the third electronic device carried in the second screen projection request, where the screen projection information of the third electronic device may be display area information and second target position information, and the display area information and the second target position information may be a default layout mode.

And S710, displaying a second user interface by the third electronic equipment.

In an embodiment of the present application, the second user interface may include a display interface of the screen-projected content of the third electronic device, and the second user interface is used for selecting an option of the electronic device to be adjusted and one or more of the following function options: a narrow function option, an expand function option, an exclusive function option, a flat function option, or a device suspend function option.

The electronic device to be adjusted may refer to an electronic device that displays screen-projected content in the first electronic device, the function option may implement an interactive operation between a user and the third electronic device, and the function option may be used to adjust the screen-projected content of the electronic device to be adjusted.

For example, the zoom-out function option may be used to perform zoom-out operation on the screen-projected content of the selected electronic device to be adjusted, the exclusive function option may be used to perform screen-fullness operation on the screen-projected content of the selected electronic device to be adjusted, the bisection function option may be used to bisect the screen display area to the electronic device to be adjusted, and the device suspend option button may be used to perform device suspend operation on the screen-projected content of the selected electronic device to be adjusted.

In one possible implementation, the second user interface may display one or more of the following function buttons: the function button is reduced, the function button is enlarged, the function button is exclusive, the function button is divided evenly or the function button is hung up, the user can adjust the screen projection content of the electronic equipment to be adjusted through touch operation of selecting the function button in the second user interface displayed by the third electronic equipment, and correspondingly, the third electronic equipment can detect the touch operation.

In another possible implementation, the second user interface may display one or more of the following options: the method comprises the steps of narrowing options, enlarging options, monopolizing options, equally dividing options or suspending options, wherein a check box is arranged in front of each option, a user can select corresponding options through the check box in the third electronic device display second user interface through an input device, the screen projection content of the electronic device to be adjusted is further adjusted, and correspondingly, the third electronic device can detect the selection operation of the user.

It can be understood that the touch operation may be any possible manner of long pressing, heavy pressing, multiple clicking, touching, gesture, and the like, and only needs to be free from conflict with the function of each touch operation in the third electronic device, and the embodiment of the present application is not particularly limited.

For example, the third electronic device may display a second user interface in which a video application interface of the third electronic device and one or more of the following function buttons for selecting the electronic device to be adjusted may be displayed: a narrow function button, an expand function button, an exclusive function button, a split function button, or a device suspend function button. The user can perform corresponding operation of adjusting the position and the size of the screen projection content of the electronic equipment on the second user interface.

And S711, the third electronic device sends adjustment instruction information to the first electronic device.

In the embodiment of the application, the adjustment instruction information may refer to information for adjusting the position and size of the screen projection content of the electronic device to be adjusted, and the adjustment instruction information may be information selected by a user according to the user's appeal and use scene. For example, if the user needs to emphasize the screen-projected content of the third electronic device, the adjustment instruction information may be information for enlarging the screen-projected content of the third electronic device.

For example, when a third electronic device with a master control right needs to adjust screen projection content of the third electronic device, adjustment indication information may be sent to the first electronic device, where the adjustment indication information may be information for enlarging and displaying screen projection content of the third electronic device.

And S712, the first electronic device adjusts the display layout of the screen projection content of the electronic device to be adjusted according to the adjustment instruction information.

In this embodiment of the application, the display layout may refer to a display area and a display position, where the display area may refer to a display size of the to-be-adjusted electronic device screen projection content on the first electronic device interface, and the display position may refer to a specific display position of the to-be-adjusted electronic device screen projection content on the first electronic device interface.

For example, after the first electronic device receives the adjustment indication information sent by the third electronic device having the master control right, the first electronic device may adjust the display layout of the screen projection content of the electronic device to be adjusted according to the adjustment indication information. For example, the adjustment instruction information may be information for enlarging and displaying the screen projection content of the third electronic device, and the first electronic device enlarges and displays the screen projection content of the third electronic device on the first electronic device interface according to the adjustment instruction information.

It should be noted that, according to the adjustment instruction information, the first electronic device may adjust a display layout of the screen projection content of the electronic device to be adjusted, where the display layout may have multiple displays, where N is a positive integer greater than 1, and a specific interface of the display layout will be described in detail in the following embodiments, which is not described herein again.

S713, the first electronic device receives indication information for acquiring the master control right from the remote controller.

In this embodiment, the remote controller may refer to a wireless transmitter, and the electronic device may be remotely controlled through buttons in the remote controller, where the buttons in the remote controller may include a number button "0-9", "a direction" button, "a confirmation" button, "a cancel" button, "a device suspend" button, "a region selection" button, "a bisection" button, "an exclusive" button, "an acquire master control right" button, and the like. The "direction" buttons may include up and down buttons and left and right buttons.

Wherein, the digital button can be used for selecting the ID number of the electronic equipment to be adjusted, the 'direction' button can be used for performing position adjustment operation on screen projection content of the electronic device to be adjusted, the 'confirm' button can be used for confirming whether the screen projection content of the electronic device to be adjusted is displayed in a certain area, the 'device hang' button can be used for performing device hang operation on the screen projection content of the electronic device to be adjusted, the 'bisection' button can be used for bisecting the screen area to the screen projection content of the electronic device to be adjusted, the 'monopolizing' button can be used for occupying the screen projection content of the electronic device to be adjusted in the screen, the 'acquiring master control' button can be used for applying to acquire master control of the first electronic device, and the 'changing device number' button can be used for modifying the number of devices which the first electronic device is allowed to access.

For example, when a user needs to control a first electronic device by using a remote controller, the user may send instruction information for acquiring a master control right to the first electronic device by triggering an "acquire master control right" button in the remote controller, and accordingly, the first electronic device may receive the instruction information for acquiring the master control right from the remote controller.

S714, the first electronic device sends a request for acquiring a master right to the third electronic device.

For example, after the first electronic device receives indication information for acquiring the master right from the remote controller, the first electronic device may send a request for acquiring the master right to a third electronic device having the master right. For example, the request may be a request code "setTransMaster = { (a, B) }", the request code may indicate that the device a having the master right hands over the screen master right to the device B, where a parameter "a" indicates a device number having the master right, a parameter "a" may be 3, a parameter "B" indicates a device number to which the master right is handed over, a parameter "B" may be 0, and the parameter 0 may represent a remote controller, and the request code may be a request code sent by the first electronic device to the third electronic device for acquiring the master right, and the request code may be used for handing over the master right of the third electronic device to the remote controller.

S715, the first electronic device receives an agreement reply of the third electronic device.

For example, the first electronic device may receive an agreement reply from the third electronic device, and the remote controller may obtain a master control right on screen projection content of the electronic device to be adjusted in the first electronic device.

S716, the first electronic equipment receives remote control information from the remote controller.

In this embodiment of the application, the remote control information may refer to adjustment information sent by a user by triggering a button of a remote controller, and the remote control information may be used to control display content selected by the remote controller to implement monopolization or device suspension, may also be used to control a display area of the first electronic device to be equally divided or the display area to be selected, and may also be used to modify the number of devices allowed to be accessed by the first electronic device.

For example, the remote controller with the master control right can send the remote control information, and then the first electronic device receives the remote control information from the remote controller. For example, the remote control information may be information for monopolizing screen-projected content of the third electronic device to the interface of the first electronic device.

And S717, the first electronic equipment controls the display of the plurality of screen projection contents in the first electronic equipment according to the remote control information.

For example, after the remote controller with the master control right sends the remote control information to the first electronic device, the first electronic device may control display of screen projection content of the electronic device to be adjusted in the first electronic device according to the remote control information. For example, the remote control information may be that the screen projection content of the third electronic device is suspended, and then the screen projection content of the third electronic device is suspended by the first electronic device according to the remote control information, and then the screen projection content of the second electronic device may be adaptively adjusted in the interface of the first electronic device.

The specific interface of the second electronic device for adaptively adjusting the screen-projected content on the interface of the first electronic device will be described in detail in the following embodiments, which are not repeated herein.

It should be noted that the first electronic device may control, according to the remote control information, a display layout of screen projection content of the electronic device to be adjusted in the first electronic device, where the display layout may have multiple displays, where N is a positive integer greater than 1, and a specific interface of the display layout will be described in detail in the following embodiments, which is not described herein again.

Optionally, if the first electronic device is a touch-enabled electronic device, the first electronic device may receive a touch operation of a user on the first electronic device to control display of multiple screen-shot contents in the first electronic device. For example, if the user performs a touch operation on the first electronic device to enlarge and display the screen projection content of the third electronic device, the first electronic device may receive the touch operation described above by the user to control the enlarged and displayed screen projection content of the third electronic device in the first electronic device.

And S718, when any electronic device which realizes screen projection in the first electronic device sends a network fault or is suspended, the first electronic device adjusts the display layout of screen projection contents of other electronic devices which normally project screens.

In the embodiment of the present application, any electronic device may refer to an electronic device such as a second electronic device or a third electronic device that projects a screen in a first electronic device, for example, any electronic device may be the second electronic device.

The network failure may refer to a state in which a network cannot provide normal services or reduce quality of services due to a problem of hardware of the electronic device, a bug of software, an intrusion of a virus, or the like, and the suspended state may refer to a state in which screen projection contents of the electronic device are displayed in the first electronic device in the form of a semi-transparent floating window.

For example, if the third electronic device sends a network failure or a suspended message to the first electronic device, and accordingly, after the first electronic device receives the network failure or the suspended message, the first electronic device may perform a rejection operation or a suspended operation on the third electronic device, and accordingly, the first electronic device may adjust a display layout of screen projection contents of other normally projected electronic devices.

For example, if the electronic device with the network failure is a third electronic device, after the first electronic device receives the network failure message of the third electronic device, the screen projection content of the third electronic device may be removed from the first electronic device, and accordingly, the first electronic device adjusts the display layout of the screen projection content of the second electronic device that normally projects the screen, where the adjusted display layout may be that a display area of the screen projection content of the second electronic device is enlarged to occupy an area resource of the previous third electronic device.

The specific interface for the first electronic device to adjust the display layout of the screen projection content of the other electronic devices that normally project the screen will be described in detail in the following embodiments, which is not described herein.

In the embodiment of the present application, some steps may not be necessary, and each step may also be combined at will, for example, with reference to S703-S712, an embodiment of the present application provides a screen projection method, where the screen projection method may receive screen projection requests of a second electronic device and a third electronic device at a same time, display screen projection contents of the second electronic device and the third electronic device in corresponding display areas and display positions based on the screen projection requests, and transfer a main control right to the third electronic device, so that the third electronic device may adjust and control a display interface of the first electronic device.

For example, in conjunction with S701-S712, before the second electronic device performs screen projection to the first electronic device, the second electronic device may perform a selection operation on the display area and the display position, and after the selection operation is performed by the second electronic device, the screen projection method of S703-S712 may be continuously performed, so that the third electronic device may adjust and control the display interface of the first electronic device.

For another example, in conjunction with S703-S717, after the screen projection method of S703-S712 is performed, the main control right of the third electronic device may be transferred to the remote controller, so that the remote controller may control the entire display interface of the first electronic device. For another example, in conjunction with S701-S717, before the above scheme of S703-S717 combination is executed, the second electronic device may perform a selection operation of the display area and the display position in the first electronic device, and after the selection operation is performed by the second electronic device, the above scheme of S703-S717 combination may be continuously executed.

It should be noted that, in this embodiment of the application, S718 is an optional step, and this S718 may be added to one scheme of any combination, for example, the combinations S703-S712 and S718 may be used, and during the process of executing the scheme of S703-S712, if any electronic device that implements screen projection in the first electronic device sends a network failure or is suspended, the first electronic device may adjust the display layout of screen projection contents of other electronic devices that normally project screens.

In summary, in the embodiment of the present application, when the second electronic device and the third electronic device need to screen, the first electronic device may receive the screen of the second electronic device and the screen of the third electronic device at the same time, and may support the personalized screen-casting requirements of the second electronic device and the third electronic device, further, the display layout of the second electronic device and the third electronic device on the first electronic device may be adjusted by the electronic device with the master control right, and the electronic device with the master control right may also be replaced, so that the display layout diversity and the operation flexibility of the first electronic device are improved.

In this embodiment, the number of the third electronic devices may be one or multiple, and the specific value of the number of the third electronic devices is not specifically limited in this embodiment.

In order to describe the embodiments of the present application more clearly, the screen projection method of the embodiments of the present application is described below with reference to an interface schematic diagram.

When the second electronic device and the third electronic device screen-cast the first electronic device, two optional ways may be used to implement the screen-cast connection between the second electronic device and the third electronic device and the first electronic device, one may be that the second electronic device and the third electronic device receive a "multi-screen interaction" button operation in a user trigger device connection to establish the screen-cast connection with the first electronic device, and the other may be that the second electronic device and the third electronic device receive a "screen-cast shortcut" button operation in a user trigger application to establish the screen-cast connection with the first electronic device.

Exemplarily, the second electronic device and the third electronic device are mobile phones, the first electronic device is a large screen, and fig. 9 and 10 are schematic interface diagrams of two optional modes for establishing screen-projecting connection between the mobile phone and the large screen according to the embodiment of the present application.

In a possible implementation manner, as shown in fig. 9, fig. 9 is a schematic view of a mobile phone interface when a screen-throwing connection is established between a mobile phone and a large screen according to an embodiment of the present application, and as shown in a in fig. 9, is a schematic view of a setting interface displayed on the mobile phone according to the embodiment of the present application, if a user operation that a user acts on a "device connection" button is detected, for example, the mobile phone receives a touch operation of the user on the setting interface, and the touch operation is to select the "device connection" button.

Further, the interface of the handset may be entered into an interface as shown in B in fig. 9, in the mobile phone interface, the mobile phone can receive the touch operation of the user in setting the connection interface, the touch operation is to select a "multi-screen interaction" button, and further, the mobile phone displays the mobile phone interface of the multi-screen interaction floating window as shown in C in fig. 9, in the mobile phone interface, the mobile phone can receive the operation of selecting a large screen needing to establish screen-casting connection in a large screen list which can be screen-cast by a user, the large screen list capable of being projected can have selectable large screen options such as "large screen 1", "large screen 2", "large screen 3", for example, the large screen needing to establish the projection connection is "large screen 1", the mobile phone can receive that the user selects 'large screen 1' touch operation in the large screen list capable of being projected to establish screen projection connection with the large screen 1.

When the mobile phone can establish screen-casting connection with the large screen 1, the mobile phone can enter a mobile phone interface shown as D in fig. 9, and the mobile phone interface can include a display area option and a display position on the large screen, as shown in D in fig. 9, the mobile phone can select the display size of the screen-casting content of the mobile phone by receiving the operation of a button "60%", "50%" or "25%" in the user touch selection display area option, and can also select the display size of the screen-casting content of the mobile phone by receiving the operation of changing the percentage of the number in a user-defined button in the display area option by the user touch.

As shown in D in fig. 9, taking the display position in the nine-grid format as an example, the mobile phone may receive an operation of touching and selecting a "position a", "position b", "position c", "position D", "position e", "position f", "position g", "position h", or "position i" button in the display positions on the large screen by the user to select a specific display position of the content projected by the mobile phone. If the user does not want to select the display area and the display position of the mobile phone screen projection content in the large screen, the user can select a default layout button in the mobile phone interface shown in D in fig. 9 through touch operation, and correspondingly, the mobile phone receives the operation of touching the default layout button by the user, and the large screen 1 enters a default layout mode.

It is understood that the default layout mode entered by the large screen 1 will be described in the following embodiments, and will not be described herein.

In another possible implementation manner, as shown in fig. 10, fig. 10 is a schematic interface diagram of another mobile phone and large screen projection connection established according to the embodiment of the present application. As shown in fig. 10 a, which is a schematic view of a mobile phone interface of an application program displayed on a mobile phone according to an embodiment of the present application, if a user operation performed by a user on a "screen-projection shortcut" button is detected, for example, the mobile phone receives a touch operation of the user on the application program interface, where the touch operation is to select a "TV" shortcut button.

Further, the cell phone interfaces shown as B in fig. 10 and C in fig. 10 are entered, and the content related to B in fig. 10 and C in fig. 10 is similar to that described above in fig. 9 and C in fig. 9, and is not described again here. When the mobile phone receives an operation of selecting a default layout button in the mobile phone interface shown in fig. 10C by a user through touch, the large screen 1 enters the large screen interface shown in fig. 10D, and the large screen interface is in a default layout mode and can display screen projection content of the mobile phone in a full screen mode.

It is to be understood that the application program may be a video playing program or a game program, and the embodiment of the present application is not particularly limited, but the application program is a program that supports the screen-casting protocol of the embodiment of the present application.

For example, as shown in fig. 11, the default layout mode that the large screen can enter may include the following three forms:

the first method is as follows: as shown in a in fig. 11, when there are 7 screen projection devices projecting screen projection contents onto a large screen, correspondingly, the screen projection contents of the 7 screen projection devices can be displayed in the large screen, and the 7 screen projection devices are respectively device "ID 1: UserName1 "-" ID 7: UserName7 ", the" ID 1: UserName1 "-" ID 7: the UserName7 "is the identification of the 7 screen projection devices, respectively, wherein the device" ID 1: the UserName1 ″ is a device having a master control right, and in a display interface of a large screen, a default layout mode may mean that the large-screen display interface is divided into 7 display layouts for display in a vertical direction, and the screen projection contents of the 7 screen projection devices are respectively displayed in the 7 display layouts.

The second method comprises the following steps: as shown in B in fig. 11, when there are 4 screen projection devices projecting screen projection contents onto a large screen, correspondingly, the screen projection contents of the 4 screen projection devices can be displayed in the large screen, and the 4 screen projection devices are respectively device "ID 1: UserName1 "-" ID 4: UserName4 ", the" ID 1: UserName1 "-" ID 4: the UserName4 "is the identification of the 4 screen projection devices, respectively, wherein the device" ID 1: the UserName1 ″ is a device having a master control right, in a large-screen display interface, a default layout mode can mean that the large-screen display interface is divided into 4 display layouts in a four-grid manner for display, and screen projection contents of the 4 screen projection devices are respectively displayed in the 4 display layouts.

The third method comprises the following steps: as shown in fig. 11C, 4 screen projection devices "ID 1: UserName1 "-" ID 4: screen-shot content of UserName4 ", ID 1: UserName1 "-" ID 4: the UserName4 "is the identification of the 4 screen projection devices, respectively, wherein the device" ID 1: the UserName1 ″ is a device having a main control right, in a large-screen display interface, a default layout mode may refer to enlarging and displaying screen projection content of the device having the main control right in the large-screen display interface, and screen projection content of other 3 screen projection devices may be adaptively adjusted to 3 display layouts for displaying in the large-screen display interface, where the positions and sizes of the adaptively adjusted 3 display layouts are not specifically limited in the embodiment of the present application.

Note that, in the device "ID 1: the screen projection content of the UserName1 "may or may not display the identifier of the" main device ", and this embodiment of the present application is not specifically limited.

It is to be understood that the default display layout of the screen projection device in the large screen may be preset by a user or may be set by a system, and the embodiment of the present application is not particularly limited.

For example, fig. 12-14 are schematic interface diagrams illustrating three possible ways of obtaining ownership of the first electronic device. Fig. 12 is an interface schematic diagram of accessing a master control right of a first electronic device, fig. 13 is an interface schematic diagram of a third electronic device obtaining the master control right of the first electronic device, and fig. 14 is an interface schematic diagram of a remote controller obtaining the master control right of the first electronic device. Next, the second electronic device and the third electronic device are respectively a mobile phone 1 and a mobile phone 2, and the first electronic device is a large screen 1, which will be described with reference to fig. 12 to 14.

As shown in a in fig. 12, after the mobile phone 1 accesses the screen-shot content to the large screen 1, the mobile phone interface displays a prompt box to prompt whether the mobile phone 1 accesses the main control right for the large screen 1, and in the mobile phone interface, the mobile phone 1 may receive an operation of triggering a "yes" button in the prompt box by the user to confirm to access the main control right for the large screen 1, and may also receive an operation of triggering a "no" button in the prompt box by the user to confirm not to access the main control right for the large screen 1.

When the mobile phone 1 receives the operation of triggering the "yes" button in the prompt box by the user to access the main control right to the large screen 1, the mobile phone enters a mobile phone interface as shown in B in fig. 12, the mobile phone interface may display the running application program interface 1, and may also display three function buttons, which are respectively a "region selection" button, a "handover main control right" button and a "quit" button, and may also display the options of the number of devices allowed to be accessed.

Wherein, the button of 'transfer master control' can transfer the master control to the large screen 1; the area selection button can be used for adjusting a display area and a display position of the device to be adjusted, the number of devices allowed to be accessed in the large screen 1 can be adjusted through the number of devices allowed to be accessed in the large screen 1, and if the number of devices allowed to be accessed in the large screen 1 needs to be changed, the mobile phone 1 can receive the operation of triggering the user-defined button in the number of devices allowed to be accessed by a user to adjust the number of devices allowed to be accessed in the large screen 1.

After the mobile phone 1 receives the operation of triggering the "area selection" button in the mobile phone interface by the user, further, as shown in fig. 11C, the mobile phone 1 displays the mobile phone interface with the corresponding function frame, the mobile phone 1 can receive the ID number of the electronic device whose position needs to be adjusted, which is input by the operation of triggering the digital button in the function frame by the user, after the ID number of the electronic device is selected, the mobile phone 1 can perform the operation of adjusting the position and size of the screen projection content of the electronic device to be adjusted, and the operation of adjusting the position and size is specifically shown in the description of the embodiment in fig. 18, and is not described herein again.

The mobile phone interface of the function box can also comprise: the electronic equipment screen-casting adjusting method comprises a zoom-out button, an expansion button, an exclusive button, a bisection button, an equipment suspension button, a cancel button and the like, wherein the zoom-out button can perform zoom-out operation on screen-casting content of the selected electronic equipment to be adjusted; the expansion button can perform expansion operation of screen projection content of the electronic equipment on the selected electronic equipment to be adjusted; the exclusive button can be used for enabling screen projection contents of certain electronic equipment to be adjusted to occupy a large screen; the 'bisection' button can be used for bisecting the large-screen display layout to the electronic equipment to be adjusted; the 'equipment suspension' button can be used for suspending screen projection content of the electronic equipment on the electronic equipment to be adjusted; the "cancel" button can cancel the above-described function operation.

Accordingly, as shown in D in fig. 12, the interface is a display interface of the large screen 1 after the ID number of the electronic device to be adjusted is selected by the mobile phone 1, for example, if the ID number of the electronic device to be adjusted selected by the mobile phone 1 is "5", the device "ID 5 in the large screen 1: the projected screen content of UserName 5' is highlighted. Wherein, the ID number of each electronic device to be adjusted corresponds to the identification of each device in the large screen 1.

It should be noted that, in fig. 12 of the embodiment of the present application, an interface after the second electronic device accesses the master right may also be represented as an interface after the third electronic device accesses the master right, and accordingly, the display interfaces in C and D in fig. 12 are adapted.

It should be noted that the second electronic device or the third electronic device accesses the content of the display interface 1 of the master control right and the position of the function button displayed in the interface are not specifically limited in the embodiment of the present application.

Fig. 13 is an interface schematic diagram of the mobile phone 2 acquiring the main control right for the large screen 1 according to the embodiment of the present application.

As shown in a in fig. 13, the interface of the mobile phone 2 includes the display interface 2, an "exit" button, and an "acquire master right" button, and if a user operation on the "acquire master right" button is detected, for example, the mobile phone 2 receives a touch operation of the user on the interface of the mobile phone 2, the touch operation is to select the "acquire master right" button.

Further, the mobile phone 2 sends a request for acquiring the master control right to the large screen 1, the interface of the large screen 1 may present an interface shown as B in fig. 13, the large screen 1 may send the request for acquiring the master control right by the mobile phone 2 to the mobile phone 1 having the master control right, and accordingly, the mobile phone 1 having the master control right may display a prompt box interface, as shown as C in fig. 13, which prompts whether the mobile phone 1 agrees with the acquisition of the master control right for the large screen 1 by the mobile phone 2, and in the mobile phone interface, the mobile phone 1 may receive an operation of triggering an "agreement" button by the user in the prompt box to confirm that the mobile phone 2 agrees with the master control right for the large screen 1, and may also receive an operation of triggering an "disagreement" button by the user in the prompt box to confirm that the mobile phone 2 does not agree with the master control right for the large screen 1.

After the mobile phone 1 receives that the user triggers the "agree" button in the prompt box to agree that the mobile phone 2 accesses the master control right of the large screen 1, the interface of the mobile phone 2 enters the interface as described in the embodiment of fig. 12, which is not described herein again.

It can be understood that, based on the operation of accessing the master control right of the first electronic device by the second electronic device in fig. 12, if the second electronic device having the master control right of the large screen 1 in fig. 13 is the mobile phone 1, the subsequent third electronic device, which is the mobile phone 2, needs to apply for obtaining the master control right from the mobile phone 1.

Fig. 14 is an interface schematic diagram of a remote controller acquiring a master right to the large screen 1 according to an embodiment of the present application.

As shown in a in fig. 14, the remote controller keys have numeric buttons "0 to 9", "direction" button, "confirm" button, "cancel" button, "device suspend" button, "area select" button, "bisect" button, "monopolize" button, "acquire master control" button, "change number of devices" button, and the like, and the "direction" button may include up and down buttons and left and right buttons.

Wherein the number buttons in the number area can be used to select the electronic device ID number to be adjusted, after the ID number of the electronic device to be adjusted is selected, the "direction" button may perform a position adjustment operation on the screen-projected content of the electronic device to be adjusted, the "confirm" button may be used to confirm whether the screen-projected content of the electronic device to be adjusted is to be displayed at the position, the "device suspend" button may be used to perform a device suspend operation on the screen-projected content of the electronic device to be adjusted, the "split" button may be used to split the screen area to the screen-projected content of the electronic device to be adjusted, the "exclusive" button may be used to occupy the screen-projected content of the electronic device to be adjusted on the large screen 1, the "acquire master control right" button may be used to apply for acquiring the master control right on the large screen 1, and the "change device number" button may be used to modify the number of devices that the large screen 1 allows to access.

For example, if a user operation on the "acquire master control" button is detected, for example, the remote controller receives a user touch operation in the remote controller, and the touch operation is to select the "acquire master control" button.

Further, the remote controller sends a request for acquiring the master control right to the large screen 1, the interface of the large screen 1 may present an interface shown as B in fig. 14, the large screen 1 may send the request for acquiring the master control right to the mobile phone 2 having the master control right, and accordingly, the mobile phone 2 having the master control right may display a prompt box interface, as shown as C in fig. 14, which prompts whether the mobile phone 2 agrees with the remote controller to acquire the master control right to the large screen 1, in the mobile phone interface, the mobile phone 2 may receive an operation of triggering an "agreement" button by the user in the prompt box to confirm that the remote controller agrees with the master control right to the large screen 1, and may also receive an operation of triggering an "disagreement" button by the user in the prompt box to confirm that the remote controller does not agree with the master control right to the large screen 1.

When the mobile phone 2 receives the operation that the user triggers the 'agree' button in the prompt box and agrees that the remote controller accesses the main control right of the large screen 1, the remote controller can regulate and control the display layout of the screen projection content in the large screen 1.

It can be understood that, based on the operation of accessing the master control right of the first electronic device by the third electronic device in fig. 13, if the third electronic device having the master control right of the large screen 1 in fig. 14 is the mobile phone 2, the subsequent remote controller needs to apply for obtaining the master control right from the mobile phone 2.

It can be understood that the embodiments of the present application only partially illustrate the functions of each key, and the implementation of the above functions that conflict exists may be implemented by selecting an adaptive manner according to requirements in a specific application, so as to ensure that the functions of each key of the remote controller do not conflict. Of course, the above functions may also be implemented by multiplexing direction buttons or number buttons in a remote controller, and the embodiment of the present application is not particularly limited.

In summary, in the embodiment of the present application, the second electronic device, the third electronic device and the remote controller can obtain the master control right through the above method, so as to conveniently regulate and control the display layout of the screen projection content in the first electronic device.

In the following embodiments, the display layout of the first electronic device and the adjustment operation method of the display layout of the first electronic device will be described with reference to the interface schematic diagram.

Illustratively, fig. 15 shows interface diagrams of three possible adjusted display layouts of the first electronic device. Taking the first electronic device as an example of a large screen, the adjusted display layout may be referred to as a self-setting screen layout.

As shown in fig. 15, the interface diagrams of the display layout after the large screen adjustment may be as shown in a in fig. 14, B in fig. 14, and C in fig. 14.

In fig. 15, a is a large-screen interface for displaying screen projection contents of each screen projection device in full screen, the large-screen interface displays screen projection contents of the screen projection devices 1 to 7, the screen projection contents of the screen projection devices 1 to 7 are interfaces of the screen projection devices 1 to 7, each screen projection device interface can display an identity of the corresponding screen projection device, for example, the screen projection devices 1 to 7 interfaces can respectively display "ID 1: UserName1 "-" ID 7: identity of UserName7 ". The display position and size of the interface of the screen projection device 1-7 on the large screen interface are not particularly limited and can be adjusted at will.

In fig. 15, B is a large screen interface in which a part of the screen projection content of the screen projection device is displayed, and another part of the screen projection interface displays an interface on which other application programs run on the large screen, so that the large screen interface can display the screen projection content of the screen projection device 1-7 and an interface on which other application programs run on the large screen, the screen projection content of the screen projection device 1-7 is the interface of the screen projection device 1-7, and the interface of the screen projection device 1-7 can display the identification "ID 1: UserName1 "-" ID 7: UserName7 ". The display positions and sizes of the interfaces of the screen projection equipment 1-7 and the interfaces operated by other application programs on the large screen are not particularly limited and can be adjusted at will.

In fig. 15, C is a layout that the screen projection content of a certain screen projection device can be displayed in a semi-transparent screen layout in the large-screen interface, and the screen projection content of other electronic devices that normally project screens is adjusted and displayed in the large-screen interface, where the semi-transparent screen layout may refer to a layout that is displayed in the form of a semi-transparent floating window. For example, the screen projection content with the ID number "5" in the screen projection device may be suspended and displayed in the large-screen interface, that is, the interface of the screen projection device 5 is suspended and displayed in the large-screen interface, and there may be two ways to adjust the display layout of other electronic devices that normally project screens in the large-screen interface. As shown in fig. 16, fig. 16 is an interface diagram illustrating a display layout of the adjusted screen projection content of the other electronic device in the large screen interface.

If the interface of the screen projecting device 5 is suspended to be displayed in the large-screen interface, the display position and size of the screen projecting content of the other electronic devices in the large-screen interface may be adaptively adjusted, as shown in fig. 16 a, it may be that the area resource occupied by the interface of the screen projecting device 5 is completely occupied by the screen projecting content of one or more of the other electronic devices, the large screen enlarges the display area of the screen projecting content of the other electronic devices, for example, the area resource occupied before the interface of the screen projecting device 5 is completely occupied by the interface of the screen projecting device 4, and the display layout of the interface of the screen projecting device 4 is to be enlarged to display.

As shown in fig. 16B, the area occupied by the interface of the screen projection device 5 may be uniformly distributed to the screen projection content of each other electronic device, the display area of the screen projection content of each other electronic device is enlarged, so as to jointly occupy the display area before the screen projection device 5, for example, the area resources occupied by the interface of the screen projection device 5 are uniformly distributed to the interfaces of the screen projection devices 1 to 4 and 6 to 7, and then the display layouts of the interfaces of the screen projection devices 1 to 4 and 6 to 7 are enlarged. And the interface of each screen projection device can display the identity of the corresponding electronic device.

It is understood that, in fig. 16, the area resources occupied by the interface of the screen projecting device 5 in a are completely occupied by the screen projecting contents of one or more of the other electronic devices, and the number of the specific one or more of the other electronic devices is not particularly limited in the embodiment of the present application.

It should be noted that the self-setting screen layout can apply for and set the position and size of the screen to be projected and displayed on the large screen according to the user's complaint and use scene, and the embodiment of the present application is not particularly limited.

Corresponding to S712 of fig. 7, the process of the first electronic device adjusting the display layout of the screen projection content of the electronic device to be adjusted according to the adjustment indication information may include that the first electronic device displays the screen projection content of the electronic device to be adjusted in a transparent floating manner in response to the adjustment indication information, and when the first electronic device adjusts the screen projection content of the electronic device to be adjusted displayed in the transparent floating manner to an adjustment manner meeting the user' S requirements, the first electronic device normally displays the screen projection content of the electronic device to be adjusted at the adjusted position.

Exemplarily, as shown in fig. 17, taking the first electronic device as a large screen as an example, fig. 17 is a schematic view of a process interface when the large screen performs an operation of adjusting a display layout.

As shown in a in fig. 17, after the large screen receives the adjustment instruction information sent by the third electronic device having the master control right, for example, the adjustment instruction information is to move the interface of the screen projection device 5 to the position where the interface of the screen projection device 4 is located and enlarge and display the area of the interface of the device 5, the large screen may adjust the display layout of the interface of the screen projection device 5 and the interface of the screen projection device 4 according to the adjustment instruction information. The interface of the screen projecting device 5 and the interface of the screen projecting device 4 are the screen projecting contents of the electronic device to be adjusted.

Further, the large-screen interface may enter an interface shown as B in fig. 17, as shown in B in fig. 17, the large-screen displays the interface of the screen projecting device 5 in a transparent suspension manner in response to the adjustment indication information, and after the large-screen moves the interface of the screen projecting device 5 displayed in the transparent suspension manner to the position where the interface of the screen projecting device 4 is located and expands the area of the interface of the device 5 to display the interface in accordance with the adjustment indication information, the large-screen may normally display the interface of the screen projecting device 5 and the interface of the screen projecting device 4 in the adjusted position, such as the large-screen interface shown as C in fig. 17, in the large-screen interface, the interface of the screen projecting device 5 is displayed at the position of the interface of the previous screen projecting device 4, and accordingly, the interface of the screen projecting device 4 is adjusted to an appropriate position and size in the large-screen display interface.

In a possible implementation manner, the third electronic device with the master control right may receive an operation of triggering a function option by a user, and is configured to adjust the display layout of the screen-casting content of the electronic device to be adjusted in the large screen, where the operation may include reducing the screen-casting content of a certain electronic device to be adjusted, expanding the screen-casting content of a certain electronic device to be adjusted, monopolizing the screen-casting content of a certain electronic device to be adjusted on the display interface of the whole large screen, bisecting the display interface of the large screen, and suspending the screen-casting content of a certain electronic device to be adjusted by the device, and so on. Specifically, taking the example of enlarging the screen-shot content of a certain electronic device to be adjusted, as shown in fig. 18.

For example, fig. 18 is an interface schematic diagram for adjusting a large-screen display layout provided in the embodiment of the present application, and taking the third electronic device as a mobile phone to adjust the large-screen display layout as an example, there may be three ways:

the first method is as follows: as shown in a in fig. 18, after the mobile phone with the main control right displays the corresponding function box interface and has received the operation of the user selecting the ID number 5 of the electronic device to be adjusted, if the user operation on the "expand" button by the user is detected, for example, the mobile phone receives the touch operation on the function box interface by the user, and the touch operation is to select the "expand" button.

Correspondingly, the mobile phone sends the adjustment instruction information with the ID number of 5 for the electronic device to be adjusted, which is enlarged, to the large screen, and further, after the large screen adjusts the screen-shot content with the ID number of 5 for the electronic device to be adjusted, which is enlarged in a transparent and floating manner, to the size that meets the instruction information, the large screen interface may enter an interface as shown in D in fig. 18, in the large screen interface, the electronic device "ID 5: the screen projection content of the UserName 5' is enlarged and highlighted, and the position and the size of the screen projection content of other electronic equipment are adjusted in a self-adaptive mode in a display interface of a large screen.

If the electronic device "ID 5 to be adjusted: if the screen projection content of the UserName5 "needs to be enlarged and displayed, the screen projection content with the ID number of 5 of the electronic device to be adjusted can be enlarged and displayed by repeating the above steps.

The second method comprises the following steps: as shown in B in fig. 18, after the mobile phone with the main control right displays the corresponding function box interface and has received the operation of the user selecting the electronic device to be adjusted with ID number 5, if it is detected that the user touches the electronic device to be adjusted "ID 5" in the mobile phone interface 1: for example, the mobile phone receives a touch operation of the user in the mobile phone interface 1, where the touch operation is to enlarge the electronic device "ID 5: UserName5 ".

Correspondingly, the mobile phone sends the adjustment indication information with the expanded ID number of 5 of the electronic device to be adjusted to the large screen, and further, after the large screen adjusts the screen projection content with the ID number of 5 of the expanded electronic device to be adjusted, which is transparently and suspendedly displayed, to the size that meets the indication information, the large screen interface may enter the interface shown as D in fig. 18, which is similar to the first mode and is not described again.

It can be understood that the touch operation may be any possible operation manner such as long pressing, heavy pressing, multiple clicking, touching, and gesture, and only needs to be free from conflict with the function of each touch operation in the mobile phone, and the embodiment of the present application is not particularly limited.

The third method comprises the following steps: as shown in C in fig. 18, in the mobile phone interface 1 accessing the master control right, the touch operation of the user may be received to enlarge and display the screen projection content with the ID number of 5 of the electronic device to be adjusted, without entering the function block interface shown in a or B in fig. 18, and accordingly, the mobile phone sends the adjustment instruction information with the ID number of 5 of the electronic device to be adjusted, which is enlarged in a transparent floating manner, to the large screen, and after the screen projection content with the ID number of 5 of the electronic device to be adjusted, which is enlarged in a transparent floating manner, is adjusted to meet the size of the instruction information, the mobile phone enters the large screen interface shown in D in fig. 18, which is similar to the first mode and is not described again. Therefore, display interfaces can be reduced, and computing resources of a large screen can be saved.

In another possible implementation manner, the remote controller with the master control right may also receive an operation of a user triggering a key of the remote controller, so as to adjust the display layout of the screen projection content of the electronic device to be adjusted in the large screen, where the operation may be to control the display content selected by the remote controller to implement monopolization or device suspension, or to control the display area of the first electronic device to be divided equally or the display area to be selected, or to change the number of the electronic devices allowed to be accessed by the first electronic device, and so on. Specifically, for example, as shown in fig. 19, the display area of the first electronic device is controlled to be selected, and the screen projection content of a certain electronic device to be adjusted is further enlarged.

For example, fig. 19 is another interface schematic diagram for adjusting a large-screen display layout provided in the embodiment of the present application, and an example is that a remote controller adjusts and controls the large-screen display layout.

As shown in a in fig. 19, if a user operation performed by the user on a key of the remote controller is detected, for example, the remote controller receives a touch operation of the user in a numeric area of the remote controller, where the touch operation is a selected numeric button "5", the numeric button "5" corresponds to an electronic device to be adjusted having an ID number of 5, and accordingly, the electronic device to be adjusted "ID 5: the screen projection content of the UserName 5' is highlighted in the display interface of the large screen, namely the interface of the screen projection device 5 in the large screen is highlighted.

Further, if it is detected that the user performs an adjustment operation on the interface of the screen projection device 5, for example, the remote controller receives an operation of the user pressing a region selection button in the remote controller for a long time, the large screen may enter the interface shown as B in fig. 19, in the interface, the large screen receives an operation of the user manually defining a corresponding large screen region, and accordingly, the screen region is displayed in the large screen in a transparent suspension manner, and the position and size of the screen region are not specifically limited in the embodiment of the present application.

Further, the large screen receives an operation of clicking a confirmation button of the remote controller by the user, the operation is used for determining that the interface of the screen projecting device 5 is displayed in the large screen area, the large screen enters the interface shown as C in fig. 19, in the interface, the interface of the screen projecting device 5 is enlarged and displayed, and the screen projecting contents of other electronic devices can be adaptively adjusted in the display interface of the large screen, that is, the interfaces of the screen projecting devices 1 to 4 and 6 to 7 are adaptively adjusted in the large screen.

It can be understood that, when the interface of the large-screen display layout is adjusted, if the large screen is a touch-controllable large screen, the large screen may control the display layout of the multiple screen-projected contents in the large screen according to the remote control information, or may adjust and control the display layout of the multiple screen-projected contents in the large screen through a touch operation of the user in the display interface of the large screen. For example, taking enlarging the screen-projected content of a certain electronic device to be adjusted as an example, if the large screen receives a touch operation that the user enlarges the screen-projected content of the certain electronic device to be adjusted in the display interface of the large screen, the screen-projected content of the certain electronic device to be adjusted is enlarged and displayed in the display interface of the large screen, and the screen-projected contents of other electronic devices can be adaptively adjusted in the display interface of the large screen.

In some embodiments, if an abnormal situation occurs in the screen-projected content of any electronic device that realizes screen projection in the first electronic device, where the abnormal situation may be a network failure, the method provided in the embodiments of the present application may intelligently optimize the display layout of the first electronic device, remove the screen-projected content of any abnormal electronic device, and adjust the display layout of the screen-projected content of other electronic devices that normally project screens in the first electronic device. For example, fig. 20 is an interface schematic diagram for adjusting a display layout when any electronic device is abnormally disconnected according to an embodiment of the present application.

As shown in fig. 20, if the display interface of the first electronic device is in the default layout state, as shown in a of fig. 20, the display interface of the first electronic device is in a display layout of four halves in a quad format, and the display interface has any electronic device "ID 1: UserName1 "-" ID 4: the screen projecting contents of the UserName 4' respectively correspond to the screen projecting devices 1-4, when the screen projecting contents of the screen projecting device 2 are abnormally disconnected, the first electronic device can intelligently optimize a display interface of the first electronic device, automatically remove the screen projecting contents of the screen projecting device 2, and enter an interface shown as B in fig. 20, in the interface, the first electronic device adjusts the display layout of the screen projecting contents of other electronic devices which normally project screens, namely the display interface of the first electronic device is adjusted to be a vertically-equally-divided trisection display layout, and the display interface has any electronic device ID 1: screen-projected content of UserName1 ", arbitrary electronic device" ID 3: screen-shot content of UserName3 "and any electronic device" ID 4: UserName4 ".

For example, fig. 21 is another interface schematic diagram for adjusting a display layout when any electronic device is abnormally disconnected according to the embodiment of the present application.

As shown in fig. 21, if the display interface of the first electronic device is in the self-setting screen layout state, as shown in a in fig. 21, the display interface of the first electronic device is in the adjusted state, and the display interface has any electronic device "ID 1: UserName1 "-" ID 7: the screen projecting contents of the UserName7 ″ respectively correspond to the screen projecting devices 1 to 7, and when the screen projecting contents of the screen projecting device 5 are abnormally disconnected, the first electronic device may intelligently optimize the display interface of the first electronic device, automatically remove the screen projecting contents of the screen projecting device 5, and enter the interface shown as B in fig. 21 or C in fig. 21, where in the interface shown as B in fig. 21 or C in fig. 21, the display layout of the display interface of the first electronic device is similar to the embodiment described in fig. 16, and is not described herein again.

Based on this, the screen projecting method provided in the embodiment of the application can enable the second electronic device and the third electronic device to have the right to selectively project the screen to the display position and size in the first electronic device, and also have the right to acquire the master control right, and can also adaptively adjust the display layout of the first electronic device when any electronic device implementing screen projection is abnormally disconnected, so that the diversity of the display layout and the operation flexibility of the first electronic device are improved.

Optionally, in this embodiment of the application, the number of the first electronic devices may also be multiple, and a connection relationship exists between the multiple first electronic devices, so that the display range may be increased.

Illustratively, taking two first electronic devices as two large screens as an example, as shown in fig. 22, fig. 22 shows an interface schematic diagram of a plurality of screen projection devices projecting screens to the two large screens.

As shown in a of fig. 22, the two first electronic devices are a large screen 1 and a large screen 2, and there is a connection relationship between the large screen 1 and the large screen 2, so that a screen sharing and expanding function can be realized, and when there are screen projection contents of 14 screen projection devices projected onto the large screen 1 and the large screen 2, further, as shown in B of fig. 22, in a display interface of the large screen 1 and the large screen 2, taking a default layout mode as an example, the default layout mode may refer to that the display interface of the large screen 1 and the large screen 2 is divided into 14 display layouts for display in a vertical direction, and in the display interface, the screen projection contents of 14 screen projection devices are shared, and are respectively screen projection devices "ID 1: UserName1 "-" ID 14: the screen projection contents of UserName14 ", the screen projection contents of the 14 screen projection devices are respectively displayed in the 14 display layouts.

It is understood that the large screen 1 and the large screen 2 may also display the display layout described in the above embodiment and perform the adjustment operation of the display layout described in the above embodiment, and details are not described herein again.

It should be noted that, in the foregoing embodiment, the third electronic device is taken as a mobile phone as an example for description, in a possible implementation manner, the third electronic device may further include a computer, for example, the third electronic device in fig. 18 may be a mobile phone and may be replaced by a computer.

In a possible implementation manner, before the third electronic device sends instruction information for adjustment to the first electronic device, the third electronic device may display a display state in the first electronic device, where the display state includes a display position and a display area size of each screen-projected content in the first electronic device, receive a dragging operation of an input device on the display position and/or the display area size of any screen-projected content, and obtain an adjustment manner of the electronic device to be adjusted according to the dragging operation, where the instruction information for adjustment includes an identifier of the electronic device to be adjusted and an adjustment manner of the electronic device to be adjusted.

In the following, the first electronic device is taken as a large screen, and the third electronic device is taken as a computer for brief description, wherein the input device may be a mouse.

For example, taking the expansion of the screen-casting content of a certain electronic device to be adjusted as an example, after a computer with a master control right displays an interface of a display position and a display area size of each screen-casting content in a large screen, if a dragging operation of a user acting on the screen-casting content of the certain electronic device to be adjusted through a mouse is detected, for example, the computer receives the dragging operation of the user in the computer interface through the mouse, and the dragging operation is the expansion of the screen-casting content of the certain electronic device to be adjusted.

Correspondingly, the computer sends the adjustment indication information for enlarging a certain electronic device to be adjusted to the large screen, and further, after the large screen adjusts the screen projection content of the enlarged electronic device to be adjusted, which is displayed in a transparent suspension manner, to the size according with the indication information, the large screen interface can enlarge and highlight the screen projection content of the certain electronic device to be adjusted, and the screen projection of other electronic devices can adaptively adjust the position and the size in the display interface of the large screen.

It can be understood that the dragging operation may also include reducing the screen-projected content of a certain electronic device to be adjusted, monopolizing the screen-projected content of the certain electronic device to be adjusted on the display interface of the whole large screen, bisecting the display interface of the large screen, suspending the screen-projected content of the certain electronic device to be adjusted by the device, and the like.

It should be noted that the above embodiments can be used alone or in combination with each other to achieve different technical effects.

In the embodiments provided in the present application, the method provided in the embodiments of the present application is described from the perspective of an electronic device as an execution subject. In order to implement the functions in the method provided by the embodiments of the present application, the electronic device may include a hardware structure and/or a software module, and the functions are implemented in the form of a hardware structure, a software module, or a hardware structure and a software module. Whether any of the above-described functions is implemented as a hardware structure, a software module, or a hardware structure plus a software module depends upon the particular application and design constraints imposed on the technical solution.

Fig. 23 is a schematic hardware structure diagram of a screen projection apparatus according to an embodiment of the present application. Referring to fig. 23, the apparatus includes: a memory 2301, a processor 2302, and interface circuitry 2303. The apparatus may also include a display 2304, wherein the memory 2301, the processor 2302, the interface circuit 2303 and the display 2304 may communicate; illustratively, the memory 2301, the processor 2302, the interface circuit 2303 and the display 2304 may communicate via a communication bus, and the memory 2301 is used for storing computer-executable instructions, and is controlled by the processor 2302 to execute the communication, and the interface circuit 2303 to execute the communication, so as to implement the screen projection method provided by the embodiments described below in the present application.

In a possible implementation manner, the computer execution instructions in the embodiment of the present application may also be referred to as application program codes, which is not specifically limited in the embodiment of the present application.

Optionally, the interface circuit 2303 may also include a transmitter and/or a receiver. Optionally, the processor 2302 may include one or more CPUs, and may also be other general-purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), and the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with the present application may be embodied directly in a hardware processor, or in a combination of the hardware and software modules in the processor.

An embodiment of the present application further provides an electronic device, including: a display screen, a processor, a memory, one or more sensors, a power source, an application program, and a computer program. The above-described devices may be connected by one or more communication buses. Wherein the one or more computer programs are stored in the memory and configured to be executed by the one or more processors, and the one or more computer programs include instructions that can be used to cause the electronic device to perform the steps of the interface display method in the embodiments.

Illustratively, the processor may be specifically the processor 210 shown in fig. 2, the memory may be specifically the memory 230 shown in fig. 2, the display screen may be specifically the display unit 270 shown in fig. 2, the sensor may be specifically one or more sensors in the sensors 201 shown in fig. 2, and the power supply may be the power supply 250 shown in fig. 2. The embodiment of the present application does not set any limit to this.

In addition, an embodiment of the present application further provides a Graphical User Interface (GUI) on an electronic device, where the GUI specifically includes a GUI displayed by the electronic device when the electronic device executes the foregoing method embodiments.

In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. The procedures or functions described in accordance with the embodiments of the invention are all or partially effected when the computer program instructions are loaded and executed on a computer. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wirelessly (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others. The aspects of the above embodiments may all be used in combination without conflict.

The embodiment of the application also provides a computer readable storage medium. The methods described in the above embodiments may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. If implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media may include computer storage media and communication media, and may include any medium that can communicate a computer program from one place to another. A storage medium may be any target medium that can be accessed by a computer.

In one possible implementation, the computer-readable medium may include RAM, ROM, a compact disk read-only memory (CD-ROM) or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer. Also, any connection is properly termed a computer-readable medium. For example, if the software is transmitted from a website, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL), or wireless technologies such as infrared, radio, and microwave, then the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. Disk and disc, as used herein, includes disc, laser disc, optical disc, Digital Versatile Disc (DVD), floppy disk and blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.

Embodiments of the present application are described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processing unit of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processing unit of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

The above embodiments are only for illustrating the embodiments of the present invention and are not to be construed as limiting the scope of the present invention, and any modifications, equivalent substitutions, improvements and the like made on the basis of the embodiments of the present invention shall be included in the scope of the present invention.

Claims

1. A screen projection method is characterized by being applied to a screen projection system, wherein the screen projection system comprises first electronic equipment, second electronic equipment and third electronic equipment, the first electronic equipment is a large screen, the second electronic equipment and the third electronic equipment are mobile phones, and the first electronic equipment is communicated with the second electronic equipment and the third electronic equipment respectively by adopting a first screen projection protocol; in the first screen projection protocol, when the screen projection device is supported to initiate screen projection to the screen projected device, the following items are specified based on an Accept header of a DESCRIBE command in a real-time streaming protocol RTSP: the channel number of the screen projection content when displayed in the screen projection device, the number of devices allowed to be accessed, a full-screen display mode or a split-screen display mode, the position of split-screen display in the screen projection device and the area of split-screen display in the screen projection device; in the first screen projection protocol, when the screen projection device replies a request for screen projection to the screen projection device, the screen projection device further supports the following items: the screen projection method comprises the steps of identifying screen projection equipment, displaying positions of the screen projection equipment, displaying areas of the screen projection equipment, identifying whether the screen projection equipment is master control equipment or not, and inquiring whether the screen projection equipment requests master control right or not;

the method comprises the following steps:

the second electronic device displaying a third user interface, the third user interface including a display area option and/or a display location on the first electronic device;

the second electronic equipment receives user operation for selecting the first display area option and/or user operation for selecting the first target position;

the second electronic device sends the first screen projection request to the first electronic device, wherein the first screen projection request comprises information of the first display area option and/or information of the first target position;

the first electronic equipment receives a first screen projection request from the second electronic equipment;

the first electronic equipment displays screen projection content of the second electronic equipment at the first target position according to the first screen projection request;

the third electronic equipment receives screen projection operation for triggering the first electronic equipment to send a second screen projection request; the second screen projection request comprises a second target position;

responding to the screen projection operation, the third electronic equipment displays a first user interface, and the first user interface comprises information for prompting whether to acquire a master control right;

when the third electronic device receives an operation for indicating to acquire a master control right, the third electronic device sends the second screen projection request to the first electronic device;

the first electronic equipment displays the screen projection content of the third electronic equipment at the second target position according to the second screen projection request;

the third electronic device displays a second user interface including an option for selecting the electronic device to be adjusted and one or more of the following functional options: narrowing function options, enlarging function options, monopolizing function options, grading function options or equipment hanging function options;

the third electronic equipment determines the electronic equipment to be adjusted according to the option for selecting the electronic equipment to be adjusted;

the third electronic equipment obtains the adjustment mode of the electronic equipment to be adjusted according to the selected function option;

the third electronic equipment sends adjustment indicating information to the first electronic equipment, wherein the adjustment indicating information is used for indicating and adjusting the display layout of the screen projection content of the electronic equipment to be adjusted, and the adjustment indicating information comprises the identification of the electronic equipment to be adjusted and the adjustment mode of the electronic equipment to be adjusted; the electronic device to be adjusted comprises the first electronic device, the second electronic device and/or the third electronic device;

the first electronic equipment adjusts the display layout of the screen projection content of the electronic equipment to be adjusted according to the adjustment indication information;

the first electronic device adjusts the display layout of the screen projection content of the electronic device to be adjusted according to the adjustment indication information, and the method includes the following steps:

the first electronic equipment responds to the adjustment indication information to transparently and suspendedly display screen projection content of the electronic equipment to be adjusted;

when the first electronic device adjusts the screen projection content of the electronic device to be adjusted, which is displayed in a transparent suspension manner, to be in accordance with an adjustment mode, the first electronic device normally displays the screen projection content of the electronic device to be adjusted at the adjusted position.

2. The method of claim 1, further comprising:

the first electronic equipment receives remote control information from a remote controller, wherein the remote control information is used for controlling display contents selected by the remote controller to realize monopolization or equipment suspension, or the remote control information is used for controlling a display area of the first electronic equipment to be divided equally or the display area to be selected, or the remote control information is used for changing the number of the electronic equipment allowed to be accessed by the first electronic equipment;

the first electronic equipment controls the display of a plurality of screen projection contents in the first electronic equipment according to the remote control information.

3. The method of claim 2, wherein before the first electronic device receives the remote control information from the remote control, further comprising:

the first electronic equipment receives indication information for acquiring the master control right from the remote controller;

the first electronic equipment sends a request for acquiring the master control right to the third electronic equipment;

the first electronic device receives an agreement reply from the third electronic device.

4. The method of claim 1, further comprising:

when any electronic device which realizes screen projection in the first electronic device sends a network fault or is suspended, the first electronic device adjusts the display layout of screen projection contents of other electronic devices which normally project screens.

5. The method of claim 4, wherein when any electronic device in the first electronic device that realizes screen projection fails to transmit a network or is suspended, the first electronic device adjusts a display layout of screen projection contents of other normally projected electronic devices, and the method comprises:

the first electronic equipment enlarges the display areas of the screen projection contents of the other electronic equipment so as to jointly occupy the display area before any electronic equipment;

or the first electronic device enlarges the display area of the screen projection content of one or more of the other electronic devices.

6. A method of screen projection, the method comprising:

the method comprises the steps that a first electronic device receives a first screen projection request from a second electronic device; the first screen projection request comprises information of a first display area option and/or information of a first target position;

the first electronic device receiving a second screen projection request from a third electronic device; wherein the third electronic device has a master control right; the second screen projection request comprises a second target position;

the first electronic device receives adjustment indication information from the third electronic device, wherein the adjustment indication information is used for indicating and adjusting the display layout of screen projection content of the electronic device to be adjusted, and the adjustment indication information comprises an identifier of the electronic device to be adjusted and an adjustment mode of the electronic device to be adjusted; the electronic device to be adjusted comprises the first electronic device, the second electronic device and/or the third electronic device;

the first electronic device is a large screen, and the second electronic device and the third electronic device are mobile phones; the first electronic device is a large screen, and the second electronic device and the third electronic device are mobile phones; the first electronic equipment is communicated with the second electronic equipment and the third electronic equipment respectively by adopting a first screen projection protocol;

in the first screen projection protocol, when the screen projection device is supported to initiate screen projection to the screen projected device, the following contents are specified based on an Accept header of a DESCRIBE command in a real-time streaming protocol RTSP: the channel number of the screen projection content when displayed in the screen projection device, the number of devices allowed to be accessed, a full-screen display mode or a split-screen display mode, the position of split-screen display in the screen projection device and the area of split-screen display in the screen projection device; in the first screen projection protocol, when the screen projection device replies a request for screen projection to the screen projection device, the screen projection device further supports the following items: the screen projection method comprises the steps of identifying screen projection equipment, displaying positions of the screen projection equipment, displaying areas of the screen projection equipment, identifying whether the screen projection equipment is master control equipment or not, and inquiring whether the screen projection equipment requests master control right or not;

the first electronic device adjusts the display layout of the screen projection content of the electronic device to be adjusted according to the adjustment indication information, and the display layout comprises the following steps:

7. The method of claim 6, further comprising:

8. The method of claim 7, wherein before the first electronic device receives the remote control information from the remote control, further comprising:

9. The method of claim 7, further comprising:

10. The method of claim 9, wherein when any electronic device that realizes screen projection in the first electronic device sends a network failure or is suspended, the first electronic device adjusts a display layout of screen projection contents of other normally projected electronic devices, and the method comprises:

11. A method of screen projection, the method comprising:

the third electronic equipment receives screen projection operation for triggering the second screen projection request sent to the first electronic equipment; the second screen projection request comprises a second target position;

the third electronic equipment sends adjustment indicating information to the first electronic equipment, wherein the adjustment indicating information is used for indicating and adjusting the display layout of the screen projection content of the electronic equipment to be adjusted; the electronic equipment to be adjusted comprises the first electronic equipment, the second electronic equipment and/or the third electronic equipment;

the adjustment indication information comprises an identifier of the electronic device to be adjusted and an adjustment mode of the electronic device to be adjusted, the first electronic device is a large screen, and the second electronic device and the third electronic device are mobile phones; the first electronic equipment is communicated with the second electronic equipment and the third electronic equipment respectively by adopting a first screen projection protocol;

in the first screen projection protocol, when the screen projection device is supported to initiate screen projection to the screen projected device, the following contents are specified based on an Accept header of a DESCRIBE command in a real-time streaming protocol RTSP: the channel number of the screen projection content when displayed in the screen projection device, the number of devices allowed to be accessed, a full-screen display mode or a split-screen display mode, the position of split-screen display in the screen projection device and the area of split-screen display in the screen projection device; in the first screen projection protocol, when the screen projection device replies a request for screen projection to the screen projection device, the screen projection device further supports the following items: the screen projection device comprises an identification of the screen projection device, a display position of the screen projection device, a display area of the screen projection device, information for identifying whether the screen projection device is a main control device, and information for inquiring whether the screen projection device requests a main control right.

12. An electronic device, comprising: a processor and a memory;

the memory stores computer-executable instructions;

the processor executing the computer-executable instructions stored by the memory causes the processor to perform the method of any of claims 6-10.

13. An electronic device, comprising: a processor and a memory;

the memory stores computer-executable instructions;

the processor executing the computer-executable instructions stored by the memory causes the processor to perform the method of claim 11.

14. A screen projection system, comprising: an electronic device as claimed in claim 12 or an electronic device as claimed in claim 13.

15. A computer-readable storage medium, in which a computer program or instructions are stored which, when executed, implement the method of any one of claims 6-10 or the method of claim 11.