CN115209213B

CN115209213B - Wireless screen projection method and mobile device

Info

Publication number: CN115209213B
Application number: CN202211010805.5A
Authority: CN
Inventors: 任自忠
Original assignee: Honor Device Co Ltd
Current assignee: Honor Device Co Ltd
Priority date: 2022-08-23
Filing date: 2022-08-23
Publication date: 2023-01-20
Anticipated expiration: 2042-08-23
Also published as: CN115209213A

Abstract

The application provides a wireless screen projection method and mobile equipment, relates to the technical field of screen projection, and can provide all screen projection modes supported by electronic equipment for a user to select so as to meet screen projection requirements of the user and improve use experience of the user. The method comprises the following steps: the mobile equipment displays a first interface, wherein the first interface comprises a first control; in response to the operation of the first control by the user, the mobile device displays an available device list, wherein the available device list comprises one or more electronic devices nearby the mobile device and screen projection modes supported by the one or more electronic devices; responding to the operation that a user selects first equipment in the available equipment list, and displaying a screen projection mode list of the first equipment by the mobile equipment, wherein the screen projection mode list comprises a first screen projection mode and a second screen projection mode supported by the first equipment; and in response to the operation that the user selects the first screen projection mode in the screen projection mode list, the mobile device projects the screen to the first device in the first screen projection mode or the second screen projection mode.

Description

Wireless screen projection method and mobile device

Technical Field

The application relates to the technical field of screen projection, in particular to a wireless screen projection method and mobile equipment.

Background

The wireless screen projection enables mobile devices such as mobile phones and tablets to project multimedia contents (such as music, pictures, videos and the like) being played to electronic devices such as televisions and smart screens with audio and video playing capabilities. Typical wireless screen shots include mirror shots, application shots, and the like. The mirror image screen projection can be realized based on the Miracast standard established by the Wi-Fi alliance and other modes; the application screen projection can be realized based on Digital Living Network Alliance (DLNA) protocols and other modes.

In the prior art, some electronic devices originally supporting mirror image screen projection and application screen projection only provide a screen projection mode for a user after receiving a screen projection request sent by a mobile device. Therefore, the user cannot select the screen projection mode by himself, and the screen projection requirement of the user is difficult to meet.

Disclosure of Invention

The embodiment of the application provides a wireless screen projection method and mobile equipment, and all screen projection modes supported by the electronic equipment can be provided for a user to select.

In order to achieve the above purpose, the embodiment of the present application adopts the following technical solutions:

in a first aspect, an embodiment of the present application provides a wireless screen projection method, where the method includes: the mobile equipment displays a first interface, wherein the first interface comprises a first control; if the operation of the user on the first control is detected, for example, a touch operation, a click operation and the like, the mobile device displays an available device list, the available device list comprises one or more electronic devices near the mobile device and screen projection modes supported by the one or more electronic devices, and the user can select specific devices needing screen projection from the available device list; if the operation that the user selects the first device in the available device list is detected, the mobile device displays a screen projection mode list of the first device, the screen projection mode list comprises a first screen projection mode (also called mirror image screen projection, mobile phone screen projection and the like) and a second screen projection mode (also called application screen projection, online screen projection and the like) supported by the first device, and the user can select a required screen projection mode in the screen projection mode list; and if the operation that the user selects the first screen projection mode in the screen projection mode list is detected, the mobile equipment projects the screen to the first equipment in the first screen projection mode or the second screen projection mode.

Therefore, when the mobile device displays the available device list, the screen projection modes which can be supported by each device can be displayed, and a user can conveniently select the screen projection devices meeting the requirements of the user after knowing the screen projection modes. In addition, after the user selects the screen projection device (for example, the first device), the user can display all screen projection modes supported by the first device for the user to select by himself, so that the screen projection requirements of the user are met, and the use experience of the user is improved.

In one possible implementation, before the mobile device displays the list of available devices, the method further comprises: the method comprises the steps that the mobile device obtains device information of one or more electronic devices nearby the mobile device; the method comprises the steps of inquiring screen projection modes supported by one or more electronic devices in a preset device database based on device information of the one or more electronic devices, wherein the preset device database stores data information of the plurality of electronic devices, and the data information of each electronic device comprises the device information of the electronic device and screen projection protocols supported by the electronic device. Furthermore, the mobile device can present the inquired one or more electronic devices and the screen projection modes supported by the electronic devices on the available device list for the user to select.

In one possible implementation, the method further includes: whether the first equipment turns on a Miracast switch is detected. On the basis, if the first equipment turns on a Miracast switch, the mobile equipment casts a screen to the first equipment in a first screen casting mode; and if the Miracast switch is not turned on by the first device, the mobile device casts a screen to the first device in a second screen casting mode.

In a possible implementation manner, if the Miracast switch is not turned on by the first device, the method further includes: the mobile device displays a first window, the first window comprises first prompt information, the first prompt information indicates that the first device does not open the Miracast switch, and guides a user to open the Miracast switch of the first device. Therefore, the Miracast switch of the first device can be rapidly guided to be opened by a user, and the requirement that the user uses a first screen projection mode is met.

In one possible implementation, the method further includes: and the mobile device casts preset media content to the first device based on the second screen casting mode, wherein the preset media content is used for indicating that the first device does not start the Miracast switch and guiding the user to start the Miracast switch of the first device. Therefore, the user can be guided to open the Miracast switch of the first device on the first device, and the requirement of the user for using the first screen projection mode is met quickly.

In one possible implementation manner, if the first device has turned on the Miracast switch, the method further includes: the mobile device displays a second window, the second window including second prompt information indicating that the mobile device has connected to the first device. That is, when the Miracast switch is turned on by the first device, the mobile device and the first device can normally mirror and project the screen.

In one possible implementation, the method further includes: and in response to the operation that the user selects the second screen projection mode in the screen projection mode list, the mobile device projects the screen to the first device in the second screen projection mode. That is, the user may select the second screen projection manner for screen projection.

In one possible implementation, the method further includes: the mobile device displays a third window, the third window comprising a plurality of application options; in response to an operation of selecting a first application from the plurality of application options by the user, the mobile device starts the first application and screens the content of the first application to the first device. The plurality of application options may include a gallery application, a music application, and a video application, that is, the second screen projection mode only supports the mobile device to project pictures, music, and videos to the first device.

In one possible implementation, the method further includes: the method comprises the steps that the mobile equipment displays a main interface, and a first icon is included on the main interface; in response to the user's operation of the first icon, the mobile device displays a third window, the third window including a plurality of application options; in response to an operation of selecting a first application from the plurality of application options by the user, the mobile device starts the first application and screens the content of the first application to the first device.

In a possible implementation manner, the first screen projection manner is screen projection based on a Miracast protocol, and the second screen projection manner is screen projection based on a DLNA protocol.

In a second aspect, an embodiment of the present application provides a mobile device, where the mobile device includes: a display screen; one or more processors; a memory; a communication module; wherein the memory has stored therein one or more computer programs, the one or more computer programs comprising instructions, which when executed by the mobile device, cause the mobile device to perform the wireless screen projection method as in any one of the implementations of the first aspect.

In a third aspect, an embodiment of the present application provides a computer-readable storage medium, where instructions are stored in the computer-readable storage medium, and when the instructions are executed on a mobile device, the mobile device may perform the wireless screen projection method in any implementation manner of the first aspect.

In a fourth aspect, embodiments of the present application provide a computer program product containing instructions that, when run on a mobile device, enable the mobile device to perform the method of any one of the above first aspects.

For technical effects brought by any one of the design manners in the second aspect to the fourth aspect, reference may be made to technical effects brought by different design manners in the first aspect, and details are not described herein.

Drawings

FIG. 1 is a schematic diagram of a projection system;

FIG. 2 is an interface diagram of a screen projection process in the prior art;

FIG. 3 is an interface diagram of a screen projection process in the prior art;

FIG. 4 is an interface diagram of a screen projection process in the prior art;

fig. 5 is a scene schematic diagram of a wireless screen projection method according to an embodiment of the present application;

fig. 6 is a schematic structural diagram of a mobile device according to an embodiment of the present application;

fig. 7 is an interface diagram of a mobile device according to an embodiment of the present application;

fig. 8 is an interface diagram of a mobile device according to an embodiment of the present application;

fig. 9 is an interface diagram of a mobile device according to an embodiment of the present application;

fig. 10 is an interface diagram of a mobile device according to an embodiment of the present application;

fig. 11 is an interface diagram of a mobile device according to an embodiment of the present application;

fig. 12 is an interface diagram of a mobile device according to an embodiment of the present application;

fig. 13 is an interface diagram of a mobile device according to an embodiment of the present application;

fig. 14 is an interface diagram of a mobile device according to an embodiment of the present application;

fig. 15 is an interface diagram of a mobile device according to an embodiment of the present application;

fig. 16 is an interface diagram of a mobile device according to an embodiment of the present application;

fig. 17 is an interface diagram of a mobile device according to an embodiment of the present application;

fig. 18 is a diagram of a screen of an electronic device according to an embodiment of the present application;

fig. 19 is an interface diagram of a mobile device according to an embodiment of the present application;

fig. 20 is a diagram of a screen of an electronic device according to an embodiment of the present application;

FIG. 21 is a set of interface diagrams for a mobile device provided by embodiments of the present application;

fig. 22 is a diagram of a screen of an electronic device according to an embodiment of the present application;

fig. 23 is an interface diagram of a mobile device according to an embodiment of the present application;

FIG. 24 is a set of interface diagrams for a mobile device provided by embodiments of the present application;

FIG. 25 is a set of interface diagrams for a mobile device provided by embodiments of the present application;

FIG. 26 is a set of interface diagrams for a mobile device provided by embodiments of the present application;

fig. 27 is an interface diagram of a mobile device according to an embodiment of the present application;

fig. 28 is a flowchart of a wireless screen projection method according to an embodiment of the present application;

fig. 29 is a schematic structural diagram of a chip system according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. In the description of the present application, unless otherwise specified, "at least one" means one or more, "a plurality" means two or more. In addition, in order to facilitate clear description of technical solutions of the embodiments of the present application, in the embodiments of the present application, terms such as "first" and "second" are used to distinguish the same items or similar items having substantially the same functions and actions. Those skilled in the art will appreciate that the terms "first," "second," etc. do not denote any order or quantity, nor do the terms "first," "second," etc. denote any order or importance.

For clarity and conciseness of the following description of the various embodiments, a brief introduction to related concepts or technologies is first presented:

mirror image projection: the method comprises the following steps that communication connection is established between mobile equipment (such as a mobile phone and a tablet) and electronic equipment (such as a television and an intelligent screen), the mobile equipment acquires multimedia content from a network side or a local side, and then the multimedia content is transmitted to the electronic equipment in a wireless transmission mode such as point-to-point transmission after being encoded; the electronic device decodes and outputs (e.g., displays, plays, etc.). The mobile device may also be referred to as an output terminal or a source terminal (source terminal), and the electronic device may also be referred to as an input terminal or a sink terminal (sink terminal).

The multimedia content may be network multimedia content, local multimedia content, or a combination of both. The network multimedia content refers to multimedia content acquired by the mobile device from a network, for example, video acquired by the mobile device from a server providing an audio and video service when the mobile device runs a video application. Local multimedia content refers to multimedia content stored or generated locally by a mobile device, such as pictures or tables stored locally by the mobile device.

The peer-to-peer transmission mode between the mobile device and the electronic device may include, but is not limited to: wireless fidelity Direct (Wifi Direct) (also known as wireless fidelity peer-to-peer (Wi-Fi P2P)) communication connection, bluetooth communication connection, near Field Communication (NFC) connection, and the like.

The mirror projection can comprise Miracast established by the Wi-Fi alliance, private mirror projection solutions established by various companies, such as Cast +, airplay, and the like. The Miracast is established on a basic technical standard and a Real Time Streaming Protocol (RTSP) developed by the Wi-Fi alliance. The Wi-Fi basic technology standard can include wireless transmission technology 802.11n, 802.11ac, wifi Direct/Wi-Fi P2P, channel Direct link setup (TDLS), wifi network security access 2 (Wifi protected access 2, WPA2) encryption for managing security, wifi multimedia (WMM) technology for providing quality of service and traffic management, and the like.

In some embodiments, the mirrored projection may also be referred to as such as a full-share projection, a wireless display, and the like.

Application screen projection: the mobile device and the electronic device both access the internet or a local area network, and the mobile device only sends a network address, such as a Uniform Resource Locator (URL), corresponding to a multimedia resource to be projected to the electronic device; and the electronic equipment acquires the corresponding multimedia content from the Internet side or the local area network side according to the network address so as to output (such as playing and displaying).

The multimedia content may be network multimedia content, local multimedia content, or a combination thereof. Here, the electronic device may access a local area network formed by the same wireless Wi-Fi access point AP as the mobile device, or may connect to a different network with the mobile device, for example, access a different local area network formed by different APs, where the different local area networks are interconnected through the internet.

The application screen projection can comprise DLNA and private application screen projection solutions established by various companies. Such as google cast, airlay, etc. DLNA is built on universal plug and play (Upnp) protocol.

In some embodiments, application projection may also be referred to as web projection, online projection, DLNA projection, and the like.

At present, most electronic devices can support mirror image screen projection and application screen projection, and in the process that a user uses a mobile device to project a screen, the electronic devices can provide a corresponding screen projection mode for the user according to the state of a Miracast switch. Specifically, when the Miracast switch is in an on state, the electronic device provides a screen projection mode of mirror image screen projection for a user; when the Miracast switch is in the off state, the electronic device provides a screen projection mode for the user to project the screen.

Illustratively, as shown in fig. 1, the screen projection process is illustrated by a screen projection system including a mobile phone 101, a television 102 and a smart screen 103. The television 102 and the smart screen 103 both support two screen projection modes, namely mirror screen projection and application screen projection, the Miracast switch of the television 102 is in a closed state, and the Miracast switch of the smart screen 103 is in an open state.

As shown in fig. 2 (a), the cell phone 101 can display an interface 201. In response to an operation of pulling down the interface 201 by the user, the cellular phone may display a pull-down menu 202 as shown in (b) in fig. 2. The pull-down menu 202 includes switches for bluetooth, mobile data, wireless screen projection, etc. If the user wishes to turn on the wireless screen projection function, he can click the wireless screen projection switch 203. In response to detecting the operation of the user clicking the wireless screen-projecting switch 203, the mobile phone may find available devices in the surroundings and display a popup box 204 as shown in (c) of fig. 2, where names of the available devices and supported screen-projecting modes may be displayed in the popup box 204. Specifically, available devices include a television 102 and a smart screen 103, wherein the television 102 only supports projection of pictures, videos and music (i.e. only supports projection of applications), and the smart screen 103 supports projection of a computer mode and a mobile phone mode (i.e. supports projection of images).

If the user wishes to use the television 102 for a screen shot, the television 102 may be clicked. As shown in fig. 3 (a), in response to an operation of the user selecting the television 102, the cellular phone 101 establishes a communication connection with the television 102 and redisplays the interface 201. Meanwhile, as shown in (b) of fig. 3, the television 102 displays an interface 205, where the interface 205 indicates that the mobile phone has successfully connected to the television and supports video applications, music applications, and multimedia resources in the gallery to be projected to the television. That is, for the user, the mobile phone 101 or the television 102 only supports application screen projection, and does not support mirror screen projection; and the user is also not clear to be able to carry out mirror image screen projection by setting the Miracast switch, which causes misunderstanding of the user on the device function.

If the user wishes to use the smart screen 103 for screen projection, the smart screen 103 may be clicked. As shown in fig. 4 (a), in response to an operation of the user selecting the smart screen 103, the cellular phone 101 establishes a communication connection with the smart screen 103 and redisplays the interface 201. Meanwhile, as shown in (b) in fig. 4, the smart screen 103 displays the content being displayed by the cellular phone 101. It can be seen that, for the user, the mobile phone 101 or the smart screen 103 only supports the mirror screen projection, and the user does not know that the mobile phone 101 or the smart screen 103 also supports the application screen projection and how to perform the application screen projection.

The scheme has the following characteristics: the electronic equipment always provides a screen projection mode for a user, which can cause misunderstanding for the user who is not familiar with a screen projection protocol, and lead the user to be unable to select the screen projection mode by himself, and can not meet the screen projection requirements of the user.

The embodiment of the application provides a wireless screen projection method, which can determine all screen projection modes supported by each electronic device, and provide all screen projection modes supported by each electronic device for a user to select by himself, so that the user can select the screen projection modes according to own requirements, and convenience and user experience in an interaction process are improved.

Fig. 5 shows a scene schematic diagram of a wireless screen projection method provided by an embodiment of the present application. As shown in fig. 5, the mobile device 301 may deliver multimedia content to the electronic device 302 through a mirror screen projection, or may deliver multimedia content to the electronic device 302 through an application screen projection.

When the mobile device 301 puts multimedia content into the electronic device 302 through mirror image screen projection, a Wi-Fip2p connection can be established between the mobile device 301 and the electronic device 302; other short-range communication direct connections, such as bluetooth, zigbee, etc., may also be established. In the mirror projection, the multimedia content projected by the mobile device 301 may come from itself; or from the server 304, when the mobile device 301 connects to the server 304 via the Wi-Fi access point 303.

When the mobile device 301 delivers multimedia content to the electronic device 302 through application screen-delivery, both the mobile device 301 and the electronic device 302 can access the Wi-Fi access point 303 and thus are in the same local area network. In other embodiments, the mobile device 301 and the electronic device 302 may also access different networks, which is not limited in this application. It is emphasized that, in the following embodiments of the present application, without specific description, both the mobile device 301 and the electronic device 302 access the same local area network through the Wi-Fi access point 303. In application screen projection, multimedia content projected by the mobile device 301 comes from the server 304.

The server 304 provides a web audio video service. Illustratively, the server 304 may be a server storing a wide variety of multimedia content. For example, server 304 may be a flight video server that provides audio-video services. The number of the servers 304 may be one or more.

The mobile device of the embodiment of the application includes, but is not limited to, a smart phone, a tablet computer, a Personal Digital Assistant (PDA), a wearable electronic device with a wireless communication function (e.g., a smart watch, smart glasses), and the like. Exemplary embodiments of the mobile device include, but are not limited to, a portable electronic device hosting an IOS, andriod, windows, harmony, linux, or exotic operating system. The mobile device may also be other portable electronic devices such as a Laptop computer (Laptop) or the like. It should also be understood that in other embodiments, the mobile device may not be a portable electronic device, but may be a desktop computer.

In the embodiment of the present application, the mobile device 301 shown in fig. 5 is taken as an example and a mobile phone, and a structure of the mobile device 301 provided in the embodiment of the present application is illustrated. As shown in fig. 6, the mobile phone may include a processor 210, an external memory interface 220, an internal memory 221, a Universal Serial Bus (USB) interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna 1, an antenna 2, a mobile communication module 250, a wireless communication module 260, an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, an earphone interface 270D, a sensor module 280, keys 290, a motor 291, an indicator 292, a camera 293, a display 294, a Subscriber Identity Module (SIM) card interface 295, and the like.

The sensor module 280 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like.

It is to be understood that the structure illustrated in the present embodiment does not constitute a specific limitation to the mobile phone. In other embodiments, the handset may include more or fewer components than illustrated, or combine certain components, or split certain components, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Processor 210 may include one or more processing units, such as: the processor 210 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a memory, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), etc. The different processing units may be separate devices or may be integrated into one or more processors.

The controller can be the neural center and the command center of the mobile phone. The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution.

A memory may also be provided in processor 210 for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 210. If the processor 210 needs to use the instruction or data again, it can be called directly from the memory. Avoiding repeated accesses reduces the latency of the processor 210, thereby increasing the efficiency of the system.

In some embodiments, processor 210 may include one or more interfaces. The interface may include an integrated circuit (I2C) interface, an integrated circuit built-in audio (I2S) interface, a Pulse Code Modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a general-purpose input/output (GPIO) interface, a Subscriber Identity Module (SIM) interface, and/or a Universal Serial Bus (USB) interface, etc.

It should be understood that the connection relationship between the modules in this embodiment is only an exemplary illustration, and does not constitute a limitation to the structure of the mobile phone. In other embodiments, the mobile phone may also adopt different interface connection manners or a combination of multiple interface connection manners in the above embodiments.

The charge management module 240 is configured to receive a charging input from a charger. The charger may be a wireless charger or a wired charger. The charging management module 240 may also supply power to the electronic device through the power management module 241 while charging the battery 242.

The power management module 241 is used to connect the battery 242, the charging management module 240 and the processor 210. The power management module 241 receives input from the battery 242 and/or the charging management module 240, and provides power to the processor 210, the internal memory 221, the external memory, the display 294, the camera 293, and the wireless communication module 260. In some embodiments, the power management module 241 and the charging management module 240 may also be disposed in the same device.

The wireless communication function of the mobile phone can be realized by the antenna 1, the antenna 2, the mobile communication module 250, the wireless communication module 260, the modem processor, the baseband processor, and the like. In some embodiments, the handset antenna 1 is coupled to the mobile communication module 250 and the handset antenna 2 is coupled to the wireless communication module 260, such that the handset can communicate with networks and other devices via wireless communication techniques.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the handset may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 250 may provide a solution including wireless communication of 2G/3G/4G/5G, etc. applied to a mobile phone. The mobile communication module 250 may include at least one filter, a switch, a power Amplifier, a Low Noise Amplifier (LNA), and the like. The mobile communication module 250 can receive the electromagnetic wave from the antenna 1, filter, amplify, etc. the received electromagnetic wave, and transmit the electromagnetic wave to the modem processor for demodulation.

The mobile communication module 250 may also amplify the signal modulated by the modem processor, and convert the signal into electromagnetic wave through the antenna 1 to radiate the electromagnetic wave. In some embodiments, at least some of the functional modules of the mobile communication module 250 may be disposed in the processor 210. In some embodiments, at least some of the functional modules of the mobile communication module 250 may be disposed in the same device as at least some of the modules of the processor 210.

The wireless communication module 260 may provide solutions for wireless communication applied to a mobile phone, including WLAN (e.g., wireless fidelity, wi-Fi) network, bluetooth (BT), global Navigation Satellite System (GNSS), frequency Modulation (FM), near Field Communication (NFC), infrared (IR), and the like.

The wireless communication module 260 may be one or more devices integrating at least one communication processing module. The wireless communication module 260 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on electromagnetic wave signals, and transmits the processed signals to the processor 210. The wireless communication module 260 may also receive a signal to be transmitted from the processor 210, frequency-modulate and amplify the signal, and convert the signal into electromagnetic waves via the antenna 2 to radiate the electromagnetic waves.

The mobile phone implements the display function through the GPU, the display screen 294, and the application processor. The GPU is a microprocessor for image processing, and is connected to the display screen 294 and an application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 210 may include one or more GPUs that execute program instructions to generate or alter display information.

The display screen 294 is used to display images, video, and the like. The display screen 294 includes a display panel.

The mobile phone can implement a shooting function through the ISP, the camera 293, the video codec, the GPU, the display screen 294, the application processor, and the like. The ISP is used to process the data fed back by the camera 293. The camera 293 is used to capture still images or video. In some embodiments, the handset may include 1 or N cameras 293, N being a positive integer greater than 1.

The external memory interface 220 may be used to connect an external memory card, such as a Micro SD card, to extend the storage capability of the mobile phone. The external memory card communicates with the processor 210 through the external memory interface 220 to implement a data storage function. For example, files such as music, video, etc. are saved in an external memory card.

Internal memory 221 may be used to store computer-executable program code, including instructions. The processor 210 executes various functional applications of the cellular phone and data processing by executing instructions stored in the internal memory 221. For example, in the present embodiment, the processor 210 may execute instructions stored in the internal memory 221, and the internal memory 221 may include a program storage area and a data storage area.

The storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, and the like) required by at least one function, and the like. The data storage area can store data (such as audio data, a phone book and the like) created in the use process of the mobile phone. In addition, the internal memory 221 may include a high speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a Universal Flash Storage (UFS), and the like.

The mobile phone can realize audio function through the audio module 270, the speaker 270A, the receiver 270B, the microphone 270C, the earphone interface 270D, the application processor, and the like. Such as music playing, recording, etc.

The keys 290 include a power-on key, a volume key, etc. The keys 290 may be mechanical keys. Or may be touch keys. The motor 291 may generate a vibration cue. The motor 291 can be used for incoming call vibration prompting, and can also be used for touch vibration feedback. Indicator 292 may be an indicator light that may be used to indicate a state of charge, a change in charge, or may be used to indicate a message, missed call, notification, etc. The SIM card interface 295 is used to connect a SIM card. The SIM card can be connected to or disconnected from the mobile phone by being inserted into the SIM card interface 295 or being pulled out of the SIM card interface 295. The mobile phone can support 1 or N SIM card interfaces, and N is a positive integer greater than 1. The SIM card interface 295 may support a Nano SIM card, a Micro SIM card, a SIM card, etc.

A process of the mobile device 301 projecting multimedia content to the electronic device 302 is described below by taking the mobile device 301 as a mobile phone and the electronic device 302 as a television as an example.

The mobile phone has a wireless screen projection function, and a user can open the wireless screen projection function of the mobile phone to enable the mobile phone to project multimedia contents (such as audio and video and pictures) being played to a television, and the multimedia contents are output (played or displayed) by the television. The wireless screen projection can comprise application screen projection and mirror image screen projection.

Fig. 7-9 illustrate a user operation to turn on the wireless screen projection function of the handset. As shown in fig. 7, the cell phone may display an interface 701. The interface 701 may include status bars, icons for clock applications, icons 702 for setup applications, icons for other applications, and the like. In some embodiments, the interface 701 may also be referred to as a main interface, home interface, or the like.

If the user wishes to turn on the wireless screen projection function, the interface 701 may be pulled down, i.e., a downward sliding gesture is input on the interface 701. When the mobile phone detects a gesture of sliding down by the user, the mobile phone displays a pull-down menu 703 on the interface 701 in response to the gesture. As shown in fig. 8, a wireless screen projection control 703a is included in the pull-down menu 703, and the wireless screen projection control 703a may receive a user operation (e.g., a touch operation, a click operation) to turn on/off a wireless screen projection function of the mobile phone. Switch controls for other functions such as bluetooth, motion data, auto-rotation, flashlight, flight mode, etc. may also be displayed in the drop down menu 703. If the user wishes to turn on the wireless screen projection function, the user may click or touch the wireless screen projection control 703a. In some implementations, the representation of the wireless projection control 703a can include an icon and/or text (e.g., text "wireless projection", "multi-screen interaction", "cell phone projection", etc.). When the mobile phone detects an operation acting on the wireless screen projection control 703a, the display form of the wireless screen projection control 703a may be changed, for example, to increase the shadow of the wireless screen projection control 703a.

It should be noted that, not limited to the interface 701 shown in fig. 7, the user may input a gesture of sliding down on another interface (for example, a setting interface, an interface of another application, or the like), and may trigger the mobile phone to display the pull-down menu 703.

When the operation of the wireless screen-projecting control 703a by the user is detected, the mobile phone can discover the available devices. The mobile phone can discover available equipment through one or more modes of Wifi, bluetooth and NFC. The available devices may specifically refer to: a screen-projectable electronic device in proximity to the cell phone. After discovering the available device, the mobile phone may obtain device information of the available device, where the device information may include a device type (device type), a device name, a device identifier, and the like of the available device. The device type may be a model of a product, such as ". Star. Tv EA55", ". Star. Smart screen V pro", etc. The device name may be the default one, or may be set by the user, for example, "red television" or the like. The device identification refers to the unique identity of the available device. The available devices may be one or more.

The mobile phone can also determine the screen projection mode supported by each available device according to the device information of the available device. Specifically, a Device database is stored in advance in the mobile phone, and the Device database records a corresponding relationship between a Device Type of each electronic Device with an application screen projection function on the market and whether the Device Type supports the Miracast protocol or not and whether the Device Type supports the DLNA protocol or not. For example, the content recorded in the device database may be as shown in table 1:

TABLE 1

For example, if the device type of the available device is "+" smart screen V pro ", it may be determined that the available device supports Miracast protocol and DLNA protocol, and then it is determined that the available device supports mirror image screen projection and application screen projection; if the device type of the available device is ". Times.TV EA55", it may be determined that the available device does not support the Miracast protocol, supports the DLNA protocol, and further determines that the available device only supports application screen projection.

Optionally, it is considered that most of the electronic devices supporting the wireless screen projection function in the market support the DLNA protocol. In the embodiment of the present application, it may be default that all available devices support the DLNA protocol, that is, all support application screen projection. Therefore, the device database does not need to record whether each electronic device supports the DLNA protocol, so that the storage space occupied by the database is reduced.

The mobile phone can also display available devices found by the mobile phone for the user to select. For example, as shown in fig. 9, after detecting an operation acting on the wireless screen projection control 703a, that is, detecting a user operation of turning on the wireless screen projection function, the mobile phone may display a window 704. The window 704 displays an available device list 704a, which includes the names of all available devices and the screen-casting modes supported by each available device, in the available device list 704 a. For example, the content in the available device list 704a indicates that the available devices found by the mobile phone include a television 1, a television 2, and a television 3, the screen projection modes supported by the television 1 include mirror screen projection and application screen projection, the screen projection mode supported by the television 2 includes application screen projection, and the screen projection mode supported by the television 3 is unknown. The unknown screen projecting mode supported by the television 3 can be understood that the mobile phone cannot determine the screen projecting mode supported by the television 3 because data matched with the device type of the television 3 does not exist in the device database. Optionally, icons of available devices may also be displayed in the window 704.

In addition to the operation of turning on the wireless screen projecting function shown in fig. 7 to 9, the user may also turn on the wireless screen projecting function in other ways, and the embodiment of the present application is not limited in particular.

For example, as shown in fig. 10-14, another way to turn on the wireless screen projection function is provided in the embodiments of the present application. As shown in fig. 10, if the user wishes to turn on the wireless screen projection function, the user may also click/touch an icon 702 of the setup application. The cell phone may receive an operation (e.g., a touch operation, a click operation) of the icon 702 of the setting application by the user, and in response to the operation, the cell phone may display the setting interface 705. As shown in fig. 11, the setting interface 705 includes a setting item 705a, and the setting item 705a may provide a way for the user to set functions of sharing with a mobile phone, NFC, wireless screen projection, and the like. In addition, the setting interface 705 also includes setting items such as WLAN, bluetooth, mobile network, and the like. The cellular phone can receive an operation of the user clicking the setting item 705a, and in response to the operation, the cellular phone displays the interface 706. As shown in fig. 12, the interface 706 includes controls 706a, and the controls 706a may provide a way for a user to turn on/off the screen projection function of the mobile phone. The representation of the control 706a can include an icon and/or text (e.g., text "wireless screen projection," "multi-screen interaction," "cell phone screen projection," etc.). The interface 706 may also include controls to set up cell phone sharing, NFC, printing, encrypted DNS functionality. The handset may receive an operation of the user clicking the control 706a, and in response to the operation, the handset may display an interface 707. As shown in fig. 13, the interface 707 may include a control 707a that may receive an operation from a user to turn on or off a wireless screen projection function. The interface 707 may also include video animations/pictures for wireless screen-casting functions/text for function interpretation for user reference. The handset may receive an operation of the user clicking on the control 707a, and in response to the operation, the handset displays a list of available devices 707b on the interface 707. As shown in fig. 14, the available device list 707b includes names of all available devices, and screen-casting modes supported by each available device. The available device list 707b is similar to the available device list 704a in fig. 9, and is not described herein again.

As can be seen from fig. 9 and 14, through the list of available devices, the user can conveniently and quickly know the screen projection modes supported by all available devices, which is beneficial for the user to select the screen projection devices as required.

After the mobile phone displays the available equipment list, the user can select screen projection equipment according to the requirement. And after receiving the operation of selecting the screen projection equipment from the available equipment list by the user, the mobile phone can display the screen projection mode supported by the screen projection equipment for the user to select.

For example, as shown in fig. 15, if the user wishes to perform a screen-casting operation using the television 1, the user may click (or touch) an icon of the television 1 (i.e., an operation of selecting the television 1 as a screen-casting device from the available device list). The mobile phone can receive an operation of clicking an icon of the television 1 by the user, and in response to the operation, the mobile phone can display a window 801. As shown in fig. 16, options of screen projection modes supported by the television 1, namely, an option 801a of mirror screen projection and an option 801b of application screen projection, are displayed in the window 801. The options of the screen projection mode can also simply introduce the screen projection contents of different screen projection modes, for example, the mirror image screen projection can enable the mobile phone picture to be synchronized to a television, and the screen projection is only supported by pictures, videos and music. Optionally, the representation of the options (e.g., option 801a and option 801 b) of the screen projection mode may include icons, texts, or a combination of the two, and the like, and is not limited specifically herein.

If the user wishes to use the television 1 for image projection, the option 801a may be clicked. After detecting that the user clicks the option 801a, the mobile phone may establish a first communication connection or a second communication connection with the television 1 according to whether the television 1 turns on the Miracast switch.

Specifically, if the Miracast switch is turned on by the television 1, the mobile phone may establish a first communication connection with the television 1 after receiving an operation of clicking the option 801a by the user. The first communication connection may include a connection established by one or more wireless communication technologies of Wifi direct connection, bluetooth, and NFC.

In addition, after detecting the operation of clicking on the option 801a by the user, the mobile phone can also display a window 802. As shown in fig. 17, the window 802 includes connection indication information 802a, a screen-projection mode option 802b, and a do not disturb message switch 802c. The connection indication information 802a is used to indicate that the mobile phone is connected to the television 1. The screen projection mode option 802b can provide two operation modes in the mirror mode, namely a mobile phone mode and a computer mode. The mobile phone mode refers to that the screen projection device (for example, the television 1) displays the content displayed by the mobile phone according to the display mode of the mobile phone. The computer mode refers to that when the screen projection equipment displays the content displayed by the mobile phone, the content displayed by the mobile phone is integrated and displayed in a computer desktop mode, and at the moment, the mobile phone serves as a mouse. The do-not-disturb message switch 802c may receive an operation (e.g., a touch or a click) by a user to turn on the do-not-disturb message function or turn off the do-not-disturb message function. When the mobile phone starts the message non-disturbing function, the mobile phone can normally receive messages and short messages, but does not display message prompts, short message prompts and the like.

After establishing the first communication connection, the mobile phone may send the currently displayed multimedia content to the television 1 based on the first communication connection. Specifically, the mobile phone may obtain currently displayed multimedia content (including images and/or audio) by means of screen recording, sound recording, and the like, and then compress the obtained multimedia content and send the compressed multimedia content to the television 1 through a communication connection (i.e., a first communication connection) with the television 1. Taking the example that the mobile phone and the television 1 share multimedia content based on Miracast as an example, the television 1 can acquire an image displayed by a display screen in a screen recording mode according to the provisions in the Miracast protocol, and compress the image by using an H.264 coding algorithm; collecting audio played by a mobile phone, and compressing the audio by using an Advanced Audio Coding (AAC) algorithm; then, the compressed audio data and image data are encapsulated into a Transport Stream (TS), and then the TS stream is encoded according to a real-time transport protocol (RTP) and the encoded data is sent to the television 1 through Wi-Fi direct connection. That is, the multimedia content is transmitted by means of streaming media.

After receiving the multimedia content, the television 1 can play the received multimedia content. Specifically, after receiving the multimedia content sent by the mobile phone based on the communication connection, the television 1 may perform decoding processing on the multimedia content, thereby obtaining the multimedia content. Taking the example that the mobile phone and the television 1 share the multimedia content based on Miracast as an example, the television 1 may receive a TS stream encoded by an RTP based on Wifi direct connection with the mobile phone, and may perform RTP decoding, TS stream decapsulation, audio-video quality processing/delay synchronization processing on the TS stream in sequence, and finally output audio and video, that is, play the multimedia content. For example, the multimedia content displayed by the television 1 may be as shown in fig. 18, and the television 1 may display an interface displayed by a mobile phone, that is, an interface 701 and a window 802 on the interface 701.

If the television 1 does not turn on the Miracast switch, the mobile phone may display a window 803 as shown in fig. 19 after detecting that the user clicks the option 801a. The window 803 is similar to the window 802 shown in fig. 17, except that the window 803 further includes guide information 803a. The guidance information 803a is used to guide the user to turn on the Miracast switch of the television 1. For example, the guidance information 803a may be "your large-screen device does not turn on the miraast switch, and the large-screen device can use mirror image projection after turning on the miraast switch, and the specific turning on mode refers to help, and if you do not find your device vendor, you can contact your large-screen vendor for customer service consultation". When the mobile phone detects that the user can click the character help, the mobile phone can automatically jump to a webpage linked by the character help, and the webpage can display the mode that each equipment manufacturer opens the Miracast switch for the user to inquire.

Optionally, the guidance information 803a may be information obtained by querying the mobile phone according to the specific model of the television 1, and may be used to guide the user to turn on a Miracast switch of the television 1. For example, the guidance information 803a may be "your large-screen device end does not turn on the Miracast switch, and the large-screen end can use the mirror image to project the screen after turning on the Miracast switch, and the specific turning-on mode may refer to: * Television EA 55-projection display-wireless display ".

Under the condition that the Miracast switch is not turned on by the television 1, after receiving the operation of clicking the option 801a by the user, the mobile phone can establish a second communication connection with the television 1. The second communication connection may comprise a Transmission Control Protocol (TCP) connection. Based on the second communication connection, the mobile phone may send a preset picture to the television 1. After receiving the preset picture, the television 1 can display the preset picture. For example, as shown in fig. 20, the preset picture displayed by the tv 1 may include information guiding the user to turn on the Miracast switch of the tv 1.

Therefore, under the condition that the user selects the mirror image screen projection, if the television 1 turns on the Miracast switch, the mobile phone can transmit multimedia contents to the television 1 based on the Miracast protocol, so that the mirror image screen projection is realized; if the television 1 does not start the Miracast switch, the mobile phone may transmit a preset picture to the television 1 based on the DLNA protocol, and actually the preset picture is an application screen, where the preset picture includes information for guiding the user to turn on the Miracast switch of the television 1. Therefore, as long as the electronic equipment supports the mirror image screen projection function, even if the electronic equipment does not turn on the Miracast switch, the user can turn on the Miracast switch according to the guiding information, and the problem that the mirror image screen projection function cannot be normally used because the user does not know the Miracast protocol is solved.

Optionally, the user may also select the television 1 for application screen projection. As shown in fig. 21 (a), the cellular phone may receive an operation of clicking on the option 801b by the user, and in response to the operation, on the one hand, the cellular phone may establish a second communication connection with the television 1. Based on the second communication connection, the handset may transmit media content such as pictures, music, and video to the television 1. Alternatively, the handset may display window 804. As shown in fig. 21 (b), the window 804 includes a plurality of application options, such as gallery option 804a, music option 804b, video option 804c. The user can open the gallery application and select pictures from the gallery application for screen projection by operating the gallery option 804 a; the user can open the music application and select music from the music application to screen through the operation of the music option 804 b; by operating the video option 804c, the user can open a video application and select a video from the video application for screen projection. Optionally, the window 804 further includes a prompt message 804d, a cancel option 804e, and the prompt message 804d is used to prompt the user of screen-casting content supported by the current screen-casting mode (i.e. application screen casting), for example, "the current screen casting only supports media content such as pictures, music, and videos to be synchronized to a large screen (DLNA screen casting). You can browse or play the content of the following applications. The user may cancel the application screen shot by operating the cancel option 804 e.

In addition, after the mobile phone establishes the second communication connection with the television 1, the preset media content can be transmitted to the television 1 based on the second communication connection. The television 1 may display the received media content. As shown in fig. 22, the media content displayed by the television 1 includes information indicating that the television 1 is connected to a mobile phone and supported screen-casting content. For example, the media content may be a picture, where the picture includes a text "your mobile phone has successfully connected to the television 1, please select media content on the mobile phone for screen projection, and the current screen projection only supports screen projection of media content such as pictures, music, and videos to a large screen (DLNA screen projection)". Optionally, the media content may also include other content, such as icons and the like; the media content may also be in other forms, such as video, audio, etc., and will not be described herein.

Optionally, after the mobile phone establishes a communication connection (including the first communication connection and the second communication connection) with the television 1, the mobile phone may display the screen projection identifier 805. As shown in fig. 23, the screen-shot mark 805 is located in the status bar and is used to indicate that the mobile phone is connected to the electronic device for screen-shooting.

Alternatively, after the mobile phone detects an operation of closing the window 804 by the user (for example, clicking on an area other than the window 804), as shown in fig. 24 (a), the mobile phone may display an interface 701, and display a screen projection identifier 806 on the interface 701. The user can redisplay the window 804 on the mobile phone by operating the screen-projection identifier 806. Specifically, in response to detecting the user operation of the screen projection identifier 806, as shown in (b) of fig. 24, the cell phone redisplays the window 804. Still alternatively, after detecting the operation of closing the window 802 by the user, the mobile phone may display the interface 701, and display the screen projection identifier 806 on the interface 701. In this case, upon detecting the user's operation of the screen projection 806, the cell phone may redisplay the window 802. The same applies to the window 803, and details are not repeated here.

Optionally, after the mobile phone establishes a communication connection (including the first communication connection and the second communication connection) with the television 1, the mobile phone may directly display the main interface of the mobile phone instead of displaying the window (including the window 802 and the window 804), and display the screen projection identifier 806 on the main interface. The mobile phone detects the operation of the user on the screen projection identifier 806, and the mobile phone can open the window 802, the window 803 or the window 804. Specifically, if the user selects mirror image screen projection and the television 1 has turned on the Miracast switch, the mobile phone may display the window 802 in response to detecting the operation of the user on the screen projection identifier 806; if the user selects mirror image screen projection and the television 1 does not turn on the Miracast switch, the mobile phone can display a window 803 in response to detecting the operation of the user on the screen projection identifier 806; if the user selects application screen projection, the cell phone may display a window 804 in response to detecting the user's operation of the screen projection identifier 806.

Having explained the relevant interface in the process of selecting the television 1 supporting the mirror image projection and the application projection for projection by the user, the process of selecting the television 2 supporting only the application projection for projection by the user will be described with reference to the drawings.

For example, as shown in fig. 25 (a), if the user wishes to perform a screen-casting operation using the television 2, the user may click (or touch) an icon of the television 2 (i.e., an operation of selecting the television 2 as a screen-casting device from the available device list). The mobile phone may receive an operation of the user clicking an icon of the television 2, and in response to the operation, the mobile phone may display the window 901. As shown in fig. 25 (b), the window 901 displays options of the screen-casting modes supported by the television 2, that is, an option 901a of applying screen casting. The representation form of the option 901a may include an icon, text (e.g., application screen projection, DLNA screen projection, application screen projection, etc.), or a combination of the two, and the like, and is not limited in particular.

This option 901a may be clicked if the user wishes to use the television 2 for application screen-casting. The handset may receive an operation of the user clicking on the option 901a, and in response to the operation, on the one hand, the handset may establish a second communication connection with the television 2. Based on the second communication connection, the handset may transmit media content such as pictures, music, and video to the television 2. On the other hand, as shown in (c) in fig. 25, the cellular phone can display a window 902. It should be noted that the window 902 is similar to the window 804, and is not described in detail here.

In addition, after the second communication connection is established between the mobile phone and the television 2, the preset media content can be transmitted to the television 2 based on the second communication connection. The television 2 may display the received media content. The media content displayed by the television 2 is similar to the media content displayed by the television 1 in fig. 22, and is not described in detail here.

The user may also select the television 3 for screen projection. For example, as shown in fig. 26 (a), if the user wishes to perform a screen-casting operation using the television 3, the user may click (or touch) an icon of the television 3 (i.e., an operation of selecting the television 3 as a screen-casting device from the available device list). The cellular phone can receive an operation of the user clicking on the icon of the television 3, and in response to the operation, as shown in (b) in fig. 26, the cellular phone can display a window 903. The window 903 is similar to the window 801, except that the window 903 further includes a prompt message 903a, where the prompt message 903a is used to prompt the user of the use condition of the mirror image projection, for example, "mirror image projection requires the miraast protocol supported by the large-screen device, and you ask for confirmation whether your large-screen device supports". On the basis of the method, the user can select mirror projection or application projection. If the user selects the application screen projection, the icon of the application screen projection can be clicked. After receiving the operation of the user clicking the application screen, the mobile phone executes a process similar to the process of performing the application screen projection by the television 1 and the television 2, specifically referring to fig. 21 to 22 and 25 and corresponding text contents, which is not described herein again.

If the user wishes to perform the mirror image projection, the user may click an icon of the mirror image projection as shown in (a) of fig. 27. If the television 3 supports the Miracast protocol and the Miracast switch is in the on state, the mobile phone receives an operation of clicking the icon of the mirror image screen projection by the user and then can establish a first communication connection with the television 3 and display an interface shown in (b) in fig. 27, where the interface is similar to the interface shown in fig. 17, and at the same time, the interface shown in (b) in fig. 27 can be displayed on the television 3 and is similar to the content shown in fig. 18, which is not described herein again. If the television 3 does not support the Miracast protocol, or the Miracast protocol is supported but the Miracast switch is not opened, after the mobile phone detects that the user clicks the icon of the mirror image screen projection, on one hand, the mobile phone can establish a second communication connection with the television 3. Based on the second communication connection, the handset may transmit media content such as pictures, music and video to the television 3. On the other hand, as shown in (c) in fig. 27, the cellular phone can display a window 904. This window 904 is similar to the window 804 in (b) of fig. 21, and is not described in detail here. Optionally, the window 904 may further include a prompt message prompting the user to confirm whether the television 3 supports the Miracast protocol and whether the television 3 turns on the Miracast switch, for example, "confirm whether your large-screen device supports the Miracast protocol and whether the Miracast switch is turned on, if yes, please turn on the Miracast switch to implement mirror image screen projection, and if not, please refer to the following contents to perform application screen projection".

Optionally, the operation of selecting the screen-projecting device may also be performed in the available device list 707b in fig. 14, and a process and an interface after selecting the screen-projecting device are similar to those of the user in the available device list 704a in fig. 9, and are not described again here.

The following describes a flow of the wireless screen projection method provided in the embodiment of the present application. As shown in fig. 28, a wireless screen projection method provided in an embodiment of the present application may include:

s2801, the mobile device displays a first interface, and the first interface comprises a first control.

For example, the first interface may be the interface shown in fig. 8, the first interface includes a pull-down menu 703, and the first control may be a wireless screen-projection control 703a in the pull-down menu 703. Still alternatively, the first interface may be interface 707 in fig. 13, and the first control may be a wireless screen projection control 707a.

S2802, responding to the operation of the first control by the user, the mobile device obtains device information of one or more electronic devices near the mobile device.

The device information may include a device type, a device identifier, and other information of the electronic device.

S2803, the mobile device queries, in a preset device database, screen-casting modes supported by one or more electronic devices based on the device information of the one or more electronic devices.

The preset equipment database stores data information of a plurality of electronic equipment, and the data information of each electronic equipment comprises the equipment information of the electronic equipment and a screen projection protocol supported by the electronic equipment.

S2804, the mobile device displays a list of available devices, the list of available devices including one or more electronic devices in a vicinity of the mobile device and a screen-casting mode supported by the one or more electronic devices.

The available device list may be, for example, the available device list 704a in fig. 9 or the available device list 707b in fig. 14.

S2805, in response to an operation that the user selects the first device from the available device list, the mobile device displays a screen projection mode list of the first device, wherein the screen projection mode list comprises a first screen projection mode and a second screen projection mode supported by the first device.

Illustratively, the first device may be a television 1 in the available device list 704a, the available device list 707b, and the screen-shot mode list may be as shown in a window 801 in fig. 16. The first screen projection mode can be mirror image screen projection, and the second screen projection mode can be application screen projection.

S2806, in response to the user selecting the first screen projection mode in the screen projection mode list, the mobile device projects the screen to the first device in the first screen projection mode or the second screen projection mode.

Specifically, if the Miracast switch is turned on by the first device, the mobile device projects a screen to the first device in a first screen projecting manner.

And if the Miracast switch is not turned on by the first device, the mobile device casts a screen to the first device in a second screen casting mode.

In an optional implementation manner, if the first device does not turn on the Miracast switch, the mobile device may display a first window, where the first window includes first prompt information indicating that the Miracast switch is not turned on by the first device, and guide the user to turn on the Miracast switch of the first device. Illustratively, the first window may be the window 803 shown in fig. 19, and the first prompt message may be the prompt message 803a.

Further, the mobile device screens preset media content to the first device based on the second screen-projecting mode, wherein the preset media content is used for indicating that the first device does not turn on the Miracast switch, and guiding a user to turn on the Miracast switch of the first device. For example, the preset media content displayed by the first device may be as shown in fig. 20.

In an optional implementation manner, if the Miracast switch is turned on by the first device, the mobile device displays a second window, where the second window includes second prompt information indicating that the mobile device is connected to the first device. Illustratively, the second window may be the window 802 shown in fig. 17, and the second prompt message may be a prompt message 802a.

In an alternative embodiment, in response to the user selecting the second screen projection mode from the screen projection mode list, the mobile device projects the screen to the first device in the second screen projection mode.

In an alternative embodiment, in response to a user selecting a second screen projection mode in the screen projection mode list, the mobile device displays a third window, and the third window comprises a plurality of application options; in response to an operation of selecting a first application from the plurality of application options by the user, the mobile device starts the first application and screens the content of the first application to the first device. Illustratively, the third window may be the window 804 shown in fig. 21 (b), and the plurality of application options may include a gallery option 804a, a music option 804b, and a video option 804c.

In an optional implementation mode, in response to the operation that the user selects the second screen projection mode from the screen projection mode list, the mobile device displays a main interface, wherein the main interface comprises a first icon; in response to the user's operation of the first icon, the mobile device displays a third window, the third window including a plurality of application options; in response to an operation of selecting a first application from the plurality of application options by the user, the mobile device starts the first application and screens the content of the first application to the first device. Illustratively, the first icon may be the screen shot identifier 806 shown in fig. 24 (a).

In summary, the wireless screen projection method provided by the application can display the screen projection mode supported by each device when the mobile device displays the available device list, so that a user can select the screen projection device meeting the own requirements after knowing the screen projection mode. In addition, after the user selects the screen projection device (for example, the first device), the user can display all screen projection modes supported by the first device for the user to select by himself, so that the screen projection requirements of the user are met, and the use experience of the user is improved.

Embodiments of the present application also provide a chip system, as shown in fig. 29, which includes at least one processor 2901 and at least one interface circuit 2902. The processor 2901 and the interface circuit 2902 may be interconnected by wires. For example, interface circuit 2902 might be used to receive signals from other apparatus (e.g., a memory of a mobile device). Also for example, interface circuit 2902 might be used to send signals to other devices (e.g., processor 2901).

For example, interface circuit 2902 may read instructions stored in memory in the mobile device and send the instructions to processor 2901. The instructions, when executed by the processor 2901, may cause a mobile device (e.g., mobile device 301 in fig. 5, etc.) to perform various steps in the embodiments described above.

Of course, the chip system may further include other discrete devices, which is not specifically limited in this embodiment of the present application.

The embodiment of the present application further provides a fault location device, where the device may be divided into different logic units or modules according to functions, and each unit or module executes different functions, so that the device executes each function or step executed by the terminal device or the server in the foregoing method embodiments.

Embodiments of the present application further provide a computer program product, which, when running on a fault location device, causes the fault location device to perform each function or step performed by the fault location device in the above method embodiments. When the computer program product is run on a server it causes the server to perform the respective functions or steps performed by the server in the above-described method embodiments.

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described device embodiments are merely illustrative, and for example, the division of the modules or units is only one logical functional division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or may be integrated into another device, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may be one physical unit or a plurality of physical units, that is, may be located in one place, or may be distributed in a plurality of different places. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in the form of hardware, or may also be implemented in the form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application, or portions of the technical solutions that substantially contribute to the prior art, or all or portions of the technical solutions may be embodied in the form of a software product, where the software product is stored in a storage medium and includes several instructions to enable a device (which may be a single chip, a chip, or the like) or a Processor (Processor) to execute all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, an optical disk, or other various media capable of storing program codes.

The above description is only an embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A wireless screen projection method, the method comprising:

the method comprises the steps that a mobile device displays a first interface, wherein the first interface comprises a first control;

in response to user operation of the first control, the mobile device displays a list of available devices, the list of available devices including one or more electronic devices in proximity to the mobile device and screen shots supported by the one or more electronic devices;

responding to the operation that a user selects a first device in the available device list, and displaying a screen projection mode list of the first device by the mobile device, wherein the screen projection mode list comprises a first screen projection mode and a second screen projection mode supported by the first device;

responding to the operation that a user selects a first screen projection mode in the screen projection mode list, and detecting whether a Miracast switch is turned on by the first equipment or not by the mobile equipment;

if the first device turns on a Miracast switch, the mobile device casts a screen to the first device in the first screen casting mode;

if the first device does not open the Miracast switch, the mobile device projects the screen to the first device in the second screen projecting mode.

2. The method of claim 1, wherein prior to the mobile device displaying the list of available devices, the method further comprises:

the mobile device acquires device information of one or more electronic devices in the vicinity of the mobile device;

and inquiring screen projection modes supported by the one or more electronic devices in a preset device database based on the device information of the one or more electronic devices, wherein the preset device database stores data information of the plurality of electronic devices, and the data information of each electronic device comprises the device information of the electronic device and a screen projection protocol supported by the electronic device.

3. The method of claim 1, wherein if the first device does not turn on a Miracast switch, the method further comprises:

the mobile device displays a first window, the first window comprises first prompt information, the first prompt information indicates that the Miracast switch is not opened by the first device, and a user is guided to open the Miracast switch of the first device.

4. The method of claim 3, further comprising:

the mobile device is based on the second throw the screen mode to first equipment is thrown the screen and is predetermine media content, it is used for instructing to predetermine media content the Miracast switch is not opened to first equipment to guide the user to open the Miracast switch of first equipment.

5. The method of claim 1, wherein if the first device has turned on a Miracast switch, the method further comprises:

the mobile device displays a second window, the second window including second prompt information indicating that the mobile device has connected to the first device.

6. The method according to claim 1 or 2, characterized in that the method further comprises: and in response to the operation that the user selects the second screen projection mode in the screen projection mode list, the mobile device projects the screen to the first device in the second screen projection mode.

7. The method of claim 6, further comprising:

the mobile device displaying a third window, the third window comprising a plurality of application options;

in response to an operation of selecting a first application from the plurality of application options by a user, the mobile device starts the first application and screens the content of the first application to the first device.

8. The method of claim 6, further comprising:

the mobile equipment displays a main interface, wherein a first icon is included on the main interface;

in response to user operation of the first icon, the mobile device displaying a third window, the third window comprising a plurality of application options;

9. The method according to claim 1 or 2, wherein the first screen projection mode is a screen projection based on a Miracast protocol, and the second screen projection mode is a screen projection based on a digital living network alliance protocol.

10. A mobile device, characterized in that the mobile device comprises:

a display screen;

one or more processors;

a memory;

a communication module;

wherein the memory has stored therein one or more computer programs, the one or more computer programs comprising instructions, which when executed by the mobile device, cause the mobile device to perform the wireless screen projection method of any of claims 1-9.

11. A computer-readable storage medium having instructions stored therein, which when run on a mobile device, cause the mobile device to perform the wireless screen projection method of any one of claims 1-9.