CN115696277A

CN115696277A - Display device and screen projection connection method

Info

Publication number: CN115696277A
Application number: CN202211189123.5A
Authority: CN
Inventors: 曹圆圆; 郑鹏
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2022-09-28
Filing date: 2022-09-28
Publication date: 2023-02-03

Abstract

The disclosure relates to a display device and a screen projection connection method, which are applied to the technical field of screen projection control and solve the problem of how to be compatible with two screen projection modes corresponding to operating systems on the same display device. The display device includes: a controller configured to: monitoring a probe request with a first channel use strategy, wherein the probe request is used for requesting to discover a display device, and an operating system of the first mobile device is different from that of the second mobile device; after receiving a detection request of first mobile equipment through a first port, sending a detection response to the first mobile equipment, and adjusting to perform data transmission by using a second channel use strategy, wherein the channel use time of the first port in the second channel use strategy is longer than that of a second port; the method comprises the steps of establishing a first screen projection connection between the display device and the first mobile device based on a screen projection protocol and a first port of the first mobile device, and receiving screen projection data sent by the first mobile device based on the first screen projection connection.

Description

Display device and screen projection connection method

Technical Field

The disclosure relates to the technical field of screen projection control, in particular to a display device and a screen projection connection method.

Background

With the continuous development of screen projection technology, the screen projection function brings great convenience to the work and life of people. Currently, operating systems commonly used for mobile devices are an Android (Android) operating system and an IOS operating system. The common screen projection protocol of the Android system is Miracast, and the common screen projection protocol of the IOS system is AirPlay (AirPlay), so that the display device can support the two protocols at the same time.

The Miracast screen projection protocol is based on Peer-to-Peer (P2P) monitoring to complete discovery of a mobile device, but due to coexistence of P2P and a Wireless Local Area Network (WLAN), network resources can be occupied to a corresponding degree, so that Network fluctuation and even Network speed reduction are caused, and for a screen projection protocol which relies on a Local Area Network for transmission, such as AirPlay, a screen projection connection based on AirPlay can be greatly affected, for example, problems of playing blockage, screen splash, even disconnection and the like occur. Therefore, how to make the Android system and the IOS system compatible with each other on the same display device becomes important.

Disclosure of Invention

In order to solve the technical problem or at least partially solve the technical problem, the present disclosure provides a display device and a screen-projecting connection method, which are compatible with two screen-projecting modes corresponding to operating systems, so that it is ensured that a second mobile device finds the display device quickly, and after receiving a detection request of a first mobile device, it is ensured that the first mobile device can stably transmit data, and a corresponding display device can also stably display screen-projecting data sent by the first mobile device, thereby achieving an effect of improving performance of the two screen-projecting modes.

In a first aspect, the present disclosure provides a display apparatus comprising:

a controller configured to:

monitoring a probe request by using a first channel use strategy, wherein the channel use duration of a first port in the first channel use strategy is less than the channel use duration of a second port, the probe request is used for requesting to discover the display device, the first port is used for a first mobile device to communicate with the display device, the second port is used for a second mobile device to communicate with the display device, and the operating systems of the first mobile device and the second mobile device are different;

after receiving a probe request of the first mobile equipment through the first port, sending a probe response to the first mobile equipment, and adjusting to perform data transmission by using a second channel use strategy, wherein the channel use duration of the first port in the second channel use strategy is longer than the channel use duration of the second port;

and establishing a first screen projection connection between the display equipment and the first mobile equipment based on the screen projection protocol of the first mobile equipment and the first port, and receiving screen projection data sent by the first mobile equipment based on the first screen projection connection.

In a second aspect, the present disclosure provides a screen projection connection method, including:

monitoring a probe request by using a first channel use strategy, wherein the channel use duration of a first port in the first channel use strategy is less than the channel use duration of a second port, the probe request is used for requesting to discover a display device, the first port is used for a first mobile device to communicate with the display device, the second port is used for a second mobile device to communicate with the display device, and the operating systems of the first mobile device and the second mobile device are different;

In a third aspect, the present disclosure provides a computer-readable storage medium comprising: the computer-readable storage medium stores thereon a computer program which, when executed by a processor, implements the screen-casting connection method as shown in the second aspect.

In a fourth aspect, the present disclosure provides a computer program product comprising: when the computer program product is run on a computer, the computer is caused to implement the screen-projection connecting method as shown in the second aspect.

Compared with the prior art, the technical scheme provided by the embodiment of the disclosure has the following advantages: the method comprises the steps that a controller of the display device firstly monitors a detection request according to a first channel use strategy, wherein the channel use time length of a first port in the first channel use strategy is shorter than the channel use time length of a second port, the detection request is used for requesting to discover the display device, the first port is used for a first mobile device to communicate with the display device, the second port is used for a second mobile device to communicate with the display device, operating systems of the first mobile device and the second mobile device are different, then after the detection request of the first mobile device is received through the first port, a detection response is sent to the first mobile device, data transmission is carried out according to a second channel use strategy, the channel use time length of the first port in the second channel use strategy is longer than the channel use time length of the second port, finally, a first screen projection connection between the display device and the first mobile device is established based on a screen projection protocol of the first mobile device and the first port, screen projection data sent by the first mobile device are received based on the first screen projection connection, screen projection data can be received by the first mobile device, two screen projection modes corresponding to ensure that the second mobile device can be compatible, the second mobile device can also receive screen projection data sent quickly, and the display device can be stably sent by the display device, and accordingly, and the two screen projection effects of the first mobile device can be stably achieved.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure.

In order to more clearly illustrate the embodiments or technical solutions in the prior art of the present disclosure, the drawings used in the embodiments or technical solutions in the prior art description will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive labor.

Fig. 1A is a schematic view of an operation scenario among a display device, a control device, and a mobile device according to one or more embodiments of the present disclosure;

FIG. 1B is a diagram illustrating the time of using channels by a P2P port and a WLAN port in the related art;

fig. 2 is a block diagram of a hardware configuration of a control apparatus according to one or more embodiments of the present disclosure;

fig. 3A is a block diagram of a hardware configuration of a display device according to one or more embodiments of the present disclosure;

FIG. 3B is a diagram illustrating a software configuration in a display device according to one or more embodiments of the present disclosure;

FIG. 3C is a schematic illustration of an icon control interface display of an application in a display device according to one or more embodiments of the present disclosure;

FIG. 4A is a system block diagram of a screen projection connection according to one or more embodiments of the present disclosure;

FIG. 4B is an architectural diagram of a screen projection connection according to one or more embodiments of the present disclosure;

fig. 5A is a schematic flowchart of a screen projection connection method according to an embodiment of the disclosure;

fig. 5B is a schematic diagram of an interaction process between a first mobile device and a display device according to an embodiment of the present disclosure;

fig. 6A is a schematic flowchart of another screen projection connection method according to an embodiment of the disclosure;

fig. 6B is a schematic diagram of an interaction process between a second mobile device and a display device according to an embodiment of the present disclosure;

fig. 6C is a schematic diagram of time length allocation in the first channel use strategy according to the embodiment of the present disclosure;

fig. 6D is a schematic diagram of time length allocation in a second channel usage strategy according to an embodiment of the present disclosure;

fig. 6E is a schematic diagram of a process of issuing an instruction of a monitoring probe request according to an embodiment of the present disclosure;

fig. 7 is a schematic diagram of an interaction process between a first mobile device, a second mobile device, and a display device according to an embodiment of the present disclosure.

Detailed Description

In order that the above objects, features and advantages of the present disclosure may be more clearly understood, aspects of the present disclosure will be further described below. It should be noted that, in the case of no conflict, the embodiments and features in the embodiments of the present disclosure may be combined with each other.

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure, but the present disclosure may be practiced in other ways than those described herein; it is to be understood that the embodiments disclosed in the specification are only a few embodiments of the present disclosure, and not all embodiments.

The terms "first" and "second," etc. in this disclosure are used to distinguish between different objects, rather than to describe a particular order of objects. For example, the first processing result, the second processing result, and the like are used to distinguish different processing results, and are not used to describe a specific order of the processing results.

Currently, there are two common operating systems for mobile devices: an Android operating system and an IOS operating system. Illustratively, if the mobile device adopts an Android operating system and performs screen projection based on the Miracast protocol, in order to ensure that the display device (i.e., the device that the mobile device wants to project a screen) quickly discovers the mobile device, the display device needs to start a P2P monitoring service, and the service needs to use a P2P port, because the P2P port can seize resources of a WLAN port, the network at this time will fluctuate regularly. The AirPlay protocol is a screen-throwing protocol carried by a mobile device of an IOS operating system, runs on the IOS system, and the mobile device and a display device need to be connected in the same local area network and depend on the local area network for transmission, so that if the mobile device adopts the IOS operating system and transmits data in real time based on the AirPlay protocol, the AirPlay protocol depends on network quality, the requirement on network stability is very high, and when the network speed slightly fluctuates, the problems of screen blocking, screen splash, even disconnection and the like may occur during screen throwing. In summary, the Miracast screen projection protocol and the AirPlay protocol are mutually exclusive in performance, and how to be compatible with the two screen projection modes on the same television equipment becomes important.

Fig. 1A is a schematic view of an operation scenario among a display device, a control device, and a mobile device according to one or more embodiments of the present disclosure. Fig. 1A includes: a control device 100, a display device 200, a first mobile device 301, a second mobile device 302, and a server 400, wherein the operating system of the first mobile device is different from the operating system of the second mobile device. Taking two mobile devices as an example in fig. 1A for illustration, both the first mobile device 301 and the second mobile device 302 may initiate a screen projection connection to the display device, so as to transmit the playing data of themselves to the display device 200 for playing and displaying, but only the screen projection data of one mobile device may be displayed in the display device 200 at a time. The control apparatus 100 (e.g., a remote controller) using the display apparatus can perform related control of the display apparatus 200.

In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the display device 200 may include infrared protocol communication, bluetooth protocol communication, wireless or other wired methods, and the like, by which the display device 200 can be controlled. The user may input a user command through keys on a remote controller, voice input, control panel input, and the like to control the display apparatus 200.

In some embodiments, mobile terminals, tablets, computers, laptops, and other smart devices may also be used to control the display device 200.

In some embodiments, the display device 200 may not receive instructions using the smart device or the control device described above, but receive control of the user through touch or gesture, or the like.

In some embodiments, the display device 200 may also be controlled by a manner other than a control device and an intelligent device, for example, the voice instruction control of the user may be directly received by a module configured inside the display device 200 to obtain a voice instruction, or may be received by a voice control device provided outside the display device 200.

In some embodiments, the mobile terminal may install a software application with the display device 200 to implement connection communication through a network communication protocol for the purpose of one-to-one control operation and data communication. And the audio and video content displayed on the mobile terminal can be transmitted to the display device 200, so that the synchronous display function is realized. The display apparatus 200 may also be in data communication with the server 400 through various communication means, which may allow the display apparatus 200 to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may be a cluster or a plurality of clusters, and may include one or more types of servers. The server 400 may provide various contents and interactions to the display apparatus 200. The display device 200 may be a liquid crystal display, an OLED display, or a projection display device, etc. The display apparatus 200 may additionally provide an intelligent network tv function that provides a computer support function in addition to the broadcast receiving tv function.

Illustratively, fig. 1B is a diagram illustrating the time when the P2P port and the WLAN port use the channel in the related art. As shown in fig. 1B, the channels used by the P2P port and the WLAN port are different, and since the P2P port and the WLAN port have a mutual exclusion problem when using resources, the WLAN port cannot use the channels when the P2P port uses the channels. In fig. 1B, T0 represents the time for the WLAN port to use the channel, T1 represents the time for the P2P port to use the channel, and T2 represents the time required for switching from the channel used by the WLAN port to the channel used by the P2P port; t3 represents the time required to switch from the channel used by the P2P port to the WLAN port. As can be seen from fig. 1B, the main factor determining the mobile device discovery speed based on the Miracast screen protocol is the duty ratio corresponding to the time when the P2P port uses the channel, when the duty ratio is large, the mobile device discovery speed based on the Miracast screen protocol is also fast, and for WIFI, the time consumption for affecting the P2P port and the WLAN port switching occurs on the channel switching.

In order to solve the above problems, an embodiment of the present disclosure provides a screen-projecting connection method, where a detection request is monitored by using a first channel usage policy, so as to ensure that a mobile device can be quickly found, then a detection response is sent to the first mobile device after the detection request of the first mobile device is received through a first port, and data transmission is performed by using a second channel usage policy, and finally, based on a screen-projecting protocol of the first mobile device and the first port, a first screen-projecting connection between a display device and the first mobile device is established, and screen-projecting data sent by the first mobile device is received based on the first screen-projecting connection, so as to ensure stability of the first mobile device when data is transmitted, and avoid problems of screen blocking, screen floating, even disconnection, and the like.

Fig. 2 is a block diagram of a hardware configuration of a control apparatus according to one or more embodiments of the present disclosure. As shown in fig. 2, the control apparatus includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply source. The control apparatus may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive by the display apparatus 200, serving as an interaction intermediary between the user and the display apparatus 200. The communication interface 130 is used for communicating with the outside, and includes at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module. The user input/output interface 140 includes at least one of a microphone, a touch pad, a sensor, a key, or an alternative module.

Fig. 3A is a block diagram of a hardware configuration of a display device according to one or more embodiments of the present disclosure. The display apparatus 200 as shown in fig. 3A includes at least one of a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface (i.e., a user input interface) 280. The controller 250 includes a central processor, a video processor, an audio processor, a graphic processor, a RAM, a ROM, first to nth interfaces for input/output. The display 260 may be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and may also be a projection device and a projection screen. The tuner demodulator 210 receives a broadcast television signal through a wired or wireless reception manner, and demodulates an audio/video signal, such as an EPG data signal, from a plurality of wireless or wired broadcast television signals. Communicator 220 is a component for communicating with servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the server 400 through the communicator 220. The detector 230 is used to collect signals of an external environment or interaction with the outside. The controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box. The user interface 280 may be used to receive control signals for controlling devices, such as infrared remote controls, etc.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display apparatus 200. A user may input a user command on a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form that is acceptable to the user. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, and a control displayed in a display screen of the electronic device, where the control may include at least one of an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, and other visual interface elements.

Fig. 3B is a schematic diagram of software configuration in a display device according to one or more embodiments of the present disclosure, and as shown in fig. 3B, the system is divided into four layers, which are, from top to bottom, an Application (Applications) layer (abbreviated as "Application layer"), an Application Framework (Application Framework) layer (abbreviated as "Framework layer"), an Android runtime (Android runtime) and system library layer (abbreviated as "system runtime library layer"), and a kernel layer.

In some embodiments, at least one application program runs in the application program layer, and the application programs may be windows (windows) programs carried by an operating system, system setting programs, clock programs or the like; or may be an application developed by a third party developer. In particular implementations, applications in the application layer include, but are not limited to, the above examples.

In some embodiments, the system runtime layer provides support for the upper layer, i.e., the framework layer, and when the framework layer is used, the android operating system runs the C/C + + library included in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a layer between hardware and software, including at least one of the following drivers: audio drive, display driver, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (like fingerprint sensor, temperature sensor, pressure sensor etc.) and power drive etc..

Fig. 3C is a schematic diagram of an icon control interface display of an application program in a display device according to one or more embodiments of the present disclosure, as shown in fig. 3C, an application program layer includes at least one application program that can display a corresponding icon control in a display, for example: the system comprises a live television application icon control, a video-on-demand application icon control, a media center application icon control, an application center icon control, a game application icon control and the like. The live television application program can provide live television through different signal sources. A video-on-demand application may provide video from different storage sources. Unlike live television applications, video on demand provides a video display from some storage source. The media center application program can provide various applications for playing multimedia contents. The application program center can provide and store various application programs.

In some embodiments, the display device is a terminal device with a display function, such as a television, a mobile phone, a computer, a learning machine, and the like. In the display device:

an output interface (display 260, and/or audio output interface 270) configured to output user interaction information;

a communicator 220 for communicating with the server 400;

a controller 250 configured to: monitoring a probe request by using a first channel use strategy, wherein the channel use duration of a first port in the first channel use strategy is less than the channel use duration of a second port, the probe request is used for requesting to discover the display device, the first port is used for a first mobile device to communicate with the display device, the second port is used for a second mobile device to communicate with the display device, and the operating systems of the first mobile device and the second mobile device are different;

In some embodiments, the controller 250 is further configured to:

after receiving a probe request of the second mobile equipment through the second port, sending a probe response to the second mobile equipment, and performing data transmission by using the first channel use strategy;

and establishing a second screen projection connection between the display device and the second mobile device based on the screen projection protocol of the second mobile device and the second port, and receiving screen projection data sent by the second mobile device based on the second screen projection connection.

In some embodiments, the first channel usage policy comprises:

based on a preset period that display equipment sends the monitoring detection request, determining a first proportion of time duration in the preset period as the use time duration of a target channel, wherein the target channel is as follows: under the condition that the display equipment establishes network connection, the network connection corresponds to a channel, and the target channel is a channel commonly used by the first port and the second port;

and determining the residual time length in the preset period as the use time length of a preset channel used by the second port, wherein the preset channel is different from the target channel.

In some embodiments, the second channel usage policy comprises:

determining the duration of a second proportion in the preset period as the channel use duration of the first port based on the preset period;

and determining the residual time length in the preset period as the channel use time length of the second port, wherein the time length of the second proportion is greater than the residual time length, and the channel of the first port is different from the channel of the second port.

In some embodiments, the controller 250 is further configured to:

after a screen projection switch of the display device is turned on, periodically sending the instruction of the monitoring and detecting request to a target driver based on the preset period so that the target driver applies for a channel of a target port based on the instruction of the monitoring and detecting request, wherein the target port is one of the first port and the second port;

and detecting whether the probe request sent by the target mobile equipment is received or not within the holding time of the channel of the target port.

In some embodiments, the controller 250 is further configured to:

and releasing the channel of the target port when the retention time of the channel of the target port is detected to be reached.

In some embodiments, the controller 250 is further configured to:

after the detection request of the first mobile device is received through the first port, if it is determined that a display of the display device displays screen projection data sent by a third mobile device, the screen projection connection between the display device and the third mobile device is disconnected, wherein an operating system of the third mobile device is one of an operating system of the first mobile device and an operating system of the second mobile device.

In some embodiments, the operating system of the first mobile device is an IOS operating system and the operating system of the second mobile device is an android operating system.

To sum up, the present disclosure executes the above screen projection connection method on a display device, where a controller of the display device monitors a detection request with a first channel usage policy, where a channel usage duration of a first port in the first channel usage policy is smaller than a channel usage duration of a second port, the detection request is used to request discovery of the display device, the first port is used for communication between a first mobile device and the display device, and the second port is used for communication between a second mobile device and the display device, and operating systems of the first mobile device and the second mobile device are different, and then after receiving the detection request of the first mobile device through the first port, sends a detection response to the first mobile device, and adjusts data transmission with the second channel usage policy, where the channel usage duration of the first port in the second channel usage policy is greater than the channel usage duration of the second port, and finally establishes a first screen projection connection between the display device and the first mobile device based on a screen projection protocol and the first port of the first mobile device, and receives screen projection data sent by the first screen projection connection, so that screen projection performance of the display device can be improved by two screen projection methods.

Fig. 4A is a block diagram of a system for performing a screen projection connection according to one or more embodiments of the present disclosure, and as shown in fig. 4A, the system may include a monitoring module 401, an adjusting module 402, and a receiving module 403. A monitoring module 401 in the system is configured to monitor a probe request with a first channel usage policy, where a channel usage duration of a first port in the first channel usage policy is shorter than a channel usage duration of a second port, the probe request is used to request discovery of a display device, the first port is used for a first mobile device to communicate with the display device, the second port is used for a second mobile device to communicate with the display device, and operating systems of the first mobile device and the second mobile device are different; the adjusting module 402 is configured to send a probe response to the first mobile device after receiving a probe request of the first mobile device through the first port, and adjust data transmission using a second channel usage policy, where a channel usage duration of the first port in the second channel usage policy is longer than a channel usage duration of the second port; and the receiving module 403 is configured to establish a first screen projection connection between the display device and the first mobile device based on the screen projection protocol and the first port of the first mobile device, and receive screen projection data sent by the first mobile device based on the first screen projection connection.

Fig. 4B is an architectural diagram of a screen projection connection according to one or more embodiments of the present disclosure. Based on the system framework, the implementation of the present disclosure in the android system is shown in fig. 4B, where the android system mainly includes an application layer, a framework layer, a system runtime layer, and a kernel layer, and the implementation logic is mainly embodied in the application layer, where the implementation logic includes a monitoring module, an adjustment module, and a receiving module, the functions of the modules have been described in detail in the foregoing embodiments, and are not described here again to avoid repetition.

For more detailed description of the screen-projection connection scheme in this embodiment, the following description is made with reference to fig. 5A in an exemplary manner, and it is understood that the steps involved in fig. 5A may include more steps or fewer steps in actual implementation, and the order between the steps may also be different, so as to enable the screen-projection connection method provided in the embodiment of the present disclosure, which is not limited in the embodiment of the present disclosure.

Fig. 5A is a schematic flowchart of a screen projection connection method according to an embodiment of the present disclosure. The embodiment is applicable to the description of the process of stably projecting the screen between the first mobile device and the display device. As shown in fig. 5A, the screen-projection connection method specifically includes the following steps:

s510, monitoring a probe request by using a first channel usage policy, where a channel usage duration of a first port in the first channel usage policy is less than a channel usage duration of a second port, the probe request is used to request discovery of the display device, the first port is used for a first mobile device to communicate with the display device, the second port is used for a second mobile device to communicate with the display device, and operating systems of the first mobile device and the second mobile device are different.

In order to solve the problem that the screen projection modes corresponding to two operating systems are compatible on the same display device, in this embodiment, the display device and the second mobile device communicate through the second port, and the channel use duration of the second port is longer than that of the first port in the first channel use policy, so that when a controller of the display device monitors a probe request (probe request) with the first channel use policy, it can be ensured that the controller can have more duration to monitor whether the second mobile device sends the probe request, and thus it is ensured that the second mobile device can have more time to discover the display device. Namely: when the controller monitors the detection request by using the first channel use strategy, the priority of the second mobile equipment is higher than that of the first mobile equipment when the second mobile equipment is projected on the screen, and the speed of the second mobile equipment for finding the display equipment is improved.

In some embodiments, optionally, the operating system of the first mobile device may be an IOS operating system, and the operating system of the second mobile device may be an Android operating system, where the first port is a WLAN port and the second port is a P2P port.

Wherein Miracast is a wireless display standard established by the Wi-Fi alliance and based on Wi-Fi Direct (Wi-Fi Direct). The device supporting the standard can share the video frame in a wireless manner, for example, the mobile device supporting the Miracast protocol can transmit resources such as videos or photos to the display device for playing based on the Miracast protocol, without a connection line or a wireless hotspot (Access Point, AP).

Specifically, when the operating system of the first mobile device is an IOS operating system and the operating system of the second mobile device is an Android operating system, since the P2P port is needed for screen projection based on the Miracast protocol, when the controller monitors the detection request by using the first channel usage policy, and since the usage duration of the P2P port is longer than that of the WLAN port, the speed at which the second mobile device discovers the display device can be ensured.

In some embodiments, optionally, the operating system of the first mobile device may be an Android operating system, and the operating system of the second mobile device may be an IOS operating system, where the first port is a P2P port and the second port is a WLAN port.

AirPlay can be understood as a playback technique that can transfer iOS or files on updated versions (including video, photos and images) to devices that support blank playback.

Specifically, when the operating system of the first mobile device is an Android operating system and the operating system of the second mobile device is an IOS operating system, because the WLAN port is needed for screen projection based on the AirPlay protocol, when the controller monitors the detection request by using the first channel usage policy, and because the usage duration of the WLAN port is longer than that of the P2P port, the speed at which the second mobile device discovers the display device can be ensured.

S520, after receiving the detection request of the first mobile equipment through the first port, sending a detection response to the first mobile equipment, and adjusting to perform data transmission by using a second channel use strategy, wherein the channel use duration of the first port in the second channel use strategy is longer than the channel use duration of the second port.

After receiving the probe request of the first mobile device through the first port, the controller sends a probe response (probe response) to the first mobile device, thereby completing the process of discovering the display device by the first mobile device. Meanwhile, in the first channel use strategy, the priority of the second mobile device when the second mobile device is projected on the screen is higher than that of the first mobile device, so that in order to ensure the stability of data transmission between the first mobile device and the display device and avoid the influence of network fluctuation, the second channel use strategy needs to be adjusted to perform data transmission. Specifically, since the channel use duration of the first port in the second channel use policy is longer than the channel use duration of the second port, it is convenient for the first mobile device to send the screen projection data to the display device through the first port.

In some embodiments, optionally, when the operating system of the first mobile device is an IOS operating system, the operating system of the second mobile device is an Android operating system, the first port is a WLAN port, and the second port is a P2P port, since when the controller monitors the probe request by using the first channel usage policy, the priority of the second mobile device when the second mobile device is projected is higher than that of the first mobile device, after the controller receives the probe request of the first mobile device through the first port, since the AirPlay protocol is easily affected by network fluctuations when the controller is projected, in order to ensure the stability of data transmission between the first mobile device and the display device, and avoid the stability of network fluctuations, it is necessary to adjust the second channel usage policy to perform data transmission, that is: when the channel use time of the WLAN port is longer than that of the P2P port, the network stability can be improved, and the problems of blocking, screen splash, even disconnection and the like when the screen projection data sent by the first mobile equipment is displayed by the subsequent display equipment are prevented.

In some embodiments, optionally, when the operating system of the first mobile device is an Android operating system, the operating system of the second mobile device is an IOS operating system, the first port is a P2P port, and the second port is a WLAN port, since when the controller monitors the probe request using the first channel usage policy, the priority of the second mobile device when the second mobile device is on screen is higher than that of the first mobile device, after the controller receives the probe request of the first mobile device through the first port, in order to ensure the data transmission speed when the Miracast protocol is used to screen, it is necessary to adjust the second channel usage policy to perform data transmission, that is: when the channel use duration of the P2P port is longer than that of the WLAN port, the speed of screen projection data transmission between the display device and the first mobile device is improved.

S530, based on the screen projection protocol and the first port of the first mobile device, establishing a first screen projection connection between the display device and the first mobile device, and receiving screen projection data sent by the first mobile device based on the first screen projection connection.

The screen projection data sent by the first mobile device may be content played in the first mobile device, such as video, music, or art, and the embodiment is not limited.

After the controller adjusts to perform data transmission by using a second channel use strategy, based on a screen-casting protocol and a first port of the first mobile device, the first mobile device sends a screen-casting connection request to a controller of the display device, and after receiving the screen-casting connection request, the corresponding controller sends a screen-casting connection response to the first mobile device. Then, based on the first screen projection connection, the first mobile device can send screen projection data to the controller of the display device, so that the controller can control the display of the display device to display the screen projection data after receiving the screen projection data sent by the first mobile device.

In this embodiment, through the above process, the screen projection modes corresponding to the two operating systems can be compatible, so that the second mobile device can be ensured to quickly find the display device, and the first mobile device can be ensured to stably transmit data after receiving the detection request of the first mobile device, and the corresponding display device can also stably display the screen projection data sent by the first mobile device, thereby achieving the effect of improving the performance of the two screen projection modes.

Fig. 5B is a schematic diagram of an interaction process between a first mobile device and a display device according to an embodiment of the present disclosure. The process of implementing the screen-casting connection between the first mobile device and the display device based on the interaction between the first mobile device and the display device shown in fig. 5B has been described in detail in the foregoing embodiments, and is not repeated here to avoid repetition.

Fig. 6A is a schematic flowchart of another screen projection connection method according to an embodiment of the present disclosure. The embodiment is optimized on the basis of the embodiment. Alternatively, the present embodiment may be applied to describe a screen projection process between the second mobile device and the display device. As shown in fig. 6A, the screen-projection connection method specifically includes the following steps:

s610, monitoring a probe request by using a first channel usage policy, where a channel usage duration of a first port in the first channel usage policy is shorter than a channel usage duration of a second port, the probe request is used to request discovery of the display device, the first port is used for a first mobile device to communicate with the display device, the second port is used for a second mobile device to communicate with the display device, and operating systems of the first mobile device and the second mobile device are different.

S620, after receiving the probe request of the second mobile device through the second port, sending a probe response to the second mobile device, and performing data transmission according to the first channel usage policy.

And after receiving the probe request of the second mobile equipment through the second port, the controller sends a probe response to the second mobile equipment, so that the process that the second mobile equipment discovers the display equipment is completed. Meanwhile, in the first channel use strategy, the priority of the second mobile device during screen projection is higher than that of the first mobile device, so that the controller continues to transmit data by using the first channel use strategy, and stable and rapid transmission of data between the first mobile device and the display device can be ensured.

In some embodiments, optionally, when the operating system of the first mobile device is an IOS operating system, the operating system of the second mobile device is an Android operating system, the first port is a WLAN port, and the second port is a P2P port, since when the controller monitors the probe request according to the first channel usage policy, the priority of the second mobile device during screen projection is higher than that of the first mobile device, after the controller receives the probe request of the second mobile device through the second port, the controller continues to perform data transmission according to the first channel usage policy, and thus stable and fast data transmission between the second mobile device and the display device can be ensured.

In some embodiments, optionally, when the operating system of the first mobile device is an Android operating system, the operating system of the second mobile device is an IOS operating system, the first port is a P2P port, and the second port is a WLAN port, since when the controller monitors the probe request with the first channel use policy, the priority of the second mobile device when the second mobile device is on screen is higher than that of the first mobile device, after the controller receives the probe request of the second mobile device through the second port, the controller continues to transmit data with the first channel use policy, so that stable and fast transmission of data between the second mobile device and the display device can be ensured, the influence of network fluctuation is avoided, the network stability can be improved, and the problems of blocking, screen splash, even disconnection and the like when the subsequent display device displays the screen cast data sent by the second mobile device are prevented.

And S630, establishing a second screen projection connection between the display device and the second mobile device based on the screen projection protocol and the second port of the second mobile device, and receiving screen projection data sent by the second mobile device based on the second screen projection connection.

The screen projection data sent by the second mobile device may be content played in the second mobile device, such as video, music, or art, and the embodiment is not limited. The screen projection data sent by the second mobile device and the screen projection data sent by the first mobile device may be the same or different, which is not specifically limited in this embodiment.

In the process that the controller performs data transmission by using the first channel use strategy, based on a screen-casting protocol and a second port of the second mobile device, the second mobile device sends a screen-casting connection request to the controller of the display device, and after receiving the screen-casting connection request, the corresponding controller sends a screen-casting connection response to the second mobile device. Then, based on the second screen projection connection, the second mobile device can send screen projection data to the controller of the display device, so that the controller can control the display of the display device to display the screen projection data after receiving the screen projection data sent by the second mobile device.

In this embodiment, through the above process, it can be ensured that the second mobile device discovers the display device quickly, and stably and quickly transmits the screen projection data of the second mobile device to the display device, and the corresponding display device can also display the screen projection data sent by the second mobile device quickly and stably, so as to achieve the effect of improving the screen projection performance of the second mobile device.

For example, fig. 6B is a schematic diagram of an interaction process between a second mobile device and a display device according to an embodiment of the present disclosure. The process of implementing the screen-casting connection between the second mobile device and the display device based on the interaction between the second mobile device and the display device, which is shown in fig. 6B, has already been described in detail in the foregoing embodiment, and is not repeated here to avoid repetition.

In some embodiments, optionally, the first channel usage policy may specifically include:

based on a preset period that display equipment sends the monitoring detection request, determining a first proportion of time duration in the preset period as the use time duration of a target channel, wherein the target channel is as follows: under the condition that the display equipment establishes network connection, the network connection is corresponding to a channel, and the target channel is a channel commonly used by the first port and the second port;

The preset period may be preset, for example, 500ms, or may be determined according to specific situations, and this embodiment is not limited thereto. The first ratio may be preset, for example, 80%, and may be determined according to specific situations, which is not limited in this embodiment. The network connection may be a WIFI connection and the corresponding target channel is the channel used by the WLAN port. The predetermined channel may be one of a plurality of channels that the second port specified in the protocol can use.

Specifically, in order to increase the speed at which the second mobile device discovers the display device, it is necessary to ensure that the channel usage duration of the second port is greater than the channel usage duration of the first port, therefore, the controller obtains a preset period during which the display device sends a monitoring probe request, and based on the preset period, when the display device establishes a network connection, determines the duration of a first proportion in the preset period as the usage duration of the channel commonly used by the first port and the second port, and determines the remaining duration of the preset period except the duration of the first proportion as the usage duration of the preset channel used by the second port.

In this embodiment, through the above process, it can be ensured that the channel use duration of the first port is shorter than the channel use duration of the second port.

For example, fig. 6C is a schematic diagram illustrating time length allocation in the first channel usage policy according to an embodiment of the present disclosure. Since the target channel is a channel commonly used by the first port and the second port, and the preset channel used by the second port exclusively occupies the remaining time duration in the preset period, as is apparent from fig. 6C, the channel usage time duration of the first port is shorter than the channel usage time duration of the second port.

For example, assuming that the operating system of the first mobile device is an IOS operating system, the operating system of the second mobile device is an Android operating system, the first port is a WLAN port, the second port is a P2P port, and the usage duration of the target channel in fig. 6C is as follows: the WLAN port and the P2P port commonly use the corresponding use duration when the network is connected with the corresponding channel, and the use duration of the preset channel used by the second port is as follows: the time length of the P2P port using its corresponding channel. If the preset period is 500ms, the use duration of the target channel may be 400ms, and the use duration of the preset channel used by the p2p port is 100ms, that is: the total channel usage time of the P2P ports is 500ms, and the total channel usage time of the WLAN ports is 400ms.

For example, assuming that the operating system of the first mobile device is an Android operating system, the operating system of the second mobile device is an IOS operating system, the first port is a P2P port, the second port is a WLAN port, and the usage duration of the target channel in fig. 6C is as follows: the WLAN port and the P2P port commonly use the corresponding use duration when the network is connected with the corresponding channel, and the use duration of the preset channel used by the second port is as follows: the length of time that the WLAN port is in use of its corresponding channel. If the preset period is 500ms, the duration of the target channel may be 400ms, and the duration of the preset channel used by the second port is 100ms, that is: the WLAN total channel usage duration is 500ms, and the P2P port total channel usage duration is 400ms.

It should be noted that: the first channel usage strategy is illustrated in fig. 6C by taking two preset periods as an example, and is not limited thereto.

In some embodiments, the probe requests are monitored by a plurality of mobile devices with a first channel usage policy, and the time to complete device discovery is counted to reach the following conclusion: the time for the mobile device to find the display device is about 2.5s (compatible with various mobile device mobile phones, 100 groups of tests are averaged), and the shortest time is about 1 s.

Accordingly, accompanying the increase in the speed at which mobile devices find display devices, there is a problem of large network fluctuations. For the specific test of whether the network fluctuates, reference may be made to the method in the related art, which is not limited in this embodiment.

In some embodiments, optionally, the second channel usage policy may specifically include:

and determining the remaining duration in the preset period as the channel use duration of the second port, wherein the duration of the second proportion is greater than the remaining duration, and the channel of the first port is different from the channel of the second port.

The second ratio may be preset, for example, 60%, or may be determined according to specific situations, and this embodiment is not limited. The second ratio may be the same as or different from the first ratio, and the embodiment is not limited.

Specifically, in order to ensure stability of data transmission between the first mobile device and the display device and avoid being affected by network fluctuation, the channel use duration of the first port needs to be longer than the channel use duration of the second port. Therefore, the controller determines the duration of the second proportion in the preset period as the duration of the channel of the first port, and determines the remaining duration of the preset period except for the duration of the second proportion as the duration of the channel of the second port, where the duration of the second proportion is greater than the remaining duration, and the channel of the first port is different from the channel of the second port, it is known that: in a preset period, the total channel use duration of the first port is longer than that of the second port.

In this embodiment, through the above process, it can be ensured that the channel use duration of the first port is longer than the channel use duration of the second port.

For example, fig. 6D is a schematic diagram of time length allocation in the second channel usage strategy provided in the embodiment of the present disclosure. As the channel usage duration of the first port is exclusive of the channel of the first port, and the channel usage duration of the second port is exclusive of the channel of the second port, it is obvious from fig. 6D that the channel usage duration of the first port is longer than the channel usage duration of the second port.

For example, assuming that the operating system of the first mobile device is an IOS operating system, the operating system of the second mobile device is an Android operating system, the first port is a WLAN port, the second port is a P2P port, and the channel usage duration of the first port in fig. 6D is as follows: the channel use duration of the second port is the use duration corresponding to the channel used by the WLAN port: and the use duration of the channel used by the P2P port corresponds to the use duration. If the preset period is 500ms, the channel use duration of the wlan port may be 300ms, and the channel use duration of the p2p port may be 200ms.

For example, assuming that the operating system of the first mobile device is an Android operating system, the operating system of the second mobile device is an IOS operating system, the first port is a P2P port, the second port is a WLAN port, and a channel usage duration of the first port in fig. 6D is as follows: the duration of the channel used by the P2P port is the duration of the channel used by the second port: the channel used by the WLAN port corresponds to the usage duration. If the preset period is 500ms, the channel use duration of the p2p port may be 300ms, and the channel use duration of the wlan port may be 200ms.

It should be noted that: the first channel use strategy is illustrated in fig. 6D by taking two preset periods as an example, and is not limited thereto.

In some embodiments, optionally, the method may further specifically include:

after a screen-projecting switch of the display device is turned on, periodically sending an instruction of the monitoring detection request to a target driver based on the preset period so that the target driver applies for a channel of a target port based on the instruction of the monitoring detection request, wherein the target port is one of the first port and the second port;

The target port may be one of the first port and the second port, and this embodiment is not limited to this. The target Driver may be a WIFI Driver (WIFI Driver) in the display device, and may also be another Driver, which is not limited in this embodiment. The target mobile device may be: the mobile device is the same as the operating system of the first mobile device, or the mobile device is the same as the operating system of the second mobile device, which is not limited in this embodiment.

In this embodiment, after a screen-projecting switch of the display device is turned on, the controller can periodically send a command for monitoring a detection request to the target driver based on a preset period, the target driver can apply for a channel of a target port based on the command after receiving the command, and meanwhile, whether the detection request sent by the target mobile device is received or not is detected within a retention time of the channel after the target port successfully applies for the channel.

In some embodiments, optionally, the method may further specifically include:

and releasing the channel of the target port when the holding time of the channel of the target port is detected to be reached.

In this embodiment, when the controller detects that the retention time of the channel of the target port is reached, the channel of the target port is released, so that other ports can use the channel conveniently, and resources can be used and allocated reasonably.

In some embodiments, optionally, the method may further specifically include:

Specifically, after receiving the detection request of the first mobile device through the first port, the controller needs to disconnect the screen projection connection between the display device and the third mobile device when determining that the display of the display device displays the screen projection data sent by the third mobile device, so as to avoid influencing the screen projection connection between the first mobile device and the display device.

In this embodiment, by the above method, the screen projection connection that has been established before the detection request of the first mobile device is received through the first port can be automatically disconnected, and normal use of the screen projection function is not affected.

In some embodiments, optionally, the method may further specifically include:

after the detection request of the second mobile device is received through the second port, if it is determined that a display of the display device displays screen projection data sent by a fourth mobile device, the screen projection connection between the display device and the fourth mobile device is disconnected, wherein an operating system of the fourth mobile device is one of an operating system of the first mobile device and an operating system of the second mobile device.

Specifically, after receiving a detection request of the second mobile device through the second port, the controller needs to disconnect the screen projection connection between the display device and the fourth mobile device when determining that the display of the display device displays the screen projection data sent by the fourth mobile device, so as to avoid influencing the screen projection connection between the subsequent second mobile device and the display device.

In this embodiment, by the above method, the screen projection connection that has been established before the detection request of the second mobile device is received through the second port can be automatically disconnected, and normal use of the screen projection function is not affected.

Fig. 6E is a schematic diagram of a process of issuing an instruction of a probe request according to an embodiment of the present disclosure. Illustratively, this process is explained by taking a P2P port as an example:

1. after the display equipment opens the screen projection switch, the application layer sends a command of monitoring a detection request to the framework layer;

2. the framework layer sends the instruction of the monitoring probe request to a network transition layer (wpa _ supplicant);

3. the network transition layer sends a command of a monitoring detection request to a target driver, wherein the command desirably comprises the time length (assumed to be T) of the current monitoring and a monitored channel;

4. after receiving the instruction of the monitoring detection request, the target driver applies for a channel of a target port, keeps a time length T in the channel after the application is successful, and informs a network transition layer to start to keep in the channel;

5. in the channel holding stage, if the target driver receives a detection request sent by the target mobile equipment, a detection response is sent to the target mobile equipment, and the target mobile equipment requests to discover the display equipment successfully;

6. after the channel holding time length T, the target driver finishes holding and informs a network transition layer to finish holding;

7. the network transition layer continues to send the instruction of the monitoring detection request.

Specifically, the process shown in fig. 6E has already been described in detail in the foregoing embodiment, and is not described again here.

Fig. 7 is a schematic diagram of an interaction process between a first mobile device, a second mobile device, and a display device according to an embodiment of the present disclosure. As shown in fig. 7, the display device first establishes a first screen-projection connection with the first mobile device, and subsequently after the controller receives a probe request of the second mobile device through the second port, the controller sends a probe response to the second mobile device, and disconnects the first screen-projection connection between the display device and the first mobile device, so as to facilitate the subsequent establishment of a second screen-projection connection between the display device and the second mobile device, and finally, the first channel usage policy is used to monitor the probe request. The remaining steps in fig. 7 have already been described in detail in the above embodiments, and are not described again here.

To sum up, the present disclosure executes the above screen projection connection method on a display device, where a controller of the display device first monitors a detection request with a first channel usage policy, where a channel usage duration of a first port in the first channel usage policy is smaller than a channel usage duration of a second port, the detection request is used to request discovery of the display device, the first port is used for communication between a first mobile device and the display device, and the second port is used for communication between a second mobile device and the display device, and operating systems of the first mobile device and the second mobile device are different, and then after receiving the detection request of the first mobile device through the first port, sends a detection response to the first mobile device, and adjusts data transmission with a second channel usage policy, where the channel usage duration of the first port in the second channel usage policy is longer than the channel usage duration of the second port, and finally, based on a screen projection protocol and the first port of the first mobile device, establishes a first screen projection connection between the display device and the first mobile device, and receives screen projection data sent by the first screen projection protocol and the first port, and can ensure that the display device can receive screen projection data transmission data in a stable manner corresponding to the display device, and can also receive the two mobile device in a stable screen projection data transmission mode corresponding to the display device, thereby ensuring that the display device can receive the two mobile device.

The disclosed embodiment provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the computer program implements each process executed by the screen-projection connection method, and can achieve the same technical effect, and in order to avoid repetition, the details are not repeated here.

The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.

The present disclosure provides a computer program product comprising: when the computer program product runs on a computer, the computer is enabled to realize the screen-casting connection method.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the foregoing discussion in some embodiments is not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A display device, comprising:

a controller configured to:

2. The display device according to claim 1, wherein the controller is further configured to:

after receiving a probe request of the second mobile equipment through the second port, sending a probe response to the second mobile equipment, and performing data transmission by using a strategy of the first channel;

3. The display device of claim 1, wherein the first channel usage policy comprises:

4. The display device of claim 3, wherein the second channel usage policy comprises:

5. The display device of claim 4, wherein the controller is further configured to:

6. The display device of claim 5, wherein the controller is further configured to:

7. The display device according to claim 1, wherein the controller is further configured to:

8. The display device of any one of claims 1-7, wherein the operating system of the first mobile device is an IOS operating system and the operating system of the second mobile device is an android operating system.

9. A screen projection connection method is characterized by comprising the following steps:

10. The method of claim 9, further comprising: