CN115643436A

CN115643436A - Display device, multi-channel screen projection method and storage medium

Info

Publication number: CN115643436A
Application number: CN202211111022.6A
Authority: CN
Inventors: 高红; 陈相涛; 王彬
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2022-09-13
Filing date: 2022-09-13
Publication date: 2023-01-24

Abstract

The disclosure relates to a display device, a multi-channel screen projection method and a storage medium, which are applied to the technical field of display and solve the problems that in the prior art, a user needs to install a corresponding application program in a mobile device, the use complexity is increased, inconvenience is brought to the use of the user, and the experience of the user is low. The display device includes: a display; a controller configured to: detecting that a plurality of mobile devices establish point-to-point connection with display equipment, and respectively sending an IP address to each mobile device, wherein the mobile devices correspond to the IP addresses one to one; aiming at each mobile device, establishing a first connection between the mobile device and the display device based on the IP address corresponding to the mobile device, and establishing a second connection between the display device and the mobile device after the display device and the mobile device negotiate through the first connection; and receiving the data stream transmitted by each mobile device through the second connection, and controlling the display to display the data stream.

Description

Display device, multi-channel screen projection method and storage medium

Technical Field

The present disclosure relates to the field of screen projection control technologies, and in particular, to a display device, a multi-channel screen projection method, and a storage medium.

Background

With the continuous development of screen projection technology, the screen projection function brings great convenience to the work and life of people. People's mobile devices (such as smart phones, tablet computers, notebooks, and the like) are connected with display devices, and files, videos, games, and the like are launched on display screens of the display devices through screen launching, and related contents are displayed through the display screens, which has become a modern common method.

Meanwhile, as the user demand gradually increases, the requirement on the display device is higher, and a plurality of users hope to project screens simultaneously, which requires the display device to have a plurality of screen sharing capabilities. The conventional multi-channel screen projection method is usually a method of installing a specific application program in a mobile device for screen recording and then performing multi-channel display, but the method requires a user to install a corresponding application program in the mobile device, which increases the use complexity, brings inconvenience to the user, and causes a low user experience.

Disclosure of Invention

In order to solve the technical problem or at least partially solve the technical problem, the present disclosure provides a display device, a multi-channel screen projecting method and a storage medium, where a user does not need to install a corresponding application program in a mobile device, and can implement multi-channel screen projection between multiple mobile devices and the display device by using a wireless screen projecting function in the mobile device, and the method has the advantages of stronger universality, wider application range, and capability of improving user experience.

In a first aspect, the present disclosure provides a display apparatus comprising:

a display;

a controller configured to: detecting that a plurality of mobile devices establish point-to-point connection with a display device, and respectively sending an Internet Protocol (IP) address to each mobile device, wherein the mobile devices and the IP addresses are in one-to-one correspondence;

for each mobile device, establishing a first connection between the mobile device and the display device based on an IP address corresponding to the mobile device, and establishing a second connection between the display device and the mobile device after the display device negotiates with the mobile device through the first connection;

and receiving the data stream sent by each mobile device through the second connection, and controlling the display to display the data stream.

In a second aspect, the present disclosure provides a multi-channel screen projection method, including:

detecting that a plurality of mobile devices establish point-to-point connection with a display device, and respectively sending an Internet Protocol (IP) address to each mobile device, wherein the mobile devices and the IP addresses are in one-to-one correspondence;

and receiving the data stream sent by each mobile device through the second connection, and controlling a display of the display device to display the data stream.

In a third aspect, the present disclosure provides a computer-readable storage medium comprising: the computer-readable storage medium has stored thereon a computer program which, when executed by a processor, implements the multi-cast method as shown in the second aspect.

In a fourth aspect, the present disclosure provides a computer program product comprising: the computer program product, when run on a computer, causes the computer to implement a multi-cast method as shown in the second aspect.

Compared with the prior art, the technical scheme provided by the embodiment of the disclosure has the following advantages: the method comprises the steps that a controller of the display device firstly detects that a plurality of mobile devices are connected with the display device in a point-to-point mode, an IP address is sent to each mobile device, the mobile devices are in one-to-one correspondence with the IP addresses, then, for each mobile device, a first connection between the mobile device and the display device is established based on the IP address corresponding to the mobile device, after the display device and the mobile device are negotiated through the first connection, a second connection between the display device and the mobile device is established, finally, data streams sent by each mobile device through the second connection are received, the display device is controlled to display the data streams, through the technical scheme, a user does not need to install corresponding application programs in the mobile device, multi-path screen projection between the mobile devices and the display device can be achieved through a wireless screen projection function in the mobile device, the universality is higher, the application range is wider, and the use experience of the user can be improved.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure.

In order to more clearly illustrate the embodiments or technical solutions in the prior art of the present disclosure, the drawings used in the embodiments or technical solutions in the prior art description will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive labor.

Fig. 1 is a schematic view of an operation scenario among a display device, a control device, and a mobile device according to one or more embodiments of the present disclosure;

fig. 2 is a block diagram of a hardware configuration of the control apparatus 100 according to one or more embodiments of the present disclosure;

fig. 3A is a block diagram of a hardware configuration of a display apparatus 200 according to one or more embodiments of the present disclosure;

fig. 3B is a schematic diagram of a software configuration in the display device 200 according to one or more embodiments of the present disclosure;

fig. 3C is a schematic illustration of an icon control interface display of an application in the display device 200 according to one or more embodiments of the present disclosure;

FIG. 4A is a system block diagram for multi-way projection according to one or more embodiments of the present disclosure;

FIG. 4B is an architecture diagram illustrating multiple projection screens in accordance with one or more embodiments of the present disclosure;

fig. 5 is a schematic flowchart of a multi-channel screen projection method according to an embodiment of the present disclosure;

fig. 6A is a schematic flowchart of another multi-way screen projection method provided in the embodiment of the present disclosure;

fig. 6B is a schematic interface diagram of a display device when two mobile devices perform screen projection according to an embodiment of the present disclosure;

fig. 6C is a schematic diagram illustrating a principle of determining a second IP address corresponding to a second mobile device according to an embodiment of the present disclosure;

fig. 7A is a schematic flow chart of another multi-way screen projection method provided in the embodiment of the present disclosure;

fig. 7B is a schematic diagram illustrating a principle of determining a playing module according to an embodiment of the disclosure;

fig. 7C is a schematic diagram illustrating a principle of establishing a point-to-point connection according to an embodiment of the disclosure;

FIG. 7D is an architectural diagram illustrating a disconnected screen projection according to an embodiment of the present disclosure;

fig. 7E is a schematic flowchart of a process when two mobile devices perform screen projection according to an embodiment of the present disclosure.

Detailed Description

In order that the above objects, features and advantages of the present disclosure may be more clearly understood, aspects of the present disclosure will be further described below. It should be noted that the embodiments and features of the embodiments of the present disclosure may be combined with each other without conflict.

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure, but the present disclosure may be practiced in other ways than those described herein; it is to be understood that the embodiments disclosed in the specification are only a few embodiments of the present disclosure, and not all embodiments.

The terms "first" and "second," etc. in this disclosure are used to distinguish between different objects, and are not used to describe a particular order of objects. For example, first connection and second connection, etc. are used to distinguish between different connections and are not used to describe a particular order of connections.

With the rapid development of the internet and the popularization of Artificial Intelligence (AI) technology in recent years, display devices such as smart televisions are gradually becoming intelligent terminals at home in people's daily life, and are also the first choice for entertainment in living rooms. Especially, when the user meets at home, the advantage of the large screen of the smart television can be highlighted, and the smart television becomes a mainstream entertainment mode of people.

Meanwhile, with the gradual increase of the user requirements, the requirements on large screens are also higher. For example, a user may wish to share a game live view on a large screen; for another example, a plurality of users wish to play favorite videos on a large screen; as another example, party a wishes to compare two parties on the same large screen, which all require a large screen device with multiple screen sharing capabilities. In order to meet the requirements of a plurality of users, the problem can be well solved by multi-path screen projection.

In the prior art, a multi-path screen projection method comprises the following steps: the method of installing a specific application program for recording a screen in the mobile equipment and then performing multi-path display has the following problems: the user is required to install the corresponding application program in the mobile equipment, the use complexity can be increased, the use space of the mobile equipment is occupied, inconvenience is brought to the use of the user, the experience feeling of the user is low, and meanwhile, if sound is transmitted through Bluetooth, the problem that the sound and the video stream are not synchronous is caused.

In order to solve the problems, the disclosure provides a multi-channel screen projection method, a controller of a display device first detects that a plurality of mobile devices and the display device establish point-to-point connection, respectively sends Internet Protocol (IP) addresses to each mobile device, the mobile devices and the IP addresses correspond to each other one by one, then establishes a first connection between the mobile devices and the display device based on the IP addresses corresponding to the mobile devices for each mobile device, establishes a second connection between the display device and the mobile device after the display device and the mobile device negotiate through the first connection, and finally receives a data stream sent by each mobile device through the second connection and controls the display device to display the data stream.

Fig. 1 is a schematic view of an operation scene among a display device, a control device, and a mobile device according to one or more embodiments of the present disclosure. As shown in fig. 1, fig. 1 includes: a control device 100, a display device 200, a first mobile device 301, a second mobile device 302, and a server 400. In fig. 1, two mobile devices are taken as an example for illustration, and the first mobile device 301 and the second mobile device 302 may transmit their own play data to the display device 200 for play display. The control device 100 using the display device, such as a remote controller, can perform related control of the display device 200.

In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the display device 200 may include infrared protocol communication, bluetooth protocol communication, wireless or other wired methods, and the like, by which the display device 200 can be controlled. The user may input a user command through keys on a remote controller, voice input, control panel input, and the like to control the display apparatus 200.

In some embodiments, mobile terminals, tablets, computers, laptops, and other smart devices may also be used to control the display device 200.

In some embodiments, the display device 200 may not receive instructions using the smart device or the control device described above, but may receive user control through touch or gesture, or the like.

In some embodiments, the display device 200 may also be controlled by a manner other than a control device and an intelligent device, for example, the voice instruction control of the user may be directly received by a module configured inside the display device 200 to obtain a voice instruction, or may be received by a voice control device provided outside the display device 200.

In some embodiments, the mobile terminal may install a software application with the display device 200, implement connection communication through a network communication protocol, and implement the purpose of one-to-one control operation and data communication. And the audio and video content displayed on the mobile terminal can be transmitted to the display device 200, so that the synchronous display function is realized. The display apparatus 200 may also be in data communication with the server 400 through various communication means, which may allow the display apparatus 200 to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may be a cluster or a plurality of clusters, and may include one or more types of servers. The server 400 may provide various contents and interactions to the display apparatus 200. The display device 200 may be a liquid crystal display, an OLED display, or a projection display device, etc. The display apparatus 200 may additionally provide an intelligent network tv function that provides a computer support function in addition to the broadcast receiving tv function.

Fig. 2 is a block diagram of a hardware configuration of the control apparatus 100 according to one or more embodiments of the present disclosure. As shown in fig. 2, the control apparatus includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply source. The control apparatus may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to the display apparatus 200, serving as an interaction intermediary between the user and the display apparatus 200. The communication interface 130 is used for communicating with the outside, and includes at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module. The user input/output interface 140 includes at least one of a microphone, a touch pad, a sensor, a key, or an alternative module.

Fig. 3A is a block diagram of a hardware configuration of a display apparatus 200 according to one or more embodiments of the present disclosure. The display apparatus 200 as shown in fig. 3A includes at least one of a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface (i.e., a user input interface) 280. The controller 250 includes a central processor, a video processor, an audio processor, a graphic processor, a RAM, a ROM, first to nth interfaces for input/output. The display 260 may be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and may also be a projection device and a projection screen. The tuner demodulator 210 receives a broadcast television signal through wired or wireless reception and demodulates an audio/video signal, such as an EPG data signal, from a plurality of wireless or wired broadcast television signals. Communicator 220 is a component for communicating with server 400 according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the control apparatus 100 or the server 400 through the communicator 220. The detector 230 is used to collect signals of the external environment or interaction with the outside. The controller 250 and the modem 210 may be located in different separate devices, that is, the modem 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box. The user interface 280 may be used to receive control signals for controlling devices, such as infrared remote controls, etc.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display apparatus 200. The user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form that is acceptable to the user. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, and a control displayed in a display screen of the electronic device, where the control may include at least one of an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, and other visual interface elements.

Fig. 3B is a schematic diagram of a software configuration in the display device 200 according to one or more embodiments of the disclosure, and as shown in fig. 3B, the system is divided into four layers, which are an application (Applications) layer (abbreviated as "application layer"), a network layer, a protocol layer, a playback layer, and a kernel layer from top to bottom.

In some embodiments, at least one application program runs in the application program layer, and the application programs may be windows (windows) programs carried by an operating system, system setting programs, clock programs or the like; or an application developed by a third party developer. In particular implementations, applications in the application layer include, but are not limited to, the above examples.

In some embodiments, the network layer is primarily used to establish point-to-point (P2P) connections with mobile devices.

In some embodiments, the kernel layer is a layer between hardware and software, including at least one of the following drivers: audio drive, display driver, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (like fingerprint sensor, temperature sensor, pressure sensor etc.) and power drive etc..

Fig. 3C is a schematic diagram of an icon control interface display of an application program in the display device 200 according to one or more embodiments of the present disclosure, as shown in fig. 3C, an application program layer includes at least one application program that can display a corresponding icon control in a display, for example: the system comprises a live television application icon control, a video on demand application icon control, a media center application icon control, an application center icon control, a game application icon control and the like. The live television application program can provide live television through different signal sources. A video-on-demand application may provide video from different storage sources. Unlike live television applications, video on demand provides video displays from some storage source. The media center application program can provide various applications for playing multimedia contents. The application center can provide and store various applications.

In some embodiments, the display device is a terminal device with a display function, such as a television, a mobile phone, a computer, a learning machine, and the like. In the display device:

an output interface (display 260, and/or audio output interface 270) configured to output user interaction information;

a communicator 220 for communicating with a server;

a controller 250 configured to: detecting that a plurality of mobile devices establish point-to-point connection with display equipment, and respectively sending Internet Protocol (IP) addresses to each mobile device, wherein the mobile devices correspond to the IP addresses one to one;

aiming at each mobile device, establishing a first connection between the mobile device and the display device based on the IP address corresponding to the mobile device, and establishing a second connection between the display device and the mobile device after the display device and the mobile device negotiate through the first connection;

In some embodiments, the plurality of mobile devices includes a first mobile device and a second mobile device, the first mobile device establishing a peer-to-peer connection with the display device at an earlier time than the second mobile device establishing a peer-to-peer connection with the display device;

a controller 250 further configured to:

after point-to-point connection between a plurality of mobile devices and display equipment is detected and an IP address is sent to each mobile device, the IP address and the Media Access Control (MAC) address corresponding to each mobile device are stored;

a controller 250 specifically configured to:

establishing a first connection between the display device and the first mobile device according to a first IP address corresponding to the first mobile device, and establishing a second connection between the display device and the first mobile device after the display device negotiates with the first mobile device through the first connection;

determining a second IP address corresponding to second mobile equipment according to the corresponding relation between the mobile equipment and the MAC address;

and establishing a first connection between the display equipment and the second mobile equipment according to the second IP address, and establishing a second connection between the display equipment and the second mobile equipment after the display equipment and the second mobile equipment negotiate through the first connection.

In some embodiments, the controller 250 is specifically configured to:

receiving an IP address and an MAC address corresponding to mobile equipment, which are sent by a system of display equipment, and deleting a first IP address and a first MAC address corresponding to first mobile equipment;

and determining that the remaining MAC addresses in the MAC addresses are the same as a second MAC address corresponding to the second mobile equipment, and determining the IP address corresponding to the second MAC address as the second IP address corresponding to the second mobile equipment.

In some embodiments, the controller 250 is specifically configured to:

determining playing modules corresponding to the data streams, wherein the playing modules correspond to the mobile equipment one to one;

and sending the corresponding data stream to a display through different playing modules, and controlling the display to display the data stream.

In some embodiments, the controller 250 is specifically configured to:

receiving a corresponding data stream through a real-time transport protocol based on the corresponding second connection of each mobile device;

and analyzing the data stream to obtain a corresponding IP address, and determining a corresponding playing module according to the IP address.

In some embodiments, the controller 250 is further configured to:

initializing a point-to-point connection module, and determining display equipment as a central node connected with a projection screen;

the point-to-point connection between the plurality of mobile devices and the display device is established in response to point-to-point connection establishment requests sent by the plurality of mobile devices for the central node.

In some embodiments, the controller 250 is specifically configured to:

and in response to the target operation of the user on the target mobile device in the plurality of mobile devices, disconnecting the point-to-point connection between the target mobile device and the display device.

To sum up, according to the multi-channel screen projection method executed on the display device, a controller of the display device firstly detects that a plurality of mobile devices establish point-to-point connection with the display device, respectively sends an IP address to each mobile device, the mobile devices and the IP addresses are in one-to-one correspondence, then, for each mobile device, based on the IP address corresponding to the mobile device, a first connection between the mobile device and the display device is established, after the display device and the mobile device negotiate through the first connection, a second connection between the display device and the mobile device is established, and finally, a data stream sent by each mobile device through the second connection is received, and the display is controlled to display the data stream.

Fig. 4A is a block diagram of a system for multi-way screen projection according to one or more embodiments of the present disclosure, and as shown in fig. 4A, the system may include a sending module 401, a creating module 402, and a display module 403. After the system detects that a plurality of mobile devices are connected with a display device in a point-to-point manner, a sending module 401 sends an IP address to each mobile device, the mobile devices and the IP addresses correspond to each other one by one, a building module 402 is used for each mobile device, a first connection between each mobile device and each display device is built based on the IP address corresponding to the mobile device, the display devices and the mobile devices negotiate through the first connection, a second connection between each display device and each mobile device is built, and finally a display module 403 receives a data stream sent by each mobile device through the second connection and controls a display to display the data stream.

Fig. 4B is an architectural diagram of a multi-way projection screen according to one or more embodiments of the present disclosure. Based on the system framework, the android system of the display device is implemented as shown in fig. 4B, the android system of the display device mainly includes an application layer, a network layer, a protocol layer, a playing layer and a kernel layer, and the android system of the mobile device mainly includes an application layer, a network layer, a protocol layer and a video stream acquisition layer. The implementation logic in the scheme is mainly embodied in an application layer, a network layer, a protocol layer and a playing layer of the display device, and an application layer, a network layer, a protocol layer and a video stream acquisition layer of the mobile device. The mobile equipment end comprises: mobile device 1, mobile device 2, \8230;, the display device end is the display device.

Wherein the application layer of the mobile device is to: scanning a P2P device or a display device, i.e.: a device capable of P2P connectivity; the network layer of the mobile device is to: establishing P2P connection, requesting an IP address and acquiring the IP address; the protocol layers of the mobile device are to: establishing a Transmission Control Protocol (TCP) connection, establishing a User Datagram Protocol (UDP) connection, and transmitting a video stream; the video stream acquisition layer of the mobile device is to: acquiring a data stream of a mobile device; the application layer of the display device is used for: sending P2P monitoring and displaying corresponding data streams in a split screen mode according to the number of the mobile devices; the network layer of the display device is configured to: establishing P2P connection with the mobile equipment and sending an IP address to the mobile equipment; the protocol layers of the display device are used to: establishing TCP connection and UDP connection according to the IP address and acquiring data stream; the play layer of the display device is used for: receiving a data stream, decoding the data stream, and transmitting the decoded data stream to an application layer.

The application layer of the mobile equipment can interact with the network layer and the protocol layer of the mobile equipment; the protocol layer of the mobile equipment can interact with the video stream acquisition layer; the network layer of the mobile equipment can interact with the network layer of the display equipment; the protocol layer of the mobile equipment can interact with the protocol layer of the display equipment; the application layer of the display equipment can interact with the network layer and the protocol layer of the display equipment; the protocol layer of the display equipment can interact with the playing layer; the play layer of the display device is capable of interacting with the application layer of the display device.

The multi-cast method in the present disclosure can be implemented by the process in fig. 4B.

It should be noted that: the TCP connection is one of the first connections and the UDP connection is one of the second connections.

For more detailed description of the multiple screen projection scheme in the present disclosure, the following will be described with reference to fig. 5 by way of example, and it is understood that the steps involved in fig. 5 may include more steps or fewer steps in actual implementation, and the order between the steps may also be different, so as to enable the multiple screen projection method provided in the embodiment of the present disclosure, which is not limited in the embodiment of the present disclosure.

Fig. 5 is a schematic flowchart of a multi-way screen projection method according to an embodiment of the present disclosure. The embodiment can be applied to the situation that a plurality of mobile devices project screens to the display device. As shown in fig. 5, the multi-way screen projection method specifically includes the following steps:

s510, detecting that a plurality of mobile devices establish point-to-point connection with a display device, and respectively sending IP addresses to the mobile devices, wherein the mobile devices correspond to the IP addresses one to one.

The mobile device may be a terminal device supporting the Miracast screen-casting protocol, such as a mobile terminal device of a smart phone, a tablet computer, an e-book reader, a portable computer, and the like. Miracast is a Wireless display standard based on Wireless Fidelity Direct (Wi-Fi Direct), and mobile devices supporting this standard can share data streams, such as videos, files, games, and the like, in a Wireless manner. The display device may be a television, or a large-screen display device having a display function, such as a monitor or a projector. The plurality of mobile devices is at least two display devices. P2P is a point-to-point technology, also known as peer-to-peer internetworking technology, that relies on the computing power and bandwidth of the participants in the network, rather than aggregating the dependencies on a few servers, P2P networks are typically used to connect nodes via point-to-point (Ad Hoc) connections.

Specifically, the controller of the display device sends out P2P monitoring, and the scanning probe frame can detect whether there is a mobile device currently establishing a point-to-point connection with the display device, that is: P2P connection; or the controller may detect whether a P2P connection is currently established between the mobile device and the display device through the detector, and the specific detection method is not limited in this embodiment. After detecting that a plurality of mobile devices establish point-to-point connection with the display device, the controller needs to allocate an IP address to each mobile device and send a corresponding IP address to each mobile device.

S520, aiming at each mobile device, establishing a first connection between the mobile device and the display device based on the IP address corresponding to the mobile device, and establishing a second connection between the display device and the mobile device after the display device and the mobile device negotiate through the first connection.

The first connection may be a TCP connection or other connections, and the second connection may be a UDP connection or other connections, which is not limited in this embodiment.

Specifically, after the controller sends the IP address to each mobile device, for each of the mobile devices, according to a Time sequence of point-to-point connection between the mobile devices and the display device, the controller sequentially uses each mobile device as a current mobile device, based on the IP address corresponding to the current mobile device, can establish a first connection between the current mobile device and the display device, after establishing the first connection, the display device and the current mobile device can establish a second connection between the current mobile device and the display device based on the IP address corresponding to the current mobile device, so as to subsequently receive the data stream sent by each mobile device through the second connection, through the first connection, after negotiating relevant parameters of the data stream, such as a data stream transmission mode, a video frame rate, and a resolution, based on a Real Time Streaming Protocol (RTSP).

It should be noted that: the second connection can transmit more data streams relative to the first connection, and is not easy to cause blockage and high in efficiency.

And S530, receiving the data stream sent by each mobile device through the second connection, and controlling a display of the display device to display the data stream.

Specifically, after the second connection between the display device and each mobile device is established, each mobile device can send a data stream to the display device through the second connection, the corresponding display device can receive the data stream sent by each mobile device, that is, the content to be displayed in the display device by each mobile device, and after receiving the data stream, the controller controls the display of the display device to display the data stream. The display may display the data stream according to a number of split screens of the mobile device when displaying the data stream.

For example, if there are two mobile devices, the display receives two data streams, and the two data streams may be displayed in a left-right split screen manner or in an up-down split screen manner, which may be determined according to actual situations.

In this embodiment, above-mentioned in-process realizes that a plurality of mobile devices and display device throw the screen and be connected and data stream transmission based on the agreement, and the user need not to install corresponding application at the mobile device, and the commonality is stronger, application scope is wider, can promote user's use and experience, simultaneously because data stream also is suitable for agreement transmission, consequently can not have the problem of sound painting asynchronization.

Fig. 6A is a schematic flowchart of another multi-way screen projection method according to an embodiment of the disclosure. The embodiment is optimized on the basis of the embodiment. Optionally, the embodiment may be applicable to explaining an implementation process of performing screen projection on two mobile devices. As shown in fig. 6A, the multi-way screen projection method specifically includes the following steps:

s610, detecting that a plurality of mobile devices establish point-to-point connection with a display device, and respectively sending IP addresses to the mobile devices, wherein the mobile devices correspond to the IP addresses one to one.

S620, storing the IP address and the MAC address corresponding to each mobile device.

The Media Access Control (MAC) address is an address of the mobile device itself for confirming its location.

After the controller sends the corresponding IP address to each mobile device, the controller needs to acquire the MAC address corresponding to each mobile device, and store the IP address and the MAC address corresponding to each mobile device, so as to facilitate subsequent determination of a second IP address corresponding to a second mobile device.

Specifically, since the time when the first mobile device establishes the peer-to-peer connection with the display device is earlier than the time when the second mobile device establishes the peer-to-peer connection with the display device, after the corresponding controller detects that the first mobile device establishes the peer-to-peer connection with the display device and sends the IP address to the first mobile device, the controller only stores the IP address and the MAC address corresponding to the first mobile device at this time. After the controller detects that the second mobile device establishes the peer-to-peer connection with the display device and sends the IP address to the second mobile device, the controller stores the IP address and the MAC address corresponding to the second mobile device, that is: the controller simultaneously stores the IP addresses and the MAC addresses corresponding to the first mobile equipment and the second mobile equipment.

S630, according to the first IP address corresponding to the first mobile device, a first connection between the display device and the first mobile device is established, and after the display device and the first mobile device negotiate through the first connection, a second connection between the display device and the first mobile device is established.

Specifically, in this embodiment, a description is given of a two-way screen projection process by taking a plurality of mobile devices as two mobile devices as an example.

The plurality of mobile devices comprise a first mobile device and a second mobile device, and the time when the first mobile device establishes the point-to-point connection with the display device is earlier than the time when the second mobile device establishes the point-to-point connection with the display device.

The time for establishing the point-to-point connection between the first mobile equipment and the display equipment is earlier than the time for establishing the point-to-point connection between the second mobile equipment and the display equipment, and the corresponding controller only stores the IP address and the MAC address corresponding to the first mobile equipment after detecting that the point-to-point connection is established between the first mobile equipment and the display equipment and sending the IP address to the first mobile equipment.

And S640, determining a second IP address corresponding to the second mobile equipment according to the corresponding relation between the mobile equipment and the MAC address.

The controller detects that the second mobile device establishes point-to-point connection with the display device and sends an IP address to the second mobile device, and at the moment, the controller simultaneously stores the IP address and the MAC address corresponding to the first mobile device and the second mobile device, so that at the moment, the MAC address corresponding to the second mobile device needs to be determined through the corresponding relation between the mobile device and the MAC address, and the second IP address corresponding to the second mobile device is determined according to the MAC address corresponding to the second mobile device.

S650, according to the second IP address, a first connection between the display device and the second mobile device is established, and after the display device and the second mobile device negotiate through the first connection, a second connection between the display device and the second mobile device is established.

After the controller determines a second IP address corresponding to the second mobile device, according to the second IP address, the first connection between the display device and the second mobile device can be directly established, and after the display device and the second mobile device negotiate through the first connection, the second connection between the display device and the second mobile device can be established.

And S660, receiving the data stream sent by each mobile device through the second connection, and controlling a display of the display device to display the data stream.

The controller is capable of receiving the data stream transmitted by the first mobile device through the second connection after establishing the second connection between the display device and the first mobile device, and is capable of receiving the data stream transmitted by the second mobile device through the second connection after establishing the second connection between the display device and the second mobile device.

It should be noted that: because the time for establishing the point-to-point connection between each mobile device and the display device usually has a sequence, the display device establishes a first connection between the mobile device and the display device based on the sequence and the IP address corresponding to the mobile device in sequence, and establishes a second connection between the display device and the mobile device after the display device negotiates with the mobile device through the first connection.

In this embodiment, according to the above scheme, for each mobile device, according to the time sequence of establishing the point-to-point connection between each mobile device and the display device, the first connection between the mobile device and the display device is established in sequence based on the IP address corresponding to the mobile device, and after the display device and the mobile device negotiate through the first connection, the second connection between the display device and the mobile device is established.

It should be noted that: if the number of the mobile devices is greater than two, the IP address corresponding to the current mobile device needs to be determined according to the corresponding relationship between the mobile device and the MAC address when the last mobile device establishes the first connection between the current mobile device and the display device based on the IP address corresponding to the current mobile device, in the third, fourth, \8230 \ 8230 \ the last mobile device establishes the point-to-point connection between the mobile device and the display device according to the time sequence of the point-to-point connection between the mobile device and the display device.

For example, fig. 6B is a schematic interface diagram of a display device when two mobile devices perform screen projection according to an embodiment of the present disclosure. As shown in fig. 6B, taking the data streams transmitted by the two mobile devices as an example, the data stream corresponding to the first mobile device is displayed on the left side of the display, and the data stream corresponding to the second mobile device is displayed on the right side of the display.

It should be noted that: fig. 6B is only an exemplary illustration, and the number of mobile devices and the display manner of the data stream are not limited.

In some embodiments, optionally, the determining, according to the correspondence between the mobile device and the MAC address, a second IP address corresponding to the second mobile device may specifically include:

receiving the IP address and the MAC address corresponding to the mobile equipment, which are sent by the system of the display equipment, and deleting the first IP address and the first MAC address corresponding to the first mobile equipment;

determining that the remaining MAC addresses in the MAC addresses are the same as a second MAC address corresponding to the second mobile equipment, and determining an IP address corresponding to the second MAC address as the second IP address corresponding to the second mobile equipment.

The system of the display device may be an Android (Android) system.

Specifically, after the point-to-point connection is established between the second mobile device and the display device, the android system of the display device sends the IP addresses and MAC addresses corresponding to all the mobile devices that have established the point-to-point connection to the display device, so that the controller can receive the IP addresses and MAC addresses corresponding to all the mobile devices that are sent by the android system of the display device, and at this time, in order to determine the second IP address corresponding to the second mobile device, it is necessary to delete the first IP address and the first MAC address corresponding to the first mobile device first, that is: the first IP address and the first MAC address are filtered. The controller then determines whether the remaining MAC addresses of the received MAC addresses are the same as a second MAC address corresponding to the second mobile device (the second MAC address is previously saved by the controller), and if so, determines the IP address corresponding to the second MAC address as a second IP address corresponding to the second mobile device.

In some embodiments, optionally, after the peer-to-peer connection is established between the third or more mobile devices and the display device, since the android system may send the IP addresses and MAC addresses corresponding to all the mobile devices that have currently established the peer-to-peer connection to the display device, at this time, the IP addresses and MAC addresses of the mobile devices that have previously established the second connection need to be filtered, and whether the remaining MAC addresses are consistent with the MAC addresses of the third or more mobile devices themselves is compared, so as to determine the IP addresses of the third or more mobile devices, which facilitates the subsequent establishment of the first connection and the second connection based on the accurate IP addresses.

In this embodiment, by the above method, it can be ensured that the acquired IP address corresponds to the mobile device that is to establish the first connection each time the first connection is established, thereby avoiding confusion and errors when the number of mobile devices is large, improving the accuracy of the established first connection and second connection, and being beneficial to ensuring correct transmission of data streams.

For example, fig. 6C is a schematic diagram illustrating a principle of determining a second IP address corresponding to a second mobile device according to an embodiment of the present disclosure. As shown in fig. 6C, the process of determining the second IP address has already been described in detail in the foregoing embodiment, and is not repeated here to avoid repetition.

Fig. 7A is a schematic flowchart of another multi-way screen projection method according to an embodiment of the disclosure. The present embodiment is optimized based on the above embodiments. Optionally, this embodiment may be applicable to the description of the implementation process of receiving the data stream sent by each mobile device through the second connection and controlling the display to display the data stream. As shown in fig. 7A, the multi-way screen projection method specifically includes the following steps:

s710, detecting that a plurality of mobile devices establish point-to-point connection with the display device, and respectively sending IP addresses to each mobile device, wherein the mobile devices correspond to the IP addresses one to one.

S720, aiming at each mobile device, establishing a first connection between the mobile device and the display device based on the IP address corresponding to the mobile device, and establishing a second connection between the display device and the mobile device after the display device and the mobile device negotiate through the first connection.

And S730, receiving the data stream sent by each mobile device through the second connection, and determining a playing module corresponding to the data stream.

After the controller establishes the second connection between the display device and the mobile device, each mobile device can send the corresponding data stream through the second connection, and accordingly, the controller can receive the data stream sent by each mobile device through the second connection.

And S740, sending the corresponding data stream to a display of the display device through different playing modules, and controlling the display to display the data stream.

The controller sends each data stream to a display of the display device through different playing modules and controls the display to display the data streams in a split screen mode, and therefore multi-path screen projection is achieved.

In the above-mentioned scheme of this embodiment, the data stream that will correspond through different broadcast modules sends the display to display device to control the display and show the data stream, can distinguish the data stream, avoid obscuring, can play a plurality of data streams simultaneously in the display device simultaneously, realized that the multichannel between a plurality of mobile device and the display device throws the screen, the commonality is stronger, application scope is wider, can promote user's use and experience.

In some embodiments, optionally, the determining the play module corresponding to the data stream may specifically include:

receiving a corresponding data stream through a real-time transport protocol based on the second connection corresponding to each mobile device;

Specifically, each mobile device can send a corresponding data stream to the controller according to a Real-time Transport Protocol (RTP) based on the corresponding second connection, and correspondingly, the controller can receive the corresponding data stream through the RTP based on the second connection corresponding to each mobile device. After receiving the data stream, the controller analyzes the data stream to obtain the IP address of the mobile device sending the data stream carried in the data stream, then queries the corresponding relationship between the IP address and the playing module pre-stored in the display device, and can determine the playing module corresponding to the IP address.

In this embodiment, by determining the playing module corresponding to the data stream by the above method, an error in the data stream transmission process can be avoided, so that a display error in the display process is caused, and the experience and satisfaction of a user are affected.

For example, fig. 7B is a schematic diagram illustrating a principle of determining a playing module according to an embodiment of the disclosure. As shown in fig. 7B, the determining process of the playing module has already been described in detail in the foregoing embodiment, and is not repeated here to avoid repetition.

In some embodiments, optionally, before detecting that the multiple mobile devices establish the peer-to-peer connection with the display device, the method may further include:

Specifically, after the display device is started or in response to an initialization operation of a user, the controller may initialize the peer-to-peer connection module, for example, the record of establishing the peer-to-peer connection in the last use process is cleared or other operations are performed, and the display device is determined as a central node of the screen projection connection (also referred to as a group owner or a group server), and the corresponding other mobile devices that are about to establish the peer-to-peer connection with the display device are websites (also referred to as group clients). The user can make a plurality of mobile devices send point-to-point connection establishment requests aiming at the central node by operating the mobile devices, so that the controller can sequentially respond to the point-to-point connection establishment requests sent by the mobile devices according to the sending sequence of the point-to-point connection establishment requests, and finally establish point-to-point connections between the plurality of mobile devices and the display device.

In this embodiment, by the method, the display device is determined as the central node of the screen-casting connection, so as to subsequently receive the peer-to-peer connection establishment request, thereby establishing a peer-to-peer connection between the display device and the mobile device, which is convenient for subsequently sending an IP address to each mobile device, establishing a first connection, a second connection, and receiving a data stream.

For example, fig. 7C is a schematic diagram illustrating a principle of establishing a point-to-point connection according to an embodiment of the disclosure. As shown in fig. 7C, the establishment procedure of the point-to-point connection has been described in detail in the foregoing embodiment, and is not described herein again to avoid repetition.

In some embodiments, optionally, the method may further specifically include:

Wherein, the target operation may be: the user closes the wireless screen, closes the network, clicks the disconnection in the dialog box of the wireless screen, and disconnects the display device, etc. in the mobile device, this embodiment is not limited. The target mobile device is a mobile device that wants to disconnect the screen-casting connection.

Specifically, the controller responds to the target operation of the user on the target mobile device in the plurality of mobile devices, and disconnects the point-to-point connection between the target mobile device and the display device, and accordingly disconnects the first connection and the second connection between the target mobile device and the display device.

In this embodiment, by the method, the screen-casting connection between the target mobile device and the display device can be quickly disconnected, and the screen-casting connections of the other mobile devices are not affected.

In some embodiments, optionally, the method may further specifically include:

and after the point-to-point connection between the target mobile equipment and the display equipment is disconnected, adjusting the display mode of the data stream according to the number of the remaining display equipment.

In this embodiment, after the point-to-point connection between the target mobile device and the display device is disconnected, the controller adjusts the display mode of the data stream according to the number of the remaining display devices, and can update the display mode of the data stream of the remaining mobile devices, so that the user has a better viewing effect.

For example, fig. 7D is an architecture diagram of a screen shot off according to an embodiment of the disclosure. As shown in fig. 7D, the mobile device side includes: mobile device 1, mobile device 2, \8230;, the display device end is the display device. When a user performs screen-off and screen-projection operation on a target mobile device in a plurality of mobile devices, an application layer of the target mobile device at a mobile device end is used for: disconnecting the screen projection connection of the target mobile equipment; the network layer of the target mobile device is to: disconnecting the P2P connection; the protocol layers of the target mobile device are to: disconnecting the TCP connection and the UDP connection; the video stream acquisition layer of the target mobile device is configured to: stopping recording the screen; the application layer of the display device is used for: receiving a message of disconnecting screen-casting connection, acquiring an IP address of a target mobile device of the disconnected connection, sending the message of disconnecting TCP connection to a protocol layer, closing a playing interface corresponding to the IP address, and readjusting the screen splitting condition; the network layer of the display device is to: initiating a process that the display equipment disconnects the P2P connection; the protocol layers of the display device are used to: disconnecting the TCP connection, the UDP connection and the corresponding playing module according to the IP address of the target mobile equipment; the play layer of the display device is used for: stopping the decoding of the playing module and ending the relevant flow.

Through the process, the screen projection connection can be disconnected, and the screen projection of other mobile devices is not influenced.

Fig. 7E is a schematic flowchart of a process of performing screen projection on two mobile devices according to an embodiment of the present disclosure. Fig. 7E illustrates a multi-cast process using two mobile devices as an example. In fig. 7E, when receiving the data stream sent by the second device, it needs to determine whether the IP address in the data stream sent by the second device is the second IP address, if yes, the data stream sent by the second device is received and sent to the second playing module, and if not, it indicates that the IP address is the first IP address, and the data stream needs to be sent to the first playing module. And in the process of determining whether the remaining MAC addresses are the same as the second MAC address, if not, ending screen projection of the second mobile equipment. The rest of the processes have already been described in detail in the above embodiments, and are not repeated here to avoid repetition.

It should be noted that: the first playing module is a playing module corresponding to the first IP address, and the second playing module is a playing module corresponding to the second IP address. When the number of the mobile devices is greater than two, the steps in the figure may be adaptively adjusted to implement multi-way screen projection, which is not limited in this embodiment.

To sum up, according to the multi-channel screen projection method executed on the display device, a controller of the display device first detects that a plurality of mobile devices establish a point-to-point connection with the display device, respectively sends Internet Protocol (IP) addresses to each mobile device, the mobile devices and the IP addresses correspond to each other one by one, then establishes a first connection between the mobile devices and the display device for each mobile device based on the IP addresses corresponding to the mobile devices, establishes a second connection between the display device and the mobile device after the display device and the mobile device negotiate through the first connection, and finally receives a data stream sent by each mobile device through the second connection, and controls the display to display the data stream.

The embodiments of the present disclosure provide a computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the computer program implements each process executed by the foregoing multi-channel screen projection method, and can achieve the same technical effect, and in order to avoid repetition, the computer program is not described herein again.

The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.

The present disclosure provides a computer program product comprising: when the computer program product runs on a computer, the computer is enabled to realize the multi-cast screen method.

The foregoing description, for purpose of explanation, has been described with reference to specific embodiments. However, the foregoing discussion in some embodiments is not intended to be exhaustive or to limit the implementations to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A display device, comprising:

a display;

2. The display device of claim 1, wherein the plurality of mobile devices comprises a first mobile device and a second mobile device, and wherein the first mobile device establishes the peer-to-peer connection with the display device at an earlier time than the second mobile device establishes the peer-to-peer connection with the display device;

the controller further configured to:

the controller is specifically configured to:

establishing a first connection between the display device and the first mobile device according to a first IP address corresponding to the first mobile device, and establishing a second connection between the display device and the first mobile device after the display device and the first mobile device negotiate through the first connection;

determining a second IP address corresponding to the second mobile equipment according to the corresponding relation between the mobile equipment and the MAC address;

and establishing a first connection between the display device and the second mobile device according to the second IP address, and establishing a second connection between the display device and the second mobile device after the display device and the second mobile device negotiate through the first connection.

3. The display device according to claim 2, wherein the controller is specifically configured to:

4. The display device of claim 1, wherein the controller is specifically configured to:

and sending the corresponding data stream to the display through different playing modules, and controlling the display to display the data stream.

5. The display device of claim 4, wherein the controller is specifically configured to:

6. The display device of claim 1, wherein the controller is further configured to:

7. The display device according to any of claims 1-6, wherein the controller is specifically configured to:

8. A multi-screen projection method is characterized by comprising the following steps:

9. The method of claim 8, wherein the plurality of mobile devices comprises a first mobile device and a second mobile device, and wherein the first mobile device establishes the peer-to-peer connection with the display device at a time earlier than a time when the second mobile device establishes the peer-to-peer connection with the display device;

the method further comprises the following steps:

the establishing, for each mobile device, a first connection between the mobile device and the display device based on an IP address corresponding to the mobile device, and after the display device and the mobile device negotiate through the first connection, establishing a second connection between the display device and the mobile device includes:

10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method as claimed in claim 8.