CN117061811A

CN117061811A - Display equipment and screen throwing method thereof

Info

Publication number: CN117061811A
Application number: CN202311021383.6A
Authority: CN
Inventors: 马会会; 贾亚洲; 刘健
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2023-08-14
Filing date: 2023-08-14
Publication date: 2023-11-14

Abstract

The embodiment of the application relates to the technical field of display, and discloses display equipment and a screen projection method thereof, wherein the display equipment comprises the following components: a display; a first wireless communication module; a second wireless communication module; a controller configured to: responding to a first operation, and starting a first network node corresponding to a first communication mode, wherein the first network node is a wireless access point; acquiring first information in response to a second operation; enabling a second network node corresponding to the second communication mode under the condition that the first information indicates the display equipment to simultaneously support the first communication mode and the second communication mode, wherein the second network node is a node in the point-to-point network; and under the condition that the first screen throwing data are received through the first network node and the second screen throwing data are received through the second network node, controlling the display to display the first screen throwing data and the second screen throwing data in a split screen mode. By applying the technical scheme of the application, the simultaneous use of hot spot screen throwing and point-to-point screen transmission can be realized.

Description

Display equipment and screen throwing method thereof

Technical Field

The embodiment of the application relates to the technical field of display, in particular to display equipment and a screen projection method thereof.

Background

Currently, a smart television can realize a wireless screen transfer function through a wireless communication (Wireless Fidelity, wiFi) chip carried by the smart television, so that a user can easily share multimedia content (such as video, music, photos or documents and the like) on other electronic devices (such as a smart phone, a tablet computer or a computer and the like) on a screen of the smart television, so as to realize better viewing experience.

Generally, two wireless screen transmission modes supported by smart televisions are mainly used. One wireless screen transmission mode is hot spot screen transmission. Specifically, the smart television can create a hot spot through the WiFi chip carried by the smart television, so that other electronic devices can be connected to the hot spot, and a user can share multimedia content on the other electronic devices to the smart television for display. Another wireless screen transmission method is point-to-point (P2P) screen transmission (e.g., miracast screen transmission). Specifically, the smart television can establish a point-to-point network with other electronic devices through the WiFi chip mounted on the smart television, and a user can share multimedia contents on the other electronic devices to the smart television for display based on the point-to-point network.

However, since most of the existing smart televisions are mounted with a single WiFi chip, the smart televisions can only support one of the functions of selectively turning on a hot spot and a peer-to-peer network (i.e., P2P), i.e., the smart televisions cannot support the hot spot screen transfer and the P2P screen transfer to be used simultaneously.

Disclosure of Invention

In view of the above problems, embodiments of the present application provide a display device and a screen-projection method thereof, which are used for solving the problem that in the prior art, the display device cannot simultaneously use hot spot screen-projection and point-to-point screen-transfer.

According to a first aspect of an embodiment of the present application, there is provided a display apparatus including: a display configured to display the screen casting data; a first wireless communication module configured to establish a communication connection with an electronic device through a first communication mode; a second wireless communication module configured to establish a communication connection with the electronic device through a second communication mode; a controller coupled to the display, the first wireless communication module, the second wireless communication module, respectively, and configured to: responding to a first operation, starting a first network node corresponding to a first communication mode, wherein the first communication mode is an access point mode, and the first network node is a wireless access point; acquiring first information in response to a second operation; enabling a second network node corresponding to a second communication mode under the condition that the first information indicates the display equipment to simultaneously support the first communication mode and the second communication mode, wherein the second communication mode is a point-to-point network mode, and the second network node is a node in a point-to-point network; and under the condition that the first screen throwing data are received through the first network node and the second screen throwing data are received through the second network node, controlling the display to display the first screen throwing data and the second screen throwing data in a split screen mode.

In an alternative, the controller is configured to: when the display equipment is started, loading a driving program corresponding to the first wireless communication module, and creating a first network node through the first wireless communication module; loading a driving program corresponding to the second wireless communication module, and creating a second network node through the second wireless communication module; the identification information corresponding to the first network node and the identification information corresponding to the second network node both accord with the first identification rule.

In an alternative, the controller is further configured to: creating a third network node and a fourth network node through the first wireless communication module; the third network node is a wireless local area network node, the fourth network node is a node in a point-to-point network, the identification information corresponding to the third network node and the identification information corresponding to the fourth network node both accord with a second identification rule, and the second identification rule is different from the first identification rule.

In an alternative, the controller is further configured to: creating a fifth network node and a sixth network node through the first wireless communication module; the fifth network node is a wireless local area network node, and the identification information corresponding to the fifth network node accords with the first identification rule; the sixth network node is a wireless access point, and the priority of the sixth network node is lower than that of the second network node.

In an alternative, the controller is further configured to: receiving a first screen connection request sent by first electronic equipment; responding to a first screen connection request, and establishing communication connection with first electronic equipment through a first network node; and establishing communication connection with the first electronic equipment based on the first network node, and receiving first screen projection data sent by the first electronic equipment.

In an alternative, the controller is further configured to: receiving a second screen-throwing connection request sent by second electronic equipment; responding to a second screen-throwing connection request, and establishing communication connection with second electronic equipment through a second network node; and establishing communication connection with the second electronic equipment based on the second network node, and receiving second screen projection data sent by the second electronic equipment.

In an alternative, the controller is further configured to: and sending out prompt information under the condition that the first network node is in an enabled state and the first information indicates that the display equipment cannot support the first communication mode and the second communication mode at the same time, wherein the prompt information is used for prompting a user to close the first network node.

In an alternative manner, the first wireless communication module is a WiFi chip, and the second wireless communication module is a WiFi chip.

According to a second aspect of the embodiment of the present application, there is provided a screen projection method, which is applied to the display device according to the first aspect of the embodiment of the present application, and the method includes: responding to a first operation, starting a first network node corresponding to a first communication mode, wherein the first communication mode is an access point mode, and the first network node is a wireless access point; acquiring first information in response to a second operation; enabling a second network node corresponding to a second communication mode under the condition that the first information indicates the display equipment to simultaneously support the first communication mode and the second communication mode, wherein the second communication mode is a point-to-point network mode, and the second network node is a node in a point-to-point network; and under the condition that the first screen throwing data are received through the first network node and the second screen throwing data are received through the second network node, the first screen throwing data and the second screen throwing data are displayed in a split screen mode.

In an alternative manner, the display device includes a first wireless communication module and a second wireless communication module, and before enabling the first network node corresponding to the first communication mode in response to the first operation, the method further includes: when the display equipment is started, loading a driving program corresponding to the first wireless communication module, and creating a first network node through the first wireless communication module; loading a driving program corresponding to the second wireless communication module, and creating a second network node through the second wireless communication module; the identification information corresponding to the first network node and the identification information corresponding to the second network node both accord with the first identification rule.

In an alternative, the method further comprises: creating a third network node and a fourth network node through the first wireless communication module; the third network node is a wireless local area network node, the fourth network node is a node in a point-to-point network, the identification information corresponding to the third network node and the identification information corresponding to the fourth network node both accord with a second identification rule, and the second identification rule is different from the first identification rule.

In an alternative, the method further comprises: creating a fifth network node and a sixth network node through the first wireless communication module; the fifth network node is a wireless local area network node, and the identification information corresponding to the fifth network node accords with the first identification rule; the sixth network node is a wireless access point, and the priority of the sixth network node is lower than that of the second network node.

In an alternative manner, before displaying the first screen-shot data and the second screen-shot data in a split-screen manner, the method further includes: receiving a first screen connection request sent by first electronic equipment; responding to a first screen connection request, and establishing communication connection with first electronic equipment through a first network node; and establishing communication connection with the first electronic equipment based on the first network node, and receiving first screen projection data sent by the first electronic equipment.

In an alternative manner, before displaying the first screen-shot data and the second screen-shot data in a split-screen manner, the method further includes: receiving a second screen-throwing connection request sent by second electronic equipment; responding to a second screen-throwing connection request, and establishing communication connection with second electronic equipment through a second network node; and establishing communication connection with the second electronic equipment based on the second network node, and receiving second screen projection data sent by the second electronic equipment.

In an alternative way, after acquiring the first information in response to the second operation, the method further comprises: and sending out prompt information under the condition that the first network node is in an enabled state and the first information indicates that the display equipment cannot support the first communication mode and the second communication mode at the same time, wherein the prompt information is used for prompting a user to close the first network node.

According to a third aspect of an embodiment of the present application, there is provided a screen projection device, including: the first control module is used for responding to a first operation, starting a first network node corresponding to a first communication mode, wherein the first communication mode is an access point mode, and the first network node is a wireless access point; the acquisition module is used for responding to the second operation and acquiring the first information; the second control module is used for starting a second network node corresponding to a second communication mode under the condition that the first information indicates the display equipment to simultaneously support the first communication mode and the second communication mode, wherein the second communication mode is a point-to-point network mode, and the second network node is a node in a point-to-point network; the display module is used for displaying the first screen throwing data and the second screen throwing data in a split-screen mode under the condition that the first screen throwing data are received through the first network node and the second screen throwing data are received through the second network node.

According to a fourth aspect of embodiments of the present application, there is provided a computer readable storage medium having stored therein at least one executable instruction that, when executed on a display device, causes the display device to perform the operations of the above-described screen projection method.

In the embodiment of the application, the display device is provided with a first wireless communication module and a second wireless communication module, wherein the first wireless communication module can be used for hot spot connection, and the second wireless communication module can be used for point-to-point screen transmission. Based on this, in response to the first operation, the display device may enable the first network node corresponding to the first communication mode, which may enable the first electronic device to initiate a hotspot screen to the display device through the first network node. In response to the second operation, the display device can acquire first information, judge whether the display device supports the first communication mode and the second communication mode at the same time according to the first information, and enable the second network node corresponding to the second communication mode when the first information indicates that the display device supports the first communication mode and the second communication mode at the same time, so that when the first electronic device initiates a hot spot screen to the display device through the first network node, the second electronic device can initiate a point-to-point screen to the display device through the second network node, and therefore simultaneous use of the hot spot screen and the point-to-point screen can be achieved, a user can simultaneously watch screen data from two different electronic devices on the display device, and further richer watching experience is provided for the user.

Moreover, when the user starts the peer-to-peer network function of the display device, the frame layer and the driving layer of the display device judge whether the display device supports the first communication mode and the second communication mode at the same time, so that the second network node can be started under the condition that the display device supports the first communication mode and the second communication mode at the same time, and the electronic device can conduct peer-to-peer screen transmission to the display device through the second network node. That is, the embodiment of the application does not need to modify the original system of the display device, so that the display device can simultaneously start the hot spot function and the point-to-point screen transfer function, and the normal operation of the display device is not affected.

The foregoing description is only an overview of the technical solutions of the embodiments of the present application, and may be implemented according to the content of the specification, so that the technical means of the embodiments of the present application can be more clearly understood, and the following specific embodiments of the present application are given for clarity and understanding.

Drawings

The drawings are only for purposes of illustrating embodiments and are not to be construed as limiting the application. Also, like reference numerals are used to designate like parts throughout the figures. In the drawings:

Fig. 1 shows an interaction schematic diagram of a display device and a control device according to an embodiment of the present application;

fig. 2 shows a block diagram of a configuration of a control device in an embodiment of the present application;

fig. 3 is a block diagram showing a hardware configuration of a display device according to an embodiment of the present application;

fig. 4 shows a software configuration schematic diagram of a display device according to an embodiment of the present application;

fig. 5 shows one of flow diagrams of a screen projection method according to an embodiment of the present application;

fig. 6 shows one of display interface diagrams of a display device according to an embodiment of the present application;

fig. 7 shows a second display interface schematic diagram of a display device according to an embodiment of the present application;

FIG. 8 is a second schematic flow chart of a screen projection method according to an embodiment of the present application;

FIG. 9 is a third schematic diagram of a display interface of a display device according to an embodiment of the present application;

FIG. 10 is a third schematic flow chart of a screen projection method according to an embodiment of the present application;

FIG. 11 shows a fourth flowchart of a screen projection method according to an embodiment of the present application;

FIG. 12 is a fifth schematic flow chart of a screen projection method according to an embodiment of the present application;

fig. 13 shows a schematic structural diagram of a screen projection device according to an embodiment of the present application.

Detailed Description

Exemplary embodiments of the present application will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present application are shown in the drawings, it should be understood that the present application may be embodied in various forms and should not be limited to the embodiments set forth herein.

However, since the existing smart tv mostly mounts a single WiFi chip, this results in that the smart tv can only support one of the option-on hotspot function and the peer-to-peer network (i.e., P2P) function. In practical implementation, under the condition that the hot spot function of the intelligent television is started, a user cannot start the P2P function of the intelligent television. If the user needs to start the P2P function of the intelligent television, the hot spot function of the intelligent television needs to be closed first, and then the P2P function of the intelligent television can be started. Under the condition that the P2P function of the intelligent television is started, if a user starts the hot spot function of the intelligent television, the intelligent television can close the P2P function first and then start the hot spot function of the intelligent television.

In addition, with the continuous development of the smart television technology, the smart television can be provided with double WiFi chips. However, since the existing smart televisions mostly carry an android system, and the architecture of the android system is designed based on a single WiFi chip, that is, the android system does not support a hot spot function and a peer-to-peer network (i.e., P2P) function to be turned on simultaneously, the smart televisions carrying dual WiFi chips can only support one of the hot spot function and the peer-to-peer network (i.e., P2P) function to be selectively turned on. That is, the existing smart tv cannot support simultaneous use of hot spot screen transfer and P2P screen transfer.

For this reason, in some embodiments, by modifying the dnsmasq configuration file of the android system, the hotspot supporting function and the peer-to-peer network (i.e., P2P) function of the android system may be turned on simultaneously, i.e., the smart tv may be used while supporting hotspot screen transfer and P2P screen transfer. However, this approach easily leads to errors in the operation of the intelligent television.

In view of one or more of the above problems, embodiments of the present application provide a display device and a screen projection method thereof, which may be applied to the display device. Fig. 1 shows an interaction schematic diagram of a display device and a control apparatus according to an embodiment of the present application. As shown in fig. 1, a user may operate the display device 200 through the smart device 300 or the control apparatus 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the remote controller and the display device 200 may communicate through an infrared protocol, a bluetooth protocol, or the remote controller may control the display device 200 in a wireless or other wired manner. The user may input user instructions through keys on a remote controller, voice input, a control panel, etc., to control the display device 200. For example, the user can control the display device 200 to switch the displayed page by means of navigation keys (up key, down key, left key, right key) on the remote controller. Also, for example, the degree of zoom of the display device 200 to display the page is adjusted by the volume up-down key. Also for example, the user may launch a target application (e.g., a wireless screen-transfer application) via a navigation key on the remote control.

In some embodiments, a user may also control the display device 200 using a smart device 300 (e.g., a mobile terminal, tablet, computer, notebook, etc. other smart devices). For example, a user may control the display device 200 through an application installed on the smart device 300 that, by configuration, may provide the user with various controls in an intuitive user interface on a screen associated with the smart device 300. Also for example, the display device 200 is controlled using an application running on the smart device 300.

In some embodiments, the smart device 300 may implement connection communication with a software application installed on the display device 200 through a network communication protocol for the purpose of one-to-one control operation and data communication. For example, it may be implemented to establish a control instruction protocol with the smart device 300 and the display device 200, synchronize a remote control keyboard to the smart device 300, control a function of the display device 200 by controlling a user interface on the smart device 300, or may also transmit content displayed on the smart device 300 to the display device 200, so as to implement a function of synchronous display.

In some embodiments, the display device 200 may also perform control in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received through a module configured inside the display device 200 device for acquiring voice commands, or the voice command control of the user may be received through a voice control device configured outside the display device 200 device.

As shown in fig. 1, the display device 200 and the server 400 may communicate data in a variety of communication manners, which may allow the display device 200 to be communicatively connected via a local area network (Local Area Network, LAN), a wireless local area network (Wireless Local Area Network, WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. For example, the display device 200 receives software program updates by sending and receiving messages, and electronic program guide (Electrical Program Guide, EPG) interactions, or accesses a remotely stored digital media library. The server 400 may be one cluster or multiple clusters, and may include one or more types of servers.

The display device 200 may be a liquid crystal display, an Organic Light-Emitting Diode (OLED) display, a projection display device, a smart terminal, such as a mobile phone, a tablet computer, etc. The specific display device type, size, resolution, etc. are not limited.

Fig. 2 shows a block diagram of a configuration of the control device 100 in an exemplary embodiment of the present application, and as shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an operation instruction input by a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, and may interact with the display device 200.

Taking a display device as an example of a television, fig. 3 shows a hardware configuration block diagram of a display device 200 according to an embodiment of the present application. As shown in fig. 3, the display device 200 includes: a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a receiver 280 and at least one of a memory, a power supply, a user interface.

The modem 210 may receive broadcast television signals through a wired or wireless reception manner and demodulate an audio/video signal, such as an EPG data signal, from a plurality of wireless or wired broadcast television signals. The detector 230 may be used to collect signals of the external environment or interaction with the outside.

In some embodiments, the frequency point demodulated by the modem 210 is controlled by the controller 250, and the controller 250 may issue a control signal according to the user selection, so that the modem responds to the television signal frequency selected by the user and modulates and demodulates the television signal carried by the frequency.

The broadcast television signal may be classified into a terrestrial broadcast signal, a cable broadcast signal, a satellite broadcast signal, an internet broadcast signal, or the like according to different broadcasting systems of the television signal. Or may be differentiated into digital modulation signals, analog modulation signals, etc., depending on the type of modulation. And further, the signals are classified into digital signals, analog signals and the like according to different signal types.

In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like.

In some embodiments, communicator 220 may be a component for communicating with external devices or external servers according to various communication protocol types. For example: the communicator may include at least one of a WiFi chip, a bluetooth communication protocol chip, a wired ethernet communication protocol chip, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. For example, the communicator 220 may include two WiFi chips, a first WiFi chip (i.e., a first wireless communication module) and a second WiFi chip (i.e., a second wireless communication module), respectively. In one aspect, the display device 200 may create an access point through the first WiFi chip (i.e., the first wireless communication module), and establish wireless communication connection with other electronic devices as a site, so as to implement a hotspot screen-transmitting function. On the other hand, the display device 200 may establish a point-to-point network connection with other electronic devices through the second WiFi chip (i.e. the second wireless communication module), so as to implement a point-to-point screen transmission function.

In some embodiments, the detector 230 may be used to collect signals of or interact with the external environment, may include an optical receiver and a temperature sensor, etc.

The light receiver can be used for acquiring a sensor of the intensity of the ambient light, and adaptively adjusting display parameters and the like according to the intensity of the ambient light; the temperature sensor may be used to sense an ambient temperature so that the display device 200 may adaptively adjust a display color temperature of an image, such as when the ambient temperature is high, a color temperature colder tone of the image displayed by the display device 200 may be adjusted, or when the ambient temperature is low, a color temperature warmer tone of the image displayed by the display device 200 may be adjusted.

In some embodiments, the detector 230 may further include an image collector, such as a camera, a video camera, etc., which may be used to collect external environmental scenes, collect attributes of a user or interact with a user, adaptively change display parameters, and recognize a user gesture to realize an interaction function with the user.

In some embodiments, the detector 230 may also include a sound collector or the like, such as a microphone, that may be used to receive the user's sound. For example, a voice signal including a control instruction for a user to control the display apparatus 200, or an acquisition environment sound for recognizing an environment scene type, so that the display apparatus 200 can adapt to an environment noise.

In some embodiments, external device interface 240 may include, but is not limited to, the following: any one or more of a high-definition multimedia interface (High Definition Multimedia Interface, HDMI) interface, an analog or data high-definition component input interface, a composite video input interface, a universal serial bus (Universal Serial Bus, USB) input interface, an RGB port, or the like, or an input/output interface in which the above interfaces form a composite is also possible.

As shown in fig. 3, the controller 250 may include a central processing unit (Central Processing Unit, CPU), a video processor, an audio processor, a graphic processor (Graphics Processing Unit, GPU), a random access Memory (Random Access Memory, RAM), a Read-Only Memory (ROM), and at least one of first to nth interfaces for input/output. Wherein the communication bus connects the various components.

In some embodiments, the controller 250 may control the operation of the display device and respond to the user's operations through various software control programs stored on an external memory. For example, a user may input a user command through a graphical user interface (Graphic User Interface, GUI) displayed on the display 260, the user input interface receiving the user input command through the graphical user interface, or the user may input the user command by inputting a specific sound or gesture, the user input interface recognizing the sound or gesture through the sensor.

A "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user that enables conversion between an internal form of information and a user-acceptable form. A commonly used presentation form of a user interface is a graphical user interface, which refers to a user interface related to computer operations that is displayed in a graphical manner. The control can comprise at least one of an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget (short for Widget) and other visual interface elements.

In some embodiments, RAM may be used to store temporary data for the operating system or other on-the-fly programs; ROM may be used to store instructions for various system starts, for example, may be used to store instructions for a basic input output system, referred to as a basic input output system (Basic Input Output System, BIOS) start. ROM can be used to complete the power-on self-test of the system, the initialization of each functional module in the system, the driving program of the basic input/output of the system and the booting of the operating system.

In some embodiments, upon receipt of the power-on signal, the display device 200 power begins to boot and the central processor runs the system boot instructions in ROM, copying temporary data of the operating system stored in memory into RAM for booting or running the operating system. When the starting of the operating system is completed, the CPU copies the temporary data of various application programs in the memory into the RAM, and then the temporary data are convenient for starting or running the various application programs.

In some embodiments, the central processor may be configured to execute operating system and application instructions stored in memory, and to execute various applications, data, and content in accordance with various interactive instructions received from external inputs, to ultimately display and play various audio-visual content.

In some example embodiments, the central processor may include a plurality of processors. The plurality of processors may include one main processor and one or more sub-processors. A main processor for performing some operations of the display apparatus 200 in the pre-power-up mode and/or displaying a picture in the normal mode. One or more sub-processors for one operation in a standby mode or the like.

In some embodiments, the video processor may be configured to receive an external video signal, perform video processing in accordance with standard codec protocols for input signals, decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, transparency settings, image composition, etc., and may result in a signal that is displayed or played on the directly displayable device 200.

In some embodiments, the video processor may include a demultiplexing module, a video decoding module, an image compositing module, a frame rate conversion module, a display formatting module, and the like.

The demultiplexing module is used for demultiplexing the input audio/video data stream, such as input moving picture expert group standard 2 (Moving Picture Experts Group-2, MPEG-2), and demultiplexes the input audio/video data stream into video signals, audio signals and the like; the video decoding module is used for processing the demultiplexed video signal, including decoding and scaling, transparency setting, etc.

And an image synthesis module, such as an image synthesizer, for performing superposition mixing processing on the graphic generator and the video image after the scaling processing according to the GUI signal input by the user or generated by the graphic generator, so as to generate an image signal for display. The frame rate conversion module is configured to convert the input video frame rate, for example, converting the 60Hz frame rate into the 120Hz frame rate or the 240Hz frame rate, and the common format is implemented in an inserting frame manner. The display format module is used for converting the received frame rate into a video output signal, and changing the video output signal to a signal conforming to the display format, such as outputting an RGB data signal.

In some embodiments, the audio processor may be configured to receive an external audio signal, decompress and decode the audio signal according to a standard codec protocol of the input signal, and perform noise reduction, digital-to-analog conversion, and amplification processes to obtain a sound signal that may be played in a speaker.

In some embodiments, the video processor may comprise one or more chips. The audio processor may also comprise one or more chips. Meanwhile, the video processor and the audio processor may be a single chip, or may be integrated with the controller in one or more chips.

In some embodiments, the interface for input/output may be used for audio output, that is, receiving the sound signal output by the audio processor under the control of the controller 250 and outputting the sound signal to an external device such as a speaker, and may output the sound signal to an external sound output terminal of the generating device of the external device, except for the speaker carried by the display device 200 itself, for example: external sound interface or earphone interface, etc. The audio output may also include a near field communication module in the communication interface, such as: and the Bluetooth module is used for outputting sound of a loudspeaker connected with the Bluetooth module.

In some embodiments, the graphics processor may be used to generate various graphical objects, such as: icons, operation menus, user input instruction display graphics, and the like. The graphic processor may include an operator to display various objects according to display attributes by receiving user input of various interactive instructions to perform operations. And a renderer for rendering the various objects obtained by the arithmetic unit, wherein the rendered objects are used for being displayed on a display.

In some embodiments, the graphics processor and the video processor may be integrated or may be separately configured, where the integrated configuration may perform processing of graphics signals output to the display, and the separate configuration may perform different functions, such as a graphics processor (Graphics Processing Unit, GPU) +frame frequency conversion technology (Frame Rate Conversion, FRC) architecture, respectively.

The display 260 may be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and may also be a projection device and a projection screen.

In some embodiments, the display 260 may be used to display a display interface of an application. The display interface is any page in the application program.

In some embodiments, the display 260 may be used to receive audio and video signals output by the audio processor and video processor, display video content and images, play audio of the video content, and display components of a menu manipulation interface.

In some embodiments, the display 260 may be used to present a user-operated UI interface generated in the display device 200 and used to control the display device 200.

In some embodiments, the display device 200 may establish control signal and data signal transmission and reception between the communicator 220 and the external control device 100 or the content providing device.

In some embodiments, the memory may include storage of various software modules for driving the display device 200. Such as: various software modules stored in the first memory, including: at least one of a base module, a detection module, a communication module, a display control module, a browser module, various service modules, and the like.

The base module is a bottom software module for communicating signals between the various hardware in the display device 200 and sending processing and control signals to the upper module. The detection module is used for collecting various information from various sensors or user input interfaces and carrying out digital-to-analog conversion and analysis management.

In some embodiments, the user interface may be used to receive control device 100, such as: an infrared control signal transmitted by an infrared remote controller, etc.

The power supply source may supply power to the display device 200 through power input from an external power source under the control of the controller 250.

In some embodiments, the display apparatus 200 may receive a control operation input by a user on the display interface by adding the receiver 280. For example, when the receiver 280 is a touch component, the touch component may together form a touch screen with the display 260. On the touch screen, a user can input different control instructions through touch operation, for example, the user can input touch instructions such as clicking, sliding, long pressing, double clicking and the like, and different touch instructions can represent different control functions.

To implement the different touch actions described above, the touch assembly 280 may generate different electrical signals when the user inputs the different touch actions, and transmit the generated electrical signals to the controller 250. The controller 250 may perform feature extraction on the received electrical signal to determine a control function to be performed by the user based on the extracted features.

In some embodiments, the receiver 280 may also be an external control component coupled to the display 260, such as a desktop computer, and the receiver 280 may be a mouse coupled to the display. The user can input different control instructions such as clicking, sliding, switching and other operation instructions through the mouse.

Accordingly, when the user performs different control operations on the external control unit, the external control unit may generate different control signals in response to the control operations of the user, and transmit the generated control signals to the controller 250. The controller 250 may perform feature extraction on the received control signal to determine a control function to be performed by the user according to the extracted features.

In some embodiments, the receiver 280 may also be a control component coupled to the display 260, such as a desktop computer, for example, and the control component may be a keyboard coupled to the display. The user can input different control instructions such as clicking, sliding, switching and other operation instructions through the keyboard.

Illustratively, the user may input a click command, a slide command, a switch command, etc. through the corresponding shortcut key. For example, the user may trigger the sliding operation by selecting the "Tab" key and the direction key, i.e., when the user selects the "Tab" key and the direction key simultaneously on the keyboard, the controller 250 may receive the key signal, determining that the user triggered the sliding operation. Then, the user can control the position identifier in the display interface to move through the directional key, and at the same time, the controller 250 can judge the sliding direction and the sliding distance of the sliding instruction according to the position change condition of the position identifier triggered by the directional key, and control to turn or scroll the display interface in the media asset display page so as to display more media asset options.

It will be appreciated that different operation instructions may be input through the control component described above, i.e. the user may input click operations, zoom operations, and switch operations through different operation modes, such as inputting different shortcuts.

Fig. 4 shows a software configuration diagram of the display device 200 in the exemplary embodiment of the present application, and as shown in fig. 4, the system is divided into four layers, namely, an application layer (application layer), an application framework layer (Application Framework layer), a kernel layer and a hardware layer from top to bottom.

In some embodiments, at least one application program is running in the application program layer, and these application programs may be a Window (Window) program of an operating system, a system setting program, a clock program, or the like; or may be an application developed by a third party developer. In particular implementations, the application packages in the application layer are not limited to the above examples. By way of example, the application layer may include a wireless screen-passing application (e.g., a Miracast screen-passing application). The display device 200 may respond to the operation of the user to start the wireless screen transmission application program, and establish a peer-to-peer network (i.e., P2P) connection with other electronic devices through the wireless screen transmission application program, so as to receive and display screen casting data sent by the other electronic devices based on the peer-to-peer network (i.e., P2P) connection between the display device and the other electronic devices, i.e., realize P2P screen transmission.

The framework layer provides an application programming interface (application programming interface, API) and programming framework for the application. The application framework layer includes a number of predefined functions. The application framework layer corresponds to a processing center that decides to let the applications in the application layer act. Through the API interface, the application program can access the resources in the system and acquire the services of the system in the execution. Illustratively, the application framework layer includes a system service that may be configured to determine, when the display device turns on the peer-to-peer network function, whether the display device supports the first communication mode (i.e., the access point mode) and the second communication mode (i.e., the peer-to-peer network mode) simultaneously, and in a case where the display device supports the first communication mode (i.e., the access point mode) and the second communication mode (i.e., the peer-to-peer network mode) simultaneously, send a first notification to a kernel layer of the display device, where the first notification is configured to instruct the display device to support the first communication mode (i.e., the access point mode) and the second communication mode (i.e., the peer-to-peer network mode) simultaneously.

In some embodiments, as shown in fig. 4, the hardware layers may include the controller 250 and the display 260 shown in fig. 3, and the like. The hardware layer may also include a communicator that may include a first WiFi chip (i.e., a first communication module) and a first WiFi chip (i.e., a first communication module)

The kernel layer is a layer between hardware and software. Illustratively, the kernel layer contains at least one of the following drivers: audio drive, display drive, bluetooth drive, camera drive, wiFi drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), MIC drive, power drive, etc.

The display driver corresponding to the display can call the interface of the display to acquire the screen throwing data, or call the interface of the display to set the display. The audio driver corresponding to the speaker may call the interface of the speaker to obtain audio data corresponding to the to-be-played screen-projection data, or call the interface of the speaker to set the speaker.

The WiFi driver may include a first WiFi driver corresponding to the first WiFi chip (i.e., the first communication module) and a second WiFi driver corresponding to the second WiFi chip (i.e., the second communication module).

In some embodiments, upon startup of the display device, the display device loads the first WiFi driver such that the first WiFi chip creates the first network node, and the display loads the second WiFi driver such that the second WiFi chip creates the second network node. In the event that the display device receives a first operation (i.e., the user turns on the hotspot function of the display device), a first WiFi drive of the kernel layer of the display device enables the first network node. In the event that the display device receives a second operation (i.e., the user turns on the peer-to-peer function of the display device), the frame layer of the display device determines whether the display device supports both the first communication mode (i.e., the access point mode) and the second communication mode (i.e., the peer-to-peer network mode). In the case where the display device supports both the first communication mode and the second communication mode, the framework layer of the display device sends a first notification to the kernel layer of the display device. After the kernel layer of the display device receives the first notification, the kernel layer of the display device judges whether the WiFi chip carried by the display device can support concurrency of a first communication mode (namely an access point mode) and a second communication mode (namely a point-to-point network mode). And under the condition that the WiFi chip carried by the display equipment supports concurrency of the first communication mode and the second communication mode, enabling the second network node by the second WiFi drive of the kernel layer of the display equipment.

And then, under the condition that the display equipment receives a first screen-throwing connection request sent by the first electronic equipment, the display equipment establishes hot spot connection with the first electronic equipment through the first network node, and based on the hot spot connection between the first electronic equipment and the display equipment, the display equipment can receive first screen-throwing data sent by the first electronic equipment. Under the condition that the display equipment receives a second screen-throwing connection request sent by the second electronic equipment, the display equipment establishes point-to-point network connection with the second electronic equipment through a second network node, and based on the standing point-to-point network connection between the second electronic equipment and the display equipment, the display equipment can receive second screen-throwing data sent by the second electronic equipment. The display device can call the display through the display driver to control the display to display the first screen throwing data and the second screen throwing data in a split-screen mode.

The screen projection method provided by the embodiment of the application is described in detail below with reference to fig. 5. The method in this embodiment may be implemented in a display device having the above-described hardware structure or software structure. The display device may include a display, a first wireless communication module, a second wireless communication module, and a controller coupled to the display, the first wireless communication module, and the second wireless communication module, respectively.

The first wireless communication module (i.e., the first WiFi chip) may establish a communication connection with the electronic device through a first communication mode. The first communication mode may be an access point mode. The display device can establish an access point through the first wireless communication module, and establish wireless communication connection with other electronic devices serving as sites, so that a hot spot screen transfer function is realized. The second wireless communication module (i.e., the second WiFi chip described above) may establish a communication connection with the electronic device through a second communication mode. The second communication mode may be a point-to-point network (i.e., P2P) mode. The display device can establish point-to-point network connection with other electronic devices through the second wireless communication module, and further the point-to-point screen transmission function is achieved. That is, the display device is equipped with a dual WiFi chip, and can support two wireless communication modes of an access point and a peer-to-peer network at the same time, that is, the display device can support a hot spot screen transfer function and a peer-to-peer screen transfer function at the same time.

The screen projection method provided by the embodiment of the application is schematically illustrated below. As shown in fig. 5, the screen projection method may include the following steps 510 to 540.

In step 510, in response to the first operation, a first network node corresponding to a first communication mode is enabled, the first communication mode being an access point mode, and the first network node being a wireless access point.

Wherein the first network node may be a network node created by the first wireless communication module. Illustratively, the first network node creates a wireless access point (i.e., access point, AP) for the first wireless communication module.

The first operation may be used to trigger a first communication mode of turning on the display device, i.e. to trigger enabling a first network node corresponding to the first communication mode. The first operation may be, for example, a triggering operation of a hotspot-initiating control of the display device by the user. The first operation may also be a user power-on operation of the display device, for example.

For example, take the first operation as a triggering operation of a user to a hotspot-initiating control of the display device. And responding to the starting operation of the user on the display equipment, starting the display equipment, and connecting the network. Thereafter, the user may open the network setup interface of the display device. As shown in fig. 6, the network setting interface of the display device 601 displays a hotspot starting control 602, and in response to a triggering operation (such as a clicking operation) of the hotspot starting control 602 by a user, the display device 601 starts a hotspot function, that is, the display device 601 starts a first network node corresponding to the first communication mode, that is, the display device 601 starts a wireless access point.

As another example, take the first operation as a user power-on operation of the display device. And responding to the starting operation of the user on the display equipment, starting the display equipment, and automatically connecting to a network. In the case that the display device is connected to the network, the display device automatically starts a hot spot function, i.e. the display device enables a first network node corresponding to the first communication mode, i.e. the display device enables a wireless access point.

In some examples, enabling the first network node corresponding to the first communication mode may specifically include: the driver corresponding to the first wireless communication module in the driving layer of the display device sets the first network node to an enabling state (or called an active state), that is, the driver corresponding to the first wireless communication module is up with the first network node.

In step 520, the first information is acquired in response to the second operation.

The first information may be used to indicate whether the display device supports the first communication mode and the second communication mode simultaneously, i.e. the first information may be used to indicate whether the driver corresponding to the first communication module and the driver corresponding to the second communication program are loaded successfully.

Illustratively, the first information may be a field value corresponding to a target field (e.g., wiFi double support) stored by the display device. For example, if the field value corresponding to the target field (e.g., wiFi double support) is a first value (e.g., true), it is indicated that the driver corresponding to the first communication module and the driver corresponding to the second communication module of the display device are both loaded successfully, that is, the display device supports the first communication mode and the second communication mode simultaneously, that is, the display device supports hot spot screen transfer and peer-to-peer (i.e., P2P) screen transfer simultaneously. The field value corresponding to the target field (e.g., wiFi double support) is a second value (e.g., false), which indicates that the display device does not support the first communication mode and the second communication mode, that is, the display device cannot support both hot spot screen transfer and point-to-point (i.e., P2P) screen transfer. The second operation may be used to trigger acquisition of the first information. Illustratively, the second operation may be a trigger operation of a point-to-point network (i.e., P2P) start control of the display device by the user.

For example, take the second operation as a trigger operation of a user to a point-to-point network (i.e., P2P) start control of the display device. As shown in fig. 7 (a), a wireless screen-passing application (e.g., miracast screen-passing application) 702 is installed on the display device 701. In response to a triggering operation (e.g., a clicking operation) of the wireless screen transfer application 702 by a user, as shown in (b) of fig. 7, the display device 701 may display an interface corresponding to the wireless screen transfer application 702. The interface corresponding to the wireless pass screen application 702 may include a point-to-point network (i.e., P2P) start control 703. In response to a trigger operation (such as a clicking operation) of the user to start the control 703 on the peer-to-peer network (i.e., P2P), the display device 701 obtains first information, and when the first information indicates that the display device supports the first communication mode and the second communication mode at the same time, the display device 701 starts a peer-to-peer network (i.e., P2P) function, that is, the display device 701 starts a second network node corresponding to the second communication mode, that is, the display device 701 initiates a P2P search, so that the user can use other electronic devices to establish a peer-to-peer network (i.e., P2P) connection with the display device, thereby implementing P2P screen transmission.

It should be noted that, since the display device may start the peer-to-peer network function when the display device is connected to the network (i.e. the display device starts the WiFi function), before the first information is acquired in response to the second operation, the screen projection method may further include: and starting the WiFi function of the display device. In some examples, in response to a user's power-on operation of the display device, the display device is powered on and automatically turns on the WiFi function, i.e., the display device automatically connects to the network after power-on.

It should be further noted that step 520 may also be performed before step 510, that is, the user may first turn on the hot spot function of the display device and then turn on the peer-to-peer network function of the display device. The user can also start the point-to-point network function of the display device first and start the hot spot function of the display device. The execution sequence of steps 510 and 520 is not limited in the embodiment of the present application.

In step 530, in the case that the first information indicates that the display device supports both the first communication mode and the second communication mode, a second network node corresponding to the second communication mode is enabled, where the second communication mode is a peer-to-peer network mode, and the second network node is a node in a peer-to-peer network.

Wherein the second network node may be a network node created by the second wireless communication module. Illustratively, the second network node is a node in a point-to-point network (i.e., P2P) created by the second wireless communication module.

After the display device acquires the first information, the frame layer of the display device may determine, according to the first information, whether the display device supports the first communication module and the second communication mode at the same time. In the case that the first information indicates that the display device supports both the first communication module and the second communication mode, a driver corresponding to the second wireless communication module in a driving layer of the display device sets the second network node to an enabling state (or referred to as an active state), that is, the driver corresponding to the second wireless communication module is up with the second network node, that is, the display device enables the second network node created by the second wireless communication module.

In some examples, the setting, by the driver corresponding to the second wireless communication module of the driving layer of the display device, the second network node to the enabled state may include: in the case where the first information indicates that the display device supports both the first communication module and the second communication mode, the frame layer of the display device sends a first notification to the drive layer of the display device, which may be used to notify the drive layer of the display device that the display device supports both the first communication module and the second communication mode. The driving layer of the display device determines whether the first wireless communication module (i.e., the first WiFi chip) and the second wireless communication module (i.e., the second WiFi chip) can support concurrency of the first communication mode and the second communication mode according to the capability of the first wireless communication module (i.e., the first WiFi chip) and the second wireless communication module (i.e., the second WiFi chip) under the condition that the driving layer of the display device receives the first notification. In the case that the first wireless communication module (i.e., the first WiFi chip) and the second wireless communication module (i.e., the second WiFi chip) can support concurrency of the first communication mode and the second communication mode, a driver corresponding to the second wireless communication module in a driving layer of the display device sets the second network node to an enabled state (or referred to as an activated state), that is, a driver corresponding to the second wireless communication module up the second network node, that is, the display device enables the second network node created by the second wireless communication module.

In the embodiment of the application, before the display device starts the hot spot function and the point-to-point network function, the display device can load the driver corresponding to the first wireless communication module and the driver corresponding to the second wireless communication module. A process of loading a driver corresponding to the first wireless communication module and a driver corresponding to the second wireless communication module by the display device will be schematically described with reference to fig. 8.

In some embodiments, before enabling the first network node corresponding to the first communication mode in response to the first operation, as shown in fig. 8, the screen projection method further includes: step 810 and step 820.

Step 810, loading a driver corresponding to the first wireless communication module when the display device is started, and creating a first network node through the first wireless communication module.

The identification information corresponding to the first network node accords with a first identification rule, and the network node identified by the first identification rule can be identified by a frame layer of the display device. For example, the identification information corresponding to the first network node is ap0. The driver corresponding to the first wireless communication module may be, for example, the first WiFi driver described above.

In some examples, the method of screening further comprises: the third network node and the fourth network node are created by the first wireless communication module. Wherein the third network node may be a wireless local area network node. The fourth network node is a node in a point-to-point network.

And compared with the first network node, the identification information corresponding to the third network node and the identification information corresponding to the fourth network node both accord with a second identification rule, and the second identification rule is different from the first identification rule. For example, the identification information corresponding to the third network node is wlan b0. For example, the identification information corresponding to the fourth network node is p2pb0.

In particular implementations, the display device is booted in response to a user power-on operation of the display device. When the display device is started, the display device loads a driver corresponding to the first wireless communication module, and generates a first network node (i.e., ap 0), a third network node (i.e., wlan b 0) and a fourth network node (i.e., p2pb 0). In this regard, since the identification information ap0 corresponding to the first network node conforms to the first identification rule, the frame layer of the display device may identify the first network node, and thus the first network node (i.e., ap 0) generated by the first wireless communication module may be available. However, the identification information wlan0 corresponding to the third network node and the identification information p2pb0 corresponding to the fourth network node do not conform to the first identification rule, and the frame layer of the display device cannot identify the third network node and the fourth network node, so the third network node (i.e., wlan b 0) and the fourth network node (i.e., p2pb 0) generated by the first wireless communication module are unavailable.

Step 820, loading a driver corresponding to the second wireless communication module, and creating a second network node through the second wireless communication module.

The identification information corresponding to the second network node accords with a first identification rule, and the network node identified by the first identification rule can be identified by a frame layer of the display device. For example, the identification information corresponding to the second network node is p2p0. The driver corresponding to the second wireless communication module may be the second WiFi driver.

In some examples, the method of screening further comprises: creating a fifth network node and a sixth network node through the first wireless communication module; the fifth network node is a wireless local area network node, and the identification information corresponding to the fifth network node accords with the first identification rule; the sixth network node is a wireless access point, and the priority of the sixth network node is lower than that of the second network node.

In particular implementations, the display device is booted in response to a user power-on operation of the display device. When the display device is started, the display device loads a driver corresponding to the second wireless communication module, and generates a second network node (i.e., p2p 0), a fifth network node (i.e., wlan 0), and a sixth network node (i.e., ap 1). Since the identification information p2p0 corresponding to the second network node and the identification information wlan0 corresponding to the fifth network node conform to the first identification rule, the frame layer of the display device can identify the second network node and the fifth network node, and thus the second network node (i.e., p2p 0) and the fifth network node (i.e., wlan 0) are available. In addition, the identification information ap1 corresponding to the sixth network node conforms to the first identification rule, and the priority of the sixth network node (i.e. ap 1) is lower than that of the first network node (i.e. ap 0), so when the display device starts the hot spot function, the display device preferentially operates the first network node (i.e. ap 0). That is, when the display device turns on the hot spot function, the display device implements the hot spot function through the first communication module (i.e., the first WiFi chip). When the display device starts the WiFi function and the point-to-point network function (such as point-to-point transmission screen), the display device realizes the WiFi function and the point-to-point network function through the second communication module (namely the second WiFi chip).

It should be noted that, step 820 may also be performed before step 810, step 820 may also be performed simultaneously with step 810, and the execution sequence of step 820 and step 810 is not limited in the embodiment of the present application.

In the embodiment of the application, when the display device is started, the display device can load the driver corresponding to the first communication module and the driver of the second communication module. Wherein the first communication module may create an available first network node when the display device loads the first communication module, and the second communication module may create an available second network node when the display device loads the second communication module. In this way, when the user turns on the hotspot function of the display device, the display device may enable the first network node to implement the hotspot function. When the user turns on the peer-to-peer network function of the display device, the display device may enable the second network node to implement the peer-to-peer network function.

After step 530, step 540 is performed to display the first screen-shot data and the second screen-shot data in a split-screen manner, in the case that the first screen-shot data is received through the first network node and the second screen-shot data is received through the second network node.

After the display device enables the first network node, the first electronic device (such as a computer, a tablet computer and a mobile phone) can be used as a site to connect with the first network node (namely a wireless access point ap 0) of the display device, and then the first electronic device can send first screen throwing data to the display device based on WiFi connection established between the first electronic device and the display device. After the display device enables the second network node, the second electronic device (such as a computer, a tablet computer and a mobile phone) can establish a point-to-point network connection with the display device, and then the second electronic device can send second screen throwing data to the display device based on the point-to-point network connection established between the second electronic device and the display device. Then, under the condition that the display device receives the first screen-throwing data through the first network node and receives the second screen-throwing data through the second network node, the display device can display the first screen-throwing data and the second screen-throwing data in a split-screen mode.

For example, taking a first electronic device as a computer and a second electronic device as a computer, as shown in fig. 9, when the first electronic device 902 sends first screen-throwing data to the display device 901 through a hot spot screen-passing, and the second electronic device 903 sends second screen-throwing data to the display device 901 through a point-to-point screen-passing, the display device 901 displays the first screen-throwing data in a first display area (e.g. a left area of a display) 904, and displays the second screen-throwing data in a second display area (e.g. a right area of the display) 905, that is, displays the first screen-throwing data and the second screen-throwing data in a split screen manner.

In some embodiments, before displaying the first screen-shot data and the second screen-shot data in a split-screen manner, as shown in fig. 10, the screen-shot method further includes: steps 1010 to 1030.

Step 1010, receiving a first screen connection request sent by a first electronic device.

The first screen-drop connection request may be for requesting a hot spot screen-transfer to the display device, i.e. the first screen-drop request may be for requesting a first network node created by the first communication module connecting the display device (i.e. the wireless access point ap 0).

For example, the first screen-connection request may be in response to a screen-connection operation of the first electronic device by the user, and the first electronic device may send the first screen-connection request to the display device.

In step 1020, a communication connection is established with the first electronic device through the first network node in response to the first screen-drop connection request.

In response to the first screen-drop connection request, the display device establishes a WiFi connection with the first electronic device through the first network node (i.e., wireless access point ap 0).

Step 1030, based on the first network node establishing communication connection with the first electronic device, receiving first screen-projection data sent by the first electronic device.

The first electronic device may send first screen-casting data to the display device based on a WiFi connection established between the first electronic device and the display device. And after the display equipment receives the first screen throwing data, controlling the display to display the first screen throwing data.

In the embodiment of the application, after the display device starts the first network node corresponding to the first communication mode, when the first electronic device needs to throw a screen to the display device, the first electronic device can send a first screen throwing connection request to the display device, and in response to the first screen throwing connection request, the first electronic device can serve as a site to connect the first network node of the display device, and further based on WiFi connection established between the first electronic device and the display device, the first electronic device can send first screen throwing data to the display device, and the display device can receive and display the first screen throwing data.

In some embodiments, before displaying the first screen-shot data and the second screen-shot data in a split-screen manner, as shown in fig. 11, the screen-shot method further includes: step 1110 to step 1130.

Step 1110, receiving a second screen connection request sent by the second electronic device.

The second screen-drop connection request may be for requesting a point-to-point screen transfer to the display device, i.e. the second screen-drop connection request may be for requesting a second network node created by the second communication module connecting the display device (i.e. p2p 0).

In step 1120, in response to the second screen-drop connection request, a communication connection is established with the second electronic device through the second network node.

In response to the second screen-drop connection request, the display device establishes a point-to-point network connection with the second electronic device through the second network node (i.e., p2p 0).

Step 1130, based on the second network node establishing communication connection with the second electronic device, receiving second screen projection data sent by the second electronic device.

The second electronic device may send second screen-cast data to the display device based on a point-to-point network connection established between the second electronic device and the display device. And after the display equipment receives the second screen throwing data, controlling the display to display the second screen throwing data. That is, the display device displays the first screen-throwing data and the second screen-throwing data in a split-screen manner.

In the embodiment of the application, after the display device starts the second network node corresponding to the second communication mode, when the second electronic device needs to perform point-to-point screen projection to the display device, the second electronic device can send a second screen projection connection request to the display device, and respond to the second screen projection connection request, the second electronic device is connected with the second network node of the display device, so that based on the point-to-point network connection established between the second electronic device and the display device, the second electronic device can send second screen projection data to the display device, and the display device can receive and display the second screen projection data.

In some embodiments, after acquiring the first information in response to the second operation, the method further includes: and sending out prompt information under the condition that the first network node is in an enabled state and the first information indicates that the display equipment cannot support the first communication mode and the second communication mode at the same time, wherein the prompt information is used for prompting a user to close the first network node.

In implementations, the user may enter the second operation when the user turns on the peer-to-peer network function of the display device. In response to the second operation, the display device obtains the first information. In the case where the first information indicates that the display device cannot support both the first communication mode and the second communication mode (i.e., the display device is carrying a single WiFi chip), the display device obtains the currently enabled network node. In the case that the currently enabled network node includes the first network node (the first network node is enabled), the second network node fails to be enabled, and the display device sends out a prompt message to prompt the user to close the first network node, that is, prompt the user to need to close the hot spot function of the display device. Thereafter, after the user turns off the hotspot function of the display device (i.e., turns off the first network node), the user may enter a second operation. In response to the second operation, the display device obtains the first information. In case the first information indicates that the display device cannot support both the first communication mode and the second communication mode (i.e. the display device is carrying a single WiFi chip), the display device obtains the currently enabled network node, and in case the currently enabled network node does not comprise the first network node (the first network node is enabled), the second network node is enabled, i.e. the peer-to-peer network function of the display device is turned on.

For example, when the display device acquires the currently enabled network node, the display device may view the network interface information of the display device through an "ifconfig" command, i.e., acquire the currently enabled network node. For example, a con:/# if config

ap0 Link encap:Ethernet Hwaddr 3e:64:07:ec:c6:ee

inet addr:172.16.52.1Bcast:172.16.52.255Mask:255.255 255.0wlan0 Link encap:Ethernet Hwaddr 84:3e:1d:ac:02:b5 Driver usb

inet addr:192.168.124.8Bcast:192.168.124.255Mask:255.255.255.0

It follows that the currently enabled network nodes include ap0 (i.e. the first network node) and wlan0.

In the embodiment of the application, when the display device receives the second operation of the user, the display device can judge in advance whether to support the first communication mode and the second communication mode simultaneously, and when the display device cannot support the first communication mode and the second communication mode simultaneously, prompt information is sent to prompt the user to close the hot spot so as to start the peer-to-peer network function of the display device.

The screen projection method provided by the embodiment of the application is described below with reference to fig. 12 by way of a specific example. As shown in fig. 12, the screen projection method includes steps 1201 to 1217.

In step 1201, in response to the power-on operation, the display device loads a driver corresponding to the first wireless communication module, and creates a first network node ap0, a third network node wlan b0, and a fourth network node p2pb0 through the first wireless communication module.

In step 1202, the display device loads a driver corresponding to the second wireless communication module, and creates a second network node p2p0, a fifth network node wlan0, and a sixth network node ap1 through the second wireless communication module.

In step 1203, in response to the first operation, the display device turns on the hotspot function and the WiFi function.

In step 1204, the driver layer of the display device sets the first network node ap0 to an enabled state.

In response to the second operation, the display device turns on the point-to-point network function, step 1205.

In step 1206, if the display device turns on the peer-to-peer network function, the framework layer of the display device determines, according to the first information, whether the display device supports the first communication mode and the second communication mode at the same time, if so, step 1207 is performed, and if not, step 1210 is performed.

In step 1207, the framework layer of the display device sends a first notification to the driver layer of the display device, where the first notification is used to instruct the display device to support the first communication mode and the second communication mode simultaneously.

Step 1208, the driver layer of the display device determines whether the display device supports concurrency of the first communication mode and the second communication mode, if so, step 1209 is performed, otherwise, step 1210 is performed.

In step 1209, the driving layer of the display device sets the second network node p2p0 to an enabled state.

Step 1210, sending out a prompt message, where the prompt message is used to prompt the user to close the first network node.

Step 1211, receiving a second screen-throwing connection request sent by the second electronic device, where the second screen-throwing connection request is used to request to perform a point-to-point screen transfer to the display device.

In step 1212, a point-to-point network connection is established with the second electronic device through the second network node in response to the second screen-drop connection request.

Step 1213, receiving second screen-cast data sent by the second electronic device based on the point-to-point network connection between the second electronic device and the display device.

Step 1214, receiving a first screen connection request sent by the first electronic device, where the first screen connection request is used to request a hot spot screen transfer to the display device.

In step 1215, a hotspot connection is established with the first electronic device via the first network node in response to the first screen-cast connection request.

In step 1216, first screen shot data sent by the first electronic device is received based on the hotspot connection between the first electronic device and the display device.

Step 1217, displaying the first screen data and the second screen data in a split-screen manner.

In this example, the display device is equipped with a first wireless communication module that may be used for hot spot connection and a second wireless communication module that may be used for point-to-point screen transfer. Based on this, in response to the first operation, the display device may enable the first network node corresponding to the first communication mode, which may enable the first electronic device to initiate a hotspot screen to the display device through the first network node. In response to the second operation, the display device can acquire first information, judge whether the display device supports the first communication mode and the second communication mode at the same time according to the first information, and enable the second network node corresponding to the second communication mode when the first information indicates that the display device supports the first communication mode and the second communication mode at the same time, so that when the first electronic device initiates a hot spot screen to the display device through the first network node, the second electronic device can initiate a point-to-point screen to the display device through the second network node, and therefore simultaneous use of the hot spot screen and the point-to-point screen can be achieved, a user can simultaneously watch screen data from two different electronic devices on the display device, and further richer watching experience is provided for the user.

Fig. 13 shows a schematic structural diagram of a screen projection device according to an embodiment of the present invention. As shown in fig. 13, the screen projection device 1300 includes: a first control module 1301, configured to enable, in response to a first operation, a first network node corresponding to a first communication mode, where the first communication mode is an access point mode, and the first network node is a wireless access point; an acquisition module 1302 for acquiring the first information in response to the second operation; the second control module 1303 is configured to enable, when the first information indicates that the display device supports both the first communication mode and the second communication mode, a second network node corresponding to the second communication mode, where the second communication mode is a peer-to-peer network mode, and the second network node is a node in a peer-to-peer network; the display module 1304 is configured to display, in a split-screen manner, the first screen-projection data and the second screen-projection data when the first screen-projection data is received through the first network node and the second screen-projection data is received through the second network node.

In some embodiments, the screen projection device 1300 may further include: the driving module is used for loading a driving program corresponding to the first wireless communication module when the display equipment is started, and creating a first network node through the first wireless communication module; loading a driving program corresponding to the second wireless communication module, and creating a second network node through the second wireless communication module; the identification information corresponding to the first network node and the identification information corresponding to the second network node both accord with the first identification rule.

In some embodiments, the driving module is further configured to create a third network node and a fourth network node through the first wireless communication module; the third network node is a wireless local area network node, the fourth network node is a node in a point-to-point network, the identification information corresponding to the third network node and the identification information corresponding to the fourth network node both accord with a second identification rule, and the second identification rule is different from the first identification rule.

In some embodiments, the driving module is further configured to create a fifth network node and a sixth network node through the first wireless communication module; the fifth network node is a wireless local area network node, and the identification information corresponding to the fifth network node accords with the first identification rule; the sixth network node is a wireless access point, and the priority of the sixth network node is lower than that of the second network node.

In some embodiments, the screen projection device 1300 may further include: the first receiving module is used for receiving a first screen-throwing connection request sent by the first electronic equipment; responding to a first screen connection request, and establishing communication connection with first electronic equipment through a first network node; and establishing communication connection with the first electronic equipment based on the first network node, and receiving first screen projection data sent by the first electronic equipment.

In some embodiments, the screen projection device 1300 may further include: the second receiving module is used for receiving a second screen-throwing connection request sent by the second electronic equipment; responding to a second screen-throwing connection request, and establishing communication connection with second electronic equipment through a second network node; and establishing communication connection with the second electronic equipment based on the second network node, and receiving second screen projection data sent by the second electronic equipment.

In some embodiments, the screen projection device 1300 may further include: the prompting module is used for sending prompting information when the first network node is in an enabled state and the first information indicates that the display equipment cannot support the first communication mode and the second communication mode at the same time, wherein the prompting information is used for prompting a user to close the first network node.

An embodiment of the present application provides a computer readable storage medium storing at least one executable instruction that, when executed on a display device/apparatus, causes the display device/apparatus to perform the screen projection method in any of the foregoing method embodiments.

The executable instructions may be particularly useful for causing a display device/apparatus to: under the condition that the next control operation is not received within a preset time period after the control operation is received, responding to the control operation, and acquiring the content to be displayed and the content to be released corresponding to the control operation; and controlling the display to display the content to be displayed and releasing the memory corresponding to the content to be released.

In this embodiment, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: an electrical connection having one or more wires, a portable disk, a hard disk, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

The algorithms or displays presented herein are not inherently related to any particular computer, virtual system, or other apparatus. In addition, embodiments of the present application are not directed to any particular programming language.

In the description provided herein, numerous specific details are set forth. It will be appreciated, however, that embodiments of the application may be practiced without such specific details. Similarly, in the above description of exemplary embodiments of the application, various features of embodiments of the application are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. Wherein the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this application.

Those skilled in the art will appreciate that the modules in the apparatus of the embodiments may be adaptively changed and disposed in one or more apparatuses different from the embodiments. The modules or units or components of the embodiments may be combined into one module or unit or component and, furthermore, they may be divided into a plurality of sub-modules or sub-units or sub-components. Except that at least some of such features and/or processes or elements are mutually exclusive.

It should be noted that the above-mentioned embodiments illustrate rather than limit the application, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The application may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The use of the words first, second, third, etc. do not denote any order. These words may be interpreted as names. The steps in the above embodiments should not be construed as limiting the order of execution unless specifically stated.

Claims

1. A display device, characterized by comprising:

a display configured to display the screen casting data;

a first wireless communication module configured to establish a communication connection with an electronic device through a first communication mode;

a second wireless communication module configured to establish a communication connection with the electronic device through a second communication mode;

a controller configured to:

in response to a first operation, enabling a first network node corresponding to the first communication mode, wherein the first communication mode is an access point mode, and the first network node is a wireless access point;

acquiring first information in response to a second operation;

enabling a second network node corresponding to the second communication mode when the first information indicates that the display device supports the first communication mode and the second communication mode at the same time, wherein the second communication mode is a point-to-point network mode, and the second network node is a node in a point-to-point network;

and under the condition that the first network node receives first screen throwing data and the second network node receives second screen throwing data, controlling the display to display the first screen throwing data and the second screen throwing data in a split screen mode.

2. The display device of claim 1, wherein the controller is further configured to:

when the display equipment is started, loading a driving program corresponding to the first wireless communication module, and creating the first network node through the first wireless communication module;

loading a driving program corresponding to the second wireless communication module, and creating the second network node through the second wireless communication module;

the identification information corresponding to the first network node and the identification information corresponding to the second network node both accord with a first identification rule.

3. The display device of claim 2, wherein the controller is further configured to:

creating a third network node and a fourth network node through the first wireless communication module; the third network node is a wireless local area network node, the fourth network node is a node in a point-to-point network, the identification information corresponding to the third network node and the identification information corresponding to the fourth network node both accord with a second identification rule, and the second identification rule is different from the first identification rule.

4. The display device of claim 2, wherein the controller is further configured to:

Creating a fifth network node and a sixth network node through the first wireless communication module; the fifth network node is a wireless local area network node, and the identification information corresponding to the fifth network node accords with the first identification rule; the sixth network node is a wireless access point, and the priority of the sixth network node is lower than that of the second network node.

5. The display device of any one of claims 1-4, wherein the controller is further configured to:

receiving a first screen connection request sent by first electronic equipment;

responding to the first screen projection connection request, and establishing communication connection with the first electronic equipment through the first network node;

and based on the first network node and the first electronic equipment, establishing communication connection, and receiving the first screen projection data sent by the first electronic equipment.

6. The display device of any one of claims 1-4, wherein the controller is further configured to:

receiving a second screen-throwing connection request sent by second electronic equipment;

responding to the second screen projection connection request, and establishing communication connection with the second electronic equipment through the second network node;

And establishing communication connection with the second electronic equipment based on the second network node, and receiving the second screen projection data sent by the second electronic equipment.

7. The display device of any one of claims 1-4, wherein the controller is further configured to:

and sending out prompt information under the condition that the first network node is in an enabled state and the first information indicates that the display equipment cannot support the first communication mode and the second communication mode at the same time, wherein the prompt information is used for prompting a user to close the first network node.

8. The display device of any one of claims 1-4, wherein the first wireless communication module is a WiFi chip and the second wireless communication module is a WiFi chip.

9. A screen projection method applied to the display device according to any one of claims 1 to 8, the method comprising:

responding to a first operation, enabling a first network node corresponding to a first communication mode, wherein the first communication mode is an access point mode, and the first network node is a wireless access point;

acquiring first information in response to a second operation;

Enabling a second network node corresponding to a second communication mode under the condition that the first information indicates that the display equipment supports the first communication mode and the second communication mode at the same time, wherein the second communication mode is a point-to-point network mode, and the second network node is a node in a point-to-point network;

and under the condition that the first screen throwing data are received through the first network node and the second screen throwing data are received through the second network node, the first screen throwing data and the second screen throwing data are displayed in a split screen mode.

10. The method of claim 9, wherein the display device comprises a first wireless communication module and a second wireless communication module, and wherein prior to the enabling of the first network node corresponding to the first communication mode in response to the first operation, the method further comprises: