CN114915833B

CN114915833B - Display control method, display device and terminal device

Info

Publication number: CN114915833B
Application number: CN202210731132.6A
Authority: CN
Inventors: 庞珊珊; 孙文苹; 周立安; 晁美燕; 王娜娜
Original assignee: Vidaa Netherlands International Holdings BV
Current assignee: Vidaa Netherlands International Holdings BV
Priority date: 2022-06-24
Filing date: 2022-06-24
Publication date: 2023-11-10
Anticipated expiration: 2042-06-24
Also published as: CN114915833A

Abstract

The application discloses a display control method, display equipment and terminal equipment, wherein the display equipment responds to a screen throwing request sent by the terminal equipment, establishes screen throwing connection between the terminal equipment and the display equipment, and plays a video stream of screen throwing of the terminal equipment. When the user controls the display device to enter an audio mode, the display is controlled to enter a black screen state, and the audio output interface is controlled to output audio data. When the terminal device drops the new data stream again, the display device or the terminal device may determine the new data stream. Based on different judgment results, whether the display device lights up the display or not is controlled. According to the method, the display device and the terminal device, whether the display is controlled to be on or not is determined by judging the data stream type and based on the judging result, so that the display can be ensured to be on in time when the video picture is required to be displayed, and the user experience is improved.

Description

Display control method, display device and terminal device

Technical Field

The present application relates to the field of display device control, and in particular, to a display control method, a display device, and a terminal device.

Background

With the development of society, the functions of display devices are increasing. The user can play the data stream such as audio or video through the display device, and the user can also send the data stream of the terminal device to the display device for playing in a screen throwing or mirror image mode. The display device may include a television, a refrigerator, other products with intelligent display screens, and the like, and the terminal device may include a mobile phone, a PAD, a computer, and the like.

In playing the data stream by using the display device in the screen-casting mode, if the user only wants to hear the sound of the data stream, the user can operate the display device to enter the audio mode. In the audio mode, the display device only plays audio data, and the display of the display device presents a black screen state.

However, if the user drops the screen again to play other data streams, such as playing video, the display device is still in the audio mode, and the display is still in a black screen state, so that the user cannot watch the video content, and the user experience is poor.

Disclosure of Invention

The application provides a display control method, display equipment and terminal equipment, which are used for solving the problem that the display equipment in an audio mode cannot light a display in time when playing other data streams.

In a first aspect, the present application provides a display apparatus comprising: a display configured to display a user interface; a communicator configured to connect with a terminal device; a video output interface configured to output video data to a display; an audio output interface configured to output audio data to a local speaker or an external audio output device; and the controller is respectively connected with the display, the communicator, the video output interface and the audio output interface:

responding to a screen projection request sent by a terminal device, and establishing screen projection connection between the terminal device and a display device, wherein the screen projection request is used for projecting a data stream in the terminal device to the display device for playing;

when a user controls the display equipment to enter an audio mode, controlling the display to enter a black screen state in the audio mode, and controlling the audio output interface to output audio data in a data stream to a local loudspeaker or an external audio output device for sound playing; and maintaining the screen-throwing connection state of the display equipment and the terminal equipment;

receiving a new data stream sent by the terminal equipment, and judging the new data stream;

If the new data stream is the audio data sent by the same terminal equipment, the display equipment is kept in an audio mode;

and if the new data stream is non-audio data sent by the same terminal equipment, controlling the audio output interface to output the audio data in the new data stream to a local loudspeaker or an external audio output device for sound playing, controlling the display to enter a bright screen state from a black screen state, and outputting video data in the new data stream to the display through the video output interface to display images.

In some embodiments of the application, the controller is further configured to: if the terminal equipment for transmitting the new data stream and the terminal equipment for establishing screen-throwing connection with the display equipment are different terminal equipment, controlling the display to enter a bright screen state from a black screen state; and controlling the audio output interface to output the audio data in the new data stream to a local loudspeaker or an external audio output device for sound playing.

In some embodiments of the present application, when determining whether the terminal device sending the new data stream and the terminal device establishing the screen-casting connection with the display device are the same, the controller is further configured to:

Acquiring a first equipment type corresponding to terminal equipment which establishes screen-throwing connection with display equipment, and extracting a second equipment type corresponding to the terminal equipment which sends the new data stream from the new data stream;

if the first equipment type is consistent with the second equipment type, determining that the terminal equipment for sending the new data stream and the terminal equipment for establishing screen-throwing connection with the display equipment are the same terminal equipment;

and if the comparison of the first equipment type and the second equipment type is inconsistent, determining that the terminal equipment for sending the new data stream and the terminal equipment for establishing the screen throwing connection with the display equipment are different terminal equipment.

In some embodiments of the present application, the display includes a backlight, and the controller includes a screen-projection driving module, a control module, a screen-projection bridging module, and a wake-up module; and the controller is executing the non-audio data sent by the same terminal equipment if the new data stream is the new data stream, and controlling the display to enter a bright screen state from a black screen state, and is further configured to:

when the screen-throwing driving module judges that the new data stream is non-audio data sent by the same terminal equipment, the screen-throwing driving module sends a notification to the control module, and the control module sends a wake-up message to the screen-throwing bridging module based on the notification;

When the screen-throwing bridging module receives the awakening message, the screen-throwing bridging module acquires a screen state attribute value from the awakening module, and the screen-throwing bridging module sets the screen state attribute value as a first attribute value, wherein the first attribute value is used for representing that a display is in a bright screen state;

and when the backlight identifies that the attribute value of the screen state in the awakening module is the first attribute value, controlling the display to enter a bright screen state from a black screen state.

In a second aspect, the present application provides a terminal device, including: a display screen configured to display a user interface; a communication module configured to connect with a display device; a control module respectively connected with the display screen and the communication module, the control module configured to:

when a terminal device plays a data stream, a screen-throwing request is sent to a display device in response to screen-throwing operation triggered by a user, screen-throwing connection between the terminal device and the display device is established, and the screen-throwing request is used for throwing the data stream in the terminal device to the display device for playing;

after a user controls a display device which is connected with a terminal device in a screen-throwing way to enter an audio mode, if the user controls the terminal device to throw a screen to play a new data stream to the display device, judging the new data stream, wherein the audio mode refers to a mode that a display of the display device enters a black screen state, and an audio output interface of the display device outputs audio data to a loudspeaker of the display device or an external audio output device to play sound;

If the new data stream is audio data, a new screen throwing request carrying the new data stream is sent, and the new screen throwing request is used for indicating a display device to play the new data stream in a state of keeping an audio mode;

and if the new data stream is non-audio data, a new screen throwing request carrying the new data stream and a wake-up message is sent, wherein the new screen throwing request is used for indicating the display equipment to control the display of the display equipment to enter a bright screen state from a black screen state based on the wake-up message and display images, and an audio output interface of the display equipment outputs audio data in the new data stream to a loudspeaker or an external audio output device of the display equipment for sound playing.

In a third aspect, the present application provides a display control method applied to a display device, the method comprising:

In some embodiments of the application, the method further comprises: if the terminal equipment for transmitting the new data stream and the terminal equipment for establishing screen-throwing connection with the display equipment are different terminal equipment, controlling the display to enter a bright screen state from a black screen state; and controlling the audio output interface to output the audio data in the new data stream to a local loudspeaker or an external audio output device for sound playing.

In some embodiments of the present application, determining whether the terminal device sending the new data stream and the terminal device establishing the screen-throwing connection with the display device are the same includes:

In some embodiments of the present application, the display includes a backlight, and the controller includes a screen-projection driving module, a control module, a screen-projection bridging module, and a wake-up module; and if the new data stream is non-audio data sent by the same terminal equipment, controlling the display to enter a bright screen state from a black screen state, wherein the method comprises the following steps:

In a fourth aspect, the present application provides a display control method, applied to a terminal device, the method including:

In a fifth aspect, the present application also provides a computer readable storage medium, where a program is stored, where the program can implement some or all of the steps included in the embodiments of the display control method provided by the present application when executed.

The application provides a display control method, display equipment and terminal equipment, wherein the display equipment responds to a screen throwing request sent by the terminal equipment, establishes screen throwing connection between the terminal equipment and the display equipment, and plays a video stream of screen throwing of the terminal equipment. When the user controls the display device to enter an audio mode, the display is controlled to enter a black screen state, and the audio output interface is controlled to output audio data. When the terminal equipment drops the new data stream again, the display equipment judges the new data stream, and if the new data stream is the audio data sent by the same terminal equipment, the display equipment is kept in an audio mode; if the new data stream is non-audio data sent by the same terminal equipment, controlling the audio output interface to output audio data in the new data stream, simultaneously controlling the display to enter a bright screen state from a black screen state, and outputting video data in the new data stream to the display through the video output interface to display images. The process of judging the new data stream can also be executed by the terminal equipment, and the terminal equipment sends different screen throwing requests to the display equipment based on the judging result so as to control whether the display equipment lightens the display. According to the method, the display device and the terminal device, whether the display is controlled to be on or not is determined by judging the data stream type and based on the judging result, so that the display can be ensured to be on in time when the video picture is required to be displayed, and the user experience is improved.

Drawings

In order to more clearly illustrate the technical solution of the present application, the drawings that are needed in the embodiments will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.

FIG. 1 illustrates a schematic diagram of an operational scenario between a display device and a control apparatus according to some embodiments;

fig. 2 shows a hardware configuration block diagram of the control apparatus 100 according to some embodiments;

fig. 3 illustrates a hardware configuration block diagram of a display device 200 according to some embodiments;

FIG. 4 illustrates a software configuration diagram in a display device 200 according to some embodiments;

FIG. 5 illustrates a flow chart of a display device performing a display control method according to some embodiments;

FIG. 6 illustrates a data flow diagram of a display device performing a display control method in accordance with some embodiments;

FIG. 7 illustrates an interface schematic diagram of a display device in a normal mode according to some embodiments;

FIG. 8 illustrates an interface schematic of a display device in an audio mode according to some embodiments;

fig. 9 illustrates a connection architecture diagram of a display device and a terminal device according to some embodiments;

FIG. 10 illustrates a logical architecture diagram of a display that lights up in audio mode to play a new data stream in accordance with some embodiments;

FIG. 11 illustrates a flow chart of a method of controlling a display to illuminate a screen in accordance with some embodiments;

FIG. 12 illustrates a schematic diagram of switching an audio mode to a normal mode, in accordance with some embodiments;

FIG. 13 illustrates another data flow diagram of a display device performing a display control method in accordance with some embodiments;

FIG. 14 illustrates a flow chart of a terminal device performing a display control method according to some embodiments;

FIG. 15 illustrates a data flow diagram of a terminal device performing a display control method in accordance with some embodiments;

fig. 16 illustrates a logical architecture diagram of a terminal device controlling the lighting of a display in audio mode according to some embodiments.

Detailed Description

For the purposes of making the objects and embodiments of the present application more apparent, an exemplary embodiment of the present application will be described in detail below with reference to the accompanying drawings in which exemplary embodiments of the present application are illustrated, it being apparent that the exemplary embodiments described are only some, but not all, of the embodiments of the present application.

It should be noted that the brief description of the terminology in the present application is for the purpose of facilitating understanding of the embodiments described below only and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms first, second, third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus. The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that is capable of performing the function associated with that element.

The display device provided by the embodiment of the application can have various implementation forms, for example, a television, an intelligent television, a computer, a laser projection device, a display (monitor), an electronic whiteboard (electronic bulletin board), an electronic desktop (electronic table) and the like. Fig. 1 and 2 are specific embodiments of a display device of the present application.

Fig. 1 illustrates a schematic diagram of an operational scenario between a display device and a control apparatus according to some embodiments. As shown in fig. 1, a user may operate the display device 200 through the terminal device 300 or the control apparatus 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, and the display device 200 is controlled by a wireless or wired mode. The user may control the display device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, etc.

In some embodiments, the terminal device 300 (e.g., mobile terminal, tablet, computer, notebook, etc.) may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on the terminal device.

In some embodiments, the display device may receive instructions not using the terminal device or the control device described above, but rather receive control of the user by touch or gesture, or the like.

In some embodiments, the display device 200 may also perform control in a manner other than the control apparatus 100 and the terminal device 300, for example, the voice instruction control of the user may be directly received through a module for acquiring a voice instruction configured inside the display device 200, or the voice instruction control of the user may be received through a voice control device provided outside the display device 200.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers.

Fig. 2 shows a hardware configuration block diagram of the control apparatus 100 according to some embodiments. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user, and convert the operation instruction into an instruction recognizable and responsive to the display device 200, and may perform an interaction between the user and the display device 200.

Fig. 3 illustrates a hardware configuration block diagram of a display device 200 according to some embodiments. As shown in fig. 3, the display apparatus 200 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

In some embodiments the controller includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, a first interface for input/output to an nth interface.

The display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, a component for receiving an image signal from the controller output, displaying video content, image content, and a menu manipulation interface, and a user manipulation UI interface.

The display 260 may be a liquid crystal display, an OLED display, a projection device, or a projection screen.

The communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The display device 200 may establish transmission and reception of control signals and data signals with an external control device or server 400 through the communicator 220.

A user interface, which may be used to receive control signals from the control device 100 (e.g., an infrared remote control, etc.).

The detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; alternatively, the detector 230 includes an image collector such as a camera, which may be used to collect external environmental scenes, user attributes, or user interaction gestures, or alternatively, the detector 230 includes a sound collector such as a microphone, or the like, which is used to receive external sounds.

The external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, or the like. The input/output interface may be a composite input/output interface formed by a plurality of interfaces.

The modem 210 receives broadcast television signals through a wired or wireless reception manner, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like.

The controller 250 controls the operation of the display device and responds to the user's operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command to select a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments the controller includes at least one of a central processing unit (Central Processing Unit, CPU), video processor, audio processor, graphics processor (Graphics Processing Unit, GPU), RAM (Random Access Memory, RAM), ROM (Read-Only Memory, ROM), first to nth interfaces for input/output, a communication Bus (Bus), etc.

The user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

A "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user, which enables conversion between an internal form of information and a user-acceptable form. A commonly used presentation form of the user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

Fig. 4 illustrates a software configuration diagram in a display device 200 according to some embodiments. In some embodiments, as shown in fig. 4, the system of the display device may include a Kernel (Kernel), a command parser (shell), a file system, and an application program. The kernel, shell, and file system together form the basic operating system architecture that allows users to manage files, run programs, and use the system. After power-up, the kernel is started, the kernel space is activated, hardware is abstracted, hardware parameters are initialized, virtual memory, a scheduler, signal and inter-process communication (IPC) are operated and maintained. After the kernel is started, shell and user application programs are loaded again. The application program is compiled into machine code after being started to form a process.

As shown in fig. 4, the system of the display device is divided into three layers, an application layer, a middleware layer, and a hardware layer, from top to bottom. In some embodiments, the system of the display device further includes a UI layer (not shown in the figure) located above the application layer, the UI layer receiving data transmissions of the application layer to enable a visual presentation of the display 260.

The application layer mainly comprises common applications on the television, and an application framework (Application Framework), wherein the common applications are mainly applications developed based on Browser, such as: HTML5 APPs; native applications (Native APPs);

The application framework (Application Framework) is a complete program model with all the basic functions required by standard application software, such as: file access, data exchange, and the interface for the use of these functions (toolbar, status column, menu, dialog box).

Native applications (Native APPs) may support online or offline, message pushing, or local resource access.

The middleware layer includes middleware such as various television protocols, multimedia protocols, and system components. The middleware can use basic services (functions) provided by the system software to connect various parts of the application system or different applications on the network, so that the purposes of resource sharing and function sharing can be achieved.

The hardware layer mainly comprises a HAL interface, hardware and a driver, wherein the HAL interface is a unified interface for all the television chips to be docked, and specific logic is realized by each chip. The driving mainly comprises: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.

In some embodiments, the display device 200 may play the data stream provided by itself, and may also receive the data stream sent by the terminal device 300 by way of projection or mirroring. The display device 200 includes playing the data stream in different modes, for example, a normal mode and an audio mode. In the normal mode, the display 260 of the display device 200 is in a bright screen state, the display 260 plays the video data of the data stream, and the audio output interface 270 outputs the audio data to the local speaker or the external audio output device for playing. In the audio mode, the display 260 of the display apparatus 200 is in a black screen state, the display 260 does not display video data, and the audio output interface 270 only outputs the audio data to the local speaker or the external audio output device for playing.

While the display device 200 is in the audio mode to play the data stream, if the user drops the screen again to play other data streams, the existing display device 200 still plays the newly played data stream in the audio mode. When the newly played data stream is video, the display 260 of the display device 200 still in the audio mode is still in a black screen state, and the video data in the newly cast data stream cannot be played through the display 260, so that the user cannot watch the video content and the user experience is poor.

To ensure that the display device 200 in audio mode can light the display 260 in time to present a video picture through the display 260 while playing other data streams, some embodiments of the present application provide a display device 200 in which, if a data stream transmitted by the terminal device 300 is received in audio mode, the state of the display 260 can be controlled so that the display 260 can be lit in time when the video picture needs to be displayed.

FIG. 5 illustrates a flow chart of a display device performing a display control method according to some embodiments; fig. 6 illustrates a data flow diagram of a display device performing a display control method according to some embodiments. Some embodiments of the present application provide a display apparatus 200, including: a display 260 configured to display a user interface; a communicator 220 configured to connect with the terminal device 300; a video output interface configured to output video data to a display, the video output interface being connected to the display, the video output interface being one of a first interface to an n-th interface for input/output; an audio output interface 270 configured to output audio data to a local speaker or an external audio output device; the controller 250, which is connected to the display 260, the communicator 220, the video output interface and the audio output interface 270, respectively, when performing the display control method shown in fig. 5 and 6, the controller 250 is configured to perform the steps of:

S11, responding to a screen projection request sent by the terminal equipment, and establishing screen projection connection between the terminal equipment and the display equipment.

The screen projection request is used for projecting the data stream in the terminal equipment to the display equipment for playing.

When the terminal device 300 plays the data stream, the user may operate the terminal device 300 to perform a screen projection operation, and generate a screen projection request based on the data stream. The display device 200 establishes a screen connection with the terminal device 300 in response to the screen request, plays video data in the data stream by the display 260, and outputs audio data in the data stream to a local speaker or an external audio output device by the audio output interface 270 for audio playing.

S12, when the user controls the display equipment to enter an audio mode, controlling the display to enter a black screen state in the audio mode, and controlling the audio output interface to output audio data in the data stream to a local loudspeaker or an external audio output device for sound playing; and maintaining the screen-throwing connection state of the display equipment and the terminal equipment.

The audio mode refers to a mode in which the display 260 is in a black screen state and audio data in the data stream is output by the audio output interface 270. In the audio mode, only the display 260 is blacked out, and the display device 200 may still respond to a voice instruction of the user, an instruction to operate the remote controller, an instruction to operate the terminal device 300, or the like.

After the display device 200 is started, the content is played in a normal mode, the display 260 is in a bright screen state, video data is output to the display 260 by the video output interface to play video pictures, and audio data is output to a local loudspeaker or an external audio output device by the audio output interface 270 to play sound. In the scenario where the display device 200 is in screen-on connection with the terminal device 300, the display device still plays the data stream of the screen-on of the terminal device in the normal mode. The display device 200 may operate the display device 200 to enter an audio mode while playing the data stream. If the user operates the display device to enter the audio mode, the display device will display the black screen, not display the video data in the data stream of the terminal device 300, but the audio output interface will output the audio data in the data stream to the local speaker or the external audio output device for audio playing, i.e. the display 260 will display the black screen, and only output the audio.

In some embodiments, the device that controls the display device 200 to enter the audio mode may be the display device 200 itself or may be other terminal devices 300. The connection mode of the terminal device 300 and the display device 200 may adopt a screen-throwing mode, a mirror image mode or other modes, etc., and the application uses the screen-throwing mode to establish the screen-throwing connection of the display device 200 and the terminal device 300 and execute the display control method for illustration, and the display control method when adopting the mirror image mode connection can refer to the method adopted by the screen-throwing mode connection.

FIG. 7 illustrates an interface schematic diagram of a display device in a normal mode according to some embodiments; fig. 8 illustrates an interface schematic of a display device in an audio mode according to some embodiments. Referring to fig. 7, taking an example in which the user operates the display apparatus 200 to enter the audio mode, in the normal mode, when the display apparatus 200 plays audio data, a play page of the audio data including an audio cover, an audio name, a progress bar, and the like, corresponding to the audio data is displayed in the display 260. The user triggers a menu key of the remote controller, calls up a menu interface to be displayed in a play page of the audio data, and the menu interface comprises only audio options and setting options. Referring to fig. 8, the display device 200, in response to a user clicking on the audio-only option, blacks out the display 260 of the display device 200, plays audio data by the audio output interface 270, i.e., the display device 200 enters an audio mode.

In some embodiments, the display device enters audio mode with display 260 in a black screen state, but no other functions of display device 200 or display 260 are turned off. To facilitate the user's perception that the display device 200 is not turned off and still in operation, an indication may be presented in an interface in audio mode (a black screen interface), such as the white dot area in the middle of the black screen interface in fig. 8.

S13, receiving the new data stream sent by the terminal equipment, and judging the new data stream.

The data stream includes at least one of content of the data stream, data stream type, device type, cache information, information reception identification, and the like. The content of the data stream includes audio data, video data, and the like of the data stream. The data stream type is used to characterize a kind of the data stream, and the data stream type includes one of an audio stream type, a video stream type, a mirror stream type, a broadcast stream type, and a live stream type. The device type is used for representing the device for transmitting the data stream; the buffer information refers to temporarily storing audio data when the data stream type is the audio stream type; the information reception identifier is used to characterize that information can be received between the terminal device 300 and the display device 200.

Different data stream types and different terminal devices for transmitting data streams can influence the audio mode of the display device. Accordingly, a determination is made by the display device as to whether the display device needs to exit the audio mode with respect to the new data stream received from the terminal device.

Fig. 9 illustrates a connection architecture diagram of a display device and a terminal device according to some embodiments. Referring to fig. 9, the controller 250 of the display device 200 includes an SOC layer (i.e., the hardware/driving layer shown in fig. 4), a HAL layer, an architecture layer (i.e., the middle layer shown in fig. 4), and an application layer. The SOC layer comprises hardware firmware, a kernel, a driver, a platform SDK and the like; the HAL layer is used for shielding hardware differences and providing a unified interface; the application layer is used for realizing UI interface display of the display 260; the architecture layer includes a system module, where the system module includes an SDK module, a message transfer module, and a function module, where the message transfer module is used to implement message transfer in the architecture layer, and the function module is used to implement different functions of the display device 200, where the function module is used to implement playing of a data stream of a terminal device on a screen in a display.

Fig. 10 illustrates a logical architecture diagram of a display that lights up in audio mode to play a new data stream, in accordance with some embodiments. Referring to fig. 10, the sdk module includes a screen-throwing driving module and a control module (GAM module), and in order to realize the lighting of the display, the system module further includes a screen-throwing bridging module and a wake-up module (Biz module). The screen-throwing driving module is used for receiving a screen-throwing request sent by the terminal equipment through the SOC layer and the HAL layer and judging the data flow in the screen-throwing request. For example, the screen-throwing driving module is used for judging whether the data stream is audio, video or mirror image, and the like, and judging whether the terminal device for sending the data stream and the terminal device for establishing screen-throwing connection with the display device are the same. The control module is used for sending a wake-up message based on the judgment result of the screen throwing driving module; the screen-throwing bridging module is used for changing the screen state attribute value in the awakening module based on the awakening message; the backlight is used to control the display to light up after recognizing the screen state attribute value of the lit screen.

When the user operates the terminal device 300 and sends the new data stream provided by the terminal device 300 to the display device 200 for playing in a screen-throwing mode, the terminal device 300 sends the new data stream to the SDK module in the system module in the architecture layer through the SOC layer and the HAL layer, and the screen-throwing driving module in the SDK module processes the data stream information. The display device performs different strategies to control the state of the display 260 based on different decisions of the screen driver module.

And S14, if the new data stream is the audio data sent by the same terminal equipment, the display equipment is kept in the state of the audio mode.

The screen-throwing driving module acquires at least one of the data stream type and the equipment type from the new data stream. The screen-throwing driving module judges whether the new data stream is an audio stream, a video stream, a mirror image stream, a broadcast stream, a live stream or the like based on the data stream type; the screen-throwing driving module judges whether the terminal device 300 currently performing screen throwing operation is a new device or a terminal device previously establishing screen throwing connection with the display device based on the device type.

In some embodiments, in determining whether the terminal device sending the new data stream and the terminal device establishing the screen-cast connection with the display device are the same, the controller is further configured to:

step 141, obtaining a first device type corresponding to a terminal device that establishes a screen-throwing connection with a display device, and extracting a second device type corresponding to the terminal device that sends the new data stream from the new data stream.

And 142, if the comparison of the first equipment type and the second equipment type is consistent, determining that the terminal equipment for transmitting the new data stream and the terminal equipment for establishing the screen-throwing connection with the display equipment are the same terminal equipment.

Step 143, if the comparison between the first device type and the second device type is inconsistent, determining that the terminal device sending the new data stream and the terminal device establishing the screen-throwing connection with the display device are different terminal devices.

Determining whether the display device 200 in audio mode requires the display 260 to be lit may depend on whether the data stream type of the new data stream for the new screen is changed or whether the device for the new screen is changed from the device for which the screen connection was previously established with the display device 200.

If the screen-throwing driving module detects that the first equipment type is consistent with the second equipment type in comparison, the equipment playing the data stream at the end of the display equipment 200 in a screen-throwing mode is not changed, namely the terminal equipment sending the new data stream and the terminal equipment establishing screen-throwing connection with the display equipment are determined to be the same terminal equipment. If the screen-throwing driving module detects that the comparison of the first equipment type and the second equipment type is inconsistent, the equipment playing the data stream at the end of the display equipment 200 in a screen-throwing mode is changed, namely, the terminal equipment sending the new data stream and the terminal equipment establishing screen-throwing connection with the display equipment are determined to be different terminal equipment.

Then, the screen projection driving module continues to judge the data stream type. If the data stream type extracted from the data stream by the screen-throwing driving module is the audio stream type, the new data stream of the current screen throwing of the terminal equipment is the audio stream data. If the data stream type extracted by the screen-throwing driving module in the data stream is one of the non-audio stream types such as video stream, mirror image stream, broadcast stream or live stream, the new data stream of the current screen throwing of the terminal equipment is the non-audio stream data.

It should be noted that, in some embodiments of the present application, the execution sequence of the two processes of the data stream type and the device type determined by the screen-throwing driving module is not limited.

In some embodiments, if the screen-throwing driving module determines that the new data stream sent by the terminal device is audio data sent by the same terminal device, the display 260 does not need to be controlled to be on, the display device is kept in the state of audio mode, and the new video stream is played in the audio mode. The screen-throwing driving module does not inform the control module to send a wake-up message to the screen-throwing bridging module, and the screen-throwing bridging module does not change the screen state attribute value in the wake-up module, namely the screen state attribute value in the wake-up module is still the second attribute value. The screen state attribute value is located in the header file of the wake module and is used to characterize the state of the display 260. The second attribute value is used to indicate that the display 260 does not need to be illuminated and that the display 260 is in a black screen state.

The screen-throwing driving module directly sends the new data stream sent by the terminal device 300 to the functional module, and the functional module plays the new data stream. Since the display device 200 does not need to exit the audio mode, the display 260 is not turned on, and continues to present the black screen state, and continues to play the data stream of the new screen of the terminal device in the audio mode, for example, the audio output interface 270 outputs audio data, and the display 260 is black screen.

Illustratively, the terminal device 300 sends the audio data a to the display device 200 for playing in a screen-throwing manner, and the user operates the display device 200 to enter an audio mode. Next, if the terminal device 300 continues to transmit the audio data b to the display device 200 for playing by the screen-casting method, and the data stream type is not changed and the device type is not changed, the display device 200 continues to play the audio data b in the audio mode, and the display 260 continues to present the black screen state.

And S15, if the new data stream is non-audio data sent by the same terminal equipment, controlling the audio output interface to output the audio data in the new data stream to a local loudspeaker or an external audio output device for sound playing, simultaneously controlling the display to enter a bright screen state from a black screen state, and outputting video data in the new data stream to the display through the video output interface to display images.

If the screen-throwing driving module judges that the new data stream sent by the terminal equipment is non-audio data sent by the same terminal equipment, the display 260 needs to be controlled to be on, the display equipment exits from the audio mode and enters into the normal mode, so that video data in the new data stream is output to the display through the video output interface, and an image is displayed. Wherein the non-audio data refers to one of a video stream, a mirror stream, a broadcast stream, and a live stream.

Under the normal mode, the display enters a bright screen state from a dark screen state, the display in the bright screen state plays video data in the new data stream, and the audio output interface outputs audio data in the new data stream to the local loudspeaker or an external audio output device for sound playing.

FIG. 11 illustrates a flow chart of a method of controlling a display to illuminate a screen according to some embodiments. Referring to fig. 10 and 11, when executing the non-audio data transmitted if the new data stream is the same terminal device, the controller 250 controls the display to enter the bright screen state from the dark screen state, and is further configured to:

and S151, when the screen-throwing driving module judges that the new data stream is non-audio data sent by the same terminal equipment, the screen-throwing driving module sends a notification to the control module, and the control module sends a wake-up message to the screen-throwing bridging module based on the notification.

S152, when the screen-throwing bridging module receives the awakening message, the screen-throwing bridging module acquires a screen state attribute value from the awakening module, and the screen-throwing bridging module sets the screen state attribute value as a first attribute value, wherein the first attribute value is used for representing that the display is in a bright screen state.

And S153, when the backlight recognizes that the attribute value of the screen state in the wake-up module is the first attribute value, controlling the display to enter a bright screen state from a black screen state.

The screen-throwing driving module judges the data stream type and the equipment type of the new data stream sent by the terminal equipment, and if the screen-throwing driving module judges that the data stream is video or mirror image and other non-audio data, the display needs to be awakened no matter whether the terminal equipment for sending the data stream is the same as the terminal equipment for establishing the screen-throwing connection; if the screen-throwing driving module judges that the terminal equipment for sending the data stream is different from the terminal equipment for establishing the screen-throwing connection, the display is required to be awakened no matter whether the data stream sent by the terminal equipment is audio, video or mirror image or the like.

If the screen-throwing driving module judges that the display needs to be awakened, the control module is informed to send an awakening message to the screen-throwing bridging module. The wake-up message includes information of message source, destination, parameter value, command value, mode, etc. The message source is used to characterize the module that generated the message, the destination is used to characterize the module that received the message, the parameter values are used to characterize the application name (e.g., the screen-drop application), the command values are used to characterize the start command, and the mode is used to characterize the display state of the display 260.

The screen-drop bridging module obtains a screen state attribute value for characterizing the state of the display 260 in a header file of the wake-up module after receiving the wake-up message. In the audio mode, the screen state attribute value is a second attribute value, and in the normal mode, the screen state attribute value is set to be a first attribute value by the screen throwing bridging module. Wherein, the first attribute value may be 1, which is used to indicate that the display 260 needs to be lightened, and the display 260 enters a bright screen state; the second attribute value may be 0 to indicate that display 260 does not need to be illuminated and display 260 is in a black screen state.

And the backlight of the display detects the screen state attribute value stored in the header file in the wake-up module in real time, and if the backlight recognizes that the screen state attribute value in the wake-up module is the first attribute value, the backlight is lightened, and the display is controlled to enter a bright screen state from a black screen state so as to display the UI interface. At this time, the display apparatus 200 exits the audio mode and enters the normal mode, i.e., the video data of the new data stream is displayed on the display 260 in the bright screen state for playing, and the audio data of the new data stream is output from the audio output interface 270 to the local speaker or the external audio output device for audio playing.

Fig. 12 shows a schematic diagram of switching an audio mode to a normal mode, according to some embodiments. Referring to fig. 12, when the user operates the terminal device 300 to transmit a new data stream to the display device 200 in a mirror image manner while the display device 200 is in an audio mode, the display device 200 controls the display 260 to light up. The display device 200 automatically exits the audio mode and displays the interface of the terminal device 300 in the display 260 in a bright screen state, in which the mirrored content of the terminal device 300 is displayed.

In some embodiments, when the screen-throwing driving module determines based on the data stream type in the new data stream, if the data stream played when the display device 200 is in the audio mode and the data stream type of the new data stream sent by the current terminal device 300 change, whether the device that previously established the screen-throwing connection with the display device 200 is the same device as the current terminal device 300 or not, the display device 200 is controlled to leave the audio mode, enter the normal mode, and the display 260 is turned on to display the video picture of the new data stream in the display 260.

In some embodiments, when the screen-throwing driving module determines based on the device type in the new data stream, if the device that has previously established the screen-throwing connection with the display device 200 is not the same device as the current terminal device 300, the display device 200 is controlled to leave the audio mode and enter the normal mode, and the display 260 is turned on to display the video picture of the new data stream in the display 260, regardless of whether the data stream played when the display device 200 is in the audio mode and the data stream type of the new data stream transmitted by the current terminal device 300 are changed.

In some embodiments, the data streams that may control the display 260 to light may include broadcast programs (broadcast stream type), live programs (live stream type), and the like, in addition to audio (different device transmissions), video, and images. For example, the display device 200 may also illuminate the display 260 when the terminal device 300 is broadcasting a broadcast program or a live program.

Fig. 13 illustrates another data flow diagram of a display device performing a display control method according to some embodiments. Referring to fig. 13, after the display apparatus 200 enters the audio mode, the display 260 enters the black screen state. At this time, the terminal device 300 transmits the new data stream to the display device 200 through the screen projection, and the screen projection driving module in the display device 200 performs the judgment of the data stream type and the device type after receiving the data. If the new data stream is audio data of the same device, the screen shot driving module will not inform the control module to send a wake-up message to the screen shot bridging module, i.e. the display 260 will not be lit. If the new data stream is a video data stream or a mirror image data stream, the screen-casting driving module in the display device 200 notifies the control module to send a wake-up message to the screen-casting bridging module. After the bridging module receives the message, the screen state attribute value in the awakening module is set to be a first attribute value. The backlight of the display is turned on after recognizing the first attribute value, and the display 260 is turned on. If it is a new terminal device 300, the screen-drop driver module also notifies the control module to send a wake-up message to the screen-drop bridge module, the logic process is the same as the video and mirror image of the same device, and finally the display 260 is lit. If the new data stream is not a data stream sent by the same device, or is not a video or mirror image, but is a broadcast or live data stream, the screen-casting driving module also notifies the control module to send a wake-up message to the screen-casting bridging module, the logic processing is the same as the video and mirror image of the same device, and finally the display 260 is turned on. If the new data stream is not of any of the types described above, the screen shot driving module will not inform the control module to send a wake-up message to the screen shot bridging module, i.e. the display 260 will not be lit.

In some embodiments of the present application, a display device 200 establishes a screen connection between a terminal device 300 and the display device 200 in response to a screen request sent by the terminal device 300. When the user controls the display apparatus 200 to enter the audio mode, the control display 260 enters the black screen state and controls the audio output interface 270 to output audio data. The display device 200 judges a new data stream sent by the terminal device 300, and if the new data stream is audio data sent by the same terminal device, the display device is kept in an audio mode; if the new data stream is non-audio data sent by the same terminal equipment, controlling the audio output interface to output audio data in the new data stream, simultaneously controlling the display to enter a bright screen state from a black screen state, and outputting video data in the new data stream to the display through the video output interface to display images. It can be seen that the display device 200 determines whether to control the display 260 to light the screen based on the determination result by determining the data stream type, so that the display 260 can be ensured to be lightened in time when the video picture needs to be displayed, and the user experience is improved.

In some embodiments, the foregoing embodiments illustrate that the display device 200 makes a determination of a new data stream from the terminal device 300 and controls whether the display 260 is lit up based on the determination result. In other embodiments, the terminal device 300 may also determine a new data stream to be displayed, and send a different display request to the display device 200 based on the determination result, so as to control whether the display device 200 lights up the display.

FIG. 14 illustrates a flow chart of a terminal device performing a display control method according to some embodiments; fig. 15 illustrates a data flow diagram of a terminal device performing a display control method according to some embodiments. Some embodiments of the present application provide a terminal device, including: a display screen configured to display a user interface; a communication module configured to connect with a display device; the control module, which is connected to the display screen and the communication module, respectively, is configured to perform the following steps when performing the display control method shown in fig. 14 and 15:

s21, when the terminal equipment plays the data stream, a screen projection request is sent to the display equipment in response to screen projection operation triggered by a user, screen projection connection between the terminal equipment and the display equipment is established, and the screen projection request is used for projecting the data stream in the terminal equipment to the display equipment for playing.

The data stream played by the terminal device may be audio, video, mirror image, broadcast, live program, etc. When the terminal equipment plays any one of the data streams, the screen throwing function of the terminal equipment is operated, and the corresponding data stream is thrown into the display equipment for playing, so that the screen throwing connection of the terminal equipment and the display equipment is realized.

S22, after the user controls the display device which establishes the screen-throwing connection with the terminal device to enter the audio mode, if the user controls the terminal device to throw the screen to play the new data stream to the display device, judging the new data stream.

When the terminal equipment and the display equipment control the display equipment to play the data stream in a screen-throwing connection mode, a user can operate the display equipment to enter an audio mode, namely, a display of the display equipment enters a black screen state, and an audio output interface of the display equipment outputs audio data to a loudspeaker of the display equipment or an external audio output device to play sound. After the display equipment enters the audio mode, the screen-throwing connection state of the display equipment and the terminal equipment is continuously kept connected. The process of the display device entering the audio mode may refer to the content of the foregoing embodiment of the display device, which is not described herein.

After the display device enters the audio mode, if the terminal device is wanted to operate to throw the new data stream to the display device again, the terminal device judges the new data stream to determine the type of a screen throwing request sent to the display device based on the judging result so as to control whether the display device needs to lighten a display.

Fig. 16 illustrates a logical architecture diagram of a terminal device controlling the lighting of a display in audio mode according to some embodiments. Referring to fig. 16, the terminal device includes a playing module and a control module, where the playing module is used to play the video stream, and the control module is used to determine a new data stream of the new screen of the terminal device. When judging the new data stream, the control module in the terminal device 300 and the screen-projection driving module in the display device 200 execute the same judgment strategy, and the relevant judgment strategy process can refer to the content described in the foregoing display device embodiment, which is not repeated here.

S23, if the new data stream is audio data, a new screen throwing request carrying the new data stream is sent, and the new screen throwing request is used for indicating the display equipment to play the new data stream in a state of keeping an audio mode.

When the control module of the terminal device 300 determines that the new data stream is audio data, the control module generates a new screen throwing request based on the new data stream and sends the new screen throwing request to the display device without lighting a display of the display device. The screen-throwing driving module in the display equipment responds to a new screen-throwing request carrying a new data stream sent by the terminal equipment, the new data stream is sent to the functional module to realize playing, and the display equipment continues to play the new data stream in an audio mode. The process of playing the new data stream in the audio mode by the display device may refer to the step S14 and related content provided in the foregoing embodiment of the display device, and will not be described herein.

And S24, if the new data stream is non-audio data, a new screen throwing request carrying the new data stream and a wake-up message is sent, wherein the new screen throwing request is used for indicating the display equipment to control the display of the display equipment to enter a bright screen state from a black screen state based on the wake-up message and display images, and an audio output interface of the display equipment outputs audio data in the new data stream to a loudspeaker or an external audio output device of the display equipment for sound playing.

When the control module of the terminal device 300 determines that the new data stream is non-audio data such as video, mirror image, broadcast or live broadcast, and the like, the control module needs to light the display 260 of the display device 200, generates a new screen throwing request based on the new data stream and the wake-up message, and sends the new screen throwing request to the display device. And the wake-up module in the display device responds to a new screen throwing request carrying a new data stream and a wake-up message sent by the terminal device, modifies the screen state attribute value, exits the audio mode and enters the normal mode. That is, the display device 200 controls the display 260 to enter a bright screen state from a dark screen state based on the wake-up message, displays an image, and the display 260 in the bright screen state plays video data in the new data stream, and the audio output interface 270 outputs audio data in the new data stream to a speaker of the display device or an external audio output device for audio playing. The process of playing the new data stream by the display device in the normal mode may refer to the step S15 and related content provided in the foregoing display device embodiment, and will not be described herein.

When the terminal equipment provided by some embodiments of the present application plays the data stream, the data stream is screen-cast to the display equipment for playing in response to the screen-cast operation triggered by the user, and the screen-cast connection between the terminal equipment and the display equipment is established. After the user controls the display device to enter an audio mode, the terminal device judges a new data stream of screen re-projection. If the new data stream is audio data, a new screen throwing request carrying the new data stream is sent, so that the display equipment plays the new data stream in an audio mode; and if the new data stream is non-audio data, sending a new screen throwing request carrying the new data stream and a wake-up message, so that the display device exits the audio mode based on the wake-up message, controlling the display to lighten the screen, displaying the image, and outputting the audio data in the new data stream by an audio output interface of the display device. It can be seen that the terminal device determines the data stream to be displayed, and sends different screen display requests to the display device 200 based on the determination result, so as to control whether the display device 200 lights up the display, so that it can be ensured that the display 260 can be timely lightened when the video picture needs to be displayed, and user experience is improved.

Fig. 5 illustrates a flow chart of a display device performing a display control method according to some embodiments. Referring to fig. 5, some embodiments of the present application provide a display control method applied to a display apparatus 200, the method including:

s11, responding to a screen projection request sent by a terminal device, and establishing screen projection connection between the terminal device and a display device, wherein the screen projection request is used for projecting a data stream in the terminal device to the display device for playing;

s12, when a user controls the display equipment to enter an audio mode, controlling the display to enter a black screen state in the audio mode, and controlling the audio output interface to output audio data in a data stream to a local loudspeaker or an external audio output device for sound playing; and maintaining the screen-throwing connection state of the display equipment and the terminal equipment;

s13, receiving a new data stream sent by the terminal equipment, and judging the new data stream;

s14, if the new data stream is the audio data sent by the same terminal equipment, the display equipment is kept in an audio mode;

and S15, if the new data stream is non-audio data sent by the same terminal equipment, controlling the audio output interface to output the audio data in the new data stream to a local loudspeaker or an external audio output device for sound playing, controlling the display to enter a bright screen state from a black screen state, and outputting video data in the new data stream to the display through the video output interface to display images.

Fig. 14 illustrates a flow chart of a terminal device performing a display control method according to some embodiments. Referring to fig. 14, the present application provides a display control method applied to a terminal device 300, the method comprising:

S21, when the terminal equipment plays the data stream, responding to a screen-throwing operation triggered by a user, sending a screen-throwing request to the display equipment, and establishing screen-throwing connection between the terminal equipment and the display equipment, wherein the screen-throwing request is used for throwing the data stream in the terminal equipment to the display equipment for playing;

s22, after a user controls a display device which is in screen-throwing connection with a terminal device to enter an audio mode, if the user controls the terminal device to throw a screen to play a new data stream to the display device, judging the new data stream, wherein the audio mode refers to a mode that a display of the display device enters a black screen state, and an audio output interface of the display device outputs audio data to a loudspeaker of the display device or an external audio output device to play sound;

s23, if the new data stream is audio data, a new screen throwing request carrying the new data stream is sent, and the new screen throwing request is used for indicating a state that the display equipment keeps an audio mode to play the new data stream;

s24, if the new data stream is non-audio data, a new screen throwing request carrying the new data stream and a wake-up message is sent, wherein the new screen throwing request is used for indicating a display device to control a display of the display device to enter a bright screen state from a black screen state based on the wake-up message, and an image is displayed; and the audio output interface of the display equipment outputs the audio data in the new data stream to a loudspeaker of the display equipment or an external audio output device for sound playing.

According to the display control method, the display device 200 and the terminal device 300 provided by some embodiments of the present application, the display device 200 responds to a screen-throwing request sent by the terminal device 300, establishes screen-throwing connection between the terminal device 300 and the display device 200, and plays a video stream of screen throwing of the terminal device 300. When the user controls the display apparatus 200 to enter the audio mode, the control display 260 enters the black screen state and controls the audio output interface 270 to output audio data. When the terminal device 300 drops the new data stream again, the display device 200 judges the new data stream, and if the new data stream is the audio data sent by the same terminal device, the display device is kept in the state of the audio mode and plays the new data stream; if the new data stream is non-audio data sent by the same terminal device, controlling the audio output interface to output audio data in the new data stream, simultaneously controlling the display 260 to enter a bright screen state from a black screen state, and outputting video data in the new data stream to the display through the video output interface to display images. The process of judging the new data stream may also be performed by the terminal device, and the terminal device 300 transmits a different screen-casting request to the display device 200 based on the judgment result to control whether the display device 200 lights up the display. Therefore, according to the method, the display device 200 and the terminal device 300, by judging the data stream type and determining whether to control the display 260 to light the screen based on the judging result, the display 260 can be ensured to be lightened in time when the video picture is required to be displayed, and the user experience is improved.

In a specific implementation, the present invention further provides a computer readable storage medium, where the computer readable storage medium may store a program, where the program may include some or all of the steps in each embodiment of the display control method provided by the present invention when executed. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), a random-access memory (random access memory, RAM), or the like.

It will be apparent to those skilled in the art that the techniques of embodiments of the present invention may be implemented in software plus a necessary general purpose hardware platform. Based on such understanding, the technical solutions in the embodiments of the present invention may be embodied in the form of a software product, which may be stored in a computer-readable storage medium, in essence or contributing to the prior art.

The same or similar parts between the various embodiments in this specification are referred to each other. In particular, for the display control method embodiment, since it is substantially similar to the display device 200 and terminal device 300 embodiments, the description is relatively simple, and reference is made to the description in the display device 200 and terminal device 300 embodiments for the matters.

Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the present disclosure and to enable others skilled in the art to best utilize the embodiments.

Claims

1. A display device, characterized by comprising:

a display configured to display an image;

a communicator configured to connect with a terminal device;

a video output interface configured to output video data to a display;

An audio output interface configured to output audio data to a local speaker or an external audio output device;

and the controller is respectively connected with the display, the communicator, the video output interface and the audio output interface:

if the new data stream is the data of the audio stream type sent by the same terminal equipment, the state of the display equipment in an audio mode is maintained;

if the new data stream is the data of the non-audio stream type sent by the same terminal equipment, controlling the audio output interface to output the audio data in the new data stream to a local loudspeaker or an external audio output device for sound playing, controlling the display to enter a bright screen state from a black screen state, and outputting the video data in the new data stream to the display through the video output interface to display images; wherein the non-audio stream type includes one of a video stream type, a mirror stream type, a broadcast stream type, and a live stream type.

2. The display device of claim 1, wherein the controller is further configured to:

if the terminal equipment for transmitting the new data stream and the terminal equipment for establishing screen-throwing connection with the display equipment are different terminal equipment, controlling the display to enter a bright screen state from a black screen state; and controlling the audio output interface to output the audio data in the new data stream to a local loudspeaker or an external audio output device for sound playing.

3. The display device of claim 2, wherein the controller, when determining whether the terminal device that sent the new data stream and the terminal device that established the screen-cast connection with the display device are the same, is further configured to:

4. The display device of claim 1, wherein the display comprises a backlight, and the controller comprises a screen-cast drive module, a control module, a screen-cast bridging module, and a wake-up module; and the controller is executing the non-audio data sent by the same terminal equipment if the new data stream is the new data stream, and controlling the display to enter a bright screen state from a black screen state, and is further configured to:

5. A terminal device, comprising:

a display screen configured to display an image;

a communication module configured to connect with a display device;

a control module respectively connected with the display screen and the communication module, the control module configured to:

If the new data stream is data of an audio stream type, a new screen throwing request carrying the new data stream is sent, and the new screen throwing request is used for indicating a state that the display equipment keeps an audio mode to play the new data stream;

if the new data stream is data of a non-audio stream type, a new screen throwing request carrying the new data stream and a wake-up message is sent, wherein the new screen throwing request is used for indicating a display device to control a display of the display device to enter a bright screen state from a black screen state based on the wake-up message and display images, and an audio output interface of the display device outputs audio data in the new data stream to a loudspeaker or an external audio output device of the display device for sound playing; wherein the non-audio stream type includes one of a video stream type, a mirror stream type, a broadcast stream type, and a live stream type.

6. A display control method applied to a display device, the method comprising:

When a user controls the display equipment to enter an audio mode, controlling the display to enter a black screen state in the audio mode, and controlling an audio output interface of the display equipment to output audio data in a data stream to a local loudspeaker or an external audio output device for sound playing; and maintaining the screen-throwing connection state of the display equipment and the terminal equipment;

7. The method of claim 6, wherein the method further comprises:

8. The method of claim 7, wherein determining whether the terminal device transmitting the new data stream and the terminal device establishing the screen-cast connection with the display device are the same comprises:

9. The method of claim 6, wherein the display comprises a backlight, and the controller of the display device comprises a screen-cast drive module, a control module, a screen-cast bridge module, and a wake-up module; and if the new data stream is the data of the non-audio stream type sent by the same terminal equipment, controlling the display to enter a bright screen state from a black screen state, wherein the method comprises the following steps:

when the screen-throwing driving module judges that the new data stream is data of a non-audio stream type sent by the same terminal equipment, the screen-throwing driving module sends a notification to the control module, and the control module sends a wake-up message to the screen-throwing bridging module based on the notification;

10. A display control method applied to a terminal device, the method comprising:

if the new data stream is data of a non-audio stream type, a new screen throwing request carrying the new data stream and a wake-up message is sent, wherein the new screen throwing request is used for indicating a display device to control a display of the display device to enter a bright screen state from a black screen state based on the wake-up message, and an image is displayed; the audio output interface of the display equipment outputs audio data in the new data stream to a loudspeaker of the display equipment or an external audio output device for sound playing; wherein the non-audio stream type includes one of a video stream type, a mirror stream type, a broadcast stream type, and a live stream type.