CN116774956A - Display device, screen projection method and medium - Google Patents

Abstract

The present disclosure relates to a display apparatus, a screen projection method, and a medium, the display apparatus including: when the controller determines that the universal serial bus interface is accessed to the terminal equipment to be screen-projected, acquiring configuration information to be screen-projected, which corresponds to the terminal equipment to be screen-projected and comprises an endpoint identifier; configuring the universal serial bus interface based on the configuration information to be screened so as to determine a target endpoint for acquiring data to be screened from a plurality of endpoints included in the universal serial bus interface; if the configuration of the universal serial bus interface fails and a non-screen-throwing application program calling the universal serial bus interface exists, the non-screen-throwing application program is closed, the universal serial bus interface is configured based on the information of the configuration to be thrown, until the configuration of the universal serial bus interface is determined to be successful, the screen-throwing application program is called according to a target screen-throwing protocol corresponding to the terminal equipment to be thrown, the data to be thrown of the terminal equipment to be thrown is obtained through a target endpoint, and the display is carried out, so that the screen throwing failure is avoided.

Description

Display device, screen projection method and medium

Technical Field

The disclosure relates to the technical field of display, and in particular relates to a display device, a screen projection method and a medium.

Background

With rapid development of technology, the content of the terminal equipment to be screened, such as a smart phone, a computer and the like, can be screened onto another display equipment, such as a smart television, through a screen screening technology, so that the display equipment can synchronously display the interface of the display screen of the terminal equipment to be screened, and a user can watch the content conveniently.

At present, a screen is generally cast between a display device and a terminal device to be cast through a wireless network connection mode, however, because the wireless connection mode of casting is limited by a network, when network transmission is unstable, the screen casting effect is poor. Based on the above problems, in the prior art, a wired connection mode is adopted for screen projection.

However, when the screen is projected by adopting a wired connection manner, the problem of conflict among multiple protocols may cause the projection failure.

Disclosure of Invention

In order to solve the above technical problems or at least partially solve the above technical problems, the present disclosure provides a display device, a screen-throwing method, and a medium, where when a configuration failure is performed on a universal serial bus interface according to configuration information to be thrown on a screen of a terminal device to be thrown on, a non-screen-throwing application program calling the universal serial bus interface can be detected and closed, and then the universal serial bus interface is configured based on the configuration information to be thrown on, so as to solve the problem that a conflict exists in the universal serial bus interface in the prior art, and avoid the screen-throwing failure.

In a first aspect, the present disclosure provides a display device comprising: a controller configured to:

when the universal serial bus interface is determined to be accessed into the terminal equipment to be screened, acquiring the configuration information to be screened, which corresponds to the terminal equipment to be screened and comprises an endpoint identifier;

configuring the universal serial bus interface based on the configuration information to be screen-projected so as to determine a target endpoint for acquiring data to be screen-projected from a plurality of endpoints included in the universal serial bus interface;

if the configuration of the universal serial bus interface fails and a non-screen-throwing application program calling the universal serial bus interface exists, closing the non-screen-throwing application program, configuring the universal serial bus interface based on the to-be-screened configuration information until the configuration of the universal serial bus interface is determined to be successful, calling the screen-throwing application program to acquire to-be-screened data of the to-be-screened terminal equipment through the target endpoint according to a target screen-throwing protocol corresponding to the to-be-screened terminal equipment, and displaying the to-be-screened data.

As an alternative implementation of the disclosed embodiments, the controller is further configured to:

Aiming at the terminal equipment accessed by the universal serial bus interface, acquiring identification information corresponding to the terminal equipment;

and judging whether the terminal equipment is the terminal equipment to be screen-projected or not based on the identification information.

As an alternative implementation of the disclosed embodiments, the controller is further configured to:

aiming at the terminal equipment to be screened, determining a preset type corresponding to the terminal equipment to be screened based on the identification information;

and determining a target screen projection protocol corresponding to the terminal equipment to be projected on the basis of the preset type.

As an alternative implementation of the disclosed embodiments, the controller is further configured to:

transmitting an authorization instruction to the terminal equipment to be screen-projected under the condition that the terminal equipment to be screen-projected is determined to be accessed to the display equipment for the first time, wherein the authorization instruction is used for indicating the terminal equipment to be screen-projected to authorize the access right of the display equipment;

and receiving an authorization success instruction sent by the terminal equipment to be screen-projected, and calling a screen-projected application program to acquire the data to be screen-projected through the target endpoint according to a target screen-projected protocol corresponding to the terminal equipment to be screen-projected.

As an alternative implementation of the embodiments of the present disclosure, the controller is specifically configured to:

when the universal serial bus interface is determined to be accessed into the terminal equipment to be screen-projected, sending an acquisition request to the terminal equipment to be screen-projected, wherein the acquisition request is used for requesting to acquire at least one piece of preset configuration information corresponding to the terminal equipment to be screen-projected;

and receiving at least one piece of preset configuration information sent by the terminal equipment to be screened, and determining the configuration information to be screened corresponding to the terminal equipment to be screened based on the at least one piece of preset configuration information corresponding to the terminal equipment to be screened.

As an alternative implementation of the disclosed embodiments, the controller is further configured to:

and when the universal serial bus interface is successfully configured, according to a target screen-throwing protocol corresponding to the terminal equipment to be screened, calling a screen-throwing application program, and when the target endpoint cannot acquire the data to be screened of the terminal equipment to be screened, sending prompt information to a user, wherein the prompt information is used for prompting the user to restart the terminal equipment to be screened.

As an alternative implementation of the embodiments of the present disclosure, the controller is specifically configured to:

And determining whether the non-screen-throwing application program of the universal serial bus interface exists or not by scanning at least one registration broadcast corresponding to the universal serial bus interface.

In a second aspect, the present disclosure provides a screen projection method, including: when the universal serial bus interface is determined to be accessed into the terminal equipment to be screened, acquiring the configuration information to be screened, which corresponds to the terminal equipment to be screened and comprises an endpoint identifier;

configuring the universal serial bus interface based on the configuration information to be screen-projected so as to determine a target endpoint for acquiring data to be screen-projected from a plurality of endpoints included in the universal serial bus interface;

if the configuration of the universal serial bus interface fails and a non-screen-throwing application program calling the universal serial bus interface exists, closing the non-screen-throwing application program, configuring the universal serial bus interface based on the to-be-screened configuration information until the configuration of the universal serial bus interface is determined to be successful, calling the screen-throwing application program to acquire to-be-screened data of the to-be-screened terminal equipment through the target endpoint according to a target screen-throwing protocol corresponding to the to-be-screened terminal equipment, and displaying the to-be-screened data.

As an optional implementation manner of the embodiment of the present disclosure, before determining that the universal serial bus interface is connected to the terminal device to be screened, the method further includes:

aiming at the terminal equipment accessed by the universal serial bus interface, acquiring identification information corresponding to the terminal equipment;

and judging whether the terminal equipment is the terminal equipment to be screen-projected or not based on the identification information.

In a third aspect, the present disclosure provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the method of screening as described in the second aspect.

Compared with the prior art, the technical scheme provided by the embodiment of the disclosure has the following advantages:

when the controller of the display equipment determines that the universal serial bus interface is accessed to the terminal equipment to be screen-projected, acquiring configuration information to be screen-projected, which corresponds to the terminal equipment to be screen-projected and comprises an endpoint identifier; configuring the universal serial bus interface based on the configuration information to be screened so as to determine a target endpoint for acquiring data to be screened from a plurality of endpoints included in the universal serial bus interface; if the configuration of the universal serial bus interface fails and a non-screen-throwing application program calling the universal serial bus interface exists, the non-screen-throwing application program is closed, the universal serial bus interface is configured based on the to-be-thrown screen configuration information until the success of the configuration of the universal serial bus interface is determined, and the screen-throwing application program is called to acquire to-be-thrown screen data of the to-be-thrown screen terminal equipment through a target endpoint according to a target screen-throwing protocol corresponding to the to-be-thrown screen terminal equipment and display the to-be-thrown screen data. According to the technical scheme, when the configuration of the universal serial bus interface fails according to the configuration information to be projected by the terminal equipment to be projected, the non-projected application program calling the universal serial bus interface can be detected and closed, then the universal serial bus interface is configured based on the configuration information to be projected, the problem that the universal serial bus interface has conflict in the prior art is solved, and the projection failure is avoided.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure.

In order to more clearly illustrate the embodiments of the present disclosure or the solutions in the prior art, the drawings that are required for the description of the embodiments or the prior art will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.

Fig. 1A is a schematic diagram of an application scenario between a display device, a control device, and a terminal device to be screen-displayed according to an embodiment of the present disclosure;

fig. 1B is a schematic view of a scene of splitting a screen in a video playing process in the prior art;

fig. 2 is a hardware configuration block diagram of a display device 200 in accordance with one or more embodiments of the present disclosure;

FIG. 3 is a schematic diagram of a software configuration in a display device 200 according to one or more embodiments of the present disclosure;

FIG. 4 is a schematic diagram of an icon control interface display for an application in a display device 200 in accordance with one or more embodiments of the present disclosure;

FIG. 5 is a diagram of a screen projection system framework in accordance with one or more embodiments of the present disclosure;

Fig. 6 is a schematic flow chart of a screen projection method according to an embodiment of the disclosure;

fig. 7 is a schematic view of a scenario displaying a user prompt interface according to an embodiment of the present disclosure;

fig. 8 is a schematic flow chart of another screen projection method according to an embodiment of the disclosure;

fig. 9 is a flowchart of another screen projection method according to an embodiment of the disclosure;

fig. 10 is a schematic view of a scenario of an authorization interface provided by an embodiment of the present disclosure;

fig. 11 is a flowchart of another screen projection method according to an embodiment of the disclosure.

Detailed Description

In order that the above objects, features and advantages of the present disclosure may be more clearly understood, a further description of aspects of the present disclosure will be provided below. It should be noted that, without conflict, the embodiments of the present disclosure and features in the embodiments may be combined with each other.

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure, but the present disclosure may be practiced otherwise than as described herein; it will be apparent that the embodiments in the specification are only some, but not all, embodiments of the disclosure.

The terms "first" and "second" and the like in this disclosure are used to distinguish between different objects and are not used to describe a particular order of objects. For example, the first processing result and the second processing result, etc., are used to distinguish between different processing results, not to describe a particular order of processing results.

The display device provided by the embodiment of the application can have various implementation forms, for example, a television, an intelligent television, a laser projection device, a display (monitor), an electronic whiteboard (electronic bulletin board), an electronic desktop (electronic table) and the like. The embodiments of the present disclosure are not limited to a specific type of display device.

1A-1B, FIG. 1A is a schematic view of an application scenario among a display device, a control device and a terminal device to be screen-projected according to an embodiment of the present disclosure, and FIG. 1B is a schematic view of a scenario in which a screen is projected between a display device and a terminal device to be screen-projected according to a wireless connection manner in the prior art. When a user views a video by using the terminal device 300 to be screen-cast, such as a smart phone, the content of the display interface of the terminal device 300 to be screen-cast, such as the smart phone, can be screen-cast onto another display device 200, such as a smart television, through a screen-cast technology, so that the user can view the content conveniently. At present, the screen is generally cast between the display device 200 and the terminal device 300 to be cast through a wireless network connection, however, because the screen casting mode of the wireless connection is limited by the network, factors of unstable network transmission are more, for example: the transmission condition of the channel, the influence of surrounding networks, the quality of routers and the like, and when the network transmission is unstable, the screen throwing effect is poor.

Based on the above-mentioned problems, in the prior art, a wired connection manner is adopted to perform screen projection, for example, a universal serial bus (Universal Serial Bus, USB) is used to connect the terminal device 300 to be projected with the display device 200, however, when the USB is used to connect the terminal device 300 to be projected with the display device 200, there are multiple protocols for the USB interface, each protocol corresponds to one operation mode, for example, a charging operation mode, a data downloading operation mode, a screen projection operation mode, etc., and since the USB interface can only operate in a single operation mode at a time, there is a problem of collision between the multiple protocols, which may cause a screen projection failure.

In order to solve the above-mentioned problems, an embodiment of the present disclosure provides a screen projection method, which obtains configuration information to be projected, including an endpoint identifier, corresponding to a terminal device to be projected when determining that a universal serial bus interface is connected to the terminal device to be projected; configuring the universal serial bus interface based on the configuration information to be screened so as to determine a target endpoint for acquiring data to be screened from a plurality of endpoints included in the universal serial bus interface; if the configuration of the universal serial bus interface fails and a non-screen-throwing application program calling the universal serial bus interface exists, the non-screen-throwing application program is closed, the universal serial bus interface is configured based on the to-be-thrown screen configuration information until the success of the configuration of the universal serial bus interface is determined, and the screen-throwing application program is called to acquire to-be-thrown screen data of the to-be-thrown screen terminal equipment through a target endpoint according to a target screen-throwing protocol corresponding to the to-be-thrown screen terminal equipment and display the to-be-thrown screen data. According to the technical scheme, when the configuration of the universal serial bus interface fails according to the configuration information to be projected by the terminal equipment to be projected, the non-projected application program calling the universal serial bus interface can be detected and closed, then the universal serial bus interface is configured based on the configuration information to be projected, the problem that the universal serial bus interface has conflict in the prior art is solved, and the projection failure is avoided.

In some embodiments, the control device 100 may be a remote control, and the communication between the remote control and the display device 200 may include infrared protocol communication, bluetooth protocol communication, wireless or other wired manner, etc., by which the display device 200 can be controlled. The user may control the display device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, and the like. Such as: the user can input corresponding control instructions through volume up-down keys, menu keys, on-off keys and the like on the remote controller to realize the function of controlling the display device 200.

In some embodiments, tablet computers, notebook computers, and other terminal devices may also be used to control display device 200.

In some embodiments, the display device 200 may receive instructions not using the control device described above, but rather receive control of the user by touch or gesture, or the like.

In some embodiments, the display device 200 may also directly receive the voice command control of the user by using an internally configured module for acquiring voice commands, or may receive the voice command control of the user by using a voice control device disposed outside the display device 200.

In some embodiments, the terminal device may install a software application with the display device 200, and implement connection communication through a network communication protocol, for the purpose of one-to-one control operation and data communication. The display device 200 may also be in data communication with a server via a variety of communication means, which may allow the display device 200 to be communicatively coupled via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server may be a cluster, or may be multiple clusters, and may include one or more types of servers. The server may provide various content and interactions to the display device 200. The display device 200 may be a liquid crystal display, an OLED display, a projection display device, or the like. The display device 200 may additionally provide an intelligent network television function of a computer support function in addition to the broadcast receiving television function.

Fig. 2 is a block diagram of a hardware configuration of a display device 200 in accordance with one or more embodiments of the present disclosure. The display apparatus 200 as shown in fig. 2 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, a user interface (i.e., a user input interface) 280. The controller 250 includes a central processor, a video processor, an audio processor, a graphic processor, a RAM, a ROM, and first to nth interfaces for input/output. The display 260 may be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and may also be a projection device and a projection screen. The modem 210 receives broadcast television signals through a wired or wireless reception manner, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals. The communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The display device 200 may establish transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220. The detector 230 is used to collect signals of the external environment or interaction with the outside. The controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box. The user interface 280 may be used to receive control signals for a control device, such as an infrared remote control or the like.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. The user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

In some embodiments, a "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user that enables conversion between an internal form of information and a form acceptable to the user. A commonly used presentation form of the user interface is a graphical user interface (Graphic User Interface, GUI for short), which refers to a user interface related to computer operations that is displayed in a graphical manner. It may be an interface element such as an icon, a window, and a control displayed in a display screen of the electronic device, where the control may include at least one of a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, and the like.

Fig. 3 is a schematic view of a software configuration in a display device 200 according to one or more embodiments of the present disclosure, as shown in fig. 3, the system is divided into four layers, namely, an application layer (application layer), an application framework layer (Application Framework layer), an Android run layer and a system library layer (system runtime layer), and a kernel layer from top to bottom.

In some embodiments, at least one application program is running in the application program layer, and these application programs may be a Window (Window) program of an operating system, a system setting program, a clock program, or the like; or may be an application developed by a third party developer. In particular implementations, applications in the application layer include, but are not limited to, the examples above.

In some embodiments, the system runtime layer provides support for the upper layer, the framework layer, and when the framework layer is in use, the android operating system runs the C/C++ libraries contained in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a layer between hardware and software, containing at least one of the following drivers: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.

Fig. 4 is a schematic diagram of an icon control interface display of an application in a display device 200 according to one or more embodiments of the present disclosure, where, as shown in fig. 4, an application layer includes at least one icon control that an application may display in a display, such as: a live television application icon control, a video on demand application icon control, a media center application icon control, an application center icon control, a game application icon control, and the like. Live television applications can provide live television through different signal sources. Video on demand applications may provide video from different storage sources. Unlike live television applications, video-on-demand provides video displays from some storage sources. The media center application may provide various applications for playing multimedia content. An application center may be provided to store various applications.

In some embodiments, the display device is a terminal device having a display function, such as a television, a mobile phone, a computer, a learning machine, and the like. In the display device:

a controller 250 configured to: when the universal serial bus interface is determined to be accessed into the terminal equipment to be screened, acquiring the configuration information to be screened, which corresponds to the terminal equipment to be screened and comprises an endpoint identifier;

Configuring the universal serial bus interface based on the configuration information to be screen-projected so as to determine a target endpoint for acquiring data to be screen-projected from a plurality of endpoints included in the universal serial bus interface;

if the configuration of the universal serial bus interface fails and a non-screen-throwing application program calling the universal serial bus interface exists, closing the non-screen-throwing application program, configuring the universal serial bus interface based on the to-be-screened configuration information until the configuration of the universal serial bus interface is determined to be successful, calling the screen-throwing application program to acquire to-be-screened data of the to-be-screened terminal equipment through the target endpoint according to a target screen-throwing protocol corresponding to the to-be-screened terminal equipment, and displaying the to-be-screened data.

In some embodiments, the controller 250 is further configured to:

aiming at the terminal equipment accessed by the universal serial bus interface, acquiring identification information corresponding to the terminal equipment;

and judging whether the terminal equipment is the terminal equipment to be screen-projected or not based on the identification information.

In some embodiments, the controller 250 is further configured to:

aiming at the terminal equipment to be screened, determining a preset type corresponding to the terminal equipment to be screened based on the identification information;

And determining a target screen projection protocol corresponding to the terminal equipment to be projected on the basis of the preset type.

In some embodiments, the controller 250 is further configured to:

transmitting an authorization instruction to the terminal equipment to be screen-projected under the condition that the terminal equipment to be screen-projected is determined to be accessed to the display equipment for the first time, wherein the authorization instruction is used for indicating the terminal equipment to be screen-projected to authorize the access right of the display equipment;

and receiving an authorization success instruction sent by the terminal equipment to be screen-projected, and calling a screen-projected application program to acquire the data to be screen-projected through the target endpoint according to a target screen-projected protocol corresponding to the terminal equipment to be screen-projected.

In some embodiments, the controller 250 is specifically configured to:

when the universal serial bus interface is determined to be accessed into the terminal equipment to be screen-projected, sending an acquisition request to the terminal equipment to be screen-projected, wherein the acquisition request is used for requesting to acquire at least one piece of preset configuration information corresponding to the terminal equipment to be screen-projected;

and receiving at least one piece of preset configuration information sent by the terminal equipment to be screened, and determining the configuration information to be screened corresponding to the terminal equipment to be screened based on the at least one piece of preset configuration information corresponding to the terminal equipment to be screened.

In some embodiments, the controller 250 is further configured to:

and when the universal serial bus interface is successfully configured, according to a target screen-throwing protocol corresponding to the terminal equipment to be screened, calling a screen-throwing application program, and when the target endpoint cannot acquire the data to be screened of the terminal equipment to be screened, sending prompt information to a user, wherein the prompt information is used for prompting the user to restart the terminal equipment to be screened.

In some embodiments, the controller 250 is specifically configured to:

and determining whether the non-screen-throwing application program of the universal serial bus interface exists or not by scanning at least one registration broadcast corresponding to the universal serial bus interface.

In summary, by executing the screen projection method on the display device, when the controller of the display device determines that the universal serial bus interface is accessed to the terminal device to be projected, acquiring the configuration information to be projected, including the endpoint identifier, corresponding to the terminal device to be projected; configuring the universal serial bus interface based on the configuration information to be screened so as to determine a target endpoint for acquiring data to be screened from a plurality of endpoints included in the universal serial bus interface; if the configuration of the universal serial bus interface fails and a non-screen-throwing application program calling the universal serial bus interface exists, the non-screen-throwing application program is closed, the universal serial bus interface is configured based on the to-be-thrown screen configuration information until the success of the configuration of the universal serial bus interface is determined, and the screen-throwing application program is called to acquire to-be-thrown screen data of the to-be-thrown screen terminal equipment through a target endpoint according to a target screen-throwing protocol corresponding to the to-be-thrown screen terminal equipment and display the to-be-thrown screen data. According to the technical scheme, when the configuration of the universal serial bus interface fails according to the configuration information to be projected by the terminal equipment to be projected, the non-projected application program calling the universal serial bus interface can be detected and closed, then the universal serial bus interface is configured based on the configuration information to be projected, the problem that the universal serial bus interface has conflict in the prior art is solved, and the projection failure is avoided.

Fig. 5 is a frame diagram of a projection system according to one or more embodiments of the present disclosure, where the system may include a configuration information acquisition module 401, a target endpoint determination module 402, and a processing module 403, as shown in fig. 5. The configuration information acquisition module is used for acquiring configuration information of the screen to be projected, which corresponds to the terminal equipment of the screen to be projected and comprises an endpoint identifier, when the universal serial bus interface is determined to be accessed to the terminal equipment of the screen to be projected; the target endpoint determining module is used for configuring the universal serial bus interface based on the configuration information to be screened so as to determine a target endpoint for acquiring the data to be screened from a plurality of endpoints included in the universal serial bus interface; the processing module is used for closing the non-screen-throwing application program if the configuration of the universal serial bus interface fails and the non-screen-throwing application program calling the universal serial bus interface exists, configuring the universal serial bus interface based on the to-be-thrown screen configuration information until the universal serial bus interface is determined to be successfully configured, calling the screen-throwing application program according to a target screen-throwing protocol corresponding to the to-be-thrown screen terminal equipment, acquiring to-be-thrown screen data of the to-be-thrown screen terminal equipment through a target endpoint, and displaying the to-be-thrown screen data. According to the technical scheme, when the configuration of the universal serial bus interface fails according to the configuration information to be projected by the terminal equipment to be projected, the non-projected application program calling the universal serial bus interface can be detected and closed, then the universal serial bus interface is configured based on the configuration information to be projected, the problem that the universal serial bus interface has conflict in the prior art is solved, and the projection failure is avoided.

For a more detailed description of the present solution, the following description will be given by way of example with reference to fig. 6, and it will be understood that the steps involved in fig. 6 may include more steps or fewer steps when actually implemented, and the order of these steps may also be different, so long as the screen projection method provided in the embodiments of the present disclosure can be implemented, and the embodiments of the present disclosure are not limited.

Fig. 6 is a schematic flow chart of a screen projection method according to an embodiment of the disclosure. As shown in fig. 6, the screen projection method specifically includes the following steps:

s610, when the universal serial bus interface is determined to be accessed to the terminal equipment to be screened, acquiring the configuration information to be screened, which corresponds to the terminal equipment to be screened and comprises the endpoint identification.

The USB interface has a hot plug function, and can be connected with various external devices, such as a mouse, a keyboard, a smart phone, a notebook, etc., but is not limited thereto.

The above-mentioned configuration information to be screen-projected is used for configuring the USB interface before the display device projects the screen of the device to be screen-projected, and after configuring the USB interface based on the configuration information to be screen-projected, so that the USB interface can work in the screen-projected working mode, and the configuration information to be screen-projected includes, but is not limited to, endpoint identification, where the endpoint identification is used for determining an endpoint for acquiring the data to be screen-projected in a plurality of endpoints included in the USB interface.

Specifically, when the controller of the display device determines that the universal serial bus interface is connected to the terminal device to be screen-projected, the controller acquires the configuration information to be screen-projected, including the endpoint identifier, corresponding to the terminal device to be screen-projected.

S620, configuring the universal serial bus interface based on the configuration information to be screened so as to determine a target endpoint for acquiring the data to be screened from a plurality of endpoints included in the universal serial bus interface.

Specifically, after obtaining the configuration information to be screened corresponding to the terminal equipment to be screened and including the endpoint identifier, the controller of the display equipment performs configuration processing on the universal serial bus interface of the display equipment according to the configuration information to be screened, so that the target endpoint for obtaining the data to be screened corresponding to the terminal equipment to be screened can be determined from a plurality of endpoints included in the USB interface.

The method includes the steps of comparing the endpoint identifier in the configuration information to be screened with identifiers corresponding to the endpoints respectively, so as to determine a target endpoint for acquiring the data to be screened corresponding to the terminal device to be screened, which is not limited to the method.

And S630, if the configuration of the universal serial bus interface fails and a non-screen-throwing application program calling the universal serial bus interface exists, closing the non-screen-throwing application program, configuring the universal serial bus interface based on the to-be-thrown screen configuration information until the configuration of the universal serial bus interface is determined to be successful, calling the screen-throwing application program to acquire to-be-thrown screen data of the to-be-thrown screen terminal equipment through a target endpoint according to a target screen-throwing protocol corresponding to the to-be-thrown screen terminal equipment, and displaying the to-be-thrown screen data.

When the USB interface works in other working modes except the screen-throwing working mode, such as a charging working mode and a data downloading working mode of the terminal equipment, the USB interface can work by calling the non-screen-throwing application programs corresponding to different working modes. Based on the above, when the configuration of the universal serial bus interface fails, whether the USB interface has a non-screen-throwing application program currently is detected, and if so, the phenomenon that the current USB interface has conflict is represented.

Optionally, based on the above embodiments, in some embodiments of the present disclosure, further, one possible implementation manner of detecting whether the USB interface currently has a non-screen-throwing application program is detected:

and determining whether a non-screen-throwing application program of the universal serial bus interface exists or not by scanning at least one registration broadcast corresponding to the universal serial bus interface.

The registration broadcast is to register a plurality of USB broadcasts on the display device, where the USB broadcasts are used to determine whether a terminal device is connected to the USB interface, or when it is determined that the terminal device to be connected to the USB interface is connected to the USB interface, the plurality of registration broadcasts are scanned by dumpsys activity broadcasts to determine that the current display device registers application programs of each registration broadcast, further, among the plurality of application programs, it is determined that the application programs of the registration USB broadcasts are application programs corresponding to the USB interface, and for the application programs corresponding to the USB interface, it is determined whether there are non-screen-throwing application programs according to preset identification information of the non-screen-throwing application programs and application information of each application program corresponding to the USB interface.

For example, for a terminal DEVICE to be on screen, a USB broadcast is set to "android, hardware, usb_device_authorized", when a plurality of registration broadcasts of a display DEVICE are scanned through dumpsys activity broadcasts, and when an application program of "android, hardware, usb_device_authorized" is scanned in the plurality of registration broadcasts, it is determined that the application program is an application program corresponding to a USB interface, and further, whether there is a non-on screen application program is determined according to identification information of the non-on screen application program and application information of the application program corresponding to the USB interface. But is not limited thereto, and the present disclosure is not particularly limited.

The above-mentioned target screen-throwing protocol is used in the process of obtaining the screen-throwing data of the terminal equipment to be thrown by the display equipment, and it is required to explain that different systems installed on the terminal equipment to be thrown, such as an android system and an IOS system, respectively correspond to different screen-throwing protocols.

Specifically, when the controller of the display device determines that the configuration of the universal serial bus interface fails, and determines that a non-screen-throwing application program calling the universal serial bus interface exists currently, the non-screen-throwing application program calling the universal serial bus interface is closed, after the non-screen-throwing application program calling the universal serial bus interface is determined to be closed, the universal serial bus interface is reconfigured based on the configuration information to be thrown, until the configuration of the universal serial bus interface is determined to be successful, the screen-throwing application program is called according to a target screen-throwing protocol corresponding to the terminal device to be thrown, the data to be thrown of the terminal device to be thrown is obtained through a target endpoint, and the content of a display interface corresponding to the terminal device to be thrown is displayed on a display interface of the display device according to the data to be thrown.

It should be noted that, when the configuration of the USB interface fails, and a preset ERROR code value is detected, for example, the preset ERROR code value is libusb_error_busy, it is determined that a conflict exists in the current USB interface.

Optionally, in some embodiments of the present disclosure, when the configuration of the usb interface fails, a prompt message may be sent to the user to prompt the user that the configuration of the usb interface fails, so that the screen between the display device and the terminal device to be screen cannot be screen-projected. For example, referring to fig. 7, when the configuration of the usb interface fails, a user prompt interface 203 is displayed on the display interface of the display device 200, and a prompt of "drop configuration failure" is displayed on the user prompt interface 203, but not limited thereto, the present disclosure is not particularly limited, and those skilled in the art may specifically set according to actual situations.

Optionally, in some embodiments of the present disclosure, after the non-screen-throwing application program is turned off, in order to ensure that the non-screen-throwing application program thoroughly releases the resources of the universal serial bus interface, after waiting for a preset period of time, the universal serial bus interface may be reconfigured based on the configuration information to be thrown. The value of the preset duration is not particularly limited, and may be set by those skilled in the art according to actual situations.

In the technical scheme provided by the embodiment of the disclosure, when a controller of a display device determines that a universal serial bus interface is connected to terminal equipment to be screen-projected, acquiring configuration information to be screen-projected, which corresponds to the terminal equipment to be screen-projected and comprises an endpoint identifier; configuring the universal serial bus interface based on the configuration information to be screened so as to determine a target endpoint for acquiring data to be screened from a plurality of endpoints included in the universal serial bus interface; if the configuration of the universal serial bus interface fails and a non-screen-throwing application program calling the universal serial bus interface exists, the non-screen-throwing application program is closed, the universal serial bus interface is configured based on the to-be-thrown screen configuration information until the success of the configuration of the universal serial bus interface is determined, and the screen-throwing application program is called to acquire to-be-thrown screen data of the to-be-thrown screen terminal equipment through a target endpoint according to a target screen-throwing protocol corresponding to the to-be-thrown screen terminal equipment and display the to-be-thrown screen data. According to the technical scheme, when the configuration of the universal serial bus interface fails according to the configuration information to be projected by the terminal equipment to be projected, the non-projected application program calling the universal serial bus interface can be detected and closed, then the universal serial bus interface is configured based on the configuration information to be projected, the problem that the universal serial bus interface has conflict in the prior art is solved, and the projection failure is avoided.

Fig. 8 is a flow chart of another screen projection method provided in the embodiment of the present disclosure, and fig. 8 is a flowchart of another screen projection method based on the embodiment shown in fig. 6, further, as shown in fig. 8, before executing S610, further including:

s810, aiming at the terminal equipment accessed by the universal serial bus interface, acquiring the identification information corresponding to the terminal equipment.

The identification information is used for judging whether the terminal equipment accessed by the universal serial bus interface is the terminal equipment to be screen-switched, and the terminal equipment accessed by the universal serial bus interface comprises, but is not limited to, the terminal equipment to be screen-switched, such as a smart phone, a notebook computer and a smart computer, and can also be a network card and a USB flash disk. For example, the identification information may be a Vendor ID (VID) and a Product ID (PID), and the VID corresponding to the terminal device on which the IOS system is installed is exemplified as follows: 0x5ac, pid: [0x1290,0x12af ], but not limited thereto, the present disclosure is not particularly limited, and those skilled in the art can specifically set according to actual situations.

S820, based on the identification information, judging whether the terminal equipment is the terminal equipment to be screen-thrown.

Specifically, when the controller of the display device monitors that the universal serial bus interface is accessed to the terminal device, the controller acquires identification information corresponding to the terminal device aiming at the terminal device accessed to the universal serial bus interface, and judges whether the terminal device is the terminal device to be screen-thrown according to the identification information of the terminal device.

Optionally, on the basis of the foregoing embodiments, in some embodiments of the present disclosure, different systems, such as an android system and an IOS system, are installed on the terminal device to be screen-projected, so that different systems correspond to different screen-projected protocols respectively. Based on this, in order to ensure that the screen-throwing function between the display device and the terminal device to be thrown is realized, after S620 is executed, as shown in fig. 9, further including:

s910, if the configuration of the universal serial bus interface fails, and a non-screen-throwing application program calling the universal serial bus interface exists, closing the non-screen-throwing application program, and configuring the universal serial bus interface based on the configuration information to be screen-throwing until the successful configuration of the universal serial bus interface is determined.

S920, aiming at the terminal equipment to be screened, determining the preset type corresponding to the terminal equipment to be screened based on the identification information.

The preset type refers to a type corresponding to the installation system of the terminal equipment to be screen-thrown.

Specifically, when the controller of the display device determines that the configuration of the universal serial bus interface fails, and determines that a non-screen-throwing application program calling the universal serial bus interface exists currently, the non-screen-throwing application program calling the universal serial bus interface is closed, after the non-screen-throwing application program calling the universal serial bus interface is determined to be closed, the universal serial bus interface is reconfigured based on the configuration information to be screened until the configuration of the universal serial bus interface is determined to be successful, and the preset type corresponding to the terminal device to be screened is determined according to the identification information of the terminal device to be screened, which is accessed into the universal serial bus interface.

Illustratively, the above embodiments are carried over for identification information such as VID:0x5ac, pid: the preset type of the terminal device to be screen-switched to the universal serial bus interface currently can be determined as the terminal device to be screen-switched to install the IOS system by [0x1290,0x12af ], but the present disclosure is not limited thereto, and the present disclosure can be specifically set by those skilled in the art according to actual situations.

S930, determining a target screen projection protocol corresponding to the terminal equipment to be screened based on the preset type.

S940, according to a target screen projection protocol corresponding to the terminal equipment to be projected, calling a screen projection application program to acquire the data to be projected of the terminal equipment to be projected through a target endpoint, and displaying the data.

Specifically, for the terminal equipment to be screened, a controller of the display equipment determines a target screening protocol corresponding to the terminal equipment to be screened according to a preset type of the terminal equipment to be screened, after the target screening protocol corresponding to the terminal equipment to be screened is obtained, a screening application program is called according to the target screening protocol, screen data to be screened of the terminal equipment to be screened is obtained through a target endpoint, and display interface content corresponding to the terminal equipment to be screened is displayed on a display interface of the display equipment according to the screen data to be screened.

According to the technical scheme provided by the embodiment of the disclosure, in the process, the target screen projection protocol corresponding to the terminal equipment to be projected can be determined according to the preset type of the terminal equipment to be projected, so that the failure of screen projection between the display equipment and the terminal equipment to be projected is avoided.

Optionally, on the basis of the foregoing embodiments, in some embodiments of the present disclosure, before executing the target screen-casting protocol corresponding to the terminal device to be screened, invoking the screen-casting application program to obtain, through the target endpoint, the data to be screened of the terminal device to be screened, further includes:

and sending an authorization instruction to the terminal equipment to be screened under the condition that the terminal equipment to be screened is determined to be accessed to the display equipment for the first time.

The authorization instruction is used for indicating the terminal equipment to be screen-thrown to authorize the access right of the display equipment.

Specifically, when the controller of the display device determines that the terminal device to be screen-projected is first accessed to the display device, an authorization instruction is sent to the terminal device to be screen-projected to instruct the terminal device to be screen-projected to carry out authorization processing on the access right of the terminal device to be screen-projected by the display device, and correspondingly, after receiving the authorization instruction sent by the display device, the terminal device to be screen-projected responds to the operation of a user on a target key to complete the authorization on the access right of the display device, and then sends an instruction of an authorization success instruction to the display device.

As illustrated in fig. 10, the controller of the display device sends an authorization command to the terminal device to be screen-projected, and after receiving the authorization command, the terminal device to be screen-projected pops up an authorization interface 101 on the terminal device to be screen-projected, where the authorization interface 101 displays "allow the device to access", and when the user clicks an allow virtual key on the authorization interface 101, the terminal device to be screen-projected sends an authorization success command to the display device in response to the operation, which is not limited to this, the disclosure is not particularly limited, and those skilled in the art can specifically set according to the actual situation.

And receiving an authorization success instruction sent by the terminal equipment to be screened, and calling a screening application program to acquire the data to be screened through a target endpoint according to a target screening protocol corresponding to the terminal equipment to be screened.

Specifically, after receiving an authorization success instruction sent by the terminal equipment to be screen-projected, the controller of the display equipment determines that the current display equipment has access right to the terminal equipment to be screen-projected, and further calls a screen-projected application program to acquire the data to be screen-projected through a target endpoint according to a target screen-projected protocol corresponding to the terminal equipment to be screen-projected.

In the technical scheme provided by the embodiment of the disclosure, before the to-be-screen data corresponding to the to-be-screen terminal equipment is acquired, the current display equipment is determined to have the access right of the to-be-screen terminal equipment, so that the follow-up normal acquisition of the to-be-screen data is ensured.

Fig. 11 is a flowchart of another screen projection method provided by an embodiment of the present disclosure, and fig. 11 is a flowchart of an embodiment shown in fig. 9, where further, as shown in fig. 11, an implementation manner of executing S610 may be:

s1110, when the universal serial bus interface is determined to be accessed to the terminal equipment to be screen-projected, an acquisition request is sent to the terminal equipment to be screen-projected.

The acquisition request is used for requesting to acquire at least one piece of preset configuration information corresponding to the terminal equipment to be screen-switched. The preset configuration information is used for configuring the universal serial bus interface according to the preset configuration information corresponding to each working mode when the universal serial bus interface works in different working modes, so that the universal serial bus interface can work normally. For example, when the current usb interface is operated in the charging operation mode, the usb interface needs to be configured through corresponding charging configuration information, but the present disclosure is not limited thereto, and one skilled in the art may specifically set according to practical situations.

Specifically, when the controller of the display device determines that the universal serial bus interface is connected to the terminal device to be screened, an acquisition request for acquiring one or more pieces of preset configuration information corresponding to the terminal device to be screened is sent to the terminal device to be screened, so that one or more pieces of preset configuration information corresponding to the terminal device to be screened are acquired, and correspondingly, when the terminal device to be screened receives the acquisition request, the one or more pieces of preset configuration information are sent to the display device.

It should be noted that, for the terminal device to be screen-projected, when the terminal device to be screen-projected installs different systems, when the terminal device to be screen-projected receives the acquisition request, the preset configuration information is sent to the display device differently.

The method includes that when an android system is installed in a terminal device to be screen-projected, when an acquisition request is received, preset configuration information is sent to a display device, wherein the preset configuration information is the configuration information to be screen-projected, or when an IOS system is installed in the terminal device to be screen-projected, when the acquisition request is received, a plurality of preset configuration information is sent to the display device, and the configuration information corresponding to the configuration information to be screen-projected and other working modes is included in the plurality of preset configuration information.

S1120, receiving at least one piece of preset configuration information sent by the terminal equipment to be screened, and determining the configuration information to be screened corresponding to the terminal equipment to be screened based on the at least one piece of preset configuration information corresponding to the terminal equipment to be screened.

Specifically, when receiving one or more pieces of preset configuration information sent by the terminal equipment to be screened, the controller of the display equipment can determine the configuration information to be screened corresponding to the terminal equipment to be screened in the one or more pieces of preset configuration information.

Optionally, on the basis of the foregoing embodiments, in some embodiments of the disclosure, the method further includes:

when the universal serial bus interface is successfully configured, according to a target screen-throwing protocol corresponding to the terminal equipment to be screened, a screen-throwing application program is called, and when the screen-throwing data of the terminal equipment to be screened cannot be acquired through a target endpoint, prompt information is sent to a user, and the prompt information is used for prompting the user to restart the terminal equipment to be screened.

Specifically, when the controller of the display device determines that the configuration of the universal serial bus interface is successful, according to a target screen-throwing protocol corresponding to the terminal device to be screened, a screen-throwing application program is called, and when the target endpoint included by the universal serial bus interface cannot acquire the data to be screened corresponding to the terminal device to be screened, prompt information is sent to a user at the moment, and the prompt information is used for prompting the user to restart the terminal device to be screened.

It should be noted that, for the above case that the controller of the display device determines that the configuration of the usb interface is successful, the to-be-screen data corresponding to the to-be-screened terminal device still cannot be acquired, at this time, an error may occur in the process of acquiring the to-be-screened data through the target endpoint included in the usb interface, further, the controller of the display device detects the type of the error occurring in the transmission process of the to-be-screened data, determines whether the error occurring currently belongs to the preset type of error, and because the preset type of error does not belong to the conventional error, the controller does not have a fixed error code, and the to-be-screened terminal device does not send error information, based on this, when it is determined that the error occurring currently belongs to the preset type of error, the system of the to-be-screened terminal device is disordered, normal interaction with the display device cannot be performed, and based on this, the display device may send prompt information to the user to restart the to-be-screened terminal device through the prompt information.

In the technical scheme provided by the embodiment of the disclosure, in the above process, under the condition that the controller of the display device determines that the configuration of the universal serial bus interface is successful, the to-be-screen data corresponding to the to-be-screen terminal device still cannot be obtained, and prompt information can be timely sent to the user, so that the user is prompted to restart the to-be-screen terminal device, and the user experience is improved.

The embodiments of the present disclosure provide a computer readable storage medium, on which a computer program is stored, where the computer program when executed by a processor implements each process executed by the above-mentioned screen projection method, and the same technical effects can be achieved, and for avoiding repetition, a detailed description is omitted herein.

The computer readable storage medium may be a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk, an optical disk, or the like.

The present disclosure provides a computer program product comprising: the computer program product, when run on a computer, causes the computer to implement the screen projection method described above.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the above discussion in some examples is not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims (10)

1. A display device, characterized by comprising:

a controller configured to:

when the universal serial bus interface is determined to be accessed into the terminal equipment to be screened, acquiring the configuration information to be screened, which corresponds to the terminal equipment to be screened and comprises an endpoint identifier;

configuring the universal serial bus interface based on the configuration information to be screen-projected so as to determine a target endpoint for acquiring data to be screen-projected from a plurality of endpoints included in the universal serial bus interface;

if the configuration of the universal serial bus interface fails and a non-screen-throwing application program calling the universal serial bus interface exists, closing the non-screen-throwing application program, configuring the universal serial bus interface based on the to-be-screened configuration information until the configuration of the universal serial bus interface is determined to be successful, calling the screen-throwing application program to acquire to-be-screened data of the to-be-screened terminal equipment through the target endpoint according to a target screen-throwing protocol corresponding to the to-be-screened terminal equipment, and displaying the to-be-screened data.

2. The display device of claim 1, wherein the controller is further configured to:

aiming at the terminal equipment accessed by the universal serial bus interface, acquiring identification information corresponding to the terminal equipment;

And judging whether the terminal equipment is the terminal equipment to be screen-projected or not based on the identification information.

3. The display device of claim 2, wherein the controller is further configured to:

aiming at the terminal equipment to be screened, determining a preset type corresponding to the terminal equipment to be screened based on the identification information;

and determining a target screen projection protocol corresponding to the terminal equipment to be projected on the basis of the preset type.

4. The display device of claim 1, wherein the controller is further configured to:

transmitting an authorization instruction to the terminal equipment to be screen-projected under the condition that the terminal equipment to be screen-projected is determined to be accessed to the display equipment for the first time, wherein the authorization instruction is used for indicating the terminal equipment to be screen-projected to authorize the access right of the display equipment;

and receiving an authorization success instruction sent by the terminal equipment to be screen-projected, and calling a screen-projected application program to acquire the data to be screen-projected through the target endpoint according to a target screen-projected protocol corresponding to the terminal equipment to be screen-projected.

5. The display device of claim 1, wherein the controller is specifically configured to:

When the universal serial bus interface is determined to be accessed into the terminal equipment to be screen-projected, sending an acquisition request to the terminal equipment to be screen-projected, wherein the acquisition request is used for requesting to acquire at least one piece of preset configuration information corresponding to the terminal equipment to be screen-projected;

and receiving at least one piece of preset configuration information sent by the terminal equipment to be screened, and determining the configuration information to be screened corresponding to the terminal equipment to be screened based on the at least one piece of preset configuration information corresponding to the terminal equipment to be screened.

6. The display device of claim 1, wherein the controller is further configured to:

and when the universal serial bus interface is successfully configured, according to a target screen-throwing protocol corresponding to the terminal equipment to be screened, calling a screen-throwing application program, and when the target endpoint cannot acquire the data to be screened of the terminal equipment to be screened, sending prompt information to a user, wherein the prompt information is used for prompting the user to restart the terminal equipment to be screened.

7. The display device of claim 1, wherein the controller is specifically configured to:

and determining whether the non-screen-throwing application program of the universal serial bus interface exists or not by scanning at least one registration broadcast corresponding to the universal serial bus interface.

8. A screen projection method, comprising:

when the universal serial bus interface is determined to be accessed into the terminal equipment to be screened, acquiring the configuration information to be screened, which corresponds to the terminal equipment to be screened and comprises an endpoint identifier;

configuring the universal serial bus interface based on the configuration information to be screen-projected so as to determine a target endpoint for acquiring data to be screen-projected from a plurality of endpoints included in the universal serial bus interface;

if the configuration of the universal serial bus interface fails and a non-screen-throwing application program calling the universal serial bus interface exists, closing the non-screen-throwing application program, configuring the universal serial bus interface based on the to-be-screened configuration information until the configuration of the universal serial bus interface is determined to be successful, calling the screen-throwing application program to acquire to-be-screened data of the to-be-screened terminal equipment through the target endpoint according to a target screen-throwing protocol corresponding to the to-be-screened terminal equipment, and displaying the to-be-screened data.

9. The method of claim 8, wherein prior to determining that the universal serial bus interface is to be accessed to the terminal device to be screened, further comprising:

Aiming at the terminal equipment accessed by the universal serial bus interface, acquiring identification information corresponding to the terminal equipment;

and judging whether the terminal equipment is the terminal equipment to be screen-projected or not based on the identification information.

10. A computer-readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the steps of the screen projection method according to any one of claims 8-9.