CN115914694A - Display device and network connection method based on USB link - Google Patents

Abstract

The application relates to the technical field of display equipment, in particular to display equipment and a network connection method based on a USB link, which can solve the problem that display based on transmission data is jammed to a certain extent due to the fact that a transmission speed bottleneck is formed when data transmission is carried out between household intelligent equipment because the bandwidth of a local area network is limited, the network card has low supporting bandwidth capacity, or the maximum allowable transmission bandwidth of a network cable is insufficient. The display device includes: a first USB port; a controller configured to: the method comprises the steps of controlling a video resource transmitted by a virtual network card to be split into a first data set and a second data set, wherein the first data set is sent to a second network card of opposite-end equipment through a corresponding network link through the first network card, the second data set is sent to a second USB port of the opposite-end equipment through a corresponding USB link through the first USB port, and the first data set and the second data set reach the opposite-end equipment and are integrated and restored into the video resource.

Description

Display device and network connection method based on USB link

Technical Field

The application relates to the technical field of display equipment, in particular to display equipment and a network connection method based on a USB link.

Background

The network television is based on a broadband high-speed IP network, takes network resources as a main body, takes a television, a personal computer and handheld equipment as a display terminal, and realizes services such as a digital television, a time-shifting television, an interactive television and the like by accessing a broadband network. The appearance of the intelligent network television brings a brand-new television watching and using scene, for example, applications of sharing a screen, transmitting videos, projecting contents and the like among a plurality of televisions and intelligent devices in a family are realized.

In some implementations of network data transmission between display devices, most display devices and intelligent terminals only allow data to be transmitted through one network access mode at the same time, and usually multiple devices need to be connected to the same wired or wireless local area network, and then a user needs to operate content data of the current display device to transmit the content data to another networked device so as to complete data transmission between the devices, thereby implementing services such as screen projection, data transmission and the like.

However, when a large amount of data is transmitted to a VR device with a high requirement on a delay index, if the local area network where the device is located has a limited bandwidth, or the networking device network card itself has a low supported bandwidth capability, or the maximum transmission bandwidth allowed by the network cable used in the local area network is insufficient, a speed bottleneck is generated in data transmission between the devices, which causes the VR device to display a card.

Disclosure of Invention

In order to solve the problem that display based on transmission data is blocked due to the fact that a transmission speed bottleneck is formed due to the fact that the bandwidth of a local area network is limited, the network card has low supporting bandwidth capacity, or the maximum allowable transmission bandwidth of a network cable is insufficient when data transmission is conducted among home intelligent devices, the application provides display equipment and a network connection method based on a USB link.

The embodiment of the application is realized as follows:

a first aspect of embodiments of the present application provides a display device, including: a display; the first USB port is used for being connected to opposite-end equipment through a USB link; the network card comprises a first network card and a virtual network card which are connected to opposite-end equipment through a network link; a controller configured to: when a signaling for displaying a video resource on an opposite-end device is received, controlling the video resource transmitted by a virtual network card to be split into a first data set and a second data set, wherein the first data set is transmitted to a second network card of the opposite-end device through a corresponding network link via the first network card, the second data set is transmitted to a second USB port of the opposite-end device through a corresponding USB link via the first USB port, and the first data set and the second data set reach the opposite-end device and are integrated and restored into the video resource; wherein the ratio of the first data set to the second data set is allocated according to the transmission capacity ratio of the network link to the USB link, and the network packets contained in the second data set are encapsulated into USB packets suitable for transmission by the USB link during transmission.

A second aspect of an embodiment of the present application provides a network connection method based on a USB link, where the method includes: when a signaling for displaying a video resource on an opposite-end device is received, controlling the video resource transmitted by a virtual network card to be split into a first data set and a second data set, wherein the first data set is transmitted to a second network card of the opposite-end device through a corresponding network link via the first network card, the second data set is transmitted to a second USB port of the opposite-end device through a corresponding USB link via the first USB port, and the first data set and the second data set reach the opposite-end device and are integrated and restored into the video resource; wherein the ratio of the first data set to the second data set is allocated according to the transmission capacity ratio of the network link to the USB link, and the network packets contained in the second data set are encapsulated into USB packets suitable for transmission by the USB link during transmission.

The method has the advantages that double-link aggregation networking among the devices can be realized by constructing the network link and the USB link among the devices; further, by constructing the first data set and the second data set, the aggregate transmission of the data to be transmitted can be realized; further, by constructing the virtual network card, data transceiving between the network card and the USB port can be realized by specific application, data can be transmitted between the devices through the network link and the USB link simultaneously, the network transmission bandwidth is improved, the network transmission bottleneck is broken through, and the local area network-oriented multilink aggregation speed increase is realized.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to these drawings without inventive exercise.

Fig. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus according to one or more embodiments of the present application;

fig. 2 is a block diagram of a hardware configuration of a display apparatus 200 according to one or more embodiments of the present application;

fig. 3 is a block diagram of a hardware configuration of the control apparatus 100 according to one or more embodiments of the present application;

fig. 4 is a schematic diagram of a software configuration in a display device 200 according to one or more embodiments of the present application;

FIG. 5 is a schematic illustration of an icon control interface display of an application in a display device 200 according to one or more embodiments of the present application;

fig. 6A is a schematic diagram illustrating a user interface of smart tv data according to an embodiment of the present application;

fig. 6B shows a schematic diagram of an architecture and a user interface for data transmission of a smart tv and VR glasses according to another embodiment of the present application;

fig. 6C is a schematic diagram illustrating an architecture and a user interface of a smart tv and VR glasses for data transmission according to another embodiment of the present application;

fig. 6D is a schematic diagram illustrating a framework and a user interface for data transmission between smart tvs according to another embodiment of the present application;

fig. 6E shows a schematic diagram of a framework and a user interface for data transmission of the smart tv and VR glasses according to another embodiment of the present application;

FIG. 7 is a logic diagram illustrating USB encapsulation and decapsulation of data transferred between devices according to another embodiment of the present application;

fig. 8 shows a logic diagram of data transmission of the smart tv according to another embodiment of the present application;

fig. 9 is a logic diagram illustrating data reception of an intelligent tv according to another embodiment of the present application;

fig. 10 is a schematic diagram illustrating a control of speed increase of a dual-link network between devices according to another embodiment of the present application.

Detailed Description

To make the objects, embodiments and advantages of the present application clearer, the following description of exemplary embodiments of the present application will clearly and completely describe the exemplary embodiments of the present application with reference to the accompanying drawings in the exemplary embodiments of the present application, and it is to be understood that the described exemplary embodiments are only a part of the embodiments of the present application, and not all of the embodiments.

All other embodiments, which can be derived by a person skilled in the art from the exemplary embodiments described herein without inventive step, are intended to be within the scope of the claims appended hereto. In addition, while the disclosure herein has been presented in terms of one or more exemplary examples, it should be appreciated that aspects of the disclosure may be implemented solely as a complete embodiment. It should be noted that the brief descriptions of the terms in the present application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of the present application. These terms should be understood in their ordinary and customary meaning unless otherwise indicated.

Fig. 1 is a schematic diagram of an operation scenario between a display device and a control device according to one or more embodiments of the present application, as shown in fig. 1, a user may operate the display device 200 through a mobile terminal 300 and the control device 100. The control device 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication, bluetooth protocol communication, wireless or other wired method to control the display device 200. The user may input a user command through a key on a remote controller, a voice input, a control panel input, etc. to control the display apparatus 200. In some embodiments, mobile terminals, tablets, computers, laptops, and other smart devices may also be used to control the display device 200.

In some embodiments, the mobile terminal 300 may install a software application with the display device 200 to implement connection communication through a network communication protocol for the purpose of one-to-one control operation and data communication. The audio and video contents displayed on the mobile terminal 300 may also be transmitted to the display device 200, so that the display device 200 with the synchronous display function may also perform data communication with the server 400 through multiple communication modes. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200. The display device 200 may be a liquid crystal display, an OLED display, a projection display device. The display apparatus 200 may additionally provide an intelligent network tv function that provides a computer support function in addition to the broadcast receiving tv function.

Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 according to an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction from a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an interaction intermediary between the user and the display device 200. The communication interface 130 is used for communicating with the outside, and includes at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module. The user input/output interface 140 includes at least one of a microphone, a touch pad, a sensor, a key, or an alternative module.

Fig. 3 shows a hardware configuration block diagram of the display apparatus 200 according to an exemplary embodiment. The display apparatus 200 as shown in fig. 3 includes at least one of a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface 280. The controller includes a central processor, a video processor, an audio processor, a graphic processor, a RAM, a ROM, and first to nth interfaces for input/output. The display 260 may be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and may also be a projection device and a projection screen. The tuner demodulator 210 receives a broadcast television signal through a wired or wireless reception manner, and demodulates an audio/video signal, such as an EPG data signal, from a plurality of wireless or wired broadcast television signals. The detector 230 is used to collect signals of an external environment or interaction with the outside. The controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

The communicator 220 may include a plurality of communication modules, and the communication modules may include one or more of a WIFI module, a bluetooth module, a wired ethernet module, and the like, where the WIFI module, the bluetooth module, and the wired ethernet module may be one or more. For example, the communicator 220 may include at least two wired ethernet modules and one WIFI module. Different communication modules can be used for connecting the same network and can also be used for connecting different networks respectively. Each communication module can independently complete data transmission and can also complete data transmission cooperatively. For example, a plurality of communication modules may be used simultaneously to independently perform data transmission, different communication modules may be used to perform data transmission in different application scenarios, or one communication module may be used to perform partial data transmission, and another communication module or an external device interface may be used to perform another partial data transmission. The manner of data transmission of the various network modules may be controlled by controller 250.

In some embodiments, there may be multiple communication modules (e.g., two wired ethernet modules, two WIFI modules, or one wired ethernet module and one WIFI module, etc.) connected to the home network at the same time for wide area network access. The plurality of communication modules can be respectively and independently configured with different IP addresses, and can respectively and independently complete data transmission and also can respectively transmit partial data, so that the data transmission is completed cooperatively.

In other embodiments, at least one communication module (such as a wired ethernet module or a WIFI module) may be connected to the community network for calling an elevator or talkbacking a visible doorbell; alternatively, there may be a communication module (e.g., a bluetooth module) or an external device interface (e.g., USB or HDMI) for connecting other intelligent devices (e.g., intelligent appliances or intelligent sensors), so as to implement data transmission or control between the intelligent devices. The data transmission between the intelligent devices can be realized by using the communication module and the external device interface at the same time, and the application is not limited to this.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display apparatus 200. The user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form that is acceptable to the user. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include at least one of an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc. visual interface elements.

Fig. 4 is a schematic diagram of a software configuration in a display device 200 according to one or more embodiments of the present Application, and as shown in fig. 4, the system is divided into four layers, which are, from top to bottom, an Application (Applications) layer (referred to as an "Application layer"), an Application Framework (Application Framework) layer (referred to as a "Framework layer"), an Android runtime (Android runtime) and system library layer (referred to as a "system runtime library layer"), and a kernel layer. The inner core layer comprises at least one of the following drivers: audio drive, display driver, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (like fingerprint sensor, temperature sensor, pressure sensor etc.) and power drive etc..

Fig. 5 is a schematic diagram illustrating an icon control interface display of an application program in the display device 200 according to one or more embodiments of the present application, as shown in fig. 5, an application layer includes at least one application program that can display a corresponding icon control in a display, for example: the system comprises a live television application icon control, a video on demand application icon control, a media center application icon control, an application center icon control, a game application icon control and the like. The live television application program can provide live television through different signal sources. A video-on-demand application may provide video from different storage sources. Unlike live television applications, video on demand provides a video display from some storage source. The media center application program can provide various applications for playing multimedia contents. The application program center can provide and store various application programs.

The embodiment of the application can be applied to various types of display devices (including but not limited to smart televisions, liquid crystal televisions, tablet computers, VR devices, mobile terminals and the like). The following description will be made of a display device and a network connection method based on a USB link, taking a smart television and VR glasses as examples.

Fig. 6A shows a schematic user interface diagram of smart tv data according to an embodiment of the present application.

In some embodiments, the smart tv may include a plurality of network interfaces, a wireless network card, and a USB port, where each network interface corresponds to a corresponding wired ethernet card configured by the smart tv, so that the smart tv may access different wired network links.

For example, the smart television may be provided with a plurality of network cable interfaces and a plurality of USB ports, and the network cable interfaces and the USB ports may be arranged at the bottom of the smart television body, for example; certainly, the schematic diagram of the smart television shown in fig. 6A does not limit the network cable interface to be disposed at a specific position of the smart television, and the network cable interface and the USB port may also be disposed at the same side, the upper portion, or the back of the smart television housing;

it should be noted that, when an available wired network is inserted into a first network cable interface of the multiple network cable interfaces, it means that a first network card corresponding to the first network cable interface is accessed to the wired network, and for convenience of understanding, the network cable interface corresponding to the network card in fig. 6A is labeled as the network card for convenience of description, and is not described in detail below.

The smart tv display may display a user interface that may display live channels of the smart tv, or run to display installed application content, for example, its desktop applications may include a camera-fused display application, a screen-cast application, an a application, a weather forecast, and a number of different video applications, and the like. It should be noted that, when the user starts a specific desktop application, the first network card is connected to an available network, and the USB port is connected to another networking device, the controller of the smart television may control the specific application program to transmit communication data of the specific application program simultaneously using the 2 network links, so as to break through the bandwidth and speed limitations when a single network is conventionally used to transmit data.

For example, when the smart television user interface runs an application a, the controller may control the application to simultaneously perform data transmission and reception through the network link corresponding to the first network card and the USB link corresponding to the USB port.

It can be understood that, assuming that when the application a is used to transmit data by using a network link corresponding to the first network card alone, the first network card may be configured as a wired network card or a wireless network card, and when the bandwidth of the network link is low, and when the opposite-end VR glasses receive data sent by the smart television and display the data on the user interface, a phenomenon of stuttering of playing pictures may occur, which is caused by the fact that the network transmission speed cannot meet the high-rate transmission requirement of the VR glasses.

And when the display device that this application provided realizes that above-mentioned data transmission shows, then through smart television network card and USB port, wait to transmit data with smart television and transmit through 2 links simultaneously, then its transmission bandwidth can improve than single file network, and corresponding VR glasses also improve when the single file network in unit interval received data volume, can satisfy high-speed, the high flow data demand of opposite end VR glasses broadcast picture to a certain extent, avoids the picture card to take place.

It should be noted that the smart television may further be configured with a virtual network card for transferring data, and the virtual network card may receive data from the application program and forward the data to the network card and the USB port of the smart television for transmission, or receive data transmitted from the network card and the USB port of the smart television and feed the data back to the specific application program.

It should be noted that the network link described in the present application may include different local area networks, private line networks, and service networks; the smart television can realize the access scene of simultaneously accessing the wired network link and the USB link, or simultaneously accessing the wireless network link and the USB link, so as to realize simultaneous network communication.

Fig. 6B shows a framework and a user interface diagram for data transmission by a smart television and VR glasses according to another embodiment of the present application.

In some embodiments, the smart televisions provided by the present application may be networked with each other, so as to achieve the effect of aggregating the USB link and the network link between the devices to perform transmission speed acceleration.

For example, a smart television and VR glasses for data transmission applications in a home, and the smart television and VR glasses may be configured with a network card for accessing a network and a USB port for transmitting data.

In some embodiments, the smart television is configured with a first network card and a first USB port, the VR glasses are configured with a second network card and a second USB port, and the available networks in the environment include types of wired network links and wireless network links.

Firstly, controlling the display equipment to access the display equipment to a wired network link through a first network card; then controlling the VR glasses to access a wired network link through a second network card; and then connecting a first USB port of the intelligent television with a second USB port of the VR glasses through a USB cable, and finally establishing 2 communication links between the intelligent television and the VR glasses, wherein the intelligent television can send data to opposite-end equipment VR glasses where a second network card is located through a wired network link corresponding to a first network card, and can also send data to opposite-end equipment VR glasses where a second USB port is located through a USB link corresponding to the first USB port, and an aggregation USB link and a network link transmission acceleration framework facing a local area network between the equipment are established.

In some embodiments, the display device controller will initiate the data transfer mechanism upon receiving signaling to display the user interface running application content on the peer device.

For example, when the smart television user interface runs an application a, when the user does not start the function of displaying on VR glasses, VR glasses of the peer device do not display a three-dimensional picture of the application content, and the smart television user interface displays and plays only in a two-dimensional mode.

If the user starts the function of displaying on the VR glasses at the smart television end or the opposite end, and the smart television controller receives the signaling for displaying the video resource on the VR glasses of the opposite end device, the controller starts the aggregation link transmission data mechanism to perform high-speed data transmission, and after the data is transmitted to the VR glasses, the user interface of the VR glasses of the opposite end device is as shown in fig. 6B.

Firstly, the controller sends video resource sending data to be transmitted from an application A to an established virtual network card, wherein the application A can also be called as sending end application; then, after the video resource data passes through the virtual network card, the controller splits the video resource data, for example, the video resource data can be split into a first data set and a second data set; it can be understood that video resource data to be transmitted need to be transmitted to VR glasses of an opposite device through 2 different links, and after splitting the video resource data, the video resource data can be transmitted from different links at the same time.

A controller of the smart television controls the split first data set to perform data transmission through a first network card, transmits the first data set to a second network card corresponding to a VR eye through a wired network link, and transmits the second data set to a second USB port corresponding to VR glasses of an opposite terminal device through a USB link, wherein the logic schematic of the first data set is shown in FIG. 8;

finally, the first data set and the second data set transmitted to the VR glasses are subjected to data integration and restoration again to be video resources during transmission under the control of the VR glasses controller of the opposite-end device, so that a user interface displayed on the VR glasses is completed, the application content a of the smart television is transmitted to the user interface of the VR glasses of the opposite-end device at a high speed through the aggregation link, and the user interface and the network architecture are shown in fig. 6B.

In some embodiments, the smart television controller further creates a data processing service for data interaction with the virtual network card in the smart television system for data splitting or data integration, which may also be referred to as a data processing center.

For example, when the display device sends data, the data packet that needs to be transmitted to the VR glasses reaches the virtual network card through the network protocol stack, the created data processing service reads the transmission data of the virtual network card node, and then splits the video resource data packet into a first data set network packet 1 and a second data set network packet 2 based on the sequence number included in the message format and the ratio of the determined data distribution ratio of the first data set and the second data set according to the transmission capacity ratio of the network link and the USB link;

dividing data packets contained in the video resources into a network packet 1 and a network packet 2 according to the transmission rate of the network card 1 and the transmission rate of the USB channel; the network packet 1 is sent to the network card 1 through the socket, and the network packet 2 is transmitted to the Mini USB port through the data portion of the USB protocol, and the logic schematic thereof is shown in fig. 8.

In some embodiments, the network packets included in the second data set are encapsulated into USB packets adapted to be transmitted by the USB link during transmission, as shown in fig. 7.

Firstly, before a second data set is sent from a first USB port of the intelligent television, a controller controls a network data head of a network data packet and network data of the second data set to be integrally packaged into USB data; and then the encapsulated USB data is combined with the corresponding USB data head to form a USB data packet, and the controller controls the USB data packet to be transmitted to the VR glasses through the USB link.

It can be understood that, as shown in fig. 7, when the second data set is transmitted through the USB channel, the smart television side encapsulates the network header and the network data into the data portion of the USB data packet as a whole, and then sends the data portion to the USB port of the VR glasses side through the USB transmission protocol.

Secondly, after the VR glasses end receives the USB data packet through the USB link, the USB data contained in the VR data packet is unpacked to obtain and restore the network data packet corresponding to the second data set, and then the network data packet is removed from the network head to obtain the network data corresponding to the video resource.

It can be understood that after the VR glasses receive the USB data, the data portion of the USB data is extracted as network data; after the data decapsulation is completed, the network data realizes the simultaneous transmission of the network data and the USB link, and realizes the link aggregation transmission of the data, as shown in fig. 7.

Fig. 6C shows a framework and a user interface diagram for data transmission by a smart television and VR glasses according to another embodiment of the present application.

In some embodiments, the smart television and the VR glasses which need to transmit data can be configured to transmit data through the USB link and the wireless network link at the same time.

For example, the display device is configured with a first wireless network card, and the VR glasses of the opposite-end device are configured with a second wireless network card; the user controls the smart television to access a wireless network link through a first wireless network card and controls the VR glasses to access the same wireless network link through a second wireless network card; and then the first USB port of the smart television is connected with the second USB port of the VR glasses through a USB cable, and finally 2 communicable links can be established between the display device and the VR glasses.

The intelligent television can send data to the VR glasses of the opposite-end equipment where the second network card is located through the wireless network link corresponding to the first network card, and can also send data to the USB port of the VR glasses of the opposite-end equipment through the USB link accessed by the intelligent television, so that double-link aggregated data transmission between the equipment can be established.

It is to be understood that, in some embodiments, for a smart television configured with 2 wired network cards and 1 wireless network card, 1 network card may be generally selected for local area network networking configuration.

Fig. 6D shows a schematic diagram of a framework and a user interface for data transmission between smart tvs according to another embodiment of the present application.

In some embodiments, the current smart television may be further configured to receive a screen-casting display request from the peer device, which transmits a network link that may correspond to the first network card through the USB link, where the first network card may be implemented as a wired network card or a wireless network card. When the display device receives the data, the data processing service writes the data received by the first network card and the first USB port into the virtual network card after removing the data heads respectively.

For example, when the smart television receives a signaling sent by the peer device for displaying a video resource generated by the peer device, the signaling is used for displaying the first video application content being displayed and played by the peer device on the user interface of the current display device.

When the controller receives the screen-casting signaling, the controller integrates data packets for controlling the opposite-end equipment to send to the first wireless network card and the first USB port of the display equipment; as described above, at this time, the data packets received by the network card of the display device may be implemented as the first data set and the second data set, and the controller controls the received data to be integrated and then sent to the established virtual network card, and then the integrated data is uniformly transmitted to the video application corresponding to the display device, so that the user interface of the display device displays the first application content being played by the peer device.

The first data set and the second data set received by the smart television respectively reach a first wireless network card and a first USB port, then the created data processing service monitors the read network data packet, and removes IP heads of the first network card and the second network card from the read data; the controller controls the USB protocol stack to remove the USB data head from the received USB data packet, and then network data is produced again through the USB service so as to be sent to the virtual network card for transmission; and writing the created virtual network card into the video resource, and transmitting the video resource to a network protocol stack to reach a target application of a receiving end.

As shown in fig. 9, the network packet 1 and the network packet 2 respectively reach the network card 1 and the USB port, and the data processing center monitors and reads network data, and cuts off the IP header of the network card 1 from the read network packet 1; writing the data packet which is received by the USB port and from which the USB data head is removed into the virtual network card; the virtual network card then sends the decapsulated data to the network protocol stack to reach the target receiving-end application, and the logic schematic thereof is as shown in fig. 9.

It should be noted that, in some embodiments, when the display device receives and displays the screen projection content, the display device may also be configured to use some general applications for playing and displaying, and is not limited to the application used for the same application for the opposite device.

It can be understood that when the display device receives data, the data sent by the display device is similar to the data sent by the display device, and the application content data generated by the opposite device also needs to be split and then is simultaneously transmitted to the current display device through the network link and the USB link.

It can be understood that when the bandwidth support capability of the smart television network card is low and the bandwidth of the local area network is high, the networking mode among the devices can break through the bottleneck limit of the transmission bandwidth; and under the scene that the transmission bandwidth and the transmission speed are affected by the defects of the quality of the optical cable and the coaxial cable used by the first network link, the bottleneck limit of the transmission bandwidth and the transmission speed can be broken through by the networking mode among the devices, and different network experiences can be generated for users.

Therefore, the technical scheme enables the intelligent television to break through the current technical bottleneck, and multiple transmission links can be used at the same time, so that the problems of insufficient network bandwidth or network bandwidth reduction caused by the fact that multiple applications use the network at the same time are solved.

It can be understood that a plurality of network cards and USB ports of the display device of the present application can be connected to a plurality of transmission links, so that the problem of link network bandwidth reduction caused by poor quality of part of network lines in a home can be avoided, and network links used by important applications are ensured to be in a good state.

Fig. 10 is a schematic diagram illustrating a control scheme for speeding up a dual link aggregation network between devices according to another embodiment of the present application.

In some embodiments, taking application a as an example to describe the technical scheme of the present application as a whole, the smart television controller may create a virtual network card and modify a routing policy, so that all network data are transmitted and transferred through the virtual network card; after data passes through the virtual network card, the data is processed again through the data processing service, the data splitting ratio is determined according to the ratio of the speed of the USB link to the transmission speed of the network link supported by the network card, for example, the transmission of the USB link can reach 500M/s, and the transmission of the network link can reach 100M/s, then the controller can control the splitting and distribution of 5 data packets in the first 6 data packets to the USB port, and the splitting and distribution of the remaining 1 data packet to the network card;

when the data to be transmitted is sent to the USB port, the USB data processing described above is performed, and the network data to be transmitted is encapsulated into USB data that can be transmitted through the USB link; the controller divides the data into a network card data packet and a USB data packet, the data of the network card data packet is sent to the network card, and the data of the USB data packet is sent to the USB interface; the data is transmitted through a local area network, the data of the intelligent television network card reaches a network card of VR glasses, the intelligent television USB data reaches a USB port of the VR glasses through a USB link, and data processing service is also established in a system of the VR glasses; after processing the received transmission data, the data processing service of the VR glasses extracts the data of the network card, cuts off the ip head of the network card and sends the data to the virtual network card, meanwhile, the USB service of the VR glasses also sends the data with the USB head removed to the virtual network card, and then the virtual network card reaches the VR glasses through the network protocol stack for displaying by the VR glasses.

In some embodiments, based on the data transmission between the VR glasses and the smart television in the above embodiments, the technical solution of the present application may also be applied to data transmission and display between the VR glasses and the computer device.

For example, a VR game can be executed on an intelligent television or a computer with strong terminal processing capability, and the display streaming of the intelligent television or the computer can be transmitted to VR glasses for display in a high-speed and real-time manner through the data transmission technology based on the USB dual link provided by the application; meanwhile, the operation data of the user at the VR glasses end can also be sent to the smart television or the computer at a high speed, so that the smart television or the computer performs corresponding calculation processing and display change according to the operation data at the VR glasses end, as shown in fig. 6E.

It can be understood that, based on the high-speed transmission technical solution provided by the present application, the operation data at the VR glasses end can be transmitted to the smart television or the computer device with higher operation capability under the low-latency standard, and then the display data transmitted by the VR glasses end is received from the smart television or the computer device, so that the resource integration between the devices is realized by using the dual-link high-speed networking transmission technology based on the USB link.

It should be noted that, although the VR glasses and the smart electronic card are used as examples to describe the transmission technical solution provided by the present application, the VR glasses may also be implemented as other VR devices or smart devices according to practical situations, and the present application does not specifically limit the VR glasses.

Based on the above description of the transmission speed-up control scheme for implementing aggregation of the USB link and the network link by the display device and the related drawings, the present application further provides a network connection method based on the USB link, where the method includes: when a signaling for displaying a video resource on an opposite-end device is received, controlling the video resource transmitted by a virtual network card to be split into a first data set and a second data set, wherein the first data set is transmitted to a second network card of the opposite-end device through a corresponding network link via the first network card, the second data set is transmitted to a second USB port of the opposite-end device through a corresponding USB link via the first USB port, and the first data set and the second data set reach the opposite-end device and are integrated and restored into the video resource; wherein the ratio of the first data set to the second data set is allocated according to the transmission capacity ratio of the network link to the USB link, and the network packets contained in the second data set are encapsulated into USB packets suitable for transmission by the USB link during transmission. The specific steps of the method for implementing speed increase between devices through aggregation of the USB link and the network link are described in detail in the above-provided technical solution of the display device, and are not described herein again.

In some embodiments, the method further comprises: when a signaling which is sent by the opposite terminal device and used for displaying the video resource generated by the opposite terminal device is received, controlling data received from the first network card and the first USB port to be integrated and then transmitted to the video application through the virtual network card, wherein the video resource generated by the opposite terminal device is split and then transmitted simultaneously through the network link and the USB link. The specific steps of the method for implementing speed increase between devices through aggregation of the USB link and the network link are described in detail in the above-provided technical solution of the display device, and are not described herein again.

In some embodiments, the controlling of the network data packet included in the second data set to be encapsulated into a USB data packet in the transmission process specifically includes: before the second data set is sent from the first USB port, a network data head for controlling a network data packet of the second data set and the network data are integrally packaged to USB data, the USB data is combined with the USB data head to form a USB data packet, and the USB data packet can be transmitted to opposite-end equipment through the USB link; after the USB data packet is received by the peer device, the USB data included in the USB data packet is decapsulated to obtain a network data packet corresponding to a second data set, and the network data packet may obtain network data corresponding to a video resource after a network header is removed. The specific steps of the method for implementing speed increase between devices through aggregation of the USB link and the network link are described in detail in the above-provided technical solution of the display device, and are not described herein again.

In some embodiments, the method further comprises: establishing data processing service for performing data interaction with the virtual network card in the system; when sending data, the data processing service divides video resources transmitted by a network protocol stack and a virtual network card into a first data set and a second data set; when receiving data, the data processing service writes the data received by the first network card and the first USB port into the virtual network card after removing the data heads respectively. The specific steps of the method for implementing speed increase between devices through aggregation of the USB link and the network link are described in detail in the above-provided technical solution of the display device, and are not described herein again.

In some embodiments, the peer device is VR glasses, and the VR glasses and the sending device implement multilink aggregation speed-up transmission in the local area network by controlling the video resource to be simultaneously transmitted to the VR glasses through the network link and the USB link. The specific steps of the method for implementing speed increase between devices through aggregation of the USB link and the network link are described in detail in the above-provided technical solution of the display device, and are not described herein again.

The method has the advantages that double-link aggregation networking among the devices can be realized by constructing the network link and the USB link among the devices; further, by constructing the first data set and the second data set, the aggregate transmission of the data to be transmitted can be realized; further, by constructing the virtual network card, data transceiving between the network card and the USB port can be realized by specific application, data can be transmitted between the devices through the network link and the USB link simultaneously, the network transmission bandwidth is improved, the network transmission bottleneck is broken through, and the local area network-oriented multilink aggregation speed increase is realized.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the foregoing discussion in some embodiments is not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims (10)

1. A display device, comprising:

a display;

the first USB port is used for being connected to opposite-end equipment through a USB link;

the network card comprises a first network card connected to opposite-end equipment through a network link;

a controller configured to:

when a signaling for displaying a video resource on an opposite-end device is received, controlling the video resource transmitted by a virtual network card to be split into a first data set and a second data set, wherein the first data set is transmitted to a second network card of the opposite-end device through a corresponding network link via the first network card, the second data set is transmitted to a second USB port of the opposite-end device through a corresponding USB link via the first USB port, and the first data set and the second data set reach the opposite-end device and are integrated and restored into the video resource;

wherein the ratio of the first data set to the second data set is allocated according to the transmission capacity ratio of the network link to the USB link, and the network packets contained in the second data set are encapsulated into USB packets suitable for transmission by the USB link during transmission.

2. The display device of claim 1, wherein the controller is further configured to:

when a signaling which is sent by the opposite terminal device and used for displaying the video resource generated by the opposite terminal device is received, controlling the data received from the first network card and the first USB port to be integrated and then transmitted to the video application through the virtual network card, wherein the video resource generated by the opposite terminal device is split and then simultaneously transmitted to the display device through the network link and the USB link.

3. The display device as claimed in claim 1, wherein the controller controls the network packets included in the second data set to be encapsulated into USB packets during transmission, and specifically includes:

before the second data set is sent from the first USB port, a network data head for controlling a network data packet of the second data set and the network data are integrally packaged to USB data, the USB data is combined with the USB data head to form a USB data packet, and the USB data packet can be transmitted to opposite-end equipment through the USB link;

after the USB data packet is received by the peer device, the USB data included in the USB data packet is decapsulated to obtain a network data packet corresponding to a second data set, and the network data packet may obtain network data corresponding to a video resource after a network header is removed.

4. The display device of claim 1, wherein the controller is further configured to:

establishing data processing service for performing data interaction with the virtual network card in the system;

when the display equipment sends data, the data processing service divides video resources transmitted by a network protocol stack and a virtual network card into a first data set and a second data set;

when the display equipment receives data, the data processing service writes the data received by the first network card and the first USB port into the virtual network card after removing the data heads respectively.

5. The display device of claim 1, wherein the peer device is a VR device;

the controller controls the video resources generated by the display device to be simultaneously transmitted to the VR device through the network link and the USB link, so that the VR device and the display device realize multilink aggregation speed-up transmission under a local area network.

6. A network connection method based on a USB link, the method comprising:

when a signaling for displaying a video resource on an opposite-end device is received, controlling the video resource transmitted by a virtual network card to be split into a first data set and a second data set, wherein the first data set is transmitted to a second network card of the opposite-end device through a corresponding network link via the first network card, the second data set is transmitted to a second USB port of the opposite-end device through a corresponding USB link via the first USB port, and the first data set and the second data set reach the opposite-end device and are integrated and restored into the video resource;

wherein the ratio of the first data set to the second data set is allocated according to the transmission capacity ratio of the network link to the USB link, and the network packets contained in the second data set are encapsulated into USB packets suitable for transmission by the USB link during transmission.

7. The USB link-based network connection method of claim 6, wherein the method further comprises:

when a signaling which is sent by the opposite terminal device and used for displaying the video resource generated by the opposite terminal device is received, controlling the data received from the first network card and the first USB port to be integrated and then transmitted to the video application through the virtual network card, wherein the video resource generated by the opposite terminal device is split and then transmitted simultaneously through the network link and the USB link.

8. The USB link-based network connection method of claim 6, wherein the step of controlling the network packets included in the second data set to be encapsulated as USB packets in the transmission process includes:

before the second data set is sent from the first USB port, a network data head for controlling a network data packet of the second data set and the network data are integrally packaged into USB data, the USB data are combined with the USB data head to form a USB data packet, and the USB data packet can be transmitted to opposite-end equipment through the USB link;

after the USB data packet is received by the peer device, the USB data included in the USB data packet is decapsulated to obtain a network data packet corresponding to a second data set, and the network data packet may obtain network data corresponding to a video resource after a network header is removed.

9. The USB link-based network connection method of claim 6, wherein the method further comprises:

establishing data processing service for performing data interaction with the virtual network card in the system;

when sending data, the data processing service divides video resources transmitted by a network protocol stack and a virtual network card into a first data set and a second data set;

when receiving data, the data processing service writes the data received by the first network card and the first USB port into the virtual network card after removing the data heads respectively.

10. The method of claim 6, wherein the peer device is a VR device, and the VR device and the sending device implement multi-link aggregation speed-up transmission over a local area network by controlling video resources to be transmitted to the VR device through the network link and the USB link simultaneously.

Images