WO2023133960A1

WO2023133960A1 - Display device, method and system

Info

Publication number: WO2023133960A1
Application number: PCT/CN2022/076436
Authority: WO
Inventors: 陈亮; 杨双; 邵彬
Original assignee: 成都拟合未来科技有限公司
Priority date: 2022-01-12
Filing date: 2022-02-16
Publication date: 2023-07-20

Abstract

A display device (100, 110, 120), method and system. A memory (105) does not need to pre-store an index file of a video stream address, thereby ensuring the security of index data; in addition, retrieval computation of an index is not processed by a processor (101), thereby saving on computing resources of the display device (100, 110, 120), and reducing a local computation delay of the display device (100, 110, 120). On the basis of the reasoning, the dependence of the display device (100, 110, 120) on the computing power of the processor (101) can be reduced, and a moderate amount of local computation delay can be obtained even if the computing power of the processor (101) is relatively low.

Description

Display device, method and system

technical field

The present invention relates to the field of communication technology, in particular to a fitness video stream acquisition and display device, method and system.

Background technique

HLS (HTTP Live Streaming) is Apple's dynamic bit rate adaptive technology. It is mainly used for audio and video services of PC and Apple terminals. Including an m3u8 index file, TS media segment file and key encrypted string file. HLS-based video transmission technology has been widely promoted, especially in smart fitness technology, it is very common to play fitness videos through mobile terminals. The smart fitness mirror is a kind of fitness equipment that can be applied to the home. It can display the user's mirror image and fitness video to the user synchronously. At present, the smart fitness mirror has become an important carrier of smart fitness.

HLS technology has been widely used in video transmission technology. However, HLS technology will slice the video. If the fitness mirror itself pre-stores the slice address index, on the one hand, the interaction between the APP and the fitness mirror will cause security risks for the slice address data. On the one hand, the amount of data that the fitness mirror needs to process will increase, which increases the operating cost of the fitness mirror.

In addition, most of the existing smart fitness mirrors are connected to external devices using Bluetooth connection. The one-to-many connection technology of Bluetooth connection is limited by the bandwidth and protocol stack, and the number of devices that can be stably connected is often small. If the user wears many electronic devices, multiple sets of Bluetooth communication modules are often required for separate transmission, which is not conducive to the real-time control and data interaction of the smart fitness mirror.

Contents of the invention

In order to at least overcome the above-mentioned deficiencies in the prior art, the purpose of the present disclosure is to provide a display device, method and system.

In a first aspect, an embodiment of the present disclosure provides a display device, including:

display device;

a first communication component;

a second communication component;

at least one processor;

A memory coupled to the processor, wherein the memory stores processor-readable instructions, and at least one of the processors executes the readable instructions so that at least one of the processors:

Communicate with at least two of the first server, the second server, the external device, and the auxiliary device through the first communication component and the second communication component, and selectively display the acquired data through a display screen.

In a possible implementation manner, the first communication component is configured to receive a first video playback request, the second communication component is configured to receive a first video stream address and/or a video stream slice, and the first The communication component and the second communication component respectively communicate with at least two of the first server, the second server, the external device, and the auxiliary device, and selectively displaying the obtained data through a display screen includes:

Receive the first video play request through the first communication component; receive the first video stream address matching the first video play request through the second communication component; receive the video stream slice matching the first video stream address through the second communication component; The received video stream slices are displayed by a display device.

In the above solution, after receiving the first video play request, the corresponding video stream slice is obtained by receiving the first video stream address matching the first video play request. On the one hand, the memory does not need to pre-store the index file of the video stream address, which ensures the security of the index data; on the other hand, the retrieval calculation of the index is not processed by the processor, which saves the computing resources of the display device and reduces the local load of the display device. Calculation delay. Based on the above reasons, the dependence of the display device on the computing power of the processor can be reduced, and a good local computing delay can be obtained even if the computing power of the processor is low.

In a possible implementation manner, the first communication component is communicatively coupled with the external device through a first communication protocol.

In a possible implementation manner, the second communication component is communicatively coupled to the first server through a second communication protocol different from the first communication protocol.

In a possible implementation manner, the second communication component is communicatively coupled with the second server through a third communication protocol different from the first communication protocol and the second communication protocol.

In a possible implementation manner, at least one of the processors receives the first video stream address matching the first video playback request from the first server through the second communication component; The component receives video stream slices matching the address of the first video stream from the second server.

In a possible implementation manner, the first communication component is configured to communicate with an external device and a server; the second communication component is configured to communicate with an auxiliary device; At least two of the first server, the second server, the external device, and the auxiliary device communicate separately, and selectively display the acquired data through a display screen, including:

receiving a first video playback request from an external device through a first communication component;

receiving a first video stream address matching the first video playback request from the server through the first communication component;

receiving a video stream slice matching the first video stream address from the server through the first communication component;

receiving assistance data from an auxiliary device via a second communication component;

displaying the received video stream slices through a display device;

The received auxiliary data is displayed on a designated area of the display device by the display device.

In a possible implementation manner, a semi-reflective glass arranged between the display device and the user is further included.

In a possible implementation manner, the first communication component is communicatively coupled with the external device through a first communication protocol, and the first communication component is communicatively coupled with the first server through a second communication protocol different from the first communication protocol .

In a possible implementation manner, the first communication component is communicatively coupled to the second server through a third communication protocol different from the first communication protocol and the second communication protocol.

In a possible implementation manner, the second communication component is communicatively coupled with the auxiliary device through a fourth communication protocol different from the first communication protocol, the second communication protocol, and the third communication protocol.

In a possible implementation manner, the auxiliary device is a physiological monitoring device or a posture monitoring device.

In a second aspect, an embodiment of the present disclosure provides a method for controlling a display device, including:

Communicate with at least two of the first server, the second server, external equipment, and auxiliary equipment through the first communication connection, the second communication connection, and the third communication connection, and selectively pass the acquired data through the display screen to show.

In a possible implementation manner, communicating with at least two of the first server, the second server, the external device, and the auxiliary device respectively through the first communication connection, the second communication connection, and the third communication connection, and Selectively displaying the acquired data through a display screen includes: obtaining a first video playback request from an external device through a first communication connection;

obtaining the first video stream address from the first server via the second communication connection according to the first video playback request;

Obtaining video stream slices from the target server through the third communication connection according to the first video stream address;

Play and display video stream slices.

In a possible implementation manner, the target server is a second server different from the first server.

In a possible implementation manner, the first communication connection, the second communication connection, and the third communication connection use different communication protocols.

In a possible implementation manner, communicating with at least two of the first server, the second server, the external device, and the auxiliary device respectively through the first communication connection, the second communication connection, and the third communication connection, and Selectively displaying the acquired data through the display screen further includes: acquiring at least one device control signal from the first server through the second communication connection according to the first video playback request.

In a possible implementation manner, the device control signal indicates working parameters of the device during playing the video slice.

In a possible implementation manner, the device control signal indicates a starting point and an ending point of collecting user-related data during playing a video slice.

In a possible implementation manner, communicating with at least two of the first server, the second server, the external device, and the auxiliary device respectively through the first communication connection, the second communication connection, and the third communication connection, and Selectively displaying the acquired data through the display screen further includes: acquiring at least one piece of video auxiliary information from the first server through the second communication connection according to the first video playback request, and displaying the acquired video auxiliary information during playing video slices information; and/or

A synchronization signal is obtained from the first server according to the first video playback request, and the synchronization signal indicates a start point and an end point of a time.

In a possible implementation manner, communicating with at least two of the first server, the second server, the external device, and the auxiliary device respectively through the first communication connection, the second communication connection, and the third communication connection, and Selectively displaying the acquired data through the display includes:

Obtaining a first video playback request from an external device through a first communication connection;

Obtaining the first video stream address from the first server through the second communication connection according to the first video playback request;

obtaining assistance data from the auxiliary device via the fourth communication connection;

Play and display video stream slices;

Display ancillary data on top of video stream slices.

In a possible implementation manner, communicating with at least two of the first server, the second server, the external device, and the auxiliary device respectively through the first communication connection, the second communication connection, and the third communication connection, and Selectively displaying the acquired data through the display screen further includes: obtaining at least one ranking data from the first server through the second communication connection according to the first video playback request,

Wherein, the ranking data includes real-time ranking data and historical ranking data, and/or auxiliary data collected by other devices.

In a possible implementation manner, communicating with at least two of the first server, the second server, the external device, and the auxiliary device respectively through the first communication connection, the second communication connection, and the third communication connection, and Selectively displaying the obtained data through a display screen also includes: processing the ranking data and auxiliary data and jointly displaying them on the upper layer of the video stream slice.

In a possible implementation manner, the first communication connection, the second communication connection, the third communication connection, and the fourth communication connection all use different communication protocols.

In a possible implementation manner, the auxiliary data is received from the auxiliary device through the second communication component according to the synchronization signal.

In a third aspect, an embodiment of the present disclosure provides a display system, including: a first display device, a first external device, a first server, a second server, and a first auxiliary device,

The first display device is configured to communicate with at least two of the first server, the second server, the first external device, and the first auxiliary device through the first communication connection, the second communication connection, and the third communication connection, respectively , and selectively display the acquired data through the display screen.

In a possible implementation manner, the first external device is configured to communicate with the first display device through a first communication connection, and the first server is configured to communicate with the first display device through a second communication connection, the second server is configured to communicate with the first display device via a third communication connection,

Said communicating with at least two of the first server, the second server, the first external device, and the first auxiliary device through the first communication connection, the second communication connection, and the third communication connection, and transferring the obtained data Optional display via display includes:

The first video playback request is obtained from the first external device through the first communication connection; the first video stream address is obtained from the first server through the second communication connection; and the video stream slice is obtained from the second server through the third communication connection.

In a possible implementation manner, the first display device is configured to obtain at least one device control signal from the first server through the second communication connection.

In a possible implementation manner, the first display device is configured to obtain at least one piece of video auxiliary information from the first server through the second communication connection.

In a possible implementation manner, it further includes a second display device, and the second display device is configured to: communicate with the second external device through the fourth communication connection; communicate with the first server through the fifth communication connection; A sixth communication connection communicates with the second server.

In a possible implementation manner, at least one of the video playback request, video stream address, and video stream slice acquired by the second display device and the first display device is the same.

In a possible implementation manner, the first external device is configured to communicate with the first display device through a first communication connection, and the first server is configured to communicate with the first display device through a second communication connection, the second server is configured to communicate with the first display device via a third communication connection, the first auxiliary device is configured to communicate with the first display device via a fourth communication connection,

Said communicating with at least two of the first server, the second server, the first external device, and the first auxiliary device through the first communication connection, the second communication connection, and the third communication connection, and transferring the obtained data Selectively displaying through the display screen includes: obtaining the first video playback request from the first external device through the first communication connection; obtaining the first video stream address from the first server through the second communication connection; obtaining the first video stream address through the third communication connection The video stream slice is acquired from the second server; and the first auxiliary data is acquired from the first auxiliary device through the fourth communication connection.

In a possible implementation manner, it further includes a second display device, and the second display device is configured to: communicate with the second external device through the fourth communication connection; communicate with the first server through the fifth communication connection; The sixth communication connection communicates with the second server; the seventh communication connection communicates with the second accessory.

In a possible implementation manner, the first server is configured to obtain first auxiliary data of the first display device and obtain second auxiliary data of the second display device.

In a possible implementation manner, the first display device is configured to obtain at least one synchronization signal from the first server through the second communication connection, the synchronization signal specifies a start point and an end point of a time, and the first display device It is configured to obtain first auxiliary data from the first auxiliary device through the fourth communication connection according to the synchronization signal.

In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, including a stored computer program, and the computer program executes any of the aforementioned control methods when running.

In a fifth aspect, an embodiment of the present disclosure provides an electronic device, including a processor and a memory; the memory is configured to store instructions executable by the processor; and the processor is configured to execute any of the foregoing control methods.

Compared with the prior art, the present invention has the following advantages and beneficial effects:

Based on any one of the above aspects, the embodiments of the present disclosure provide a display device, method and system. On the one hand, the memory does not need to pre-store the index file of the video stream address, which ensures the security of the index data; on the other hand, the retrieval calculation of the index is not processed by the processor, which saves the computing resources of the display device and reduces the local load of the display device. Calculation delay. Based on the above reasons, the dependence of the display device on the computing power of the processor can be reduced, and a good local computing delay can be obtained even if the computing power of the processor is low.

In addition, based on any one of the above aspects, the embodiments of the present disclosure provide a display device, method and system. On the one hand, the user's physiological data or motion data acquired by the auxiliary device can be received and displayed through the second communication component; on the other hand, the interaction between the display device and the external device will not conflict with the auxiliary device, which improves the efficiency of data transmission. Timeliness buys time for the processing and display of auxiliary data. Based on the above reasons, it is beneficial to the real-time data transmission and real-time control of the smart fitness mirror, which improves the user experience.

Description of drawings

The drawings described here are used to provide further understanding of the embodiments of the present invention, constitute a part of the present disclosure, and do not limit the embodiments of the present invention. In the attached picture:

FIG. 1 is a schematic diagram of a usage scenario provided by an embodiment of the present disclosure;

FIG. 2 is a schematic diagram of a system architecture of a display device provided by an embodiment of the present disclosure;

FIG. 3 is a schematic diagram of a method in an embodiment of the present disclosure;

FIG. 4 is a schematic diagram of another usage scenario provided by an embodiment of the present disclosure;

FIG. 5 is a schematic diagram of the overall structure of a device provided by an embodiment of the present disclosure;

Fig. 6 is the enlarged schematic view of place A in Fig. 5;

FIG. 7 is a schematic diagram of a usage scenario provided by an embodiment of the present disclosure;

FIG. 8 is a schematic diagram of a method in an embodiment of the present disclosure;

FIG. 9 is a schematic diagram of another usage scenario provided by an embodiment of the present disclosure.

Detailed ways

In order to make the purpose, technical solutions and advantages of the embodiments of the present disclosure clearer, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present disclosure. The drawings are for illustration and description purposes only, and are not intended to limit the protection scope of the present disclosure. Additionally, it should be understood that the schematic drawings are not drawn to scale. The flowcharts used in this disclosure illustrate operations implemented in accordance with some of the embodiments of the disclosure. It should be understood that the operations of the flowcharts may be performed out of order, and operations without logical context may be performed in reverse order or simultaneously. In addition, those skilled in the art may add one or more other operations to the flowchart, or remove one or more operations from the flowchart under the guidance of the present disclosure.

In addition, the described embodiments are only some of the embodiments of the present disclosure, not all of them. The components of the disclosed embodiments generally described and illustrated in the figures herein may be arranged and designed in a variety of different configurations. Accordingly, the following detailed description of the embodiments of the present disclosure provided in the accompanying drawings is not intended to limit the scope of the claimed disclosure, but merely represents selected embodiments of the present disclosure. Based on the embodiments of the present disclosure, all other embodiments obtained by those skilled in the art without creative efforts shall fall within the protection scope of the present disclosure.

Please refer to FIG. 1 , which shows a schematic diagram of an interaction scene of a video stream interaction system 10 provided by an embodiment of the present disclosure. For example, the video stream interactive system 10 may include a display device 100 and an external device 200 connected in communication, and further include a first server 300 and a second server 400 connected in communication with the display device 100 .

In the embodiment of the present disclosure, the external device 200 may be, but not limited to, a smart phone, a personal digital assistant, a tablet computer, a personal computer, a notebook computer, a virtual reality terminal device, an augmented reality terminal device, and the like. In a specific implementation process, there may be one or more external devices 200 connected to the display device 100, and only one is shown in FIG. 1 . Wherein, a program product that provides services (such as fitness services) by the display device 100 can be installed in the external device 200, for example, the program product can be an application program APP or applet related to fitness exercise used in a computer or a smart phone.

In the embodiment of the present disclosure, the first server 300 and the second server 400 may be a single physical server, or a server group composed of multiple physical servers for performing different data processing functions. The server group can be centralized or distributed (for example, the first server 300 and the second server 400 can be a distributed system). In some possible implementations, if the first server 300 and the second server 400 use a single physical server, different logical server components may be assigned to the physical server based on different business functions.

It can be understood that the video stream interaction system 10 shown in FIG. 1 is only a feasible example, and in other feasible embodiments, the video stream interaction system 10 may also include only a part of the components shown in FIG. Other components may be included.

The display device provided by the embodiment of the present disclosure will be exemplarily described below in conjunction with the application scenario shown in FIG. 1 . First, please refer to FIG. 2 , an embodiment of the present disclosure provides a display device 100, including:

display device 102;

the first communication component 103;

a second communication component 104;

at least one processor 101;

A memory 105 coupled to the processor 101, the memory 105 stores readable instructions of the processor 101, and at least one of the processors 101 executes the readable instructions so that at least one of the processors 101: through the first communication The component 103 and the second communication component 104 communicate with at least two of the first server 300, the second server 400, the external device 200, and the auxiliary device (not shown in FIG. 1 ), respectively, and select the acquired data displayed on the display.

In a possible implementation manner, the display device 102 may be, for example, a display screen.

In a possible implementation manner, the first communication component 103 is configured to receive a first video playback request, the second communication component 104 is configured to receive a first video stream address and/or a video stream slice, and the The first communication component 103 and the second communication component 104 respectively communicate with at least two of the first server 300, the second server 400, the external device 200, and the auxiliary device, and selectively display the acquired data through the display screen. The display includes: receiving the first video play request through the first communication component 103; receiving the first video stream address matching the first video play request through the second communication component 104; receiving the address matching the first video stream through the second communication component 104 Matched video stream slices; the received video stream slices are displayed by the display device 102 . The address of the video stream may be the address of the real-time live video stream, or the address of the pre-recorded coaching video stored on the server. Users can choose whether the video they want to play is a live video or a pre-recorded coaching video session.

In this embodiment, the video stream slices are stored in the second server 400, and the first server 300 presets slice address indexes.

In an example, when the user needs to exercise, the external device 200 sends a first video play request, and the display device 100 receives the first video play request through the first communication component 103 . The processor 101 calls the instructions stored in the memory 105 to process the first video playback request received by the first video playback request, and obtains the identification information of the fitness video corresponding to the first video playback request. The display device 100 sends the identification information to the first server 300 through the second communication component 104, and the first server 300 identifies the identification information and obtains the first video stream address corresponding to the identification information through the slice address index; wherein The first video stream address may be an address of all video stream slices corresponding to the identification information, or may be an address of a part of video stream slices corresponding to the identification information. The display device 100 receives the first video stream address through the second communication component 104, and downloads the video stream slice matching the first video stream address from the second server 400 through the first video stream address, and finally the display device 102 displays the received video stream address to the user. to the video stream slice. The address of the video stream may be the address of the real-time live video stream, or the address of the pre-recorded coaching video stored on the server. The user can select the video content to be played and whether the video is a live video or a pre-recorded coaching video course through the external device 200 .

In one example, when the playing time of the fitness video is preset, the external device 200 or the timing model configured on the display device 100 can send the first video playing request when the playing time is reached, and its subsequent data processing and video The stream slice receiving process is the same as the above example.

It can be seen from the above example that there is no need to pre-store the slice address index in the memory 105, and the acquisition and calculation of the video slice address can be processed and calculated by an external server, which ensures the data security of the slice address index and saves display devices. 100 computing resources, reducing the local computing delay of the display device 100.

In a possible implementation manner, the first communication component 103 is communicatively coupled with the external device 200 through a first communication protocol.

In the embodiment of the present disclosure, the first communication component 103 needs to adopt a communication component corresponding to the first communication protocol to receive the first video play request.

For example, when the display device 100 and the external device 200 are in the same network, such as the Internet or a local area network, the first communication protocol may use a communication protocol such as the TCP/IP protocol or the MQTT protocol based on the TCP/IP protocol suite.

For example, when the display device 100 and the external device 200 are not in the same network, the data interaction can be completed through near-field networking. At this time, the first communication protocol can use common communication protocols such as Bluetooth, zigbee, and NBIoT.

In a possible implementation manner, the second communication component 104 is communicatively coupled with the first server 300 through a second communication protocol different from the first communication protocol.

In the embodiment of the present disclosure, the second communication component 104 needs to use a communication component corresponding to the second communication protocol for communication coupling with the first server 300, wherein the second communication protocol is different from the first communication protocol.

Exemplarily, in order to ensure data security, the second communication protocol can adopt the HTTPS protocol, and the second communication component 104 adopts a communication component that needs to be compatible with the HTTPS protocol. In detail, when the display device 100 requests the video stream address from the first server 300 through the second communication component 104, the first server 300 sends the first video stream address searched from the slice address index to the display device through the HTTPS protocol. The device 100 ; the display device 100 receives a first video stream address through the second communication component 104 . Wherein the first video stream address is preferably a URL address.

In a possible implementation manner, the second communication component 104 is communicatively coupled with the second server 400 through a third communication protocol different from the first communication protocol and the second communication protocol.

In the embodiment of the present disclosure, the second communication component 104 needs to adopt communication components corresponding to the second communication protocol and the third communication protocol for communication coupling with the first server 300 and the second server 400 . The second communication component 104 can be formed by integrating modules corresponding to the second communication protocol and the third communication protocol, or a communication component compatible with the second communication protocol and the third communication protocol can also be used.

Exemplarily, when the second communication protocol adopts the HTTPS protocol, the third communication protocol adopts the HTTP protocol in the HLS protocol. In detail, when the display device 100 receives the first video stream address through the second communication component 104 based on the second communication protocol, the second communication component 104 downloads the corresponding first video stream address from the second server 400 based on the third communication protocol. video stream slice.

In a possible implementation, at least one of the processors 101 receives from the first server 300 the first video stream address matching the first video playback request through the second communication component 104; at least one of the processors 101 The video stream slice matching the first video stream address is received from the second server 400 through the second communication component 104 .

In the embodiment of the present disclosure, when the display device 100 receives the first video stream address through the second communication component 104, the processor 101 receives the first video stream address; when the display device 100 receives the first video stream address through the second communication component 104 When the server 400 downloads the video stream slice corresponding to the first video stream address, the processor 101 receives the video stream slice.

Exemplarily, the first video stream address is generated by the first server 300 and matches the first video playback request; video stream slices are pre-stored in the second server 400, and the processor downloads from the second server 400 according to the first video stream address .

In the embodiment of the present disclosure, the first video stream address and video stream slices are divided into two servers for storage, and the calculations that should be completed by the processor 101 can be distributed to the servers, thereby improving data security and calculation efficiency.

In the embodiment of the present disclosure, the semi-reflective glass is a glass that can display video to the user through the display device, and can also reflect the user's mirror image; its main function is that when the user watches the video, it can also be intuitive through the reflected mirror image Get your own exercise status.

The embodiment of the present disclosure provides that the display device 100 can also be applied to the application scenario shown in FIG. 7 . The display device 100 provided in the embodiment of the present disclosure will be described below with reference to FIG. 7 .

Please refer to FIG. 7 , which shows a schematic diagram of an interaction scenario of an interaction system 60 provided by an embodiment of the present disclosure. For example, the video stream interaction system 60 may include a display device 100 and an external device 200 connected in communication, and further include a server 600 and an auxiliary device 500 connected in communication with the display device 100 .

In the embodiment of the present disclosure, the external device 200 may be, but not limited to, a smart phone, a personal digital assistant, a tablet computer, a personal computer, a notebook computer, a virtual reality terminal device, an augmented reality terminal device, and the like. In a specific implementation process, there may be one or more external devices 200 connected to the display device 100, and only one is shown in FIG. 7 . Wherein, a program product that provides services (such as fitness services) by the display device 100 can be installed in the external device 200, for example, the program product can be an application program APP or applet related to fitness exercise used in a computer or a smart phone.

In the embodiment of the present disclosure, the video stream address may be the address of the real-time live video stream, or the address where the pre-recorded coaching video is stored on the server. Users can choose whether the video they want to play is a live video or a pre-recorded coaching video session.

In the embodiment of the present disclosure, the server 600 may be a single physical server, or a server group composed of multiple physical servers for performing different data processing functions. The server group can be centralized or distributed (for example, server 600 can be a distributed system). In some possible implementation manners, if the server 600 adopts a single physical server, different logical server components may be assigned to the physical server based on different business functions.

In the embodiment of the present disclosure, the auxiliary device 500 may be a sensor worn on the user's body, or may be a device for collecting other data for assisting fitness. The auxiliary device 500 can be a bracelet, a wearable sensor, a smart wearable, a depth camera, a handheld fitness device, etc., and the data detected by it can be the biological data of the user, or the IMU data and image data. In some possible implementations, if the auxiliary device 500 uses a single device for data collection, different logic components may be assigned to the auxiliary device 500 based on different business functions.

It can be understood that the interactive system 60 shown in FIG. 7 is only a feasible example, and in other feasible embodiments, the interactive system 60 may also include only a part of the components shown in FIG. 7 or may also include other component.

2 and 7, in a possible implementation, the first communication component 103 is configured to communicate with the external device 200 and the server 600; the second communication component 104 is configured to communicate with the auxiliary device 500; communicate with at least two of the first server 300, the second server 400, the external device 200, and the auxiliary device 500 through the first communication component 103 and the second communication component 104, and selectively pass the acquired data through The displays on display include:

receiving a first video playback request from the external device 200 through the first communication component 103;

Receive the first video stream address matched with the first video playback request from the server 600 by the first communication component 103;

receiving a video stream slice matching the first video stream address from the server 600 through the first communication component 103;

receiving auxiliary data from the auxiliary device 500 via the second communication component 104;

Displaying the received video stream slices through the display device 102;

The received auxiliary data is displayed in a designated area of the display device 102 by the display device 102 .

In this embodiment, the server 600 may adopt a single server configuration, or may adopt a multi-server configuration. Exemplarily, the server 600 includes a first server 300 and a second server 400, wherein video stream slices are stored in the second server 400, and the first server 300 presets slice address indexes. For example, when the server 600 adopts a single server configuration, the video stream slice storage and the slice address index are all set on the same server.

In an example, when the user needs to exercise, the external device 200 sends a first video play request, and the display device 100 receives the first video play request through the first communication component 103 . The processor 101 calls the instructions stored in the memory 105 to process the first video playback request received by the first video playback request, and obtains the identification information of the fitness video corresponding to the first video playback request. The display device 100 sends the identification information to the server 600 through the second communication component 104, and the server 600 identifies the identification information and obtains the first video stream address corresponding to the identification information through the slice address index; wherein the first video stream The address may be an address of all video stream slices corresponding to the identification information, or an address of a part of video stream slices corresponding to the identification information. The display device 100 receives the first video stream address through the first communication component 103, and downloads the video stream slice matching the first video stream address from the server 600 through the first video stream address, and finally the display device 102 displays the received video stream slice to the user. Video stream slicing.

At the same time, the auxiliary device 500 collects the user's heart rate data, the display device 100 receives the auxiliary data through the second communication component 104, and displays the received auxiliary data on the lower left corner, lower right corner, upper left corner, upper right corner or both sides of the display device 102 .

It can be seen from the above examples that the display device 100 uses the second communication component 104 to interact with the auxiliary device 500 , and uses the first communication component 103 to interact with the external device 200 . The above two interaction processes are independent of each other. On the one hand, the user’s physiological data or exercise data acquired by the auxiliary device 500 can be received and displayed through the second communication component 104; Conflicts will occur with the auxiliary device 500, which improves the timeliness of data transmission and buys time for the processing and display of auxiliary data.

In a possible implementation, the first communication component 103 is communicatively coupled with the external device 200 through a first communication protocol, and the first communication component 103 communicates with the first communication component 103 through a second communication protocol different from the first communication protocol. Server 300 is communicatively coupled.

In the embodiment of the present disclosure, the server 600 includes the first server 300, the first server 300 presets the slice address index, and the first communication component 103 needs to adopt a communication component corresponding to the first communication protocol to receive the first video playback request. The first communication component 103 also needs to use a communication component corresponding to the second communication protocol to receive from the first server 300 a first video stream address matching the first video playback request.

For example, the second communication protocol may use the HTTPS protocol, and the display device 100 communicates with the first server 300 through the Internet using the HTTPS protocol, thereby enhancing data security.

If the first communication protocol is the MQTT protocol based on the TCP/IP protocol family, and the second communication protocol is the HTTPS protocol, then the first communication component 103 can use the same communication component to simultaneously implement HTTPS protocol and MQTT protocol communication. In detail, when the first communication component 103 receives the first video playback request sent by the external device 200 through the MQTT protocol, the display device 100 requests the video stream address from the first server 300; The first video stream address searched in the index is sent to the display device 100; wherein the first video stream address is preferably a URL address.

In a possible implementation manner, the first communication component 103 is communicatively coupled with the second server 104 through a third communication protocol different from the first communication protocol and the second communication protocol.

In the embodiment of the present disclosure, the server 600 includes a second server 400, and the second server 400 stores video stream slices. The first communication component 103 needs to adopt a communication component corresponding to the third communication protocol for receiving video stream slices.

For example, the third communication protocol may use the HLS protocol to transmit video slices, and the display device 100 communicates with the second server 400 through the Internet using the HLS protocol. In detail, when the first communication component 103 receives the first video playback request sent by the external device 200 through the MQTT protocol, the display device 100 requests the video stream address from the first server 300; The first video stream address searched in the index is sent to the display device 100; when the display device 100 downloads video stream slices from the second server 104 according to the first video stream address, the HLS protocol is used; wherein the first video stream address is preferably is the URL address.

In a possible implementation manner, the second communication component 104 is communicatively coupled with the auxiliary device 500 through a fourth communication protocol different from the first communication protocol, the second communication protocol, and the third communication protocol.

In the embodiment of the present disclosure, the second communication component 104 needs to adopt a communication component corresponding to the fourth communication protocol to receive the auxiliary data sent by the auxiliary device 500 .

Exemplarily, the fourth communication protocol may use bluetooth, zigbee and other near field communication methods for auxiliary data transmission, and the display device 100 communicates with the auxiliary device 500 through near field communication methods and adopts bluetooth, zigbee and other protocols.

In detail, during the user's exercise, the auxiliary device 500 collects the auxiliary data and sends it to the display device 100 through Bluetooth; the display device 100 receives the auxiliary data through the second communication component 104, and processes the auxiliary data Or directly displayed in a designated area of the display device 102 .

In the embodiment of the present disclosure, when the auxiliary equipment is a physiological monitoring equipment, physiological data monitoring equipment such as wristbands, heart rate sensors, and blood pressure sensors are used, and when the physiological data generated by them are displayed to the user through the display device 102 as auxiliary data, it can be Let users observe the changes of their physiological data in real time during exercise. When the auxiliary device is an attitude monitoring device, the attitude monitoring equipment such as a wristband, a wearable IMU sensor, and a depth camera are used. When the attitude data generated by the equipment is displayed to the user through the display device 102 as auxiliary data, the user can monitor his own movement. Real-time observation of the standard degree of the user's posture can be carried out, and the standard degree of the user's posture can also be scored by the processor to improve user experience after processing the posture data.

In a possible implementation manner, a semi-reflective glass disposed between the display device 102 and the user is further included.

The method provided by the embodiment of the present disclosure will be exemplarily described below in conjunction with the application scenario shown in FIG. 1 . The method provided by the embodiment of the present disclosure may be the control method of the aforementioned display device 100, including: communicating with the first server 300, the second server 400, the external device 200, At least two of the auxiliary devices communicate separately, and selectively display the acquired data through a display screen.

In a possible implementation, please refer to FIG. 3 , the method provided by the embodiment of the present disclosure can be executed by the aforementioned display device 100 , and in other embodiments, the order of some operations in the method of the embodiment of the present disclosure can be based on the actual It needs to be exchanged with each other, or some of the operations can also be omitted or deleted. The display device 100 communicates with at least two of the first server 300, the second server 400, the external device 200, and the auxiliary device respectively through the first communication connection, the second communication connection, and the third communication connection, and Selectively displaying the acquired data through a display screen may include the following operations.

Operation S1: Obtain a first video playback request from the external device 200 through the first communication connection;

In the embodiment of the present disclosure, the first communication connection with the external device 200 can be established by the display device 100 through the first communication component 103 , or the first communication connection with the external device 200 can be established by the display device 100 in other ways. The first video play request may be generated by the external device 200 itself according to needs, or may be generated by the user operating the external device 200 . The first video playback request may include an identification or identification number of the requested video. Specifically, in this embodiment, the first video play request may be encoded and decoded according to the communication protocol corresponding to the first communication connection.

Operation S2: obtain the address of the first video stream from the first server 300 through the second communication connection according to the first video playback request;

In the embodiment of the present disclosure, the second communication connection with the first server 300 can be established by the display device 100 through the second communication component 104, and the first video stream address can be obtained from the first server 300 by the display device 100 through the second communication connection. Communication acquisition, wherein the address of the first video stream should match the first video playback request. Specifically, the display device 100 may extract the data representing the requested video from the first video playback request, and send the data to the first server 300 after encapsulating the data according to the protocol matching the second communication connection. The first server The 300 can obtain the matching first video stream address from the index configured on the first server 300 according to the data.

Operation S3: Obtain video stream slices from the target server through the third communication connection according to the first video stream address;

In the embodiment of the present disclosure, the third communication connection with the target server may be established by the display device 100 through the second communication component 104, or the third communication connection with the target server may be established by the display device 100 through other communication components; the target server It may be the first server 300 , or a server or server group different from the first server 300 .

Specifically, the display device 100 acquires the download address from the address of the first video stream, and the acquisition method can be the address arranged in sequence for each video stream slice, or the address corresponding to any video stream slice; Download the corresponding video stream slices from the target server.

Operation S4: Play and display the video stream slice.

In the embodiment of the present disclosure, video stream slices can be played and displayed through the display device 102 configured on the display device 100; the playback and display method can be based on the HLS protocol technology to play video stream slices, or other existing technologies can be used. way.

In a possible implementation manner, the target server is a second server 400 different from the first server 300 .

In the embodiment of the present disclosure, in order to ensure data security, the target server used is the second server 400 .

In a possible implementation manner, at least two of the first server 300, the second server 400, the external device 200, and the auxiliary device are respectively connected through the first communication connection, the second communication connection, and the third communication connection. Communication, and selectively displaying the obtained data through the display also includes:

S5: Obtain at least one device control signal from the first server 300 via the second communication connection according to the first video playback request.

In the embodiment of the present disclosure, the device control signal may be corresponding to the video requested by the first video playback request, or may be corresponding to the device that sends the first video playback request and corresponds to the user; the device control signal is used in video stream slicing During downloading and playing, the playing process is controlled, or the user-related data that the display device 100 needs to obtain during the playing process is controlled.

Specifically, the display device 100 obtains the play times from the first server 300 through the second communication component 104 as a device control signal, and when the display device 100 plays the fitness video, controls the playback duration of the current fitness video according to the obtained device control signal .

In the embodiment of the present disclosure, the device indicated by the device control signal may be the display device 100 , and may also be a sensor, a camera, and other devices matched with the display device 100 . If the device indicated by the device control signal is the display device 100, the working parameters may include related parameters such as playback speed and playback duration. If the device indicated by the device control signal is a device such as a sensor and a camera used in conjunction with the display device 100, the working parameters may include a data collection period, a data collection start time, a data collection end time, and the like.

Specifically, when the display device 100 receives the device control signal, it judges the control object of the device control signal, if the control object is the display device 100, then performs video playback control according to the device control signal; if the control object is the display device 100 is equipped with sensors, cameras and other devices, and these devices are controlled according to the device control signals.

In the embodiment of the present disclosure, the device indicated by the device control signal is a device capable of collecting user-related data, and the device may be a part of the display device 100 or other devices matched with the display device 100 . The user-related data may include IMU data, video image data, physiological data, and the like.

Specifically, when the display device 100 receives the device control signal, the device control signal indicates to start detecting the user's heart rate data 30 seconds after the video is turned on, then the display device 100 will wear the heart rate data 30 seconds after the video is turned on. The exercise bracelet on the user's body collects the user's heart rate data, and displays the user's heart rate data through the display device 102 .

S6: Obtain at least one piece of auxiliary video information from the first server 300 through the second communication connection according to the first video playback request, and display the acquired auxiliary video information during playing the video slice.

In the embodiment of the present disclosure, the video auxiliary information may be corresponding to the video requested by the first video playback request, or may be corresponding to the device that sends the first video playback request and corresponds to the user. The auxiliary video information may include a target heart rate expected by the user, a target heart rate corresponding to a fitness video, relevant information of the fitness video, and the like.

Specifically, when the display device 100 receives the video auxiliary information, the video auxiliary information is the target heart rate that the user should reach after 30 seconds after the video is turned on, then the display device 100, 30 seconds after the video is turned on, passes The display device 102 displays the target heart rate to the user. At the same time, the display device 100 can also collect the user's heart rate data through the sports bracelet worn on the user's body 30 seconds after the video is turned on, and display the user's heart rate data through the display device 102 synchronously.

The method provided by the embodiment of the present disclosure will be exemplarily described below in conjunction with the application scenario shown in FIG. 7 . Please refer to FIG. 8 , the method provided by the embodiment of the present disclosure can be executed by the aforementioned display device 100. In other embodiments, the order of some operations in the method of the embodiment of the present disclosure can be exchanged according to actual needs, or part of the operations can be exchanged according to actual needs. It can also be omitted or deleted.

The display device 100 communicates with at least two of the first server 300, the second server 400, the external device 200, and the auxiliary device respectively through the first communication connection, the second communication connection, and the third communication connection, and Selectively displaying the acquired data through a display screen may include the following operations.

Operation S10: Obtain a first video playback request from the external device 200 through the first communication connection;

Operation S20: Obtain the address of the first video stream from the first server 300 through the second communication connection according to the first video playback request;

In the embodiment of the present disclosure, the second communication connection with the first server 300 can be established by the display device 100 through the first communication component 103, and the first video stream address can be obtained from the first server 300 by the display device 100 through the second communication connection. Communication acquisition, wherein the address of the first video stream should match the first video playback request. Specifically, the display device 100 may extract the data representing the requested video from the first video playback request, and send the data to the first server 300 after encapsulating the data according to the protocol matching the second communication connection. The first server The 300 can obtain the matching first video stream address from the index configured on the first server 300 according to the data.

Operation S30: Obtain video stream slices from the target server through the third communication connection according to the first video stream address;

In the embodiment of the present disclosure, the third communication connection with the target server may be established by the display device 100 through the first communication component 103, or the third communication connection with the target server may be established by the display device 100 through other communication components; the target server It may be the first server 300 , or a server or server group different from the first server 300 .

Operation S40: acquiring auxiliary data from the auxiliary device 500 through the fourth communication connection;

In the embodiment of the present disclosure, the fourth communication connection with the auxiliary device 500 can be established by the display device 100 through the second communication component 104; the auxiliary device 500 can be a sensor worn on the user's body, or can be used to collect other data devices. The auxiliary device 500 can be a bracelet, a wearable sensor, a smart wearable, a depth camera, a handheld fitness device, etc., and the data detected by it can be the biological data of the user, or the IMU data and image data.

Operation S50: Play and display the video stream slice;

Operation S6: Display the auxiliary data on the upper layer of the video stream slice.

In the embodiment of the present disclosure, the auxiliary data may be fused with the video stream slice to be displayed on the upper layer of the video stream slice when playing the video stream slice, or may be implemented by using the simultaneous playback technology of different data streams.

For example, the auxiliary device 500 collects the user's heart rate data, the display device 100 receives the auxiliary data through the second communication component 104, and displays the received auxiliary data on the lower left corner, lower right corner, upper left corner, upper right corner or both sides of the display device 102 data.

Operation S401: Obtain at least one type of ranking data from the first server through a second communication connection according to the first video playback request.

In the embodiment of the present disclosure, the ranking data may be data that can visually show the exercise effect to the user, such as the duration of the user's exercise, the score of the exercise posture, and physiological data.

For example, the first video play request may be generated by the external device 200 itself according to needs, or may be generated by the user operating the external device 200 . The first video playback request may include an identification or identification number of the requested video. Specifically, in this embodiment, the first video play request may be encoded and decoded according to the communication protocol corresponding to the first communication connection. The first video playback request should correspond to at least one motion type; when the display device 100 establishes a second communication connection with the first server 301 through the first communication component 103, the first server 301 obtains the first video playback request, except Generate the first video stream address according to the first video playback request and send it to the display device 100, and also need to obtain the ranking data of the sports type corresponding to the first video playback request according to the first video playback request, and pass the ranking data through the second communication The sending display device 100 is connected.

In a possible implementation manner, the ranking data includes real-time ranking data and historical ranking data.

In the embodiment of the present disclosure, the real-time ranking data is the ranking data of the sport corresponding to the first video playback request at the same time; the historical ranking data is the ranking data of the sport corresponding to the first video playback request within a period of time before the current sport.

For example, when the user is performing a squat exercise, the action corresponding to the first video playback request is a squat exercise. At this time, if the ranking data is real-time ranking data, the user will be shown the ranking data of other users who are performing squat exercises at the same time; Rank data of other users performing squat exercises.

In a possible implementation manner, the ranking data is auxiliary data collected by other devices.

In the embodiment of the present disclosure, the other device is the auxiliary device 400 , and may also be a device of the same type different from the auxiliary device 400 . It should be understood that other devices corresponding to real-time ranking data may use at least one device of the same type different from auxiliary device 400; other devices corresponding to historical ranking data may use auxiliary device 400 or at least one device of the same type different from auxiliary device 400.

Operation S402: The ranking data and the auxiliary data are processed and displayed together on the upper layer of the video stream slice.

In the embodiment of the present disclosure, the processing of ranking data and auxiliary data may be performed by using the processor 101, or may be implemented by using other devices with computing functions. The processing of ranking data and auxiliary data includes transcoding processing, merging processing, and other processing methods that are convenient for visually displaying the user's fitness status to the user.

For example, the processor 101 processes the acquired ranking data into a list form, compares the auxiliary data with the data in the ranking data, and then inserts them into the list; at the same time, the auxiliary data is highlighted by means of image processing to form common data . The processor 101 displays the common data on the upper layer of the video stream slice. This display method allows users to clearly see their current exercise status and position in the ranking data, thereby providing incentives based on users and improving user experience.

Operation S411: Obtain a synchronization signal from the first server 300 according to the first video playback request, and the synchronization signal indicates a start point and an end point of a time.

In the embodiment of the present disclosure, the synchronization signal may indicate a start point and end point of a time, which may correspond to the start time and end time of video playback, or may correspond to the start time and end time of fitness actions in the video.

For example, the first video playback request should correspond to at least one type of motion; when the display device 100 establishes a second communication connection with the first server 300 through the first communication component 103, the first server 300 obtains the first video playback request , in addition to generating the first video stream address according to the first video playback request and sending it to the display device 100, it is also necessary to obtain the start time and end time of the fitness video or exercise type corresponding to the first video playback request according to the first video playback request As a synchronization signal, the synchronization signal is sent to the display device 100 through the second communication connection.

Operation S412: Receive auxiliary data from the auxiliary device 500 through the second communication component 104 according to the synchronization signal.

In the embodiment of the present disclosure, the receiving time of the auxiliary data may be determined according to the start point and the end point of the time.

Exemplarily, when the start point is reached, the display device 100 sends a first trigger signal to the auxiliary device 500, and the auxiliary device 500 starts sampling corresponding data and sends it to the display device 100; when the end point is reached, the The display device 100 sends a second trigger signal to the auxiliary device 500, and the auxiliary device 500 ends sampling. In this way, the degree of alignment between data samples of the auxiliary device 500 and video stream slices or fitness actions can be effectively improved.

Based on the same inventive concept, a display system is also provided. Referring to FIG. 4, the display system 20 includes: a first display device 110, a first external device 210, a first server 310, a second server 410, a first auxiliary device (not shown in FIG. 4), the first The display device 110 is configured to communicate with at least two of the first server 310, the second server 410, the first external device 210, and the first auxiliary device respectively through the first communication connection, the second communication connection, and the third communication connection , and selectively display the acquired data through the display screen.

In a possible implementation manner, the first external device 210 is configured to communicate with the first display device 110 through a first communication connection, and the first server 310 is configured to communicate with the first display device 110 through a second communication connection. The device 110 communicates, and the second server 410 is configured to communicate with the first display device 110 through a third communication connection, and communicates with the first server 310, the first display device 110 through the first communication connection, the second communication connection, and the third communication connection. At least two of the second server 410, the first external device 210, and the first auxiliary device communicate separately, and selectively displaying the acquired data through the display screen includes: connecting from the first external device 210 through the first communication Obtain the first video playback request at the location; obtain the first video stream address from the first server 310 through the second communication connection; obtain video stream slices from the second server 310 through the third communication connection.

In the embodiment of the present disclosure, for the detailed implementation manner of the first display device 110, reference may be made to the above detailed description for operations S1-S4.

In a possible implementation manner, the first display device 110 is configured to obtain at least one device control signal from the first server 310 through the second communication connection.

In a possible implementation manner, the first display device 110 is configured to obtain at least one piece of video auxiliary information from the first server 310 through the second communication connection.

In the embodiment of the present disclosure, for the detailed implementation manner of the first display device 110, reference may be made to the above detailed description for operations S5 and S6.

In a possible implementation manner, it further includes a second display device 120, and the second display device 120 is configured to: communicate with the second external device 220 through the fourth communication connection; communicate with the first server 220 through the fifth communication connection 310 communicate; communicate with the second server 410 through the sixth communication connection.

In the embodiment of the present disclosure, the fourth communication connection may adopt the same or similar method as the first communication connection, and may also be selected according to needs; similarly, the fifth communication connection may adopt the same or similar method as the second communication connection, It can also be selected according to needs; similarly, the sixth communication connection can use the same or similar method as the third communication connection, and can also be selected according to needs. The second display device 120 can adopt the working mode of the first display device 110 in the above embodiment, and the second external device 220 can adopt the working mode of the first external device 210 in the above embodiment.

Specifically, the second display device 120 may obtain a video playback request from the second external device 220, and the playback request of the second external device 220 may be a course selected by the second user to be played, or may be received by the second external device 220. The received common class request sent by the first external device 210, that is, the second display device 120 obtains the same video playback request from the second external device 220 as the first display device 110 obtains from the second external device 210. The first server 310 obtains the address of the video stream slice corresponding to the video play request, and then obtains the video stream slice corresponding to the video play request from the second server 410 , and finally the second display device 120 plays the video stream slice.

In a possible implementation manner, at least one of the video playback request, video stream address, and video stream slice obtained by the second display device 120 and the first display device 110 is the same.

Embodiments of the present disclosure can be applied to large-scale fitness places such as gyms, public fitness areas, and the like. The display devices include, but are not limited to, the second display device 120 and the first display device 110 , and the implementation of more than two display devices may refer to this embodiment. Specifically, when any one of the video playback request, video stream address, and video stream slice acquired by the second display device 120 and the first display device 110 is the same, the second display device 120 and the first display device 110 are synchronized. The display of corresponding fitness videos is beneficial to the exercise classes in gyms or public fitness places.

The display system of the present disclosure can also be implemented as a display system 80 as shown in FIG. The second server 410 is configured to communicate with the first display device 110 through the second communication connection, the second server 410 is configured to communicate with the first display device 110 through the third communication connection, and the first auxiliary device 510 is configured to communicate with the first display device 110 through the second communication connection. The four communication connections communicate with the first display device 110, and communicate with the first server 310, the second server 410, the first external device 210, and the first auxiliary device 510 through the first communication connection, the second communication connection, and the third communication connection At least two of them communicate respectively, and selectively displaying the obtained data through the display screen includes: obtaining the first video playback request from the first external device 210 through the first communication connection; obtaining the first video playback request from the first external device 210 through the second communication connection The first video stream address is obtained from the first server 310; the video stream slice is obtained from the second server 410 through the third communication connection; and the first auxiliary data is obtained from the first auxiliary device 510 through the fourth communication connection.

In the embodiment of the present disclosure, for a detailed implementation manner of the first display device 110, reference may be made to the above detailed description for operations S10-S60.

In a possible implementation manner, it further includes a second display device 120, and the second display device 120 is configured to: communicate 210 with the second external device through the fourth communication connection; communicate with the first server through the fifth communication connection 310 communicate; communicate with the second server 410 through the sixth communication connection; communicate 520 with the second auxiliary device through the seventh communication connection.

Specifically, the second display device 120 may obtain the video playback request from the second external device 220, obtain the video stream slice address corresponding to the video playback request from the first server 310, and then obtain the video address corresponding to the video playback request from the second server 410. stream slice, and finally the video stream slice is played by the second display device 120

Embodiments of the present disclosure can be applied to large-scale fitness places such as gyms, public fitness areas, and the like. The display device 100 includes but is not limited to the second display device 120 and the first display device 110 , and the implementation of more than two display devices may refer to this embodiment. Specifically, when any one of the video playback request, video stream address, and video stream slice acquired by the second display device 120 and the first display device 110 is the same, the second display device 120 and the first display device 110 are synchronized. The display of corresponding fitness videos is beneficial to the exercise classes in gyms or public fitness places.

In a possible implementation manner, the first server 310 is configured to obtain first auxiliary data of the first display device 110 and obtain second auxiliary data of the second display device 120 .

In a possible implementation manner, the first display device 110 is configured to obtain at least one synchronization signal from the first server 310 through the second communication connection, the synchronization signal specifies a start point and an end point of a time, and the first The display device 110 is configured to obtain the first auxiliary data from the first auxiliary device 510 through the fourth communication connection according to the synchronization signal. Based on the same inventive concept, embodiments of the present disclosure provide a computer-readable storage medium, including a stored computer program, and the computer program executes any one of the methods described above when running.

Based on the same inventive concept, embodiments of the present disclosure provide an electronic device, including a processor and a memory; the memory is configured to store instructions executable by the processor; the processor is configured to execute any one of the above-mentioned the control method described above.

As shown in FIG. 5 and FIG. 6 , based on the same inventive concept, an embodiment of the present disclosure provides a display device. For a detailed implementation, refer to the above detailed description for operations S1-S4 and/or operations S10-S60. The display device includes a frame body 901. A semi-transparent glass 902 is provided on the front of the frame body 901. The semi-transparent glass 902 includes a light-transmitting area 903 and a non-light-transmitting area. A display screen; a light sensor 905 and a camera 904 are arranged on the back of the semi-transparent glass 902, and the camera 904 is used to collect external image data to track the user's actions and gestures. The side of the frame body 901 also includes buttons 909 for device control.

Those of ordinary skill in the art can realize that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the relationship between hardware and software Interchangeability. In the above description, the composition and operation of each example have been generally described in terms of functions. Whether these functions are executed by hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present invention.

In the several embodiments provided in the present disclosure, it should be understood that the disclosed devices and methods may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or May be integrated into another system, or some features may be ignored, or not implemented. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be indirect coupling or communication connection through some interfaces, devices or units, and may also be electrical, mechanical or other forms of connection.

The units described as separate components may or may not be physically separated, and those of ordinary skill in the art may realize that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, it is possible to It is realized by electronic hardware, computer software or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and operation of each example have been generally described in terms of functions in the above description. Whether these functions are executed by hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present invention.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

If the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of software products, and the computer software products are stored in a storage medium In, several instructions are included to make a computer device (which may be a personal computer, a server, or a grid device, etc.) execute all or part of the operations of the methods described in various embodiments of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-OnlyMemory), random access memory (RAM, Random Access Memory), magnetic disk or optical disc and other media that can store program codes.

The specific embodiments described above have further described the purpose, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above descriptions are only specific embodiments of the present invention and are not intended to limit the scope of the present invention. Protection scope, within the spirit and principles of the present invention, any modification, equivalent replacement, improvement, etc., shall be included in the protection scope of the present invention.

Claims

Display devices, including:

display device;

a first communication component;

a second communication component;

at least one processor;

A memory coupled to the processor, wherein the memory stores processor-readable instructions, and at least one of the processors executes the readable instructions so that at least one of the processors:

Communicate with at least two of the first server, the second server, the external device, and the auxiliary device through the first communication component and the second communication component, and selectively display the acquired data through a display screen.
The display device according to claim 1, wherein the first communication component is configured to receive a first video playback request, the second communication component is configured to receive a first video stream address and/or a video stream slice, the Communicating with at least two of the first server, the second server, external equipment, and auxiliary equipment through the first communication component and the second communication component, and selectively displaying the acquired data through a display screen includes: through The first communication component receives the first video play request; receives the first video stream address matching the first video play request through the second communication component; receives the video stream slice matching the first video stream address through the second communication component; The display device displays the received video stream slices.
The display device according to claim 2, wherein the first communication component is communicatively coupled with the external device through a first communication protocol, and the second communication component communicates with the first external device through a second communication protocol different from the first communication protocol. The server is communicatively coupled, and the second communication component is communicatively coupled to the second server via a third communication protocol different from the first communication protocol and the second communication protocol.
The display device according to claim 3, wherein at least one of the processors receives the first video stream address matching the first video playback request from the first server through the second communication component; at least one of the processors through the The second communication component receives video stream slices matching the first video stream address from the second server.
The display device according to claim 1, wherein the first communication component is configured to communicate with an external device and a server; the second communication component is configured to communicate with an auxiliary device; The communication component communicates with at least two of the first server, the second server, the external device, and the auxiliary device, and selectively displays the acquired data through a display screen, including:

receiving a first video playback request from an external device through a first communication component;

receiving a first video stream address matching the first video playback request from the server through the first communication component;

receiving a video stream slice matching the first video stream address from the server through the first communication component;

receiving assistance data from an auxiliary device via a second communication component;

displaying the received video stream slices through a display device;

The received auxiliary data is displayed on a designated area of the display device by the display device.
The display device according to any one of claims 1 to 5, further comprising a semi-reflective glass disposed between the display device and the user.
A method for controlling a display device, comprising:

Communicate with at least two of the first server, the second server, external equipment, and auxiliary equipment through the first communication connection, the second communication connection, and the third communication connection, and selectively pass the acquired data through the display screen to show.
The method according to claim 7, wherein said communicating with at least two of the first server, the second server, the external device and the auxiliary device respectively through the first communication connection, the second communication connection and the third communication connection , and selectively display the acquired data through the display screen, including:

Obtaining a first video playback request from an external device through a first communication connection;

obtaining the first video stream address from the first server via the second communication connection according to the first video playback request;

Obtaining video stream slices from the target server through the third communication connection according to the first video stream address;

Play and display video stream slices.
The method according to claim 8, said communicating with at least two of the first server, the second server, the external device and the auxiliary device respectively through the first communication connection, the second communication connection and the third communication connection, and Selectively displaying the acquired data through the display screen further includes: obtaining at least one device control signal from the first server through the second communication connection according to the first video playback request,

Wherein, the device control signal indicates the operating parameters of the device during playing the video slice, and/or indicates the start and end points of collecting user-related data during the playing of the video slice.
The method according to claim 8, said communicating with at least two of the first server, the second server, the external device and the auxiliary device respectively through the first communication connection, the second communication connection and the third communication connection, and Selectively displaying the acquired data through the display screen further includes: acquiring at least one piece of video auxiliary information from the first server through the second communication connection according to the first video playback request, and displaying the acquired video auxiliary information during playing video slices information; and/or

A synchronization signal is obtained from the first server according to the first video playback request, and the synchronization signal indicates a start point and an end point of a time.
The method according to claim 7, wherein said communicating with at least two of the first server, the second server, the external device and the auxiliary device respectively through the first communication connection, the second communication connection and the third communication connection , and selectively display the acquired data through the display screen, including:

Obtaining a first video playback request from an external device through a first communication connection;

Obtain the first video stream address from the first server through the second communication connection according to the first video playback request;

Obtaining video stream slices from the target server through the third communication connection according to the first video stream address;

obtaining assistance data from the auxiliary device via the fourth communication connection;

Play and display video stream slices;

Display ancillary data on top of video stream slices.
The method according to claim 11, wherein said communicating with at least two of the first server, the second server, the external device and the auxiliary device respectively through the first communication connection, the second communication connection and the third communication connection and selectively displaying the obtained data through a display screen further includes: acquiring at least one ranking data from the first server through the second communication connection according to the first video playback request,

Wherein, the ranking data includes real-time ranking data and historical ranking data, and/or auxiliary data collected by other devices.
The method according to claim 12, said communicating with at least two of the first server, the second server, the external device and the auxiliary device respectively through the first communication connection, the second communication connection and the third communication connection, and Selectively displaying the obtained data through a display screen also includes: processing the ranking data and auxiliary data and jointly displaying them on the upper layer of the video stream slice.
The display system includes: a first display device, a first external device, a first server,

second server, first auxiliary device,

The first display device is configured to communicate with at least two of the first server, the second server, the first external device, and the first auxiliary device through the first communication connection, the second communication connection, and the third communication connection , and selectively display the acquired data through the display screen.
The display system according to claim 14, wherein the first external device is configured to communicate with the first display device through a first communication connection, and the first server is configured to communicate with the first display device through a second communication connection. Device communication, the second server is configured to communicate with the first display device through a third communication connection, the first communication connection, the second communication connection, the third communication connection with the first server, the second server, the first display device An external device and at least two of the first auxiliary device respectively communicate, and selectively displaying the acquired data through the display screen includes: obtaining the first video playback request from the first external device through the first communication connection ; Obtain the first video stream address from the first server through the second communication connection; obtain the video stream slice from the second server through the third communication connection.
The display system according to claim 15, further comprising a second display device configured to: communicate with a second external device through a fourth communication connection; communicate with the first server through a fifth communication connection; Communicate with the second server via a sixth communication connection.
The display system according to claim 14, wherein the first external device is configured to communicate with the first display device through a first communication connection, and the first server is configured to communicate with the first display device through a second communication connection. device communication, the second server is configured to communicate with the first display device via a third communication connection, the first auxiliary device is configured to communicate with the first display device via a fourth communication connection,

Said communicating with at least two of the first server, the second server, the first external device, and the first auxiliary device through the first communication connection, the second communication connection, and the third communication connection, and transferring the obtained data Selectively displaying through the display screen includes: obtaining the first video playback request from the first external device through the first communication connection; obtaining the first video stream address from the first server through the second communication connection; obtaining the first video stream address through the third communication connection The video stream slice is acquired from the second server; and the first auxiliary data is acquired from the first auxiliary device through the fourth communication connection.
The display system according to claim 17, further comprising a second display device configured to: communicate with a second external device through a fourth communication connection; communicate with the first server through a fifth communication connection; communicating with the second server via the sixth communication connection; communicating with the second auxiliary device via the seventh communication connection.
The display system according to claim 16 or 18, wherein at least one of the video playback request, video stream address and video stream slice acquired by the second display device and the first display device is the same.
The display system according to claim 18, wherein the first server is configured to obtain the first auxiliary data of the first display device and obtain the second auxiliary data of the second display device.