CN115174672A

CN115174672A - Terminal, display device and data transmission method

Info

Publication number: CN115174672A
Application number: CN202210749523.0A
Authority: CN
Inventors: 刘彦彦; 丁振宇; 李辉; 黄继超; 宋一迪; 张建; 张淯易; 丛伟升; 廖希洋
Original assignee: Hisense Group Holding Co Ltd
Current assignee: Hisense Group Holding Co Ltd
Priority date: 2022-06-28
Filing date: 2022-06-28
Publication date: 2022-10-11
Anticipated expiration: 2042-06-28
Also published as: CN115174672B

Abstract

The invention provides a terminal, display equipment and a data transmission method, which relate to the technical field of equipment interaction, and comprise the following steps: after receiving device data sent by a target IOT device, if the target IOT device finds a display device corresponding to the target IOT device in a device set, the data of the IOT is sent to the display device through a private server corresponding to the IOT device, or information of the display device is sent to the IOT device through a terminal, so that the IOT device can directly upload the device information of the IOT device to the corresponding server, or the IOT device directly sends the information to the display device, and the IOT device and the display device can perform data interaction. The embodiment of the invention can enable the IOT equipment and the display equipment to transmit information by taking the terminal as an intermediary or establishing a communication channel between the IOT equipment and the display equipment through the terminal, thereby solving the problem that the IOT equipment can not transmit data with the display equipment.

Description

Terminal, display device and data transmission method

Technical Field

The invention relates to the technical field of equipment interaction, in particular to a terminal, display equipment and a data transmission method.

Background

With the rise of smart homes, more and more smart home appliances, health equipment and fitness equipment enter common families in a dispute, and the data sharing and operation of the IOT equipment are more hopeful to be shared on a larger screen, so that the family pleasure is increased.

Aiming at the user requirements, the IOT equipment cannot be connected with a distribution network by self, bluetooth connection is required to be established with a terminal with communication modules such as Bluetooth and the like, the login information of a home local area network is sent to the IOT equipment by the terminal through the Bluetooth, the IOT equipment surfs the internet according to the login information of the local area network, so that the information of the IOT equipment can be sent to a cloud platform, and only the information of the IOT equipment can be acquired through the cloud platform.

However, some televisions are not configured with communication modules such as bluetooth, and the IOT device cannot complete the network distribution process, so that the television cannot exchange data with the IOT device.

Disclosure of Invention

The invention provides a terminal, a display device and a data transmission method, which can carry out information transmission between an IOT device and the display device by taking the terminal as an intermediary or establish a communication channel between the IOT device and the display device through the terminal so as to carry out information transmission between the IOT device and the display device, and solve the problem that the IOT device cannot transmit data with the display device.

In a first aspect, an embodiment of the present invention provides a terminal, including: a communication unit and a processor;

a communication unit for communicating with a target IOT device, a private server, and a display device;

the processor is used for determining display equipment corresponding to the target IOT equipment according to the corresponding relation between the IOT equipment and the display equipment if equipment data sent by the target IOT equipment are received; sending the device data to display equipment corresponding to the target IOT equipment through a private server corresponding to a terminal so that the corresponding display equipment can display the device data to a user; or

Acquiring identity information of display equipment corresponding to target IOT equipment, and after the display equipment is connected with the target IOT equipment, transmitting the identity information of the display equipment corresponding to the target IOT equipment so that the target IOT equipment transmits the identity information of the corresponding display equipment to a server corresponding to the target IOT equipment, and binding the corresponding server with the target IOT equipment according to the identity information of the corresponding display equipment, thereby realizing that the display equipment corresponding to the target IOT equipment can acquire equipment data of the target IOT equipment from the server corresponding to the target IOT equipment; or

The method comprises the steps of obtaining communication information required by MQTT communication service in display equipment corresponding to target IOT equipment, and after the communication information is connected with the target IOT equipment, sending the communication information of the display equipment corresponding to the target IOT equipment so that the target IOT equipment adopts the MQTT communication service and sends equipment data to the corresponding display equipment through the communication information of the corresponding display equipment; wherein, the communication information comprises an IP address.

The terminal can determine whether the target IOT equipment is in the equipment set or not after receiving the equipment data sent by the target IOT equipment, if so, find the display equipment corresponding to the target IOT equipment, and send the data of the IOT to the display equipment through the private server corresponding to the IOT equipment, so that information transmission is carried out between the display equipment and the IOT equipment, or the information of the display equipment is sent to the IOT equipment through the terminal, so that the IOT equipment can directly upload the equipment information of the IOT equipment to the corresponding server, the display equipment obtains the data from the corresponding server, or the IOT equipment directly sends the information to the display equipment, and the problem that the IOT equipment cannot transmit the data with the display equipment is solved.

In one possible implementation, the processor is further configured to:

after receiving device data sent by a target IOT device, if first control information sent by a private server corresponding to a terminal is received, sending a control instruction contained in the first control information to the target IOT device contained in the first control information, so that the target IOT device executes the control instruction after receiving the control instruction;

the first control information is generated by a private server corresponding to the terminal according to second control information sent by the display equipment; the second control information is generated by the display device according to a control instruction issued by the display device to the target IOT device and the device type of the target IOT device; or the first control information is generated by the display equipment and transmitted through a private server corresponding to the terminal.

The terminal can receive the control instruction sent by the display equipment, so that the control instruction is forwarded to the target IOT equipment, the purpose of controlling the IOT equipment is achieved, and the problem that the IOT equipment cannot transmit data with the display equipment is solved.

In a possible implementation manner, the processor is specifically configured to:

encrypting the device data by adopting a target key appointed by display equipment corresponding to the target IOT device, and sending the encrypted device data to the display equipment corresponding to the target IOT device through a private server corresponding to a terminal;

the target key is determined according to a public character string agreed by the terminal and the display device corresponding to the target IOT device, a private character string generated by the terminal and a private character string generated by the display device corresponding to the target IOT device.

The terminal can establish the key between the display equipment and the terminal, and the key is adopted to encrypt information when the terminal and the display equipment transmit the information, so that the information security is improved.

receiving target information of display equipment corresponding to target IOT equipment input by a user; the target information is communication information or identity information required by MQTT communication service in the display equipment; or alternatively

Establishing a display device connection corresponding to a target IOT device, and requesting target information from the display device corresponding to the target IOT device; receiving target information sent by display equipment corresponding to the target IOT equipment; and the target information is sent after the display device corresponding to the target IOT device receives the request.

The terminal can enable the target IOT equipment and the display equipment to be in direct communication through inputting the target information of the display equipment corresponding to the target IOT equipment by a user or actively requesting the target information of the display equipment corresponding to the target IOT equipment, and therefore communication efficiency is improved.

In a second aspect, an embodiment of the present invention provides a display device, including: a communication unit, a display and a controller;

a communication unit for communicating with a target IOT device, a terminal and a private server;

the display is used for displaying a display interface;

the controller is used for receiving equipment data sent by the terminal through the private server corresponding to the terminal; the device data is generated by the target IOT device and sent to the terminal; the display device is the display device corresponding to the target IOT device determined by the terminal according to the corresponding relation between the IOT device and the display device;

and displaying the equipment data by adopting a display interface of the equipment type of the target IOT equipment.

In one possible implementation, the controller is further configured to:

responding to a control instruction triggered by a user on a control interface corresponding to the type of equipment, determining target IOT equipment which is required to be controlled by display equipment according to the type of the equipment corresponding to the control interface, generating first control information according to the control instruction and the target IOT equipment, and sending the first control information to a terminal through a private server corresponding to the terminal; or

And responding to a control instruction triggered by a user on a control interface corresponding to the equipment type, generating second control information according to the control instruction and the equipment type corresponding to the control interface, and sending the second control information to the private server so that the private server sends the control signaling to the target IOT equipment through the terminal.

In a third aspect, an embodiment of the present invention provides a data transmission method, applied to a terminal, including:

if receiving device data sent by target IOT equipment, determining display equipment corresponding to the target IOT equipment according to the corresponding relation between the IOT equipment and the display equipment; sending the device data to display equipment corresponding to the target IOT equipment through a private server corresponding to a terminal so that the corresponding display equipment can display the device data to a user; or

In one possible implementation, the method further comprises:

the first control information is generated by a private server corresponding to the terminal according to second control information sent by the display equipment; the second control information is generated by the display device according to a control instruction issued by the display device to the target IOT device and the device type of the target IOT device; or the first control information is generated by the display device and transmitted through a private server corresponding to the terminal.

In a fourth aspect, an embodiment of the present invention provides a data transmission method, which is applied to a display device, and includes:

receiving equipment data sent by a terminal through a private server corresponding to the terminal; the device data is generated by the target IOT device and sent to the terminal; the display device is the display device corresponding to the target IOT device determined by the terminal according to the corresponding relation between the IOT device and the display device;

In one possible implementation, the method further comprises:

responding to a control instruction triggered by a user on a control interface corresponding to the device type, determining target IOT (input/output) equipment which is required to be controlled by display equipment according to the device type corresponding to the control interface, generating first control information according to the control instruction and the target IOT equipment, and sending the first control information to a terminal through a private server corresponding to the terminal; or

In a fifth aspect, an embodiment of the present invention provides a storage medium, where instructions executed by a processor of a terminal enable the terminal to execute the data transmission method according to any one of the third aspects.

In a sixth aspect, an embodiment of the present invention provides a storage medium, where when executed by a processor of a display device, instructions enable the display device to perform the data transmission method according to any one of the fourth aspects.

In addition, for technical effects brought by any one implementation manner of the second aspect to the ninth aspect, reference may be made to technical effects brought by different implementation manners of the first aspect, and details are not described here.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.

Drawings

Fig. 1 is a schematic diagram of an interaction between an IOT device and a terminal according to an embodiment of the present invention;

fig. 2 is a schematic diagram of a device relationship among an IOT device, a terminal, a private server, and a display device according to an embodiment of the present invention;

fig. 3 is a flowchart of data transmission between an IOT device, a terminal, a private server, and a display device according to an embodiment of the present invention;

fig. 4 is a schematic diagram of user interaction when a user selects a private server corresponding to an IOT device according to an embodiment of the present invention;

fig. 5 is a schematic diagram of a user interaction for selecting a display device corresponding to an IOT device by a user according to an embodiment of the present invention;

fig. 6 is a schematic diagram illustrating an IOT device transmitting data to a display device according to an embodiment of the present invention;

fig. 7 is a schematic diagram of another user interaction for selecting a display device corresponding to an IOT device according to an embodiment of the present invention;

fig. 8 is a schematic diagram of another IOT device transmitting data to a display device according to an embodiment of the present invention;

fig. 9 is a flowchart illustrating a display device sending a control command to an IOT device according to an embodiment of the present invention;

fig. 10 is a schematic diagram of a user triggering a control command from a display device side according to an embodiment of the present invention;

fig. 11 is a flowchart illustrating another method for sending a control command to an IOT device by a display device according to an embodiment of the present invention;

fig. 12 is a schematic diagram of a configuration device type and a corresponding private server on the display device side according to an embodiment of the present invention;

fig. 13 is a schematic diagram of encrypting data during data transmission between a terminal and a display device according to an embodiment of the present invention;

fig. 14 is a schematic diagram illustrating data exchange between a terminal and a display device according to an embodiment of the present invention;

fig. 15 is a schematic diagram of a terminal-side user configuration display device according to an embodiment of the present invention;

fig. 16 is a schematic diagram of interaction among a terminal, an IOT device, a server corresponding to the IOT device, and a display device according to an embodiment of the present invention;

fig. 17 is a flowchart illustrating an IOT device sending device information to a display device according to an embodiment of the present invention;

fig. 18 is a flowchart illustrating a display device sending a control command to an IOT device according to an embodiment of the present invention;

fig. 19 is a schematic diagram of interaction between a terminal, an IOT device, and a display device according to an embodiment of the present invention;

fig. 20 is a flowchart illustrating an alternative method for sending device information to a display device by an IOT device according to an embodiment of the present invention;

fig. 21 is a flowchart illustrating another example of a display device sending a control command to an IOT device according to an embodiment of the present invention;

fig. 22 is a schematic structural diagram of a terminal according to an embodiment of the present invention;

fig. 23 is a schematic structural diagram of a display device according to an embodiment of the present invention.

Detailed Description

To make the purpose and embodiments of the present application clearer, the following will clearly and completely describe the exemplary embodiments of the present application with reference to the attached drawings in the exemplary embodiments of the present application, and it is obvious that the described exemplary embodiments are only a part of the embodiments of the present application, and not all of the embodiments.

The IOT device: namely, internet of things equipment such as smart homes, sphygmomanometers, treadmills, spinning bicycles and the like; the internet of things equipment cannot be directly connected with a local area network set by a family, and the internet of things equipment can be networked only after the mobile phone sends login information of the local area network to the internet of things, so that the IOT equipment has communication capacity with the cloud server.

For example, as shown in fig. 1, the IOT device 11 is connected to the mobile phone 12 via bluetooth, the mobile phone 12 sends the local area network login information in the home to the IOT device 11, after the IOT device 11 logs in the local area network using the local area network login information, the network distribution is successful, and the target IOT device 11 is accessed to the cloud platform 10; then, the IOT device 11 may upload data information collected by some sensors of the IOT device itself to the cloud platform 10 in real time through the message data transmission protocol, and the cloud platform 10 may push the device data information to the mobile phone 12 connected to the device in real time, so that the mobile phone 12 may display the device data information. The process of the mobile phone 12 controlling the IOT device 11 is that the mobile phone 12 sends a control instruction to push the cloud platform 10, the cloud platform 10 receives the instruction and issues the instruction to the IOT device 11, and the IOT device 11 executes the instruction.

Or, the IOT device 11 is connected to the mobile phone 12 via bluetooth, the IOT device 11 sends data to the mobile phone 12 via bluetooth, and the mobile phone 12 displays data information of the device. The mobile phone 12 sends a control instruction, and sends the control instruction to the IOT device 11 through bluetooth, and the IOT device 11 executes the control instruction.

However, if the television does not have a bluetooth module, the IOT device cannot complete the initial network distribution process, and then the television cannot communicate with the target IOT device.

Based on this, the present invention provides a data communication system, as shown in fig. 2, including: a terminal 200, a private server 201, a display device 202, and a target IOT device 203;

in the data communication system, the process of the target IOT device 203 sending device information to the display device 202, which is shown in fig. 3, includes:

s300: the target IOT equipment sends the equipment data which is required to be sent to the display equipment to the terminal;

s301: if the terminal receives the device data sent by the target IOT device and determines that the target IOT device is in the device set, determining the display device corresponding to the target IOT device according to the corresponding relationship between the IOT device and the display device; and sending the device data to the display device corresponding to the target IOT device through the private server corresponding to the terminal, so that the corresponding display device displays the device data to the user.

S302: and if the private server receives the equipment data sent by the terminal, sending the equipment data sent by the terminal to the display equipment corresponding to the target IOT equipment.

S303: the display equipment receives equipment data sent by a private server corresponding to the terminal; and displaying the equipment data by adopting a display interface of the equipment type of the target IOT equipment.

Specifically, the target IOT device 203 transmits device data to the terminal 200 through bluetooth or a cloud platform. Specifically, referring to the part of fig. 1, the target IOT device 203 may upload device data collected by some sensors of the target IOT device to the cloud platform in real time through the message data transmission protocol, and the cloud platform then pushes the device data to the terminal 200 connected to the device in real time, so that the device data may be displayed on the terminal 200.

Or, the target IOT device 203 is connected to the terminal 200 via bluetooth, the target IOT device 203 sends device data to the terminal 200 via bluetooth, and the terminal 200 displays the device data. Of course, the terminal 200 may not display the device data, and the invention is not limited thereto.

The terminal 200 has a network access function, for example, accessing the internet by using WiFi or 4G/5G, and the display device 202 may also be connected to the network, for example, connecting WiFi. Both the terminal 200 and the display device 202 can communicate with the private server 201 through a network;

after the terminal 200 is connected to the private server 201 through the network, the device data of the target IOT device 203 is sent to the private server 201 corresponding to the terminal 200, the private server 201 corresponding to the terminal 200 sends the device data to the display device 202 corresponding to the target IOT device 203, and the display device 202 displays the device data.

The private server 201 corresponding to the terminal 200 is a server corresponding to the non-target IOT device, is a self-established server, and may be a server specially used for communication between the target IOT device and the display device. Meanwhile, for data security, whether the device for transmitting data is the terminal or not can be verified, specifically, the terminal can send the identity information of the terminal to the server corresponding to the terminal, after the server corresponding to the terminal receives the device data sent by the terminal, whether the identity information of the terminal is the identity information transmitted before is verified firstly, and if the identity verification is successful, the server corresponding to the terminal sends the device data to the display device corresponding to the target IOT device.

For data communication, there may be a plurality of target IOT devices that want to perform data transmission with the display device. Target IOT devices such as spinning bicycles, treadmills, glucometers, etc. When there are multiple private servers corresponding to the terminal, the private servers communicating with the display device may be different for each target IOT device, so that the corresponding relationship between the two is established on the terminal side, and shown in table 1:

TABLE 1

Target IOT device	Private server
		Spinning bicycle	Private Server 1
Running machine	Private Server 2
		Blood glucose meter	Private server 3

The set of devices provided by the terminal 200 is a spinning bike, a treadmill, and a blood glucose meter, and information representing their identities may be recorded when recording each device. When the target IOT device sends the device data to the terminal 200, the terminal 200 sends its own identity information to the terminal 200, and the terminal 200 checks the table to see whether the device is in the device set, and if so, checks the table again to find the corresponding private server, for example, if the target IOT device is a spinning bike, the corresponding private server is the private server 1. Therefore, the terminal can send the device data provided by the spinning to the private server 1, and the private server 1 forwards the device data of the spinning received by the terminal.

Referring to fig. 4, a user opens a corresponding configuration interface through the terminal 200, and enters a target IOT device, or selects a target IOT device connected via bluetooth currently to a terminal 200, for example, a spinning bike, after the selection is completed, the terminal 200 displays that the private server can be connected, the private servers can transmit their own information to the terminal 200 in advance, when the user selects the private server 1, the terminal 200 records the corresponding relationship, and similarly, the user can configure the private server corresponding to the treadmill as the private server 2, and the user configures the private server corresponding to the blood glucose meter as the private server 3. The terminal 200 may then store the information configured by the user, so that after receiving the information sent by the corresponding IOT device, the terminal can quickly find the corresponding private server.

The IOT devices transmitted by different private servers may also be configured by the private server, the configuration personnel writes the corresponding relationship to the private server, and the private server transmits the information to the terminal 200, for example, the private server 1 may transmit device data of a spinning bike, the private server 2 may transmit device data of a treadmill, and the private server 3 may transmit device data of a blood glucose meter.

If there is only one private server for transmitting the IOT device, the terminal may default the private server to transmit the target IOT device, that is, the IOT device may be transmitted to the private server as long as the IOT device is in the device set. In this regard, the present invention is not particularly limited.

For the display device that displays the device data of the target IOT device, it needs to be set in advance, and as shown in fig. 5, the target IOT device may be selected on the terminal 200, then the display device that needs to be configured is selected, and the display device corresponding to the target IOT device is selected, for example, the target IOT device is a spinning bike, after the user selects the spinning bike, then the corresponding display device is selected, and the exhibition hall tv (after the selection is completed, the selection frame is blackened).

As shown in fig. 6, when the user only selects the main exhibition room tv to display the device data transmitted by the spinning, the device data is transmitted to the mobile phone (when the terminal is a mobile phone) for transfer by the data transmitted by the spinning, the mobile phone is transmitted to the private server corresponding to the spinning, and according to the corresponding relationship between the spinning and the main exhibition room tv, the private server transmits the device data transmitted by the spinning to the main exhibition room tv, which displays the device data.

When the television of the main exhibition room is displayed, the images of the user riding the spinning through the equipment data transmission can be displayed by combining the motion data of the spinning. The images of the user when riding the spinning and the motion data of the spinning both belong to the device data.

In addition to the selection performed by the user at the terminal 200, the target IOT device that needs to perform data transmission through the terminal may also be configured to a preset display device. When only one display device capable of displaying the device data is provided, the target IOT device can be directly configured to the preset display device without user selection.

The user can select the number of the display devices corresponding to the spinning to be multiple. As shown in fig. 7, after selecting the target IOT device that the user wants to configure, the user selects the corresponding display device, and the information of the display device may be sent to the terminal through the private server, or if the user knows the information of the display device, the information of the display device may be added to the terminal, so that the display device may be selected when the user selects the display device. For example, the display device corresponding to the spinning selected by the user comprises a main exhibition hall television, an exhibition hall and study room television and an exhibition hall and bedroom television.

With reference to fig. 8, when the user selects the main exhibition room tv, the exhibition room study tv, and the exhibition room bedroom tv to display the device data transmitted by the spinning, then the device data is transmitted to the mobile phone (when the terminal is the mobile phone) of the transfer by the data transmitted by the spinning, the mobile phone is transmitted to the private server corresponding to the spinning, the private server respectively transmits the device data transmitted by the spinning to the main exhibition room tv, the exhibition room study tv, and the exhibition room bedroom tv according to the corresponding relationship between the spinning and the main exhibition room tv, and the exhibition room study tv, and the exhibition bedroom tv to display.

And the user can also reselect the display equipment corresponding to different IOT equipment, and the last corresponding relation is adopted for data transmission all the time before the user does not reselect the display equipment corresponding to the IOT equipment.

In the process of displaying device data by the display device, the display device needs to download and display related applications, and display pictures of multiple device types can be included in the applications. If the target IOT device is a spinning, the data of the display interface corresponding to the type of the spinning can be called. If the target IOT device is a treadmill, the presentation interface presentation device data corresponding to the type of equipment of the treadmill can be called.

In summary, since the private server communicating with the display device may be different for each target IOT device, and the display device displaying the device data of the IOT device may also be different, the correspondence relationship between the three devices is established on the terminal side, and is shown in table 2:

TABLE 2

As shown above, when a user or automatically configures the private server corresponding to the IOT device and the display device corresponding to the IOT device, the relationship shown in table 1 may be formed by three of them, and each row corresponds to a corresponding relationship between the IOT device, the private server and the display device. For example, if the terminal receives the device data of the spinning, the terminal may transmit the device data to the private server 1 based on the table 2, and when the private server 1 receives the device data of the spinning sent by the terminal, the device data may be sent to the display device a based on the table 2. The table may be sent to the private server after being formed at the terminal side, so that the private server can send the corresponding IOT device data to the corresponding display device when receiving the corresponding IOT device data.

For the above, since the corresponding relationship between the IOT device and the display device may be formed on the terminal side, the terminal side may determine the display device corresponding to the target IOT device in advance, and send the device information of the display device corresponding to the target IOT device to the private server corresponding to the target IOT device. Therefore, the private server can directly determine the display equipment according to the received equipment information of the display equipment corresponding to the target IOT equipment, and the private server can directly transmit the data to the corresponding display equipment without any change after knowing the destination to which the data of the equipment is transmitted.

When the corresponding relationship between the IOT device and the private server is stored on the terminal side, and the corresponding relationship between the IOT device and the display device is stored on the private server side, the terminal directly sends the device data to the corresponding private server, and on the private server side, the display device corresponding to the target IOT device needs to be determined according to the corresponding relationship between the IOT device and the display device. The private server is facilitated to be able to send device data to its own determined display device.

In the data transmission process, as shown in fig. 2, the display device 202 may also send a control instruction to the target IOT device 203, so as to control the target IOT device 203.

As shown in fig. 9, the method includes:

s900: the display device responds to a control instruction triggered by a user on a control interface corresponding to the device type, determines target IOT equipment which the display device wants to control according to the device type corresponding to the control interface, generates first control information according to the control instruction and the target IOT equipment, and sends the first control information to the terminal through a private server corresponding to the terminal.

S901: and if the private server receives the first control information sent by the display equipment, sending the first control information to the terminal.

S902: and if the terminal receives the first control information sent by the private server, sending a control instruction contained in the first control information to the target IOT equipment contained in the first control information.

S903: and the target IOT equipment executes the control instruction after receiving the control instruction.

Specifically, taking the display device 202 as a television as an example, as shown in fig. 10, the user controls the television to open a health application through a remote controller (right side of the image), the health application is an application for controlling the target IOT device, and then finds a device type that wants to control the target IOT device, the target application will be presented to the control interface of the device type of the target IOT device 203, and when the target IOT device 203 is a treadmill, the user selects the control instruction as acceleration. The television then sends the acceleration control command and the first control information generated by the target IOT device 203 to the private server corresponding to the target IOT device 203.

The correspondence between the target IOT device and the private server may be as shown in table 1, and after the terminal completes setting the correspondence table between the IOT device and the private server, the private server transmits the corresponding relationship table to the display device. The display devices may be all display devices connected to the private server. For example, if the private server 1 is connected to the display devices a to c and the private server 2 is connected to the display devices c to e, the terminal may transmit the contents of table 1 to the display devices a to c through the private server 1 and transmit the contents of table 1 to the display devices c to e through the private server 2.

When the terminal stores the correspondence table of table 2, the contents of table 2 can be transmitted to the display devices a to c, respectively, through the private server. Thus, the display devices a-c can directly query the private server corresponding to the target IOT device through table 2. For example, if the display device a wants to control a spinning bike, the control instruction can be sent to the private server 1 by looking up the table 2.

As shown in fig. 11, the method includes:

s1100: the display equipment responds to a control instruction triggered by a user on a control interface corresponding to the equipment type, generates second control information according to the control instruction and the equipment type corresponding to the control interface, and sends the second control information to a private server corresponding to the terminal.

S1110: if the private server receives second control information sent by the display equipment, determining target IOT equipment which the display equipment wants to control according to the equipment type contained in the second control information; and generating first control information according to the target IOT equipment and the control instruction, and sending the first control information to the terminal.

S1120: and if the terminal receives the first control information sent by the private server, sending a control instruction contained in the first control information to the target IOT equipment contained in the first control information.

S1130: and the target IOT equipment executes the control instruction after receiving the control instruction.

Specifically, taking the display device 202 as a television as an example, and referring to fig. 10, the user controls the television through the remote controller to open a target application, and then finds a device type that wants to control the target IOT device, the target application will be presented to the control interface of the device type of the target IOT device, and when the target IOT device is a treadmill, the user selects the control instruction as acceleration. And then the television generates second control information by accelerating the control instruction and the equipment type of the target IOT equipment and sends the second control information to a private server corresponding to the terminal, the private server corresponding to the terminal determines the target IOT equipment according to the equipment type, generates first control information and sends the first control information to the terminal.

Wherein the number of the private servers corresponding to the terminal can be multiple, further judgment of the device type is needed. The private server corresponding to the device type can be configured through the display device side. Referring to fig. 12, the user opens the health application, selects a device type in the settings of the health application, and then selects a private server corresponding to the device type. After the user configuration is completed, the configuration information can be stored in the display device so as to be used in subsequent data transmission.

In combination with the table 3:

TABLE 3

Type of device	Private server
		Treadmill type	Private Server a
Bicycle type	Private Server b

Of course, since the private server stores the corresponding relationship between the target IOT device and the display device, the private server may send the information to the display device, and the display device may modify the target IOT device into the device type corresponding to the target IOT device by changing the corresponding relationship, so as to store the information as shown in table 2.

After the private server receives the information sent by the display device, because the private server stores the corresponding relationship between the target IOT device and the display device sent by the terminal, the corresponding target IOT device can be directly found according to the device type in the second control instruction sent by the display device, so as to query the corresponding relationship, and then the target IOT device which the display device wants to control can be directly determined. And then the target IOT equipment and the control instruction are sent to the terminal. After receiving the information sent by the private server, the terminal sends the control instruction to the target IOT device, so that the function of controlling the target IOT device by the display device can be realized.

Exemplarily, since the terminal and the display device are connected to the private server through the network, in order to protect the security of data transmission, the present invention proposes to encrypt device data by using a target key agreed by the display device corresponding to the target IOT device, and send the encrypted device data to the display device corresponding to the target IOT device through the private server corresponding to the terminal;

the target key is determined according to a public character string agreed by the terminal and the private server corresponding to the target IOT device, a private character string generated by the terminal and a private character string generated by the private server corresponding to the target IOT device.

Specifically, the encryption mode can be AES symmetric encryption, and the selection reasons are high safety, very high encryption speed and high efficiency, so that the encryption method is suitable for occasions where data are often sent in real time. The key exchange adopts DH key exchange, its function is to make both sides of communication can establish a identical key in the unsafe channel, produce an identical secret key through exchanging the public key in customer end and server end, and regard this secret key as the secret key of the symmetric encryption algorithm, achieve the goal that the secret key of the symmetric encryption algorithm can be revised dynamically. This improves the security of data transmission over the network. The key exchange process of the invention comprises the following steps:

1. a terminal (hereinafter referred to as a) a and a display device (hereinafter referred to as B) B agree on an initial number g, such as g =5, a prime number p, such as p =23, g and p are disclosed;

2.A generates a random number a, a being a secret private key, e.g., a =6;

3.A calculates g ^ a% p to send to B, g ^ a% p =5^6 =23 =8;

4.B generates a random number b, which is a secret private key, e.g., b =15;

5.B calculates g ^ b% p to send to A, g ^ b% p =5^15 =23 =19;

6.A receives g ^ b% p, and then calculates (g ^ b% p) ^ a% p =19^6%23=2 by using the private key a;

7.B receiving g ^ a% p, calculating (g ^ a% p) ^ b% p =8^15 =23 =2 using private key b;

8. thus both parties a and B obtain one and the same key K:2;

in the whole communication process, g, p, g ^ a% p and g ^ b% p are public, at the moment, a is more difficult to obtain through g, p and g ^ a% p, and b is more difficult to obtain through g, p and g ^ b% p, so the final secret key is safer.

And finally, the two ends perform encryption and decryption on data by taking the key K as a symmetric encryption key.

Of course, the above-mentioned encryption content is performed in the private server without changing the data content transmitted to the display device by the terminal, and the key may be agreed at both ends of the terminal and the display device according to the above-mentioned scheme, so that the private server directly forwards the encrypted content. Referring to fig. 13, after receiving device data sent by the target IOT device, the terminal obtains the device data as plaintext P, obtains a ciphertext C through an AES encryption function using a key K (i.e., a target key), sends the ciphertext C to the display device through the private server, and the display device can decrypt the ciphertext C obtained through the AES encryption function using the key K, and then obtains the decrypted plaintext P, i.e., the device data.

Before the terminal and the display device, except that a private server can be adopted for connection, the embodiment of the invention also provides the introduction of socket communication connection. Specifically, the terminal integration device sdk is connected with the device, and then a socket communication service is introduced, so that two-way communication between the terminal and the two ends of the display device is realized, wherein one end is used as a server and the other end is used as a client. With reference to fig. 14, the specific implementation flow is as follows:

1. the display equipment is used as a Socket server, and opens a Port to receive message content sent by the terminal;

2. on one hand, the terminal is integrated with the SDK of the IOT equipment to realize the data interaction between the prior IOT equipment and the cloud platform; on the other hand, a Socket client is also integrated to connect the address and the port of the display device (namely, the IP address and the open port of the display device) and establish a data transceiving channel with the display device;

3. when the terminal receives the equipment data pushed by the equipment cloud platform, the socket service can be called, and the received equipment data from the equipment cloud platform are sent to the connected display equipment;

4. the display equipment can receive the equipment data sent by the IOT equipment and carry out interface display;

5. when the display equipment needs to control the IOT equipment, the display equipment sends an instruction message to the terminal;

6. the terminal receives an instruction sent by the display equipment and sends an operation instruction to the IOT equipment hungry cloud platform;

7. the cloud platform of the IOT equipment receives the operation instruction and issues the operation instruction to the IOT equipment;

8. the IOT device receives the instruction and executes the corresponding command.

For the above communication mode, when the terminal is a mobile phone, the IOT device is a bicycle, and the display device is a television, the user first establishes a connection pairing with the bicycle device through bluetooth, as shown in fig. 15; after the connection is successful, the name of the connected equipment is displayed under the mobile phone; clicking a configuration button behind the equipment, popping up a mode selection dialog box, and selecting a sharing mode by a user according to the requirement of the user; if the user selects one pair to share all the time, the IP address of the television to be directly connected needs to be configured, and after the connection is successful, real-time data of the riding equipment can be seen at the large-screen end of the television.

An IOT device and a display device may not pass through a terminal when performing data communication, an embodiment of the present invention provides another data transmission system, which is shown in fig. 16 and includes: the terminal 200, the display device 202, the target IOT device 203, and the server 204 corresponding to the target IOT device. The target IOT device 203 is connected to the terminal 200 via bluetooth, the display device 202 is connected to the server 204 corresponding to the target IOT device via a network, and the target IOT device 203 is connected to the server 204 corresponding to the target IOT device via a network.

Based on the foregoing data transmission system, an embodiment of the present invention provides a process in which a target IOT device sends data to a display device, and as shown in fig. 17, the process includes:

s1700: the terminal acquires identity information of display equipment corresponding to the target IOT equipment, and sends the identity information of the display equipment corresponding to the target IOT equipment after the terminal is connected with the target IOT equipment;

s1710: the target IOT equipment sends the identity information of the corresponding display equipment to a server corresponding to the target IOT equipment;

s1720: the server corresponding to the target IOT equipment is bound with the target IOT equipment according to the identity information of the corresponding display equipment;

s1730: a display device corresponding to a target IOT device sends a data request carrying identity information to a server corresponding to the target IOT device;

s1740: the method comprises the steps that a server corresponding to a target IOT device sends device information of the target IOT device after determining that identity information of a display device and the target IOT device have a binding relationship;

s1750: receiving device data sent by a server corresponding to the target IOT device by display equipment corresponding to the target IOT device; and displaying the equipment data by adopting a display interface of the equipment type of the target IOT equipment.

In detail, the display device 202 and the terminal 200 corresponding to the target IOT device may be connected through a local area network, that is, after the display device 202 corresponding to the target IOT device and the terminal 200 are both connected to the local area network, that is, the display device 202 and the terminal 200 corresponding to the target IOT device may communicate. Thus, the terminal 200 can obtain the identity information of the display device 202 corresponding to the target IOT device, the terminal 200 is connected with the target IOT device 203 through bluetooth, the terminal 200 sends the identity information to the target IOT device 203 through bluetooth, after the target IOT device 203 sends the identity information to the server 204 corresponding to the target IOT device 203, the server 204 performs binding processing, and after the display device 202 downloads the application software corresponding to the target IOT device 203, data interaction is performed with the server 204 through the account number, the password and the identity information of the display device itself.

The account and the password may be registered through the terminal 200. The present invention is not particularly limited.

An embodiment of the present invention provides a process in which a display device sends a control instruction to a target IOT device, and as shown in fig. 18, the process includes:

s1800: the server corresponding to the target IOT equipment is bound with the target IOT equipment according to the identity information of the corresponding display equipment; the process of binding is illustrated with reference to fig. 17.

S1810: the display equipment corresponding to the target IOT equipment responds to a control instruction triggered by a user on a control interface corresponding to the equipment type, determines the target IOT equipment which the display equipment wants to control according to the equipment type corresponding to the control interface, and sends the control instruction carrying identity information to a server corresponding to the target IOT equipment;

s1820: the server corresponding to the target IOT equipment sends a control instruction to the target IOT equipment after determining that the identity information of the display equipment and the target IOT equipment have a binding relationship;

s1830: the target IOT device executes the control instruction.

The process of acquiring the identity information of the display device corresponding to the target IOT device by the terminal 200 is as follows:

the terminal 200 receives identity information of a display device corresponding to a target IOT device, which is input by a user; or

Establishing a display device connection corresponding to the target IOT device, and requesting identity information from the display device corresponding to the target IOT device; receiving identity information sent by display equipment corresponding to target IOT equipment; the identity information is sent after the display device corresponding to the target IOT device receives the request.

The display device corresponding to the target IOT device may be selected by the user, which may be specifically referred to as fig. 4 and fig. 5.

An embodiment of the present invention provides a third data transmission system, which is shown in fig. 19 and includes: terminal 200, display device 202, target IOT device 203. The target IOT device 203 is connected to the terminal 200 via bluetooth, and the display device 202 is connected to the target IOT device via a lan.

Based on the foregoing data transmission system, an embodiment of the present invention provides a process in which a target IOT device sends data to a display device, and as shown in fig. 20, the process includes:

s2000: the method comprises the steps that a terminal obtains communication information required by MQTT communication service in display equipment corresponding to target IOT equipment, and after the terminal is connected with the target IOT equipment, the terminal sends the communication information of the display equipment corresponding to the target IOT equipment;

s2010: and the target IOT equipment adopts MQTT communication service and sends the equipment data to the corresponding display equipment through the communication information of the corresponding display equipment.

In detail, the display device 202 and the terminal 200 corresponding to the target IOT device may be connected through a local area network, that is, after the display device 202 corresponding to the target IOT device and the terminal 200 are both connected to the local area network, that is, the display device 202 and the terminal 200 corresponding to the target IOT device may communicate. Therefore, the terminal 200 can obtain communication information required by MQTT communication service in the display device 202 corresponding to the target IOT device, the terminal 200 is connected with the target IOT device 203 through Bluetooth, the terminal 200 sends the communication information required by the MQTT communication service to the target IOT device 203 through Bluetooth, and the target IOT device 203 adopts the MQTT communication service to send device data to the corresponding display device through the required communication information. Wherein, the communication information includes an IP address.

The display device corresponding to the target IOT device may be selected by the user, and specifically refer to fig. 4 and fig. 5.

An embodiment of the present invention provides a process in which a display device sends a control instruction to a target IOT device, and as shown in fig. 21, the process includes:

s2100: the target IOT equipment acquires communication information required by MQTT communication service in display equipment corresponding to the target IOT equipment; the process is illustrated with reference to fig. 20.

S2110: the display equipment corresponding to the target IOT equipment responds to a control instruction triggered by a user on a control interface corresponding to the equipment type, determines the target IOT equipment which the display equipment wants to control according to the equipment type corresponding to the control interface, and sends the control instruction carrying communication information of the display equipment to a server corresponding to the target IOT equipment by adopting MQTT communication service;

s2120: and after the target IOT equipment verifies that the communication information in the control instruction is the communication information acquired by the target IOT equipment, executing the control instruction.

The process of the terminal 200 acquiring the communication information required by the MQTT communication service of the display device corresponding to the target IOT device is as follows:

the terminal 200 receives communication information required by MQTT communication service of display equipment corresponding to target IOT equipment and input by a user; or alternatively

Establishing a display device connection corresponding to the target IOT device, and requesting communication information required by the MQTT communication service from the display device corresponding to the target IOT device; receiving communication information required by MQTT communication service sent by display equipment corresponding to target IOT equipment; the communication information required by the MQTT communication service is sent after the display equipment corresponding to the target IOT equipment receives the request.

Based on the above description, an embodiment of the present invention provides a data transmission method, which is applied to a terminal, and includes:

if receiving device data sent by a target IOT device, determining a display device corresponding to the target IOT device according to the corresponding relation between the IOT device and the display device; sending the device data to display equipment corresponding to the target IOT equipment through a private server corresponding to a terminal so that the corresponding display equipment can display the device data to a user; or alternatively

Optionally, the method further includes: after receiving device data sent by a target IOT device, if first control information sent by a private server corresponding to a terminal is received, sending a control instruction contained in the first control information to the target IOT device contained in the first control information, so that the target IOT device executes the control instruction after receiving the control instruction;

Optionally, uploading the device data to a private server corresponding to the target IOT device includes:

Optionally, the target information of the display device corresponding to the target IOT device is obtained in the following manner:

receiving target information of display equipment corresponding to target IOT equipment input by a user; the target information is communication information or identity information required by MQTT communication service in the display equipment; or

The embodiment of the invention provides a device data transmission method, which is applied to display equipment and comprises the following steps:

Optionally, the method further includes:

In addition, the data transmission method applied to the terminal according to the embodiment of the present invention described in conjunction with the drawings may be implemented by the terminal.

The terminal comprises: a communication unit and a processor;

a communication unit for communicating with the target IOT device, the private server, and the display device;

the processor is used for determining display equipment corresponding to the target IOT equipment according to the corresponding relation between the IOT equipment and the display equipment if equipment data sent by the target IOT equipment are received; sending the device data to display equipment corresponding to the target IOT device through a private server corresponding to a terminal, so that the corresponding display equipment can display the device data to a user; or

Optionally, the processor is further configured to:

Optionally, the processor is specifically configured to:

Fig. 22 shows a schematic configuration of the terminal.

Fig. 22 is a block diagram exemplarily showing a hardware configuration of a terminal according to an exemplary embodiment. As shown in fig. 22, the terminal includes: radio Frequency (RF) circuit 2210, memory 2220, display unit 2230, camera 2240, sensor 2250, audio circuit 2260, wireless Fidelity (Wi-Fi) module 2270, processor 2280, bluetooth module 2281, and power supply 2290. The aforementioned communication unit is a Radio Frequency (RF) circuit 2210, a Wireless Fidelity (Wi-Fi) module 2270, or a bluetooth module 2281.

RF circuit 2210 may be configured to receive and transmit signals during a message transmission or call, and may receive downlink data from a base station and then send the received downlink data to processor 2280 for processing; the uplink data may be transmitted to the base station. Typically, the RF circuitry includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like.

Memory 2220 may be used to store software programs and data. The processor 2280 performs various functions of the terminal and data processing by executing software programs or data stored in the memory 2220. The memory 2220 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device. The memory 2220 stores an operating system that enables the terminal to operate. The memory 2220 may store an operating system and various application programs, and may also store codes for executing the methods described in the embodiments of the present application.

The display unit 2230 may be used to receive input numeric or character information and generate signal inputs related to user settings and function control of the terminal, and particularly, the display unit 2230 may include a touch screen 2231 disposed on a front surface of the terminal and collecting touch operations by a user thereon or nearby, such as clicking a button, dragging a scroll box, and the like.

The display unit 2230 may also be used for a Graphical User Interface (GUI) that displays information input by the user or information provided to the user, and various menus of the terminal. Specifically, the display unit 2230 may include a display screen 2232 disposed on the front surface of the terminal. The display screen 2232 may be configured in the form of a liquid crystal display, a light emitting diode, or the like. The display unit 2230 may be used to display various graphical user interfaces described herein.

The touch screen 2231 may be covered on the display screen 2232, or the touch screen 2231 and the display screen 2232 may be integrated to implement an input and output function of the terminal, and the integrated function may be referred to as a touch display screen for short. The display unit 2230 in this application can display the application programs and the corresponding operation steps.

The camera 2240 may be used to capture still images or video. The object generates an optical image through the lens and projects the optical image to the photosensitive element. The photosensitive element may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The light sensing elements convert the light signals into electrical signals which are then passed to a processor 2280 for conversion into digital image signals.

The terminal may further include at least one sensor 2250, such as an acceleration sensor 2251, a distance sensor 2252, a fingerprint sensor 2253, a temperature sensor 2254. The terminal may also be configured with other sensors such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, light sensors, motion sensors, etc.

The audio circuitry 2260, speaker 2261, and microphone 2262 may provide an audio interface between the user and the terminal. The audio circuit 2260 may transmit the electrical signal converted from the received audio data to the speaker 2261, and the signal is converted into a sound signal by the speaker 2261 for outputting. The terminal may be further provided with a volume button for adjusting the volume of the sound signal. On the other hand, the microphone 2262 converts the collected sound signals into electrical signals, which are received by the audio circuitry 2260 and converted into audio data, which are output to the RF circuitry 2210 for transmission, for example, to another terminal or to the memory 2220 for further processing. In the present application, the microphone 2262 may capture the user's voice.

Wi-Fi belongs to short-distance wireless transmission technology, and the terminal can help a user to receive and send e-mails, browse webpages, access streaming media and the like through a Wi-Fi module 2270, and provides wireless broadband internet access for the user.

The processor 2280 is a control center of the terminal, connects various parts of the entire terminal using various interfaces and lines, and performs various functions of the terminal and processes data by operating or executing software programs stored in the memory 2220 and calling data stored in the memory 2220. In some embodiments, processor 2280 may include one or more processing units; the processor 2280 may also integrate an application processor, which mainly handles operating systems, user interfaces, application programs, and the like, and a baseband processor, which mainly handles wireless communications. It will be appreciated that the baseband processor may not be integrated into the processor 2280. In the present application, the processor 2280 may run an operating system, an application program, a user interface display, a touch response, and the processing method according to the embodiment of the present application. Further, processor 2280 is coupled to a display unit 2230.

And the Bluetooth module 2281 is configured to perform information interaction with other Bluetooth devices having a Bluetooth module through a Bluetooth protocol. For example, the terminal may establish a bluetooth connection with a wearable electronic device (e.g., a smart watch) that is also equipped with a bluetooth module through the bluetooth module 2281, so as to perform data interaction.

The terminal also includes a power supply 2290 (e.g., a battery) for powering the various components. The power supply may be logically connected to processor 2280 via a power management system that manages charging, discharging, and power consumption. The terminal can also be provided with a power button for starting and shutting down the terminal, locking the screen and the like.

The data transmission method applied to the display device of the embodiment of the present invention described in conjunction with the drawings may be implemented by the display device.

The display device includes: a communication unit, a display and a controller;

the communication unit is used for communicating with the target IOT equipment, the terminal and the private server;

the display is used for displaying a display interface;

the controller is used for receiving the equipment data sent by the terminal through the private server corresponding to the terminal; the device data is generated by the target IOT device and sent to the terminal; the display device is the display device corresponding to the target IOT device determined by the terminal according to the corresponding relation between the IOT device and the display device;

Optionally, the controller is further configured to:

As an example, the structure of the display device described above may be as shown in fig. 23.

In some embodiments, the display apparatus includes at least one of a tuner demodulator 2310, a communicator 2320, a detector 2330, an external device interface 2340, a controller 2350, a display 2360, an audio output interface 2370, a memory, a power supply, a user interface.

In some embodiments, controller 2350 includes a central processor, a video processor, an audio processor, a graphics processor, RAM, ROM, a first interface to an nth interface for input/output.

In some embodiments, the display 2360 includes a display screen component for presenting pictures, and a driving component for driving image display, a component for receiving image signals from the controller output, displaying video content, image content, and menu manipulation interface, and a user manipulation UI interface, and the like.

In some embodiments, the display 2360 can be at least one of a liquid crystal display, an OLED display, and a projection display, and can also be a projection device and a projection screen.

In some embodiments, the tuner demodulator 2310 receives a broadcast television signal through a wired or wireless reception manner, and demodulates an audio and video signal, such as an EPG data signal, from a plurality of wireless or wired broadcast television signals.

In some embodiments, communicator 2320 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display device may establish transmission and reception of control signals and data signals with the above-described private server through the communicator 2320.

In some embodiments, the detector 2330 is used to collect signals of the external environment or interaction with the outside. For example, detector 2330 includes a light receiver, a sensor for collecting ambient light intensity; alternatively, the detector 2330 includes an image collector, such as a camera, which can be used to collect external environmental scenes, attributes of the user, or user interaction gestures, or the detector 2330 includes a sound collector, such as a microphone, which receives external sounds.

In some embodiments, the external device interface 2340 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, and the like. The interface may be a composite input/output interface formed by the plurality of interfaces.

In some embodiments, controller 2350 and modem 2310 may be located in separate devices, i.e., modem 2310 may also be located in an external device, such as an external set-top box, of the host device in which controller 2350 is located.

In some embodiments, the controller 2350 controls the operation of the display device and responds to user operations by way of various software control programs stored in memory. The controller 2350 controls the overall operation of the display apparatus. For example: in response to receiving a user command for selecting a UI object displayed on the display 2360, the controller 2350 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any one of selectable objects, such as a hyperlink, an icon, or other actionable control. The operations related to the selected object are: displaying an operation connected to a hyperlink page, document, image, or the like, or performing an operation of a program corresponding to the icon.

In some embodiments the controller comprises at least one of a Central Processing Unit (CPU), a video processor, an audio processor, a Graphics Processing Unit (GPU), a RAM Random Access Memory (RAM), a ROM (Read-Only Memory), a first to nth interface for input/output, a communication Bus (Bus), and the like.

A CPU processor. For executing operating system and application program instructions stored in the memory, and executing various application programs, data and contents according to various interactive instructions receiving external input, so as to finally display and play various audio-video contents. The CPU processor may include a plurality of processors. E.g. comprising a main processor and one or more sub-processors.

In some embodiments, a graphics processor for generating various graphics objects, such as: at least one of an icon, an operation menu, and a user input instruction display figure. The graphic processor comprises an arithmetic unit, which performs operation by receiving various interactive instructions input by a user and displays various objects according to display attributes; the system also comprises a renderer which renders various objects obtained based on the arithmetic unit, and the rendered objects are used for being displayed on a display.

In some embodiments, the video processor is configured to receive an external video signal, and perform at least one of video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a signal displayed or played on the directly displayable device.

In some embodiments, the video processor includes at least one of a demultiplexing module, a video decoding module, an image composition module, a frame rate conversion module, a display formatting module, and the like. The demultiplexing module is used for demultiplexing the input audio and video data stream. And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like. And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display. And the frame rate conversion module is used for converting the frame rate of the input video. And the display formatting module is used for converting the received video output signal after the frame rate conversion, and changing the signal to be in accordance with the signal of the display format, such as an output RGB data signal.

In some embodiments, the audio processor is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform at least one of noise reduction, digital-to-analog conversion, and amplification processing to obtain a sound signal that can be played in the speaker.

In some embodiments, the user may enter user commands on a Graphical User Interface (GUI) displayed on the display 2360, and the user input interface receives the user input commands through the Graphical User Interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form that is acceptable to the user. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in the display screen of the electronic device, where the control may include at least one of an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc. visual interface elements.

In some embodiments, user interface 2380 is an interface that can be used to receive control inputs (e.g., physical buttons on the body of the display device, or the like).

In some embodiments, the system of the display device may include a Kernel (Kernel), a command parser (shell), a file system, and an application. The kernel, shell, and file system together make up the basic operating system structure that allows users to manage files, run programs, and use the system. After power-on, the kernel is started, kernel space is activated, hardware is abstracted, hardware parameters are initialized, and virtual memory, a scheduler, signals and interprocess communication (IPC) are operated and maintained. And after the kernel is started, loading the Shell and the user application program. The application program is compiled into machine code after being started, and a process is formed.

In addition, in combination with the display device in the above embodiments, an embodiment of the present invention may provide a storage medium, where instructions are executed by a controller of the display device, so that the display device can perform the data transmission method according to any one of the above.

While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.

It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims

1. A terminal, comprising: a communication unit and a processor;

2. The terminal of claim 1, wherein the processor is further configured to:

3. The terminal of claim 1, wherein the processor is specifically configured to:

4. The terminal of claim 1, wherein the processor is specifically configured to:

5. A display device, comprising: a communication unit, a display and a controller;

the display is used for displaying a display interface;

6. The display device of claim 5, wherein the controller is further configured to:

7. A data transmission method is applied to a terminal and comprises the following steps:

if receiving device data sent by a target IOT device, determining a display device corresponding to the target IOT device according to the corresponding relation between the IOT device and the display device; sending the device data to display equipment corresponding to the target IOT equipment through a private server corresponding to a terminal so that the corresponding display equipment can display the device data to a user; or

8. The method of claim 7, further comprising:

9. A data transmission method is applied to a display device and comprises the following steps:

10. The method of claim 9, further comprising: