WO2024001435A1 - Appareil d'affichage et procédé de traitement de données - Google Patents

Appareil d'affichage et procédé de traitement de données Download PDF

Info

Publication number
WO2024001435A1
WO2024001435A1 PCT/CN2023/088758 CN2023088758W WO2024001435A1 WO 2024001435 A1 WO2024001435 A1 WO 2024001435A1 CN 2023088758 W CN2023088758 W CN 2023088758W WO 2024001435 A1 WO2024001435 A1 WO 2024001435A1
Authority
WO
WIPO (PCT)
Prior art keywords
display device
control device
link
cis
broadcast isochronous
Prior art date
Application number
PCT/CN2023/088758
Other languages
English (en)
Chinese (zh)
Inventor
周颖昕
杨坤
姜晓胜
邓子敬
Original Assignee
海信视像科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN202210771143.7A external-priority patent/CN115278928A/zh
Priority claimed from CN202210770347.9A external-priority patent/CN115278322A/zh
Priority claimed from CN202210771127.8A external-priority patent/CN115175156A/zh
Application filed by 海信视像科技股份有限公司 filed Critical 海信视像科技股份有限公司
Publication of WO2024001435A1 publication Critical patent/WO2024001435A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication

Definitions

  • the embodiments of the present application relate to Bluetooth technology, and in particular, to a display device and a data processing method.
  • the existing Bluetooth communication between the display device and the control device all transmits data through the Asynchronous Connection-oriented link (ACL) link.
  • the control device corresponds to the user control instructions through the ACL link.
  • the data is sent to the display device to control the display device.
  • This application provides a display device and a data processing method, which can improve the flexibility of data transmission, and when multiple data need to be transmitted, parallel transmission of data can be realized and the transmission efficiency can be improved.
  • this application provides a display device, which includes:
  • a communicator for communicating with an external device under the control of the processor, the external device including a control device;
  • Memory used to store computer instructions
  • the processor coupled to the memory, is configured to execute computer instructions such that the display device: receives the control device via an isochronous flow CIS link connecting the display device and the control device.
  • the target data sent, the target data is generated by the control device according to the received user control instruction;
  • this application provides a data processing method for a display device, the method includes:
  • Figure 1 is an operation scene between the control device and the display device according to the embodiment of the present application
  • FIG. 2 is a hardware configuration block diagram of the control device 100 according to the embodiment of the present application.
  • FIG. 3 is a hardware configuration block diagram of the display device 200 according to the embodiment of the present application.
  • Figure 4 is a schematic diagram of the interaction flow between the control device and the display device according to the embodiment of the present application.
  • Figure 5 is a schematic diagram of using the CIE flag to end a CIS event according to an embodiment of the present application
  • Figure 6 is a schematic diagram of the CIS PDU Header in the embodiment of this application.
  • Figure 7 is one of the flow diagrams of a data processing method according to an embodiment of the present application.
  • Figure 8 is a second schematic flowchart of a data processing method according to an embodiment of the present application.
  • Figure 9 is the third flowchart of a data processing method according to the embodiment of the present application.
  • Figure 10 is the fourth schematic flowchart of a data processing method according to the embodiment of the present application.
  • Figure 11 is a schematic flowchart 5 of a data processing method according to an embodiment of the present application.
  • Figure 12 is one of the schematic diagrams showing how different transmission parameters affect transmission results according to an embodiment of the present application.
  • Figure 13 is a second schematic diagram showing how different transmission parameters affect the transmission results according to the embodiment of the present application.
  • Figure 14 is the third schematic diagram showing how different transmission parameters affect the transmission results according to the embodiment of the present application.
  • Figure 15 is the fourth schematic diagram showing how different transmission parameters affect the transmission results according to the embodiment of the present application.
  • Figure 16 is a schematic diagram of a software configuration of the display device 200.
  • FIG. 17 is a schematic diagram of the control device in the embodiment of the present application.
  • Figure 18 is a schematic diagram of broadcast isochronous group data packets in the embodiment of the present application.
  • Figure 19 is a schematic diagram of broadcast isochronous group data packets in the embodiment of the present application.
  • Figure 20 is a schematic diagram of broadcast isochronous group data packets in the embodiment of the present application.
  • Figure 21 is a schematic diagram of broadcast isochronous group data packets in the embodiment of the present application.
  • FIG. 22 is a schematic diagram of the control device in the embodiment of the present application.
  • Figure 23 is a flow chart of the OTA upgrade method in the embodiment of the present application.
  • Figure 24 is a flow chart of the OTA upgrade method in the embodiment of the present application.
  • Figure 25 is one of the interactive flow charts of the control method of the display device in the embodiment of the present application.
  • Figure 26 is the second interactive flow chart of the control method of the display device in the embodiment of the present application.
  • Figure 27 is the third interactive flow chart of the control method of the display device in the embodiment of the present application.
  • Figure 28 is the fourth interactive flow chart of the control method of the display device in the embodiment of the present application.
  • Figure 29 is the fifth interactive flow chart of the control method of the display device in the embodiment of the present application.
  • Figure 30 is the sixth interactive flow chart of the control method of the display device in the embodiment of the present application.
  • the display device provided by the embodiment of the present application can have a variety of implementation forms, for example, it can be a TV, a smart TV, a laser projection device, a monitor, an electronic bulletin board, an electronic table, a mobile phone, Tablets, laptops, PDAs, vehicle electronic devices, etc.
  • FIG. 1 is a schematic diagram of an operation scenario between a display device and a control device according to an embodiment, where the control device includes an intelligent device or a control device. As shown in FIG. 1 , the user can operate the display device 200 through the smart device 300 or the control device 100 .
  • control device 100 may be a remote controller.
  • the communication between the remote controller and the display device includes infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods to control the display device 200 through wireless or wired methods.
  • the user can control the display device 200 by inputting user instructions through buttons on the remote control, voice input, control panel input, etc.
  • a smart device 300 (such as a mobile terminal, a tablet, a computer, a laptop, etc.) can also be used to control the display device 200 .
  • the display device 200 is controlled using an application running on the smart device.
  • the display device may not use the above-mentioned smart device or control device to receive instructions, but may receive user control through touch or gestures.
  • the display device 200 can also be controlled in a manner other than the control device 100 and the smart device 300 .
  • the display device 200 can directly receive the user's voice command control through a module configured inside the display device 200 to obtain voice commands.
  • the user's voice command control can also be received through a voice control device provided outside the display device 200 .
  • display device 200 also communicates data with server 400.
  • the display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.
  • the server 400 can provide various content and interactions to the display device 200.
  • the server 400 may be a cluster or multiple clusters, and may include one or more types of servers.
  • FIG. 2 schematically shows a configuration block diagram of the control device 100 according to an exemplary embodiment.
  • the control device 100 includes a processor 110, a communication interface 130, a user input/output interface 140, an external memory, and a power supply.
  • the control device 100 can receive input operation instructions from the user, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, thereby mediating the interaction between the user and the display device 200 .
  • the display device 200 includes a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a processor 250, a display 260, an audio output interface 270, a user interface 280, an external memory, and a power supply. At least one.
  • the processor includes a video processor, an audio processor, a graphics processor, RAM, ROM, first to nth interfaces for input/output.
  • the display 260 includes a display screen component for presenting images, a driving component for driving image display, a component for receiving image signals output from the processor, displaying video content, image content, menu control interface components, and a user control UI interface. .
  • the display 260 can be a liquid crystal display, an OLED display, a projection display, or a projection device and a projection screen.
  • the communicator 220 is a component for communicating with external devices or servers according to various communication protocol types.
  • the communicator may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near field communication protocol chips, and an infrared receiver.
  • the display device 200 can establish transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220 .
  • the user interface 280 can be used to receive control signals from the control device 100 (such as an infrared remote control, etc.). It can also be used to directly receive user input operation instructions and convert the operation instructions into instructions that the display device 200 can recognize and respond to. In this case, it can be called a user input interface.
  • the detector 230 is used to collect signals from the external environment or interactions with the outside.
  • the detector 230 includes a light receiver, a sensor used to collect ambient light intensity; or the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures, or , the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.
  • the external device interface 240 may include, but is not limited to, any one of the following: high-definition multimedia interface (HDMI), analog or data high-definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, etc., or Multiple interfaces. It can also be a composite input/output interface formed by the above-mentioned plurality of interfaces.
  • HDMI high-definition multimedia interface
  • component analog or data high-definition component input interface
  • CVBS composite video input interface
  • USB USB input interface
  • RGB port etc.
  • Multiple interfaces or Multiple interfaces. It can also be a composite input/output interface formed by the above-mentioned plurality of interfaces.
  • the tuner 210 receives broadcast television signals via wired or wireless reception, and receives broadcast television signals from a plurality of wireless or wired broadcast television signals. Demodulate audio and video signals, such as EPG data signals.
  • the processor 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the processor 250 is located, such as an external set-top box. wait.
  • the processor 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory (internal memory or external memory).
  • the processor 250 controls the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object to be displayed on display 260, processor 250 may perform operations related to the object selected by the user command.
  • the processor includes a central processing unit (CPU), a video processor, an audio processor, a graphics processor (Graphics Processing Unit, GPU), and a random access memory (Random Access Memory, RAM). , read-only memory (Read-Only Memory, ROM), at least one of the first to nth interfaces for input/output, communication bus (Bus), etc.
  • RAM is also called main memory, which is an internal memory that directly exchanges data with the processor. It can be read and written at any time (except when refreshing), is very fast, and is often used as a temporary data storage medium for the operating system or other running programs.
  • the biggest difference between it and ROM is the volatility of data, that is, the stored data will be lost once the power is turned off.
  • RAM is used in computers and digital systems to temporarily store programs, data, and intermediate results. ROM works in a non-destructive reading mode and can only read information but cannot write information. Once the information is written, it is fixed and will not be lost even if the power is turned off, so it is also called fixed memory.
  • the user may input a user command into a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI).
  • GUI graphical user interface
  • the user can input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.
  • the display device provided by the embodiment of the present application includes: a display and a processor, where the processor corresponds to the processor 260 in Figure 3 above.
  • the control device in the embodiment of the present application may be the control device 100 in FIG. 1
  • the display device may be the display device 200 in FIG. 1 .
  • An embodiment of the present application provides a display device.
  • the display device includes: a processor and a display.
  • the processor is configured to: pass a Connected Isochronous Stream (CIS) chain between the display device and the control device. path to receive target data sent by the control device.
  • the target data is generated by the control device according to the received user control instructions; through the CIS link, a reply message is sent to the control device.
  • the reply message is used to represent that the target data has been received; based on the target data , obtain the target information corresponding to the user control instruction; the display is configured to: display the target information.
  • CIS Connected Isochronous Stream
  • Figure 16 is a schematic diagram of a software configuration of a display device. As shown in Figure 16, the system is divided into four layers. From top to bottom they are the Applications layer (referred to as the "Application layer”), the Application Framework Framework) layer (referred to as “framework layer”), Android runtime (Android runtime) and system library layer (referred to as “system runtime library layer”), and kernel layer.
  • the kernel layer contains at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply Driver etc.
  • An embodiment of the present application provides a control device.
  • the control device includes: a processor configured to: receive user control instructions; generate target data based on the user control instructions; and send data to the control device through a CIS link between the control device and the display device.
  • the display device sends target data so that the display device displays target information corresponding to the user control instruction based on the target data; through the CIS link, a reply message sent by the display device is received, and the reply message is used to indicate that the display device has received the target data.
  • the control device generates target data based on user control instructions, sends the target data to the display device through the CIS link between the control device and the display device, and the display device receives the target data sent by the control device through the CIS link and sends a reply to the control device.
  • message (the reply message is used to indicate that the display device has received the target data) and based on the target data, obtain the target information corresponding to the user control instruction, display the target information, and control the device to receive the reply message.
  • the user control instructions can be the user's voice control instructions, the user's key control instructions, or other user control instructions. Control instructions are not limited in the embodiments of this application.
  • the target data is generated based on a complete user control instruction.
  • the target data includes at least one data packet. Specifically, based on the size of the target data and the length of each data packet, it is determined how many data packets the target data needs to be sent.
  • the target data is sent to the display device through the CIS link between the control device and the display device.
  • the control device divides the target data into at least one data packet and sends it to the display device.
  • the display device will reply with a A message used to indicate that a data packet has been received.
  • the reply message sent by the display device in the embodiment of the present application to the control device is used to indicate that the display device has completed receiving the target data.
  • CIS is a data stream transmission channel with a fixed time interval (ISO Interval) established between connected devices based on the established ACL link.
  • the ACL link and CIS link are both low-power Bluetooth transmission links. .
  • Displaying target information may include at least one of the following: updating the interface (such as interface switching), displaying pop-up messages (such as popping up a window on the current interface or displaying another interface in a floating manner on the current interface), moving the focus of the display device (such as : the focus of the display device moves from one control to another), the display target information is specifically determined according to the actual situation, and is not limited in the embodiments of this application.
  • the object where the focus is located is the object currently in the selected state.
  • the display target information is to update the interface of channel 1 to the interface of channel 2; if the user If the user's control instruction is a voice control instruction, and the content of the instruction is "today's weather", the display target information is to display information about today's weather conditions in a pop-up window on the current interface; if the user's control instruction is a voice control instruction, and the content of the instruction is is "xxx TV series”, the display target information is to display all the information about "xxx TV series” in the current interface; if the current interface is selected control 1 and the user's control instruction is to select control 2, the display target information is to focus from Move control 1 to control 2 and select control 2.
  • the control device generates target data based on user control instructions, and sends the target data to the display device through the CIS link between the control device and the display device.
  • Send target data the display device receives the target data sent by the control device through the CIS link, sends a reply message to the control device (the reply message is used to indicate that the display device has received the target data) and based on the target data (the control device receives the reply message) , obtain the target information corresponding to the user control instruction, and display the target information.
  • the CIS link is based on the ACL link, there are both ACL links and CIS links that can be used for data transmission between the control device and the display device in this solution.
  • ACL link is based on the ACL link, there are both ACL links and CIS links that can be used for data transmission between the control device and the display device in this solution.
  • This solution adds a CIS link on the basis of the ACL link, which can improve the flexibility of data transmission.
  • parallel transmission of data can be achieved. Improve transmission efficiency.
  • target data is sent to the display device through the CIS link.
  • the link for sending the target data can be determined based on whether the ACL link is occupied. For example, when the ACL link between the control device and the display device is occupied, the target data is sent to the display device through the CIS link; when the ACL link between the control device and the display device is not occupied , sending target data to the display device through the ACL link.
  • the link to which the target data is sent can also be determined based on whether the link is occupied.
  • target data is sent to the display device through the CIS link; when the ACL link between the control device and the display device When the ACL link is not occupied and the CIS link is occupied, the target data is sent to the display device through the ACL link; when the ACL link between the control device and the display device is not occupied and the CIS link is not occupied Next, send the target data to the display device through either ACL link or CIS link.
  • the target data when the ACL link between the control device and the display device is occupied, the target data is sent to the display device through the CIS link; in this way, when the ACL link is in use, the target data is sent through the CIS link Transmitting target data can realize parallel transmission of data, saving time and improving transmission efficiency.
  • the target data is sent to the display device through the CIS link.
  • the link for sending the target data is determined: when the user control instruction is a voice control instruction, the target data is sent to the display device through the CIS link; When the user control instruction is other control instruction (such as key control instruction, etc.), the target data is sent to the display device through the ACL link.
  • the target data is sent to the display device through the CIS link; when the user control instruction is other control instructions, the target data is sent to the display device through the ACL link.
  • Send target data Among the data transmitted between the display device and the control device, voice data has the highest requirements on the link and consumes the most resources. Therefore, the most resource-consuming voice data is transmitted through the CIS link, and the ACL link is no longer needed. It is established or maintained according to the configuration that has the highest link requirements for transmitting voice data, thus saving a lot of resources. At the same time, parallel transmission of target data generated by voice control instructions and other control instructions can be achieved, improving transmission efficiency.
  • the control device before the control device sends target data to the display device, the control device first determines whether there is a CIS link with the display device. When a CIS link exists between the control device and the display device, target data is sent to the display device through the CIS link, and the display device receives the target data. When there is no CIS link between the control device and the display device, the control device sends a request message to the display device. The request message is used to request the establishment of a CIS link; the display device receives the request message and sends a response message to the control device. The response message is used to represent the agreement to establish a CIS link. The control device receives the response message sent by the display device. Based on the response message, a CIS link is established between the control device and the display device, and target data is sent to the display device through the CIS link.
  • the CIS link can be established before the control device and the display device communicate, or it can be a CIS link established only when data needs to be transmitted through the CIS link. Specifically, it can be determined according to actual needs. This application The examples are not limiting.
  • the control device before the control device sends target data to the display device, the control device first determines whether there is a CIS link between the control device and the display device. If there is a CIS link between the control device and the display device, the control device uses the CIS link, sending target data to the display device, and the display device receives the target data. When there is no CIS link between the control device and the display device, the control device sends a request message to the display device. The request message is used to request the establishment of a CIS link. path; the display device receives the request message and sends a response message to the control device. The response message is used to indicate the agreement to establish the CIS link.
  • the control device receives the response message sent by the display device, and based on the response message, establishes a connection between the control device and the display device.
  • CIS link Send target data to the display device through the CIS link. Therefore, the timing of establishing the CIS link can be flexibly selected. It can be established before the control device communicates with the display device, or it can be established when the CIS link needs to be used.
  • the user control instruction is a voice control instruction.
  • the display device After receiving the reply message sent by the display device through the CIS link, the display device resets the timer and starts the timer timing; the control device does not receive the message when the timer times out.
  • the CIS link is disconnected; when a new voice control command is received before the timer times out, the timer is stopped.
  • the target data generated based on the user's voice control instruction is sent to the display device.
  • the display device has completed the reception, resets the timer, and starts the timer timing.
  • the control device is in If a new voice control command from the user is received before the timer expires, the timing will be stopped; if the control device does not receive a new voice control command from the user before the timer expires, the control device sends a message to the display device for disconnection.
  • the display device receives the instruction from the control device to disconnect the CIS link and releases the resources used by the display device to maintain the CIS link.
  • the total time duration of the timer can be set to a preset duration, and whether the timer times out can be determined based on whether the timer's timing duration is equal to the preset duration.
  • the timer's timing duration is equal to the preset duration, it is determined that the timer has timed out.
  • the preset duration can be a fixed value, and the preset duration can also be dynamically adjusted according to the user's history of using voice control instructions.
  • FIG. 4 it is a schematic flowchart of using a timer to determine whether the CIS link needs to be disconnected, including steps 401 to 413.
  • the control device receives the user's voice control instruction.
  • the control device determines whether a CIS link exists.
  • the control device sends a request message to the display device.
  • the request message is used to request the establishment of a CIS link.
  • the display device receives the request message sent by the control device.
  • the display device sends a response message to the control device according to the request message.
  • the control device receives the response message sent by the display device.
  • the control device establishes a CIS link based on the response message.
  • the control device generates target data based on voice control instructions.
  • the control device sends target data to the display device through the CIS link.
  • the display device receives the target data sent by the control device.
  • the display device obtains target information corresponding to the user instruction based on the target data.
  • the display device displays target information.
  • the display device sends a reply message to the control device through the CIS link.
  • the control device receives the reply message sent by the display device.
  • the control device determines whether a new voice control command is received before the timer times out.
  • the control device sends a disconnection CIS link instruction to the display device and releases resources.
  • the display device receives the disconnection CIS link instruction sent by the control device and releases the resources.
  • steps 401 to 419 is determined according to actual needs and is not limited in the embodiments of this application.
  • step 402 and step 409 can be executed at the same time, or step 409 can be executed first and then step 402.
  • the user control instruction is a voice control instruction.
  • the display device After the display device receives the reply message sent by the display device through the CIS link, it resets the timer and starts the timer timing; the control device does not receive the message when the timer times out. If a new voice control command is received, the CIS link is disconnected; if a new voice control command is received before the timer times out, the timer is stopped. Because the frequency of users using the voice control function of the control device is relatively low, leaving the CIS link idle for a long time will waste resources. Therefore, by setting a timer, when the timer times out, the control device has not received the user's voice control. command, the CIS link can be disconnected, thereby reducing idle waste of resources.
  • the control device sends target data to the display device through at least one CIS event on the CIS link, and each CIS event includes at least one CIS sub-event; the display device uses at least one CIS event on the CIS link , receive the target data, and the display device sends a reply message to the control device.
  • the control device After the control device receives the reply message sent by the display device, the control device sends an instruction message to the display device.
  • the instruction message is used to indicate that the target data corresponding to the user control instruction has been sent.
  • the display device receives the instruction message, and according to the instruction message, closes the last CIS event in at least one CIS event, so that the display device no longer listens to the CIS sub-event of the last CIS event.
  • a CIS event has a fixed interval duration, and the interval duration can be adjusted according to actual needs;
  • a CIS event includes at least one CIS sub-event, and each sub-event also has a fixed interval duration.
  • the interval length can also be adjusted according to actual needs.
  • a data packet is transmitted through a CIS sub-event.
  • a CIS link includes at least one CIS event, and each CIS event includes at least one CIS sub-event. Each sub-event is used to transmit a data packet.
  • a CIS link includes N(N is an integer greater than 0) CIS events, wherein both CIS event 1 and CIS event N include 4 CIS sub-events, and each of the CIS events not shown between CIS event 1 and CIS event N also has Including 4 CIS sub-events, each CIS sub-event is used to transmit a data packet. Therefore, up to 4 data packets can be transmitted in any CIS event on the CIS link. Specifically, each CIS event can transmit up to 4 data packets.
  • Transmitting 4 data packets can be understood as being affected by other factors (such as the number of bursts, network environment congestion, etc.).
  • Each CIS event can actually transmit 1, 2, 3 or 4 data packets, for example, in Figure 12
  • One CIS event can be used to transmit one data packet.
  • one CIS event can be used to transmit 2 data packets.
  • one CIS event can be used to transmit 4 data packets.
  • the target data is divided into at least one data packet, and the control device sends at least one data packet to the display device through at least one corresponding CIS sub-event (one data packet corresponds to one CIS sub-event), and the display device responds in each sub-event.
  • a reply message is sent to the control device through the CIS sub-event, and the control device receives the reply message of the data packet corresponding to the last CIS sub-event (that is, the control device receives the reply message of the last data packet in the target data) Afterwards, the control device sends an instruction message to the display device. After receiving the instruction message, the display device closes the CIS event where the last CIS sub-event is located.
  • the display device will no longer continue to listen for the remaining duration of the CIS event interval.
  • no data packet is sent in the sub-event (that is, the display device no longer continues to listen to the sub-event after the sub-event of receiving the indication message in the last CIS event).
  • the display device continues to listen. Subevent in the next CIS event.
  • the sender in order to use the CIE flag bit to close the CIS event in advance, in the Nth CIS (CIS N event) event, the sender completes sending the data (Data) and receives the Ack reply from the receiver. Finally, the sender sends a data packet with a CIE of 1. After receiving the data packet with a CIE of 1, the receiving end ends the CIS N event early.
  • CIS sub-event 3 CIS sub-event 4
  • CIS sub-event 4 During the entire interval, that is, from the time after the CIE of sub-event 2 of the CIS N event is sent to the arrival of the next CIS event (the shaded area indicated by the label 600), the display device does not need to monitor the sub-events within this time period. Therefore, during this time Within the duration, resources can be allocated to other operations.
  • the indication message is used to indicate that the target data corresponding to the user control instruction has been sent.
  • the display device receives the indication message, it can determine that the target data has been sent, and therefore the last CIS event used to transmit the target data can be closed.
  • the indication message may include information that the target data has been sent.
  • the indication message may also include a flag bit indicating that the target data has been sent. It may also include a flag bit indicating closing the current CIS event (the last CIS event). It may also include Other contents can be determined according to actual needs and are not limited in the embodiments of this application.
  • the packet header (Connected Isochronous Protocol Data Unit Header, CIS PDU Header) of the CIS protocol data unit, in which the Close Isochronous Event (CIE) flag is set to 1, that is Close the current CIS event, therefore, the data packet with CIE 1 can be used as an indication message.
  • CIE Close Isochronous Event
  • the control device sends target data to the display device through at least one CIS event on the CIS link, and each CIS event includes at least one CIS sub-event; the display device uses at least one CIS event on the CIS link, After receiving the target data, the display device sends a reply message to the control device. After the control device receives the reply message sent by the display device, the control device sends an instruction message to the display device. The instruction message is used to indicate that the target data corresponding to the user control instruction has been sent. , the display device receives the instruction message, and according to the instruction message, closes the last CIS event in at least one CIS event, so that the display device no longer listens to the CIS sub-event of the last CIS event.
  • the control device After the control device receives the reply message from the display device and determines that the display device has completed receiving the target data, it sends an instruction message to the display device to indicate that the target data corresponding to the user control instruction has been sent, and the CIS event can be closed.
  • the display device closes the current CIS event (i.e., the last CIS event), so that the display device does not need to monitor the subsequent CIS sub-events of the CIS event, that is, the CIS event ends early. In this way, after the CIS event for the rest of the time, Resources can be allocated to other operations (such as interacting with other Bluetooth devices, sending and receiving WiFi data, etc.), thus saving resources and improving the work efficiency of the display device.
  • a data processing method for a display device is provided. As shown in Figure 7 , the method includes the following steps 101 to 108.
  • the control device receives user control instructions.
  • the control device generates target data based on user control instructions.
  • the control device sends the target data to the display device.
  • the display device receives the target data sent by the control device.
  • the display device obtains target information corresponding to the user control instruction based on the target data.
  • the display device sends a reply message to the control device.
  • the reply message is used to indicate that the target data has been received;
  • the control device receives the reply message sent by the display device.
  • the control device generates target data based on user control instructions, and sends the target data to the display device through the CIS link between the control device and the display device.
  • Send target data the display device receives the target data sent by the control device through the CIS link, sends a reply message to the control device (the reply message is used to indicate that the display device has received the target data) and based on the target data (the control device receives the reply message) , obtain the target information corresponding to the user control instruction, and display the target information.
  • the CIS link is based on the ACL link, there are both ACL links and CIS links that can be used for data transmission between the control device and the display device in this solution.
  • ACL link is based on the ACL link, there are both ACL links and CIS links that can be used for data transmission between the control device and the display device in this solution.
  • This solution adds a CIS link on the basis of the ACL link, which can improve the flexibility of data transmission.
  • parallel transmission of data can be achieved. Improve transmission efficiency.
  • step 103 may be implemented through the following step 103a or step 103b.
  • the control device sends the target data to the display device through the CIS link.
  • the control device sends target data to the display device through the CIS link.
  • the target data when the ACL link between the control device and the display device is occupied, the target data is sent to the display device through the CIS link; or, when the user control instruction is a voice control instruction, Send the target data to the display device through the CIS link.
  • the target data when the ACL link is in use, the target data is transmitted through the CIS link, or the voice data that consumes Bluetooth resources is transmitted through the CIS link. Data can be realized. parallel transmission to improve data transmission efficiency.
  • step 103 can be implemented specifically through the following steps 103c to 103i.
  • the control device determines whether there is a CIS link between the control device and the display device.
  • step 103i If there is a CIS link between the control device and the display device, step 103i is executed; otherwise, step 103d is executed.
  • the control device sends a request message to the display device, and the request message is used to request the establishment of the CIS link.
  • the display device receives the request message sent by the control device.
  • the display device sends a response message to the control device according to the request message.
  • the response message is used to indicate agreement to establish the CIS link.
  • the control device receives a response message sent by the display device.
  • the response message is used to indicate that the display device agrees to establish the CIS link.
  • the control device establishes a CIS link between the control device and the display device based on the response message.
  • the control device sends target data to the display device.
  • the control device before the control device sends target data to the display device, the control device first determines whether there is a CIS link between the control device and the display device. If there is a CIS link between the control device and the display device, the control device uses the CIS link, sending target data to the display device, and the display device receives the target data. When there is no CIS link between the control device and the display device, the control device sends a request message to the display device. The request message is used to request the establishment of a CIS link. path; the display device receives the request message and sends a response message to the control device. The response message is used to indicate the agreement to establish the CIS link.
  • the control device receives the response message sent by the display device, and based on the response message, establishes a connection between the control device and the display device.
  • CIS link Send target data to the display device through the CIS link. Therefore, the timing of establishing the CIS link can be flexibly selected. It can be established before the control device communicates with the display device, or it can be established when the CIS link needs to be used.
  • the user control instructions are voice control instructions.
  • the data processing method in the embodiment of the present application also includes the following steps 109, 110 and 110a. That is step 110b.
  • the control device determines whether a new voice control command is received before the timer times out.
  • step 110b If a new voice control instruction is received, step 110b is executed, otherwise step 110a is executed.
  • the user control instruction is a voice control instruction.
  • the display device After the display device receives the reply message sent by the display device through the CIS link, it resets the timer and starts the timer timing; the control device does not receive the message when the timer times out. If a new voice control command is received, the CIS link is disconnected; if a new voice control command is received before the timer times out, the timer is stopped. Because the frequency of users using the voice control instructions of the control device is relatively low, and the CIS link is idle for a long time, it will waste resources. Therefore, by setting a timer, when the timer times out, the control device has not received the user's voice control. command, the CIS link can be disconnected, thereby reducing idle waste of resources.
  • the above step 103 can be implemented through the following step 103j, and the above step 104 can be implemented through the following step 104a.
  • the data processing method also includes the following steps 111 to 113.
  • the control device sends target data to the display device through at least one CIS event on the CIS link, and each CIS event includes at least one CIS sub-event.
  • the display device receives the target data through at least one CIS event on the CIS link.
  • the control device sends an instruction message to the display device.
  • the instruction message is used to indicate that the target data corresponding to the user control instruction has been sent.
  • the display device receives the instruction message sent by the control device.
  • the display device closes the last CIS event among at least one CIS event according to the instruction message.
  • the display device after the display device closes the last CIS event in at least one CIS event, the display device no longer monitors the CIS sub-event of the last CIS event.
  • the control device sends target data to the display device through at least one CIS event on the CIS link, and each CIS event includes at least one CIS sub-event; the display device uses at least one CIS event on the CIS link, After receiving the target data, the display device sends a reply message to the control device. After the control device receives the reply message sent by the display device, the control device sends an instruction message to the display device. The instruction message is used to indicate that the target data corresponding to the user control instruction has been sent. , the display device receives the instruction message, and according to the instruction message, closes the last CIS event in at least one CIS event, so that the display device no longer listens to the CIS sub-event of the last CIS event.
  • the control device receives the reply message from the display device and confirms that the display device has completed receiving the target data. Afterwards, an instruction message is sent to the display device to indicate that the target data corresponding to the user control instruction has been sent and the CIS event can be closed. After receiving the instruction message, the display device closes the current CIS event (i.e., the last CIS event). , so that the display device does not need to monitor the subsequent CIS sub-events of the CIS event, that is, the CIS event ends early. In this way, in the remaining time of the CIS event, resources can be allocated to other operations (such as interacting with other Bluetooth devices) , WiFi data sending and receiving, etc.), thereby saving resources and improving the work efficiency of the display device.
  • the current CIS event i.e., the last CIS event
  • the transmission parameters of the CIS link when the network environment is not congested, are adjusted to the first target parameter; when the network environment is congested, the transmission parameters of the CIS link are adjusted to the second target parameter;
  • the transmission parameters of the CIS link include at least one of the following: burst number (BN), number of subevents (NSE), flush timeout (FT), and the NSE in the first target parameter is greater than The NSE in the second target parameter, the BN in the first target parameter are greater than the BN in the second target parameter, and the FT in the first target parameter is smaller than the FT in the second target parameter.
  • BN is used to indicate the number of different data packets allowed to be sent in a CIS event
  • NSE is used to indicate the maximum number of sub-events allowed to exist in a CIS event
  • FT is used to indicate that the same sub-event is allowed to exist in FT at most. Sent in event.
  • the data transmission rate can be increased by increasing NSE, and/or increasing BN, and/or decreasing FT.
  • PDUs Protocol Data Units
  • the network environment is congested and four PDUs need to be transmitted. Each PDU needs to be sent three times.
  • a maximum of two different packets are allowed to be sent per CIS event.
  • the PDU corresponding to 1 was lost, and the PDU corresponding to 2 was sent 3 times in the second CIS event and received.
  • the PDU corresponding to 3 was sent once in the second CIS event but no response was received, but it could not be sent further in the third CIS event, so the PDU corresponding to 3 was lost. Therefore, the transmission was completed 0, 1, 2,
  • the number of CIS events required for the four PDUs corresponding to 3 is 2 (that is, 2 intervals are required), but the first PDU and the third PDU are both lost, and the packet loss rate is 50%.
  • each CIS sub-event is allowed to be sent in two CIS events, then the PDU corresponding to 0 is sent 3 times and a response is received, and the PDU corresponding to 1 is sent once in the first CIS event. No response was received, and the response was received after sending two more times in the second CIS event. The PDU corresponding to 2 was sent two times in the second CIS event but no response was received. It was continued to be sent once and received in the third CIS event. When the response is received, the PDU corresponding to 3 is sent three times in the third CIS event and the response is received.
  • the number of CIS events required to complete the transmission of the 4 PDUs corresponding to 0, 1, 2, and 3 is 3 (that is, 3 intervals are required ), but all PDUs are transmitted without packet loss; it can be seen that when FT increases from 1 to 2 and the same 4 PDUs are transmitted, the packet loss rate in Figure 14 is 50%. In Figure 15, no packet is lost, which reduces the loss rate. Package rate.
  • the transmission parameters of the CIS link when the network environment is not congested, are adjusted to the first target parameter; when the network environment is congested, the transmission parameters of the CIS link are adjusted to the second target parameter; CIS
  • the transmission parameters of the link include at least one of the following: the number of bursts BN, the number of sub-events NSE, and the refresh timeout FT.
  • the NSE in the first target parameter is greater than the NSE in the second target parameter.
  • the BN in the first target parameter is greater than the NSE in the second target parameter.
  • FT in the first target parameter is smaller than FT in the second target parameter.
  • FIG 17 is a schematic diagram of a display device in an embodiment of the present application.
  • the display device 1700 includes: a display 1730 for displaying images and/or user interfaces from the broadcast system and the network, and a memory 1740 configured to store a computer Instructions and code stream data, communicator, configured to communicate with external devices over the network;
  • the processor 1710 connected to the display 1730, the memory 1740 and the communicator 1720, is configured to execute computer instructions so that the display device: obtains firmware data, divides the firmware data into multiple sub-data, and generates corresponding corresponding sub-data. Broadcast isochronous streaming packets.
  • Firmware data is an upgrade file used for OTA upgrade of the control device and is stored in the display device. Since firmware data usually occupies a large storage space, the firmware data can be divided into multiple sub-data and then each sub-data is transmitted to the control device.
  • this application can fill a single sub-data into a single broadcast isochronous flow data packet (ie, BIS data packet), thereby generating a broadcast isochronous flow data packet corresponding to each sub-data.
  • broadcast isochronous flow data packets can form a broadcast isochronous group data packet
  • multiple broadcast isochronous group data packets can be generated based on multiple broadcast isochronous flow data packets.
  • N N is a positive integer, for example, it can be 2, 3, 4, 5, etc.
  • broadcast isochronous flow data packets can be combined into one broadcast isochronous group data packet. Assume that a total of 15 broadcast isochronous flow data packets are included, and 5 broadcast isochronous flow data packets are used as one broadcast isochronous group data packet, and 3 broadcast isochronous group data packets can be generated.
  • the processor is configured to: broadcast and send multiple broadcast isochronous group data packets, so that one or more control devices obtain firmware data from the broadcast isochronous group data after receiving the broadcast isochronous group data packet, and obtain firmware data according to the broadcast isochronous group data packet.
  • the firmware data can be downloaded over the air to upgrade the control device.
  • the multiple broadcast isochronous group data packets may be broadcast and sent.
  • the plurality of broadcast isochronous group data packets may be broadcast and sent periodically.
  • One or more control devices can receive broadcast isochronous group data packets at the same time.
  • 31 control devices can receive broadcast isochronous group data packets at the same time.
  • the control device After the control device receives multiple broadcast isochronous group data packets, it can obtain firmware data from the broadcast isochronous group data packets to perform OTA upgrades on itself.
  • the control device may be a remote control that communicates with the display device according to a Bluetooth protocol, for example, the technical standard of Low Energy Audio (Low Energy Audio).
  • Low Energy Audio Low Energy Audio
  • the processor 1710 can process each broadcast isochronous stream data packet in sequence. Numbering so that each broadcast isochronous flow packet has sequentially numbered sequence number information. For example, the numbering can start from 0, and the sequence number information of each broadcast isochronous flow data packet is 0, 1, 2, 3... See Figure 18, which is a type of broadcast isochronous group data packet in the embodiment of the present application. Schematic diagram. It can be seen that there are a total of 12 broadcast isochronous flow data packets, and the sequence number information is from 0 to 11.
  • broadcast isochronous flow data packets form a broadcast isochronous group data packet
  • a total of 3 broadcast isochronous groups can be generated. data pack. It can be understood that the number of broadcast isochronous flow data packets contained in a broadcast isochronous group data packet may be uniform or uneven. Here, the uniform case is taken as an example for explanation.
  • the sequence number information of the broadcast isochronous flow data packet can be filled in the broadcast isochronous group data, so that a single broadcast isochronous group data packet includes One or more broadcast isochronous flow data packets and sequence number information of one or more broadcast isochronous flow data packets.
  • the control device receives the broadcast isochronous group data packet, it can determine whether packet loss has occurred based on the sequence number information in the broadcast isochronous group data packet and the received broadcast isochronous flow data packet.
  • the display device only needs to maintain an ACL (Asynchronous Connectionless Link) with any one of one or more control devices, that is, one control device only needs to feedback the packet loss situation to the display device.
  • ACL Asynchronous Connectionless Link
  • the communicator receives the sequence number information of the lost broadcast isochronous flow data packet sent by any control device, and rebroadcasts and sends the broadcast containing the lost broadcast isochronous flow data packet according to the sequence number information of the lost broadcast isochronous flow data packet. time group packets so that one or more control devices receive the missing broadcast isochronous flow packets.
  • control device that maintains an ACL connection with the display device can still receive broadcast isochronous group data packets in the BIS method. At the same time, it will count the lost broadcast isochronous flow packets and store the lost broadcast isochronous flow data in real time. The sequence number information of the packet is fed back to the display device through the ACL link.
  • the processor 1710 is configured to: fill a broadcast isochronous group data packet with the sequence number information of the currently sent first broadcast isochronous flow data packet and the to-be-sent second broadcast isochronous flow data packet. to generate a broadcast isochronous group data packet corresponding to the first broadcast isochronous flow data packet.
  • the control device can grasp the status of the broadcast isochronous flow data packet it receives in real time based on the sequence number information, and determine whether packet loss has occurred, and when loss occurs. packet time, the sequence number information of the lost broadcast isochronous flow data packet, etc.
  • the sequence number information of the first broadcast isochronous flow data packet currently sent is N
  • the sequence number information of the second broadcast isochronous flow data packet to be sent is N+1.
  • the display device displays the broadcast isochronous group data packets currently sent by the device. Includes the first broadcast isochronous stream packet and N+1. After the control device receives the broadcast isochronous group data packet, according to N+1, it can know that the display device has sent N broadcast isochronous flow data packets.
  • N-1 broadcast isochronous flow data packets If it currently receives N-1 broadcast isochronous flow data packets, it can It is determined that packet loss currently occurs, and the sequence number information of the lost broadcast isochronous flow data packet is N; if N broadcast isochronous flow data packets are currently received, it can be determined that no packet loss currently occurs.
  • a pre-transmission mechanism can also be used to reduce the packet loss rate and improve the OTA upgrade success rate.
  • the processor 1710 is configured to: combine the currently sent first broadcast isochronous flow data packet, the sequence number information of the first broadcast isochronous flow data packet, the second broadcast isochronous flow data packet to be sent, and the second broadcast isochronous flow data packet.
  • the sequence number information of the flow data packet is filled into a broadcast isochronous group data packet to generate a broadcast isochronous group data packet corresponding to the first broadcast isochronous flow data packet.
  • a total of 3 broadcast isochronous group data packets are included. If the first broadcast isochronous group data packet is currently sent, then the currently sent first broadcast isochronous flow data packet includes: sequence number information is 0 ⁇ 3
  • the second broadcast isochronous flow data packet to be sent includes: the broadcast isochronous flow data packet with sequence number information 4 to 7.
  • the second broadcast isochronous stream data packet to be sent can be filled into the currently sent first broadcast isochronous group data packet. If the second broadcast isochronous flow data packet to be sent is directly filled into the first broadcast isochronous group data packet, the length of the first broadcast isochronous group data packet will be longer.
  • the first broadcast isochronous flow currently sent can be Data packets are adapted accordingly.
  • the first broadcast isochronous flow data packet may be a broadcast isochronous flow data packet with sequence number information, or may be a broadcast isochronous flow data packet containing two or more sequence number information.
  • broadcast isochronous flow data packets with sequence number information 0 to 1 can be used as the currently sent
  • broadcast isochronous flow data packets with sequence number information 2 to 3 are used as broadcast isochronous flow data packets to be sent.
  • the generated broadcast isochronous group data packet is shown in Figure 19. It can be seen that the broadcast isochronous flow data packet with sequence number information 2 to 3 is not only located in the first broadcast isochronous group data packet, but also in the second broadcast isochronous group data packet, and the broadcast isochronous flow data packet with sequence number information 4 to 5 The isochronous flow packet is not only in the second broadcast isochronous group packet, but also in the third broadcast isochronous group packet, and so on.
  • the broadcast isochronous flow data packet with sequence number information of 2 or 3
  • the broadcast isochronous flow packet can be discarded. If the broadcast isochronous flow packet is not received in the first broadcast isochronous group packet, the broadcast isochronous flow packet can be received from the second broadcast isochronous group packet. If the broadcast isochronous flow data packet is still not received in the second broadcast isochronous group data packet, it means that the broadcast isochronous flow data packet is lost.
  • the currently sent first broadcast isochronous flow data packet can also be repeatedly sent, and the type and quantity of the second broadcast isochronous flow data packet to be sent can be set. That is, the number of first broadcast isochronous flow data packets contained in one broadcast isochronous group data packet is the first preset number, the number of second broadcast isochronous flow data packets included in one broadcast isochronous group data packet is the second preset number, the second broadcast isochronous flow data packet is the second preset number, and the second broadcast isochronous flow data packet is the second preset number.
  • the time flow data packet includes one or more broadcast isochronous flow data packets, that is, the second broadcast isochronous flow data packet can be a broadcast isochronous flow data packet with sequence number information, or it can also contain two or more sequence number information. of broadcast isochronous flow packets.
  • the first preset number and the second preset number are integers greater than 1.
  • the second broadcast isochronous flow data packet can contain two or more broadcast isochronous flow data packets with sequence number information, and broadcast isochronous flow data with a single sequence number information.
  • the number of packages can be one.
  • the first broadcast isochronous flow data packet contains a broadcast isochronous flow data packet with sequence number information.
  • the number of first broadcast isochronous flow data packets can be 2, and the second broadcast isochronous flow data packet can contain two sequence number information. of broadcast isochronous flow data packets, and the number of broadcast isochronous flow data packets of a single sequence number information is one.
  • the generated broadcast isochronous group data packet is shown in Figure 20.
  • Figure 20 shows 4 broadcast isochronous group data packets.
  • the first broadcast isochronous flow data packet currently sent in the first broadcast isochronous group data packet The sequence number information is 0, the sequence number information of the second broadcast isochronous flow data packet to be sent is 1 and 2; the sequence number information of the first broadcast isochronous flow data packet currently sent in the second broadcast isochronous group data packet is 1.
  • the sequence number information of the second broadcast isochronous stream data packet to be sent is 2 and 3, and so on.
  • the remaining broadcast isochronous flow packets exist in 3 broadcast isochronous group packets, and are repeatedly filled in one of the broadcast isochronous group packets, In this way, the packet loss rate can be reduced and the OTA upgrade success rate can be improved.
  • any control device can maintain an ACL connection with the display device, and when packet loss occurs, send the sequence number information of the lost broadcast isochronous flow packet to the display device.
  • broadcast isochronous group data packet 1 broadcast isochronous group data packet 2 and broadcast isochronous group data packet 3 all receive broadcast isochronous flow data packets with sequence number information of 2, the sequence number information can be 2 is sent to the display device.
  • the display device can rebroadcast and send the broadcast isochronous group data packet 3 that has been sent in the broadcast isochronous group data packet 5, that is, the data in the broadcast isochronous group data packet 5 is the same as the data in the broadcast isochronous group data packet 3. .
  • the data in the broadcast isochronous group data packets can be flexibly filled, for example, the broadcast isochronous flow data packets are sequentially numbered, and in the broadcast, etc.
  • the time group data packet is filled with the sequence number information of the broadcast isochronous flow data packet to be sent, so as to inform in advance the sequence number information of the broadcast isochronous flow data packet to be sent.
  • the control device can grasp the status of the broadcast isochronous stream data packets it receives in real time, and determine whether packet loss has occurred and which packets have been lost.
  • the same broadcast isochronous flow data packet is sent repeatedly, and the broadcast isochronous flow data packet that has been sent is supplementary sent to reduce the packet loss rate. And after the control device detects packet loss, it can receive the lost packets by providing feedback to the display device, ensuring the success rate of OTA upgrade.
  • control device 2200 includes:
  • the communicator 2210 is configured to: receive multiple broadcast isochronous group data packets broadcast and sent by the display device, the multiple broadcast isochronous group data packets are generated based on the multiple broadcast isochronous flow data packets, and the single broadcast isochronous flow data packet is based on Single sub-data corresponding to firmware data is generated;
  • the processor 2220 is configured to: obtain firmware data from broadcast isochronous group data, and perform over-the-air download technology upgrades to the control device based on the firmware data.
  • each broadcast isochronous flow data packet has sequentially numbered sequence number information;
  • a single broadcast isochronous group data packet includes one or more broadcast isochronous flow data packets and the sequence numbers of one or more broadcast isochronous flow data packets information;
  • the processor 2220 in any control device is configured to: determine whether packet loss occurs based on the sequence number information and the received broadcast isochronous flow data packet; and, if packet loss occurs, determine the location of the lost broadcast isochronous flow data packet.
  • Serial number information
  • the communicator 2210 in any control device is configured to: send the sequence number information of the lost broadcast isochronous stream data packet to the display device. information, so that the display device re-broadcasts and sends the broadcast isochronous group data packet containing the lost broadcast isochronous flow data packet based on the sequence number information of the lost broadcast isochronous flow data packet;
  • the communicator 2210 in one or more control devices is configured to: receive the broadcast isochronous group data packet containing the lost broadcast isochronous flow data packet to obtain the lost broadcast isochronous flow data packet.
  • the currently received broadcast isochronous group data packet includes: sequence number information of the first broadcast isochronous flow data packet currently sent by the display device and the second broadcast isochronous flow data packet to be sent;
  • the processor 2220 is configured to: determine the first number of broadcast isochronous flow data packets that have been sent by the display device based on the sequence number information of the second broadcast isochronous flow data packet;
  • the lost broadcast isochronous flow data packet is the first broadcast isochronous flow data packet.
  • the currently received broadcast isochronous group data packet includes: the first broadcast isochronous flow data packet currently sent by the display device, the first sequence number information of the first broadcast isochronous flow data packet, and the first broadcast isochronous flow data packet to be sent by the display device.
  • the second broadcast isochronous flow data packet and the second sequence number information of the second broadcast isochronous flow data packet includes: the first broadcast isochronous flow data packet currently sent by the display device, the first sequence number information of the first broadcast isochronous flow data packet, and the first broadcast isochronous flow data packet to be sent by the display device.
  • the processor 2220 is configured to: if no broadcast isochronous flow data packet with the second sequence number information is received in neither the currently received broadcast isochronous group data packet nor the to-be-received broadcast isochronous group data packet, determine The broadcast isochronous flow data packet with the second sequence number information is lost;
  • the number of first broadcast isochronous flow data packets is a first preset number
  • the number of second broadcast isochronous flow data packets is a second preset number
  • the second broadcast isochronous flow data packet includes one or
  • the first preset number and the second preset number are integers greater than 1.
  • FIG 22 shows an embodiment on the control device side. The specific details have been described in detail on the display device side, so they will not be described again here.
  • Figure 23 is a flow chart of an OTA upgrade method in an embodiment of the present application. It is applied to a display device and may include the following steps:
  • Step S2310 Obtain firmware data, divide the firmware data into multiple sub-data, and generate broadcast isochronous flow data packets corresponding to each sub-data.
  • Step S2320 Generate multiple broadcast isochronous group data packets based on multiple broadcast isochronous flow data packets.
  • Step S2330 Broadcast and send multiple broadcast isochronous group data packets, so that one or more control devices obtain firmware data from the broadcast isochronous group data after receiving the broadcast isochronous group data packet, and control the control device according to the firmware data.
  • the equipment undergoes over-the-air technology upgrades.
  • each broadcast isochronous flow data packet has sequentially numbered sequence number information; a single broadcast isochronous group data packet includes one or more broadcast isochronous flow data packets and the sequence numbers of one or more broadcast isochronous flow data packets information; methods also include:
  • sequence number information of the lost broadcast isochronous flow data packet sent by any control device; the sequence number information of the lost broadcast isochronous flow data packet is based on the sequence number information in the broadcast isochronous group data packet and the received broadcast isochronous flow Packet OK;
  • sequence number information of the lost broadcast isochronous flow data packet rebroadcast and send the broadcast isochronous group data packet containing the lost broadcast isochronous flow data packet, so that one or more control devices receive the lost broadcast isochronous flow data Bag.
  • the number of first broadcast isochronous flow data packets is a first preset number
  • the number of second broadcast isochronous flow data packets is a second preset number
  • the second broadcast isochronous flow data packet includes one or
  • the first preset number and the second preset number are integers greater than 1.
  • Figure 24 is a flow chart of an OTA upgrade method in an embodiment of the present application. When applied to a control device, it may include the following steps:
  • Step S2410 Receive multiple broadcast isochronous group data packets broadcast and sent by the display device.
  • the multiple broadcast isochronous group data packets are generated based on multiple broadcast isochronous flow data packets.
  • a single broadcast isochronous flow data packet is based on a single broadcast isochronous flow data packet corresponding to the firmware data. Subdata generation.
  • Step S2420 Obtain firmware data from the broadcast isochronous group data, and perform over-the-air download technology upgrades on the control device based on the firmware data.
  • each broadcast isochronous flow data packet has sequentially numbered sequence number information; a single broadcast isochronous group data packet includes one or more broadcast isochronous flow data packets and the sequence numbers of one or more broadcast isochronous flow data packets information; methods also include:
  • Any control device determines whether packet loss has occurred based on the sequence number information and the received broadcast isochronous flow data packet; and, if packet loss occurs, determines the sequence number information of the lost broadcast isochronous flow data packet and sends the lost broadcast to the display device The sequence number information of the isochronous flow data packet, so that the display device re-broadcasts and sends the broadcast isochronous group data packet containing the lost broadcast isochronous flow data packet according to the sequence number information of the lost broadcast isochronous flow data packet;
  • One or more control devices receive the broadcast isochronous group packet containing the lost broadcast isochronous flow packet to obtain the lost broadcast isochronous flow packet.
  • the currently received broadcast isochronous group data packet includes: sequence number information of the first broadcast isochronous flow data packet currently sent by the display device and the second broadcast isochronous flow data packet to be sent;
  • the lost broadcast isochronous flow data packet is the first broadcast isochronous flow data packet.
  • the currently received broadcast isochronous group data packet includes: the first broadcast isochronous flow data packet currently sent by the display device, the first sequence number information of the first broadcast isochronous flow data packet, and the first broadcast isochronous flow data packet to be sent by the display device.
  • the second broadcast isochronous flow data packet and the second sequence number information of the second broadcast isochronous flow data packet includes: the first broadcast isochronous flow data packet currently sent by the display device, the first sequence number information of the first broadcast isochronous flow data packet, and the first broadcast isochronous flow data packet to be sent by the display device.
  • broadcast isochronous flow data packet with the second sequence number information If the broadcast isochronous flow data packet with the second sequence number information is not received in the currently received broadcast isochronous group data packet and the to-be-received broadcast isochronous group data packet, then determine the broadcast isochronous flow data packet with the second sequence number information. Packet loss occurs when streaming data packets occur;
  • the number of first broadcast isochronous flow data packets is a first preset number
  • the number of second broadcast isochronous flow data packets is a second preset number
  • the second broadcast isochronous flow data packet includes one or
  • the first preset number and the second preset number are integers greater than 1.
  • the display device receives the mode switching instruction.
  • the mode switching instruction is used to switch the Bluetooth connection mode between the display device and the control device to a multi-connection mode.
  • the multi-connection mode is a Bluetooth connection mode in which one control device connects to multiple display devices.
  • Bluetooth SIG Bluetooth SIG
  • Low Energy Audio Low Energy Audio
  • the implementation of the display device receiving the mode switching instruction includes: the display device first displays the connection mode selection interface 261 in response to the user operation, and the connection mode selection interface 261 includes: "Prohibit connection”, “Multiple connection mode” and “single connection mode” are available for the user to choose.
  • the user inputs a selection operation for "multiple connection mode" it can be determined that the display device has received the mode switching instruction.
  • the display device determines the current Bluetooth connection mode and the connection status with the control device.
  • the determination results in the above step S2502 may include the following:
  • the current Bluetooth connection mode of the display device is to prohibit Bluetooth connection with the control device.
  • the current Bluetooth connection mode of the display device is single connection mode, but no Bluetooth connection link has been established with the control device.
  • the current Bluetooth connection mode of the display device is single connection mode, and the first link is established with the first control device.
  • the current Bluetooth connection mode of the display device is multi-connection mode, but no Bluetooth connection link has been established with the control device.
  • the current Bluetooth connection mode of the display device is multi-connection mode, and a Bluetooth connection link has been established with the control device.
  • step S2502 if the determination result is result 3 (the display device and the first control device have established a first link, and the first link is a Bluetooth connection link established in the single connection mode), then the control method of the display device provided by the embodiment of the present application continues to execute the following steps S2503 and S2504:
  • the display device sends a control instruction to the first control device through the first link.
  • the first control device receives the control instruction sent by the display device through the first link.
  • control instruction is used to instruct the first control device to enter the multi-connection mode.
  • the first link may be a Bluetooth Low Energy (BLE) link established based on the Generic Attribute Profile (GATT).
  • BLE Bluetooth Low Energy
  • the first control device determines whether it supports the multi-connection mode.
  • step S2504 if the first control device does not support the multi-connection mode, the process of the control method of the display device provided by the embodiment of the present application ends. If the first control device supports the multi-connection mode, the present application The control method of the display device provided by the embodiment continues to execute the following steps S2505 to S2510:
  • the first control device sends confirmation information to the display device through the first link.
  • the display device receives the confirmation information sent by the first control device through the first link.
  • the display device disconnects the first link.
  • the display device actively disconnects the Bluetooth connection link established with the first control device in the single connection mode.
  • the display device enters the multi-connection mode.
  • the display device converts the role in the Bluetooth connection relationship to the receiver (Acceptor), and does the work to establish a Bluetooth connection link with the initiator as one of the multiple receivers connected to the initiator via Bluetooth. Be prepared.
  • the first control device enters the multi-connection mode.
  • the first control device converts the role in the Bluetooth connection relationship to the initiator (Initiator), and is prepared to establish Bluetooth connection links with multiple receivers as the initiator (Initiator).
  • the first control device sends a connection request to the display device.
  • the display device receives the connection request sent by the first control device.
  • the first control device may send the connection request in a broadcast manner to send the connection request to the display device.
  • the display device may first perform steps S2506 and S2507, and then the first control device may perform step S2508, or the first control device may first perform the steps S2506 and S2507.
  • Step S2508 is executed, and then the display device executes steps S2506 and S2507.
  • the display device and the first control device may also execute step S2508 synchronously.
  • the display device establishes a second link with the first control device in the multi-connection mode.
  • the first control device establishes a second link with the display device in the multi-connection mode.
  • the second link may be a Connected Isochronous Streams (CIS) link established based on the Low Energy Audio (LE Audio, LE Audio) technical standard.
  • CIS Connected Isochronous Streams
  • the implementation process of establishing the second link between the first control device and the display device may include the following steps a to step d:
  • Step a The first control device sends a connection establishment request to the display device.
  • the display device receives the establishment request.
  • the establishment request is used to request the establishment of an isochronous channel connection.
  • Step b The display device establishes an isochronous channel connection with the first control device in response to the connection establishment request.
  • Step c An ACL (Indicates a low level) link is established between the first control device and the display device.
  • Step d Establish a GATT link or an EATT link between the first control device and the display device.
  • Step e Send interaction instructions.
  • the display device control method When receiving a mode switching instruction to switch the Bluetooth connection mode between the display device and the control device to the multi-connection mode, the display device control method provided by the embodiment of the present application first determines whether the display device is in the single connection mode.
  • a Bluetooth connection link is established with the control device, and a first link is established between the display device and the first control device, and the first link is a Bluetooth connection link established in single connection mode.
  • sending a control instruction instructing the first control device to enter the multi-connection mode to the first control device through the first link and receiving the control instruction sent by the first control device through the first link.
  • disconnect the first link After receiving the confirmation information, disconnect the first link, enter the multi-connection mode, and respond to the connection request sent by the first control device, conduct the communication with the first control device in the multi-connection mode.
  • Embodiments of the present application can connect multiple display devices through one control device and control multiple display devices at the same time without having to control the display devices individually one-to-one through the control device. Therefore, embodiments of the present application can include multiple display devices. It simplifies the operation of controlling multiple display devices in scenarios and solves the problem that one-to-one control of display devices will be very cumbersome.
  • step S271 the control method of the display device provided by the embodiment of the present application is as follows step S271:
  • the display device sends link information to the first control device through the first link.
  • the first control device receives the link information sent by the display device through the first link.
  • the link information includes information about the display device that the control device needs to use during the process of establishing the second link.
  • the link information may include the media access control address (MAC address) of the display device, the Bluetooth device address (BD_ADDR), the system clock used to generate the device access code (Device Access Code), the user Information such as normal and synchronization mode device categories, device names, supported service classes, etc. used to establish links.
  • MAC address media access control address
  • BD_ADDR Bluetooth device address
  • Device Access Code the system clock used to generate the device access code
  • user Information such as normal and synchronization mode device categories, device names, supported service classes, etc. used to establish links.
  • the above step S2509 (the first control device sends a connection request to the display device) includes: sending a connection request to the display device based on the link information.
  • the device sends a connection request.
  • step S2510 (the first control device establishes the second link with the control device in the multi-connection mode) includes: based on the link information, establishes the second link with the display device in the multi-connection mode. Perform establishment of the second link.
  • the display device before disconnecting the first link, the display device sends link information to the first control device through the first link, so the first control device can directly use the link information Quickly establish a second link with the display device, thereby switching the Bluetooth connection link between the display device and the first control device from the first link to the second link without the user being aware of it.
  • Figure 28 exemplarily shows a schematic flowchart of the control method of the display device provided by the embodiment of the present application.
  • the control method of the display device provided by the embodiment of the present application includes the following steps:
  • the display device receives the mode switching instruction.
  • the display device determines the current Bluetooth connection mode and the connection status with the control device.
  • the determination results in the above step S2802 may include the following:
  • the current Bluetooth connection mode of the display device is to prohibit Bluetooth connection with the control device, and no Bluetooth connection has been established with any control device.
  • the current Bluetooth connection mode of the display device is single connection mode, but no Bluetooth connection link has been established with the control device.
  • the current Bluetooth connection mode of the display device is single connection mode, and the first link is established with the first control device.
  • the current Bluetooth connection mode of the display device is multi-connection mode, but no Bluetooth connection link has been established with the control device.
  • the current Bluetooth connection mode of the display device is multi-connection mode, and a Bluetooth connection link has been established with the control device.
  • step S2802 if the determination result is result 1 (the current Bluetooth connection mode of the display device is to prohibit Bluetooth connection with the control device) or 2 (the current Bluetooth connection mode of the display device is single connection mode, but no Bluetooth connection is established with the control device) connection link), then the control method of the display device provided by the embodiment of the present application continues to perform the following steps S2803 and S2804:
  • the display device enters the multi-connection mode.
  • the display device converts the role in the Bluetooth connection relationship to the receiver (Acceptor), and does the work to establish a Bluetooth connection link with the initiator as one of the multiple receivers connected to the initiator via Bluetooth. Be prepared.
  • the second control device sends a connection request to the display device.
  • the display device receives the connection request sent by the second control device.
  • the second control device may send the connection request in a broadcast manner to send the connection request to the display device.
  • the implementation method of triggering the second control device to send the connection request in a broadcast manner may be the same as the embodiment shown in FIG. 25 .
  • the display device establishes a second link with the second control device in the multi-connection mode.
  • the second control device establishes a second link with the display device in the multi-connection mode.
  • the determination result in the above step S2502 or S2802 may also be the above result 4 (the current Bluetooth connection mode of the display device is multi-connection mode, but a Bluetooth connection chain is not established with the control device. Road) Result 5 (the current Bluetooth connection mode of the display device is multi-connection mode, and a Bluetooth connection link has been established with the control device).
  • the result may also be the above Result 4 or Result 5, because the current Bluetooth connection mode of the display device The multi-connection mode has been entered, so the received mode switching command can be ignored and the mode switching command directly waits and received.
  • control method of the display device provided by the embodiment of the present application also includes :
  • the display device sends the value code table of the display device to the control device through the second link.
  • the first control device or the second control device receives the value code table of the display device sent by the display device through the second link.
  • the value code table includes a code value corresponding to at least one operation instruction of the display device.
  • the display device sends the value code table of the display device to the control device through the second link, which means that when the display device establishes the second link with the first control device, the display device The device sends the value code table of the display device to the first control device through the second link.
  • the display device transmits the value code table to the first control device through the second link.
  • the second link sends the value code table of the display device to the second control device.
  • the display device has established a second link with the first control device, so the above step S2901 includes: the display device sends the value of the display device to the first control device through the second link.
  • the code table, and the first control device receives the value code table of the display device sent by the display device through the second link.
  • step S2901 includes: the display device sends the value of the display device to the second control device through the second link.
  • the code table, and the second control device receives the value code table of the display device sent by the display device through the second link.
  • the value code table of the display device can be as shown in Table 1 below:
  • the control device receives the operation instruction input by the user.
  • the user can operate the keys of the control device, so that the control device receives operation instructions input by the user.
  • the user may also input operation instructions to the control device through gravity changes, voice input, presence and absence input, etc., so that the control device receives the operation instructions input by the user.
  • the control device (the first control device or the second control device) obtains the code value corresponding to the operation instruction according to the value code table of the display device.
  • step S2903 will be explained by taking the following example where the control device is connected to two display devices (display device A and display device B) via Bluetooth.
  • code value table of display device A is shown in Table 1 above, and the code value table of display device A is shown in Table 2 below:
  • the control device sends the code value corresponding to the operation instruction to the display device.
  • the display device receives the code value sent by the control device (the first control device or the second control device) through the second link device.
  • the control device has two display devices (display device A and display device B) connected via Bluetooth, and the value code table of display device A is as shown in Table 1 above, and the value code table of display device B is as shown in Table 2 above.
  • the display device obtains the operation instruction corresponding to the code value according to the value code table of the display device.
  • both display device A and display device B can obtain the operation command corresponding to the received code value as "shutdown”.
  • the control device receives the operation command input by the user as "volume + "
  • the value code received by display device A is "0000”
  • the value code received by display device A is "1111”.
  • both display device A and display device B can The operation command corresponding to the received code value is "volume +".
  • the display device executes the operation instruction corresponding to the code value.
  • the display device first sends a value code table including code values corresponding to at least one operation instruction of the display device to the display device.
  • the control device receives the control instruction input by the user, it can control the display device according to the value of each display device.
  • the code table sends the code values corresponding to the control instructions to each display device. Therefore, the above embodiment can control the display device to perform the same control operation through different code values when the control device receives the control instructions input by the user.
  • FIG. 30 Exemplarily, refer to Figure 30.
  • the opposite end of the second link is set as the control device.
  • the control device is Bluetooth connected to display device A and display device B.
  • the value code tables of display device A and display device B are Take Table 1 and Table 2 above as examples to illustrate, as shown in Figure 30
  • the control methods of the display device include:
  • Display device A sends the value code table shown in Table 1 to the control device.
  • control device receives the value code table shown in Table 1 sent by the display device A.
  • Display device B sends the value code table shown in Table 2 to the control device.
  • control device receives the value code table shown in Table 2 sent by display device B.
  • the control device receives the operation command "volume +" input by the user.
  • the control device determines the code value "0000" according to the value code table shown in Table 1.
  • the control device sends the code value "0000" to the display device A.
  • display device A receives the code value "0000" sent by the control device.
  • Display device A determines the operation command "volume +" according to the value code table shown in Table 1 and the code value "0000".
  • the control device determines the code value "1111" according to the value code table shown in Table 2.
  • the control device sends the code value “1111” to display device B.
  • display device B receives the code value "1111" sent by the control device.
  • Display device B determines the operation command "volume +" according to the value code table shown in Table 2 and the code value "1111".
  • Display device B executes the operation command "volume +".
  • Embodiments of the present invention also provide a computer-readable non-volatile storage medium.
  • a computer program is stored on the computer-readable storage medium.
  • the computer program When the computer program is executed by a processor, the computer program implements various processes executed by the above data processing method, and can To achieve the same technical effect, to avoid repetition, we will not repeat them here.
  • the computer-readable storage medium can be read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk, etc.
  • the present invention provides a computer program product, which includes: when the computer program product is run on a computer, the computer implements the above data processing method.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

La présente divulgation concerne un appareil d'affichage et un procédé de traitement de données, qui sont appliqués au domaine technique du Bluetooth. L'appareil d'affichage comprend : une unité d'affichage, un dispositif de communication, une mémoire et un processeur. Le processeur est configuré pour exécuter une instruction informatique dans la mémoire de façon à permettre à l'appareil d'affichage de : recevoir, au moyen d'une liaison de flux isochrone connectée (CIS) entre l'appareil d'affichage et un appareil de commande, des données cibles envoyées par l'appareil de commande, les données cibles étant générées par l'appareil de commande selon une instruction de commande d'utilisateur reçue ; envoyer un message de réponse à l'appareil de commande au moyen de la liaison CIS, le message de réponse étant utilisé pour représenter le fait que les données cibles sont reçues ; et obtenir, sur la base des données cibles, des informations cibles correspondant à l'instruction de commande d'utilisateur. L'unité d'affichage est configurée pour afficher les informations cibles. La flexibilité de transmission de données peut être améliorée, et lorsqu'une pluralité d'éléments de données doivent être transmis, une transmission de données parallèle peut être réalisée, de telle sorte que l'efficacité de transmission est améliorée.
PCT/CN2023/088758 2022-06-30 2023-04-17 Appareil d'affichage et procédé de traitement de données WO2024001435A1 (fr)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
CN202210771143.7A CN115278928A (zh) 2022-06-30 2022-06-30 一种显示设备、控制设备和数据传输方法
CN202210771127.8 2022-06-30
CN202210770347.9A CN115278322A (zh) 2022-06-30 2022-06-30 显示设备、控制设备及显示设备的控制方法
CN202210770347.9 2022-06-30
CN202210771143.7 2022-06-30
CN202210771127.8A CN115175156A (zh) 2022-06-30 2022-06-30 蓝牙设备及空中下载技术升级方法

Publications (1)

Publication Number Publication Date
WO2024001435A1 true WO2024001435A1 (fr) 2024-01-04

Family

ID=89383146

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/088758 WO2024001435A1 (fr) 2022-06-30 2023-04-17 Appareil d'affichage et procédé de traitement de données

Country Status (1)

Country Link
WO (1) WO2024001435A1 (fr)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190349718A1 (en) * 2016-10-21 2019-11-14 Lg Electronics Inc. Method and device for transmitting and receiving data using bluetooth technology
CN111869142A (zh) * 2020-02-20 2020-10-30 深圳市汇顶科技股份有限公司 数据传输方法、装置、设备、系统及介质
CN112640505A (zh) * 2018-12-22 2021-04-09 华为技术有限公司 一种传输速率的控制方法及设备
CN113346982A (zh) * 2021-05-31 2021-09-03 合肥中感微电子有限公司 数据传输方法、发送方法、接收方法及装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190349718A1 (en) * 2016-10-21 2019-11-14 Lg Electronics Inc. Method and device for transmitting and receiving data using bluetooth technology
CN112640505A (zh) * 2018-12-22 2021-04-09 华为技术有限公司 一种传输速率的控制方法及设备
CN111869142A (zh) * 2020-02-20 2020-10-30 深圳市汇顶科技股份有限公司 数据传输方法、装置、设备、系统及介质
CN113346982A (zh) * 2021-05-31 2021-09-03 合肥中感微电子有限公司 数据传输方法、发送方法、接收方法及装置

Similar Documents

Publication Publication Date Title
CN102595239B (zh) 一种终端系统的多屏互动方法、装置及智能电视机
US8698702B2 (en) Image displaying system, image displaying device, image data outputting device, image displaying method, image displaying program, and image data outputting program
CN112350981B (zh) 一种切换通信协议的方法、装置和系统
EP3554109A1 (fr) Procédé d'établissement de communication, et terminal
US9307375B2 (en) Methods for connecting devices and devices using the same
CN111654742B (zh) 一种远程智能联动投屏方法及系统
US8973074B2 (en) Method and system for isochronous communication in audio/video networks
KR100922116B1 (ko) 멀티 디스플레이 장치 통합 시스템 및 그 방법
WO2021169965A1 (fr) Procédé de rapport d'état de mémoire cache, dispositif terminal de relais et support de stockage lisible par ordinateur
KR20110059202A (ko) 단말 장치 및 그의 ｕｓｂ 기기 제어 방법
US20180262801A1 (en) Method and device for changing orientation of image by wfd sink
CN115209192A (zh) 一种显示设备、智能设备和摄像头共享方法
US20240089526A1 (en) Method for playback in split screen and display device
WO2024001435A1 (fr) Appareil d'affichage et procédé de traitement de données
WO2022077503A1 (fr) Procédé, appareil et système de projection sur écran sans fil
CN115665707A (zh) 显示设备及数据传输方法
CN115175156A (zh) 蓝牙设备及空中下载技术升级方法
CN115278928A (zh) 一种显示设备、控制设备和数据传输方法
WO2024001535A1 (fr) Dispositif d'affichage, dispositif de lecture, dispositif de commande et procédé de transmission de données
CN115914694A (zh) 一种显示设备、及基于usb链路的网络连接方法
CN114697876B (zh) 一种局域网投屏方法、装置和电子设备
WO2022142496A1 (fr) Dispositif d'affichage, dispositif externe, procédé de commutation de mode de fonctionnement pour dispositif externe et procédé de commande vocale en champ lointain
CN116193191A (zh) 多路投屏方法、多路投屏装置及显示设备
CN115278322A (zh) 显示设备、控制设备及显示设备的控制方法
CN115988248A (zh) 显示设备及蓝牙通信方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23829625

Country of ref document: EP

Kind code of ref document: A1